[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:10:48.828817 28234 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.27.146.190:37105
I20260709 13:10:48.830862 28234 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:10:48.832208 28234 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:48.855545 28243 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:48.856240 28241 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:48.857789 28234 server_base.cc:1061] running on GCE node
W20260709 13:10:48.855803 28240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:50.071601 28234 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:50.071911 28234 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:50.072150 28234 hybrid_clock.cc:648] HybridClock initialized: now 1783602650072124 us; error 0 us; skew 500 ppm
I20260709 13:10:50.073048 28234 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:50.079176 28234 webserver.cc:533] Webserver started at http://127.27.146.190:35319/ using document root <none> and password file <none>
I20260709 13:10:50.080168 28234 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:50.080435 28234 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:50.080930 28234 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:50.086993 28234 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602648606606-28234-0/minicluster-data/master-0-root/instance:
uuid: "e46dd153599d44469f72e9e95ac5a404"
format_stamp: "Formatted at 2026-07-09 13:10:50 on dist-test-slave-clfv"
I20260709 13:10:50.095294 28234 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:10:50.101300 28249 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:50.103045 28234 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.003s
I20260709 13:10:50.103549 28234 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602648606606-28234-0/minicluster-data/master-0-root
uuid: "e46dd153599d44469f72e9e95ac5a404"
format_stamp: "Formatted at 2026-07-09 13:10:50 on dist-test-slave-clfv"
I20260709 13:10:50.103942 28234 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602648606606-28234-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602648606606-28234-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602648606606-28234-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:50.156005 28234 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:50.157627 28234 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:10:50.158157 28234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:50.240481 28234 rpc_server.cc:307] RPC server started. Bound to: 127.27.146.190:37105
I20260709 13:10:50.240757 28300 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.146.190:37105 every 8 connection(s)
I20260709 13:10:50.249943 28301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:50.277580 28301 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e46dd153599d44469f72e9e95ac5a404: Bootstrap starting.
I20260709 13:10:50.285058 28301 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e46dd153599d44469f72e9e95ac5a404: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:50.287369 28301 log.cc:826] T 00000000000000000000000000000000 P e46dd153599d44469f72e9e95ac5a404: Log is configured to *not* fsync() on all Append() calls
I20260709 13:10:50.293488 28301 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e46dd153599d44469f72e9e95ac5a404: No bootstrap required, opened a new log
I20260709 13:10:50.316458 28301 raft_consensus.cc:359] T 00000000000000000000000000000000 P e46dd153599d44469f72e9e95ac5a404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e46dd153599d44469f72e9e95ac5a404" member_type: VOTER }
I20260709 13:10:50.317122 28301 raft_consensus.cc:385] T 00000000000000000000000000000000 P e46dd153599d44469f72e9e95ac5a404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:50.317334 28301 raft_consensus.cc:740] T 00000000000000000000000000000000 P e46dd153599d44469f72e9e95ac5a404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e46dd153599d44469f72e9e95ac5a404, State: Initialized, Role: FOLLOWER
I20260709 13:10:50.318329 28301 consensus_queue.cc:260] T 00000000000000000000000000000000 P e46dd153599d44469f72e9e95ac5a404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e46dd153599d44469f72e9e95ac5a404" member_type: VOTER }
I20260709 13:10:50.318853 28301 raft_consensus.cc:399] T 00000000000000000000000000000000 P e46dd153599d44469f72e9e95ac5a404 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:50.319120 28301 raft_consensus.cc:493] T 00000000000000000000000000000000 P e46dd153599d44469f72e9e95ac5a404 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:50.319435 28301 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e46dd153599d44469f72e9e95ac5a404 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:50.324404 28301 raft_consensus.cc:515] T 00000000000000000000000000000000 P e46dd153599d44469f72e9e95ac5a404 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e46dd153599d44469f72e9e95ac5a404" member_type: VOTER }
I20260709 13:10:50.325356 28301 leader_election.cc:304] T 00000000000000000000000000000000 P e46dd153599d44469f72e9e95ac5a404 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e46dd153599d44469f72e9e95ac5a404; no voters: 
I20260709 13:10:50.327399 28301 leader_election.cc:290] T 00000000000000000000000000000000 P e46dd153599d44469f72e9e95ac5a404 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:50.327987 28304 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e46dd153599d44469f72e9e95ac5a404 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:50.331066 28304 raft_consensus.cc:697] T 00000000000000000000000000000000 P e46dd153599d44469f72e9e95ac5a404 [term 1 LEADER]: Becoming Leader. State: Replica: e46dd153599d44469f72e9e95ac5a404, State: Running, Role: LEADER
I20260709 13:10:50.332171 28304 consensus_queue.cc:237] T 00000000000000000000000000000000 P e46dd153599d44469f72e9e95ac5a404 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e46dd153599d44469f72e9e95ac5a404" member_type: VOTER }
I20260709 13:10:50.333520 28301 sys_catalog.cc:565] T 00000000000000000000000000000000 P e46dd153599d44469f72e9e95ac5a404 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:50.346767 28305 sys_catalog.cc:455] T 00000000000000000000000000000000 P e46dd153599d44469f72e9e95ac5a404 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e46dd153599d44469f72e9e95ac5a404" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e46dd153599d44469f72e9e95ac5a404" member_type: VOTER } }
I20260709 13:10:50.346606 28306 sys_catalog.cc:455] T 00000000000000000000000000000000 P e46dd153599d44469f72e9e95ac5a404 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e46dd153599d44469f72e9e95ac5a404. Latest consensus state: current_term: 1 leader_uuid: "e46dd153599d44469f72e9e95ac5a404" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e46dd153599d44469f72e9e95ac5a404" member_type: VOTER } }
I20260709 13:10:50.347596 28306 sys_catalog.cc:458] T 00000000000000000000000000000000 P e46dd153599d44469f72e9e95ac5a404 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:50.347451 28305 sys_catalog.cc:458] T 00000000000000000000000000000000 P e46dd153599d44469f72e9e95ac5a404 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:50.355129 28313 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:50.368732 28313 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:50.373175 28234 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:50.390331 28313 catalog_manager.cc:1383] Generated new cluster ID: e2290c56d200408096997f773cc43210
I20260709 13:10:50.390753 28313 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:50.413210 28313 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:50.415481 28313 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:50.433069 28313 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e46dd153599d44469f72e9e95ac5a404: Generated new TSK 0
I20260709 13:10:50.434159 28313 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:50.440477 28234 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:50.450780 28323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:50.452661 28324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:50.458726 28326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:50.460186 28234 server_base.cc:1061] running on GCE node
I20260709 13:10:50.461283 28234 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:50.461578 28234 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:50.461791 28234 hybrid_clock.cc:648] HybridClock initialized: now 1783602650461769 us; error 0 us; skew 500 ppm
I20260709 13:10:50.462646 28234 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:50.467303 28234 webserver.cc:533] Webserver started at http://127.27.146.129:35021/ using document root <none> and password file <none>
I20260709 13:10:50.468096 28234 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:50.468371 28234 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:50.468740 28234 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:50.470367 28234 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602648606606-28234-0/minicluster-data/ts-0-root/instance:
uuid: "1a5a33ca0108455c9cd1358bf0e50943"
format_stamp: "Formatted at 2026-07-09 13:10:50 on dist-test-slave-clfv"
I20260709 13:10:50.477754 28234 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:10:50.483384 28331 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:50.484762 28234 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.002s
I20260709 13:10:50.485175 28234 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602648606606-28234-0/minicluster-data/ts-0-root
uuid: "1a5a33ca0108455c9cd1358bf0e50943"
format_stamp: "Formatted at 2026-07-09 13:10:50 on dist-test-slave-clfv"
I20260709 13:10:50.485569 28234 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602648606606-28234-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602648606606-28234-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602648606606-28234-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:50.524019 28234 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:50.525894 28234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:50.530098 28234 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:50.535722 28234 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:50.536057 28234 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:50.536372 28234 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:50.536566 28234 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:50.672979 28234 rpc_server.cc:307] RPC server started. Bound to: 127.27.146.129:36037
I20260709 13:10:50.673099 28393 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.146.129:36037 every 8 connection(s)
I20260709 13:10:50.683344 28234 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:50.693948 28398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:50.696085 28399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:50.710623 28234 server_base.cc:1061] running on GCE node
W20260709 13:10:50.710754 28401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:50.712713 28234 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:50.713095 28234 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:50.713335 28234 hybrid_clock.cc:648] HybridClock initialized: now 1783602650713310 us; error 0 us; skew 500 ppm
I20260709 13:10:50.714226 28234 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:50.715715 28394 heartbeater.cc:344] Connected to a master server at 127.27.146.190:37105
I20260709 13:10:50.716342 28394 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:50.717747 28394 heartbeater.cc:507] Master 127.27.146.190:37105 requested a full tablet report, sending...
I20260709 13:10:50.718541 28234 webserver.cc:533] Webserver started at http://127.27.146.130:42553/ using document root <none> and password file <none>
I20260709 13:10:50.719234 28234 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:50.719538 28234 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:50.719882 28234 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:50.721259 28234 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602648606606-28234-0/minicluster-data/ts-1-root/instance:
uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
format_stamp: "Formatted at 2026-07-09 13:10:50 on dist-test-slave-clfv"
I20260709 13:10:50.722113 28266 ts_manager.cc:194] Registered new tserver with Master: 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037)
I20260709 13:10:50.725363 28266 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56558
I20260709 13:10:50.729035 28234 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.004s
I20260709 13:10:50.735810 28406 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:50.737447 28234 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.001s
I20260709 13:10:50.737838 28234 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602648606606-28234-0/minicluster-data/ts-1-root
uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
format_stamp: "Formatted at 2026-07-09 13:10:50 on dist-test-slave-clfv"
I20260709 13:10:50.738211 28234 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602648606606-28234-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602648606606-28234-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602648606606-28234-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:50.772140 28234 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:50.774641 28234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:50.779174 28234 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:50.783880 28234 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:50.784227 28234 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:50.784603 28234 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:50.784853 28234 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:50.923907 28234 rpc_server.cc:307] RPC server started. Bound to: 127.27.146.130:40891
I20260709 13:10:50.924089 28468 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.146.130:40891 every 8 connection(s)
I20260709 13:10:50.935221 28234 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:50.947710 28472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:50.948176 28469 heartbeater.cc:344] Connected to a master server at 127.27.146.190:37105
I20260709 13:10:50.948855 28469 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:50.950459 28469 heartbeater.cc:507] Master 127.27.146.190:37105 requested a full tablet report, sending...
W20260709 13:10:50.953945 28473 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:50.954138 28266 ts_manager.cc:194] Registered new tserver with Master: b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130:40891)
I20260709 13:10:50.956946 28266 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56560
I20260709 13:10:50.964417 28234 server_base.cc:1061] running on GCE node
W20260709 13:10:50.965102 28475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:50.966444 28234 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:50.966804 28234 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:50.967036 28234 hybrid_clock.cc:648] HybridClock initialized: now 1783602650967014 us; error 0 us; skew 500 ppm
I20260709 13:10:50.968096 28234 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:50.971463 28234 webserver.cc:533] Webserver started at http://127.27.146.131:38519/ using document root <none> and password file <none>
I20260709 13:10:50.972239 28234 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:50.972527 28234 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:50.972865 28234 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:50.974434 28234 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602648606606-28234-0/minicluster-data/ts-2-root/instance:
uuid: "efb7184756dd41928c127a50037e3672"
format_stamp: "Formatted at 2026-07-09 13:10:50 on dist-test-slave-clfv"
I20260709 13:10:50.981208 28234 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:10:50.986078 28480 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:50.987073 28234 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:10:50.987370 28234 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602648606606-28234-0/minicluster-data/ts-2-root
uuid: "efb7184756dd41928c127a50037e3672"
format_stamp: "Formatted at 2026-07-09 13:10:50 on dist-test-slave-clfv"
I20260709 13:10:50.987779 28234 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602648606606-28234-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602648606606-28234-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602648606606-28234-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:51.001559 28234 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:51.002828 28234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:51.005519 28234 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:51.009040 28234 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:51.009258 28234 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:51.009572 28234 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:51.009727 28234 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:51.118610 28234 rpc_server.cc:307] RPC server started. Bound to: 127.27.146.131:41969
I20260709 13:10:51.118711 28542 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.146.131:41969 every 8 connection(s)
I20260709 13:10:51.139001 28543 heartbeater.cc:344] Connected to a master server at 127.27.146.190:37105
I20260709 13:10:51.139394 28543 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:51.140534 28543 heartbeater.cc:507] Master 127.27.146.190:37105 requested a full tablet report, sending...
I20260709 13:10:51.142755 28266 ts_manager.cc:194] Registered new tserver with Master: efb7184756dd41928c127a50037e3672 (127.27.146.131:41969)
I20260709 13:10:51.143450 28234 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01890132s
I20260709 13:10:51.144512 28266 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56562
I20260709 13:10:51.204005 28266 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56570:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:51.208225 28266 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:51.343050 28359 tablet_service.cc:1511] Processing CreateTablet for tablet faa54b9861874eaa90e9077878da98c3 (DEFAULT_TABLE table=test-workload [id=664aead7aeac4b1ea744d9c084b4181c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:51.349007 28359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faa54b9861874eaa90e9077878da98c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:51.351524 28357 tablet_service.cc:1511] Processing CreateTablet for tablet 6ac16ecbdad44d309b75903ff8748aa2 (DEFAULT_TABLE table=test-workload [id=664aead7aeac4b1ea744d9c084b4181c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:51.352056 28355 tablet_service.cc:1511] Processing CreateTablet for tablet cac3fbb52a734ffe840da27199a58f05 (DEFAULT_TABLE table=test-workload [id=664aead7aeac4b1ea744d9c084b4181c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:51.350159 28358 tablet_service.cc:1511] Processing CreateTablet for tablet 48ef7adf3ca24d4ba44c678da62b64bb (DEFAULT_TABLE table=test-workload [id=664aead7aeac4b1ea744d9c084b4181c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:51.351964 28356 tablet_service.cc:1511] Processing CreateTablet for tablet a7c7c56087d64b37af648badd045b987 (DEFAULT_TABLE table=test-workload [id=664aead7aeac4b1ea744d9c084b4181c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:51.360667 28357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ac16ecbdad44d309b75903ff8748aa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:51.360072 28354 tablet_service.cc:1511] Processing CreateTablet for tablet 178f126036d74fc1aa8e7db809be61d0 (DEFAULT_TABLE table=test-workload [id=664aead7aeac4b1ea744d9c084b4181c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:51.363091 28354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 178f126036d74fc1aa8e7db809be61d0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:51.363816 28314 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:51.369179 28356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7c7c56087d64b37af648badd045b987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:51.373063 28508 tablet_service.cc:1511] Processing CreateTablet for tablet faa54b9861874eaa90e9077878da98c3 (DEFAULT_TABLE table=test-workload [id=664aead7aeac4b1ea744d9c084b4181c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:51.375280 28506 tablet_service.cc:1511] Processing CreateTablet for tablet 6ac16ecbdad44d309b75903ff8748aa2 (DEFAULT_TABLE table=test-workload [id=664aead7aeac4b1ea744d9c084b4181c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:51.371343 28507 tablet_service.cc:1511] Processing CreateTablet for tablet 48ef7adf3ca24d4ba44c678da62b64bb (DEFAULT_TABLE table=test-workload [id=664aead7aeac4b1ea744d9c084b4181c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:51.385733 28505 tablet_service.cc:1511] Processing CreateTablet for tablet a7c7c56087d64b37af648badd045b987 (DEFAULT_TABLE table=test-workload [id=664aead7aeac4b1ea744d9c084b4181c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:51.382761 28503 tablet_service.cc:1511] Processing CreateTablet for tablet 178f126036d74fc1aa8e7db809be61d0 (DEFAULT_TABLE table=test-workload [id=664aead7aeac4b1ea744d9c084b4181c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:51.383426 28355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cac3fbb52a734ffe840da27199a58f05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:51.383906 28504 tablet_service.cc:1511] Processing CreateTablet for tablet cac3fbb52a734ffe840da27199a58f05 (DEFAULT_TABLE table=test-workload [id=664aead7aeac4b1ea744d9c084b4181c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:51.389731 28508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faa54b9861874eaa90e9077878da98c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:51.391829 28353 tablet_service.cc:1511] Processing CreateTablet for tablet 23939bc50fd04a08925ae3d5508ef5ab (DEFAULT_TABLE table=test-workload [id=664aead7aeac4b1ea744d9c084b4181c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:51.396051 28505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7c7c56087d64b37af648badd045b987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:51.397526 28503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 178f126036d74fc1aa8e7db809be61d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:51.401909 28504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cac3fbb52a734ffe840da27199a58f05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:51.404140 28506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ac16ecbdad44d309b75903ff8748aa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:51.402632 28358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48ef7adf3ca24d4ba44c678da62b64bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:51.412616 28502 tablet_service.cc:1511] Processing CreateTablet for tablet 23939bc50fd04a08925ae3d5508ef5ab (DEFAULT_TABLE table=test-workload [id=664aead7aeac4b1ea744d9c084b4181c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:51.414884 28507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48ef7adf3ca24d4ba44c678da62b64bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:51.417774 28353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23939bc50fd04a08925ae3d5508ef5ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:51.421229 28434 tablet_service.cc:1511] Processing CreateTablet for tablet faa54b9861874eaa90e9077878da98c3 (DEFAULT_TABLE table=test-workload [id=664aead7aeac4b1ea744d9c084b4181c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:51.428145 28434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faa54b9861874eaa90e9077878da98c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:51.430146 28502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23939bc50fd04a08925ae3d5508ef5ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:51.428005 28432 tablet_service.cc:1511] Processing CreateTablet for tablet 6ac16ecbdad44d309b75903ff8748aa2 (DEFAULT_TABLE table=test-workload [id=664aead7aeac4b1ea744d9c084b4181c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:51.426151 28433 tablet_service.cc:1511] Processing CreateTablet for tablet 48ef7adf3ca24d4ba44c678da62b64bb (DEFAULT_TABLE table=test-workload [id=664aead7aeac4b1ea744d9c084b4181c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:51.440393 28432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ac16ecbdad44d309b75903ff8748aa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:51.438541 28430 tablet_service.cc:1511] Processing CreateTablet for tablet cac3fbb52a734ffe840da27199a58f05 (DEFAULT_TABLE table=test-workload [id=664aead7aeac4b1ea744d9c084b4181c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:51.448913 28431 tablet_service.cc:1511] Processing CreateTablet for tablet a7c7c56087d64b37af648badd045b987 (DEFAULT_TABLE table=test-workload [id=664aead7aeac4b1ea744d9c084b4181c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:51.453922 28352 tablet_service.cc:1511] Processing CreateTablet for tablet cd08ca5dee984515ad04c435411426e3 (DEFAULT_TABLE table=test-workload [id=664aead7aeac4b1ea744d9c084b4181c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:51.454071 28429 tablet_service.cc:1511] Processing CreateTablet for tablet 178f126036d74fc1aa8e7db809be61d0 (DEFAULT_TABLE table=test-workload [id=664aead7aeac4b1ea744d9c084b4181c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:51.457609 28352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd08ca5dee984515ad04c435411426e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:51.473207 28433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48ef7adf3ca24d4ba44c678da62b64bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:51.447827 28428 tablet_service.cc:1511] Processing CreateTablet for tablet 23939bc50fd04a08925ae3d5508ef5ab (DEFAULT_TABLE table=test-workload [id=664aead7aeac4b1ea744d9c084b4181c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:51.467908 28427 tablet_service.cc:1511] Processing CreateTablet for tablet cd08ca5dee984515ad04c435411426e3 (DEFAULT_TABLE table=test-workload [id=664aead7aeac4b1ea744d9c084b4181c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:51.488642 28430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cac3fbb52a734ffe840da27199a58f05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:51.492115 28427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd08ca5dee984515ad04c435411426e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:51.494881 28431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7c7c56087d64b37af648badd045b987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:51.500907 28428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23939bc50fd04a08925ae3d5508ef5ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:51.504184 28429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 178f126036d74fc1aa8e7db809be61d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:51.548708 28501 tablet_service.cc:1511] Processing CreateTablet for tablet cd08ca5dee984515ad04c435411426e3 (DEFAULT_TABLE table=test-workload [id=664aead7aeac4b1ea744d9c084b4181c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:51.553035 28501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd08ca5dee984515ad04c435411426e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:51.573257 28351 tablet_service.cc:1511] Processing CreateTablet for tablet a24e93a2f6ca4b23b4d193527621e98b (DEFAULT_TABLE table=test-workload [id=664aead7aeac4b1ea744d9c084b4181c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:51.577275 28351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a24e93a2f6ca4b23b4d193527621e98b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:51.596793 28426 tablet_service.cc:1511] Processing CreateTablet for tablet a24e93a2f6ca4b23b4d193527621e98b (DEFAULT_TABLE table=test-workload [id=664aead7aeac4b1ea744d9c084b4181c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:51.606657 28426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a24e93a2f6ca4b23b4d193527621e98b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:51.613142 28500 tablet_service.cc:1511] Processing CreateTablet for tablet a24e93a2f6ca4b23b4d193527621e98b (DEFAULT_TABLE table=test-workload [id=664aead7aeac4b1ea744d9c084b4181c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:51.615463 28500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a24e93a2f6ca4b23b4d193527621e98b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:51.729967 28394 heartbeater.cc:499] Master 127.27.146.190:37105 was elected leader, sending a full tablet report...
I20260709 13:10:51.788416 28561 tablet_bootstrap.cc:492] T cac3fbb52a734ffe840da27199a58f05 P 1a5a33ca0108455c9cd1358bf0e50943: Bootstrap starting.
I20260709 13:10:51.810442 28562 tablet_bootstrap.cc:492] T 6ac16ecbdad44d309b75903ff8748aa2 P efb7184756dd41928c127a50037e3672: Bootstrap starting.
I20260709 13:10:51.835675 28563 tablet_bootstrap.cc:492] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3: Bootstrap starting.
I20260709 13:10:51.860545 28562 tablet_bootstrap.cc:654] T 6ac16ecbdad44d309b75903ff8748aa2 P efb7184756dd41928c127a50037e3672: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:51.871006 28561 tablet_bootstrap.cc:654] T cac3fbb52a734ffe840da27199a58f05 P 1a5a33ca0108455c9cd1358bf0e50943: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:51.871587 28563 tablet_bootstrap.cc:654] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:51.883201 28561 tablet_bootstrap.cc:492] T cac3fbb52a734ffe840da27199a58f05 P 1a5a33ca0108455c9cd1358bf0e50943: No bootstrap required, opened a new log
I20260709 13:10:51.884029 28561 ts_tablet_manager.cc:1403] T cac3fbb52a734ffe840da27199a58f05 P 1a5a33ca0108455c9cd1358bf0e50943: Time spent bootstrapping tablet: real 0.100s	user 0.011s	sys 0.007s
I20260709 13:10:51.885624 28563 tablet_bootstrap.cc:492] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3: No bootstrap required, opened a new log
I20260709 13:10:51.886394 28563 ts_tablet_manager.cc:1403] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3: Time spent bootstrapping tablet: real 0.083s	user 0.004s	sys 0.011s
I20260709 13:10:51.888492 28561 raft_consensus.cc:359] T cac3fbb52a734ffe840da27199a58f05 P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:51.889777 28561 raft_consensus.cc:385] T cac3fbb52a734ffe840da27199a58f05 P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:51.889860 28563 raft_consensus.cc:359] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } } peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } }
I20260709 13:10:51.890292 28561 raft_consensus.cc:740] T cac3fbb52a734ffe840da27199a58f05 P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a5a33ca0108455c9cd1358bf0e50943, State: Initialized, Role: FOLLOWER
I20260709 13:10:51.890724 28563 raft_consensus.cc:385] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:51.891069 28563 raft_consensus.cc:740] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b234feb6496d4a1cbddaf57ae75ed5e3, State: Initialized, Role: FOLLOWER
I20260709 13:10:51.891536 28561 consensus_queue.cc:260] T cac3fbb52a734ffe840da27199a58f05 P 1a5a33ca0108455c9cd1358bf0e50943 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:51.893627 28563 consensus_queue.cc:260] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } } peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } }
I20260709 13:10:51.894869 28562 tablet_bootstrap.cc:492] T 6ac16ecbdad44d309b75903ff8748aa2 P efb7184756dd41928c127a50037e3672: No bootstrap required, opened a new log
I20260709 13:10:51.895419 28562 ts_tablet_manager.cc:1403] T 6ac16ecbdad44d309b75903ff8748aa2 P efb7184756dd41928c127a50037e3672: Time spent bootstrapping tablet: real 0.116s	user 0.017s	sys 0.015s
I20260709 13:10:51.898739 28562 raft_consensus.cc:359] T 6ac16ecbdad44d309b75903ff8748aa2 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:51.899617 28562 raft_consensus.cc:385] T 6ac16ecbdad44d309b75903ff8748aa2 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:51.900476 28562 raft_consensus.cc:740] T 6ac16ecbdad44d309b75903ff8748aa2 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efb7184756dd41928c127a50037e3672, State: Initialized, Role: FOLLOWER
I20260709 13:10:51.902439 28563 ts_tablet_manager.cc:1434] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.005s
I20260709 13:10:51.901551 28562 consensus_queue.cc:260] T 6ac16ecbdad44d309b75903ff8748aa2 P efb7184756dd41928c127a50037e3672 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:51.903430 28561 ts_tablet_manager.cc:1434] T cac3fbb52a734ffe840da27199a58f05 P 1a5a33ca0108455c9cd1358bf0e50943: Time spent starting tablet: real 0.019s	user 0.013s	sys 0.001s
I20260709 13:10:51.903411 28469 heartbeater.cc:499] Master 127.27.146.190:37105 was elected leader, sending a full tablet report...
I20260709 13:10:51.909893 28561 tablet_bootstrap.cc:492] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943: Bootstrap starting.
I20260709 13:10:51.911737 28562 ts_tablet_manager.cc:1434] T 6ac16ecbdad44d309b75903ff8748aa2 P efb7184756dd41928c127a50037e3672: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.010s
I20260709 13:10:51.912578 28543 heartbeater.cc:499] Master 127.27.146.190:37105 was elected leader, sending a full tablet report...
I20260709 13:10:51.915635 28562 tablet_bootstrap.cc:492] T faa54b9861874eaa90e9077878da98c3 P efb7184756dd41928c127a50037e3672: Bootstrap starting.
I20260709 13:10:51.919675 28561 tablet_bootstrap.cc:654] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:51.925912 28562 tablet_bootstrap.cc:654] T faa54b9861874eaa90e9077878da98c3 P efb7184756dd41928c127a50037e3672: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:51.909965 28563 tablet_bootstrap.cc:492] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3: Bootstrap starting.
I20260709 13:10:51.938372 28562 tablet_bootstrap.cc:492] T faa54b9861874eaa90e9077878da98c3 P efb7184756dd41928c127a50037e3672: No bootstrap required, opened a new log
I20260709 13:10:51.939851 28562 ts_tablet_manager.cc:1403] T faa54b9861874eaa90e9077878da98c3 P efb7184756dd41928c127a50037e3672: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.002s
I20260709 13:10:51.942838 28561 tablet_bootstrap.cc:492] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943: No bootstrap required, opened a new log
I20260709 13:10:51.943413 28561 ts_tablet_manager.cc:1403] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.012s
I20260709 13:10:51.943621 28562 raft_consensus.cc:359] T faa54b9861874eaa90e9077878da98c3 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } } peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } }
I20260709 13:10:51.944368 28562 raft_consensus.cc:385] T faa54b9861874eaa90e9077878da98c3 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:51.944657 28562 raft_consensus.cc:740] T faa54b9861874eaa90e9077878da98c3 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efb7184756dd41928c127a50037e3672, State: Initialized, Role: FOLLOWER
I20260709 13:10:51.946058 28562 consensus_queue.cc:260] T faa54b9861874eaa90e9077878da98c3 P efb7184756dd41928c127a50037e3672 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } } peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } }
I20260709 13:10:51.947860 28563 tablet_bootstrap.cc:654] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:51.949250 28562 ts_tablet_manager.cc:1434] T faa54b9861874eaa90e9077878da98c3 P efb7184756dd41928c127a50037e3672: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:10:51.950311 28562 tablet_bootstrap.cc:492] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672: Bootstrap starting.
W20260709 13:10:51.952421 28395 tablet.cc:2406] T cac3fbb52a734ffe840da27199a58f05 P 1a5a33ca0108455c9cd1358bf0e50943: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:10:51.953581 28561 raft_consensus.cc:359] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } } peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } }
I20260709 13:10:51.954391 28561 raft_consensus.cc:385] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:51.954743 28561 raft_consensus.cc:740] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a5a33ca0108455c9cd1358bf0e50943, State: Initialized, Role: FOLLOWER
I20260709 13:10:51.955668 28561 consensus_queue.cc:260] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } } peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } }
I20260709 13:10:51.958431 28561 ts_tablet_manager.cc:1434] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:10:51.963366 28562 tablet_bootstrap.cc:654] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:51.971607 28561 tablet_bootstrap.cc:492] T 48ef7adf3ca24d4ba44c678da62b64bb P 1a5a33ca0108455c9cd1358bf0e50943: Bootstrap starting.
I20260709 13:10:51.980152 28562 tablet_bootstrap.cc:492] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672: No bootstrap required, opened a new log
I20260709 13:10:51.980877 28562 ts_tablet_manager.cc:1403] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.009s
I20260709 13:10:51.981046 28561 tablet_bootstrap.cc:654] T 48ef7adf3ca24d4ba44c678da62b64bb P 1a5a33ca0108455c9cd1358bf0e50943: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:51.988224 28562 raft_consensus.cc:359] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:51.989172 28562 raft_consensus.cc:385] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:51.989531 28562 raft_consensus.cc:740] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efb7184756dd41928c127a50037e3672, State: Initialized, Role: FOLLOWER
I20260709 13:10:51.990494 28562 consensus_queue.cc:260] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:51.993260 28562 ts_tablet_manager.cc:1434] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:10:51.994385 28562 tablet_bootstrap.cc:492] T cd08ca5dee984515ad04c435411426e3 P efb7184756dd41928c127a50037e3672: Bootstrap starting.
I20260709 13:10:52.001930 28562 tablet_bootstrap.cc:654] T cd08ca5dee984515ad04c435411426e3 P efb7184756dd41928c127a50037e3672: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:52.013309 28562 tablet_bootstrap.cc:492] T cd08ca5dee984515ad04c435411426e3 P efb7184756dd41928c127a50037e3672: No bootstrap required, opened a new log
I20260709 13:10:52.014003 28562 ts_tablet_manager.cc:1403] T cd08ca5dee984515ad04c435411426e3 P efb7184756dd41928c127a50037e3672: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.001s
I20260709 13:10:52.018059 28561 tablet_bootstrap.cc:492] T 48ef7adf3ca24d4ba44c678da62b64bb P 1a5a33ca0108455c9cd1358bf0e50943: No bootstrap required, opened a new log
I20260709 13:10:52.018448 28563 tablet_bootstrap.cc:492] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3: No bootstrap required, opened a new log
I20260709 13:10:52.018635 28561 ts_tablet_manager.cc:1403] T 48ef7adf3ca24d4ba44c678da62b64bb P 1a5a33ca0108455c9cd1358bf0e50943: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.008s
I20260709 13:10:52.019030 28563 ts_tablet_manager.cc:1403] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3: Time spent bootstrapping tablet: real 0.109s	user 0.030s	sys 0.045s
I20260709 13:10:52.019033 28562 raft_consensus.cc:359] T cd08ca5dee984515ad04c435411426e3 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.020156 28562 raft_consensus.cc:385] T cd08ca5dee984515ad04c435411426e3 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:52.020465 28562 raft_consensus.cc:740] T cd08ca5dee984515ad04c435411426e3 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efb7184756dd41928c127a50037e3672, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.021338 28562 consensus_queue.cc:260] T cd08ca5dee984515ad04c435411426e3 P efb7184756dd41928c127a50037e3672 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.022267 28561 raft_consensus.cc:359] T 48ef7adf3ca24d4ba44c678da62b64bb P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.022495 28563 raft_consensus.cc:359] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.022996 28561 raft_consensus.cc:385] T 48ef7adf3ca24d4ba44c678da62b64bb P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:52.023239 28563 raft_consensus.cc:385] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:52.023348 28561 raft_consensus.cc:740] T 48ef7adf3ca24d4ba44c678da62b64bb P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a5a33ca0108455c9cd1358bf0e50943, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.023682 28563 raft_consensus.cc:740] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b234feb6496d4a1cbddaf57ae75ed5e3, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.024441 28561 consensus_queue.cc:260] T 48ef7adf3ca24d4ba44c678da62b64bb P 1a5a33ca0108455c9cd1358bf0e50943 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.024502 28563 consensus_queue.cc:260] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.023761 28562 ts_tablet_manager.cc:1434] T cd08ca5dee984515ad04c435411426e3 P efb7184756dd41928c127a50037e3672: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:10:52.026736 28561 ts_tablet_manager.cc:1434] T 48ef7adf3ca24d4ba44c678da62b64bb P 1a5a33ca0108455c9cd1358bf0e50943: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:10:52.027745 28562 tablet_bootstrap.cc:492] T 48ef7adf3ca24d4ba44c678da62b64bb P efb7184756dd41928c127a50037e3672: Bootstrap starting.
I20260709 13:10:52.027853 28561 tablet_bootstrap.cc:492] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943: Bootstrap starting.
I20260709 13:10:52.026751 28563 ts_tablet_manager.cc:1434] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:10:52.036628 28563 tablet_bootstrap.cc:492] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3: Bootstrap starting.
I20260709 13:10:52.037081 28562 tablet_bootstrap.cc:654] T 48ef7adf3ca24d4ba44c678da62b64bb P efb7184756dd41928c127a50037e3672: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:52.043448 28563 tablet_bootstrap.cc:654] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:52.051522 28561 tablet_bootstrap.cc:654] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:52.073792 28563 tablet_bootstrap.cc:492] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3: No bootstrap required, opened a new log
I20260709 13:10:52.074359 28563 ts_tablet_manager.cc:1403] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3: Time spent bootstrapping tablet: real 0.038s	user 0.004s	sys 0.014s
I20260709 13:10:52.077576 28563 raft_consensus.cc:359] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.078372 28563 raft_consensus.cc:385] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:52.078663 28563 raft_consensus.cc:740] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b234feb6496d4a1cbddaf57ae75ed5e3, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.079720 28563 consensus_queue.cc:260] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.080299 28561 tablet_bootstrap.cc:492] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943: No bootstrap required, opened a new log
I20260709 13:10:52.081926 28562 tablet_bootstrap.cc:492] T 48ef7adf3ca24d4ba44c678da62b64bb P efb7184756dd41928c127a50037e3672: No bootstrap required, opened a new log
I20260709 13:10:52.082422 28563 ts_tablet_manager.cc:1434] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:10:52.082521 28562 ts_tablet_manager.cc:1403] T 48ef7adf3ca24d4ba44c678da62b64bb P efb7184756dd41928c127a50037e3672: Time spent bootstrapping tablet: real 0.055s	user 0.024s	sys 0.027s
I20260709 13:10:52.083809 28561 ts_tablet_manager.cc:1403] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943: Time spent bootstrapping tablet: real 0.056s	user 0.014s	sys 0.009s
I20260709 13:10:52.086930 28562 raft_consensus.cc:359] T 48ef7adf3ca24d4ba44c678da62b64bb P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.087951 28562 raft_consensus.cc:385] T 48ef7adf3ca24d4ba44c678da62b64bb P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:52.087370 28561 raft_consensus.cc:359] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.088312 28562 raft_consensus.cc:740] T 48ef7adf3ca24d4ba44c678da62b64bb P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efb7184756dd41928c127a50037e3672, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.088622 28561 raft_consensus.cc:385] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:52.089231 28561 raft_consensus.cc:740] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a5a33ca0108455c9cd1358bf0e50943, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.089432 28562 consensus_queue.cc:260] T 48ef7adf3ca24d4ba44c678da62b64bb P efb7184756dd41928c127a50037e3672 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.092664 28562 ts_tablet_manager.cc:1434] T 48ef7adf3ca24d4ba44c678da62b64bb P efb7184756dd41928c127a50037e3672: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.005s
I20260709 13:10:52.095078 28568 raft_consensus.cc:493] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.095556 28562 tablet_bootstrap.cc:492] T a24e93a2f6ca4b23b4d193527621e98b P efb7184756dd41928c127a50037e3672: Bootstrap starting.
I20260709 13:10:52.095672 28568 raft_consensus.cc:515] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.090274 28561 consensus_queue.cc:260] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.104503 28562 tablet_bootstrap.cc:654] T a24e93a2f6ca4b23b4d193527621e98b P efb7184756dd41928c127a50037e3672: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:52.106619 28569 raft_consensus.cc:493] T 6ac16ecbdad44d309b75903ff8748aa2 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.107208 28569 raft_consensus.cc:515] T 6ac16ecbdad44d309b75903ff8748aa2 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.108129 28561 ts_tablet_manager.cc:1434] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.001s
I20260709 13:10:52.110663 28569 leader_election.cc:290] T 6ac16ecbdad44d309b75903ff8748aa2 P efb7184756dd41928c127a50037e3672 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037), b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130:40891)
I20260709 13:10:52.111629 28563 tablet_bootstrap.cc:492] T cac3fbb52a734ffe840da27199a58f05 P b234feb6496d4a1cbddaf57ae75ed5e3: Bootstrap starting.
I20260709 13:10:52.117192 28561 tablet_bootstrap.cc:492] T 178f126036d74fc1aa8e7db809be61d0 P 1a5a33ca0108455c9cd1358bf0e50943: Bootstrap starting.
I20260709 13:10:52.119011 28568 leader_election.cc:290] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037), efb7184756dd41928c127a50037e3672 (127.27.146.131:41969)
I20260709 13:10:52.121433 28563 tablet_bootstrap.cc:654] T cac3fbb52a734ffe840da27199a58f05 P b234feb6496d4a1cbddaf57ae75ed5e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:52.123344 28562 tablet_bootstrap.cc:492] T a24e93a2f6ca4b23b4d193527621e98b P efb7184756dd41928c127a50037e3672: No bootstrap required, opened a new log
I20260709 13:10:52.124055 28562 ts_tablet_manager.cc:1403] T a24e93a2f6ca4b23b4d193527621e98b P efb7184756dd41928c127a50037e3672: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.000s
I20260709 13:10:52.126636 28561 tablet_bootstrap.cc:654] T 178f126036d74fc1aa8e7db809be61d0 P 1a5a33ca0108455c9cd1358bf0e50943: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:52.127871 28562 raft_consensus.cc:359] T a24e93a2f6ca4b23b4d193527621e98b P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.129976 28562 raft_consensus.cc:385] T a24e93a2f6ca4b23b4d193527621e98b P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:52.130306 28562 raft_consensus.cc:740] T a24e93a2f6ca4b23b4d193527621e98b P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efb7184756dd41928c127a50037e3672, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.131597 28562 consensus_queue.cc:260] T a24e93a2f6ca4b23b4d193527621e98b P efb7184756dd41928c127a50037e3672 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.146795 28562 ts_tablet_manager.cc:1434] T a24e93a2f6ca4b23b4d193527621e98b P efb7184756dd41928c127a50037e3672: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.004s
I20260709 13:10:52.159464 28562 tablet_bootstrap.cc:492] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672: Bootstrap starting.
I20260709 13:10:52.169523 28561 tablet_bootstrap.cc:492] T 178f126036d74fc1aa8e7db809be61d0 P 1a5a33ca0108455c9cd1358bf0e50943: No bootstrap required, opened a new log
I20260709 13:10:52.170153 28561 ts_tablet_manager.cc:1403] T 178f126036d74fc1aa8e7db809be61d0 P 1a5a33ca0108455c9cd1358bf0e50943: Time spent bootstrapping tablet: real 0.053s	user 0.005s	sys 0.019s
I20260709 13:10:52.183058 28568 raft_consensus.cc:493] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.185494 28568 raft_consensus.cc:515] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } } peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } }
I20260709 13:10:52.189268 28563 tablet_bootstrap.cc:492] T cac3fbb52a734ffe840da27199a58f05 P b234feb6496d4a1cbddaf57ae75ed5e3: No bootstrap required, opened a new log
I20260709 13:10:52.189572 28568 leader_election.cc:290] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efb7184756dd41928c127a50037e3672 (127.27.146.131:41969), 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037)
I20260709 13:10:52.189810 28563 ts_tablet_manager.cc:1403] T cac3fbb52a734ffe840da27199a58f05 P b234feb6496d4a1cbddaf57ae75ed5e3: Time spent bootstrapping tablet: real 0.106s	user 0.014s	sys 0.019s
I20260709 13:10:52.194553 28562 tablet_bootstrap.cc:654] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:52.185333 28561 raft_consensus.cc:359] T 178f126036d74fc1aa8e7db809be61d0 P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.195596 28561 raft_consensus.cc:385] T 178f126036d74fc1aa8e7db809be61d0 P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:52.196034 28561 raft_consensus.cc:740] T 178f126036d74fc1aa8e7db809be61d0 P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a5a33ca0108455c9cd1358bf0e50943, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.198796 28569 raft_consensus.cc:493] T faa54b9861874eaa90e9077878da98c3 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.199734 28563 raft_consensus.cc:359] T cac3fbb52a734ffe840da27199a58f05 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.199873 28569 raft_consensus.cc:515] T faa54b9861874eaa90e9077878da98c3 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } } peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } }
I20260709 13:10:52.201411 28563 raft_consensus.cc:385] T cac3fbb52a734ffe840da27199a58f05 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:52.200116 28561 consensus_queue.cc:260] T 178f126036d74fc1aa8e7db809be61d0 P 1a5a33ca0108455c9cd1358bf0e50943 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.204243 28567 raft_consensus.cc:493] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.202054 28563 raft_consensus.cc:740] T cac3fbb52a734ffe840da27199a58f05 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b234feb6496d4a1cbddaf57ae75ed5e3, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.206620 28569 leader_election.cc:290] T faa54b9861874eaa90e9077878da98c3 P efb7184756dd41928c127a50037e3672 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037), b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130:40891)
I20260709 13:10:52.206461 28518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23939bc50fd04a08925ae3d5508ef5ab" candidate_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efb7184756dd41928c127a50037e3672" is_pre_election: true
I20260709 13:10:52.208105 28568 raft_consensus.cc:493] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.205291 28567 raft_consensus.cc:515] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } } peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } }
I20260709 13:10:52.208964 28568 raft_consensus.cc:515] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.212317 28368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faa54b9861874eaa90e9077878da98c3" candidate_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943" is_pre_election: true
I20260709 13:10:52.212813 28369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23939bc50fd04a08925ae3d5508ef5ab" candidate_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943" is_pre_election: true
I20260709 13:10:52.212698 28517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faa54b9861874eaa90e9077878da98c3" candidate_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efb7184756dd41928c127a50037e3672" is_pre_election: true
I20260709 13:10:52.218317 28517 raft_consensus.cc:2468] T faa54b9861874eaa90e9077878da98c3 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b234feb6496d4a1cbddaf57ae75ed5e3 in term 0.
I20260709 13:10:52.218871 28568 leader_election.cc:290] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037), efb7184756dd41928c127a50037e3672 (127.27.146.131:41969)
W20260709 13:10:52.219548 28407 leader_election.cc:343] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efb7184756dd41928c127a50037e3672 (127.27.146.131:41969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:52.221153 28368 raft_consensus.cc:2468] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b234feb6496d4a1cbddaf57ae75ed5e3 in term 0.
I20260709 13:10:52.211687 28563 consensus_queue.cc:260] T cac3fbb52a734ffe840da27199a58f05 P b234feb6496d4a1cbddaf57ae75ed5e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.223444 28367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac16ecbdad44d309b75903ff8748aa2" candidate_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943" is_pre_election: true
I20260709 13:10:52.226325 28517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac16ecbdad44d309b75903ff8748aa2" candidate_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efb7184756dd41928c127a50037e3672" is_pre_election: true
I20260709 13:10:52.227816 28517 raft_consensus.cc:2468] T 6ac16ecbdad44d309b75903ff8748aa2 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b234feb6496d4a1cbddaf57ae75ed5e3 in term 0.
I20260709 13:10:52.229766 28563 ts_tablet_manager.cc:1434] T cac3fbb52a734ffe840da27199a58f05 P b234feb6496d4a1cbddaf57ae75ed5e3: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.002s
I20260709 13:10:52.223932 28407 leader_election.cc:304] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b234feb6496d4a1cbddaf57ae75ed5e3, efb7184756dd41928c127a50037e3672; no voters: 
I20260709 13:10:52.235666 28568 raft_consensus.cc:2804] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:52.236110 28568 raft_consensus.cc:493] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.232788 28567 leader_election.cc:290] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efb7184756dd41928c127a50037e3672 (127.27.146.131:41969), b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130:40891)
I20260709 13:10:52.236263 28563 tablet_bootstrap.cc:492] T a7c7c56087d64b37af648badd045b987 P b234feb6496d4a1cbddaf57ae75ed5e3: Bootstrap starting.
I20260709 13:10:52.237111 28568 raft_consensus.cc:3060] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:52.241467 28407 leader_election.cc:304] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b234feb6496d4a1cbddaf57ae75ed5e3, efb7184756dd41928c127a50037e3672; no voters: 
W20260709 13:10:52.256250 28409 leader_election.cc:343] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:52.269059 28568 raft_consensus.cc:515] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } } peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } }
I20260709 13:10:52.272652 28568 leader_election.cc:290] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [CANDIDATE]: Term 1 election: Requested vote from peers efb7184756dd41928c127a50037e3672 (127.27.146.131:41969), 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037)
I20260709 13:10:52.273612 28568 raft_consensus.cc:2804] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:52.274124 28568 raft_consensus.cc:493] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.274611 28568 raft_consensus.cc:3060] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:52.276330 28409 leader_election.cc:343] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:52.276993 28409 leader_election.cc:304] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b234feb6496d4a1cbddaf57ae75ed5e3; no voters: 1a5a33ca0108455c9cd1358bf0e50943, efb7184756dd41928c127a50037e3672
I20260709 13:10:52.286276 28561 ts_tablet_manager.cc:1434] T 178f126036d74fc1aa8e7db809be61d0 P 1a5a33ca0108455c9cd1358bf0e50943: Time spent starting tablet: real 0.116s	user 0.020s	sys 0.012s
I20260709 13:10:52.289047 28561 tablet_bootstrap.cc:492] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943: Bootstrap starting.
I20260709 13:10:52.286360 28569 raft_consensus.cc:493] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.304497 28563 tablet_bootstrap.cc:654] T a7c7c56087d64b37af648badd045b987 P b234feb6496d4a1cbddaf57ae75ed5e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:52.302963 28593 raft_consensus.cc:2749] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:52.308048 28369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faa54b9861874eaa90e9077878da98c3" candidate_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943"
I20260709 13:10:52.302419 28569 raft_consensus.cc:515] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
W20260709 13:10:52.305948 28407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:41969, user_credentials={real_user=slave}} blocked reactor thread for 66624.5us
I20260709 13:10:52.306370 28444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac16ecbdad44d309b75903ff8748aa2" candidate_uuid: "efb7184756dd41928c127a50037e3672" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" is_pre_election: true
I20260709 13:10:52.313761 28369 raft_consensus.cc:3060] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:52.310773 28443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faa54b9861874eaa90e9077878da98c3" candidate_uuid: "efb7184756dd41928c127a50037e3672" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" is_pre_election: true
I20260709 13:10:52.317426 28562 tablet_bootstrap.cc:492] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672: No bootstrap required, opened a new log
I20260709 13:10:52.317312 28590 raft_consensus.cc:493] T cac3fbb52a734ffe840da27199a58f05 P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.319739 28517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faa54b9861874eaa90e9077878da98c3" candidate_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efb7184756dd41928c127a50037e3672"
I20260709 13:10:52.320349 28517 raft_consensus.cc:3060] T faa54b9861874eaa90e9077878da98c3 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:52.321456 28562 ts_tablet_manager.cc:1403] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672: Time spent bootstrapping tablet: real 0.173s	user 0.022s	sys 0.007s
I20260709 13:10:52.314759 28568 raft_consensus.cc:515] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.318727 28590 raft_consensus.cc:515] T cac3fbb52a734ffe840da27199a58f05 P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.326416 28443 raft_consensus.cc:2393] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efb7184756dd41928c127a50037e3672 in current term 1: Already voted for candidate b234feb6496d4a1cbddaf57ae75ed5e3 in this term.
I20260709 13:10:52.329293 28569 leader_election.cc:290] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037), b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130:40891)
I20260709 13:10:52.334129 28568 leader_election.cc:290] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [CANDIDATE]: Term 1 election: Requested vote from peers 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037), efb7184756dd41928c127a50037e3672 (127.27.146.131:41969)
I20260709 13:10:52.332253 28569 raft_consensus.cc:493] T a24e93a2f6ca4b23b4d193527621e98b P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.337821 28444 raft_consensus.cc:2393] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efb7184756dd41928c127a50037e3672 in current term 1: Already voted for candidate b234feb6496d4a1cbddaf57ae75ed5e3 in this term.
I20260709 13:10:52.341161 28367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac16ecbdad44d309b75903ff8748aa2" candidate_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943"
I20260709 13:10:52.343123 28518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac16ecbdad44d309b75903ff8748aa2" candidate_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efb7184756dd41928c127a50037e3672"
I20260709 13:10:52.343746 28518 raft_consensus.cc:3060] T 6ac16ecbdad44d309b75903ff8748aa2 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:52.339605 28569 raft_consensus.cc:515] T a24e93a2f6ca4b23b4d193527621e98b P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.346772 28368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faa54b9861874eaa90e9077878da98c3" candidate_uuid: "efb7184756dd41928c127a50037e3672" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943" is_pre_election: true
I20260709 13:10:52.340006 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7c7c56087d64b37af648badd045b987" candidate_uuid: "efb7184756dd41928c127a50037e3672" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" is_pre_election: true
I20260709 13:10:52.348630 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7c7c56087d64b37af648badd045b987" candidate_uuid: "efb7184756dd41928c127a50037e3672" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943" is_pre_election: true
I20260709 13:10:52.351647 28483 leader_election.cc:304] T faa54b9861874eaa90e9077878da98c3 P efb7184756dd41928c127a50037e3672 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efb7184756dd41928c127a50037e3672; no voters: 1a5a33ca0108455c9cd1358bf0e50943, b234feb6496d4a1cbddaf57ae75ed5e3
I20260709 13:10:52.350023 28367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac16ecbdad44d309b75903ff8748aa2" candidate_uuid: "efb7184756dd41928c127a50037e3672" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943" is_pre_election: true
I20260709 13:10:52.357134 28562 raft_consensus.cc:359] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.360479 28369 raft_consensus.cc:2468] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b234feb6496d4a1cbddaf57ae75ed5e3 in term 1.
W20260709 13:10:52.361394 28409 leader_election.cc:343] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:52.357860 28484 leader_election.cc:343] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130:40891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:52.362051 28562 raft_consensus.cc:385] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:52.362644 28562 raft_consensus.cc:740] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efb7184756dd41928c127a50037e3672, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.364007 28562 consensus_queue.cc:260] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.356109 28366 raft_consensus.cc:2468] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efb7184756dd41928c127a50037e3672 in term 0.
I20260709 13:10:52.360373 28517 raft_consensus.cc:2468] T faa54b9861874eaa90e9077878da98c3 P efb7184756dd41928c127a50037e3672 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b234feb6496d4a1cbddaf57ae75ed5e3 in term 1.
I20260709 13:10:52.363102 28590 leader_election.cc:290] T cac3fbb52a734ffe840da27199a58f05 P 1a5a33ca0108455c9cd1358bf0e50943 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130:40891), efb7184756dd41928c127a50037e3672 (127.27.146.131:41969)
I20260709 13:10:52.370904 28569 leader_election.cc:290] T a24e93a2f6ca4b23b4d193527621e98b P efb7184756dd41928c127a50037e3672 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037), b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130:40891)
I20260709 13:10:52.372390 28569 raft_consensus.cc:2749] T faa54b9861874eaa90e9077878da98c3 P efb7184756dd41928c127a50037e3672 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:52.373605 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24e93a2f6ca4b23b4d193527621e98b" candidate_uuid: "efb7184756dd41928c127a50037e3672" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" is_pre_election: true
W20260709 13:10:52.376807 28484 leader_election.cc:343] T a24e93a2f6ca4b23b4d193527621e98b P efb7184756dd41928c127a50037e3672 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130:40891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:52.378008 28409 leader_election.cc:304] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a5a33ca0108455c9cd1358bf0e50943, b234feb6496d4a1cbddaf57ae75ed5e3; no voters: 
I20260709 13:10:52.378875 28568 raft_consensus.cc:2804] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:52.379390 28568 raft_consensus.cc:697] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 LEADER]: Becoming Leader. State: Replica: b234feb6496d4a1cbddaf57ae75ed5e3, State: Running, Role: LEADER
I20260709 13:10:52.380326 28568 consensus_queue.cc:237] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } } peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } }
W20260709 13:10:52.381165 28314 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:52.389614 28561 tablet_bootstrap.cc:654] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:52.391678 28562 ts_tablet_manager.cc:1434] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672: Time spent starting tablet: real 0.070s	user 0.008s	sys 0.003s
I20260709 13:10:52.402086 28569 raft_consensus.cc:493] T cd08ca5dee984515ad04c435411426e3 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.403051 28569 raft_consensus.cc:515] T cd08ca5dee984515ad04c435411426e3 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.393219 28563 tablet_bootstrap.cc:492] T a7c7c56087d64b37af648badd045b987 P b234feb6496d4a1cbddaf57ae75ed5e3: No bootstrap required, opened a new log
I20260709 13:10:52.402998 28265 catalog_manager.cc:5697] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130). New cstate: current_term: 1 leader_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:52.411214 28569 leader_election.cc:290] T cd08ca5dee984515ad04c435411426e3 P efb7184756dd41928c127a50037e3672 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037), b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130:40891)
I20260709 13:10:52.412743 28563 ts_tablet_manager.cc:1403] T a7c7c56087d64b37af648badd045b987 P b234feb6496d4a1cbddaf57ae75ed5e3: Time spent bootstrapping tablet: real 0.177s	user 0.021s	sys 0.014s
I20260709 13:10:52.415928 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd08ca5dee984515ad04c435411426e3" candidate_uuid: "efb7184756dd41928c127a50037e3672" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" is_pre_election: true
I20260709 13:10:52.417944 28517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faa54b9861874eaa90e9077878da98c3" candidate_uuid: "1a5a33ca0108455c9cd1358bf0e50943" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efb7184756dd41928c127a50037e3672" is_pre_election: true
I20260709 13:10:52.419265 28516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac3fbb52a734ffe840da27199a58f05" candidate_uuid: "1a5a33ca0108455c9cd1358bf0e50943" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efb7184756dd41928c127a50037e3672" is_pre_election: true
I20260709 13:10:52.414845 28562 tablet_bootstrap.cc:492] T 178f126036d74fc1aa8e7db809be61d0 P efb7184756dd41928c127a50037e3672: Bootstrap starting.
I20260709 13:10:52.421901 28517 raft_consensus.cc:2393] T faa54b9861874eaa90e9077878da98c3 P efb7184756dd41928c127a50037e3672 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a5a33ca0108455c9cd1358bf0e50943 in current term 1: Already voted for candidate b234feb6496d4a1cbddaf57ae75ed5e3 in this term.
W20260709 13:10:52.418648 28483 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:36037, user_credentials={real_user=slave}} blocked reactor thread for 66261.2us
I20260709 13:10:52.416605 28518 raft_consensus.cc:2468] T 6ac16ecbdad44d309b75903ff8748aa2 P efb7184756dd41928c127a50037e3672 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b234feb6496d4a1cbddaf57ae75ed5e3 in term 1.
W20260709 13:10:52.424566 28332 leader_election.cc:343] T cac3fbb52a734ffe840da27199a58f05 P 1a5a33ca0108455c9cd1358bf0e50943 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efb7184756dd41928c127a50037e3672 (127.27.146.131:41969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:52.426013 28369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24e93a2f6ca4b23b4d193527621e98b" candidate_uuid: "efb7184756dd41928c127a50037e3672" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943" is_pre_election: true
I20260709 13:10:52.429252 28444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac3fbb52a734ffe840da27199a58f05" candidate_uuid: "1a5a33ca0108455c9cd1358bf0e50943" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" is_pre_election: true
W20260709 13:10:52.427716 28484 leader_election.cc:343] T cd08ca5dee984515ad04c435411426e3 P efb7184756dd41928c127a50037e3672 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130:40891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:52.428941 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faa54b9861874eaa90e9077878da98c3" candidate_uuid: "1a5a33ca0108455c9cd1358bf0e50943" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" is_pre_election: true
I20260709 13:10:52.431252 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd08ca5dee984515ad04c435411426e3" candidate_uuid: "efb7184756dd41928c127a50037e3672" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943" is_pre_election: true
I20260709 13:10:52.433111 28444 raft_consensus.cc:2468] T cac3fbb52a734ffe840da27199a58f05 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a5a33ca0108455c9cd1358bf0e50943 in term 0.
I20260709 13:10:52.434269 28561 tablet_bootstrap.cc:492] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943: No bootstrap required, opened a new log
I20260709 13:10:52.435122 28335 leader_election.cc:304] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a5a33ca0108455c9cd1358bf0e50943; no voters: b234feb6496d4a1cbddaf57ae75ed5e3, efb7184756dd41928c127a50037e3672
I20260709 13:10:52.435123 28561 ts_tablet_manager.cc:1403] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943: Time spent bootstrapping tablet: real 0.146s	user 0.013s	sys 0.020s
I20260709 13:10:52.436527 28590 raft_consensus.cc:2749] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:52.439291 28483 leader_election.cc:343] T 6ac16ecbdad44d309b75903ff8748aa2 P efb7184756dd41928c127a50037e3672 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:52.439317 28335 leader_election.cc:304] T cac3fbb52a734ffe840da27199a58f05 P 1a5a33ca0108455c9cd1358bf0e50943 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a5a33ca0108455c9cd1358bf0e50943, b234feb6496d4a1cbddaf57ae75ed5e3; no voters: efb7184756dd41928c127a50037e3672
I20260709 13:10:52.440250 28563 raft_consensus.cc:359] T a7c7c56087d64b37af648badd045b987 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.444990 28590 raft_consensus.cc:2804] T cac3fbb52a734ffe840da27199a58f05 P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:52.445423 28590 raft_consensus.cc:493] T cac3fbb52a734ffe840da27199a58f05 P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.445758 28590 raft_consensus.cc:3060] T cac3fbb52a734ffe840da27199a58f05 P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:52.444806 28563 raft_consensus.cc:385] T a7c7c56087d64b37af648badd045b987 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:52.441087 28483 leader_election.cc:304] T 6ac16ecbdad44d309b75903ff8748aa2 P efb7184756dd41928c127a50037e3672 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efb7184756dd41928c127a50037e3672; no voters: 1a5a33ca0108455c9cd1358bf0e50943, b234feb6496d4a1cbddaf57ae75ed5e3
I20260709 13:10:52.448746 28597 raft_consensus.cc:2749] T 6ac16ecbdad44d309b75903ff8748aa2 P efb7184756dd41928c127a50037e3672 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:52.447310 28563 raft_consensus.cc:740] T a7c7c56087d64b37af648badd045b987 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b234feb6496d4a1cbddaf57ae75ed5e3, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.454119 28483 leader_election.cc:304] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a5a33ca0108455c9cd1358bf0e50943, efb7184756dd41928c127a50037e3672; no voters: b234feb6496d4a1cbddaf57ae75ed5e3
I20260709 13:10:52.451289 28561 raft_consensus.cc:359] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.451361 28563 consensus_queue.cc:260] T a7c7c56087d64b37af648badd045b987 P b234feb6496d4a1cbddaf57ae75ed5e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.456447 28597 raft_consensus.cc:2804] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:52.457715 28597 raft_consensus.cc:493] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:52.457727 28483 leader_election.cc:343] T a24e93a2f6ca4b23b4d193527621e98b P efb7184756dd41928c127a50037e3672 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:52.458201 28597 raft_consensus.cc:3060] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:52.455749 28561 raft_consensus.cc:385] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:52.458458 28483 leader_election.cc:304] T a24e93a2f6ca4b23b4d193527621e98b P efb7184756dd41928c127a50037e3672 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efb7184756dd41928c127a50037e3672; no voters: 1a5a33ca0108455c9cd1358bf0e50943, b234feb6496d4a1cbddaf57ae75ed5e3
I20260709 13:10:52.459234 28561 raft_consensus.cc:740] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a5a33ca0108455c9cd1358bf0e50943, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.461882 28569 raft_consensus.cc:2749] T a24e93a2f6ca4b23b4d193527621e98b P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:52.464609 28567 raft_consensus.cc:493] T 48ef7adf3ca24d4ba44c678da62b64bb P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.465893 28567 raft_consensus.cc:515] T 48ef7adf3ca24d4ba44c678da62b64bb P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.462518 28561 consensus_queue.cc:260] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.469779 28562 tablet_bootstrap.cc:654] T 178f126036d74fc1aa8e7db809be61d0 P efb7184756dd41928c127a50037e3672: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:52.471587 28444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ef7adf3ca24d4ba44c678da62b64bb" candidate_uuid: "1a5a33ca0108455c9cd1358bf0e50943" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" is_pre_election: true
I20260709 13:10:52.480353 28567 leader_election.cc:290] T 48ef7adf3ca24d4ba44c678da62b64bb P 1a5a33ca0108455c9cd1358bf0e50943 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130:40891), efb7184756dd41928c127a50037e3672 (127.27.146.131:41969)
W20260709 13:10:52.480814 28335 leader_election.cc:343] T 48ef7adf3ca24d4ba44c678da62b64bb P 1a5a33ca0108455c9cd1358bf0e50943 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130:40891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:52.481969 28518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ef7adf3ca24d4ba44c678da62b64bb" candidate_uuid: "1a5a33ca0108455c9cd1358bf0e50943" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efb7184756dd41928c127a50037e3672" is_pre_election: true
I20260709 13:10:52.484936 28518 raft_consensus.cc:2468] T 48ef7adf3ca24d4ba44c678da62b64bb P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a5a33ca0108455c9cd1358bf0e50943 in term 0.
I20260709 13:10:52.471287 28597 raft_consensus.cc:515] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.486627 28332 leader_election.cc:304] T 48ef7adf3ca24d4ba44c678da62b64bb P 1a5a33ca0108455c9cd1358bf0e50943 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a5a33ca0108455c9cd1358bf0e50943, efb7184756dd41928c127a50037e3672; no voters: b234feb6496d4a1cbddaf57ae75ed5e3
I20260709 13:10:52.513890 28567 raft_consensus.cc:2804] T 48ef7adf3ca24d4ba44c678da62b64bb P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:52.515764 28597 leader_election.cc:290] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [CANDIDATE]: Term 1 election: Requested vote from peers 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037), b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130:40891)
I20260709 13:10:52.514340 28567 raft_consensus.cc:493] T 48ef7adf3ca24d4ba44c678da62b64bb P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.521209 28567 raft_consensus.cc:3060] T 48ef7adf3ca24d4ba44c678da62b64bb P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:52.516893 28590 raft_consensus.cc:515] T cac3fbb52a734ffe840da27199a58f05 P 1a5a33ca0108455c9cd1358bf0e50943 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.521981 28444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7c7c56087d64b37af648badd045b987" candidate_uuid: "efb7184756dd41928c127a50037e3672" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
I20260709 13:10:52.522663 28444 raft_consensus.cc:3060] T a7c7c56087d64b37af648badd045b987 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:52.520241 28563 ts_tablet_manager.cc:1434] T a7c7c56087d64b37af648badd045b987 P b234feb6496d4a1cbddaf57ae75ed5e3: Time spent starting tablet: real 0.097s	user 0.010s	sys 0.000s
I20260709 13:10:52.526222 28590 leader_election.cc:290] T cac3fbb52a734ffe840da27199a58f05 P 1a5a33ca0108455c9cd1358bf0e50943 [CANDIDATE]: Term 1 election: Requested vote from peers b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130:40891), efb7184756dd41928c127a50037e3672 (127.27.146.131:41969)
W20260709 13:10:52.524951 28483 leader_election.cc:343] T cd08ca5dee984515ad04c435411426e3 P efb7184756dd41928c127a50037e3672 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:52.528023 28563 tablet_bootstrap.cc:492] T 48ef7adf3ca24d4ba44c678da62b64bb P b234feb6496d4a1cbddaf57ae75ed5e3: Bootstrap starting.
I20260709 13:10:52.530529 28561 ts_tablet_manager.cc:1434] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943: Time spent starting tablet: real 0.094s	user 0.003s	sys 0.014s
I20260709 13:10:52.532794 28590 raft_consensus.cc:493] T 178f126036d74fc1aa8e7db809be61d0 P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.534413 28590 raft_consensus.cc:515] T 178f126036d74fc1aa8e7db809be61d0 P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.531838 28561 tablet_bootstrap.cc:492] T cd08ca5dee984515ad04c435411426e3 P 1a5a33ca0108455c9cd1358bf0e50943: Bootstrap starting.
I20260709 13:10:52.538084 28442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac3fbb52a734ffe840da27199a58f05" candidate_uuid: "1a5a33ca0108455c9cd1358bf0e50943" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
I20260709 13:10:52.540144 28443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "178f126036d74fc1aa8e7db809be61d0" candidate_uuid: "1a5a33ca0108455c9cd1358bf0e50943" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" is_pre_election: true
I20260709 13:10:52.540563 28590 leader_election.cc:290] T 178f126036d74fc1aa8e7db809be61d0 P 1a5a33ca0108455c9cd1358bf0e50943 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130:40891), efb7184756dd41928c127a50037e3672 (127.27.146.131:41969)
I20260709 13:10:52.542026 28442 raft_consensus.cc:3060] T cac3fbb52a734ffe840da27199a58f05 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:52.542897 28335 leader_election.cc:343] T 178f126036d74fc1aa8e7db809be61d0 P 1a5a33ca0108455c9cd1358bf0e50943 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130:40891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:52.542039 28517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "178f126036d74fc1aa8e7db809be61d0" candidate_uuid: "1a5a33ca0108455c9cd1358bf0e50943" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efb7184756dd41928c127a50037e3672" is_pre_election: true
I20260709 13:10:52.546690 28567 raft_consensus.cc:515] T 48ef7adf3ca24d4ba44c678da62b64bb P 1a5a33ca0108455c9cd1358bf0e50943 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.547711 28518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac3fbb52a734ffe840da27199a58f05" candidate_uuid: "1a5a33ca0108455c9cd1358bf0e50943" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efb7184756dd41928c127a50037e3672"
W20260709 13:10:52.549891 28332 leader_election.cc:343] T 178f126036d74fc1aa8e7db809be61d0 P 1a5a33ca0108455c9cd1358bf0e50943 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer efb7184756dd41928c127a50037e3672 (127.27.146.131:41969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:52.550577 28332 leader_election.cc:304] T 178f126036d74fc1aa8e7db809be61d0 P 1a5a33ca0108455c9cd1358bf0e50943 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a5a33ca0108455c9cd1358bf0e50943; no voters: b234feb6496d4a1cbddaf57ae75ed5e3, efb7184756dd41928c127a50037e3672
I20260709 13:10:52.550819 28443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ef7adf3ca24d4ba44c678da62b64bb" candidate_uuid: "1a5a33ca0108455c9cd1358bf0e50943" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
I20260709 13:10:52.533432 28483 leader_election.cc:304] T cd08ca5dee984515ad04c435411426e3 P efb7184756dd41928c127a50037e3672 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efb7184756dd41928c127a50037e3672; no voters: 1a5a33ca0108455c9cd1358bf0e50943, b234feb6496d4a1cbddaf57ae75ed5e3
I20260709 13:10:52.554632 28597 raft_consensus.cc:2749] T cd08ca5dee984515ad04c435411426e3 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:52.552961 28590 raft_consensus.cc:2749] T 178f126036d74fc1aa8e7db809be61d0 P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:52.552958 28332 leader_election.cc:343] T cac3fbb52a734ffe840da27199a58f05 P 1a5a33ca0108455c9cd1358bf0e50943 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer efb7184756dd41928c127a50037e3672 (127.27.146.131:41969): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:52.559397 28407 leader_election.cc:304] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b234feb6496d4a1cbddaf57ae75ed5e3, efb7184756dd41928c127a50037e3672; no voters: 1a5a33ca0108455c9cd1358bf0e50943
I20260709 13:10:52.560493 28568 raft_consensus.cc:2804] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:52.561501 28568 raft_consensus.cc:697] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 LEADER]: Becoming Leader. State: Replica: b234feb6496d4a1cbddaf57ae75ed5e3, State: Running, Role: LEADER
I20260709 13:10:52.563302 28562 tablet_bootstrap.cc:492] T 178f126036d74fc1aa8e7db809be61d0 P efb7184756dd41928c127a50037e3672: No bootstrap required, opened a new log
I20260709 13:10:52.562690 28568 consensus_queue.cc:237] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.565325 28563 tablet_bootstrap.cc:654] T 48ef7adf3ca24d4ba44c678da62b64bb P b234feb6496d4a1cbddaf57ae75ed5e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:52.565387 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7c7c56087d64b37af648badd045b987" candidate_uuid: "efb7184756dd41928c127a50037e3672" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943"
I20260709 13:10:52.563853 28562 ts_tablet_manager.cc:1403] T 178f126036d74fc1aa8e7db809be61d0 P efb7184756dd41928c127a50037e3672: Time spent bootstrapping tablet: real 0.155s	user 0.007s	sys 0.029s
I20260709 13:10:52.566078 28366 raft_consensus.cc:3060] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:52.558569 28335 leader_election.cc:343] T 48ef7adf3ca24d4ba44c678da62b64bb P 1a5a33ca0108455c9cd1358bf0e50943 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130:40891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:52.568372 28442 raft_consensus.cc:2468] T cac3fbb52a734ffe840da27199a58f05 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a5a33ca0108455c9cd1358bf0e50943 in term 1.
I20260709 13:10:52.568536 28567 leader_election.cc:290] T 48ef7adf3ca24d4ba44c678da62b64bb P 1a5a33ca0108455c9cd1358bf0e50943 [CANDIDATE]: Term 1 election: Requested vote from peers b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130:40891), efb7184756dd41928c127a50037e3672 (127.27.146.131:41969)
I20260709 13:10:52.575150 28562 raft_consensus.cc:359] T 178f126036d74fc1aa8e7db809be61d0 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.576107 28562 raft_consensus.cc:385] T 178f126036d74fc1aa8e7db809be61d0 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:52.575562 28518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ef7adf3ca24d4ba44c678da62b64bb" candidate_uuid: "1a5a33ca0108455c9cd1358bf0e50943" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efb7184756dd41928c127a50037e3672"
I20260709 13:10:52.576495 28562 raft_consensus.cc:740] T 178f126036d74fc1aa8e7db809be61d0 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efb7184756dd41928c127a50037e3672, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.576825 28518 raft_consensus.cc:3060] T 48ef7adf3ca24d4ba44c678da62b64bb P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:52.575294 28335 leader_election.cc:304] T cac3fbb52a734ffe840da27199a58f05 P 1a5a33ca0108455c9cd1358bf0e50943 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a5a33ca0108455c9cd1358bf0e50943, b234feb6496d4a1cbddaf57ae75ed5e3; no voters: efb7184756dd41928c127a50037e3672
I20260709 13:10:52.579242 28562 consensus_queue.cc:260] T 178f126036d74fc1aa8e7db809be61d0 P efb7184756dd41928c127a50037e3672 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.578735 28567 raft_consensus.cc:2804] T cac3fbb52a734ffe840da27199a58f05 P 1a5a33ca0108455c9cd1358bf0e50943 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:52.590276 28562 ts_tablet_manager.cc:1434] T 178f126036d74fc1aa8e7db809be61d0 P efb7184756dd41928c127a50037e3672: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.000s
I20260709 13:10:52.591781 28444 raft_consensus.cc:2468] T a7c7c56087d64b37af648badd045b987 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efb7184756dd41928c127a50037e3672 in term 1.
I20260709 13:10:52.586349 28567 raft_consensus.cc:697] T cac3fbb52a734ffe840da27199a58f05 P 1a5a33ca0108455c9cd1358bf0e50943 [term 1 LEADER]: Becoming Leader. State: Replica: 1a5a33ca0108455c9cd1358bf0e50943, State: Running, Role: LEADER
I20260709 13:10:52.594486 28562 tablet_bootstrap.cc:492] T cac3fbb52a734ffe840da27199a58f05 P efb7184756dd41928c127a50037e3672: Bootstrap starting.
I20260709 13:10:52.595964 28561 tablet_bootstrap.cc:654] T cd08ca5dee984515ad04c435411426e3 P 1a5a33ca0108455c9cd1358bf0e50943: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:52.600351 28484 leader_election.cc:304] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b234feb6496d4a1cbddaf57ae75ed5e3, efb7184756dd41928c127a50037e3672; no voters: 
I20260709 13:10:52.602643 28597 raft_consensus.cc:2804] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:52.603226 28597 raft_consensus.cc:697] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [term 1 LEADER]: Becoming Leader. State: Replica: efb7184756dd41928c127a50037e3672, State: Running, Role: LEADER
I20260709 13:10:52.605392 28597 consensus_queue.cc:237] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.608826 28563 tablet_bootstrap.cc:492] T 48ef7adf3ca24d4ba44c678da62b64bb P b234feb6496d4a1cbddaf57ae75ed5e3: No bootstrap required, opened a new log
I20260709 13:10:52.609407 28563 ts_tablet_manager.cc:1403] T 48ef7adf3ca24d4ba44c678da62b64bb P b234feb6496d4a1cbddaf57ae75ed5e3: Time spent bootstrapping tablet: real 0.082s	user 0.017s	sys 0.000s
I20260709 13:10:52.609359 28562 tablet_bootstrap.cc:654] T cac3fbb52a734ffe840da27199a58f05 P efb7184756dd41928c127a50037e3672: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:52.613451 28518 raft_consensus.cc:2468] T 48ef7adf3ca24d4ba44c678da62b64bb P efb7184756dd41928c127a50037e3672 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a5a33ca0108455c9cd1358bf0e50943 in term 1.
I20260709 13:10:52.602406 28567 consensus_queue.cc:237] T cac3fbb52a734ffe840da27199a58f05 P 1a5a33ca0108455c9cd1358bf0e50943 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.614043 28366 raft_consensus.cc:2468] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efb7184756dd41928c127a50037e3672 in term 1.
I20260709 13:10:52.616812 28332 leader_election.cc:304] T 48ef7adf3ca24d4ba44c678da62b64bb P 1a5a33ca0108455c9cd1358bf0e50943 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a5a33ca0108455c9cd1358bf0e50943, efb7184756dd41928c127a50037e3672; no voters: b234feb6496d4a1cbddaf57ae75ed5e3
I20260709 13:10:52.620002 28590 raft_consensus.cc:2804] T 48ef7adf3ca24d4ba44c678da62b64bb P 1a5a33ca0108455c9cd1358bf0e50943 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:52.620692 28590 raft_consensus.cc:697] T 48ef7adf3ca24d4ba44c678da62b64bb P 1a5a33ca0108455c9cd1358bf0e50943 [term 1 LEADER]: Becoming Leader. State: Replica: 1a5a33ca0108455c9cd1358bf0e50943, State: Running, Role: LEADER
I20260709 13:10:52.615083 28563 raft_consensus.cc:359] T 48ef7adf3ca24d4ba44c678da62b64bb P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.624236 28563 raft_consensus.cc:385] T 48ef7adf3ca24d4ba44c678da62b64bb P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:52.626665 28563 raft_consensus.cc:740] T 48ef7adf3ca24d4ba44c678da62b64bb P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b234feb6496d4a1cbddaf57ae75ed5e3, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.625933 28590 consensus_queue.cc:237] T 48ef7adf3ca24d4ba44c678da62b64bb P 1a5a33ca0108455c9cd1358bf0e50943 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.631582 28563 consensus_queue.cc:260] T 48ef7adf3ca24d4ba44c678da62b64bb P b234feb6496d4a1cbddaf57ae75ed5e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.640187 28562 tablet_bootstrap.cc:492] T cac3fbb52a734ffe840da27199a58f05 P efb7184756dd41928c127a50037e3672: No bootstrap required, opened a new log
I20260709 13:10:52.640940 28562 ts_tablet_manager.cc:1403] T cac3fbb52a734ffe840da27199a58f05 P efb7184756dd41928c127a50037e3672: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.007s
I20260709 13:10:52.641547 28563 ts_tablet_manager.cc:1434] T 48ef7adf3ca24d4ba44c678da62b64bb P b234feb6496d4a1cbddaf57ae75ed5e3: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.006s
I20260709 13:10:52.645912 28563 tablet_bootstrap.cc:492] T 178f126036d74fc1aa8e7db809be61d0 P b234feb6496d4a1cbddaf57ae75ed5e3: Bootstrap starting.
I20260709 13:10:52.649588 28561 tablet_bootstrap.cc:492] T cd08ca5dee984515ad04c435411426e3 P 1a5a33ca0108455c9cd1358bf0e50943: No bootstrap required, opened a new log
I20260709 13:10:52.660347 28597 raft_consensus.cc:493] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.656062 28561 ts_tablet_manager.cc:1403] T cd08ca5dee984515ad04c435411426e3 P 1a5a33ca0108455c9cd1358bf0e50943: Time spent bootstrapping tablet: real 0.124s	user 0.014s	sys 0.011s
I20260709 13:10:52.661168 28562 raft_consensus.cc:359] T cac3fbb52a734ffe840da27199a58f05 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.660964 28597 raft_consensus.cc:515] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.661896 28562 raft_consensus.cc:385] T cac3fbb52a734ffe840da27199a58f05 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:52.662272 28562 raft_consensus.cc:740] T cac3fbb52a734ffe840da27199a58f05 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efb7184756dd41928c127a50037e3672, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.663232 28562 consensus_queue.cc:260] T cac3fbb52a734ffe840da27199a58f05 P efb7184756dd41928c127a50037e3672 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.665083 28562 ts_tablet_manager.cc:1434] T cac3fbb52a734ffe840da27199a58f05 P efb7184756dd41928c127a50037e3672: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.010s
I20260709 13:10:52.667757 28597 leader_election.cc:290] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037), b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130:40891)
I20260709 13:10:52.669909 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23939bc50fd04a08925ae3d5508ef5ab" candidate_uuid: "efb7184756dd41928c127a50037e3672" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943" is_pre_election: true
I20260709 13:10:52.672027 28444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23939bc50fd04a08925ae3d5508ef5ab" candidate_uuid: "efb7184756dd41928c127a50037e3672" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" is_pre_election: true
I20260709 13:10:52.673851 28444 raft_consensus.cc:2468] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efb7184756dd41928c127a50037e3672 in term 0.
W20260709 13:10:52.674067 28483 leader_election.cc:343] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:52.675590 28484 leader_election.cc:304] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b234feb6496d4a1cbddaf57ae75ed5e3, efb7184756dd41928c127a50037e3672; no voters: 1a5a33ca0108455c9cd1358bf0e50943
I20260709 13:10:52.677839 28597 raft_consensus.cc:2804] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:52.678349 28597 raft_consensus.cc:493] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.678728 28597 raft_consensus.cc:3060] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:52.678057 28561 raft_consensus.cc:359] T cd08ca5dee984515ad04c435411426e3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.683174 28561 raft_consensus.cc:385] T cd08ca5dee984515ad04c435411426e3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:52.683570 28561 raft_consensus.cc:740] T cd08ca5dee984515ad04c435411426e3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a5a33ca0108455c9cd1358bf0e50943, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.684703 28561 consensus_queue.cc:260] T cd08ca5dee984515ad04c435411426e3 P 1a5a33ca0108455c9cd1358bf0e50943 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.681699 28262 catalog_manager.cc:5697] T cac3fbb52a734ffe840da27199a58f05 P 1a5a33ca0108455c9cd1358bf0e50943 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "1a5a33ca0108455c9cd1358bf0e50943" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:52.689967 28561 ts_tablet_manager.cc:1434] T cd08ca5dee984515ad04c435411426e3 P 1a5a33ca0108455c9cd1358bf0e50943: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.003s
I20260709 13:10:52.691586 28561 tablet_bootstrap.cc:492] T a24e93a2f6ca4b23b4d193527621e98b P 1a5a33ca0108455c9cd1358bf0e50943: Bootstrap starting.
I20260709 13:10:52.696941 28563 tablet_bootstrap.cc:654] T 178f126036d74fc1aa8e7db809be61d0 P b234feb6496d4a1cbddaf57ae75ed5e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:52.701486 28597 raft_consensus.cc:515] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.704442 28597 leader_election.cc:290] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [CANDIDATE]: Term 1 election: Requested vote from peers 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037), b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130:40891)
I20260709 13:10:52.705430 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23939bc50fd04a08925ae3d5508ef5ab" candidate_uuid: "efb7184756dd41928c127a50037e3672" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943"
I20260709 13:10:52.706419 28561 tablet_bootstrap.cc:654] T a24e93a2f6ca4b23b4d193527621e98b P 1a5a33ca0108455c9cd1358bf0e50943: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:52.706703 28444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23939bc50fd04a08925ae3d5508ef5ab" candidate_uuid: "efb7184756dd41928c127a50037e3672" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
W20260709 13:10:52.707089 28483 leader_election.cc:343] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:52.707336 28444 raft_consensus.cc:3060] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:52.706914 28263 catalog_manager.cc:5697] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130). New cstate: current_term: 1 leader_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:52.718288 28561 tablet_bootstrap.cc:492] T a24e93a2f6ca4b23b4d193527621e98b P 1a5a33ca0108455c9cd1358bf0e50943: No bootstrap required, opened a new log
I20260709 13:10:52.718829 28561 ts_tablet_manager.cc:1403] T a24e93a2f6ca4b23b4d193527621e98b P 1a5a33ca0108455c9cd1358bf0e50943: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.009s
I20260709 13:10:52.723919 28444 raft_consensus.cc:2468] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efb7184756dd41928c127a50037e3672 in term 1.
I20260709 13:10:52.726449 28484 leader_election.cc:304] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b234feb6496d4a1cbddaf57ae75ed5e3, efb7184756dd41928c127a50037e3672; no voters: 1a5a33ca0108455c9cd1358bf0e50943
I20260709 13:10:52.727406 28561 raft_consensus.cc:359] T a24e93a2f6ca4b23b4d193527621e98b P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.728278 28561 raft_consensus.cc:385] T a24e93a2f6ca4b23b4d193527621e98b P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:52.728650 28561 raft_consensus.cc:740] T a24e93a2f6ca4b23b4d193527621e98b P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a5a33ca0108455c9cd1358bf0e50943, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.728000 28265 catalog_manager.cc:5697] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 reported cstate change: term changed from 0 to 1, leader changed from <none> to efb7184756dd41928c127a50037e3672 (127.27.146.131). New cstate: current_term: 1 leader_uuid: "efb7184756dd41928c127a50037e3672" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:52.729386 28561 consensus_queue.cc:260] T a24e93a2f6ca4b23b4d193527621e98b P 1a5a33ca0108455c9cd1358bf0e50943 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.730855 28597 raft_consensus.cc:2804] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:52.731714 28561 ts_tablet_manager.cc:1434] T a24e93a2f6ca4b23b4d193527621e98b P 1a5a33ca0108455c9cd1358bf0e50943: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:10:52.730983 28262 catalog_manager.cc:5697] T 48ef7adf3ca24d4ba44c678da62b64bb P 1a5a33ca0108455c9cd1358bf0e50943 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "1a5a33ca0108455c9cd1358bf0e50943" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:52.732784 28561 tablet_bootstrap.cc:492] T 23939bc50fd04a08925ae3d5508ef5ab P 1a5a33ca0108455c9cd1358bf0e50943: Bootstrap starting.
I20260709 13:10:52.740258 28597 raft_consensus.cc:697] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [term 1 LEADER]: Becoming Leader. State: Replica: efb7184756dd41928c127a50037e3672, State: Running, Role: LEADER
I20260709 13:10:52.741128 28561 tablet_bootstrap.cc:654] T 23939bc50fd04a08925ae3d5508ef5ab P 1a5a33ca0108455c9cd1358bf0e50943: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:52.741560 28597 consensus_queue.cc:237] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.762583 28563 tablet_bootstrap.cc:492] T 178f126036d74fc1aa8e7db809be61d0 P b234feb6496d4a1cbddaf57ae75ed5e3: No bootstrap required, opened a new log
I20260709 13:10:52.763717 28563 ts_tablet_manager.cc:1403] T 178f126036d74fc1aa8e7db809be61d0 P b234feb6496d4a1cbddaf57ae75ed5e3: Time spent bootstrapping tablet: real 0.118s	user 0.020s	sys 0.001s
I20260709 13:10:52.770022 28568 raft_consensus.cc:493] T 48ef7adf3ca24d4ba44c678da62b64bb P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.768808 28265 catalog_manager.cc:5697] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 reported cstate change: term changed from 0 to 1, leader changed from <none> to efb7184756dd41928c127a50037e3672 (127.27.146.131). New cstate: current_term: 1 leader_uuid: "efb7184756dd41928c127a50037e3672" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:52.770889 28568 raft_consensus.cc:515] T 48ef7adf3ca24d4ba44c678da62b64bb P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.774334 28568 leader_election.cc:290] T 48ef7adf3ca24d4ba44c678da62b64bb P b234feb6496d4a1cbddaf57ae75ed5e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037), efb7184756dd41928c127a50037e3672 (127.27.146.131:41969)
I20260709 13:10:52.775065 28518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ef7adf3ca24d4ba44c678da62b64bb" candidate_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efb7184756dd41928c127a50037e3672" is_pre_election: true
I20260709 13:10:52.775223 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ef7adf3ca24d4ba44c678da62b64bb" candidate_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943" is_pre_election: true
I20260709 13:10:52.775976 28518 raft_consensus.cc:2393] T 48ef7adf3ca24d4ba44c678da62b64bb P efb7184756dd41928c127a50037e3672 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b234feb6496d4a1cbddaf57ae75ed5e3 in current term 1: Already voted for candidate 1a5a33ca0108455c9cd1358bf0e50943 in this term.
I20260709 13:10:52.777339 28407 leader_election.cc:304] T 48ef7adf3ca24d4ba44c678da62b64bb P b234feb6496d4a1cbddaf57ae75ed5e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b234feb6496d4a1cbddaf57ae75ed5e3; no voters: 1a5a33ca0108455c9cd1358bf0e50943, efb7184756dd41928c127a50037e3672
I20260709 13:10:52.777480 28563 raft_consensus.cc:359] T 178f126036d74fc1aa8e7db809be61d0 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.779145 28563 raft_consensus.cc:385] T 178f126036d74fc1aa8e7db809be61d0 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:52.780078 28563 raft_consensus.cc:740] T 178f126036d74fc1aa8e7db809be61d0 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b234feb6496d4a1cbddaf57ae75ed5e3, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.784479 28568 raft_consensus.cc:3060] T 48ef7adf3ca24d4ba44c678da62b64bb P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:52.785782 28590 raft_consensus.cc:493] T cd08ca5dee984515ad04c435411426e3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.786298 28590 raft_consensus.cc:515] T cd08ca5dee984515ad04c435411426e3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.781193 28563 consensus_queue.cc:260] T 178f126036d74fc1aa8e7db809be61d0 P b234feb6496d4a1cbddaf57ae75ed5e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.789945 28590 leader_election.cc:290] T cd08ca5dee984515ad04c435411426e3 P 1a5a33ca0108455c9cd1358bf0e50943 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130:40891), efb7184756dd41928c127a50037e3672 (127.27.146.131:41969)
I20260709 13:10:52.790896 28444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd08ca5dee984515ad04c435411426e3" candidate_uuid: "1a5a33ca0108455c9cd1358bf0e50943" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" is_pre_election: true
W20260709 13:10:52.792658 28335 leader_election.cc:343] T cd08ca5dee984515ad04c435411426e3 P 1a5a33ca0108455c9cd1358bf0e50943 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130:40891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:52.792214 28518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd08ca5dee984515ad04c435411426e3" candidate_uuid: "1a5a33ca0108455c9cd1358bf0e50943" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efb7184756dd41928c127a50037e3672" is_pre_election: true
I20260709 13:10:52.793934 28518 raft_consensus.cc:2468] T cd08ca5dee984515ad04c435411426e3 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a5a33ca0108455c9cd1358bf0e50943 in term 0.
I20260709 13:10:52.795918 28332 leader_election.cc:304] T cd08ca5dee984515ad04c435411426e3 P 1a5a33ca0108455c9cd1358bf0e50943 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a5a33ca0108455c9cd1358bf0e50943, efb7184756dd41928c127a50037e3672; no voters: b234feb6496d4a1cbddaf57ae75ed5e3
I20260709 13:10:52.796342 28563 ts_tablet_manager.cc:1434] T 178f126036d74fc1aa8e7db809be61d0 P b234feb6496d4a1cbddaf57ae75ed5e3: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.003s
I20260709 13:10:52.797115 28590 raft_consensus.cc:2804] T cd08ca5dee984515ad04c435411426e3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:52.797515 28590 raft_consensus.cc:493] T cd08ca5dee984515ad04c435411426e3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.797421 28563 tablet_bootstrap.cc:492] T cd08ca5dee984515ad04c435411426e3 P b234feb6496d4a1cbddaf57ae75ed5e3: Bootstrap starting.
I20260709 13:10:52.797967 28590 raft_consensus.cc:3060] T cd08ca5dee984515ad04c435411426e3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:52.803020 28593 consensus_queue.cc:1048] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:52.804431 28561 tablet_bootstrap.cc:492] T 23939bc50fd04a08925ae3d5508ef5ab P 1a5a33ca0108455c9cd1358bf0e50943: No bootstrap required, opened a new log
I20260709 13:10:52.804931 28561 ts_tablet_manager.cc:1403] T 23939bc50fd04a08925ae3d5508ef5ab P 1a5a33ca0108455c9cd1358bf0e50943: Time spent bootstrapping tablet: real 0.072s	user 0.031s	sys 0.025s
I20260709 13:10:52.808072 28561 raft_consensus.cc:359] T 23939bc50fd04a08925ae3d5508ef5ab P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.809319 28561 raft_consensus.cc:385] T 23939bc50fd04a08925ae3d5508ef5ab P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:52.809608 28561 raft_consensus.cc:740] T 23939bc50fd04a08925ae3d5508ef5ab P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a5a33ca0108455c9cd1358bf0e50943, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.810374 28568 raft_consensus.cc:2749] T 48ef7adf3ca24d4ba44c678da62b64bb P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:52.810328 28561 consensus_queue.cc:260] T 23939bc50fd04a08925ae3d5508ef5ab P 1a5a33ca0108455c9cd1358bf0e50943 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.813607 28561 ts_tablet_manager.cc:1434] T 23939bc50fd04a08925ae3d5508ef5ab P 1a5a33ca0108455c9cd1358bf0e50943: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:10:52.823443 28590 raft_consensus.cc:515] T cd08ca5dee984515ad04c435411426e3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.825172 28563 tablet_bootstrap.cc:654] T cd08ca5dee984515ad04c435411426e3 P b234feb6496d4a1cbddaf57ae75ed5e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:52.828720 28444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd08ca5dee984515ad04c435411426e3" candidate_uuid: "1a5a33ca0108455c9cd1358bf0e50943" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
I20260709 13:10:52.829684 28518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd08ca5dee984515ad04c435411426e3" candidate_uuid: "1a5a33ca0108455c9cd1358bf0e50943" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efb7184756dd41928c127a50037e3672"
I20260709 13:10:52.830283 28518 raft_consensus.cc:3060] T cd08ca5dee984515ad04c435411426e3 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:52.830346 28335 leader_election.cc:343] T cd08ca5dee984515ad04c435411426e3 P 1a5a33ca0108455c9cd1358bf0e50943 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130:40891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:52.838297 28518 raft_consensus.cc:2468] T cd08ca5dee984515ad04c435411426e3 P efb7184756dd41928c127a50037e3672 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a5a33ca0108455c9cd1358bf0e50943 in term 1.
I20260709 13:10:52.839694 28332 leader_election.cc:304] T cd08ca5dee984515ad04c435411426e3 P 1a5a33ca0108455c9cd1358bf0e50943 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a5a33ca0108455c9cd1358bf0e50943, efb7184756dd41928c127a50037e3672; no voters: b234feb6496d4a1cbddaf57ae75ed5e3
I20260709 13:10:52.840716 28567 raft_consensus.cc:2804] T cd08ca5dee984515ad04c435411426e3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:52.841517 28567 raft_consensus.cc:697] T cd08ca5dee984515ad04c435411426e3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 1 LEADER]: Becoming Leader. State: Replica: 1a5a33ca0108455c9cd1358bf0e50943, State: Running, Role: LEADER
I20260709 13:10:52.841599 28590 leader_election.cc:290] T cd08ca5dee984515ad04c435411426e3 P 1a5a33ca0108455c9cd1358bf0e50943 [CANDIDATE]: Term 1 election: Requested vote from peers b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130:40891), efb7184756dd41928c127a50037e3672 (127.27.146.131:41969)
I20260709 13:10:52.842438 28567 consensus_queue.cc:237] T cd08ca5dee984515ad04c435411426e3 P 1a5a33ca0108455c9cd1358bf0e50943 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.844069 28563 tablet_bootstrap.cc:492] T cd08ca5dee984515ad04c435411426e3 P b234feb6496d4a1cbddaf57ae75ed5e3: No bootstrap required, opened a new log
I20260709 13:10:52.844569 28563 ts_tablet_manager.cc:1403] T cd08ca5dee984515ad04c435411426e3 P b234feb6496d4a1cbddaf57ae75ed5e3: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.000s
I20260709 13:10:52.850406 28563 raft_consensus.cc:359] T cd08ca5dee984515ad04c435411426e3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.851624 28563 raft_consensus.cc:385] T cd08ca5dee984515ad04c435411426e3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:52.852192 28563 raft_consensus.cc:740] T cd08ca5dee984515ad04c435411426e3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b234feb6496d4a1cbddaf57ae75ed5e3, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.864815 28563 consensus_queue.cc:260] T cd08ca5dee984515ad04c435411426e3 P b234feb6496d4a1cbddaf57ae75ed5e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.874644 28590 raft_consensus.cc:493] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.875443 28590 raft_consensus.cc:515] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.879566 28444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac16ecbdad44d309b75903ff8748aa2" candidate_uuid: "1a5a33ca0108455c9cd1358bf0e50943" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" is_pre_election: true
I20260709 13:10:52.880788 28563 ts_tablet_manager.cc:1434] T cd08ca5dee984515ad04c435411426e3 P b234feb6496d4a1cbddaf57ae75ed5e3: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.003s
I20260709 13:10:52.881826 28563 tablet_bootstrap.cc:492] T a24e93a2f6ca4b23b4d193527621e98b P b234feb6496d4a1cbddaf57ae75ed5e3: Bootstrap starting.
I20260709 13:10:52.882902 28593 consensus_queue.cc:1048] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:52.883411 28590 leader_election.cc:290] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130:40891), efb7184756dd41928c127a50037e3672 (127.27.146.131:41969)
I20260709 13:10:52.884202 28518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac16ecbdad44d309b75903ff8748aa2" candidate_uuid: "1a5a33ca0108455c9cd1358bf0e50943" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efb7184756dd41928c127a50037e3672" is_pre_election: true
I20260709 13:10:52.885076 28518 raft_consensus.cc:2393] T 6ac16ecbdad44d309b75903ff8748aa2 P efb7184756dd41928c127a50037e3672 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a5a33ca0108455c9cd1358bf0e50943 in current term 1: Already voted for candidate b234feb6496d4a1cbddaf57ae75ed5e3 in this term.
I20260709 13:10:52.886417 28332 leader_election.cc:304] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a5a33ca0108455c9cd1358bf0e50943; no voters: b234feb6496d4a1cbddaf57ae75ed5e3, efb7184756dd41928c127a50037e3672
I20260709 13:10:52.887416 28567 raft_consensus.cc:3060] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:52.895743 28265 catalog_manager.cc:5697] T cd08ca5dee984515ad04c435411426e3 P 1a5a33ca0108455c9cd1358bf0e50943 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "1a5a33ca0108455c9cd1358bf0e50943" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:52.897022 28567 raft_consensus.cc:2749] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:52.901039 28563 tablet_bootstrap.cc:654] T a24e93a2f6ca4b23b4d193527621e98b P b234feb6496d4a1cbddaf57ae75ed5e3: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:52.929836 28409 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:36037, user_credentials={real_user=slave}} blocked reactor thread for 60431us
I20260709 13:10:52.931267 28563 tablet_bootstrap.cc:492] T a24e93a2f6ca4b23b4d193527621e98b P b234feb6496d4a1cbddaf57ae75ed5e3: No bootstrap required, opened a new log
I20260709 13:10:52.931788 28563 ts_tablet_manager.cc:1403] T a24e93a2f6ca4b23b4d193527621e98b P b234feb6496d4a1cbddaf57ae75ed5e3: Time spent bootstrapping tablet: real 0.050s	user 0.019s	sys 0.017s
I20260709 13:10:52.944654 28623 raft_consensus.cc:493] T cd08ca5dee984515ad04c435411426e3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.945215 28623 raft_consensus.cc:515] T cd08ca5dee984515ad04c435411426e3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.946157 28563 raft_consensus.cc:359] T a24e93a2f6ca4b23b4d193527621e98b P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.946913 28563 raft_consensus.cc:385] T a24e93a2f6ca4b23b4d193527621e98b P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:52.947901 28563 raft_consensus.cc:740] T a24e93a2f6ca4b23b4d193527621e98b P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b234feb6496d4a1cbddaf57ae75ed5e3, State: Initialized, Role: FOLLOWER
I20260709 13:10:52.948235 28623 leader_election.cc:290] T cd08ca5dee984515ad04c435411426e3 P b234feb6496d4a1cbddaf57ae75ed5e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037), efb7184756dd41928c127a50037e3672 (127.27.146.131:41969)
I20260709 13:10:52.949036 28563 consensus_queue.cc:260] T a24e93a2f6ca4b23b4d193527621e98b P b234feb6496d4a1cbddaf57ae75ed5e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.949944 28369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd08ca5dee984515ad04c435411426e3" candidate_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943" is_pre_election: true
I20260709 13:10:52.952121 28563 ts_tablet_manager.cc:1434] T a24e93a2f6ca4b23b4d193527621e98b P b234feb6496d4a1cbddaf57ae75ed5e3: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.002s
I20260709 13:10:52.952042 28518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd08ca5dee984515ad04c435411426e3" candidate_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efb7184756dd41928c127a50037e3672" is_pre_election: true
I20260709 13:10:52.952951 28518 raft_consensus.cc:2393] T cd08ca5dee984515ad04c435411426e3 P efb7184756dd41928c127a50037e3672 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b234feb6496d4a1cbddaf57ae75ed5e3 in current term 1: Already voted for candidate 1a5a33ca0108455c9cd1358bf0e50943 in this term.
I20260709 13:10:52.954176 28407 leader_election.cc:304] T cd08ca5dee984515ad04c435411426e3 P b234feb6496d4a1cbddaf57ae75ed5e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b234feb6496d4a1cbddaf57ae75ed5e3; no voters: 1a5a33ca0108455c9cd1358bf0e50943, efb7184756dd41928c127a50037e3672
I20260709 13:10:52.955395 28593 raft_consensus.cc:3060] T cd08ca5dee984515ad04c435411426e3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:52.964615 28593 raft_consensus.cc:2749] T cd08ca5dee984515ad04c435411426e3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:52.972620 28597 raft_consensus.cc:493] T cac3fbb52a734ffe840da27199a58f05 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.973275 28597 raft_consensus.cc:515] T cac3fbb52a734ffe840da27199a58f05 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.975683 28597 leader_election.cc:290] T cac3fbb52a734ffe840da27199a58f05 P efb7184756dd41928c127a50037e3672 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037), b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130:40891)
I20260709 13:10:52.976630 28369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac3fbb52a734ffe840da27199a58f05" candidate_uuid: "efb7184756dd41928c127a50037e3672" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943" is_pre_election: true
I20260709 13:10:52.976799 28444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac3fbb52a734ffe840da27199a58f05" candidate_uuid: "efb7184756dd41928c127a50037e3672" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" is_pre_election: true
I20260709 13:10:52.977602 28444 raft_consensus.cc:2393] T cac3fbb52a734ffe840da27199a58f05 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efb7184756dd41928c127a50037e3672 in current term 1: Already voted for candidate 1a5a33ca0108455c9cd1358bf0e50943 in this term.
I20260709 13:10:52.978559 28484 leader_election.cc:304] T cac3fbb52a734ffe840da27199a58f05 P efb7184756dd41928c127a50037e3672 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efb7184756dd41928c127a50037e3672; no voters: 1a5a33ca0108455c9cd1358bf0e50943, b234feb6496d4a1cbddaf57ae75ed5e3
I20260709 13:10:52.979334 28597 raft_consensus.cc:3060] T cac3fbb52a734ffe840da27199a58f05 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:52.980738 28569 raft_consensus.cc:493] T 178f126036d74fc1aa8e7db809be61d0 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.981313 28569 raft_consensus.cc:515] T 178f126036d74fc1aa8e7db809be61d0 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.983880 28569 leader_election.cc:290] T 178f126036d74fc1aa8e7db809be61d0 P efb7184756dd41928c127a50037e3672 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037), b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130:40891)
I20260709 13:10:52.984777 28369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "178f126036d74fc1aa8e7db809be61d0" candidate_uuid: "efb7184756dd41928c127a50037e3672" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943" is_pre_election: true
I20260709 13:10:52.985519 28369 raft_consensus.cc:2468] T 178f126036d74fc1aa8e7db809be61d0 P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efb7184756dd41928c127a50037e3672 in term 0.
I20260709 13:10:52.985678 28444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "178f126036d74fc1aa8e7db809be61d0" candidate_uuid: "efb7184756dd41928c127a50037e3672" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" is_pre_election: true
I20260709 13:10:52.986380 28444 raft_consensus.cc:2468] T 178f126036d74fc1aa8e7db809be61d0 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efb7184756dd41928c127a50037e3672 in term 0.
I20260709 13:10:52.986886 28483 leader_election.cc:304] T 178f126036d74fc1aa8e7db809be61d0 P efb7184756dd41928c127a50037e3672 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a5a33ca0108455c9cd1358bf0e50943, efb7184756dd41928c127a50037e3672; no voters: 
I20260709 13:10:52.988305 28569 raft_consensus.cc:2804] T 178f126036d74fc1aa8e7db809be61d0 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:52.988744 28569 raft_consensus.cc:493] T 178f126036d74fc1aa8e7db809be61d0 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.989117 28569 raft_consensus.cc:3060] T 178f126036d74fc1aa8e7db809be61d0 P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:52.989750 28597 raft_consensus.cc:2749] T cac3fbb52a734ffe840da27199a58f05 P efb7184756dd41928c127a50037e3672 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:52.995004 28569 raft_consensus.cc:515] T 178f126036d74fc1aa8e7db809be61d0 P efb7184756dd41928c127a50037e3672 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:52.996990 28569 leader_election.cc:290] T 178f126036d74fc1aa8e7db809be61d0 P efb7184756dd41928c127a50037e3672 [CANDIDATE]: Term 1 election: Requested vote from peers 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037), b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130:40891)
I20260709 13:10:52.998060 28444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "178f126036d74fc1aa8e7db809be61d0" candidate_uuid: "efb7184756dd41928c127a50037e3672" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
I20260709 13:10:52.998063 28369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "178f126036d74fc1aa8e7db809be61d0" candidate_uuid: "efb7184756dd41928c127a50037e3672" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943"
I20260709 13:10:52.998874 28444 raft_consensus.cc:3060] T 178f126036d74fc1aa8e7db809be61d0 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:52.998888 28369 raft_consensus.cc:3060] T 178f126036d74fc1aa8e7db809be61d0 P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:53.007045 28444 raft_consensus.cc:2468] T 178f126036d74fc1aa8e7db809be61d0 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efb7184756dd41928c127a50037e3672 in term 1.
I20260709 13:10:53.007045 28369 raft_consensus.cc:2468] T 178f126036d74fc1aa8e7db809be61d0 P 1a5a33ca0108455c9cd1358bf0e50943 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efb7184756dd41928c127a50037e3672 in term 1.
I20260709 13:10:53.008589 28484 leader_election.cc:304] T 178f126036d74fc1aa8e7db809be61d0 P efb7184756dd41928c127a50037e3672 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b234feb6496d4a1cbddaf57ae75ed5e3, efb7184756dd41928c127a50037e3672; no voters: 
I20260709 13:10:53.009368 28569 raft_consensus.cc:2804] T 178f126036d74fc1aa8e7db809be61d0 P efb7184756dd41928c127a50037e3672 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:53.009865 28569 raft_consensus.cc:697] T 178f126036d74fc1aa8e7db809be61d0 P efb7184756dd41928c127a50037e3672 [term 1 LEADER]: Becoming Leader. State: Replica: efb7184756dd41928c127a50037e3672, State: Running, Role: LEADER
I20260709 13:10:53.010792 28569 consensus_queue.cc:237] T 178f126036d74fc1aa8e7db809be61d0 P efb7184756dd41928c127a50037e3672 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:53.018086 28593 raft_consensus.cc:493] T a24e93a2f6ca4b23b4d193527621e98b P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.018684 28593 raft_consensus.cc:515] T a24e93a2f6ca4b23b4d193527621e98b P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:53.020896 28593 leader_election.cc:290] T a24e93a2f6ca4b23b4d193527621e98b P b234feb6496d4a1cbddaf57ae75ed5e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037), efb7184756dd41928c127a50037e3672 (127.27.146.131:41969)
I20260709 13:10:53.022346 28518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24e93a2f6ca4b23b4d193527621e98b" candidate_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efb7184756dd41928c127a50037e3672" is_pre_election: true
I20260709 13:10:53.021639 28265 catalog_manager.cc:5697] T 178f126036d74fc1aa8e7db809be61d0 P efb7184756dd41928c127a50037e3672 reported cstate change: term changed from 0 to 1, leader changed from <none> to efb7184756dd41928c127a50037e3672 (127.27.146.131). New cstate: current_term: 1 leader_uuid: "efb7184756dd41928c127a50037e3672" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:53.022979 28518 raft_consensus.cc:2468] T a24e93a2f6ca4b23b4d193527621e98b P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b234feb6496d4a1cbddaf57ae75ed5e3 in term 0.
I20260709 13:10:53.023818 28369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24e93a2f6ca4b23b4d193527621e98b" candidate_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943" is_pre_election: true
I20260709 13:10:53.024430 28407 leader_election.cc:304] T a24e93a2f6ca4b23b4d193527621e98b P b234feb6496d4a1cbddaf57ae75ed5e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b234feb6496d4a1cbddaf57ae75ed5e3, efb7184756dd41928c127a50037e3672; no voters: 
I20260709 13:10:53.024617 28369 raft_consensus.cc:2468] T a24e93a2f6ca4b23b4d193527621e98b P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b234feb6496d4a1cbddaf57ae75ed5e3 in term 0.
I20260709 13:10:53.025461 28593 raft_consensus.cc:2804] T a24e93a2f6ca4b23b4d193527621e98b P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:53.025867 28593 raft_consensus.cc:493] T a24e93a2f6ca4b23b4d193527621e98b P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:53.026683 28593 raft_consensus.cc:3060] T a24e93a2f6ca4b23b4d193527621e98b P b234feb6496d4a1cbddaf57ae75ed5e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:53.034584 28593 raft_consensus.cc:515] T a24e93a2f6ca4b23b4d193527621e98b P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:53.036729 28593 leader_election.cc:290] T a24e93a2f6ca4b23b4d193527621e98b P b234feb6496d4a1cbddaf57ae75ed5e3 [CANDIDATE]: Term 1 election: Requested vote from peers 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037), efb7184756dd41928c127a50037e3672 (127.27.146.131:41969)
I20260709 13:10:53.038004 28518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24e93a2f6ca4b23b4d193527621e98b" candidate_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efb7184756dd41928c127a50037e3672"
I20260709 13:10:53.038061 28369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24e93a2f6ca4b23b4d193527621e98b" candidate_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943"
I20260709 13:10:53.038615 28518 raft_consensus.cc:3060] T a24e93a2f6ca4b23b4d193527621e98b P efb7184756dd41928c127a50037e3672 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:53.038749 28369 raft_consensus.cc:3060] T a24e93a2f6ca4b23b4d193527621e98b P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:53.044499 28518 raft_consensus.cc:2468] T a24e93a2f6ca4b23b4d193527621e98b P efb7184756dd41928c127a50037e3672 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b234feb6496d4a1cbddaf57ae75ed5e3 in term 1.
I20260709 13:10:53.045779 28407 leader_election.cc:304] T a24e93a2f6ca4b23b4d193527621e98b P b234feb6496d4a1cbddaf57ae75ed5e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b234feb6496d4a1cbddaf57ae75ed5e3, efb7184756dd41928c127a50037e3672; no voters: 
I20260709 13:10:53.046156 28369 raft_consensus.cc:2468] T a24e93a2f6ca4b23b4d193527621e98b P 1a5a33ca0108455c9cd1358bf0e50943 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b234feb6496d4a1cbddaf57ae75ed5e3 in term 1.
I20260709 13:10:53.046543 28593 raft_consensus.cc:2804] T a24e93a2f6ca4b23b4d193527621e98b P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:53.047093 28593 raft_consensus.cc:697] T a24e93a2f6ca4b23b4d193527621e98b P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 LEADER]: Becoming Leader. State: Replica: b234feb6496d4a1cbddaf57ae75ed5e3, State: Running, Role: LEADER
I20260709 13:10:53.048058 28593 consensus_queue.cc:237] T a24e93a2f6ca4b23b4d193527621e98b P b234feb6496d4a1cbddaf57ae75ed5e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:53.057852 28567 consensus_queue.cc:1048] T cac3fbb52a734ffe840da27199a58f05 P 1a5a33ca0108455c9cd1358bf0e50943 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:53.057811 28265 catalog_manager.cc:5697] T a24e93a2f6ca4b23b4d193527621e98b P b234feb6496d4a1cbddaf57ae75ed5e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130). New cstate: current_term: 1 leader_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:53.069844 28567 raft_consensus.cc:493] T 23939bc50fd04a08925ae3d5508ef5ab P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.069816 28623 consensus_queue.cc:1048] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:53.070537 28567 raft_consensus.cc:515] T 23939bc50fd04a08925ae3d5508ef5ab P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:53.072779 28567 leader_election.cc:290] T 23939bc50fd04a08925ae3d5508ef5ab P 1a5a33ca0108455c9cd1358bf0e50943 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130:40891), efb7184756dd41928c127a50037e3672 (127.27.146.131:41969)
I20260709 13:10:53.073596 28444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23939bc50fd04a08925ae3d5508ef5ab" candidate_uuid: "1a5a33ca0108455c9cd1358bf0e50943" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" is_pre_election: true
I20260709 13:10:53.074188 28444 raft_consensus.cc:2393] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a5a33ca0108455c9cd1358bf0e50943 in current term 1: Already voted for candidate efb7184756dd41928c127a50037e3672 in this term.
I20260709 13:10:53.080157 28518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23939bc50fd04a08925ae3d5508ef5ab" candidate_uuid: "1a5a33ca0108455c9cd1358bf0e50943" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efb7184756dd41928c127a50037e3672" is_pre_election: true
I20260709 13:10:53.085078 28590 consensus_queue.cc:1048] T cac3fbb52a734ffe840da27199a58f05 P 1a5a33ca0108455c9cd1358bf0e50943 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:53.088276 28332 leader_election.cc:304] T 23939bc50fd04a08925ae3d5508ef5ab P 1a5a33ca0108455c9cd1358bf0e50943 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a5a33ca0108455c9cd1358bf0e50943; no voters: b234feb6496d4a1cbddaf57ae75ed5e3, efb7184756dd41928c127a50037e3672
I20260709 13:10:53.090291 28602 raft_consensus.cc:3060] T 23939bc50fd04a08925ae3d5508ef5ab P 1a5a33ca0108455c9cd1358bf0e50943 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:53.103042 28626 consensus_queue.cc:1048] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:53.116355 28602 raft_consensus.cc:2749] T 23939bc50fd04a08925ae3d5508ef5ab P 1a5a33ca0108455c9cd1358bf0e50943 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:53.124821 28569 consensus_queue.cc:1048] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:53.152041 28569 consensus_queue.cc:1048] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:53.169812 28569 consensus_queue.cc:1048] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:53.187670 28442 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "faa54b9861874eaa90e9077878da98c3"
dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
mode: GRACEFUL
new_leader_uuid: "1a5a33ca0108455c9cd1358bf0e50943"
 from {username='slave'} at 127.0.0.1:44292
I20260709 13:10:53.188494 28442 raft_consensus.cc:606] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 LEADER]: Received request to transfer leadership to TS 1a5a33ca0108455c9cd1358bf0e50943
I20260709 13:10:53.204988 28637 consensus_queue.cc:1048] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:53.206292 28442 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ac16ecbdad44d309b75903ff8748aa2"
dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
mode: GRACEFUL
new_leader_uuid: "1a5a33ca0108455c9cd1358bf0e50943"
 from {username='slave'} at 127.0.0.1:44292
I20260709 13:10:53.207046 28442 raft_consensus.cc:606] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 LEADER]: Received request to transfer leadership to TS 1a5a33ca0108455c9cd1358bf0e50943
I20260709 13:10:53.228900 28602 consensus_queue.cc:1048] T 48ef7adf3ca24d4ba44c678da62b64bb P 1a5a33ca0108455c9cd1358bf0e50943 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:53.243108 28602 consensus_queue.cc:1048] T 48ef7adf3ca24d4ba44c678da62b64bb P 1a5a33ca0108455c9cd1358bf0e50943 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:53.254307 28518 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7c7c56087d64b37af648badd045b987"
dest_uuid: "efb7184756dd41928c127a50037e3672"
mode: GRACEFUL
new_leader_uuid: "1a5a33ca0108455c9cd1358bf0e50943"
 from {username='slave'} at 127.0.0.1:36386
I20260709 13:10:53.255163 28518 raft_consensus.cc:606] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [term 1 LEADER]: Received request to transfer leadership to TS 1a5a33ca0108455c9cd1358bf0e50943
I20260709 13:10:53.280488 28369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cac3fbb52a734ffe840da27199a58f05"
dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943"
mode: GRACEFUL
new_leader_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
 from {username='slave'} at 127.0.0.1:49548
I20260709 13:10:53.281102 28369 raft_consensus.cc:606] T cac3fbb52a734ffe840da27199a58f05 P 1a5a33ca0108455c9cd1358bf0e50943 [term 1 LEADER]: Received request to transfer leadership to TS b234feb6496d4a1cbddaf57ae75ed5e3
I20260709 13:10:53.287169 28517 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "178f126036d74fc1aa8e7db809be61d0"
dest_uuid: "efb7184756dd41928c127a50037e3672"
mode: GRACEFUL
new_leader_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
 from {username='slave'} at 127.0.0.1:36386
I20260709 13:10:53.287940 28517 raft_consensus.cc:606] T 178f126036d74fc1aa8e7db809be61d0 P efb7184756dd41928c127a50037e3672 [term 1 LEADER]: Received request to transfer leadership to TS b234feb6496d4a1cbddaf57ae75ed5e3
I20260709 13:10:53.296891 28517 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23939bc50fd04a08925ae3d5508ef5ab"
dest_uuid: "efb7184756dd41928c127a50037e3672"
mode: GRACEFUL
new_leader_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
 from {username='slave'} at 127.0.0.1:36386
I20260709 13:10:53.297657 28517 raft_consensus.cc:606] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [term 1 LEADER]: Received request to transfer leadership to TS b234feb6496d4a1cbddaf57ae75ed5e3
I20260709 13:10:53.305616 28369 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd08ca5dee984515ad04c435411426e3"
dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943"
mode: GRACEFUL
new_leader_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
 from {username='slave'} at 127.0.0.1:49548
I20260709 13:10:53.306278 28369 raft_consensus.cc:606] T cd08ca5dee984515ad04c435411426e3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 1 LEADER]: Received request to transfer leadership to TS b234feb6496d4a1cbddaf57ae75ed5e3
I20260709 13:10:53.313078 28442 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a24e93a2f6ca4b23b4d193527621e98b"
dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
mode: GRACEFUL
new_leader_uuid: "efb7184756dd41928c127a50037e3672"
 from {username='slave'} at 127.0.0.1:44292
I20260709 13:10:53.313781 28442 raft_consensus.cc:606] T a24e93a2f6ca4b23b4d193527621e98b P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 LEADER]: Received request to transfer leadership to TS efb7184756dd41928c127a50037e3672
I20260709 13:10:53.411092 28567 consensus_queue.cc:1048] T cd08ca5dee984515ad04c435411426e3 P 1a5a33ca0108455c9cd1358bf0e50943 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:53.416092 28593 raft_consensus.cc:993] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3: : Instructing follower 1a5a33ca0108455c9cd1358bf0e50943 to start an election
I20260709 13:10:53.416826 28593 raft_consensus.cc:1081] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 LEADER]: Signalling peer 1a5a33ca0108455c9cd1358bf0e50943 to start an election
I20260709 13:10:53.419278 28369 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "faa54b9861874eaa90e9077878da98c3"
dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943"
 from {username='slave'} at 127.0.0.1:58092
I20260709 13:10:53.419997 28369 raft_consensus.cc:493] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:53.420392 28369 raft_consensus.cc:3060] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:53.420930 28602 raft_consensus.cc:993] T cd08ca5dee984515ad04c435411426e3 P 1a5a33ca0108455c9cd1358bf0e50943: : Instructing follower b234feb6496d4a1cbddaf57ae75ed5e3 to start an election
I20260709 13:10:53.421388 28602 raft_consensus.cc:1081] T cd08ca5dee984515ad04c435411426e3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 1 LEADER]: Signalling peer b234feb6496d4a1cbddaf57ae75ed5e3 to start an election
I20260709 13:10:53.423947 28444 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd08ca5dee984515ad04c435411426e3"
dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
 from {username='slave'} at 127.0.0.1:58708
I20260709 13:10:53.424608 28444 raft_consensus.cc:493] T cd08ca5dee984515ad04c435411426e3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:53.425025 28444 raft_consensus.cc:3060] T cd08ca5dee984515ad04c435411426e3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:53.426847 28602 consensus_queue.cc:1048] T cd08ca5dee984515ad04c435411426e3 P 1a5a33ca0108455c9cd1358bf0e50943 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:53.434607 28444 raft_consensus.cc:515] T cd08ca5dee984515ad04c435411426e3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:53.437088 28442 raft_consensus.cc:1240] T cd08ca5dee984515ad04c435411426e3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 FOLLOWER]: Rejecting Update request from peer 1a5a33ca0108455c9cd1358bf0e50943 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:53.439576 28602 consensus_queue.cc:1059] T cd08ca5dee984515ad04c435411426e3 P 1a5a33ca0108455c9cd1358bf0e50943 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:53.440807 28590 raft_consensus.cc:3055] T cd08ca5dee984515ad04c435411426e3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:53.441201 28590 raft_consensus.cc:740] T cd08ca5dee984515ad04c435411426e3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a5a33ca0108455c9cd1358bf0e50943, State: Running, Role: LEADER
I20260709 13:10:53.441452 28444 leader_election.cc:290] T cd08ca5dee984515ad04c435411426e3 P b234feb6496d4a1cbddaf57ae75ed5e3 [CANDIDATE]: Term 2 election: Requested vote from peers 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037), efb7184756dd41928c127a50037e3672 (127.27.146.131:41969)
I20260709 13:10:53.442090 28590 consensus_queue.cc:260] T cd08ca5dee984515ad04c435411426e3 P 1a5a33ca0108455c9cd1358bf0e50943 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:53.442868 28518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd08ca5dee984515ad04c435411426e3" candidate_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efb7184756dd41928c127a50037e3672"
I20260709 13:10:53.445005 28590 raft_consensus.cc:3060] T cd08ca5dee984515ad04c435411426e3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:53.447511 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd08ca5dee984515ad04c435411426e3" candidate_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943"
I20260709 13:10:53.455216 28369 raft_consensus.cc:515] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } } peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } }
I20260709 13:10:53.459033 28517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faa54b9861874eaa90e9077878da98c3" candidate_uuid: "1a5a33ca0108455c9cd1358bf0e50943" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efb7184756dd41928c127a50037e3672"
I20260709 13:10:53.459364 28444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faa54b9861874eaa90e9077878da98c3" candidate_uuid: "1a5a33ca0108455c9cd1358bf0e50943" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
I20260709 13:10:53.459749 28517 raft_consensus.cc:3060] T faa54b9861874eaa90e9077878da98c3 P efb7184756dd41928c127a50037e3672 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:53.459985 28444 raft_consensus.cc:3055] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:53.460376 28444 raft_consensus.cc:740] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b234feb6496d4a1cbddaf57ae75ed5e3, State: Running, Role: LEADER
I20260709 13:10:53.461246 28444 consensus_queue.cc:260] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } } peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } }
I20260709 13:10:53.462422 28444 raft_consensus.cc:3060] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:53.469987 28444 raft_consensus.cc:2468] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a5a33ca0108455c9cd1358bf0e50943 in term 2.
I20260709 13:10:53.470587 28369 leader_election.cc:290] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 [CANDIDATE]: Term 2 election: Requested vote from peers efb7184756dd41928c127a50037e3672 (127.27.146.131:41969), b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130:40891)
I20260709 13:10:53.472451 28335 leader_election.cc:304] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a5a33ca0108455c9cd1358bf0e50943, b234feb6496d4a1cbddaf57ae75ed5e3; no voters: 
I20260709 13:10:53.473313 28602 raft_consensus.cc:2804] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:53.473811 28602 raft_consensus.cc:697] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 LEADER]: Becoming Leader. State: Replica: 1a5a33ca0108455c9cd1358bf0e50943, State: Running, Role: LEADER
I20260709 13:10:53.474031 28366 raft_consensus.cc:2468] T cd08ca5dee984515ad04c435411426e3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b234feb6496d4a1cbddaf57ae75ed5e3 in term 2.
I20260709 13:10:53.474721 28602 consensus_queue.cc:237] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } } peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } }
I20260709 13:10:53.475402 28517 raft_consensus.cc:2468] T faa54b9861874eaa90e9077878da98c3 P efb7184756dd41928c127a50037e3672 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a5a33ca0108455c9cd1358bf0e50943 in term 2.
I20260709 13:10:53.476351 28409 leader_election.cc:304] T cd08ca5dee984515ad04c435411426e3 P b234feb6496d4a1cbddaf57ae75ed5e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a5a33ca0108455c9cd1358bf0e50943, b234feb6496d4a1cbddaf57ae75ed5e3; no voters: efb7184756dd41928c127a50037e3672
I20260709 13:10:53.477365 28593 raft_consensus.cc:2804] T cd08ca5dee984515ad04c435411426e3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:53.477880 28593 raft_consensus.cc:697] T cd08ca5dee984515ad04c435411426e3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 LEADER]: Becoming Leader. State: Replica: b234feb6496d4a1cbddaf57ae75ed5e3, State: Running, Role: LEADER
I20260709 13:10:53.478727 28593 consensus_queue.cc:237] T cd08ca5dee984515ad04c435411426e3 P b234feb6496d4a1cbddaf57ae75ed5e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:53.485785 28262 catalog_manager.cc:5697] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 reported cstate change: term changed from 1 to 2, leader changed from b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130) to 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129). New cstate: current_term: 2 leader_uuid: "1a5a33ca0108455c9cd1358bf0e50943" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:53.487196 28265 catalog_manager.cc:5697] T cd08ca5dee984515ad04c435411426e3 P b234feb6496d4a1cbddaf57ae75ed5e3 reported cstate change: term changed from 1 to 2, leader changed from 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129) to b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130). New cstate: current_term: 2 leader_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:53.501945 28593 consensus_queue.cc:1048] T a24e93a2f6ca4b23b4d193527621e98b P b234feb6496d4a1cbddaf57ae75ed5e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:53.509883 28626 raft_consensus.cc:993] T a24e93a2f6ca4b23b4d193527621e98b P b234feb6496d4a1cbddaf57ae75ed5e3: : Instructing follower efb7184756dd41928c127a50037e3672 to start an election
I20260709 13:10:53.510496 28624 raft_consensus.cc:1081] T a24e93a2f6ca4b23b4d193527621e98b P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 LEADER]: Signalling peer efb7184756dd41928c127a50037e3672 to start an election
I20260709 13:10:53.514729 28517 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a24e93a2f6ca4b23b4d193527621e98b"
dest_uuid: "efb7184756dd41928c127a50037e3672"
 from {username='slave'} at 127.0.0.1:59816
I20260709 13:10:53.518303 28624 consensus_queue.cc:1048] T a24e93a2f6ca4b23b4d193527621e98b P b234feb6496d4a1cbddaf57ae75ed5e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:53.520004 28517 raft_consensus.cc:493] T a24e93a2f6ca4b23b4d193527621e98b P efb7184756dd41928c127a50037e3672 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:53.520473 28517 raft_consensus.cc:3060] T a24e93a2f6ca4b23b4d193527621e98b P efb7184756dd41928c127a50037e3672 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:53.528403 28517 raft_consensus.cc:515] T a24e93a2f6ca4b23b4d193527621e98b P efb7184756dd41928c127a50037e3672 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:53.533463 28517 leader_election.cc:290] T a24e93a2f6ca4b23b4d193527621e98b P efb7184756dd41928c127a50037e3672 [CANDIDATE]: Term 2 election: Requested vote from peers 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037), b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130:40891)
I20260709 13:10:53.533655 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24e93a2f6ca4b23b4d193527621e98b" candidate_uuid: "efb7184756dd41928c127a50037e3672" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943"
I20260709 13:10:53.534353 28366 raft_consensus.cc:3060] T a24e93a2f6ca4b23b4d193527621e98b P 1a5a33ca0108455c9cd1358bf0e50943 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:53.534528 28444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24e93a2f6ca4b23b4d193527621e98b" candidate_uuid: "efb7184756dd41928c127a50037e3672" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
I20260709 13:10:53.535202 28444 raft_consensus.cc:3055] T a24e93a2f6ca4b23b4d193527621e98b P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:53.535554 28444 raft_consensus.cc:740] T a24e93a2f6ca4b23b4d193527621e98b P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b234feb6496d4a1cbddaf57ae75ed5e3, State: Running, Role: LEADER
I20260709 13:10:53.536402 28444 consensus_queue.cc:260] T a24e93a2f6ca4b23b4d193527621e98b P b234feb6496d4a1cbddaf57ae75ed5e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:53.537658 28444 raft_consensus.cc:3060] T a24e93a2f6ca4b23b4d193527621e98b P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:53.543473 28366 raft_consensus.cc:2468] T a24e93a2f6ca4b23b4d193527621e98b P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efb7184756dd41928c127a50037e3672 in term 2.
I20260709 13:10:53.544800 28444 raft_consensus.cc:2468] T a24e93a2f6ca4b23b4d193527621e98b P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efb7184756dd41928c127a50037e3672 in term 2.
I20260709 13:10:53.546084 28484 leader_election.cc:304] T a24e93a2f6ca4b23b4d193527621e98b P efb7184756dd41928c127a50037e3672 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b234feb6496d4a1cbddaf57ae75ed5e3, efb7184756dd41928c127a50037e3672; no voters: 
I20260709 13:10:53.547447 28637 raft_consensus.cc:2804] T a24e93a2f6ca4b23b4d193527621e98b P efb7184756dd41928c127a50037e3672 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:53.548009 28637 raft_consensus.cc:697] T a24e93a2f6ca4b23b4d193527621e98b P efb7184756dd41928c127a50037e3672 [term 2 LEADER]: Becoming Leader. State: Replica: efb7184756dd41928c127a50037e3672, State: Running, Role: LEADER
I20260709 13:10:53.548929 28637 consensus_queue.cc:237] T a24e93a2f6ca4b23b4d193527621e98b P efb7184756dd41928c127a50037e3672 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:53.558028 28265 catalog_manager.cc:5697] T a24e93a2f6ca4b23b4d193527621e98b P efb7184756dd41928c127a50037e3672 reported cstate change: term changed from 1 to 2, leader changed from b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130) to efb7184756dd41928c127a50037e3672 (127.27.146.131). New cstate: current_term: 2 leader_uuid: "efb7184756dd41928c127a50037e3672" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:53.609266 28637 consensus_queue.cc:1048] T 178f126036d74fc1aa8e7db809be61d0 P efb7184756dd41928c127a50037e3672 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:53.619777 28597 raft_consensus.cc:993] T 178f126036d74fc1aa8e7db809be61d0 P efb7184756dd41928c127a50037e3672: : Instructing follower b234feb6496d4a1cbddaf57ae75ed5e3 to start an election
I20260709 13:10:53.620329 28597 raft_consensus.cc:1081] T 178f126036d74fc1aa8e7db809be61d0 P efb7184756dd41928c127a50037e3672 [term 1 LEADER]: Signalling peer b234feb6496d4a1cbddaf57ae75ed5e3 to start an election
I20260709 13:10:53.622509 28444 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "178f126036d74fc1aa8e7db809be61d0"
dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
 from {username='slave'} at 127.0.0.1:58692
I20260709 13:10:53.623188 28444 raft_consensus.cc:493] T 178f126036d74fc1aa8e7db809be61d0 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:53.623689 28444 raft_consensus.cc:3060] T 178f126036d74fc1aa8e7db809be61d0 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:53.627180 28569 consensus_queue.cc:1048] T 178f126036d74fc1aa8e7db809be61d0 P efb7184756dd41928c127a50037e3672 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:53.632861 28444 raft_consensus.cc:515] T 178f126036d74fc1aa8e7db809be61d0 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:53.637342 28444 leader_election.cc:290] T 178f126036d74fc1aa8e7db809be61d0 P b234feb6496d4a1cbddaf57ae75ed5e3 [CANDIDATE]: Term 2 election: Requested vote from peers 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037), efb7184756dd41928c127a50037e3672 (127.27.146.131:41969)
I20260709 13:10:53.638536 28369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "178f126036d74fc1aa8e7db809be61d0" candidate_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943"
I20260709 13:10:53.641115 28517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "178f126036d74fc1aa8e7db809be61d0" candidate_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efb7184756dd41928c127a50037e3672"
I20260709 13:10:53.641820 28517 raft_consensus.cc:3055] T 178f126036d74fc1aa8e7db809be61d0 P efb7184756dd41928c127a50037e3672 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:53.642166 28517 raft_consensus.cc:740] T 178f126036d74fc1aa8e7db809be61d0 P efb7184756dd41928c127a50037e3672 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: efb7184756dd41928c127a50037e3672, State: Running, Role: LEADER
I20260709 13:10:53.642580 28442 raft_consensus.cc:1240] T 178f126036d74fc1aa8e7db809be61d0 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 FOLLOWER]: Rejecting Update request from peer efb7184756dd41928c127a50037e3672 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:53.643045 28517 consensus_queue.cc:260] T 178f126036d74fc1aa8e7db809be61d0 P efb7184756dd41928c127a50037e3672 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:53.644065 28517 raft_consensus.cc:3060] T 178f126036d74fc1aa8e7db809be61d0 P efb7184756dd41928c127a50037e3672 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:53.641149 28602 raft_consensus.cc:993] T cac3fbb52a734ffe840da27199a58f05 P 1a5a33ca0108455c9cd1358bf0e50943: : Instructing follower b234feb6496d4a1cbddaf57ae75ed5e3 to start an election
I20260709 13:10:53.645244 28602 raft_consensus.cc:1081] T cac3fbb52a734ffe840da27199a58f05 P 1a5a33ca0108455c9cd1358bf0e50943 [term 1 LEADER]: Signalling peer b234feb6496d4a1cbddaf57ae75ed5e3 to start an election
I20260709 13:10:53.647595 28442 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cac3fbb52a734ffe840da27199a58f05"
dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
 from {username='slave'} at 127.0.0.1:58708
I20260709 13:10:53.648195 28442 raft_consensus.cc:493] T cac3fbb52a734ffe840da27199a58f05 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:53.648922 28442 raft_consensus.cc:3060] T cac3fbb52a734ffe840da27199a58f05 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:53.655563 28624 raft_consensus.cc:993] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3: : Instructing follower 1a5a33ca0108455c9cd1358bf0e50943 to start an election
I20260709 13:10:53.656123 28624 raft_consensus.cc:1081] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 LEADER]: Signalling peer 1a5a33ca0108455c9cd1358bf0e50943 to start an election
I20260709 13:10:53.656812 28517 raft_consensus.cc:2468] T 178f126036d74fc1aa8e7db809be61d0 P efb7184756dd41928c127a50037e3672 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b234feb6496d4a1cbddaf57ae75ed5e3 in term 2.
I20260709 13:10:53.658072 28407 leader_election.cc:304] T 178f126036d74fc1aa8e7db809be61d0 P b234feb6496d4a1cbddaf57ae75ed5e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b234feb6496d4a1cbddaf57ae75ed5e3, efb7184756dd41928c127a50037e3672; no voters: 1a5a33ca0108455c9cd1358bf0e50943
I20260709 13:10:53.659271 28626 raft_consensus.cc:2804] T 178f126036d74fc1aa8e7db809be61d0 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:53.659798 28626 raft_consensus.cc:697] T 178f126036d74fc1aa8e7db809be61d0 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 LEADER]: Becoming Leader. State: Replica: b234feb6496d4a1cbddaf57ae75ed5e3, State: Running, Role: LEADER
I20260709 13:10:53.660035 28369 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ac16ecbdad44d309b75903ff8748aa2"
dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943"
 from {username='slave'} at 127.0.0.1:58092
I20260709 13:10:53.660650 28369 raft_consensus.cc:493] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:53.661053 28369 raft_consensus.cc:3060] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:53.660751 28626 consensus_queue.cc:237] T 178f126036d74fc1aa8e7db809be61d0 P b234feb6496d4a1cbddaf57ae75ed5e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:53.662688 28597 raft_consensus.cc:993] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672: : Instructing follower b234feb6496d4a1cbddaf57ae75ed5e3 to start an election
I20260709 13:10:53.663148 28597 raft_consensus.cc:1081] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [term 1 LEADER]: Signalling peer b234feb6496d4a1cbddaf57ae75ed5e3 to start an election
I20260709 13:10:53.665728 28444 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23939bc50fd04a08925ae3d5508ef5ab"
dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
 from {username='slave'} at 127.0.0.1:58692
I20260709 13:10:53.666371 28444 raft_consensus.cc:493] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:53.666755 28444 raft_consensus.cc:3060] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:53.668768 28369 raft_consensus.cc:515] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:53.672259 28443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac16ecbdad44d309b75903ff8748aa2" candidate_uuid: "1a5a33ca0108455c9cd1358bf0e50943" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
I20260709 13:10:53.672907 28443 raft_consensus.cc:3055] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:53.673218 28443 raft_consensus.cc:740] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b234feb6496d4a1cbddaf57ae75ed5e3, State: Running, Role: LEADER
I20260709 13:10:53.673520 28442 raft_consensus.cc:515] T cac3fbb52a734ffe840da27199a58f05 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:53.674091 28443 consensus_queue.cc:260] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:53.675930 28443 raft_consensus.cc:3060] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:53.676985 28367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac3fbb52a734ffe840da27199a58f05" candidate_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943"
I20260709 13:10:53.677717 28367 raft_consensus.cc:3055] T cac3fbb52a734ffe840da27199a58f05 P 1a5a33ca0108455c9cd1358bf0e50943 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:53.678025 28369 leader_election.cc:290] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943 [CANDIDATE]: Term 2 election: Requested vote from peers b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130:40891), efb7184756dd41928c127a50037e3672 (127.27.146.131:41969)
I20260709 13:10:53.678073 28367 raft_consensus.cc:740] T cac3fbb52a734ffe840da27199a58f05 P 1a5a33ca0108455c9cd1358bf0e50943 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a5a33ca0108455c9cd1358bf0e50943, State: Running, Role: LEADER
I20260709 13:10:53.676462 28442 leader_election.cc:290] T cac3fbb52a734ffe840da27199a58f05 P b234feb6496d4a1cbddaf57ae75ed5e3 [CANDIDATE]: Term 2 election: Requested vote from peers 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037), efb7184756dd41928c127a50037e3672 (127.27.146.131:41969)
I20260709 13:10:53.682197 28518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac16ecbdad44d309b75903ff8748aa2" candidate_uuid: "1a5a33ca0108455c9cd1358bf0e50943" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efb7184756dd41928c127a50037e3672"
I20260709 13:10:53.678637 28262 catalog_manager.cc:5697] T 178f126036d74fc1aa8e7db809be61d0 P b234feb6496d4a1cbddaf57ae75ed5e3 reported cstate change: term changed from 1 to 2, leader changed from efb7184756dd41928c127a50037e3672 (127.27.146.131) to b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130). New cstate: current_term: 2 leader_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:53.679085 28367 consensus_queue.cc:260] T cac3fbb52a734ffe840da27199a58f05 P 1a5a33ca0108455c9cd1358bf0e50943 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:53.682871 28518 raft_consensus.cc:3060] T 6ac16ecbdad44d309b75903ff8748aa2 P efb7184756dd41928c127a50037e3672 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:53.683835 28367 raft_consensus.cc:3060] T cac3fbb52a734ffe840da27199a58f05 P 1a5a33ca0108455c9cd1358bf0e50943 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:53.685534 28517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cac3fbb52a734ffe840da27199a58f05" candidate_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efb7184756dd41928c127a50037e3672"
I20260709 13:10:53.686167 28517 raft_consensus.cc:3060] T cac3fbb52a734ffe840da27199a58f05 P efb7184756dd41928c127a50037e3672 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:53.682190 28444 raft_consensus.cc:515] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:53.696897 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23939bc50fd04a08925ae3d5508ef5ab" candidate_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943"
I20260709 13:10:53.697618 28366 raft_consensus.cc:3060] T 23939bc50fd04a08925ae3d5508ef5ab P 1a5a33ca0108455c9cd1358bf0e50943 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:53.706184 28444 leader_election.cc:290] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [CANDIDATE]: Term 2 election: Requested vote from peers 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037), efb7184756dd41928c127a50037e3672 (127.27.146.131:41969)
I20260709 13:10:53.707587 28516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23939bc50fd04a08925ae3d5508ef5ab" candidate_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efb7184756dd41928c127a50037e3672"
I20260709 13:10:53.708386 28516 raft_consensus.cc:3055] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:53.708770 28516 raft_consensus.cc:740] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: efb7184756dd41928c127a50037e3672, State: Running, Role: LEADER
I20260709 13:10:53.709722 28366 raft_consensus.cc:2468] T 23939bc50fd04a08925ae3d5508ef5ab P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b234feb6496d4a1cbddaf57ae75ed5e3 in term 2.
I20260709 13:10:53.709627 28516 consensus_queue.cc:260] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:53.711052 28516 raft_consensus.cc:3060] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:53.710950 28409 leader_election.cc:304] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a5a33ca0108455c9cd1358bf0e50943, b234feb6496d4a1cbddaf57ae75ed5e3; no voters: 
I20260709 13:10:53.712102 28624 raft_consensus.cc:2804] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:53.712613 28624 raft_consensus.cc:697] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 LEADER]: Becoming Leader. State: Replica: b234feb6496d4a1cbddaf57ae75ed5e3, State: Running, Role: LEADER
I20260709 13:10:53.713593 28624 consensus_queue.cc:237] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:53.718006 28518 raft_consensus.cc:2468] T 6ac16ecbdad44d309b75903ff8748aa2 P efb7184756dd41928c127a50037e3672 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a5a33ca0108455c9cd1358bf0e50943 in term 2.
I20260709 13:10:53.719448 28332 leader_election.cc:304] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a5a33ca0108455c9cd1358bf0e50943, efb7184756dd41928c127a50037e3672; no voters: 
I20260709 13:10:53.720578 28602 raft_consensus.cc:2804] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:53.721128 28602 raft_consensus.cc:697] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 LEADER]: Becoming Leader. State: Replica: 1a5a33ca0108455c9cd1358bf0e50943, State: Running, Role: LEADER
I20260709 13:10:53.721990 28602 consensus_queue.cc:237] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:53.723309 28266 catalog_manager.cc:5697] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 reported cstate change: term changed from 1 to 2, leader changed from efb7184756dd41928c127a50037e3672 (127.27.146.131) to b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130). New cstate: current_term: 2 leader_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:53.728951 28516 raft_consensus.cc:2468] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b234feb6496d4a1cbddaf57ae75ed5e3 in term 2.
I20260709 13:10:53.732456 28443 raft_consensus.cc:2468] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a5a33ca0108455c9cd1358bf0e50943 in term 2.
I20260709 13:10:53.737432 28367 raft_consensus.cc:2468] T cac3fbb52a734ffe840da27199a58f05 P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b234feb6496d4a1cbddaf57ae75ed5e3 in term 2.
I20260709 13:10:53.741621 28409 leader_election.cc:304] T cac3fbb52a734ffe840da27199a58f05 P b234feb6496d4a1cbddaf57ae75ed5e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a5a33ca0108455c9cd1358bf0e50943, b234feb6496d4a1cbddaf57ae75ed5e3; no voters: 
I20260709 13:10:53.742857 28624 raft_consensus.cc:2804] T cac3fbb52a734ffe840da27199a58f05 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:53.743396 28624 raft_consensus.cc:697] T cac3fbb52a734ffe840da27199a58f05 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 LEADER]: Becoming Leader. State: Replica: b234feb6496d4a1cbddaf57ae75ed5e3, State: Running, Role: LEADER
I20260709 13:10:53.744318 28624 consensus_queue.cc:237] T cac3fbb52a734ffe840da27199a58f05 P b234feb6496d4a1cbddaf57ae75ed5e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:53.750527 28517 raft_consensus.cc:2468] T cac3fbb52a734ffe840da27199a58f05 P efb7184756dd41928c127a50037e3672 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b234feb6496d4a1cbddaf57ae75ed5e3 in term 2.
I20260709 13:10:53.753959 28265 catalog_manager.cc:5697] T cac3fbb52a734ffe840da27199a58f05 P b234feb6496d4a1cbddaf57ae75ed5e3 reported cstate change: term changed from 1 to 2, leader changed from 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129) to b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130). New cstate: current_term: 2 leader_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:53.754940 28266 catalog_manager.cc:5697] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943 reported cstate change: term changed from 1 to 2, leader changed from b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130) to 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129). New cstate: current_term: 2 leader_uuid: "1a5a33ca0108455c9cd1358bf0e50943" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:53.771870 28597 raft_consensus.cc:993] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672: : Instructing follower 1a5a33ca0108455c9cd1358bf0e50943 to start an election
I20260709 13:10:53.772455 28637 raft_consensus.cc:1081] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [term 1 LEADER]: Signalling peer 1a5a33ca0108455c9cd1358bf0e50943 to start an election
I20260709 13:10:53.774140 28367 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7c7c56087d64b37af648badd045b987"
dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943"
 from {username='slave'} at 127.0.0.1:58104
I20260709 13:10:53.774683 28367 raft_consensus.cc:493] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:53.775038 28367 raft_consensus.cc:3060] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:53.781725 28367 raft_consensus.cc:515] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:53.784646 28367 leader_election.cc:290] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943 [CANDIDATE]: Term 2 election: Requested vote from peers b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130:40891), efb7184756dd41928c127a50037e3672 (127.27.146.131:41969)
I20260709 13:10:53.785982 28443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7c7c56087d64b37af648badd045b987" candidate_uuid: "1a5a33ca0108455c9cd1358bf0e50943" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
I20260709 13:10:53.786265 28517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7c7c56087d64b37af648badd045b987" candidate_uuid: "1a5a33ca0108455c9cd1358bf0e50943" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efb7184756dd41928c127a50037e3672"
I20260709 13:10:53.786966 28443 raft_consensus.cc:3060] T a7c7c56087d64b37af648badd045b987 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:53.787322 28517 raft_consensus.cc:3055] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:53.787847 28517 raft_consensus.cc:740] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: efb7184756dd41928c127a50037e3672, State: Running, Role: LEADER
I20260709 13:10:53.788759 28517 consensus_queue.cc:260] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:53.790046 28517 raft_consensus.cc:3060] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:53.796319 28517 raft_consensus.cc:2468] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a5a33ca0108455c9cd1358bf0e50943 in term 2.
I20260709 13:10:53.796909 28443 raft_consensus.cc:2468] T a7c7c56087d64b37af648badd045b987 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a5a33ca0108455c9cd1358bf0e50943 in term 2.
I20260709 13:10:53.797806 28332 leader_election.cc:304] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a5a33ca0108455c9cd1358bf0e50943, efb7184756dd41928c127a50037e3672; no voters: 
I20260709 13:10:53.798765 28602 raft_consensus.cc:2804] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:53.799674 28602 raft_consensus.cc:697] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 LEADER]: Becoming Leader. State: Replica: 1a5a33ca0108455c9cd1358bf0e50943, State: Running, Role: LEADER
I20260709 13:10:53.800777 28602 consensus_queue.cc:237] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:53.809008 28266 catalog_manager.cc:5697] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943 reported cstate change: term changed from 1 to 2, leader changed from efb7184756dd41928c127a50037e3672 (127.27.146.131) to 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129). New cstate: current_term: 2 leader_uuid: "1a5a33ca0108455c9cd1358bf0e50943" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:54.000382 28517 raft_consensus.cc:1275] T faa54b9861874eaa90e9077878da98c3 P efb7184756dd41928c127a50037e3672 [term 2 FOLLOWER]: Refusing update from remote peer 1a5a33ca0108455c9cd1358bf0e50943: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:54.002990 28567 consensus_queue.cc:1048] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:54.004966 28443 raft_consensus.cc:1275] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 FOLLOWER]: Refusing update from remote peer 1a5a33ca0108455c9cd1358bf0e50943: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:54.006760 28567 consensus_queue.cc:1048] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:54.020445 28516 raft_consensus.cc:3060] T cd08ca5dee984515ad04c435411426e3 P efb7184756dd41928c127a50037e3672 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:54.031802 28516 raft_consensus.cc:1275] T cd08ca5dee984515ad04c435411426e3 P efb7184756dd41928c127a50037e3672 [term 2 FOLLOWER]: Refusing update from remote peer b234feb6496d4a1cbddaf57ae75ed5e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:54.036409 28624 consensus_queue.cc:1048] T cd08ca5dee984515ad04c435411426e3 P b234feb6496d4a1cbddaf57ae75ed5e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:54.039120 28367 raft_consensus.cc:1275] T cd08ca5dee984515ad04c435411426e3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 FOLLOWER]: Refusing update from remote peer b234feb6496d4a1cbddaf57ae75ed5e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:54.044812 28626 consensus_queue.cc:1048] T cd08ca5dee984515ad04c435411426e3 P b234feb6496d4a1cbddaf57ae75ed5e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:54.069480 28517 raft_consensus.cc:1275] T 178f126036d74fc1aa8e7db809be61d0 P efb7184756dd41928c127a50037e3672 [term 2 FOLLOWER]: Refusing update from remote peer b234feb6496d4a1cbddaf57ae75ed5e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:54.072805 28624 consensus_queue.cc:1048] T 178f126036d74fc1aa8e7db809be61d0 P b234feb6496d4a1cbddaf57ae75ed5e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:54.075084 28367 raft_consensus.cc:3060] T 178f126036d74fc1aa8e7db809be61d0 P 1a5a33ca0108455c9cd1358bf0e50943 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:54.077019 28443 raft_consensus.cc:1275] T a24e93a2f6ca4b23b4d193527621e98b P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 FOLLOWER]: Refusing update from remote peer efb7184756dd41928c127a50037e3672: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:54.078723 28637 consensus_queue.cc:1048] T a24e93a2f6ca4b23b4d193527621e98b P efb7184756dd41928c127a50037e3672 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:54.082161 28366 raft_consensus.cc:1275] T a24e93a2f6ca4b23b4d193527621e98b P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 FOLLOWER]: Refusing update from remote peer efb7184756dd41928c127a50037e3672: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:54.088130 28569 consensus_queue.cc:1048] T a24e93a2f6ca4b23b4d193527621e98b P efb7184756dd41928c127a50037e3672 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:54.092971 28367 raft_consensus.cc:1275] T 178f126036d74fc1aa8e7db809be61d0 P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 FOLLOWER]: Refusing update from remote peer b234feb6496d4a1cbddaf57ae75ed5e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:54.105943 28444 raft_consensus.cc:1275] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 FOLLOWER]: Refusing update from remote peer 1a5a33ca0108455c9cd1358bf0e50943: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:54.108086 28593 consensus_queue.cc:1048] T 178f126036d74fc1aa8e7db809be61d0 P b234feb6496d4a1cbddaf57ae75ed5e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:54.108496 28567 consensus_queue.cc:1048] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:54.132723 28516 raft_consensus.cc:1275] T 6ac16ecbdad44d309b75903ff8748aa2 P efb7184756dd41928c127a50037e3672 [term 2 FOLLOWER]: Refusing update from remote peer 1a5a33ca0108455c9cd1358bf0e50943: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:54.134898 28590 consensus_queue.cc:1048] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:54.199664 28516 raft_consensus.cc:1275] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [term 2 FOLLOWER]: Refusing update from remote peer 1a5a33ca0108455c9cd1358bf0e50943: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:54.201262 28590 consensus_queue.cc:1048] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:54.212975 28443 raft_consensus.cc:1275] T a7c7c56087d64b37af648badd045b987 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 FOLLOWER]: Refusing update from remote peer 1a5a33ca0108455c9cd1358bf0e50943: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:54.214778 28602 consensus_queue.cc:1048] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:54.231127 28516 raft_consensus.cc:1275] T cac3fbb52a734ffe840da27199a58f05 P efb7184756dd41928c127a50037e3672 [term 2 FOLLOWER]: Refusing update from remote peer b234feb6496d4a1cbddaf57ae75ed5e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:54.232825 28593 consensus_queue.cc:1048] T cac3fbb52a734ffe840da27199a58f05 P b234feb6496d4a1cbddaf57ae75ed5e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:54.244292 28366 raft_consensus.cc:1275] T cac3fbb52a734ffe840da27199a58f05 P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 FOLLOWER]: Refusing update from remote peer b234feb6496d4a1cbddaf57ae75ed5e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:54.246189 28624 consensus_queue.cc:1048] T cac3fbb52a734ffe840da27199a58f05 P b234feb6496d4a1cbddaf57ae75ed5e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:54.278936 28366 raft_consensus.cc:1275] T 23939bc50fd04a08925ae3d5508ef5ab P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 FOLLOWER]: Refusing update from remote peer b234feb6496d4a1cbddaf57ae75ed5e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:54.280573 28624 consensus_queue.cc:1048] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:54.291133 28516 raft_consensus.cc:1275] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [term 2 FOLLOWER]: Refusing update from remote peer b234feb6496d4a1cbddaf57ae75ed5e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:54.293805 28593 consensus_queue.cc:1048] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:56.350383 28234 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:10:56.351289 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:56.368997 28444 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23939bc50fd04a08925ae3d5508ef5ab"
dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
mode: GRACEFUL
new_leader_uuid: "efb7184756dd41928c127a50037e3672"
 from {username='slave'} at 127.0.0.1:44302
I20260709 13:10:56.369637 28444 raft_consensus.cc:606] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 LEADER]: Received request to transfer leadership to TS efb7184756dd41928c127a50037e3672
I20260709 13:10:56.382077 28366 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7c7c56087d64b37af648badd045b987"
dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943"
mode: GRACEFUL
new_leader_uuid: "efb7184756dd41928c127a50037e3672"
 from {username='slave'} at 127.0.0.1:49560
I20260709 13:10:56.382688 28366 raft_consensus.cc:606] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 LEADER]: Received request to transfer leadership to TS efb7184756dd41928c127a50037e3672
I20260709 13:10:56.384004 28234 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:56.384546 28234 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:56.441704 28669 raft_consensus.cc:993] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943: : Instructing follower efb7184756dd41928c127a50037e3672 to start an election
I20260709 13:10:56.442226 28602 raft_consensus.cc:1081] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 LEADER]: Signalling peer efb7184756dd41928c127a50037e3672 to start an election
I20260709 13:10:56.444020 28516 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7c7c56087d64b37af648badd045b987"
dest_uuid: "efb7184756dd41928c127a50037e3672"
 from {username='slave'} at 127.0.0.1:59828
I20260709 13:10:56.444609 28516 raft_consensus.cc:493] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:56.444983 28516 raft_consensus.cc:3060] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:56.449482 28516 raft_consensus.cc:515] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:56.451140 28516 leader_election.cc:290] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [CANDIDATE]: Term 3 election: Requested vote from peers 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037), b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130:40891)
I20260709 13:10:56.452255 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7c7c56087d64b37af648badd045b987" candidate_uuid: "efb7184756dd41928c127a50037e3672" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943"
I20260709 13:10:56.452414 28444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7c7c56087d64b37af648badd045b987" candidate_uuid: "efb7184756dd41928c127a50037e3672" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
I20260709 13:10:56.453047 28444 raft_consensus.cc:3060] T a7c7c56087d64b37af648badd045b987 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:56.453047 28366 raft_consensus.cc:3055] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:56.453608 28366 raft_consensus.cc:740] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1a5a33ca0108455c9cd1358bf0e50943, State: Running, Role: LEADER
I20260709 13:10:56.454502 28366 consensus_queue.cc:260] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:56.455847 28366 raft_consensus.cc:3060] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:56.461406 28444 raft_consensus.cc:2468] T a7c7c56087d64b37af648badd045b987 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efb7184756dd41928c127a50037e3672 in term 3.
I20260709 13:10:56.462990 28484 leader_election.cc:304] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b234feb6496d4a1cbddaf57ae75ed5e3, efb7184756dd41928c127a50037e3672; no voters: 
I20260709 13:10:56.463958 28665 raft_consensus.cc:2804] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:56.464416 28366 raft_consensus.cc:2468] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efb7184756dd41928c127a50037e3672 in term 3.
I20260709 13:10:56.465427 28665 raft_consensus.cc:697] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [term 3 LEADER]: Becoming Leader. State: Replica: efb7184756dd41928c127a50037e3672, State: Running, Role: LEADER
I20260709 13:10:56.466416 28665 consensus_queue.cc:237] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:56.476454 28262 catalog_manager.cc:5697] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 reported cstate change: term changed from 2 to 3, leader changed from 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129) to efb7184756dd41928c127a50037e3672 (127.27.146.131). New cstate: current_term: 3 leader_uuid: "efb7184756dd41928c127a50037e3672" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:56.569123 28676 raft_consensus.cc:993] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3: : Instructing follower efb7184756dd41928c127a50037e3672 to start an election
I20260709 13:10:56.569720 28593 raft_consensus.cc:1081] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 LEADER]: Signalling peer efb7184756dd41928c127a50037e3672 to start an election
I20260709 13:10:56.571547 28516 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23939bc50fd04a08925ae3d5508ef5ab"
dest_uuid: "efb7184756dd41928c127a50037e3672"
 from {username='slave'} at 127.0.0.1:59816
I20260709 13:10:56.572239 28516 raft_consensus.cc:493] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:56.572701 28516 raft_consensus.cc:3060] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:56.578374 28516 raft_consensus.cc:515] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:56.580453 28516 leader_election.cc:290] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [CANDIDATE]: Term 3 election: Requested vote from peers 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037), b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130:40891)
I20260709 13:10:56.581198 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23939bc50fd04a08925ae3d5508ef5ab" candidate_uuid: "efb7184756dd41928c127a50037e3672" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943"
I20260709 13:10:56.581952 28366 raft_consensus.cc:3060] T 23939bc50fd04a08925ae3d5508ef5ab P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:56.581815 28444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23939bc50fd04a08925ae3d5508ef5ab" candidate_uuid: "efb7184756dd41928c127a50037e3672" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
I20260709 13:10:56.582564 28444 raft_consensus.cc:3055] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:56.582860 28444 raft_consensus.cc:740] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b234feb6496d4a1cbddaf57ae75ed5e3, State: Running, Role: LEADER
I20260709 13:10:56.583676 28444 consensus_queue.cc:260] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:56.584944 28444 raft_consensus.cc:3060] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:56.587778 28366 raft_consensus.cc:2468] T 23939bc50fd04a08925ae3d5508ef5ab P 1a5a33ca0108455c9cd1358bf0e50943 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efb7184756dd41928c127a50037e3672 in term 3.
I20260709 13:10:56.589021 28483 leader_election.cc:304] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a5a33ca0108455c9cd1358bf0e50943, efb7184756dd41928c127a50037e3672; no voters: 
I20260709 13:10:56.589978 28665 raft_consensus.cc:2804] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:56.590658 28665 raft_consensus.cc:697] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [term 3 LEADER]: Becoming Leader. State: Replica: efb7184756dd41928c127a50037e3672, State: Running, Role: LEADER
I20260709 13:10:56.591871 28444 raft_consensus.cc:2468] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efb7184756dd41928c127a50037e3672 in term 3.
I20260709 13:10:56.591635 28665 consensus_queue.cc:237] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:56.600143 28262 catalog_manager.cc:5697] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 reported cstate change: term changed from 2 to 3, leader changed from b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130) to efb7184756dd41928c127a50037e3672 (127.27.146.131). New cstate: current_term: 3 leader_uuid: "efb7184756dd41928c127a50037e3672" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:56.864686 28366 raft_consensus.cc:1275] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943 [term 3 FOLLOWER]: Refusing update from remote peer efb7184756dd41928c127a50037e3672: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:56.866132 28665 consensus_queue.cc:1048] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:56.877614 28444 raft_consensus.cc:1275] T a7c7c56087d64b37af648badd045b987 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 3 FOLLOWER]: Refusing update from remote peer efb7184756dd41928c127a50037e3672: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:56.879566 28680 consensus_queue.cc:1048] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:57.072866 28444 raft_consensus.cc:1275] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [term 3 FOLLOWER]: Refusing update from remote peer efb7184756dd41928c127a50037e3672: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:57.074316 28680 consensus_queue.cc:1048] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:57.084846 28366 raft_consensus.cc:1275] T 23939bc50fd04a08925ae3d5508ef5ab P 1a5a33ca0108455c9cd1358bf0e50943 [term 3 FOLLOWER]: Refusing update from remote peer efb7184756dd41928c127a50037e3672: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:57.086561 28680 consensus_queue.cc:1048] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:57.385689 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:57.397709 28366 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "faa54b9861874eaa90e9077878da98c3"
dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943"
mode: GRACEFUL
new_leader_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
 from {username='slave'} at 127.0.0.1:49548
I20260709 13:10:57.398373 28366 raft_consensus.cc:606] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 LEADER]: Received request to transfer leadership to TS b234feb6496d4a1cbddaf57ae75ed5e3
I20260709 13:10:57.404043 28366 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48ef7adf3ca24d4ba44c678da62b64bb"
dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943"
mode: GRACEFUL
new_leader_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
 from {username='slave'} at 127.0.0.1:49548
I20260709 13:10:57.404567 28366 raft_consensus.cc:606] T 48ef7adf3ca24d4ba44c678da62b64bb P 1a5a33ca0108455c9cd1358bf0e50943 [term 1 LEADER]: Received request to transfer leadership to TS b234feb6496d4a1cbddaf57ae75ed5e3
I20260709 13:10:57.410209 28366 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ac16ecbdad44d309b75903ff8748aa2"
dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943"
mode: GRACEFUL
new_leader_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
 from {username='slave'} at 127.0.0.1:49548
I20260709 13:10:57.410815 28366 raft_consensus.cc:606] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 LEADER]: Received request to transfer leadership to TS b234feb6496d4a1cbddaf57ae75ed5e3
I20260709 13:10:57.412672 28602 raft_consensus.cc:993] T 48ef7adf3ca24d4ba44c678da62b64bb P 1a5a33ca0108455c9cd1358bf0e50943: : Instructing follower b234feb6496d4a1cbddaf57ae75ed5e3 to start an election
I20260709 13:10:57.413165 28685 raft_consensus.cc:1081] T 48ef7adf3ca24d4ba44c678da62b64bb P 1a5a33ca0108455c9cd1358bf0e50943 [term 1 LEADER]: Signalling peer b234feb6496d4a1cbddaf57ae75ed5e3 to start an election
I20260709 13:10:57.414724 28444 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "48ef7adf3ca24d4ba44c678da62b64bb"
dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
 from {username='slave'} at 127.0.0.1:58708
I20260709 13:10:57.415264 28444 raft_consensus.cc:493] T 48ef7adf3ca24d4ba44c678da62b64bb P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:57.415645 28444 raft_consensus.cc:3060] T 48ef7adf3ca24d4ba44c678da62b64bb P b234feb6496d4a1cbddaf57ae75ed5e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.416368 28517 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7c7c56087d64b37af648badd045b987"
dest_uuid: "efb7184756dd41928c127a50037e3672"
mode: GRACEFUL
new_leader_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
 from {username='slave'} at 127.0.0.1:36386
I20260709 13:10:57.417073 28517 raft_consensus.cc:606] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [term 3 LEADER]: Received request to transfer leadership to TS b234feb6496d4a1cbddaf57ae75ed5e3
I20260709 13:10:57.421332 28444 raft_consensus.cc:515] T 48ef7adf3ca24d4ba44c678da62b64bb P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:57.423480 28444 leader_election.cc:290] T 48ef7adf3ca24d4ba44c678da62b64bb P b234feb6496d4a1cbddaf57ae75ed5e3 [CANDIDATE]: Term 2 election: Requested vote from peers 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037), efb7184756dd41928c127a50037e3672 (127.27.146.131:41969)
I20260709 13:10:57.423911 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ef7adf3ca24d4ba44c678da62b64bb" candidate_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943"
I20260709 13:10:57.424139 28517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ef7adf3ca24d4ba44c678da62b64bb" candidate_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efb7184756dd41928c127a50037e3672"
I20260709 13:10:57.424759 28517 raft_consensus.cc:3060] T 48ef7adf3ca24d4ba44c678da62b64bb P efb7184756dd41928c127a50037e3672 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.424724 28366 raft_consensus.cc:3055] T 48ef7adf3ca24d4ba44c678da62b64bb P 1a5a33ca0108455c9cd1358bf0e50943 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:57.425330 28366 raft_consensus.cc:740] T 48ef7adf3ca24d4ba44c678da62b64bb P 1a5a33ca0108455c9cd1358bf0e50943 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a5a33ca0108455c9cd1358bf0e50943, State: Running, Role: LEADER
I20260709 13:10:57.426236 28366 consensus_queue.cc:260] T 48ef7adf3ca24d4ba44c678da62b64bb P 1a5a33ca0108455c9cd1358bf0e50943 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:57.427176 28366 raft_consensus.cc:3060] T 48ef7adf3ca24d4ba44c678da62b64bb P 1a5a33ca0108455c9cd1358bf0e50943 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:57.430013 28516 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23939bc50fd04a08925ae3d5508ef5ab"
dest_uuid: "efb7184756dd41928c127a50037e3672"
mode: GRACEFUL
new_leader_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
 from {username='slave'} at 127.0.0.1:36386
I20260709 13:10:57.430683 28516 raft_consensus.cc:606] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [term 3 LEADER]: Received request to transfer leadership to TS b234feb6496d4a1cbddaf57ae75ed5e3
I20260709 13:10:57.432732 28517 raft_consensus.cc:2468] T 48ef7adf3ca24d4ba44c678da62b64bb P efb7184756dd41928c127a50037e3672 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b234feb6496d4a1cbddaf57ae75ed5e3 in term 2.
I20260709 13:10:57.433662 28366 raft_consensus.cc:2468] T 48ef7adf3ca24d4ba44c678da62b64bb P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b234feb6496d4a1cbddaf57ae75ed5e3 in term 2.
I20260709 13:10:57.434417 28407 leader_election.cc:304] T 48ef7adf3ca24d4ba44c678da62b64bb P b234feb6496d4a1cbddaf57ae75ed5e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b234feb6496d4a1cbddaf57ae75ed5e3, efb7184756dd41928c127a50037e3672; no voters: 
I20260709 13:10:57.435554 28676 raft_consensus.cc:2804] T 48ef7adf3ca24d4ba44c678da62b64bb P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:57.436121 28676 raft_consensus.cc:697] T 48ef7adf3ca24d4ba44c678da62b64bb P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 LEADER]: Becoming Leader. State: Replica: b234feb6496d4a1cbddaf57ae75ed5e3, State: Running, Role: LEADER
I20260709 13:10:57.436950 28676 consensus_queue.cc:237] T 48ef7adf3ca24d4ba44c678da62b64bb P b234feb6496d4a1cbddaf57ae75ed5e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:57.444423 28265 catalog_manager.cc:5697] T 48ef7adf3ca24d4ba44c678da62b64bb P b234feb6496d4a1cbddaf57ae75ed5e3 reported cstate change: term changed from 1 to 2, leader changed from 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129) to b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130). New cstate: current_term: 2 leader_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:57.514292 28602 raft_consensus.cc:993] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943: : Instructing follower b234feb6496d4a1cbddaf57ae75ed5e3 to start an election
I20260709 13:10:57.514791 28685 raft_consensus.cc:1081] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 LEADER]: Signalling peer b234feb6496d4a1cbddaf57ae75ed5e3 to start an election
I20260709 13:10:57.516484 28444 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "faa54b9861874eaa90e9077878da98c3"
dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
 from {username='slave'} at 127.0.0.1:58708
I20260709 13:10:57.517089 28444 raft_consensus.cc:493] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:57.517397 28444 raft_consensus.cc:3060] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:57.522012 28444 raft_consensus.cc:515] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } } peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } }
I20260709 13:10:57.523665 28444 leader_election.cc:290] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [CANDIDATE]: Term 3 election: Requested vote from peers efb7184756dd41928c127a50037e3672 (127.27.146.131:41969), 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037)
I20260709 13:10:57.524729 28517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faa54b9861874eaa90e9077878da98c3" candidate_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "efb7184756dd41928c127a50037e3672"
I20260709 13:10:57.524861 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faa54b9861874eaa90e9077878da98c3" candidate_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943"
I20260709 13:10:57.525367 28517 raft_consensus.cc:3060] T faa54b9861874eaa90e9077878da98c3 P efb7184756dd41928c127a50037e3672 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:57.525470 28366 raft_consensus.cc:3055] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:57.526186 28366 raft_consensus.cc:740] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1a5a33ca0108455c9cd1358bf0e50943, State: Running, Role: LEADER
I20260709 13:10:57.527045 28366 consensus_queue.cc:260] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } } peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } }
I20260709 13:10:57.527999 28366 raft_consensus.cc:3060] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:57.531951 28517 raft_consensus.cc:2468] T faa54b9861874eaa90e9077878da98c3 P efb7184756dd41928c127a50037e3672 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b234feb6496d4a1cbddaf57ae75ed5e3 in term 3.
I20260709 13:10:57.532967 28366 raft_consensus.cc:2468] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b234feb6496d4a1cbddaf57ae75ed5e3 in term 3.
I20260709 13:10:57.533236 28407 leader_election.cc:304] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b234feb6496d4a1cbddaf57ae75ed5e3, efb7184756dd41928c127a50037e3672; no voters: 
I20260709 13:10:57.534152 28676 raft_consensus.cc:2804] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:57.534649 28676 raft_consensus.cc:697] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 3 LEADER]: Becoming Leader. State: Replica: b234feb6496d4a1cbddaf57ae75ed5e3, State: Running, Role: LEADER
I20260709 13:10:57.535560 28676 consensus_queue.cc:237] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } } peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } }
I20260709 13:10:57.542654 28265 catalog_manager.cc:5697] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 reported cstate change: term changed from 2 to 3, leader changed from 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129) to b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130). New cstate: current_term: 3 leader_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:57.637908 28665 raft_consensus.cc:993] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672: : Instructing follower b234feb6496d4a1cbddaf57ae75ed5e3 to start an election
I20260709 13:10:57.638439 28665 raft_consensus.cc:1081] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [term 3 LEADER]: Signalling peer b234feb6496d4a1cbddaf57ae75ed5e3 to start an election
I20260709 13:10:57.640166 28444 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23939bc50fd04a08925ae3d5508ef5ab"
dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
 from {username='slave'} at 127.0.0.1:58692
I20260709 13:10:57.640801 28444 raft_consensus.cc:493] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:57.641129 28444 raft_consensus.cc:3060] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:57.645116 28444 raft_consensus.cc:515] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:57.646526 28444 leader_election.cc:290] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [CANDIDATE]: Term 4 election: Requested vote from peers 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037), efb7184756dd41928c127a50037e3672 (127.27.146.131:41969)
I20260709 13:10:57.647742 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23939bc50fd04a08925ae3d5508ef5ab" candidate_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943"
I20260709 13:10:57.647917 28517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23939bc50fd04a08925ae3d5508ef5ab" candidate_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "efb7184756dd41928c127a50037e3672"
I20260709 13:10:57.648253 28366 raft_consensus.cc:3060] T 23939bc50fd04a08925ae3d5508ef5ab P 1a5a33ca0108455c9cd1358bf0e50943 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:57.648553 28517 raft_consensus.cc:3055] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:57.648897 28517 raft_consensus.cc:740] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: efb7184756dd41928c127a50037e3672, State: Running, Role: LEADER
I20260709 13:10:57.649617 28517 consensus_queue.cc:260] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:57.650714 28517 raft_consensus.cc:3060] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:57.653082 28366 raft_consensus.cc:2468] T 23939bc50fd04a08925ae3d5508ef5ab P 1a5a33ca0108455c9cd1358bf0e50943 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b234feb6496d4a1cbddaf57ae75ed5e3 in term 4.
I20260709 13:10:57.654299 28409 leader_election.cc:304] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a5a33ca0108455c9cd1358bf0e50943, b234feb6496d4a1cbddaf57ae75ed5e3; no voters: 
I20260709 13:10:57.655191 28676 raft_consensus.cc:2804] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:57.655674 28676 raft_consensus.cc:697] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [term 4 LEADER]: Becoming Leader. State: Replica: b234feb6496d4a1cbddaf57ae75ed5e3, State: Running, Role: LEADER
I20260709 13:10:57.656466 28676 consensus_queue.cc:237] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:57.656869 28517 raft_consensus.cc:2468] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b234feb6496d4a1cbddaf57ae75ed5e3 in term 4.
I20260709 13:10:57.662657 28265 catalog_manager.cc:5697] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 reported cstate change: term changed from 3 to 4, leader changed from efb7184756dd41928c127a50037e3672 (127.27.146.131) to b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130). New cstate: current_term: 4 leader_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:57.872107 28602 raft_consensus.cc:993] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943: : Instructing follower b234feb6496d4a1cbddaf57ae75ed5e3 to start an election
I20260709 13:10:57.872689 28685 raft_consensus.cc:1081] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 LEADER]: Signalling peer b234feb6496d4a1cbddaf57ae75ed5e3 to start an election
I20260709 13:10:57.874356 28444 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ac16ecbdad44d309b75903ff8748aa2"
dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
 from {username='slave'} at 127.0.0.1:58708
I20260709 13:10:57.874855 28444 raft_consensus.cc:493] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:57.875116 28444 raft_consensus.cc:3060] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:57.880503 28444 raft_consensus.cc:515] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:57.882000 28444 leader_election.cc:290] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [CANDIDATE]: Term 3 election: Requested vote from peers 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037), efb7184756dd41928c127a50037e3672 (127.27.146.131:41969)
I20260709 13:10:57.883121 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac16ecbdad44d309b75903ff8748aa2" candidate_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943"
I20260709 13:10:57.883121 28517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac16ecbdad44d309b75903ff8748aa2" candidate_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "efb7184756dd41928c127a50037e3672"
I20260709 13:10:57.884011 28517 raft_consensus.cc:3060] T 6ac16ecbdad44d309b75903ff8748aa2 P efb7184756dd41928c127a50037e3672 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:57.883999 28366 raft_consensus.cc:3055] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:57.884573 28366 raft_consensus.cc:740] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1a5a33ca0108455c9cd1358bf0e50943, State: Running, Role: LEADER
I20260709 13:10:57.885372 28366 consensus_queue.cc:260] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:57.886605 28366 raft_consensus.cc:3060] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:57.891896 28517 raft_consensus.cc:2468] T 6ac16ecbdad44d309b75903ff8748aa2 P efb7184756dd41928c127a50037e3672 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b234feb6496d4a1cbddaf57ae75ed5e3 in term 3.
I20260709 13:10:57.893146 28407 leader_election.cc:304] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b234feb6496d4a1cbddaf57ae75ed5e3, efb7184756dd41928c127a50037e3672; no voters: 
I20260709 13:10:57.893357 28366 raft_consensus.cc:2468] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b234feb6496d4a1cbddaf57ae75ed5e3 in term 3.
I20260709 13:10:57.893992 28676 raft_consensus.cc:2804] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:57.894621 28676 raft_consensus.cc:697] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 3 LEADER]: Becoming Leader. State: Replica: b234feb6496d4a1cbddaf57ae75ed5e3, State: Running, Role: LEADER
I20260709 13:10:57.895372 28676 consensus_queue.cc:237] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:57.902011 28265 catalog_manager.cc:5697] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 reported cstate change: term changed from 2 to 3, leader changed from 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129) to b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130). New cstate: current_term: 3 leader_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:57.926227 28680 raft_consensus.cc:993] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672: : Instructing follower b234feb6496d4a1cbddaf57ae75ed5e3 to start an election
I20260709 13:10:57.926721 28665 raft_consensus.cc:1081] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [term 3 LEADER]: Signalling peer b234feb6496d4a1cbddaf57ae75ed5e3 to start an election
I20260709 13:10:57.928318 28444 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7c7c56087d64b37af648badd045b987"
dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
 from {username='slave'} at 127.0.0.1:58692
I20260709 13:10:57.928731 28444 raft_consensus.cc:493] T a7c7c56087d64b37af648badd045b987 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:57.928979 28444 raft_consensus.cc:3060] T a7c7c56087d64b37af648badd045b987 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:57.932989 28444 raft_consensus.cc:515] T a7c7c56087d64b37af648badd045b987 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:57.934371 28444 leader_election.cc:290] T a7c7c56087d64b37af648badd045b987 P b234feb6496d4a1cbddaf57ae75ed5e3 [CANDIDATE]: Term 4 election: Requested vote from peers 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037), efb7184756dd41928c127a50037e3672 (127.27.146.131:41969)
I20260709 13:10:57.935743 28517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7c7c56087d64b37af648badd045b987" candidate_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "efb7184756dd41928c127a50037e3672"
I20260709 13:10:57.935788 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7c7c56087d64b37af648badd045b987" candidate_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943"
I20260709 13:10:57.936358 28517 raft_consensus.cc:3055] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:57.936427 28366 raft_consensus.cc:3060] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:57.936676 28517 raft_consensus.cc:740] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: efb7184756dd41928c127a50037e3672, State: Running, Role: LEADER
I20260709 13:10:57.937486 28517 consensus_queue.cc:260] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:57.938417 28517 raft_consensus.cc:3060] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:57.942111 28366 raft_consensus.cc:2468] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b234feb6496d4a1cbddaf57ae75ed5e3 in term 4.
I20260709 13:10:57.943260 28409 leader_election.cc:304] T a7c7c56087d64b37af648badd045b987 P b234feb6496d4a1cbddaf57ae75ed5e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a5a33ca0108455c9cd1358bf0e50943, b234feb6496d4a1cbddaf57ae75ed5e3; no voters: 
I20260709 13:10:57.943634 28517 raft_consensus.cc:2468] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b234feb6496d4a1cbddaf57ae75ed5e3 in term 4.
I20260709 13:10:57.944186 28676 raft_consensus.cc:2804] T a7c7c56087d64b37af648badd045b987 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:57.944698 28676 raft_consensus.cc:697] T a7c7c56087d64b37af648badd045b987 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 4 LEADER]: Becoming Leader. State: Replica: b234feb6496d4a1cbddaf57ae75ed5e3, State: Running, Role: LEADER
I20260709 13:10:57.945585 28676 consensus_queue.cc:237] T a7c7c56087d64b37af648badd045b987 P b234feb6496d4a1cbddaf57ae75ed5e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:10:57.953562 28265 catalog_manager.cc:5697] T a7c7c56087d64b37af648badd045b987 P b234feb6496d4a1cbddaf57ae75ed5e3 reported cstate change: term changed from 3 to 4, leader changed from efb7184756dd41928c127a50037e3672 (127.27.146.131) to b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130). New cstate: current_term: 4 leader_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:57.985729 28517 raft_consensus.cc:1275] T 48ef7adf3ca24d4ba44c678da62b64bb P efb7184756dd41928c127a50037e3672 [term 2 FOLLOWER]: Refusing update from remote peer b234feb6496d4a1cbddaf57ae75ed5e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:57.987226 28676 consensus_queue.cc:1048] T 48ef7adf3ca24d4ba44c678da62b64bb P b234feb6496d4a1cbddaf57ae75ed5e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:58.001178 28366 raft_consensus.cc:1275] T 48ef7adf3ca24d4ba44c678da62b64bb P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 FOLLOWER]: Refusing update from remote peer b234feb6496d4a1cbddaf57ae75ed5e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:58.002687 28676 consensus_queue.cc:1048] T 48ef7adf3ca24d4ba44c678da62b64bb P b234feb6496d4a1cbddaf57ae75ed5e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:58.014648 28517 raft_consensus.cc:1275] T faa54b9861874eaa90e9077878da98c3 P efb7184756dd41928c127a50037e3672 [term 3 FOLLOWER]: Refusing update from remote peer b234feb6496d4a1cbddaf57ae75ed5e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:58.016237 28676 consensus_queue.cc:1048] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:58.025458 28366 raft_consensus.cc:1275] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 3 FOLLOWER]: Refusing update from remote peer b234feb6496d4a1cbddaf57ae75ed5e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:58.028076 28593 consensus_queue.cc:1048] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:58.092767 28366 raft_consensus.cc:1275] T 23939bc50fd04a08925ae3d5508ef5ab P 1a5a33ca0108455c9cd1358bf0e50943 [term 4 FOLLOWER]: Refusing update from remote peer b234feb6496d4a1cbddaf57ae75ed5e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:58.094226 28593 consensus_queue.cc:1048] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:58.104897 28517 raft_consensus.cc:1275] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [term 4 FOLLOWER]: Refusing update from remote peer b234feb6496d4a1cbddaf57ae75ed5e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:58.106544 28703 consensus_queue.cc:1048] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:58.386243 28366 raft_consensus.cc:1275] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943 [term 3 FOLLOWER]: Refusing update from remote peer b234feb6496d4a1cbddaf57ae75ed5e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:58.387990 28703 consensus_queue.cc:1048] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:58.397423 28517 raft_consensus.cc:1275] T 6ac16ecbdad44d309b75903ff8748aa2 P efb7184756dd41928c127a50037e3672 [term 3 FOLLOWER]: Refusing update from remote peer b234feb6496d4a1cbddaf57ae75ed5e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:58.399086 28697 consensus_queue.cc:1048] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:58.426385 28366 raft_consensus.cc:1275] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943 [term 4 FOLLOWER]: Refusing update from remote peer b234feb6496d4a1cbddaf57ae75ed5e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:58.428238 28593 consensus_queue.cc:1048] T a7c7c56087d64b37af648badd045b987 P b234feb6496d4a1cbddaf57ae75ed5e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:58.438642 28517 raft_consensus.cc:1275] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [term 4 FOLLOWER]: Refusing update from remote peer b234feb6496d4a1cbddaf57ae75ed5e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:58.440485 28703 consensus_queue.cc:1048] T a7c7c56087d64b37af648badd045b987 P b234feb6496d4a1cbddaf57ae75ed5e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:00.441933 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:00.454129 28444 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23939bc50fd04a08925ae3d5508ef5ab"
dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
mode: GRACEFUL
new_leader_uuid: "efb7184756dd41928c127a50037e3672"
 from {username='slave'} at 127.0.0.1:44302
I20260709 13:11:00.455125 28444 raft_consensus.cc:606] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [term 4 LEADER]: Received request to transfer leadership to TS efb7184756dd41928c127a50037e3672
I20260709 13:11:00.458940 28444 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48ef7adf3ca24d4ba44c678da62b64bb"
dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
mode: GRACEFUL
new_leader_uuid: "efb7184756dd41928c127a50037e3672"
 from {username='slave'} at 127.0.0.1:44302
I20260709 13:11:00.459833 28444 raft_consensus.cc:606] T 48ef7adf3ca24d4ba44c678da62b64bb P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 LEADER]: Received request to transfer leadership to TS efb7184756dd41928c127a50037e3672
I20260709 13:11:00.463209 28444 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ac16ecbdad44d309b75903ff8748aa2"
dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
mode: GRACEFUL
new_leader_uuid: "1a5a33ca0108455c9cd1358bf0e50943"
 from {username='slave'} at 127.0.0.1:44302
I20260709 13:11:00.463999 28444 raft_consensus.cc:606] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 3 LEADER]: Received request to transfer leadership to TS 1a5a33ca0108455c9cd1358bf0e50943
I20260709 13:11:00.467456 28444 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7c7c56087d64b37af648badd045b987"
dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
mode: GRACEFUL
new_leader_uuid: "1a5a33ca0108455c9cd1358bf0e50943"
 from {username='slave'} at 127.0.0.1:44302
I20260709 13:11:00.468739 28444 raft_consensus.cc:606] T a7c7c56087d64b37af648badd045b987 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 4 LEADER]: Received request to transfer leadership to TS 1a5a33ca0108455c9cd1358bf0e50943
I20260709 13:11:00.472057 28444 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "faa54b9861874eaa90e9077878da98c3"
dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
mode: GRACEFUL
new_leader_uuid: "1a5a33ca0108455c9cd1358bf0e50943"
 from {username='slave'} at 127.0.0.1:44302
I20260709 13:11:00.472647 28444 raft_consensus.cc:606] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 3 LEADER]: Received request to transfer leadership to TS 1a5a33ca0108455c9cd1358bf0e50943
I20260709 13:11:00.474040 28234 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:00.474586 28234 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:00.553826 28710 raft_consensus.cc:993] T a7c7c56087d64b37af648badd045b987 P b234feb6496d4a1cbddaf57ae75ed5e3: : Instructing follower 1a5a33ca0108455c9cd1358bf0e50943 to start an election
I20260709 13:11:00.554487 28676 raft_consensus.cc:1081] T a7c7c56087d64b37af648badd045b987 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 4 LEADER]: Signalling peer 1a5a33ca0108455c9cd1358bf0e50943 to start an election
I20260709 13:11:00.556192 28366 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7c7c56087d64b37af648badd045b987"
dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943"
 from {username='slave'} at 127.0.0.1:58092
I20260709 13:11:00.556702 28366 raft_consensus.cc:493] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:00.556990 28366 raft_consensus.cc:3060] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:00.562101 28366 raft_consensus.cc:515] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:11:00.564986 28366 leader_election.cc:290] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943 [CANDIDATE]: Term 5 election: Requested vote from peers b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130:40891), efb7184756dd41928c127a50037e3672 (127.27.146.131:41969)
I20260709 13:11:00.565640 28517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7c7c56087d64b37af648badd045b987" candidate_uuid: "1a5a33ca0108455c9cd1358bf0e50943" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "efb7184756dd41928c127a50037e3672"
I20260709 13:11:00.565631 28444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7c7c56087d64b37af648badd045b987" candidate_uuid: "1a5a33ca0108455c9cd1358bf0e50943" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
I20260709 13:11:00.566419 28517 raft_consensus.cc:3060] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:00.567008 28444 raft_consensus.cc:3055] T a7c7c56087d64b37af648badd045b987 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:00.567348 28444 raft_consensus.cc:740] T a7c7c56087d64b37af648badd045b987 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b234feb6496d4a1cbddaf57ae75ed5e3, State: Running, Role: LEADER
I20260709 13:11:00.568537 28444 consensus_queue.cc:260] T a7c7c56087d64b37af648badd045b987 P b234feb6496d4a1cbddaf57ae75ed5e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:11:00.569653 28444 raft_consensus.cc:3060] T a7c7c56087d64b37af648badd045b987 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:00.572110 28517 raft_consensus.cc:2468] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a5a33ca0108455c9cd1358bf0e50943 in term 5.
I20260709 13:11:00.573827 28332 leader_election.cc:304] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a5a33ca0108455c9cd1358bf0e50943, efb7184756dd41928c127a50037e3672; no voters: 
I20260709 13:11:00.576134 28711 raft_consensus.cc:2804] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:00.576676 28444 raft_consensus.cc:2468] T a7c7c56087d64b37af648badd045b987 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a5a33ca0108455c9cd1358bf0e50943 in term 5.
I20260709 13:11:00.577447 28711 raft_consensus.cc:697] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943 [term 5 LEADER]: Becoming Leader. State: Replica: 1a5a33ca0108455c9cd1358bf0e50943, State: Running, Role: LEADER
I20260709 13:11:00.578580 28711 consensus_queue.cc:237] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:11:00.585989 28262 catalog_manager.cc:5697] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943 reported cstate change: term changed from 4 to 5, leader changed from b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130) to 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129). New cstate: current_term: 5 leader_uuid: "1a5a33ca0108455c9cd1358bf0e50943" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:00.614351 28710 raft_consensus.cc:993] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3: : Instructing follower 1a5a33ca0108455c9cd1358bf0e50943 to start an election
I20260709 13:11:00.614873 28710 raft_consensus.cc:1081] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 3 LEADER]: Signalling peer 1a5a33ca0108455c9cd1358bf0e50943 to start an election
I20260709 13:11:00.616585 28366 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "faa54b9861874eaa90e9077878da98c3"
dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943"
 from {username='slave'} at 127.0.0.1:58092
I20260709 13:11:00.617031 28366 raft_consensus.cc:493] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:00.617269 28366 raft_consensus.cc:3060] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:00.621812 28366 raft_consensus.cc:515] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } } peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } }
I20260709 13:11:00.623593 28366 leader_election.cc:290] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 [CANDIDATE]: Term 4 election: Requested vote from peers efb7184756dd41928c127a50037e3672 (127.27.146.131:41969), b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130:40891)
I20260709 13:11:00.624331 28517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faa54b9861874eaa90e9077878da98c3" candidate_uuid: "1a5a33ca0108455c9cd1358bf0e50943" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "efb7184756dd41928c127a50037e3672"
I20260709 13:11:00.624902 28517 raft_consensus.cc:3060] T faa54b9861874eaa90e9077878da98c3 P efb7184756dd41928c127a50037e3672 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:00.624754 28444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faa54b9861874eaa90e9077878da98c3" candidate_uuid: "1a5a33ca0108455c9cd1358bf0e50943" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
I20260709 13:11:00.625458 28444 raft_consensus.cc:3055] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:00.625687 28444 raft_consensus.cc:740] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b234feb6496d4a1cbddaf57ae75ed5e3, State: Running, Role: LEADER
I20260709 13:11:00.626441 28444 consensus_queue.cc:260] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } } peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } }
I20260709 13:11:00.627389 28444 raft_consensus.cc:3060] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:00.629354 28517 raft_consensus.cc:2468] T faa54b9861874eaa90e9077878da98c3 P efb7184756dd41928c127a50037e3672 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a5a33ca0108455c9cd1358bf0e50943 in term 4.
I20260709 13:11:00.630411 28332 leader_election.cc:304] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a5a33ca0108455c9cd1358bf0e50943, efb7184756dd41928c127a50037e3672; no voters: 
I20260709 13:11:00.631157 28711 raft_consensus.cc:2804] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:00.631717 28711 raft_consensus.cc:697] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 4 LEADER]: Becoming Leader. State: Replica: 1a5a33ca0108455c9cd1358bf0e50943, State: Running, Role: LEADER
I20260709 13:11:00.632699 28711 consensus_queue.cc:237] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } } peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } }
I20260709 13:11:00.633522 28444 raft_consensus.cc:2468] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a5a33ca0108455c9cd1358bf0e50943 in term 4.
I20260709 13:11:00.641093 28262 catalog_manager.cc:5697] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 reported cstate change: term changed from 3 to 4, leader changed from b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130) to 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129). New cstate: current_term: 4 leader_uuid: "1a5a33ca0108455c9cd1358bf0e50943" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:00.650960 28676 raft_consensus.cc:993] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3: : Instructing follower efb7184756dd41928c127a50037e3672 to start an election
I20260709 13:11:00.651477 28710 raft_consensus.cc:1081] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [term 4 LEADER]: Signalling peer efb7184756dd41928c127a50037e3672 to start an election
I20260709 13:11:00.653424 28517 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23939bc50fd04a08925ae3d5508ef5ab"
dest_uuid: "efb7184756dd41928c127a50037e3672"
 from {username='slave'} at 127.0.0.1:59816
I20260709 13:11:00.653883 28517 raft_consensus.cc:493] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:00.654121 28517 raft_consensus.cc:3060] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:00.658994 28517 raft_consensus.cc:515] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:11:00.660749 28517 leader_election.cc:290] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [CANDIDATE]: Term 5 election: Requested vote from peers 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037), b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130:40891)
I20260709 13:11:00.661986 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23939bc50fd04a08925ae3d5508ef5ab" candidate_uuid: "efb7184756dd41928c127a50037e3672" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943"
I20260709 13:11:00.661968 28444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23939bc50fd04a08925ae3d5508ef5ab" candidate_uuid: "efb7184756dd41928c127a50037e3672" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
I20260709 13:11:00.662909 28366 raft_consensus.cc:3060] T 23939bc50fd04a08925ae3d5508ef5ab P 1a5a33ca0108455c9cd1358bf0e50943 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:00.662909 28444 raft_consensus.cc:3055] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:00.663564 28444 raft_consensus.cc:740] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b234feb6496d4a1cbddaf57ae75ed5e3, State: Running, Role: LEADER
I20260709 13:11:00.664669 28444 consensus_queue.cc:260] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:11:00.666627 28444 raft_consensus.cc:3060] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:00.673401 28366 raft_consensus.cc:2468] T 23939bc50fd04a08925ae3d5508ef5ab P 1a5a33ca0108455c9cd1358bf0e50943 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efb7184756dd41928c127a50037e3672 in term 5.
I20260709 13:11:00.675352 28483 leader_election.cc:304] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a5a33ca0108455c9cd1358bf0e50943, efb7184756dd41928c127a50037e3672; no voters: 
I20260709 13:11:00.675673 28444 raft_consensus.cc:2468] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efb7184756dd41928c127a50037e3672 in term 5.
I20260709 13:11:00.676527 28665 raft_consensus.cc:2804] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:00.678323 28665 raft_consensus.cc:697] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [term 5 LEADER]: Becoming Leader. State: Replica: efb7184756dd41928c127a50037e3672, State: Running, Role: LEADER
I20260709 13:11:00.679231 28665 consensus_queue.cc:237] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:11:00.687857 28262 catalog_manager.cc:5697] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 reported cstate change: term changed from 4 to 5, leader changed from b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130) to efb7184756dd41928c127a50037e3672 (127.27.146.131). New cstate: current_term: 5 leader_uuid: "efb7184756dd41928c127a50037e3672" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:00.715096 28710 raft_consensus.cc:993] T 48ef7adf3ca24d4ba44c678da62b64bb P b234feb6496d4a1cbddaf57ae75ed5e3: : Instructing follower efb7184756dd41928c127a50037e3672 to start an election
I20260709 13:11:00.715641 28676 raft_consensus.cc:1081] T 48ef7adf3ca24d4ba44c678da62b64bb P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 LEADER]: Signalling peer efb7184756dd41928c127a50037e3672 to start an election
I20260709 13:11:00.717492 28517 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "48ef7adf3ca24d4ba44c678da62b64bb"
dest_uuid: "efb7184756dd41928c127a50037e3672"
 from {username='slave'} at 127.0.0.1:59816
I20260709 13:11:00.718076 28517 raft_consensus.cc:493] T 48ef7adf3ca24d4ba44c678da62b64bb P efb7184756dd41928c127a50037e3672 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:00.718416 28517 raft_consensus.cc:3060] T 48ef7adf3ca24d4ba44c678da62b64bb P efb7184756dd41928c127a50037e3672 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:00.723006 28517 raft_consensus.cc:515] T 48ef7adf3ca24d4ba44c678da62b64bb P efb7184756dd41928c127a50037e3672 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:11:00.724750 28517 leader_election.cc:290] T 48ef7adf3ca24d4ba44c678da62b64bb P efb7184756dd41928c127a50037e3672 [CANDIDATE]: Term 3 election: Requested vote from peers 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037), b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130:40891)
I20260709 13:11:00.725883 28444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ef7adf3ca24d4ba44c678da62b64bb" candidate_uuid: "efb7184756dd41928c127a50037e3672" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
I20260709 13:11:00.726086 28366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48ef7adf3ca24d4ba44c678da62b64bb" candidate_uuid: "efb7184756dd41928c127a50037e3672" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943"
I20260709 13:11:00.726495 28444 raft_consensus.cc:3055] T 48ef7adf3ca24d4ba44c678da62b64bb P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:00.726541 28366 raft_consensus.cc:3060] T 48ef7adf3ca24d4ba44c678da62b64bb P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:00.726990 28444 raft_consensus.cc:740] T 48ef7adf3ca24d4ba44c678da62b64bb P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b234feb6496d4a1cbddaf57ae75ed5e3, State: Running, Role: LEADER
I20260709 13:11:00.727806 28444 consensus_queue.cc:260] T 48ef7adf3ca24d4ba44c678da62b64bb P b234feb6496d4a1cbddaf57ae75ed5e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:11:00.728946 28444 raft_consensus.cc:3060] T 48ef7adf3ca24d4ba44c678da62b64bb P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:00.733099 28366 raft_consensus.cc:2468] T 48ef7adf3ca24d4ba44c678da62b64bb P 1a5a33ca0108455c9cd1358bf0e50943 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efb7184756dd41928c127a50037e3672 in term 3.
I20260709 13:11:00.734678 28483 leader_election.cc:304] T 48ef7adf3ca24d4ba44c678da62b64bb P efb7184756dd41928c127a50037e3672 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a5a33ca0108455c9cd1358bf0e50943, efb7184756dd41928c127a50037e3672; no voters: 
I20260709 13:11:00.735044 28444 raft_consensus.cc:2468] T 48ef7adf3ca24d4ba44c678da62b64bb P b234feb6496d4a1cbddaf57ae75ed5e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efb7184756dd41928c127a50037e3672 in term 3.
I20260709 13:11:00.735632 28665 raft_consensus.cc:2804] T 48ef7adf3ca24d4ba44c678da62b64bb P efb7184756dd41928c127a50037e3672 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:00.736143 28665 raft_consensus.cc:697] T 48ef7adf3ca24d4ba44c678da62b64bb P efb7184756dd41928c127a50037e3672 [term 3 LEADER]: Becoming Leader. State: Replica: efb7184756dd41928c127a50037e3672, State: Running, Role: LEADER
I20260709 13:11:00.737006 28665 consensus_queue.cc:237] T 48ef7adf3ca24d4ba44c678da62b64bb P efb7184756dd41928c127a50037e3672 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:11:00.744755 28262 catalog_manager.cc:5697] T 48ef7adf3ca24d4ba44c678da62b64bb P efb7184756dd41928c127a50037e3672 reported cstate change: term changed from 2 to 3, leader changed from b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130) to efb7184756dd41928c127a50037e3672 (127.27.146.131). New cstate: current_term: 3 leader_uuid: "efb7184756dd41928c127a50037e3672" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:00.842226 28710 raft_consensus.cc:993] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3: : Instructing follower 1a5a33ca0108455c9cd1358bf0e50943 to start an election
I20260709 13:11:00.842712 28676 raft_consensus.cc:1081] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 3 LEADER]: Signalling peer 1a5a33ca0108455c9cd1358bf0e50943 to start an election
I20260709 13:11:00.844342 28366 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ac16ecbdad44d309b75903ff8748aa2"
dest_uuid: "1a5a33ca0108455c9cd1358bf0e50943"
 from {username='slave'} at 127.0.0.1:58092
I20260709 13:11:00.845198 28366 raft_consensus.cc:493] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:00.845530 28366 raft_consensus.cc:3060] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:00.851931 28366 raft_consensus.cc:515] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:11:00.853920 28366 leader_election.cc:290] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943 [CANDIDATE]: Term 4 election: Requested vote from peers b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130:40891), efb7184756dd41928c127a50037e3672 (127.27.146.131:41969)
I20260709 13:11:00.855043 28444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac16ecbdad44d309b75903ff8748aa2" candidate_uuid: "1a5a33ca0108455c9cd1358bf0e50943" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3"
I20260709 13:11:00.855253 28517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac16ecbdad44d309b75903ff8748aa2" candidate_uuid: "1a5a33ca0108455c9cd1358bf0e50943" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "efb7184756dd41928c127a50037e3672"
I20260709 13:11:00.855670 28444 raft_consensus.cc:3055] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:00.856027 28517 raft_consensus.cc:3060] T 6ac16ecbdad44d309b75903ff8748aa2 P efb7184756dd41928c127a50037e3672 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:00.856081 28444 raft_consensus.cc:740] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b234feb6496d4a1cbddaf57ae75ed5e3, State: Running, Role: LEADER
I20260709 13:11:00.857231 28444 consensus_queue.cc:260] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:11:00.858589 28444 raft_consensus.cc:3060] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:00.864774 28517 raft_consensus.cc:2468] T 6ac16ecbdad44d309b75903ff8748aa2 P efb7184756dd41928c127a50037e3672 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a5a33ca0108455c9cd1358bf0e50943 in term 4.
I20260709 13:11:00.866348 28332 leader_election.cc:304] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a5a33ca0108455c9cd1358bf0e50943, efb7184756dd41928c127a50037e3672; no voters: 
I20260709 13:11:00.867045 28444 raft_consensus.cc:2468] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a5a33ca0108455c9cd1358bf0e50943 in term 4.
I20260709 13:11:00.867158 28711 raft_consensus.cc:2804] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:00.868055 28711 raft_consensus.cc:697] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943 [term 4 LEADER]: Becoming Leader. State: Replica: 1a5a33ca0108455c9cd1358bf0e50943, State: Running, Role: LEADER
I20260709 13:11:00.868949 28711 consensus_queue.cc:237] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } }
I20260709 13:11:00.878616 28262 catalog_manager.cc:5697] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943 reported cstate change: term changed from 3 to 4, leader changed from b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130) to 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129). New cstate: current_term: 4 leader_uuid: "1a5a33ca0108455c9cd1358bf0e50943" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:01.028508 28517 raft_consensus.cc:1275] T faa54b9861874eaa90e9077878da98c3 P efb7184756dd41928c127a50037e3672 [term 4 FOLLOWER]: Refusing update from remote peer 1a5a33ca0108455c9cd1358bf0e50943: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:01.030181 28711 consensus_queue.cc:1048] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:01.042541 28444 raft_consensus.cc:1275] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 4 FOLLOWER]: Refusing update from remote peer 1a5a33ca0108455c9cd1358bf0e50943: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:01.044643 28711 consensus_queue.cc:1048] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:01.080084 28517 raft_consensus.cc:1275] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [term 5 FOLLOWER]: Refusing update from remote peer 1a5a33ca0108455c9cd1358bf0e50943: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:11:01.081457 28711 consensus_queue.cc:1048] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:01.092686 28444 raft_consensus.cc:1275] T a7c7c56087d64b37af648badd045b987 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 5 FOLLOWER]: Refusing update from remote peer 1a5a33ca0108455c9cd1358bf0e50943: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:11:01.094092 28712 consensus_queue.cc:1048] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:01.120182 28366 raft_consensus.cc:1275] T 23939bc50fd04a08925ae3d5508ef5ab P 1a5a33ca0108455c9cd1358bf0e50943 [term 5 FOLLOWER]: Refusing update from remote peer efb7184756dd41928c127a50037e3672: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:11:01.121114 28369 raft_consensus.cc:1275] T 48ef7adf3ca24d4ba44c678da62b64bb P 1a5a33ca0108455c9cd1358bf0e50943 [term 3 FOLLOWER]: Refusing update from remote peer efb7184756dd41928c127a50037e3672: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:01.121778 28719 consensus_queue.cc:1048] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:01.122563 28665 consensus_queue.cc:1048] T 48ef7adf3ca24d4ba44c678da62b64bb P efb7184756dd41928c127a50037e3672 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a5a33ca0108455c9cd1358bf0e50943" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 36037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:01.135811 28444 raft_consensus.cc:1275] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [term 5 FOLLOWER]: Refusing update from remote peer efb7184756dd41928c127a50037e3672: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:11:01.138197 28734 consensus_queue.cc:1048] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:01.141502 28444 raft_consensus.cc:1275] T 48ef7adf3ca24d4ba44c678da62b64bb P b234feb6496d4a1cbddaf57ae75ed5e3 [term 3 FOLLOWER]: Refusing update from remote peer efb7184756dd41928c127a50037e3672: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:01.143167 28719 consensus_queue.cc:1048] T 48ef7adf3ca24d4ba44c678da62b64bb P efb7184756dd41928c127a50037e3672 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:01.445855 28517 raft_consensus.cc:1275] T 6ac16ecbdad44d309b75903ff8748aa2 P efb7184756dd41928c127a50037e3672 [term 4 FOLLOWER]: Refusing update from remote peer 1a5a33ca0108455c9cd1358bf0e50943: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:01.447094 28712 consensus_queue.cc:1048] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efb7184756dd41928c127a50037e3672" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:01.457113 28444 raft_consensus.cc:1275] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 4 FOLLOWER]: Refusing update from remote peer 1a5a33ca0108455c9cd1358bf0e50943: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:01.459075 28729 consensus_queue.cc:1048] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b234feb6496d4a1cbddaf57ae75ed5e3" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:01.475860 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:01.481165 28234 tablet_server.cc:179] TabletServer@127.27.146.129:0 shutting down...
I20260709 13:11:01.520597 28234 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:01.521503 28234 tablet_replica.cc:333] T 23939bc50fd04a08925ae3d5508ef5ab P 1a5a33ca0108455c9cd1358bf0e50943: stopping tablet replica
I20260709 13:11:01.522461 28234 raft_consensus.cc:2243] T 23939bc50fd04a08925ae3d5508ef5ab P 1a5a33ca0108455c9cd1358bf0e50943 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.522997 28234 raft_consensus.cc:2272] T 23939bc50fd04a08925ae3d5508ef5ab P 1a5a33ca0108455c9cd1358bf0e50943 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.526298 28234 tablet_replica.cc:333] T a24e93a2f6ca4b23b4d193527621e98b P 1a5a33ca0108455c9cd1358bf0e50943: stopping tablet replica
I20260709 13:11:01.527014 28234 raft_consensus.cc:2243] T a24e93a2f6ca4b23b4d193527621e98b P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.527581 28234 raft_consensus.cc:2272] T a24e93a2f6ca4b23b4d193527621e98b P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.529593 28234 tablet_replica.cc:333] T 178f126036d74fc1aa8e7db809be61d0 P 1a5a33ca0108455c9cd1358bf0e50943: stopping tablet replica
I20260709 13:11:01.530170 28234 raft_consensus.cc:2243] T 178f126036d74fc1aa8e7db809be61d0 P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.530660 28234 raft_consensus.cc:2272] T 178f126036d74fc1aa8e7db809be61d0 P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.532688 28234 tablet_replica.cc:333] T cd08ca5dee984515ad04c435411426e3 P 1a5a33ca0108455c9cd1358bf0e50943: stopping tablet replica
I20260709 13:11:01.533282 28234 raft_consensus.cc:2243] T cd08ca5dee984515ad04c435411426e3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.533756 28234 raft_consensus.cc:2272] T cd08ca5dee984515ad04c435411426e3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.535708 28234 tablet_replica.cc:333] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943: stopping tablet replica
I20260709 13:11:01.536365 28234 raft_consensus.cc:2243] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:11:01.537166 28234 raft_consensus.cc:2272] T a7c7c56087d64b37af648badd045b987 P 1a5a33ca0108455c9cd1358bf0e50943 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.539793 28234 tablet_replica.cc:333] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943: stopping tablet replica
I20260709 13:11:01.540350 28234 raft_consensus.cc:2243] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:11:01.541257 28234 raft_consensus.cc:2272] T 6ac16ecbdad44d309b75903ff8748aa2 P 1a5a33ca0108455c9cd1358bf0e50943 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.543614 28234 tablet_replica.cc:333] T 48ef7adf3ca24d4ba44c678da62b64bb P 1a5a33ca0108455c9cd1358bf0e50943: stopping tablet replica
I20260709 13:11:01.544142 28234 raft_consensus.cc:2243] T 48ef7adf3ca24d4ba44c678da62b64bb P 1a5a33ca0108455c9cd1358bf0e50943 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.544605 28234 raft_consensus.cc:2272] T 48ef7adf3ca24d4ba44c678da62b64bb P 1a5a33ca0108455c9cd1358bf0e50943 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.546877 28234 tablet_replica.cc:333] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943: stopping tablet replica
I20260709 13:11:01.547413 28234 raft_consensus.cc:2243] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:11:01.548354 28234 raft_consensus.cc:2272] T faa54b9861874eaa90e9077878da98c3 P 1a5a33ca0108455c9cd1358bf0e50943 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.550549 28234 tablet_replica.cc:333] T cac3fbb52a734ffe840da27199a58f05 P 1a5a33ca0108455c9cd1358bf0e50943: stopping tablet replica
I20260709 13:11:01.551049 28234 raft_consensus.cc:2243] T cac3fbb52a734ffe840da27199a58f05 P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.551554 28234 raft_consensus.cc:2272] T cac3fbb52a734ffe840da27199a58f05 P 1a5a33ca0108455c9cd1358bf0e50943 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:01.738488 28409 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.146.129:36037: connect: Connection refused (error 111)
I20260709 13:11:01.739979 28234 tablet_server.cc:196] TabletServer@127.27.146.129:0 shutdown complete.
W20260709 13:11:01.747424 28409 consensus_peers.cc:597] T 178f126036d74fc1aa8e7db809be61d0 P b234feb6496d4a1cbddaf57ae75ed5e3 -> Peer 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037): Couldn't send request to peer 1a5a33ca0108455c9cd1358bf0e50943. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:36037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:01.757516 28409 consensus_peers.cc:597] T cac3fbb52a734ffe840da27199a58f05 P b234feb6496d4a1cbddaf57ae75ed5e3 -> Peer 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037): Couldn't send request to peer 1a5a33ca0108455c9cd1358bf0e50943. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:36037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:01.757608 28483 consensus_peers.cc:597] T 48ef7adf3ca24d4ba44c678da62b64bb P efb7184756dd41928c127a50037e3672 -> Peer 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037): Couldn't send request to peer 1a5a33ca0108455c9cd1358bf0e50943. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:36037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:01.758456 28483 consensus_peers.cc:597] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 -> Peer 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037): Couldn't send request to peer 1a5a33ca0108455c9cd1358bf0e50943. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:36037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:01.759368 28483 consensus_peers.cc:597] T a24e93a2f6ca4b23b4d193527621e98b P efb7184756dd41928c127a50037e3672 -> Peer 1a5a33ca0108455c9cd1358bf0e50943 (127.27.146.129:36037): Couldn't send request to peer 1a5a33ca0108455c9cd1358bf0e50943. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:36037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:01.773048 28234 tablet_server.cc:179] TabletServer@127.27.146.130:0 shutting down...
I20260709 13:11:01.811405 28234 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:01.812222 28234 tablet_replica.cc:333] T a24e93a2f6ca4b23b4d193527621e98b P b234feb6496d4a1cbddaf57ae75ed5e3: stopping tablet replica
I20260709 13:11:01.812992 28234 raft_consensus.cc:2243] T a24e93a2f6ca4b23b4d193527621e98b P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.813421 28234 raft_consensus.cc:2272] T a24e93a2f6ca4b23b4d193527621e98b P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.815124 28234 tablet_replica.cc:333] T 178f126036d74fc1aa8e7db809be61d0 P b234feb6496d4a1cbddaf57ae75ed5e3: stopping tablet replica
I20260709 13:11:01.815701 28234 raft_consensus.cc:2243] T 178f126036d74fc1aa8e7db809be61d0 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:01.816406 28234 raft_consensus.cc:2272] T 178f126036d74fc1aa8e7db809be61d0 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.818075 28234 tablet_replica.cc:333] T cd08ca5dee984515ad04c435411426e3 P b234feb6496d4a1cbddaf57ae75ed5e3: stopping tablet replica
I20260709 13:11:01.818523 28234 raft_consensus.cc:2243] T cd08ca5dee984515ad04c435411426e3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:01.819186 28234 raft_consensus.cc:2272] T cd08ca5dee984515ad04c435411426e3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.820730 28234 tablet_replica.cc:333] T a7c7c56087d64b37af648badd045b987 P b234feb6496d4a1cbddaf57ae75ed5e3: stopping tablet replica
I20260709 13:11:01.821211 28234 raft_consensus.cc:2243] T a7c7c56087d64b37af648badd045b987 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.821548 28234 raft_consensus.cc:2272] T a7c7c56087d64b37af648badd045b987 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.823818 28234 tablet_replica.cc:333] T 48ef7adf3ca24d4ba44c678da62b64bb P b234feb6496d4a1cbddaf57ae75ed5e3: stopping tablet replica
I20260709 13:11:01.824267 28234 raft_consensus.cc:2243] T 48ef7adf3ca24d4ba44c678da62b64bb P b234feb6496d4a1cbddaf57ae75ed5e3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.824661 28234 raft_consensus.cc:2272] T 48ef7adf3ca24d4ba44c678da62b64bb P b234feb6496d4a1cbddaf57ae75ed5e3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.827219 28234 tablet_replica.cc:333] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3: stopping tablet replica
I20260709 13:11:01.827723 28234 raft_consensus.cc:2243] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.828073 28234 raft_consensus.cc:2272] T 6ac16ecbdad44d309b75903ff8748aa2 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.830129 28234 tablet_replica.cc:333] T cac3fbb52a734ffe840da27199a58f05 P b234feb6496d4a1cbddaf57ae75ed5e3: stopping tablet replica
I20260709 13:11:01.830574 28234 raft_consensus.cc:2243] T cac3fbb52a734ffe840da27199a58f05 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:01.831233 28234 raft_consensus.cc:2272] T cac3fbb52a734ffe840da27199a58f05 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.832751 28234 tablet_replica.cc:333] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3: stopping tablet replica
I20260709 13:11:01.833181 28234 raft_consensus.cc:2243] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.833494 28234 raft_consensus.cc:2272] T 23939bc50fd04a08925ae3d5508ef5ab P b234feb6496d4a1cbddaf57ae75ed5e3 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.835578 28234 tablet_replica.cc:333] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3: stopping tablet replica
I20260709 13:11:01.836074 28234 raft_consensus.cc:2243] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.836467 28234 raft_consensus.cc:2272] T faa54b9861874eaa90e9077878da98c3 P b234feb6496d4a1cbddaf57ae75ed5e3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.867187 28234 tablet_server.cc:196] TabletServer@127.27.146.130:0 shutdown complete.
I20260709 13:11:01.889560 28234 tablet_server.cc:179] TabletServer@127.27.146.131:0 shutting down...
W20260709 13:11:01.911739 28484 consensus_peers.cc:597] T a24e93a2f6ca4b23b4d193527621e98b P efb7184756dd41928c127a50037e3672 -> Peer b234feb6496d4a1cbddaf57ae75ed5e3 (127.27.146.130:40891): Couldn't send request to peer b234feb6496d4a1cbddaf57ae75ed5e3. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40891: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:01.926549 28234 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:01.927413 28234 tablet_replica.cc:333] T cac3fbb52a734ffe840da27199a58f05 P efb7184756dd41928c127a50037e3672: stopping tablet replica
I20260709 13:11:01.928224 28234 raft_consensus.cc:2243] T cac3fbb52a734ffe840da27199a58f05 P efb7184756dd41928c127a50037e3672 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.928802 28234 raft_consensus.cc:2272] T cac3fbb52a734ffe840da27199a58f05 P efb7184756dd41928c127a50037e3672 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.930652 28234 tablet_replica.cc:333] T 178f126036d74fc1aa8e7db809be61d0 P efb7184756dd41928c127a50037e3672: stopping tablet replica
I20260709 13:11:01.931208 28234 raft_consensus.cc:2243] T 178f126036d74fc1aa8e7db809be61d0 P efb7184756dd41928c127a50037e3672 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.931742 28234 raft_consensus.cc:2272] T 178f126036d74fc1aa8e7db809be61d0 P efb7184756dd41928c127a50037e3672 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.933465 28234 tablet_replica.cc:333] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672: stopping tablet replica
I20260709 13:11:01.934002 28234 raft_consensus.cc:2243] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:11:01.934777 28234 raft_consensus.cc:2272] T 23939bc50fd04a08925ae3d5508ef5ab P efb7184756dd41928c127a50037e3672 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.937107 28234 tablet_replica.cc:333] T a24e93a2f6ca4b23b4d193527621e98b P efb7184756dd41928c127a50037e3672: stopping tablet replica
I20260709 13:11:01.937657 28234 raft_consensus.cc:2243] T a24e93a2f6ca4b23b4d193527621e98b P efb7184756dd41928c127a50037e3672 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:01.938410 28234 raft_consensus.cc:2272] T a24e93a2f6ca4b23b4d193527621e98b P efb7184756dd41928c127a50037e3672 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.940317 28234 tablet_replica.cc:333] T 6ac16ecbdad44d309b75903ff8748aa2 P efb7184756dd41928c127a50037e3672: stopping tablet replica
I20260709 13:11:01.940902 28234 raft_consensus.cc:2243] T 6ac16ecbdad44d309b75903ff8748aa2 P efb7184756dd41928c127a50037e3672 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.941386 28234 raft_consensus.cc:2272] T 6ac16ecbdad44d309b75903ff8748aa2 P efb7184756dd41928c127a50037e3672 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.944245 28234 tablet_replica.cc:333] T 48ef7adf3ca24d4ba44c678da62b64bb P efb7184756dd41928c127a50037e3672: stopping tablet replica
I20260709 13:11:01.944772 28234 raft_consensus.cc:2243] T 48ef7adf3ca24d4ba44c678da62b64bb P efb7184756dd41928c127a50037e3672 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:01.945475 28234 raft_consensus.cc:2272] T 48ef7adf3ca24d4ba44c678da62b64bb P efb7184756dd41928c127a50037e3672 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.947623 28234 tablet_replica.cc:333] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672: stopping tablet replica
I20260709 13:11:01.948112 28234 raft_consensus.cc:2243] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.948544 28234 raft_consensus.cc:2272] T a7c7c56087d64b37af648badd045b987 P efb7184756dd41928c127a50037e3672 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.950934 28234 tablet_replica.cc:333] T cd08ca5dee984515ad04c435411426e3 P efb7184756dd41928c127a50037e3672: stopping tablet replica
I20260709 13:11:01.951421 28234 raft_consensus.cc:2243] T cd08ca5dee984515ad04c435411426e3 P efb7184756dd41928c127a50037e3672 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.951905 28234 raft_consensus.cc:2272] T cd08ca5dee984515ad04c435411426e3 P efb7184756dd41928c127a50037e3672 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.953534 28234 tablet_replica.cc:333] T faa54b9861874eaa90e9077878da98c3 P efb7184756dd41928c127a50037e3672: stopping tablet replica
I20260709 13:11:01.953979 28234 raft_consensus.cc:2243] T faa54b9861874eaa90e9077878da98c3 P efb7184756dd41928c127a50037e3672 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:01.954408 28234 raft_consensus.cc:2272] T faa54b9861874eaa90e9077878da98c3 P efb7184756dd41928c127a50037e3672 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:01.985543 28234 tablet_server.cc:196] TabletServer@127.27.146.131:0 shutdown complete.
I20260709 13:11:02.006528 28234 master.cc:562] Master@127.27.146.190:37105 shutting down...
I20260709 13:11:02.155695 28234 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e46dd153599d44469f72e9e95ac5a404 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:02.156319 28234 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e46dd153599d44469f72e9e95ac5a404 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:02.156690 28234 tablet_replica.cc:333] T 00000000000000000000000000000000 P e46dd153599d44469f72e9e95ac5a404: stopping tablet replica
I20260709 13:11:02.176162 28234 master.cc:584] Master@127.27.146.190:37105 shutdown complete.
1a5a33ca0108455c9cd1358bf0e50943  4
b234feb6496d4a1cbddaf57ae75ed5e3  4
efb7184756dd41928c127a50037e3672  1
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (13396 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:11:02.220255 28234 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.27.146.190:43467
I20260709 13:11:02.221417 28234 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:02.228766 28748 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:02.228932 28747 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:02.229684 28750 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:02.230165 28234 server_base.cc:1061] running on GCE node
I20260709 13:11:02.231160 28234 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:02.231348 28234 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:02.231892 28234 hybrid_clock.cc:648] HybridClock initialized: now 1783602662231872 us; error 0 us; skew 500 ppm
I20260709 13:11:02.232476 28234 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:02.235313 28234 webserver.cc:533] Webserver started at http://127.27.146.190:45845/ using document root <none> and password file <none>
I20260709 13:11:02.235918 28234 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:02.236116 28234 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:02.236440 28234 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:02.237613 28234 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602648606606-28234-0/minicluster-data/master-0-root/instance:
uuid: "dc19e5facfda45d7a754de977e1f0daf"
format_stamp: "Formatted at 2026-07-09 13:11:02 on dist-test-slave-clfv"
I20260709 13:11:02.242558 28234 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:11:02.246565 28755 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:02.247663 28234 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:11:02.247953 28234 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602648606606-28234-0/minicluster-data/master-0-root
uuid: "dc19e5facfda45d7a754de977e1f0daf"
format_stamp: "Formatted at 2026-07-09 13:11:02 on dist-test-slave-clfv"
I20260709 13:11:02.248258 28234 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602648606606-28234-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602648606606-28234-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602648606606-28234-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:02.261988 28234 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:02.263417 28234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:02.309792 28234 rpc_server.cc:307] RPC server started. Bound to: 127.27.146.190:43467
I20260709 13:11:02.309918 28806 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.146.190:43467 every 8 connection(s)
I20260709 13:11:02.314320 28807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.323612 28807 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc19e5facfda45d7a754de977e1f0daf: Bootstrap starting.
I20260709 13:11:02.328164 28807 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dc19e5facfda45d7a754de977e1f0daf: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:02.332942 28807 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc19e5facfda45d7a754de977e1f0daf: No bootstrap required, opened a new log
I20260709 13:11:02.335031 28807 raft_consensus.cc:359] T 00000000000000000000000000000000 P dc19e5facfda45d7a754de977e1f0daf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc19e5facfda45d7a754de977e1f0daf" member_type: VOTER }
I20260709 13:11:02.335407 28807 raft_consensus.cc:385] T 00000000000000000000000000000000 P dc19e5facfda45d7a754de977e1f0daf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:02.335700 28807 raft_consensus.cc:740] T 00000000000000000000000000000000 P dc19e5facfda45d7a754de977e1f0daf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc19e5facfda45d7a754de977e1f0daf, State: Initialized, Role: FOLLOWER
I20260709 13:11:02.336328 28807 consensus_queue.cc:260] T 00000000000000000000000000000000 P dc19e5facfda45d7a754de977e1f0daf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc19e5facfda45d7a754de977e1f0daf" member_type: VOTER }
I20260709 13:11:02.336781 28807 raft_consensus.cc:399] T 00000000000000000000000000000000 P dc19e5facfda45d7a754de977e1f0daf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:11:02.337002 28807 raft_consensus.cc:493] T 00000000000000000000000000000000 P dc19e5facfda45d7a754de977e1f0daf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:11:02.337332 28807 raft_consensus.cc:3060] T 00000000000000000000000000000000 P dc19e5facfda45d7a754de977e1f0daf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:02.341410 28807 raft_consensus.cc:515] T 00000000000000000000000000000000 P dc19e5facfda45d7a754de977e1f0daf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc19e5facfda45d7a754de977e1f0daf" member_type: VOTER }
I20260709 13:11:02.341951 28807 leader_election.cc:304] T 00000000000000000000000000000000 P dc19e5facfda45d7a754de977e1f0daf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dc19e5facfda45d7a754de977e1f0daf; no voters: 
I20260709 13:11:02.343240 28807 leader_election.cc:290] T 00000000000000000000000000000000 P dc19e5facfda45d7a754de977e1f0daf [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:11:02.343794 28810 raft_consensus.cc:2804] T 00000000000000000000000000000000 P dc19e5facfda45d7a754de977e1f0daf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:02.345321 28810 raft_consensus.cc:697] T 00000000000000000000000000000000 P dc19e5facfda45d7a754de977e1f0daf [term 1 LEADER]: Becoming Leader. State: Replica: dc19e5facfda45d7a754de977e1f0daf, State: Running, Role: LEADER
I20260709 13:11:02.346101 28810 consensus_queue.cc:237] T 00000000000000000000000000000000 P dc19e5facfda45d7a754de977e1f0daf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc19e5facfda45d7a754de977e1f0daf" member_type: VOTER }
I20260709 13:11:02.346303 28807 sys_catalog.cc:565] T 00000000000000000000000000000000 P dc19e5facfda45d7a754de977e1f0daf [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:11:02.351588 28811 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc19e5facfda45d7a754de977e1f0daf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dc19e5facfda45d7a754de977e1f0daf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc19e5facfda45d7a754de977e1f0daf" member_type: VOTER } }
I20260709 13:11:02.352468 28811 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc19e5facfda45d7a754de977e1f0daf [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:02.352397 28812 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc19e5facfda45d7a754de977e1f0daf [sys.catalog]: SysCatalogTable state changed. Reason: New leader dc19e5facfda45d7a754de977e1f0daf. Latest consensus state: current_term: 1 leader_uuid: "dc19e5facfda45d7a754de977e1f0daf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc19e5facfda45d7a754de977e1f0daf" member_type: VOTER } }
I20260709 13:11:02.353490 28812 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc19e5facfda45d7a754de977e1f0daf [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:02.356125 28818 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:11:02.361780 28818 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:11:02.366326 28234 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:11:02.372294 28818 catalog_manager.cc:1383] Generated new cluster ID: 9215a18aa32f4a94ace4bdf7449d7bda
I20260709 13:11:02.372749 28818 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:11:02.408048 28818 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:11:02.409513 28818 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:11:02.423298 28818 catalog_manager.cc:6070] T 00000000000000000000000000000000 P dc19e5facfda45d7a754de977e1f0daf: Generated new TSK 0
I20260709 13:11:02.424124 28818 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:11:02.433421 28234 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:02.440784 28828 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:02.442088 28829 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:02.445083 28831 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:02.445363 28234 server_base.cc:1061] running on GCE node
I20260709 13:11:02.446272 28234 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:02.446450 28234 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:02.446570 28234 hybrid_clock.cc:648] HybridClock initialized: now 1783602662446559 us; error 0 us; skew 500 ppm
I20260709 13:11:02.447026 28234 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:02.449685 28234 webserver.cc:533] Webserver started at http://127.27.146.129:42065/ using document root <none> and password file <none>
I20260709 13:11:02.450152 28234 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:02.450420 28234 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:02.450721 28234 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:02.451836 28234 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602648606606-28234-0/minicluster-data/ts-0-root/instance:
uuid: "9c79e0ceee6c4fe9ab2850342122b291"
format_stamp: "Formatted at 2026-07-09 13:11:02 on dist-test-slave-clfv"
I20260709 13:11:02.456610 28234 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:11:02.460958 28836 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:02.462200 28234 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:11:02.462601 28234 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602648606606-28234-0/minicluster-data/ts-0-root
uuid: "9c79e0ceee6c4fe9ab2850342122b291"
format_stamp: "Formatted at 2026-07-09 13:11:02 on dist-test-slave-clfv"
I20260709 13:11:02.462945 28234 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602648606606-28234-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602648606606-28234-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602648606606-28234-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:02.484284 28234 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:02.485778 28234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:02.487574 28234 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:02.490336 28234 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:02.490595 28234 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:02.490866 28234 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:02.491067 28234 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:02.541982 28234 rpc_server.cc:307] RPC server started. Bound to: 127.27.146.129:45909
I20260709 13:11:02.542128 28898 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.146.129:45909 every 8 connection(s)
I20260709 13:11:02.547406 28234 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:02.558408 28904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:02.558921 28903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:02.562172 28906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:02.562306 28234 server_base.cc:1061] running on GCE node
I20260709 13:11:02.563572 28234 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:02.563879 28234 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:02.564005 28234 hybrid_clock.cc:648] HybridClock initialized: now 1783602662563992 us; error 0 us; skew 500 ppm
I20260709 13:11:02.564957 28234 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:02.569795 28234 webserver.cc:533] Webserver started at http://127.27.146.130:32859/ using document root <none> and password file <none>
I20260709 13:11:02.571697 28234 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:02.572043 28234 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:02.572384 28234 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:02.574309 28899 heartbeater.cc:344] Connected to a master server at 127.27.146.190:43467
I20260709 13:11:02.574397 28234 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602648606606-28234-0/minicluster-data/ts-1-root/instance:
uuid: "f240b20bb4d549f1abfde7991d89ff4c"
format_stamp: "Formatted at 2026-07-09 13:11:02 on dist-test-slave-clfv"
I20260709 13:11:02.574868 28899 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:02.576006 28899 heartbeater.cc:507] Master 127.27.146.190:43467 requested a full tablet report, sending...
I20260709 13:11:02.579105 28772 ts_manager.cc:194] Registered new tserver with Master: 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909)
I20260709 13:11:02.582002 28234 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:11:02.582495 28772 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36388
I20260709 13:11:02.587157 28911 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:02.588389 28234 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:11:02.588881 28234 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602648606606-28234-0/minicluster-data/ts-1-root
uuid: "f240b20bb4d549f1abfde7991d89ff4c"
format_stamp: "Formatted at 2026-07-09 13:11:02 on dist-test-slave-clfv"
I20260709 13:11:02.589217 28234 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602648606606-28234-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602648606606-28234-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602648606606-28234-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:02.610288 28234 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:02.611948 28234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:02.613705 28234 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:02.616323 28234 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:02.616889 28234 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.000s	sys 0.000s
I20260709 13:11:02.617233 28234 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:02.617439 28234 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:02.667481 28234 rpc_server.cc:307] RPC server started. Bound to: 127.27.146.130:37889
I20260709 13:11:02.667747 28973 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.146.130:37889 every 8 connection(s)
I20260709 13:11:02.673118 28234 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:02.682782 28977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:02.683338 28978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:02.685913 28980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:02.687301 28234 server_base.cc:1061] running on GCE node
I20260709 13:11:02.688445 28234 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:02.688637 28234 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:02.688910 28234 hybrid_clock.cc:648] HybridClock initialized: now 1783602662688869 us; error 0 us; skew 500 ppm
I20260709 13:11:02.689177 28974 heartbeater.cc:344] Connected to a master server at 127.27.146.190:43467
I20260709 13:11:02.689566 28974 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:02.689576 28234 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:02.690649 28974 heartbeater.cc:507] Master 127.27.146.190:43467 requested a full tablet report, sending...
I20260709 13:11:02.692878 28234 webserver.cc:533] Webserver started at http://127.27.146.131:33721/ using document root <none> and password file <none>
I20260709 13:11:02.693346 28772 ts_manager.cc:194] Registered new tserver with Master: f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889)
I20260709 13:11:02.693606 28234 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:02.693923 28234 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:02.694259 28234 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:02.695176 28772 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36402
I20260709 13:11:02.695729 28234 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602648606606-28234-0/minicluster-data/ts-2-root/instance:
uuid: "cc7720d1626a4ef88af4b3319ba703da"
format_stamp: "Formatted at 2026-07-09 13:11:02 on dist-test-slave-clfv"
I20260709 13:11:02.701318 28234 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:11:02.705171 28985 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:02.706096 28234 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:11:02.706380 28234 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602648606606-28234-0/minicluster-data/ts-2-root
uuid: "cc7720d1626a4ef88af4b3319ba703da"
format_stamp: "Formatted at 2026-07-09 13:11:02 on dist-test-slave-clfv"
I20260709 13:11:02.706693 28234 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602648606606-28234-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602648606606-28234-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602648606606-28234-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:02.743083 28234 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:02.744635 28234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:02.747035 28234 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:02.751569 28234 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:02.751878 28234 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:11:02.752204 28234 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:02.752378 28234 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:02.804601 28234 rpc_server.cc:307] RPC server started. Bound to: 127.27.146.131:34903
I20260709 13:11:02.804690 29047 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.146.131:34903 every 8 connection(s)
I20260709 13:11:02.820217 29048 heartbeater.cc:344] Connected to a master server at 127.27.146.190:43467
I20260709 13:11:02.820688 29048 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:02.821533 29048 heartbeater.cc:507] Master 127.27.146.190:43467 requested a full tablet report, sending...
I20260709 13:11:02.823808 28772 ts_manager.cc:194] Registered new tserver with Master: cc7720d1626a4ef88af4b3319ba703da (127.27.146.131:34903)
I20260709 13:11:02.824268 28234 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016116733s
I20260709 13:11:02.825446 28772 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36408
I20260709 13:11:02.855693 28772 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36416:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:11:02.858974 28772 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:11:02.952394 28863 tablet_service.cc:1511] Processing CreateTablet for tablet 5a9e932a762b44efa39af0a81206bf4e (DEFAULT_TABLE table=test-workload [id=4bb37c7a056d412690b0363152082f32]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:11:02.952706 28862 tablet_service.cc:1511] Processing CreateTablet for tablet e457a1d9027b4083bb5f457451a06215 (DEFAULT_TABLE table=test-workload [id=4bb37c7a056d412690b0363152082f32]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:11:02.954169 28863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a9e932a762b44efa39af0a81206bf4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.953969 28864 tablet_service.cc:1511] Processing CreateTablet for tablet 2185b9a3133c45849577db9fd53cc3da (DEFAULT_TABLE table=test-workload [id=4bb37c7a056d412690b0363152082f32]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:11:02.954684 28860 tablet_service.cc:1511] Processing CreateTablet for tablet 698707b1216545c19dd7d883dfba7ac4 (DEFAULT_TABLE table=test-workload [id=4bb37c7a056d412690b0363152082f32]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:11:02.956274 28864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2185b9a3133c45849577db9fd53cc3da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.959179 28861 tablet_service.cc:1511] Processing CreateTablet for tablet 0dbb162930114b59bfb5e51c599feb0b (DEFAULT_TABLE table=test-workload [id=4bb37c7a056d412690b0363152082f32]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:11:02.960701 28859 tablet_service.cc:1511] Processing CreateTablet for tablet 3932435a38f74cc59388d2b95bf0c1c9 (DEFAULT_TABLE table=test-workload [id=4bb37c7a056d412690b0363152082f32]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:11:02.964072 28858 tablet_service.cc:1511] Processing CreateTablet for tablet fc3a7e97dac54e96a71f171e9c7782c5 (DEFAULT_TABLE table=test-workload [id=4bb37c7a056d412690b0363152082f32]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:11:02.960688 28861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dbb162930114b59bfb5e51c599feb0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.969146 28857 tablet_service.cc:1511] Processing CreateTablet for tablet d98145f080424a68b9868bae7ba47a5a (DEFAULT_TABLE table=test-workload [id=4bb37c7a056d412690b0363152082f32]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:11:02.970690 28857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d98145f080424a68b9868bae7ba47a5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.973359 28856 tablet_service.cc:1511] Processing CreateTablet for tablet bd7a00c612f44184878b8c93532bd49a (DEFAULT_TABLE table=test-workload [id=4bb37c7a056d412690b0363152082f32]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:11:02.974355 29013 tablet_service.cc:1511] Processing CreateTablet for tablet 2185b9a3133c45849577db9fd53cc3da (DEFAULT_TABLE table=test-workload [id=4bb37c7a056d412690b0363152082f32]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:11:02.974812 28856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd7a00c612f44184878b8c93532bd49a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.975780 29013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2185b9a3133c45849577db9fd53cc3da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.976075 29009 tablet_service.cc:1511] Processing CreateTablet for tablet 698707b1216545c19dd7d883dfba7ac4 (DEFAULT_TABLE table=test-workload [id=4bb37c7a056d412690b0363152082f32]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:11:02.976800 29012 tablet_service.cc:1511] Processing CreateTablet for tablet 5a9e932a762b44efa39af0a81206bf4e (DEFAULT_TABLE table=test-workload [id=4bb37c7a056d412690b0363152082f32]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:11:02.976862 29011 tablet_service.cc:1511] Processing CreateTablet for tablet e457a1d9027b4083bb5f457451a06215 (DEFAULT_TABLE table=test-workload [id=4bb37c7a056d412690b0363152082f32]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:11:02.977591 29009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 698707b1216545c19dd7d883dfba7ac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.978289 29012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a9e932a762b44efa39af0a81206bf4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.979036 29010 tablet_service.cc:1511] Processing CreateTablet for tablet 0dbb162930114b59bfb5e51c599feb0b (DEFAULT_TABLE table=test-workload [id=4bb37c7a056d412690b0363152082f32]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:11:02.979808 29008 tablet_service.cc:1511] Processing CreateTablet for tablet 3932435a38f74cc59388d2b95bf0c1c9 (DEFAULT_TABLE table=test-workload [id=4bb37c7a056d412690b0363152082f32]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:11:02.980368 29011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e457a1d9027b4083bb5f457451a06215. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.981015 29010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dbb162930114b59bfb5e51c599feb0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.981734 29007 tablet_service.cc:1511] Processing CreateTablet for tablet fc3a7e97dac54e96a71f171e9c7782c5 (DEFAULT_TABLE table=test-workload [id=4bb37c7a056d412690b0363152082f32]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:11:02.982504 28862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e457a1d9027b4083bb5f457451a06215. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.987982 28860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 698707b1216545c19dd7d883dfba7ac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.988346 29007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc3a7e97dac54e96a71f171e9c7782c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.989219 29006 tablet_service.cc:1511] Processing CreateTablet for tablet d98145f080424a68b9868bae7ba47a5a (DEFAULT_TABLE table=test-workload [id=4bb37c7a056d412690b0363152082f32]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:11:02.990782 29006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d98145f080424a68b9868bae7ba47a5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.991183 28859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3932435a38f74cc59388d2b95bf0c1c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.991782 29008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3932435a38f74cc59388d2b95bf0c1c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:02.994675 28858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc3a7e97dac54e96a71f171e9c7782c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:03.014627 29005 tablet_service.cc:1511] Processing CreateTablet for tablet bd7a00c612f44184878b8c93532bd49a (DEFAULT_TABLE table=test-workload [id=4bb37c7a056d412690b0363152082f32]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:11:03.016782 28855 tablet_service.cc:1511] Processing CreateTablet for tablet f14fb4bd1ed04f3794d9445e51d8c620 (DEFAULT_TABLE table=test-workload [id=4bb37c7a056d412690b0363152082f32]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:11:03.018358 28855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f14fb4bd1ed04f3794d9445e51d8c620. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:03.020323 29005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd7a00c612f44184878b8c93532bd49a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:03.036063 29063 tablet_bootstrap.cc:492] T 2185b9a3133c45849577db9fd53cc3da P cc7720d1626a4ef88af4b3319ba703da: Bootstrap starting.
I20260709 13:11:03.055246 29004 tablet_service.cc:1511] Processing CreateTablet for tablet f14fb4bd1ed04f3794d9445e51d8c620 (DEFAULT_TABLE table=test-workload [id=4bb37c7a056d412690b0363152082f32]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:11:03.057329 29004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f14fb4bd1ed04f3794d9445e51d8c620. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:03.081498 29064 tablet_bootstrap.cc:492] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291: Bootstrap starting.
I20260709 13:11:03.090922 29064 tablet_bootstrap.cc:654] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:03.121891 28932 tablet_service.cc:1511] Processing CreateTablet for tablet d98145f080424a68b9868bae7ba47a5a (DEFAULT_TABLE table=test-workload [id=4bb37c7a056d412690b0363152082f32]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:11:03.122635 28939 tablet_service.cc:1511] Processing CreateTablet for tablet 2185b9a3133c45849577db9fd53cc3da (DEFAULT_TABLE table=test-workload [id=4bb37c7a056d412690b0363152082f32]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:11:03.123462 28932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d98145f080424a68b9868bae7ba47a5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:03.125017 28938 tablet_service.cc:1511] Processing CreateTablet for tablet 5a9e932a762b44efa39af0a81206bf4e (DEFAULT_TABLE table=test-workload [id=4bb37c7a056d412690b0363152082f32]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:11:03.126487 28938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a9e932a762b44efa39af0a81206bf4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:03.126116 29063 tablet_bootstrap.cc:654] T 2185b9a3133c45849577db9fd53cc3da P cc7720d1626a4ef88af4b3319ba703da: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:03.128881 28937 tablet_service.cc:1511] Processing CreateTablet for tablet e457a1d9027b4083bb5f457451a06215 (DEFAULT_TABLE table=test-workload [id=4bb37c7a056d412690b0363152082f32]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:11:03.130260 28930 tablet_service.cc:1511] Processing CreateTablet for tablet f14fb4bd1ed04f3794d9445e51d8c620 (DEFAULT_TABLE table=test-workload [id=4bb37c7a056d412690b0363152082f32]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:11:03.131484 28936 tablet_service.cc:1511] Processing CreateTablet for tablet 0dbb162930114b59bfb5e51c599feb0b (DEFAULT_TABLE table=test-workload [id=4bb37c7a056d412690b0363152082f32]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:11:03.133886 28935 tablet_service.cc:1511] Processing CreateTablet for tablet 698707b1216545c19dd7d883dfba7ac4 (DEFAULT_TABLE table=test-workload [id=4bb37c7a056d412690b0363152082f32]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:11:03.136646 28934 tablet_service.cc:1511] Processing CreateTablet for tablet 3932435a38f74cc59388d2b95bf0c1c9 (DEFAULT_TABLE table=test-workload [id=4bb37c7a056d412690b0363152082f32]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:11:03.139395 28933 tablet_service.cc:1511] Processing CreateTablet for tablet fc3a7e97dac54e96a71f171e9c7782c5 (DEFAULT_TABLE table=test-workload [id=4bb37c7a056d412690b0363152082f32]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:11:03.128911 28931 tablet_service.cc:1511] Processing CreateTablet for tablet bd7a00c612f44184878b8c93532bd49a (DEFAULT_TABLE table=test-workload [id=4bb37c7a056d412690b0363152082f32]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:11:03.153187 28937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e457a1d9027b4083bb5f457451a06215. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:03.155934 28930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f14fb4bd1ed04f3794d9445e51d8c620. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:03.156680 28931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd7a00c612f44184878b8c93532bd49a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:03.160004 28933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc3a7e97dac54e96a71f171e9c7782c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:03.163883 28934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3932435a38f74cc59388d2b95bf0c1c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:03.165076 28935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 698707b1216545c19dd7d883dfba7ac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:03.167879 28939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2185b9a3133c45849577db9fd53cc3da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:03.171993 28936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dbb162930114b59bfb5e51c599feb0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:03.219669 29064 tablet_bootstrap.cc:492] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291: No bootstrap required, opened a new log
I20260709 13:11:03.220260 29064 ts_tablet_manager.cc:1403] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291: Time spent bootstrapping tablet: real 0.139s	user 0.043s	sys 0.050s
I20260709 13:11:03.223347 29064 raft_consensus.cc:359] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.224320 29064 raft_consensus.cc:385] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:03.224676 29064 raft_consensus.cc:740] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c79e0ceee6c4fe9ab2850342122b291, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.227996 29063 tablet_bootstrap.cc:492] T 2185b9a3133c45849577db9fd53cc3da P cc7720d1626a4ef88af4b3319ba703da: No bootstrap required, opened a new log
I20260709 13:11:03.228577 29063 ts_tablet_manager.cc:1403] T 2185b9a3133c45849577db9fd53cc3da P cc7720d1626a4ef88af4b3319ba703da: Time spent bootstrapping tablet: real 0.193s	user 0.027s	sys 0.023s
I20260709 13:11:03.232210 29063 raft_consensus.cc:359] T 2185b9a3133c45849577db9fd53cc3da P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.233085 29063 raft_consensus.cc:385] T 2185b9a3133c45849577db9fd53cc3da P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:03.233449 29063 raft_consensus.cc:740] T 2185b9a3133c45849577db9fd53cc3da P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7720d1626a4ef88af4b3319ba703da, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.234277 29063 consensus_queue.cc:260] T 2185b9a3133c45849577db9fd53cc3da P cc7720d1626a4ef88af4b3319ba703da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.234272 29067 tablet_bootstrap.cc:492] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c: Bootstrap starting.
I20260709 13:11:03.238935 29048 heartbeater.cc:499] Master 127.27.146.190:43467 was elected leader, sending a full tablet report...
I20260709 13:11:03.239461 29063 ts_tablet_manager.cc:1434] T 2185b9a3133c45849577db9fd53cc3da P cc7720d1626a4ef88af4b3319ba703da: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.004s
I20260709 13:11:03.239111 29064 consensus_queue.cc:260] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.240598 29063 tablet_bootstrap.cc:492] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da: Bootstrap starting.
I20260709 13:11:03.242460 29067 tablet_bootstrap.cc:654] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:03.252437 29063 tablet_bootstrap.cc:654] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:03.261471 29064 ts_tablet_manager.cc:1434] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291: Time spent starting tablet: real 0.041s	user 0.012s	sys 0.014s
I20260709 13:11:03.262562 28899 heartbeater.cc:499] Master 127.27.146.190:43467 was elected leader, sending a full tablet report...
I20260709 13:11:03.264353 29064 tablet_bootstrap.cc:492] T 3932435a38f74cc59388d2b95bf0c1c9 P 9c79e0ceee6c4fe9ab2850342122b291: Bootstrap starting.
I20260709 13:11:03.266083 29063 tablet_bootstrap.cc:492] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da: No bootstrap required, opened a new log
I20260709 13:11:03.266654 29063 ts_tablet_manager.cc:1403] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.004s
I20260709 13:11:03.269965 29063 raft_consensus.cc:359] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.270752 29063 raft_consensus.cc:385] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:03.271067 29063 raft_consensus.cc:740] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7720d1626a4ef88af4b3319ba703da, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.271934 29063 consensus_queue.cc:260] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.272706 29064 tablet_bootstrap.cc:654] T 3932435a38f74cc59388d2b95bf0c1c9 P 9c79e0ceee6c4fe9ab2850342122b291: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:03.274339 29063 ts_tablet_manager.cc:1434] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:11:03.277791 29067 tablet_bootstrap.cc:492] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c: No bootstrap required, opened a new log
I20260709 13:11:03.278465 29067 ts_tablet_manager.cc:1403] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.015s
I20260709 13:11:03.281945 29064 tablet_bootstrap.cc:492] T 3932435a38f74cc59388d2b95bf0c1c9 P 9c79e0ceee6c4fe9ab2850342122b291: No bootstrap required, opened a new log
I20260709 13:11:03.282503 29064 ts_tablet_manager.cc:1403] T 3932435a38f74cc59388d2b95bf0c1c9 P 9c79e0ceee6c4fe9ab2850342122b291: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.005s
I20260709 13:11:03.282229 29067 raft_consensus.cc:359] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.283288 29067 raft_consensus.cc:385] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:03.283633 29067 raft_consensus.cc:740] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f240b20bb4d549f1abfde7991d89ff4c, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.284437 29067 consensus_queue.cc:260] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.285739 29064 raft_consensus.cc:359] T 3932435a38f74cc59388d2b95bf0c1c9 P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.287267 28974 heartbeater.cc:499] Master 127.27.146.190:43467 was elected leader, sending a full tablet report...
I20260709 13:11:03.287806 29067 ts_tablet_manager.cc:1434] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.000s
I20260709 13:11:03.288877 29067 tablet_bootstrap.cc:492] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c: Bootstrap starting.
I20260709 13:11:03.286613 29064 raft_consensus.cc:385] T 3932435a38f74cc59388d2b95bf0c1c9 P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:03.291656 29064 raft_consensus.cc:740] T 3932435a38f74cc59388d2b95bf0c1c9 P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c79e0ceee6c4fe9ab2850342122b291, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.292829 29064 consensus_queue.cc:260] T 3932435a38f74cc59388d2b95bf0c1c9 P 9c79e0ceee6c4fe9ab2850342122b291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.295315 29064 ts_tablet_manager.cc:1434] T 3932435a38f74cc59388d2b95bf0c1c9 P 9c79e0ceee6c4fe9ab2850342122b291: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.002s
I20260709 13:11:03.296433 29067 tablet_bootstrap.cc:654] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:03.296485 29064 tablet_bootstrap.cc:492] T e457a1d9027b4083bb5f457451a06215 P 9c79e0ceee6c4fe9ab2850342122b291: Bootstrap starting.
I20260709 13:11:03.275373 29063 tablet_bootstrap.cc:492] T 698707b1216545c19dd7d883dfba7ac4 P cc7720d1626a4ef88af4b3319ba703da: Bootstrap starting.
I20260709 13:11:03.304662 29068 raft_consensus.cc:493] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.305313 29068 raft_consensus.cc:515] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.305833 29064 tablet_bootstrap.cc:654] T e457a1d9027b4083bb5f457451a06215 P 9c79e0ceee6c4fe9ab2850342122b291: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:03.307377 29063 tablet_bootstrap.cc:654] T 698707b1216545c19dd7d883dfba7ac4 P cc7720d1626a4ef88af4b3319ba703da: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:03.308516 29068 leader_election.cc:290] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909), f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889)
I20260709 13:11:03.316215 29067 tablet_bootstrap.cc:492] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c: No bootstrap required, opened a new log
I20260709 13:11:03.317040 29067 ts_tablet_manager.cc:1403] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c: Time spent bootstrapping tablet: real 0.028s	user 0.023s	sys 0.003s
I20260709 13:11:03.321431 29067 raft_consensus.cc:359] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.323094 29067 raft_consensus.cc:385] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:03.323606 29067 raft_consensus.cc:740] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f240b20bb4d549f1abfde7991d89ff4c, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.324877 29067 consensus_queue.cc:260] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.328543 28874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d98145f080424a68b9868bae7ba47a5a" candidate_uuid: "cc7720d1626a4ef88af4b3319ba703da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291" is_pre_election: true
W20260709 13:11:03.330924 28986 leader_election.cc:343] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:03.332228 29067 ts_tablet_manager.cc:1434] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 13:11:03.334352 29067 tablet_bootstrap.cc:492] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c: Bootstrap starting.
I20260709 13:11:03.336678 29064 tablet_bootstrap.cc:492] T e457a1d9027b4083bb5f457451a06215 P 9c79e0ceee6c4fe9ab2850342122b291: No bootstrap required, opened a new log
I20260709 13:11:03.337281 29064 ts_tablet_manager.cc:1403] T e457a1d9027b4083bb5f457451a06215 P 9c79e0ceee6c4fe9ab2850342122b291: Time spent bootstrapping tablet: real 0.041s	user 0.021s	sys 0.015s
I20260709 13:11:03.340610 29064 raft_consensus.cc:359] T e457a1d9027b4083bb5f457451a06215 P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.341449 29064 raft_consensus.cc:385] T e457a1d9027b4083bb5f457451a06215 P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:03.341789 29064 raft_consensus.cc:740] T e457a1d9027b4083bb5f457451a06215 P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c79e0ceee6c4fe9ab2850342122b291, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.342118 29067 tablet_bootstrap.cc:654] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:03.342589 29064 consensus_queue.cc:260] T e457a1d9027b4083bb5f457451a06215 P 9c79e0ceee6c4fe9ab2850342122b291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.343067 28949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d98145f080424a68b9868bae7ba47a5a" candidate_uuid: "cc7720d1626a4ef88af4b3319ba703da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c" is_pre_election: true
I20260709 13:11:03.343969 28949 raft_consensus.cc:2468] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7720d1626a4ef88af4b3319ba703da in term 0.
I20260709 13:11:03.345466 29064 ts_tablet_manager.cc:1434] T e457a1d9027b4083bb5f457451a06215 P 9c79e0ceee6c4fe9ab2850342122b291: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:11:03.346593 29064 tablet_bootstrap.cc:492] T f14fb4bd1ed04f3794d9445e51d8c620 P 9c79e0ceee6c4fe9ab2850342122b291: Bootstrap starting.
I20260709 13:11:03.346201 28986 leader_election.cc:304] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc7720d1626a4ef88af4b3319ba703da, f240b20bb4d549f1abfde7991d89ff4c; no voters: 9c79e0ceee6c4fe9ab2850342122b291
I20260709 13:11:03.350353 29068 raft_consensus.cc:2804] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:03.350903 29068 raft_consensus.cc:493] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.351359 29068 raft_consensus.cc:3060] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:03.355362 29067 tablet_bootstrap.cc:492] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c: No bootstrap required, opened a new log
I20260709 13:11:03.355983 29067 ts_tablet_manager.cc:1403] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.007s
I20260709 13:11:03.356868 29064 tablet_bootstrap.cc:654] T f14fb4bd1ed04f3794d9445e51d8c620 P 9c79e0ceee6c4fe9ab2850342122b291: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:03.359427 29067 raft_consensus.cc:359] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.360534 29067 raft_consensus.cc:385] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:03.360951 29067 raft_consensus.cc:740] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f240b20bb4d549f1abfde7991d89ff4c, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.361037 29068 raft_consensus.cc:515] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.362017 29067 consensus_queue.cc:260] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.364233 28874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d98145f080424a68b9868bae7ba47a5a" candidate_uuid: "cc7720d1626a4ef88af4b3319ba703da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
I20260709 13:11:03.364717 29067 ts_tablet_manager.cc:1434] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:11:03.365871 29067 tablet_bootstrap.cc:492] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c: Bootstrap starting.
W20260709 13:11:03.366010 28986 leader_election.cc:343] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:03.369122 28820 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:03.374831 29068 leader_election.cc:290] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 1 election: Requested vote from peers 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909), f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889)
I20260709 13:11:03.376574 29067 tablet_bootstrap.cc:654] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:03.377985 29064 tablet_bootstrap.cc:492] T f14fb4bd1ed04f3794d9445e51d8c620 P 9c79e0ceee6c4fe9ab2850342122b291: No bootstrap required, opened a new log
I20260709 13:11:03.378707 29064 ts_tablet_manager.cc:1403] T f14fb4bd1ed04f3794d9445e51d8c620 P 9c79e0ceee6c4fe9ab2850342122b291: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.011s
I20260709 13:11:03.383244 29064 raft_consensus.cc:359] T f14fb4bd1ed04f3794d9445e51d8c620 P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.384577 29064 raft_consensus.cc:385] T f14fb4bd1ed04f3794d9445e51d8c620 P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:03.384982 29064 raft_consensus.cc:740] T f14fb4bd1ed04f3794d9445e51d8c620 P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c79e0ceee6c4fe9ab2850342122b291, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.386324 28949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d98145f080424a68b9868bae7ba47a5a" candidate_uuid: "cc7720d1626a4ef88af4b3319ba703da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c"
I20260709 13:11:03.386976 28949 raft_consensus.cc:3060] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:03.387056 29064 consensus_queue.cc:260] T f14fb4bd1ed04f3794d9445e51d8c620 P 9c79e0ceee6c4fe9ab2850342122b291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.389628 29067 tablet_bootstrap.cc:492] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c: No bootstrap required, opened a new log
I20260709 13:11:03.390283 29067 ts_tablet_manager.cc:1403] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.003s
I20260709 13:11:03.390436 29063 tablet_bootstrap.cc:492] T 698707b1216545c19dd7d883dfba7ac4 P cc7720d1626a4ef88af4b3319ba703da: No bootstrap required, opened a new log
I20260709 13:11:03.390928 29063 ts_tablet_manager.cc:1403] T 698707b1216545c19dd7d883dfba7ac4 P cc7720d1626a4ef88af4b3319ba703da: Time spent bootstrapping tablet: real 0.116s	user 0.032s	sys 0.018s
I20260709 13:11:03.392033 29064 ts_tablet_manager.cc:1434] T f14fb4bd1ed04f3794d9445e51d8c620 P 9c79e0ceee6c4fe9ab2850342122b291: Time spent starting tablet: real 0.013s	user 0.013s	sys 0.000s
I20260709 13:11:03.393128 29064 tablet_bootstrap.cc:492] T d98145f080424a68b9868bae7ba47a5a P 9c79e0ceee6c4fe9ab2850342122b291: Bootstrap starting.
I20260709 13:11:03.394112 29063 raft_consensus.cc:359] T 698707b1216545c19dd7d883dfba7ac4 P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.394330 29067 raft_consensus.cc:359] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.394953 29063 raft_consensus.cc:385] T 698707b1216545c19dd7d883dfba7ac4 P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:03.395136 29067 raft_consensus.cc:385] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:03.395309 29063 raft_consensus.cc:740] T 698707b1216545c19dd7d883dfba7ac4 P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7720d1626a4ef88af4b3319ba703da, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.395623 29067 raft_consensus.cc:740] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f240b20bb4d549f1abfde7991d89ff4c, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.396350 29063 consensus_queue.cc:260] T 698707b1216545c19dd7d883dfba7ac4 P cc7720d1626a4ef88af4b3319ba703da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.396520 29067 consensus_queue.cc:260] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.399161 29067 ts_tablet_manager.cc:1434] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:11:03.400285 29067 tablet_bootstrap.cc:492] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c: Bootstrap starting.
I20260709 13:11:03.400682 29064 tablet_bootstrap.cc:654] T d98145f080424a68b9868bae7ba47a5a P 9c79e0ceee6c4fe9ab2850342122b291: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:03.401403 29063 ts_tablet_manager.cc:1434] T 698707b1216545c19dd7d883dfba7ac4 P cc7720d1626a4ef88af4b3319ba703da: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.007s
I20260709 13:11:03.402415 29063 tablet_bootstrap.cc:492] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da: Bootstrap starting.
I20260709 13:11:03.408034 29067 tablet_bootstrap.cc:654] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:03.410228 29063 tablet_bootstrap.cc:654] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:03.410704 28949 raft_consensus.cc:2468] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7720d1626a4ef88af4b3319ba703da in term 1.
I20260709 13:11:03.439932 29068 raft_consensus.cc:493] T 2185b9a3133c45849577db9fd53cc3da P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.440765 29068 raft_consensus.cc:515] T 2185b9a3133c45849577db9fd53cc3da P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.443637 29068 leader_election.cc:290] T 2185b9a3133c45849577db9fd53cc3da P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909), f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889)
I20260709 13:11:03.444881 28874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2185b9a3133c45849577db9fd53cc3da" candidate_uuid: "cc7720d1626a4ef88af4b3319ba703da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291" is_pre_election: true
I20260709 13:11:03.445521 28948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2185b9a3133c45849577db9fd53cc3da" candidate_uuid: "cc7720d1626a4ef88af4b3319ba703da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c" is_pre_election: true
W20260709 13:11:03.446623 28986 leader_election.cc:343] T 2185b9a3133c45849577db9fd53cc3da P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:03.447587 28986 leader_election.cc:343] T 2185b9a3133c45849577db9fd53cc3da P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:03.448324 28986 leader_election.cc:304] T 2185b9a3133c45849577db9fd53cc3da P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc7720d1626a4ef88af4b3319ba703da; no voters: 9c79e0ceee6c4fe9ab2850342122b291, f240b20bb4d549f1abfde7991d89ff4c
I20260709 13:11:03.449858 29073 raft_consensus.cc:493] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.450567 29073 raft_consensus.cc:515] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.450870 29068 raft_consensus.cc:2749] T 2185b9a3133c45849577db9fd53cc3da P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:03.453214 29069 raft_consensus.cc:493] T 3932435a38f74cc59388d2b95bf0c1c9 P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.453714 29069 raft_consensus.cc:515] T 3932435a38f74cc59388d2b95bf0c1c9 P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.456913 29069 leader_election.cc:290] T 3932435a38f74cc59388d2b95bf0c1c9 P 9c79e0ceee6c4fe9ab2850342122b291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889), cc7720d1626a4ef88af4b3319ba703da (127.27.146.131:34903)
I20260709 13:11:03.463651 29069 raft_consensus.cc:493] T f14fb4bd1ed04f3794d9445e51d8c620 P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.464236 29069 raft_consensus.cc:515] T f14fb4bd1ed04f3794d9445e51d8c620 P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.467384 29069 leader_election.cc:290] T f14fb4bd1ed04f3794d9445e51d8c620 P 9c79e0ceee6c4fe9ab2850342122b291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889), cc7720d1626a4ef88af4b3319ba703da (127.27.146.131:34903)
I20260709 13:11:03.470539 29073 leader_election.cc:290] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909), cc7720d1626a4ef88af4b3319ba703da (127.27.146.131:34903)
I20260709 13:11:03.474404 29064 tablet_bootstrap.cc:492] T d98145f080424a68b9868bae7ba47a5a P 9c79e0ceee6c4fe9ab2850342122b291: No bootstrap required, opened a new log
I20260709 13:11:03.474951 29064 ts_tablet_manager.cc:1403] T d98145f080424a68b9868bae7ba47a5a P 9c79e0ceee6c4fe9ab2850342122b291: Time spent bootstrapping tablet: real 0.082s	user 0.040s	sys 0.020s
I20260709 13:11:03.474874 29063 tablet_bootstrap.cc:492] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da: No bootstrap required, opened a new log
I20260709 13:11:03.475996 29063 ts_tablet_manager.cc:1403] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da: Time spent bootstrapping tablet: real 0.074s	user 0.026s	sys 0.026s
I20260709 13:11:03.478449 29064 raft_consensus.cc:359] T d98145f080424a68b9868bae7ba47a5a P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.479003 29063 raft_consensus.cc:359] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.479779 29063 raft_consensus.cc:385] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:03.480121 29063 raft_consensus.cc:740] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7720d1626a4ef88af4b3319ba703da, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.481123 29063 consensus_queue.cc:260] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.479393 29064 raft_consensus.cc:385] T d98145f080424a68b9868bae7ba47a5a P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:03.482362 29064 raft_consensus.cc:740] T d98145f080424a68b9868bae7ba47a5a P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c79e0ceee6c4fe9ab2850342122b291, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.486645 29064 consensus_queue.cc:260] T d98145f080424a68b9868bae7ba47a5a P 9c79e0ceee6c4fe9ab2850342122b291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.483839 29063 ts_tablet_manager.cc:1434] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:11:03.485257 29067 tablet_bootstrap.cc:492] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c: No bootstrap required, opened a new log
I20260709 13:11:03.482901 28874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a9e932a762b44efa39af0a81206bf4e" candidate_uuid: "f240b20bb4d549f1abfde7991d89ff4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291" is_pre_election: true
I20260709 13:11:03.488343 28874 raft_consensus.cc:2468] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f240b20bb4d549f1abfde7991d89ff4c in term 0.
I20260709 13:11:03.488787 29063 tablet_bootstrap.cc:492] T f14fb4bd1ed04f3794d9445e51d8c620 P cc7720d1626a4ef88af4b3319ba703da: Bootstrap starting.
I20260709 13:11:03.490392 28912 leader_election.cc:304] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c79e0ceee6c4fe9ab2850342122b291, f240b20bb4d549f1abfde7991d89ff4c; no voters: 
I20260709 13:11:03.490401 28986 leader_election.cc:304] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc7720d1626a4ef88af4b3319ba703da, f240b20bb4d549f1abfde7991d89ff4c; no voters: 9c79e0ceee6c4fe9ab2850342122b291
I20260709 13:11:03.494043 28949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3932435a38f74cc59388d2b95bf0c1c9" candidate_uuid: "9c79e0ceee6c4fe9ab2850342122b291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c" is_pre_election: true
W20260709 13:11:03.495952 28837 leader_election.cc:343] T 3932435a38f74cc59388d2b95bf0c1c9 P 9c79e0ceee6c4fe9ab2850342122b291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:03.494916 29073 raft_consensus.cc:2804] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:03.496939 29073 raft_consensus.cc:493] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.497340 29073 raft_consensus.cc:3060] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:03.498764 29023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3932435a38f74cc59388d2b95bf0c1c9" candidate_uuid: "9c79e0ceee6c4fe9ab2850342122b291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7720d1626a4ef88af4b3319ba703da" is_pre_election: true
I20260709 13:11:03.499342 29063 tablet_bootstrap.cc:654] T f14fb4bd1ed04f3794d9445e51d8c620 P cc7720d1626a4ef88af4b3319ba703da: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:03.500600 29022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14fb4bd1ed04f3794d9445e51d8c620" candidate_uuid: "9c79e0ceee6c4fe9ab2850342122b291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7720d1626a4ef88af4b3319ba703da" is_pre_election: true
I20260709 13:11:03.501748 29068 raft_consensus.cc:2804] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:03.492651 29064 ts_tablet_manager.cc:1434] T d98145f080424a68b9868bae7ba47a5a P 9c79e0ceee6c4fe9ab2850342122b291: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.003s
I20260709 13:11:03.493009 28948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14fb4bd1ed04f3794d9445e51d8c620" candidate_uuid: "9c79e0ceee6c4fe9ab2850342122b291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c" is_pre_election: true
I20260709 13:11:03.503755 29064 tablet_bootstrap.cc:492] T 2185b9a3133c45849577db9fd53cc3da P 9c79e0ceee6c4fe9ab2850342122b291: Bootstrap starting.
W20260709 13:11:03.504073 28837 leader_election.cc:343] T f14fb4bd1ed04f3794d9445e51d8c620 P 9c79e0ceee6c4fe9ab2850342122b291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:03.488366 29067 ts_tablet_manager.cc:1403] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c: Time spent bootstrapping tablet: real 0.088s	user 0.025s	sys 0.024s
I20260709 13:11:03.507965 29073 raft_consensus.cc:515] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.509748 29067 raft_consensus.cc:359] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.510568 29067 raft_consensus.cc:385] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:03.510857 29067 raft_consensus.cc:740] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f240b20bb4d549f1abfde7991d89ff4c, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.511317 28874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a9e932a762b44efa39af0a81206bf4e" candidate_uuid: "f240b20bb4d549f1abfde7991d89ff4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
I20260709 13:11:03.511935 28874 raft_consensus.cc:3060] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:03.511683 29067 consensus_queue.cc:260] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.512416 29068 raft_consensus.cc:697] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da [term 1 LEADER]: Becoming Leader. State: Replica: cc7720d1626a4ef88af4b3319ba703da, State: Running, Role: LEADER
I20260709 13:11:03.513504 29068 consensus_queue.cc:237] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.515604 29063 tablet_bootstrap.cc:492] T f14fb4bd1ed04f3794d9445e51d8c620 P cc7720d1626a4ef88af4b3319ba703da: No bootstrap required, opened a new log
I20260709 13:11:03.516140 29063 ts_tablet_manager.cc:1403] T f14fb4bd1ed04f3794d9445e51d8c620 P cc7720d1626a4ef88af4b3319ba703da: Time spent bootstrapping tablet: real 0.028s	user 0.003s	sys 0.011s
I20260709 13:11:03.511989 29064 tablet_bootstrap.cc:654] T 2185b9a3133c45849577db9fd53cc3da P 9c79e0ceee6c4fe9ab2850342122b291: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:03.519274 29063 raft_consensus.cc:359] T f14fb4bd1ed04f3794d9445e51d8c620 P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.520042 29063 raft_consensus.cc:385] T f14fb4bd1ed04f3794d9445e51d8c620 P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:03.520349 29063 raft_consensus.cc:740] T f14fb4bd1ed04f3794d9445e51d8c620 P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7720d1626a4ef88af4b3319ba703da, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.520732 28874 raft_consensus.cc:2468] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f240b20bb4d549f1abfde7991d89ff4c in term 1.
I20260709 13:11:03.523468 29022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a9e932a762b44efa39af0a81206bf4e" candidate_uuid: "f240b20bb4d549f1abfde7991d89ff4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7720d1626a4ef88af4b3319ba703da" is_pre_election: true
I20260709 13:11:03.523921 28912 leader_election.cc:304] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c79e0ceee6c4fe9ab2850342122b291, f240b20bb4d549f1abfde7991d89ff4c; no voters: 
I20260709 13:11:03.524833 29023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a9e932a762b44efa39af0a81206bf4e" candidate_uuid: "f240b20bb4d549f1abfde7991d89ff4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7720d1626a4ef88af4b3319ba703da"
I20260709 13:11:03.526999 29067 ts_tablet_manager.cc:1434] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.003s
W20260709 13:11:03.521806 28839 leader_election.cc:343] T 3932435a38f74cc59388d2b95bf0c1c9 P 9c79e0ceee6c4fe9ab2850342122b291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7720d1626a4ef88af4b3319ba703da (127.27.146.131:34903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:03.527841 28839 leader_election.cc:304] T 3932435a38f74cc59388d2b95bf0c1c9 P 9c79e0ceee6c4fe9ab2850342122b291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9c79e0ceee6c4fe9ab2850342122b291; no voters: cc7720d1626a4ef88af4b3319ba703da, f240b20bb4d549f1abfde7991d89ff4c
I20260709 13:11:03.528556 29091 raft_consensus.cc:2804] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:03.529069 29091 raft_consensus.cc:697] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c [term 1 LEADER]: Becoming Leader. State: Replica: f240b20bb4d549f1abfde7991d89ff4c, State: Running, Role: LEADER
W20260709 13:11:03.529575 28839 leader_election.cc:343] T f14fb4bd1ed04f3794d9445e51d8c620 P 9c79e0ceee6c4fe9ab2850342122b291 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7720d1626a4ef88af4b3319ba703da (127.27.146.131:34903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:03.530150 28839 leader_election.cc:304] T f14fb4bd1ed04f3794d9445e51d8c620 P 9c79e0ceee6c4fe9ab2850342122b291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9c79e0ceee6c4fe9ab2850342122b291; no voters: cc7720d1626a4ef88af4b3319ba703da, f240b20bb4d549f1abfde7991d89ff4c
I20260709 13:11:03.529980 29091 consensus_queue.cc:237] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.530689 29069 raft_consensus.cc:2749] T 3932435a38f74cc59388d2b95bf0c1c9 P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:03.521188 29063 consensus_queue.cc:260] T f14fb4bd1ed04f3794d9445e51d8c620 P cc7720d1626a4ef88af4b3319ba703da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
W20260709 13:11:03.527086 28914 leader_election.cc:343] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7720d1626a4ef88af4b3319ba703da (127.27.146.131:34903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:03.531466 29069 raft_consensus.cc:2749] T f14fb4bd1ed04f3794d9445e51d8c620 P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:03.532774 28914 leader_election.cc:343] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc7720d1626a4ef88af4b3319ba703da (127.27.146.131:34903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:03.522311 29073 leader_election.cc:290] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c [CANDIDATE]: Term 1 election: Requested vote from peers 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909), cc7720d1626a4ef88af4b3319ba703da (127.27.146.131:34903)
I20260709 13:11:03.537365 29067 tablet_bootstrap.cc:492] T e457a1d9027b4083bb5f457451a06215 P f240b20bb4d549f1abfde7991d89ff4c: Bootstrap starting.
I20260709 13:11:03.537532 29063 ts_tablet_manager.cc:1434] T f14fb4bd1ed04f3794d9445e51d8c620 P cc7720d1626a4ef88af4b3319ba703da: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.004s
I20260709 13:11:03.539309 29063 tablet_bootstrap.cc:492] T e457a1d9027b4083bb5f457451a06215 P cc7720d1626a4ef88af4b3319ba703da: Bootstrap starting.
I20260709 13:11:03.546401 29067 tablet_bootstrap.cc:654] T e457a1d9027b4083bb5f457451a06215 P f240b20bb4d549f1abfde7991d89ff4c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:03.545912 28769 catalog_manager.cc:5697] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da reported cstate change: term changed from 0 to 1, leader changed from <none> to cc7720d1626a4ef88af4b3319ba703da (127.27.146.131). New cstate: current_term: 1 leader_uuid: "cc7720d1626a4ef88af4b3319ba703da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:03.555346 29063 tablet_bootstrap.cc:654] T e457a1d9027b4083bb5f457451a06215 P cc7720d1626a4ef88af4b3319ba703da: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:03.556622 29094 raft_consensus.cc:493] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.557099 29094 raft_consensus.cc:515] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.559278 29067 tablet_bootstrap.cc:492] T e457a1d9027b4083bb5f457451a06215 P f240b20bb4d549f1abfde7991d89ff4c: No bootstrap required, opened a new log
I20260709 13:11:03.559891 29067 ts_tablet_manager.cc:1403] T e457a1d9027b4083bb5f457451a06215 P f240b20bb4d549f1abfde7991d89ff4c: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.005s
I20260709 13:11:03.560698 29094 leader_election.cc:290] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909), cc7720d1626a4ef88af4b3319ba703da (127.27.146.131:34903)
I20260709 13:11:03.561102 29064 tablet_bootstrap.cc:492] T 2185b9a3133c45849577db9fd53cc3da P 9c79e0ceee6c4fe9ab2850342122b291: No bootstrap required, opened a new log
I20260709 13:11:03.560240 28770 catalog_manager.cc:5697] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c reported cstate change: term changed from 0 to 1, leader changed from <none> to f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130). New cstate: current_term: 1 leader_uuid: "f240b20bb4d549f1abfde7991d89ff4c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:03.561509 28874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3a7e97dac54e96a71f171e9c7782c5" candidate_uuid: "f240b20bb4d549f1abfde7991d89ff4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291" is_pre_election: true
I20260709 13:11:03.561609 29064 ts_tablet_manager.cc:1403] T 2185b9a3133c45849577db9fd53cc3da P 9c79e0ceee6c4fe9ab2850342122b291: Time spent bootstrapping tablet: real 0.058s	user 0.017s	sys 0.011s
I20260709 13:11:03.563804 29095 raft_consensus.cc:493] T e457a1d9027b4083bb5f457451a06215 P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:03.564633 28912 leader_election.cc:343] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:03.564368 29095 raft_consensus.cc:515] T e457a1d9027b4083bb5f457451a06215 P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.567770 29023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3a7e97dac54e96a71f171e9c7782c5" candidate_uuid: "f240b20bb4d549f1abfde7991d89ff4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7720d1626a4ef88af4b3319ba703da" is_pre_election: true
I20260709 13:11:03.568462 29063 tablet_bootstrap.cc:492] T e457a1d9027b4083bb5f457451a06215 P cc7720d1626a4ef88af4b3319ba703da: No bootstrap required, opened a new log
I20260709 13:11:03.569026 29063 ts_tablet_manager.cc:1403] T e457a1d9027b4083bb5f457451a06215 P cc7720d1626a4ef88af4b3319ba703da: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.000s
I20260709 13:11:03.568835 29067 raft_consensus.cc:359] T e457a1d9027b4083bb5f457451a06215 P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
W20260709 13:11:03.569674 28914 leader_election.cc:343] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7720d1626a4ef88af4b3319ba703da (127.27.146.131:34903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:03.570297 29067 raft_consensus.cc:385] T e457a1d9027b4083bb5f457451a06215 P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:03.570699 29067 raft_consensus.cc:740] T e457a1d9027b4083bb5f457451a06215 P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f240b20bb4d549f1abfde7991d89ff4c, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.570494 28914 leader_election.cc:304] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f240b20bb4d549f1abfde7991d89ff4c; no voters: 9c79e0ceee6c4fe9ab2850342122b291, cc7720d1626a4ef88af4b3319ba703da
I20260709 13:11:03.571729 29067 consensus_queue.cc:260] T e457a1d9027b4083bb5f457451a06215 P f240b20bb4d549f1abfde7991d89ff4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.572131 29094 raft_consensus.cc:2749] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:03.573494 29063 raft_consensus.cc:359] T e457a1d9027b4083bb5f457451a06215 P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.574304 29063 raft_consensus.cc:385] T e457a1d9027b4083bb5f457451a06215 P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:03.574465 29067 ts_tablet_manager.cc:1434] T e457a1d9027b4083bb5f457451a06215 P f240b20bb4d549f1abfde7991d89ff4c: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:11:03.574757 29063 raft_consensus.cc:740] T e457a1d9027b4083bb5f457451a06215 P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7720d1626a4ef88af4b3319ba703da, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.575906 28948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e457a1d9027b4083bb5f457451a06215" candidate_uuid: "9c79e0ceee6c4fe9ab2850342122b291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c" is_pre_election: true
I20260709 13:11:03.576535 28948 raft_consensus.cc:2468] T e457a1d9027b4083bb5f457451a06215 P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c79e0ceee6c4fe9ab2850342122b291 in term 0.
I20260709 13:11:03.576516 29023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e457a1d9027b4083bb5f457451a06215" candidate_uuid: "9c79e0ceee6c4fe9ab2850342122b291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7720d1626a4ef88af4b3319ba703da" is_pre_election: true
I20260709 13:11:03.577162 29067 tablet_bootstrap.cc:492] T f14fb4bd1ed04f3794d9445e51d8c620 P f240b20bb4d549f1abfde7991d89ff4c: Bootstrap starting.
I20260709 13:11:03.577607 29095 leader_election.cc:290] T e457a1d9027b4083bb5f457451a06215 P 9c79e0ceee6c4fe9ab2850342122b291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889), cc7720d1626a4ef88af4b3319ba703da (127.27.146.131:34903)
I20260709 13:11:03.578223 28837 leader_election.cc:304] T e457a1d9027b4083bb5f457451a06215 P 9c79e0ceee6c4fe9ab2850342122b291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c79e0ceee6c4fe9ab2850342122b291, f240b20bb4d549f1abfde7991d89ff4c; no voters: 
I20260709 13:11:03.567800 29064 raft_consensus.cc:359] T 2185b9a3133c45849577db9fd53cc3da P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.575625 29063 consensus_queue.cc:260] T e457a1d9027b4083bb5f457451a06215 P cc7720d1626a4ef88af4b3319ba703da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.579380 29064 raft_consensus.cc:385] T 2185b9a3133c45849577db9fd53cc3da P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:03.579432 29095 raft_consensus.cc:2804] T e457a1d9027b4083bb5f457451a06215 P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:03.579910 29064 raft_consensus.cc:740] T 2185b9a3133c45849577db9fd53cc3da P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c79e0ceee6c4fe9ab2850342122b291, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.580070 29095 raft_consensus.cc:493] T e457a1d9027b4083bb5f457451a06215 P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.580621 29095 raft_consensus.cc:3060] T e457a1d9027b4083bb5f457451a06215 P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:03.581841 29064 consensus_queue.cc:260] T 2185b9a3133c45849577db9fd53cc3da P 9c79e0ceee6c4fe9ab2850342122b291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.584614 29067 tablet_bootstrap.cc:654] T f14fb4bd1ed04f3794d9445e51d8c620 P f240b20bb4d549f1abfde7991d89ff4c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:03.584942 29064 ts_tablet_manager.cc:1434] T 2185b9a3133c45849577db9fd53cc3da P 9c79e0ceee6c4fe9ab2850342122b291: Time spent starting tablet: real 0.022s	user 0.002s	sys 0.005s
I20260709 13:11:03.586025 29064 tablet_bootstrap.cc:492] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291: Bootstrap starting.
I20260709 13:11:03.586220 29023 raft_consensus.cc:2468] T e457a1d9027b4083bb5f457451a06215 P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c79e0ceee6c4fe9ab2850342122b291 in term 0.
I20260709 13:11:03.589524 29095 raft_consensus.cc:515] T e457a1d9027b4083bb5f457451a06215 P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.590313 29063 ts_tablet_manager.cc:1434] T e457a1d9027b4083bb5f457451a06215 P cc7720d1626a4ef88af4b3319ba703da: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.003s
I20260709 13:11:03.591600 29063 tablet_bootstrap.cc:492] T 5a9e932a762b44efa39af0a81206bf4e P cc7720d1626a4ef88af4b3319ba703da: Bootstrap starting.
I20260709 13:11:03.595033 29064 tablet_bootstrap.cc:654] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:03.602787 28948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e457a1d9027b4083bb5f457451a06215" candidate_uuid: "9c79e0ceee6c4fe9ab2850342122b291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c"
I20260709 13:11:03.603688 28948 raft_consensus.cc:3060] T e457a1d9027b4083bb5f457451a06215 P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:03.610666 29063 tablet_bootstrap.cc:654] T 5a9e932a762b44efa39af0a81206bf4e P cc7720d1626a4ef88af4b3319ba703da: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:03.613787 29091 raft_consensus.cc:493] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.623780 29091 raft_consensus.cc:515] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.616376 29095 leader_election.cc:290] T e457a1d9027b4083bb5f457451a06215 P 9c79e0ceee6c4fe9ab2850342122b291 [CANDIDATE]: Term 1 election: Requested vote from peers f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889), cc7720d1626a4ef88af4b3319ba703da (127.27.146.131:34903)
I20260709 13:11:03.618089 29068 raft_consensus.cc:493] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.628216 28874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd7a00c612f44184878b8c93532bd49a" candidate_uuid: "f240b20bb4d549f1abfde7991d89ff4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291" is_pre_election: true
I20260709 13:11:03.628505 29022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd7a00c612f44184878b8c93532bd49a" candidate_uuid: "f240b20bb4d549f1abfde7991d89ff4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7720d1626a4ef88af4b3319ba703da" is_pre_election: true
I20260709 13:11:03.628583 29068 raft_consensus.cc:515] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
W20260709 13:11:03.630400 28912 leader_election.cc:343] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:03.628259 29091 leader_election.cc:290] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909), cc7720d1626a4ef88af4b3319ba703da (127.27.146.131:34903)
I20260709 13:11:03.633091 29022 raft_consensus.cc:2468] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f240b20bb4d549f1abfde7991d89ff4c in term 0.
I20260709 13:11:03.633249 28949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd7a00c612f44184878b8c93532bd49a" candidate_uuid: "cc7720d1626a4ef88af4b3319ba703da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c" is_pre_election: true
I20260709 13:11:03.633908 28949 raft_consensus.cc:2468] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7720d1626a4ef88af4b3319ba703da in term 0.
I20260709 13:11:03.634924 29068 leader_election.cc:290] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909), f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889)
I20260709 13:11:03.635277 28986 leader_election.cc:304] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc7720d1626a4ef88af4b3319ba703da, f240b20bb4d549f1abfde7991d89ff4c; no voters: 
I20260709 13:11:03.635993 28914 leader_election.cc:304] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc7720d1626a4ef88af4b3319ba703da, f240b20bb4d549f1abfde7991d89ff4c; no voters: 9c79e0ceee6c4fe9ab2850342122b291
I20260709 13:11:03.622746 28948 raft_consensus.cc:2468] T e457a1d9027b4083bb5f457451a06215 P f240b20bb4d549f1abfde7991d89ff4c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c79e0ceee6c4fe9ab2850342122b291 in term 1.
I20260709 13:11:03.636176 29068 raft_consensus.cc:2804] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:03.636783 29068 raft_consensus.cc:493] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.637125 29068 raft_consensus.cc:3060] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:03.637207 29091 raft_consensus.cc:2804] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:03.637588 29091 raft_consensus.cc:493] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.637879 28837 leader_election.cc:304] T e457a1d9027b4083bb5f457451a06215 P 9c79e0ceee6c4fe9ab2850342122b291 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c79e0ceee6c4fe9ab2850342122b291, f240b20bb4d549f1abfde7991d89ff4c; no voters: 
I20260709 13:11:03.638708 28874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd7a00c612f44184878b8c93532bd49a" candidate_uuid: "cc7720d1626a4ef88af4b3319ba703da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291" is_pre_election: true
I20260709 13:11:03.639051 29069 raft_consensus.cc:2804] T e457a1d9027b4083bb5f457451a06215 P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:11:03.640208 28986 leader_election.cc:343] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:03.637915 29091 raft_consensus.cc:3060] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:03.619267 29023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e457a1d9027b4083bb5f457451a06215" candidate_uuid: "9c79e0ceee6c4fe9ab2850342122b291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7720d1626a4ef88af4b3319ba703da"
I20260709 13:11:03.641171 29023 raft_consensus.cc:3060] T e457a1d9027b4083bb5f457451a06215 P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:03.643731 29069 raft_consensus.cc:697] T e457a1d9027b4083bb5f457451a06215 P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 LEADER]: Becoming Leader. State: Replica: 9c79e0ceee6c4fe9ab2850342122b291, State: Running, Role: LEADER
I20260709 13:11:03.644999 29069 consensus_queue.cc:237] T e457a1d9027b4083bb5f457451a06215 P 9c79e0ceee6c4fe9ab2850342122b291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.646164 29068 raft_consensus.cc:515] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.651703 28874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd7a00c612f44184878b8c93532bd49a" candidate_uuid: "cc7720d1626a4ef88af4b3319ba703da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
W20260709 13:11:03.655542 28986 leader_election.cc:343] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:03.662068 29063 tablet_bootstrap.cc:492] T 5a9e932a762b44efa39af0a81206bf4e P cc7720d1626a4ef88af4b3319ba703da: No bootstrap required, opened a new log
I20260709 13:11:03.662627 29063 ts_tablet_manager.cc:1403] T 5a9e932a762b44efa39af0a81206bf4e P cc7720d1626a4ef88af4b3319ba703da: Time spent bootstrapping tablet: real 0.071s	user 0.009s	sys 0.009s
I20260709 13:11:03.667017 29067 tablet_bootstrap.cc:492] T f14fb4bd1ed04f3794d9445e51d8c620 P f240b20bb4d549f1abfde7991d89ff4c: No bootstrap required, opened a new log
I20260709 13:11:03.666783 29063 raft_consensus.cc:359] T 5a9e932a762b44efa39af0a81206bf4e P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.667945 29063 raft_consensus.cc:385] T 5a9e932a762b44efa39af0a81206bf4e P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:03.668089 29067 ts_tablet_manager.cc:1403] T f14fb4bd1ed04f3794d9445e51d8c620 P f240b20bb4d549f1abfde7991d89ff4c: Time spent bootstrapping tablet: real 0.091s	user 0.027s	sys 0.041s
I20260709 13:11:03.668390 29063 raft_consensus.cc:740] T 5a9e932a762b44efa39af0a81206bf4e P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7720d1626a4ef88af4b3319ba703da, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.671100 29090 raft_consensus.cc:493] T f14fb4bd1ed04f3794d9445e51d8c620 P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.672017 29090 raft_consensus.cc:515] T f14fb4bd1ed04f3794d9445e51d8c620 P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.673398 29067 raft_consensus.cc:359] T f14fb4bd1ed04f3794d9445e51d8c620 P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.674429 29067 raft_consensus.cc:385] T f14fb4bd1ed04f3794d9445e51d8c620 P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:03.674823 29067 raft_consensus.cc:740] T f14fb4bd1ed04f3794d9445e51d8c620 P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f240b20bb4d549f1abfde7991d89ff4c, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.675158 29090 leader_election.cc:290] T f14fb4bd1ed04f3794d9445e51d8c620 P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909), f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889)
I20260709 13:11:03.678013 28948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14fb4bd1ed04f3794d9445e51d8c620" candidate_uuid: "cc7720d1626a4ef88af4b3319ba703da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c" is_pre_election: true
I20260709 13:11:03.680059 28874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14fb4bd1ed04f3794d9445e51d8c620" candidate_uuid: "cc7720d1626a4ef88af4b3319ba703da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291" is_pre_election: true
I20260709 13:11:03.680797 28874 raft_consensus.cc:2468] T f14fb4bd1ed04f3794d9445e51d8c620 P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7720d1626a4ef88af4b3319ba703da in term 0.
I20260709 13:11:03.683471 28986 leader_election.cc:304] T f14fb4bd1ed04f3794d9445e51d8c620 P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c79e0ceee6c4fe9ab2850342122b291, cc7720d1626a4ef88af4b3319ba703da; no voters: 
I20260709 13:11:03.683694 29068 leader_election.cc:290] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 1 election: Requested vote from peers 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909), f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889)
I20260709 13:11:03.684091 29064 tablet_bootstrap.cc:492] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291: No bootstrap required, opened a new log
I20260709 13:11:03.684373 29068 raft_consensus.cc:2804] T f14fb4bd1ed04f3794d9445e51d8c620 P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:03.684588 29064 ts_tablet_manager.cc:1403] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291: Time spent bootstrapping tablet: real 0.099s	user 0.034s	sys 0.034s
I20260709 13:11:03.684785 29068 raft_consensus.cc:493] T f14fb4bd1ed04f3794d9445e51d8c620 P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.685140 29068 raft_consensus.cc:3060] T f14fb4bd1ed04f3794d9445e51d8c620 P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:03.685479 28949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd7a00c612f44184878b8c93532bd49a" candidate_uuid: "cc7720d1626a4ef88af4b3319ba703da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c"
I20260709 13:11:03.669726 29063 consensus_queue.cc:260] T 5a9e932a762b44efa39af0a81206bf4e P cc7720d1626a4ef88af4b3319ba703da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.688386 29063 ts_tablet_manager.cc:1434] T 5a9e932a762b44efa39af0a81206bf4e P cc7720d1626a4ef88af4b3319ba703da: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.005s
I20260709 13:11:03.688601 29091 raft_consensus.cc:515] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.689445 29063 tablet_bootstrap.cc:492] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da: Bootstrap starting.
I20260709 13:11:03.690101 28949 raft_consensus.cc:2393] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cc7720d1626a4ef88af4b3319ba703da in current term 1: Already voted for candidate f240b20bb4d549f1abfde7991d89ff4c in this term.
I20260709 13:11:03.692869 29023 raft_consensus.cc:2468] T e457a1d9027b4083bb5f457451a06215 P cc7720d1626a4ef88af4b3319ba703da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c79e0ceee6c4fe9ab2850342122b291 in term 1.
I20260709 13:11:03.692698 29064 raft_consensus.cc:359] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.693632 29064 raft_consensus.cc:385] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:03.693984 29064 raft_consensus.cc:740] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c79e0ceee6c4fe9ab2850342122b291, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.694521 29067 consensus_queue.cc:260] T f14fb4bd1ed04f3794d9445e51d8c620 P f240b20bb4d549f1abfde7991d89ff4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.695025 28986 leader_election.cc:304] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc7720d1626a4ef88af4b3319ba703da; no voters: 9c79e0ceee6c4fe9ab2850342122b291, f240b20bb4d549f1abfde7991d89ff4c
I20260709 13:11:03.696283 28948 raft_consensus.cc:2468] T f14fb4bd1ed04f3794d9445e51d8c620 P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7720d1626a4ef88af4b3319ba703da in term 0.
I20260709 13:11:03.697350 29091 leader_election.cc:290] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c [CANDIDATE]: Term 1 election: Requested vote from peers 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909), cc7720d1626a4ef88af4b3319ba703da (127.27.146.131:34903)
I20260709 13:11:03.697641 29067 ts_tablet_manager.cc:1434] T f14fb4bd1ed04f3794d9445e51d8c620 P f240b20bb4d549f1abfde7991d89ff4c: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.000s
I20260709 13:11:03.698253 28874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd7a00c612f44184878b8c93532bd49a" candidate_uuid: "f240b20bb4d549f1abfde7991d89ff4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
I20260709 13:11:03.698735 29067 tablet_bootstrap.cc:492] T 698707b1216545c19dd7d883dfba7ac4 P f240b20bb4d549f1abfde7991d89ff4c: Bootstrap starting.
W20260709 13:11:03.700173 28912 leader_election.cc:343] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:03.700465 29023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd7a00c612f44184878b8c93532bd49a" candidate_uuid: "f240b20bb4d549f1abfde7991d89ff4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7720d1626a4ef88af4b3319ba703da"
I20260709 13:11:03.701344 29023 raft_consensus.cc:2393] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f240b20bb4d549f1abfde7991d89ff4c in current term 1: Already voted for candidate cc7720d1626a4ef88af4b3319ba703da in this term.
I20260709 13:11:03.704612 29068 raft_consensus.cc:515] T f14fb4bd1ed04f3794d9445e51d8c620 P cc7720d1626a4ef88af4b3319ba703da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.705516 28914 leader_election.cc:304] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f240b20bb4d549f1abfde7991d89ff4c; no voters: 9c79e0ceee6c4fe9ab2850342122b291, cc7720d1626a4ef88af4b3319ba703da
I20260709 13:11:03.707484 29091 raft_consensus.cc:2749] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:03.709825 29090 raft_consensus.cc:2749] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:03.709930 29068 leader_election.cc:290] T f14fb4bd1ed04f3794d9445e51d8c620 P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 1 election: Requested vote from peers 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909), f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889)
I20260709 13:11:03.710932 29067 tablet_bootstrap.cc:654] T 698707b1216545c19dd7d883dfba7ac4 P f240b20bb4d549f1abfde7991d89ff4c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:03.712743 28874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14fb4bd1ed04f3794d9445e51d8c620" candidate_uuid: "cc7720d1626a4ef88af4b3319ba703da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
I20260709 13:11:03.713373 28874 raft_consensus.cc:3060] T f14fb4bd1ed04f3794d9445e51d8c620 P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:03.694773 29064 consensus_queue.cc:260] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.716213 29067 tablet_bootstrap.cc:492] T 698707b1216545c19dd7d883dfba7ac4 P f240b20bb4d549f1abfde7991d89ff4c: No bootstrap required, opened a new log
I20260709 13:11:03.716573 28948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14fb4bd1ed04f3794d9445e51d8c620" candidate_uuid: "cc7720d1626a4ef88af4b3319ba703da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c"
I20260709 13:11:03.717212 28948 raft_consensus.cc:3060] T f14fb4bd1ed04f3794d9445e51d8c620 P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:03.717530 29067 ts_tablet_manager.cc:1403] T 698707b1216545c19dd7d883dfba7ac4 P f240b20bb4d549f1abfde7991d89ff4c: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.003s
I20260709 13:11:03.718029 29063 tablet_bootstrap.cc:654] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:03.718067 28770 catalog_manager.cc:5697] T e457a1d9027b4083bb5f457451a06215 P 9c79e0ceee6c4fe9ab2850342122b291 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "9c79e0ceee6c4fe9ab2850342122b291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:03.720408 29064 ts_tablet_manager.cc:1434] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.002s
I20260709 13:11:03.724753 29064 tablet_bootstrap.cc:492] T bd7a00c612f44184878b8c93532bd49a P 9c79e0ceee6c4fe9ab2850342122b291: Bootstrap starting.
I20260709 13:11:03.723155 29067 raft_consensus.cc:359] T 698707b1216545c19dd7d883dfba7ac4 P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.726403 29067 raft_consensus.cc:385] T 698707b1216545c19dd7d883dfba7ac4 P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:03.728637 29067 raft_consensus.cc:740] T 698707b1216545c19dd7d883dfba7ac4 P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f240b20bb4d549f1abfde7991d89ff4c, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.729924 29067 consensus_queue.cc:260] T 698707b1216545c19dd7d883dfba7ac4 P f240b20bb4d549f1abfde7991d89ff4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.733518 28948 raft_consensus.cc:2468] T f14fb4bd1ed04f3794d9445e51d8c620 P f240b20bb4d549f1abfde7991d89ff4c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7720d1626a4ef88af4b3319ba703da in term 1.
I20260709 13:11:03.730407 28874 raft_consensus.cc:2468] T f14fb4bd1ed04f3794d9445e51d8c620 P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7720d1626a4ef88af4b3319ba703da in term 1.
I20260709 13:11:03.738982 28986 leader_election.cc:304] T f14fb4bd1ed04f3794d9445e51d8c620 P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c79e0ceee6c4fe9ab2850342122b291, cc7720d1626a4ef88af4b3319ba703da; no voters: 
I20260709 13:11:03.739949 29068 raft_consensus.cc:2804] T f14fb4bd1ed04f3794d9445e51d8c620 P cc7720d1626a4ef88af4b3319ba703da [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:03.735160 29064 tablet_bootstrap.cc:654] T bd7a00c612f44184878b8c93532bd49a P 9c79e0ceee6c4fe9ab2850342122b291: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:03.736627 29090 raft_consensus.cc:493] T 698707b1216545c19dd7d883dfba7ac4 P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.737192 29067 ts_tablet_manager.cc:1434] T 698707b1216545c19dd7d883dfba7ac4 P f240b20bb4d549f1abfde7991d89ff4c: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:11:03.744251 29090 raft_consensus.cc:515] T 698707b1216545c19dd7d883dfba7ac4 P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.745428 29067 tablet_bootstrap.cc:492] T 2185b9a3133c45849577db9fd53cc3da P f240b20bb4d549f1abfde7991d89ff4c: Bootstrap starting.
I20260709 13:11:03.747071 29090 leader_election.cc:290] T 698707b1216545c19dd7d883dfba7ac4 P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909), f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889)
I20260709 13:11:03.750576 28948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "698707b1216545c19dd7d883dfba7ac4" candidate_uuid: "cc7720d1626a4ef88af4b3319ba703da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c" is_pre_election: true
I20260709 13:11:03.751367 28948 raft_consensus.cc:2468] T 698707b1216545c19dd7d883dfba7ac4 P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7720d1626a4ef88af4b3319ba703da in term 0.
I20260709 13:11:03.750576 28874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "698707b1216545c19dd7d883dfba7ac4" candidate_uuid: "cc7720d1626a4ef88af4b3319ba703da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291" is_pre_election: true
I20260709 13:11:03.753998 28986 leader_election.cc:304] T 698707b1216545c19dd7d883dfba7ac4 P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc7720d1626a4ef88af4b3319ba703da, f240b20bb4d549f1abfde7991d89ff4c; no voters: 
W20260709 13:11:03.754976 28986 leader_election.cc:343] T 698707b1216545c19dd7d883dfba7ac4 P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:03.756057 29090 raft_consensus.cc:2804] T 698707b1216545c19dd7d883dfba7ac4 P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:03.756600 29090 raft_consensus.cc:493] T 698707b1216545c19dd7d883dfba7ac4 P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.761873 29090 raft_consensus.cc:3060] T 698707b1216545c19dd7d883dfba7ac4 P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:03.762908 29068 raft_consensus.cc:697] T f14fb4bd1ed04f3794d9445e51d8c620 P cc7720d1626a4ef88af4b3319ba703da [term 1 LEADER]: Becoming Leader. State: Replica: cc7720d1626a4ef88af4b3319ba703da, State: Running, Role: LEADER
I20260709 13:11:03.764490 29068 consensus_queue.cc:237] T f14fb4bd1ed04f3794d9445e51d8c620 P cc7720d1626a4ef88af4b3319ba703da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.770994 29063 tablet_bootstrap.cc:492] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da: No bootstrap required, opened a new log
I20260709 13:11:03.771785 29063 ts_tablet_manager.cc:1403] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da: Time spent bootstrapping tablet: real 0.083s	user 0.018s	sys 0.021s
I20260709 13:11:03.775353 29063 raft_consensus.cc:359] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.776170 29063 raft_consensus.cc:385] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:03.776460 29063 raft_consensus.cc:740] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7720d1626a4ef88af4b3319ba703da, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.777218 29063 consensus_queue.cc:260] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.777904 29067 tablet_bootstrap.cc:654] T 2185b9a3133c45849577db9fd53cc3da P f240b20bb4d549f1abfde7991d89ff4c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:03.779484 29063 ts_tablet_manager.cc:1434] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:11:03.779874 29064 tablet_bootstrap.cc:492] T bd7a00c612f44184878b8c93532bd49a P 9c79e0ceee6c4fe9ab2850342122b291: No bootstrap required, opened a new log
I20260709 13:11:03.780509 29064 ts_tablet_manager.cc:1403] T bd7a00c612f44184878b8c93532bd49a P 9c79e0ceee6c4fe9ab2850342122b291: Time spent bootstrapping tablet: real 0.056s	user 0.020s	sys 0.016s
I20260709 13:11:03.780730 29063 tablet_bootstrap.cc:492] T 3932435a38f74cc59388d2b95bf0c1c9 P cc7720d1626a4ef88af4b3319ba703da: Bootstrap starting.
I20260709 13:11:03.781270 28770 catalog_manager.cc:5697] T f14fb4bd1ed04f3794d9445e51d8c620 P cc7720d1626a4ef88af4b3319ba703da reported cstate change: term changed from 0 to 1, leader changed from <none> to cc7720d1626a4ef88af4b3319ba703da (127.27.146.131). New cstate: current_term: 1 leader_uuid: "cc7720d1626a4ef88af4b3319ba703da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:03.783720 29064 raft_consensus.cc:359] T bd7a00c612f44184878b8c93532bd49a P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.784504 29064 raft_consensus.cc:385] T bd7a00c612f44184878b8c93532bd49a P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:03.784796 29064 raft_consensus.cc:740] T bd7a00c612f44184878b8c93532bd49a P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c79e0ceee6c4fe9ab2850342122b291, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.785636 29064 consensus_queue.cc:260] T bd7a00c612f44184878b8c93532bd49a P 9c79e0ceee6c4fe9ab2850342122b291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.787730 29064 ts_tablet_manager.cc:1434] T bd7a00c612f44184878b8c93532bd49a P 9c79e0ceee6c4fe9ab2850342122b291: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:11:03.788739 29064 tablet_bootstrap.cc:492] T 698707b1216545c19dd7d883dfba7ac4 P 9c79e0ceee6c4fe9ab2850342122b291: Bootstrap starting.
I20260709 13:11:03.790273 29063 tablet_bootstrap.cc:654] T 3932435a38f74cc59388d2b95bf0c1c9 P cc7720d1626a4ef88af4b3319ba703da: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:03.795928 29064 tablet_bootstrap.cc:654] T 698707b1216545c19dd7d883dfba7ac4 P 9c79e0ceee6c4fe9ab2850342122b291: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:03.808493 29064 tablet_bootstrap.cc:492] T 698707b1216545c19dd7d883dfba7ac4 P 9c79e0ceee6c4fe9ab2850342122b291: No bootstrap required, opened a new log
I20260709 13:11:03.809062 29064 ts_tablet_manager.cc:1403] T 698707b1216545c19dd7d883dfba7ac4 P 9c79e0ceee6c4fe9ab2850342122b291: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.008s
I20260709 13:11:03.812885 29064 raft_consensus.cc:359] T 698707b1216545c19dd7d883dfba7ac4 P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.813629 29064 raft_consensus.cc:385] T 698707b1216545c19dd7d883dfba7ac4 P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:03.813916 29064 raft_consensus.cc:740] T 698707b1216545c19dd7d883dfba7ac4 P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c79e0ceee6c4fe9ab2850342122b291, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.818236 29064 consensus_queue.cc:260] T 698707b1216545c19dd7d883dfba7ac4 P 9c79e0ceee6c4fe9ab2850342122b291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.823135 29064 ts_tablet_manager.cc:1434] T 698707b1216545c19dd7d883dfba7ac4 P 9c79e0ceee6c4fe9ab2850342122b291: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.004s
I20260709 13:11:03.824210 29064 tablet_bootstrap.cc:492] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291: Bootstrap starting.
I20260709 13:11:03.831254 29064 tablet_bootstrap.cc:654] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:03.835331 29069 raft_consensus.cc:493] T bd7a00c612f44184878b8c93532bd49a P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.835944 29069 raft_consensus.cc:515] T bd7a00c612f44184878b8c93532bd49a P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.838346 29069 leader_election.cc:290] T bd7a00c612f44184878b8c93532bd49a P 9c79e0ceee6c4fe9ab2850342122b291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889), cc7720d1626a4ef88af4b3319ba703da (127.27.146.131:34903)
I20260709 13:11:03.840282 28948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd7a00c612f44184878b8c93532bd49a" candidate_uuid: "9c79e0ceee6c4fe9ab2850342122b291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c" is_pre_election: true
I20260709 13:11:03.841177 28948 raft_consensus.cc:2393] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9c79e0ceee6c4fe9ab2850342122b291 in current term 1: Already voted for candidate f240b20bb4d549f1abfde7991d89ff4c in this term.
I20260709 13:11:03.840983 29090 raft_consensus.cc:515] T 698707b1216545c19dd7d883dfba7ac4 P cc7720d1626a4ef88af4b3319ba703da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.844648 29023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd7a00c612f44184878b8c93532bd49a" candidate_uuid: "9c79e0ceee6c4fe9ab2850342122b291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7720d1626a4ef88af4b3319ba703da" is_pre_election: true
I20260709 13:11:03.844777 28874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "698707b1216545c19dd7d883dfba7ac4" candidate_uuid: "cc7720d1626a4ef88af4b3319ba703da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
I20260709 13:11:03.845656 28874 raft_consensus.cc:3060] T 698707b1216545c19dd7d883dfba7ac4 P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:03.845836 29023 raft_consensus.cc:2393] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9c79e0ceee6c4fe9ab2850342122b291 in current term 1: Already voted for candidate cc7720d1626a4ef88af4b3319ba703da in this term.
I20260709 13:11:03.847664 28839 leader_election.cc:304] T bd7a00c612f44184878b8c93532bd49a P 9c79e0ceee6c4fe9ab2850342122b291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9c79e0ceee6c4fe9ab2850342122b291; no voters: cc7720d1626a4ef88af4b3319ba703da, f240b20bb4d549f1abfde7991d89ff4c
I20260709 13:11:03.848835 29069 raft_consensus.cc:3060] T bd7a00c612f44184878b8c93532bd49a P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:03.862702 29069 raft_consensus.cc:2749] T bd7a00c612f44184878b8c93532bd49a P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:03.864795 29090 leader_election.cc:290] T 698707b1216545c19dd7d883dfba7ac4 P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 1 election: Requested vote from peers 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909), f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889)
I20260709 13:11:03.866468 28948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "698707b1216545c19dd7d883dfba7ac4" candidate_uuid: "cc7720d1626a4ef88af4b3319ba703da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c"
I20260709 13:11:03.867565 28948 raft_consensus.cc:3060] T 698707b1216545c19dd7d883dfba7ac4 P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:03.867738 28874 raft_consensus.cc:2468] T 698707b1216545c19dd7d883dfba7ac4 P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7720d1626a4ef88af4b3319ba703da in term 1.
I20260709 13:11:03.868847 29067 tablet_bootstrap.cc:492] T 2185b9a3133c45849577db9fd53cc3da P f240b20bb4d549f1abfde7991d89ff4c: No bootstrap required, opened a new log
I20260709 13:11:03.869421 29067 ts_tablet_manager.cc:1403] T 2185b9a3133c45849577db9fd53cc3da P f240b20bb4d549f1abfde7991d89ff4c: Time spent bootstrapping tablet: real 0.124s	user 0.043s	sys 0.052s
I20260709 13:11:03.869625 28986 leader_election.cc:304] T 698707b1216545c19dd7d883dfba7ac4 P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c79e0ceee6c4fe9ab2850342122b291, cc7720d1626a4ef88af4b3319ba703da; no voters: 
I20260709 13:11:03.870955 29090 raft_consensus.cc:2804] T 698707b1216545c19dd7d883dfba7ac4 P cc7720d1626a4ef88af4b3319ba703da [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:03.872937 29090 raft_consensus.cc:697] T 698707b1216545c19dd7d883dfba7ac4 P cc7720d1626a4ef88af4b3319ba703da [term 1 LEADER]: Becoming Leader. State: Replica: cc7720d1626a4ef88af4b3319ba703da, State: Running, Role: LEADER
I20260709 13:11:03.875231 29069 raft_consensus.cc:493] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.875694 29067 raft_consensus.cc:359] T 2185b9a3133c45849577db9fd53cc3da P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.875844 29069 raft_consensus.cc:515] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.876452 29067 raft_consensus.cc:385] T 2185b9a3133c45849577db9fd53cc3da P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:03.876861 29067 raft_consensus.cc:740] T 2185b9a3133c45849577db9fd53cc3da P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f240b20bb4d549f1abfde7991d89ff4c, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.877307 28948 raft_consensus.cc:2468] T 698707b1216545c19dd7d883dfba7ac4 P f240b20bb4d549f1abfde7991d89ff4c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7720d1626a4ef88af4b3319ba703da in term 1.
I20260709 13:11:03.877676 29067 consensus_queue.cc:260] T 2185b9a3133c45849577db9fd53cc3da P f240b20bb4d549f1abfde7991d89ff4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.874501 29090 consensus_queue.cc:237] T 698707b1216545c19dd7d883dfba7ac4 P cc7720d1626a4ef88af4b3319ba703da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.880111 29067 ts_tablet_manager.cc:1434] T 2185b9a3133c45849577db9fd53cc3da P f240b20bb4d549f1abfde7991d89ff4c: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:11:03.881580 29067 tablet_bootstrap.cc:492] T 3932435a38f74cc59388d2b95bf0c1c9 P f240b20bb4d549f1abfde7991d89ff4c: Bootstrap starting.
I20260709 13:11:03.883401 29064 tablet_bootstrap.cc:492] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291: No bootstrap required, opened a new log
I20260709 13:11:03.883925 29064 ts_tablet_manager.cc:1403] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291: Time spent bootstrapping tablet: real 0.060s	user 0.019s	sys 0.014s
I20260709 13:11:03.885996 29068 raft_consensus.cc:493] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.886504 29068 raft_consensus.cc:515] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.886832 29023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3a7e97dac54e96a71f171e9c7782c5" candidate_uuid: "9c79e0ceee6c4fe9ab2850342122b291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7720d1626a4ef88af4b3319ba703da" is_pre_election: true
I20260709 13:11:03.887001 29064 raft_consensus.cc:359] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.887578 29023 raft_consensus.cc:2468] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c79e0ceee6c4fe9ab2850342122b291 in term 0.
I20260709 13:11:03.888720 29068 leader_election.cc:290] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909), f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889)
I20260709 13:11:03.889158 28839 leader_election.cc:304] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c79e0ceee6c4fe9ab2850342122b291, cc7720d1626a4ef88af4b3319ba703da; no voters: 
I20260709 13:11:03.890508 29095 raft_consensus.cc:2804] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:03.891073 29095 raft_consensus.cc:493] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.891558 28949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3a7e97dac54e96a71f171e9c7782c5" candidate_uuid: "cc7720d1626a4ef88af4b3319ba703da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c" is_pre_election: true
I20260709 13:11:03.891601 29095 raft_consensus.cc:3060] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:03.892354 28949 raft_consensus.cc:2468] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7720d1626a4ef88af4b3319ba703da in term 0.
I20260709 13:11:03.894306 28874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3a7e97dac54e96a71f171e9c7782c5" candidate_uuid: "cc7720d1626a4ef88af4b3319ba703da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291" is_pre_election: true
I20260709 13:11:03.896112 28986 leader_election.cc:304] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc7720d1626a4ef88af4b3319ba703da, f240b20bb4d549f1abfde7991d89ff4c; no voters: 
I20260709 13:11:03.896545 29067 tablet_bootstrap.cc:654] T 3932435a38f74cc59388d2b95bf0c1c9 P f240b20bb4d549f1abfde7991d89ff4c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:03.896807 29091 raft_consensus.cc:493] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.897285 29091 raft_consensus.cc:515] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.901355 28873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbb162930114b59bfb5e51c599feb0b" candidate_uuid: "f240b20bb4d549f1abfde7991d89ff4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291" is_pre_election: true
I20260709 13:11:03.902650 29091 leader_election.cc:290] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909), cc7720d1626a4ef88af4b3319ba703da (127.27.146.131:34903)
I20260709 13:11:03.903980 28948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3a7e97dac54e96a71f171e9c7782c5" candidate_uuid: "9c79e0ceee6c4fe9ab2850342122b291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c" is_pre_election: true
I20260709 13:11:03.904458 29068 raft_consensus.cc:2804] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:03.904722 29023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbb162930114b59bfb5e51c599feb0b" candidate_uuid: "f240b20bb4d549f1abfde7991d89ff4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7720d1626a4ef88af4b3319ba703da" is_pre_election: true
I20260709 13:11:03.905025 29068 raft_consensus.cc:493] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.905544 29068 raft_consensus.cc:3060] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:03.906476 28914 leader_election.cc:343] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc7720d1626a4ef88af4b3319ba703da (127.27.146.131:34903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:03.903618 29069 leader_election.cc:290] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889), cc7720d1626a4ef88af4b3319ba703da (127.27.146.131:34903)
I20260709 13:11:03.907171 29063 tablet_bootstrap.cc:492] T 3932435a38f74cc59388d2b95bf0c1c9 P cc7720d1626a4ef88af4b3319ba703da: No bootstrap required, opened a new log
I20260709 13:11:03.907729 29063 ts_tablet_manager.cc:1403] T 3932435a38f74cc59388d2b95bf0c1c9 P cc7720d1626a4ef88af4b3319ba703da: Time spent bootstrapping tablet: real 0.127s	user 0.033s	sys 0.038s
I20260709 13:11:03.904742 28948 raft_consensus.cc:2468] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c79e0ceee6c4fe9ab2850342122b291 in term 0.
I20260709 13:11:03.887760 29064 raft_consensus.cc:385] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:03.908977 29064 raft_consensus.cc:740] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c79e0ceee6c4fe9ab2850342122b291, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.911567 29095 raft_consensus.cc:515] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.912977 28874 raft_consensus.cc:2393] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc7720d1626a4ef88af4b3319ba703da in current term 1: Already voted for candidate 9c79e0ceee6c4fe9ab2850342122b291 in this term.
I20260709 13:11:03.912874 29063 raft_consensus.cc:359] T 3932435a38f74cc59388d2b95bf0c1c9 P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.913681 29063 raft_consensus.cc:385] T 3932435a38f74cc59388d2b95bf0c1c9 P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:03.914009 29063 raft_consensus.cc:740] T 3932435a38f74cc59388d2b95bf0c1c9 P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7720d1626a4ef88af4b3319ba703da, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.915299 28948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3a7e97dac54e96a71f171e9c7782c5" candidate_uuid: "9c79e0ceee6c4fe9ab2850342122b291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c"
I20260709 13:11:03.916183 28948 raft_consensus.cc:3060] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:03.919598 29063 consensus_queue.cc:260] T 3932435a38f74cc59388d2b95bf0c1c9 P cc7720d1626a4ef88af4b3319ba703da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.922498 29110 consensus_queue.cc:1048] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da [LEADER]: Connected to new peer: Peer: permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:03.924623 29095 leader_election.cc:290] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [CANDIDATE]: Term 1 election: Requested vote from peers f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889), cc7720d1626a4ef88af4b3319ba703da (127.27.146.131:34903)
I20260709 13:11:03.909794 29064 consensus_queue.cc:260] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.925341 29023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3a7e97dac54e96a71f171e9c7782c5" candidate_uuid: "9c79e0ceee6c4fe9ab2850342122b291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7720d1626a4ef88af4b3319ba703da"
I20260709 13:11:03.926525 28873 raft_consensus.cc:2468] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f240b20bb4d549f1abfde7991d89ff4c in term 0.
I20260709 13:11:03.928808 28912 leader_election.cc:304] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9c79e0ceee6c4fe9ab2850342122b291, f240b20bb4d549f1abfde7991d89ff4c; no voters: cc7720d1626a4ef88af4b3319ba703da
I20260709 13:11:03.929589 29064 ts_tablet_manager.cc:1434] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.000s
I20260709 13:11:03.930864 29091 raft_consensus.cc:2804] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:03.931262 29091 raft_consensus.cc:493] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.931644 29091 raft_consensus.cc:3060] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:03.933106 28948 raft_consensus.cc:2468] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c79e0ceee6c4fe9ab2850342122b291 in term 1.
I20260709 13:11:03.934924 28837 leader_election.cc:304] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c79e0ceee6c4fe9ab2850342122b291, f240b20bb4d549f1abfde7991d89ff4c; no voters: 
I20260709 13:11:03.936352 29095 raft_consensus.cc:2804] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:03.937225 29095 raft_consensus.cc:697] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 LEADER]: Becoming Leader. State: Replica: 9c79e0ceee6c4fe9ab2850342122b291, State: Running, Role: LEADER
I20260709 13:11:03.938395 29095 consensus_queue.cc:237] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.940426 29063 ts_tablet_manager.cc:1434] T 3932435a38f74cc59388d2b95bf0c1c9 P cc7720d1626a4ef88af4b3319ba703da: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:11:03.941545 29063 tablet_bootstrap.cc:492] T 0dbb162930114b59bfb5e51c599feb0b P cc7720d1626a4ef88af4b3319ba703da: Bootstrap starting.
I20260709 13:11:03.945995 29022 raft_consensus.cc:3060] T 5a9e932a762b44efa39af0a81206bf4e P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:03.927073 29068 raft_consensus.cc:515] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.954911 29023 raft_consensus.cc:2393] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9c79e0ceee6c4fe9ab2850342122b291 in current term 1: Already voted for candidate cc7720d1626a4ef88af4b3319ba703da in this term.
I20260709 13:11:03.959265 28873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3a7e97dac54e96a71f171e9c7782c5" candidate_uuid: "cc7720d1626a4ef88af4b3319ba703da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
I20260709 13:11:03.960052 29068 leader_election.cc:290] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 1 election: Requested vote from peers 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909), f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889)
I20260709 13:11:03.962519 28948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3a7e97dac54e96a71f171e9c7782c5" candidate_uuid: "cc7720d1626a4ef88af4b3319ba703da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c"
I20260709 13:11:03.963724 28948 raft_consensus.cc:2393] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cc7720d1626a4ef88af4b3319ba703da in current term 1: Already voted for candidate 9c79e0ceee6c4fe9ab2850342122b291 in this term.
I20260709 13:11:03.964052 29063 tablet_bootstrap.cc:654] T 0dbb162930114b59bfb5e51c599feb0b P cc7720d1626a4ef88af4b3319ba703da: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:03.969300 29091 raft_consensus.cc:515] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.974896 28986 leader_election.cc:304] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc7720d1626a4ef88af4b3319ba703da; no voters: 9c79e0ceee6c4fe9ab2850342122b291, f240b20bb4d549f1abfde7991d89ff4c
I20260709 13:11:03.976745 29068 raft_consensus.cc:2749] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:03.976642 29094 consensus_queue.cc:1048] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:03.979454 29095 raft_consensus.cc:493] T d98145f080424a68b9868bae7ba47a5a P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.978538 28769 catalog_manager.cc:5697] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "9c79e0ceee6c4fe9ab2850342122b291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:03.980046 29095 raft_consensus.cc:515] T d98145f080424a68b9868bae7ba47a5a P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.980685 29067 tablet_bootstrap.cc:492] T 3932435a38f74cc59388d2b95bf0c1c9 P f240b20bb4d549f1abfde7991d89ff4c: No bootstrap required, opened a new log
I20260709 13:11:03.983918 29067 ts_tablet_manager.cc:1403] T 3932435a38f74cc59388d2b95bf0c1c9 P f240b20bb4d549f1abfde7991d89ff4c: Time spent bootstrapping tablet: real 0.103s	user 0.046s	sys 0.035s
I20260709 13:11:03.983541 29095 leader_election.cc:290] T d98145f080424a68b9868bae7ba47a5a P 9c79e0ceee6c4fe9ab2850342122b291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889), cc7720d1626a4ef88af4b3319ba703da (127.27.146.131:34903)
I20260709 13:11:03.987895 28948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d98145f080424a68b9868bae7ba47a5a" candidate_uuid: "9c79e0ceee6c4fe9ab2850342122b291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c" is_pre_election: true
I20260709 13:11:03.988596 28873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbb162930114b59bfb5e51c599feb0b" candidate_uuid: "f240b20bb4d549f1abfde7991d89ff4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
I20260709 13:11:03.989188 28873 raft_consensus.cc:3060] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:03.989329 29022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbb162930114b59bfb5e51c599feb0b" candidate_uuid: "f240b20bb4d549f1abfde7991d89ff4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7720d1626a4ef88af4b3319ba703da"
I20260709 13:11:03.990067 29067 raft_consensus.cc:359] T 3932435a38f74cc59388d2b95bf0c1c9 P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.992556 29067 raft_consensus.cc:385] T 3932435a38f74cc59388d2b95bf0c1c9 P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:03.993402 29067 raft_consensus.cc:740] T 3932435a38f74cc59388d2b95bf0c1c9 P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f240b20bb4d549f1abfde7991d89ff4c, State: Initialized, Role: FOLLOWER
I20260709 13:11:03.992671 29091 leader_election.cc:290] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c [CANDIDATE]: Term 1 election: Requested vote from peers 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909), cc7720d1626a4ef88af4b3319ba703da (127.27.146.131:34903)
I20260709 13:11:03.995158 29067 consensus_queue.cc:260] T 3932435a38f74cc59388d2b95bf0c1c9 P f240b20bb4d549f1abfde7991d89ff4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:03.997740 29067 ts_tablet_manager.cc:1434] T 3932435a38f74cc59388d2b95bf0c1c9 P f240b20bb4d549f1abfde7991d89ff4c: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
W20260709 13:11:04.000488 28914 leader_election.cc:343] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc7720d1626a4ef88af4b3319ba703da (127.27.146.131:34903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:04.000398 29091 raft_consensus.cc:493] T 2185b9a3133c45849577db9fd53cc3da P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.001746 29095 raft_consensus.cc:493] T 2185b9a3133c45849577db9fd53cc3da P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.001444 29091 raft_consensus.cc:515] T 2185b9a3133c45849577db9fd53cc3da P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:04.002214 29095 raft_consensus.cc:515] T 2185b9a3133c45849577db9fd53cc3da P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:04.004437 29021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d98145f080424a68b9868bae7ba47a5a" candidate_uuid: "9c79e0ceee6c4fe9ab2850342122b291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7720d1626a4ef88af4b3319ba703da" is_pre_election: true
I20260709 13:11:04.005847 28874 raft_consensus.cc:3060] T d98145f080424a68b9868bae7ba47a5a P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:04.006354 29095 leader_election.cc:290] T 2185b9a3133c45849577db9fd53cc3da P 9c79e0ceee6c4fe9ab2850342122b291 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889), cc7720d1626a4ef88af4b3319ba703da (127.27.146.131:34903)
I20260709 13:11:04.008289 28949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2185b9a3133c45849577db9fd53cc3da" candidate_uuid: "9c79e0ceee6c4fe9ab2850342122b291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c" is_pre_election: true
I20260709 13:11:04.011817 28839 leader_election.cc:304] T d98145f080424a68b9868bae7ba47a5a P 9c79e0ceee6c4fe9ab2850342122b291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9c79e0ceee6c4fe9ab2850342122b291; no voters: cc7720d1626a4ef88af4b3319ba703da, f240b20bb4d549f1abfde7991d89ff4c
I20260709 13:11:04.012180 29021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2185b9a3133c45849577db9fd53cc3da" candidate_uuid: "9c79e0ceee6c4fe9ab2850342122b291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7720d1626a4ef88af4b3319ba703da" is_pre_election: true
I20260709 13:11:04.012820 29021 raft_consensus.cc:2468] T 2185b9a3133c45849577db9fd53cc3da P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c79e0ceee6c4fe9ab2850342122b291 in term 0.
I20260709 13:11:04.013206 28873 raft_consensus.cc:2468] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f240b20bb4d549f1abfde7991d89ff4c in term 1.
I20260709 13:11:04.014716 28912 leader_election.cc:304] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9c79e0ceee6c4fe9ab2850342122b291, f240b20bb4d549f1abfde7991d89ff4c; no voters: cc7720d1626a4ef88af4b3319ba703da
I20260709 13:11:04.014639 28839 leader_election.cc:304] T 2185b9a3133c45849577db9fd53cc3da P 9c79e0ceee6c4fe9ab2850342122b291 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c79e0ceee6c4fe9ab2850342122b291, cc7720d1626a4ef88af4b3319ba703da; no voters: 
I20260709 13:11:04.014528 28949 raft_consensus.cc:2468] T 2185b9a3133c45849577db9fd53cc3da P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c79e0ceee6c4fe9ab2850342122b291 in term 0.
I20260709 13:11:04.016131 29069 raft_consensus.cc:2804] T 2185b9a3133c45849577db9fd53cc3da P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:04.016480 29069 raft_consensus.cc:493] T 2185b9a3133c45849577db9fd53cc3da P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.016798 29069 raft_consensus.cc:3060] T 2185b9a3133c45849577db9fd53cc3da P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:04.018748 29095 raft_consensus.cc:2749] T d98145f080424a68b9868bae7ba47a5a P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:04.020455 29110 consensus_queue.cc:1048] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:04.023469 29063 tablet_bootstrap.cc:492] T 0dbb162930114b59bfb5e51c599feb0b P cc7720d1626a4ef88af4b3319ba703da: No bootstrap required, opened a new log
I20260709 13:11:04.025848 29063 ts_tablet_manager.cc:1403] T 0dbb162930114b59bfb5e51c599feb0b P cc7720d1626a4ef88af4b3319ba703da: Time spent bootstrapping tablet: real 0.085s	user 0.021s	sys 0.002s
I20260709 13:11:04.027858 29069 raft_consensus.cc:515] T 2185b9a3133c45849577db9fd53cc3da P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:04.029007 29063 raft_consensus.cc:359] T 0dbb162930114b59bfb5e51c599feb0b P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:04.029752 29063 raft_consensus.cc:385] T 0dbb162930114b59bfb5e51c599feb0b P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:04.030079 29063 raft_consensus.cc:740] T 0dbb162930114b59bfb5e51c599feb0b P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc7720d1626a4ef88af4b3319ba703da, State: Initialized, Role: FOLLOWER
I20260709 13:11:04.030897 29063 consensus_queue.cc:260] T 0dbb162930114b59bfb5e51c599feb0b P cc7720d1626a4ef88af4b3319ba703da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:04.031203 28948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2185b9a3133c45849577db9fd53cc3da" candidate_uuid: "9c79e0ceee6c4fe9ab2850342122b291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c"
I20260709 13:11:04.025218 29091 leader_election.cc:290] T 2185b9a3133c45849577db9fd53cc3da P f240b20bb4d549f1abfde7991d89ff4c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909), cc7720d1626a4ef88af4b3319ba703da (127.27.146.131:34903)
I20260709 13:11:04.033456 29063 ts_tablet_manager.cc:1434] T 0dbb162930114b59bfb5e51c599feb0b P cc7720d1626a4ef88af4b3319ba703da: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:11:04.034035 29069 leader_election.cc:290] T 2185b9a3133c45849577db9fd53cc3da P 9c79e0ceee6c4fe9ab2850342122b291 [CANDIDATE]: Term 1 election: Requested vote from peers f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889), cc7720d1626a4ef88af4b3319ba703da (127.27.146.131:34903)
I20260709 13:11:04.036233 29073 raft_consensus.cc:2804] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:04.036803 29073 raft_consensus.cc:697] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c [term 1 LEADER]: Becoming Leader. State: Replica: f240b20bb4d549f1abfde7991d89ff4c, State: Running, Role: LEADER
I20260709 13:11:04.037761 29073 consensus_queue.cc:237] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:04.039112 28873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2185b9a3133c45849577db9fd53cc3da" candidate_uuid: "f240b20bb4d549f1abfde7991d89ff4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291" is_pre_election: true
I20260709 13:11:04.040024 28873 raft_consensus.cc:2393] T 2185b9a3133c45849577db9fd53cc3da P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f240b20bb4d549f1abfde7991d89ff4c in current term 1: Already voted for candidate 9c79e0ceee6c4fe9ab2850342122b291 in this term.
I20260709 13:11:04.043712 29023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2185b9a3133c45849577db9fd53cc3da" candidate_uuid: "9c79e0ceee6c4fe9ab2850342122b291" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7720d1626a4ef88af4b3319ba703da"
I20260709 13:11:04.044756 29023 raft_consensus.cc:3060] T 2185b9a3133c45849577db9fd53cc3da P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:04.044884 28769 catalog_manager.cc:5697] T 698707b1216545c19dd7d883dfba7ac4 P cc7720d1626a4ef88af4b3319ba703da reported cstate change: term changed from 0 to 1, leader changed from <none> to cc7720d1626a4ef88af4b3319ba703da (127.27.146.131). New cstate: current_term: 1 leader_uuid: "cc7720d1626a4ef88af4b3319ba703da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:04.047669 29021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2185b9a3133c45849577db9fd53cc3da" candidate_uuid: "f240b20bb4d549f1abfde7991d89ff4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc7720d1626a4ef88af4b3319ba703da" is_pre_election: true
I20260709 13:11:04.050889 28914 leader_election.cc:304] T 2185b9a3133c45849577db9fd53cc3da P f240b20bb4d549f1abfde7991d89ff4c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f240b20bb4d549f1abfde7991d89ff4c; no voters: 9c79e0ceee6c4fe9ab2850342122b291, cc7720d1626a4ef88af4b3319ba703da
I20260709 13:11:04.053133 29128 consensus_queue.cc:1048] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:04.054358 29091 raft_consensus.cc:3060] T 2185b9a3133c45849577db9fd53cc3da P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:04.056713 29104 consensus_queue.cc:1048] T e457a1d9027b4083bb5f457451a06215 P 9c79e0ceee6c4fe9ab2850342122b291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:04.066509 29091 raft_consensus.cc:2749] T 2185b9a3133c45849577db9fd53cc3da P f240b20bb4d549f1abfde7991d89ff4c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:04.093320 29023 raft_consensus.cc:2468] T 2185b9a3133c45849577db9fd53cc3da P cc7720d1626a4ef88af4b3319ba703da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c79e0ceee6c4fe9ab2850342122b291 in term 1.
I20260709 13:11:04.081998 28770 catalog_manager.cc:5697] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c reported cstate change: term changed from 0 to 1, leader changed from <none> to f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130). New cstate: current_term: 1 leader_uuid: "f240b20bb4d549f1abfde7991d89ff4c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:04.101346 28839 leader_election.cc:304] T 2185b9a3133c45849577db9fd53cc3da P 9c79e0ceee6c4fe9ab2850342122b291 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9c79e0ceee6c4fe9ab2850342122b291, cc7720d1626a4ef88af4b3319ba703da; no voters: f240b20bb4d549f1abfde7991d89ff4c
I20260709 13:11:04.102501 29104 raft_consensus.cc:2804] T 2185b9a3133c45849577db9fd53cc3da P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:04.102339 29095 consensus_queue.cc:1048] T e457a1d9027b4083bb5f457451a06215 P 9c79e0ceee6c4fe9ab2850342122b291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:04.103000 29104 raft_consensus.cc:697] T 2185b9a3133c45849577db9fd53cc3da P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 LEADER]: Becoming Leader. State: Replica: 9c79e0ceee6c4fe9ab2850342122b291, State: Running, Role: LEADER
I20260709 13:11:04.103986 29104 consensus_queue.cc:237] T 2185b9a3133c45849577db9fd53cc3da P 9c79e0ceee6c4fe9ab2850342122b291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:04.114245 29110 raft_consensus.cc:493] T 3932435a38f74cc59388d2b95bf0c1c9 P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.114904 29110 raft_consensus.cc:515] T 3932435a38f74cc59388d2b95bf0c1c9 P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:04.117399 29110 leader_election.cc:290] T 3932435a38f74cc59388d2b95bf0c1c9 P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909), f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889)
I20260709 13:11:04.119529 28948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3932435a38f74cc59388d2b95bf0c1c9" candidate_uuid: "cc7720d1626a4ef88af4b3319ba703da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c" is_pre_election: true
I20260709 13:11:04.120296 28948 raft_consensus.cc:2468] T 3932435a38f74cc59388d2b95bf0c1c9 P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7720d1626a4ef88af4b3319ba703da in term 0.
I20260709 13:11:04.122716 28986 leader_election.cc:304] T 3932435a38f74cc59388d2b95bf0c1c9 P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc7720d1626a4ef88af4b3319ba703da, f240b20bb4d549f1abfde7991d89ff4c; no voters: 
I20260709 13:11:04.123798 29110 raft_consensus.cc:2804] T 3932435a38f74cc59388d2b95bf0c1c9 P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:04.124183 29110 raft_consensus.cc:493] T 3932435a38f74cc59388d2b95bf0c1c9 P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.124563 29110 raft_consensus.cc:3060] T 3932435a38f74cc59388d2b95bf0c1c9 P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:04.132727 28874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3932435a38f74cc59388d2b95bf0c1c9" candidate_uuid: "cc7720d1626a4ef88af4b3319ba703da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291" is_pre_election: true
I20260709 13:11:04.133592 28874 raft_consensus.cc:2468] T 3932435a38f74cc59388d2b95bf0c1c9 P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7720d1626a4ef88af4b3319ba703da in term 0.
I20260709 13:11:04.137981 28770 catalog_manager.cc:5697] T 2185b9a3133c45849577db9fd53cc3da P 9c79e0ceee6c4fe9ab2850342122b291 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "9c79e0ceee6c4fe9ab2850342122b291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:04.138521 29110 raft_consensus.cc:515] T 3932435a38f74cc59388d2b95bf0c1c9 P cc7720d1626a4ef88af4b3319ba703da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:04.142019 29110 leader_election.cc:290] T 3932435a38f74cc59388d2b95bf0c1c9 P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 1 election: Requested vote from peers 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909), f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889)
I20260709 13:11:04.142369 29068 raft_consensus.cc:493] T 0dbb162930114b59bfb5e51c599feb0b P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.142810 29068 raft_consensus.cc:515] T 0dbb162930114b59bfb5e51c599feb0b P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:04.143358 28874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3932435a38f74cc59388d2b95bf0c1c9" candidate_uuid: "cc7720d1626a4ef88af4b3319ba703da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
I20260709 13:11:04.143961 28874 raft_consensus.cc:3060] T 3932435a38f74cc59388d2b95bf0c1c9 P 9c79e0ceee6c4fe9ab2850342122b291 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:04.144297 28949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3932435a38f74cc59388d2b95bf0c1c9" candidate_uuid: "cc7720d1626a4ef88af4b3319ba703da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c"
I20260709 13:11:04.144843 28949 raft_consensus.cc:3060] T 3932435a38f74cc59388d2b95bf0c1c9 P f240b20bb4d549f1abfde7991d89ff4c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:04.145084 29068 leader_election.cc:290] T 0dbb162930114b59bfb5e51c599feb0b P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909), f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889)
I20260709 13:11:04.147475 28873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbb162930114b59bfb5e51c599feb0b" candidate_uuid: "cc7720d1626a4ef88af4b3319ba703da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291" is_pre_election: true
I20260709 13:11:04.148366 28873 raft_consensus.cc:2393] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc7720d1626a4ef88af4b3319ba703da in current term 1: Already voted for candidate f240b20bb4d549f1abfde7991d89ff4c in this term.
I20260709 13:11:04.149446 28948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbb162930114b59bfb5e51c599feb0b" candidate_uuid: "cc7720d1626a4ef88af4b3319ba703da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c" is_pre_election: true
I20260709 13:11:04.151958 28986 leader_election.cc:304] T 0dbb162930114b59bfb5e51c599feb0b P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc7720d1626a4ef88af4b3319ba703da; no voters: 9c79e0ceee6c4fe9ab2850342122b291, f240b20bb4d549f1abfde7991d89ff4c
I20260709 13:11:04.153257 29068 raft_consensus.cc:3060] T 0dbb162930114b59bfb5e51c599feb0b P cc7720d1626a4ef88af4b3319ba703da [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:04.153497 28874 raft_consensus.cc:2468] T 3932435a38f74cc59388d2b95bf0c1c9 P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7720d1626a4ef88af4b3319ba703da in term 1.
I20260709 13:11:04.153582 28949 raft_consensus.cc:2468] T 3932435a38f74cc59388d2b95bf0c1c9 P f240b20bb4d549f1abfde7991d89ff4c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7720d1626a4ef88af4b3319ba703da in term 1.
I20260709 13:11:04.158586 28986 leader_election.cc:304] T 3932435a38f74cc59388d2b95bf0c1c9 P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc7720d1626a4ef88af4b3319ba703da, f240b20bb4d549f1abfde7991d89ff4c; no voters: 
I20260709 13:11:04.159418 29110 raft_consensus.cc:2804] T 3932435a38f74cc59388d2b95bf0c1c9 P cc7720d1626a4ef88af4b3319ba703da [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:04.159961 29110 raft_consensus.cc:697] T 3932435a38f74cc59388d2b95bf0c1c9 P cc7720d1626a4ef88af4b3319ba703da [term 1 LEADER]: Becoming Leader. State: Replica: cc7720d1626a4ef88af4b3319ba703da, State: Running, Role: LEADER
I20260709 13:11:04.160094 29068 raft_consensus.cc:2749] T 0dbb162930114b59bfb5e51c599feb0b P cc7720d1626a4ef88af4b3319ba703da [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:04.161018 29110 consensus_queue.cc:237] T 3932435a38f74cc59388d2b95bf0c1c9 P cc7720d1626a4ef88af4b3319ba703da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:04.169225 28771 catalog_manager.cc:5697] T 3932435a38f74cc59388d2b95bf0c1c9 P cc7720d1626a4ef88af4b3319ba703da reported cstate change: term changed from 0 to 1, leader changed from <none> to cc7720d1626a4ef88af4b3319ba703da (127.27.146.131). New cstate: current_term: 1 leader_uuid: "cc7720d1626a4ef88af4b3319ba703da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:04.178539 29110 consensus_queue.cc:1048] T f14fb4bd1ed04f3794d9445e51d8c620 P cc7720d1626a4ef88af4b3319ba703da [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:04.191780 29110 consensus_queue.cc:1048] T f14fb4bd1ed04f3794d9445e51d8c620 P cc7720d1626a4ef88af4b3319ba703da [LEADER]: Connected to new peer: Peer: permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:04.329730 29104 consensus_queue.cc:1048] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:04.340749 29095 consensus_queue.cc:1048] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:11:04.376664 28820 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:04.427021 29090 consensus_queue.cc:1048] T 698707b1216545c19dd7d883dfba7ac4 P cc7720d1626a4ef88af4b3319ba703da [LEADER]: Connected to new peer: Peer: permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:04.438855 29090 consensus_queue.cc:1048] T 698707b1216545c19dd7d883dfba7ac4 P cc7720d1626a4ef88af4b3319ba703da [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:04.543704 29094 consensus_queue.cc:1048] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:04.554808 29073 consensus_queue.cc:1048] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:04.564363 29090 consensus_queue.cc:1048] T 3932435a38f74cc59388d2b95bf0c1c9 P cc7720d1626a4ef88af4b3319ba703da [LEADER]: Connected to new peer: Peer: permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:04.576110 29068 consensus_queue.cc:1048] T 3932435a38f74cc59388d2b95bf0c1c9 P cc7720d1626a4ef88af4b3319ba703da [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:04.621496 29104 consensus_queue.cc:1048] T 2185b9a3133c45849577db9fd53cc3da P 9c79e0ceee6c4fe9ab2850342122b291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:04.633112 29069 consensus_queue.cc:1048] T 2185b9a3133c45849577db9fd53cc3da P 9c79e0ceee6c4fe9ab2850342122b291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:05.327267 29090 raft_consensus.cc:493] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.327919 29090 raft_consensus.cc:515] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:05.330220 29090 leader_election.cc:290] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909), f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889)
I20260709 13:11:05.331218 28874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd7a00c612f44184878b8c93532bd49a" candidate_uuid: "cc7720d1626a4ef88af4b3319ba703da" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291" is_pre_election: true
I20260709 13:11:05.331385 28949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd7a00c612f44184878b8c93532bd49a" candidate_uuid: "cc7720d1626a4ef88af4b3319ba703da" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c" is_pre_election: true
I20260709 13:11:05.331928 28874 raft_consensus.cc:2468] T bd7a00c612f44184878b8c93532bd49a P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7720d1626a4ef88af4b3319ba703da in term 1.
I20260709 13:11:05.332159 28949 raft_consensus.cc:2468] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc7720d1626a4ef88af4b3319ba703da in term 1.
I20260709 13:11:05.333227 28986 leader_election.cc:304] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c79e0ceee6c4fe9ab2850342122b291, cc7720d1626a4ef88af4b3319ba703da; no voters: 
I20260709 13:11:05.333957 29090 raft_consensus.cc:2804] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:05.334354 29090 raft_consensus.cc:493] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.334657 29090 raft_consensus.cc:3060] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.340497 29090 raft_consensus.cc:515] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:05.343259 29090 leader_election.cc:290] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 2 election: Requested vote from peers 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909), f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889)
I20260709 13:11:05.344400 28874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd7a00c612f44184878b8c93532bd49a" candidate_uuid: "cc7720d1626a4ef88af4b3319ba703da" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
I20260709 13:11:05.344496 28949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd7a00c612f44184878b8c93532bd49a" candidate_uuid: "cc7720d1626a4ef88af4b3319ba703da" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c"
I20260709 13:11:05.345058 28874 raft_consensus.cc:3060] T bd7a00c612f44184878b8c93532bd49a P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.345165 28949 raft_consensus.cc:3060] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.351086 28949 raft_consensus.cc:2468] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7720d1626a4ef88af4b3319ba703da in term 2.
I20260709 13:11:05.352207 28986 leader_election.cc:304] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc7720d1626a4ef88af4b3319ba703da, f240b20bb4d549f1abfde7991d89ff4c; no voters: 
I20260709 13:11:05.352396 28874 raft_consensus.cc:2468] T bd7a00c612f44184878b8c93532bd49a P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7720d1626a4ef88af4b3319ba703da in term 2.
I20260709 13:11:05.352993 29090 raft_consensus.cc:2804] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:05.353565 29090 raft_consensus.cc:697] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [term 2 LEADER]: Becoming Leader. State: Replica: cc7720d1626a4ef88af4b3319ba703da, State: Running, Role: LEADER
I20260709 13:11:05.354543 29090 consensus_queue.cc:237] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:05.364217 28771 catalog_manager.cc:5697] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da reported cstate change: term changed from 0 to 2, leader changed from <none> to cc7720d1626a4ef88af4b3319ba703da (127.27.146.131). New cstate: current_term: 2 leader_uuid: "cc7720d1626a4ef88af4b3319ba703da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:05.655884 28949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a9e932a762b44efa39af0a81206bf4e"
dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c"
mode: GRACEFUL
new_leader_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
 from {username='slave'} at 127.0.0.1:52910
I20260709 13:11:05.656493 28949 raft_consensus.cc:606] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c [term 1 LEADER]: Received request to transfer leadership to TS 9c79e0ceee6c4fe9ab2850342122b291
I20260709 13:11:05.664899 28949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0dbb162930114b59bfb5e51c599feb0b"
dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c"
mode: GRACEFUL
new_leader_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
 from {username='slave'} at 127.0.0.1:52910
I20260709 13:11:05.665486 28949 raft_consensus.cc:606] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c [term 1 LEADER]: Received request to transfer leadership to TS 9c79e0ceee6c4fe9ab2850342122b291
I20260709 13:11:05.680382 29021 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "698707b1216545c19dd7d883dfba7ac4"
dest_uuid: "cc7720d1626a4ef88af4b3319ba703da"
mode: GRACEFUL
new_leader_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
 from {username='slave'} at 127.0.0.1:58368
I20260709 13:11:05.680923 29021 raft_consensus.cc:606] T 698707b1216545c19dd7d883dfba7ac4 P cc7720d1626a4ef88af4b3319ba703da [term 1 LEADER]: Received request to transfer leadership to TS 9c79e0ceee6c4fe9ab2850342122b291
I20260709 13:11:05.687470 29021 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3932435a38f74cc59388d2b95bf0c1c9"
dest_uuid: "cc7720d1626a4ef88af4b3319ba703da"
mode: GRACEFUL
new_leader_uuid: "f240b20bb4d549f1abfde7991d89ff4c"
 from {username='slave'} at 127.0.0.1:58368
I20260709 13:11:05.688100 29021 raft_consensus.cc:606] T 3932435a38f74cc59388d2b95bf0c1c9 P cc7720d1626a4ef88af4b3319ba703da [term 1 LEADER]: Received request to transfer leadership to TS f240b20bb4d549f1abfde7991d89ff4c
I20260709 13:11:05.704614 28874 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc3a7e97dac54e96a71f171e9c7782c5"
dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
mode: GRACEFUL
new_leader_uuid: "f240b20bb4d549f1abfde7991d89ff4c"
 from {username='slave'} at 127.0.0.1:54824
I20260709 13:11:05.705229 28874 raft_consensus.cc:606] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 LEADER]: Received request to transfer leadership to TS f240b20bb4d549f1abfde7991d89ff4c
I20260709 13:11:05.710567 29021 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d98145f080424a68b9868bae7ba47a5a"
dest_uuid: "cc7720d1626a4ef88af4b3319ba703da"
mode: GRACEFUL
new_leader_uuid: "f240b20bb4d549f1abfde7991d89ff4c"
 from {username='slave'} at 127.0.0.1:58368
I20260709 13:11:05.711218 29021 raft_consensus.cc:606] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da [term 1 LEADER]: Received request to transfer leadership to TS f240b20bb4d549f1abfde7991d89ff4c
I20260709 13:11:05.716825 29021 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd7a00c612f44184878b8c93532bd49a"
dest_uuid: "cc7720d1626a4ef88af4b3319ba703da"
mode: GRACEFUL
new_leader_uuid: "f240b20bb4d549f1abfde7991d89ff4c"
 from {username='slave'} at 127.0.0.1:58368
I20260709 13:11:05.717463 29021 raft_consensus.cc:606] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [term 2 LEADER]: Received request to transfer leadership to TS f240b20bb4d549f1abfde7991d89ff4c
I20260709 13:11:05.752377 29073 raft_consensus.cc:993] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c: : Instructing follower 9c79e0ceee6c4fe9ab2850342122b291 to start an election
I20260709 13:11:05.752846 29073 raft_consensus.cc:1081] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c [term 1 LEADER]: Signalling peer 9c79e0ceee6c4fe9ab2850342122b291 to start an election
I20260709 13:11:05.754487 28874 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0dbb162930114b59bfb5e51c599feb0b"
dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
 from {username='slave'} at 127.0.0.1:54812
I20260709 13:11:05.755041 28874 raft_consensus.cc:493] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:05.755343 28874 raft_consensus.cc:3060] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.761065 28874 raft_consensus.cc:515] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:05.762951 28874 leader_election.cc:290] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291 [CANDIDATE]: Term 2 election: Requested vote from peers f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889), cc7720d1626a4ef88af4b3319ba703da (127.27.146.131:34903)
I20260709 13:11:05.764215 28949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbb162930114b59bfb5e51c599feb0b" candidate_uuid: "9c79e0ceee6c4fe9ab2850342122b291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c"
I20260709 13:11:05.764523 29021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbb162930114b59bfb5e51c599feb0b" candidate_uuid: "9c79e0ceee6c4fe9ab2850342122b291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc7720d1626a4ef88af4b3319ba703da"
I20260709 13:11:05.764956 28949 raft_consensus.cc:3055] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:05.765230 29021 raft_consensus.cc:3060] T 0dbb162930114b59bfb5e51c599feb0b P cc7720d1626a4ef88af4b3319ba703da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.765403 28949 raft_consensus.cc:740] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f240b20bb4d549f1abfde7991d89ff4c, State: Running, Role: LEADER
I20260709 13:11:05.766594 28949 consensus_queue.cc:260] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:05.767715 28949 raft_consensus.cc:3060] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.770697 29021 raft_consensus.cc:2468] T 0dbb162930114b59bfb5e51c599feb0b P cc7720d1626a4ef88af4b3319ba703da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c79e0ceee6c4fe9ab2850342122b291 in term 2.
I20260709 13:11:05.771929 28839 leader_election.cc:304] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c79e0ceee6c4fe9ab2850342122b291, cc7720d1626a4ef88af4b3319ba703da; no voters: 
I20260709 13:11:05.772696 29069 raft_consensus.cc:2804] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:05.773809 29069 raft_consensus.cc:697] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 LEADER]: Becoming Leader. State: Replica: 9c79e0ceee6c4fe9ab2850342122b291, State: Running, Role: LEADER
I20260709 13:11:05.774101 28949 raft_consensus.cc:2468] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c79e0ceee6c4fe9ab2850342122b291 in term 2.
I20260709 13:11:05.774784 29069 consensus_queue.cc:237] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:05.783035 28771 catalog_manager.cc:5697] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291 reported cstate change: term changed from 1 to 2, leader changed from f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130) to 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129). New cstate: current_term: 2 leader_uuid: "9c79e0ceee6c4fe9ab2850342122b291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:05.823020 29159 raft_consensus.cc:993] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c: : Instructing follower 9c79e0ceee6c4fe9ab2850342122b291 to start an election
I20260709 13:11:05.823616 29159 raft_consensus.cc:1081] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c [term 1 LEADER]: Signalling peer 9c79e0ceee6c4fe9ab2850342122b291 to start an election
I20260709 13:11:05.825208 28874 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a9e932a762b44efa39af0a81206bf4e"
dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
 from {username='slave'} at 127.0.0.1:54812
I20260709 13:11:05.825748 28874 raft_consensus.cc:493] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:05.826140 28874 raft_consensus.cc:3060] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.832754 28874 raft_consensus.cc:515] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:05.834681 28874 leader_election.cc:290] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291 [CANDIDATE]: Term 2 election: Requested vote from peers f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889), cc7720d1626a4ef88af4b3319ba703da (127.27.146.131:34903)
I20260709 13:11:05.835844 29021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a9e932a762b44efa39af0a81206bf4e" candidate_uuid: "9c79e0ceee6c4fe9ab2850342122b291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc7720d1626a4ef88af4b3319ba703da"
I20260709 13:11:05.835799 28949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a9e932a762b44efa39af0a81206bf4e" candidate_uuid: "9c79e0ceee6c4fe9ab2850342122b291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c"
I20260709 13:11:05.836601 29021 raft_consensus.cc:3060] T 5a9e932a762b44efa39af0a81206bf4e P cc7720d1626a4ef88af4b3319ba703da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.836622 28949 raft_consensus.cc:3055] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:05.837181 28949 raft_consensus.cc:740] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f240b20bb4d549f1abfde7991d89ff4c, State: Running, Role: LEADER
I20260709 13:11:05.838068 28949 consensus_queue.cc:260] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:05.839303 28949 raft_consensus.cc:3060] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.843886 29021 raft_consensus.cc:2468] T 5a9e932a762b44efa39af0a81206bf4e P cc7720d1626a4ef88af4b3319ba703da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c79e0ceee6c4fe9ab2850342122b291 in term 2.
I20260709 13:11:05.845170 28839 leader_election.cc:304] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c79e0ceee6c4fe9ab2850342122b291, cc7720d1626a4ef88af4b3319ba703da; no voters: 
I20260709 13:11:05.846041 28949 raft_consensus.cc:2468] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c79e0ceee6c4fe9ab2850342122b291 in term 2.
I20260709 13:11:05.846065 29069 raft_consensus.cc:2804] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:05.846791 29069 raft_consensus.cc:697] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 LEADER]: Becoming Leader. State: Replica: 9c79e0ceee6c4fe9ab2850342122b291, State: Running, Role: LEADER
I20260709 13:11:05.847735 29069 consensus_queue.cc:237] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:05.856841 28771 catalog_manager.cc:5697] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291 reported cstate change: term changed from 1 to 2, leader changed from f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130) to 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129). New cstate: current_term: 2 leader_uuid: "9c79e0ceee6c4fe9ab2850342122b291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:05.858130 28949 raft_consensus.cc:1275] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c [term 2 FOLLOWER]: Refusing update from remote peer cc7720d1626a4ef88af4b3319ba703da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:11:05.859894 29110 consensus_queue.cc:1048] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [LEADER]: Connected to new peer: Peer: permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:05.865397 29160 raft_consensus.cc:993] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291: : Instructing follower f240b20bb4d549f1abfde7991d89ff4c to start an election
I20260709 13:11:05.868621 29164 raft_consensus.cc:1081] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 LEADER]: Signalling peer f240b20bb4d549f1abfde7991d89ff4c to start an election
I20260709 13:11:05.871176 28949 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc3a7e97dac54e96a71f171e9c7782c5"
dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c"
 from {username='slave'} at 127.0.0.1:52906
I20260709 13:11:05.871810 28949 raft_consensus.cc:493] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:05.872274 28949 raft_consensus.cc:3060] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.874011 29110 raft_consensus.cc:993] T 698707b1216545c19dd7d883dfba7ac4 P cc7720d1626a4ef88af4b3319ba703da: : Instructing follower 9c79e0ceee6c4fe9ab2850342122b291 to start an election
I20260709 13:11:05.874423 29110 raft_consensus.cc:1081] T 698707b1216545c19dd7d883dfba7ac4 P cc7720d1626a4ef88af4b3319ba703da [term 1 LEADER]: Signalling peer 9c79e0ceee6c4fe9ab2850342122b291 to start an election
I20260709 13:11:05.876493 28874 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "698707b1216545c19dd7d883dfba7ac4"
dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
 from {username='slave'} at 127.0.0.1:54798
I20260709 13:11:05.877413 28874 raft_consensus.cc:493] T 698707b1216545c19dd7d883dfba7ac4 P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:05.877949 28874 raft_consensus.cc:3060] T 698707b1216545c19dd7d883dfba7ac4 P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.878587 28949 raft_consensus.cc:515] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:05.881258 29165 raft_consensus.cc:993] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da: : Instructing follower f240b20bb4d549f1abfde7991d89ff4c to start an election
I20260709 13:11:05.881467 28873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3a7e97dac54e96a71f171e9c7782c5" candidate_uuid: "f240b20bb4d549f1abfde7991d89ff4c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
I20260709 13:11:05.881783 29110 raft_consensus.cc:1081] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [term 2 LEADER]: Signalling peer f240b20bb4d549f1abfde7991d89ff4c to start an election
I20260709 13:11:05.882045 28873 raft_consensus.cc:3055] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:05.882370 28873 raft_consensus.cc:740] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9c79e0ceee6c4fe9ab2850342122b291, State: Running, Role: LEADER
I20260709 13:11:05.883641 28947 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd7a00c612f44184878b8c93532bd49a"
dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c"
 from {username='slave'} at 127.0.0.1:52896
I20260709 13:11:05.883163 28873 consensus_queue.cc:260] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:05.885937 28873 raft_consensus.cc:3060] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.887153 28874 raft_consensus.cc:515] T 698707b1216545c19dd7d883dfba7ac4 P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:05.888039 28872 raft_consensus.cc:1275] T bd7a00c612f44184878b8c93532bd49a P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 FOLLOWER]: Refusing update from remote peer cc7720d1626a4ef88af4b3319ba703da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:11:05.890136 29165 consensus_queue.cc:1048] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:05.891726 29021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3a7e97dac54e96a71f171e9c7782c5" candidate_uuid: "f240b20bb4d549f1abfde7991d89ff4c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc7720d1626a4ef88af4b3319ba703da"
I20260709 13:11:05.892418 29021 raft_consensus.cc:3060] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.900425 28873 raft_consensus.cc:2468] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f240b20bb4d549f1abfde7991d89ff4c in term 2.
I20260709 13:11:05.900727 29021 raft_consensus.cc:2468] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f240b20bb4d549f1abfde7991d89ff4c in term 2.
I20260709 13:11:05.901536 28949 leader_election.cc:290] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c [CANDIDATE]: Term 2 election: Requested vote from peers 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909), cc7720d1626a4ef88af4b3319ba703da (127.27.146.131:34903)
I20260709 13:11:05.901925 28912 leader_election.cc:304] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c79e0ceee6c4fe9ab2850342122b291, f240b20bb4d549f1abfde7991d89ff4c; no voters: 
I20260709 13:11:05.902839 29159 raft_consensus.cc:2804] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:05.903316 29159 raft_consensus.cc:697] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c [term 2 LEADER]: Becoming Leader. State: Replica: f240b20bb4d549f1abfde7991d89ff4c, State: Running, Role: LEADER
I20260709 13:11:05.905855 29159 consensus_queue.cc:237] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:05.907582 29021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "698707b1216545c19dd7d883dfba7ac4" candidate_uuid: "9c79e0ceee6c4fe9ab2850342122b291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc7720d1626a4ef88af4b3319ba703da"
I20260709 13:11:05.908310 29021 raft_consensus.cc:3055] T 698707b1216545c19dd7d883dfba7ac4 P cc7720d1626a4ef88af4b3319ba703da [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:05.908630 29021 raft_consensus.cc:740] T 698707b1216545c19dd7d883dfba7ac4 P cc7720d1626a4ef88af4b3319ba703da [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc7720d1626a4ef88af4b3319ba703da, State: Running, Role: LEADER
I20260709 13:11:05.909415 29021 consensus_queue.cc:260] T 698707b1216545c19dd7d883dfba7ac4 P cc7720d1626a4ef88af4b3319ba703da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:05.910316 29021 raft_consensus.cc:3060] T 698707b1216545c19dd7d883dfba7ac4 P cc7720d1626a4ef88af4b3319ba703da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.914923 28947 raft_consensus.cc:493] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:05.915380 28947 raft_consensus.cc:3060] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:05.905881 28949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "698707b1216545c19dd7d883dfba7ac4" candidate_uuid: "9c79e0ceee6c4fe9ab2850342122b291" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c"
I20260709 13:11:05.916168 28949 raft_consensus.cc:3060] T 698707b1216545c19dd7d883dfba7ac4 P f240b20bb4d549f1abfde7991d89ff4c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.925071 29021 raft_consensus.cc:2468] T 698707b1216545c19dd7d883dfba7ac4 P cc7720d1626a4ef88af4b3319ba703da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c79e0ceee6c4fe9ab2850342122b291 in term 2.
I20260709 13:11:05.923605 28874 leader_election.cc:290] T 698707b1216545c19dd7d883dfba7ac4 P 9c79e0ceee6c4fe9ab2850342122b291 [CANDIDATE]: Term 2 election: Requested vote from peers f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889), cc7720d1626a4ef88af4b3319ba703da (127.27.146.131:34903)
I20260709 13:11:05.923461 28771 catalog_manager.cc:5697] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c reported cstate change: term changed from 1 to 2, leader changed from 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129) to f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130). New cstate: current_term: 2 leader_uuid: "f240b20bb4d549f1abfde7991d89ff4c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:05.926434 28949 raft_consensus.cc:2468] T 698707b1216545c19dd7d883dfba7ac4 P f240b20bb4d549f1abfde7991d89ff4c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c79e0ceee6c4fe9ab2850342122b291 in term 2.
I20260709 13:11:05.926595 28839 leader_election.cc:304] T 698707b1216545c19dd7d883dfba7ac4 P 9c79e0ceee6c4fe9ab2850342122b291 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c79e0ceee6c4fe9ab2850342122b291, cc7720d1626a4ef88af4b3319ba703da; no voters: 
I20260709 13:11:05.928010 29069 raft_consensus.cc:2804] T 698707b1216545c19dd7d883dfba7ac4 P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:05.928512 29069 raft_consensus.cc:697] T 698707b1216545c19dd7d883dfba7ac4 P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 LEADER]: Becoming Leader. State: Replica: 9c79e0ceee6c4fe9ab2850342122b291, State: Running, Role: LEADER
I20260709 13:11:05.929350 29069 consensus_queue.cc:237] T 698707b1216545c19dd7d883dfba7ac4 P 9c79e0ceee6c4fe9ab2850342122b291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:05.932078 28947 raft_consensus.cc:515] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:05.937878 28947 leader_election.cc:290] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c [CANDIDATE]: Term 3 election: Requested vote from peers 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909), cc7720d1626a4ef88af4b3319ba703da (127.27.146.131:34903)
I20260709 13:11:05.938405 28874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd7a00c612f44184878b8c93532bd49a" candidate_uuid: "f240b20bb4d549f1abfde7991d89ff4c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
I20260709 13:11:05.938625 29021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd7a00c612f44184878b8c93532bd49a" candidate_uuid: "f240b20bb4d549f1abfde7991d89ff4c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "cc7720d1626a4ef88af4b3319ba703da"
I20260709 13:11:05.939059 28874 raft_consensus.cc:3060] T bd7a00c612f44184878b8c93532bd49a P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:05.939250 29021 raft_consensus.cc:3055] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:05.939738 29021 raft_consensus.cc:740] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cc7720d1626a4ef88af4b3319ba703da, State: Running, Role: LEADER
I20260709 13:11:05.940819 29021 consensus_queue.cc:260] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:05.941802 29021 raft_consensus.cc:3060] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:05.944938 28874 raft_consensus.cc:2468] T bd7a00c612f44184878b8c93532bd49a P 9c79e0ceee6c4fe9ab2850342122b291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f240b20bb4d549f1abfde7991d89ff4c in term 3.
I20260709 13:11:05.946142 28912 leader_election.cc:304] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c79e0ceee6c4fe9ab2850342122b291, f240b20bb4d549f1abfde7991d89ff4c; no voters: 
I20260709 13:11:05.947098 29170 raft_consensus.cc:2804] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:05.947659 29170 raft_consensus.cc:697] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c [term 3 LEADER]: Becoming Leader. State: Replica: f240b20bb4d549f1abfde7991d89ff4c, State: Running, Role: LEADER
I20260709 13:11:05.948554 29021 raft_consensus.cc:2468] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f240b20bb4d549f1abfde7991d89ff4c in term 3.
I20260709 13:11:05.948573 29170 consensus_queue.cc:237] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:05.950727 28769 catalog_manager.cc:5697] T 698707b1216545c19dd7d883dfba7ac4 P 9c79e0ceee6c4fe9ab2850342122b291 reported cstate change: term changed from 1 to 2, leader changed from cc7720d1626a4ef88af4b3319ba703da (127.27.146.131) to 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129). New cstate: current_term: 2 leader_uuid: "9c79e0ceee6c4fe9ab2850342122b291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:05.960029 28771 catalog_manager.cc:5697] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c reported cstate change: term changed from 2 to 3, leader changed from cc7720d1626a4ef88af4b3319ba703da (127.27.146.131) to f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130). New cstate: current_term: 3 leader_uuid: "f240b20bb4d549f1abfde7991d89ff4c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:05.973918 29166 raft_consensus.cc:993] T 3932435a38f74cc59388d2b95bf0c1c9 P cc7720d1626a4ef88af4b3319ba703da: : Instructing follower f240b20bb4d549f1abfde7991d89ff4c to start an election
I20260709 13:11:05.974423 29110 raft_consensus.cc:1081] T 3932435a38f74cc59388d2b95bf0c1c9 P cc7720d1626a4ef88af4b3319ba703da [term 1 LEADER]: Signalling peer f240b20bb4d549f1abfde7991d89ff4c to start an election
I20260709 13:11:05.975977 28947 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3932435a38f74cc59388d2b95bf0c1c9"
dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c"
 from {username='slave'} at 127.0.0.1:52896
I20260709 13:11:05.976519 28947 raft_consensus.cc:493] T 3932435a38f74cc59388d2b95bf0c1c9 P f240b20bb4d549f1abfde7991d89ff4c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:05.976809 28947 raft_consensus.cc:3060] T 3932435a38f74cc59388d2b95bf0c1c9 P f240b20bb4d549f1abfde7991d89ff4c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.981484 28947 raft_consensus.cc:515] T 3932435a38f74cc59388d2b95bf0c1c9 P f240b20bb4d549f1abfde7991d89ff4c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:05.983120 28947 leader_election.cc:290] T 3932435a38f74cc59388d2b95bf0c1c9 P f240b20bb4d549f1abfde7991d89ff4c [CANDIDATE]: Term 2 election: Requested vote from peers 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909), cc7720d1626a4ef88af4b3319ba703da (127.27.146.131:34903)
I20260709 13:11:05.984297 28874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3932435a38f74cc59388d2b95bf0c1c9" candidate_uuid: "f240b20bb4d549f1abfde7991d89ff4c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
I20260709 13:11:05.984330 29021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3932435a38f74cc59388d2b95bf0c1c9" candidate_uuid: "f240b20bb4d549f1abfde7991d89ff4c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc7720d1626a4ef88af4b3319ba703da"
I20260709 13:11:05.985021 28874 raft_consensus.cc:3060] T 3932435a38f74cc59388d2b95bf0c1c9 P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.985146 29021 raft_consensus.cc:3055] T 3932435a38f74cc59388d2b95bf0c1c9 P cc7720d1626a4ef88af4b3319ba703da [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:05.985539 29021 raft_consensus.cc:740] T 3932435a38f74cc59388d2b95bf0c1c9 P cc7720d1626a4ef88af4b3319ba703da [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc7720d1626a4ef88af4b3319ba703da, State: Running, Role: LEADER
I20260709 13:11:05.986279 29021 consensus_queue.cc:260] T 3932435a38f74cc59388d2b95bf0c1c9 P cc7720d1626a4ef88af4b3319ba703da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:05.987259 29021 raft_consensus.cc:3060] T 3932435a38f74cc59388d2b95bf0c1c9 P cc7720d1626a4ef88af4b3319ba703da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:05.990258 28874 raft_consensus.cc:2468] T 3932435a38f74cc59388d2b95bf0c1c9 P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f240b20bb4d549f1abfde7991d89ff4c in term 2.
I20260709 13:11:05.991410 28912 leader_election.cc:304] T 3932435a38f74cc59388d2b95bf0c1c9 P f240b20bb4d549f1abfde7991d89ff4c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c79e0ceee6c4fe9ab2850342122b291, f240b20bb4d549f1abfde7991d89ff4c; no voters: 
I20260709 13:11:05.992434 29170 raft_consensus.cc:2804] T 3932435a38f74cc59388d2b95bf0c1c9 P f240b20bb4d549f1abfde7991d89ff4c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:05.992929 29170 raft_consensus.cc:697] T 3932435a38f74cc59388d2b95bf0c1c9 P f240b20bb4d549f1abfde7991d89ff4c [term 2 LEADER]: Becoming Leader. State: Replica: f240b20bb4d549f1abfde7991d89ff4c, State: Running, Role: LEADER
I20260709 13:11:05.993664 29170 consensus_queue.cc:237] T 3932435a38f74cc59388d2b95bf0c1c9 P f240b20bb4d549f1abfde7991d89ff4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:05.994350 29021 raft_consensus.cc:2468] T 3932435a38f74cc59388d2b95bf0c1c9 P cc7720d1626a4ef88af4b3319ba703da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f240b20bb4d549f1abfde7991d89ff4c in term 2.
I20260709 13:11:06.001302 28771 catalog_manager.cc:5697] T 3932435a38f74cc59388d2b95bf0c1c9 P f240b20bb4d549f1abfde7991d89ff4c reported cstate change: term changed from 1 to 2, leader changed from cc7720d1626a4ef88af4b3319ba703da (127.27.146.131) to f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130). New cstate: current_term: 2 leader_uuid: "f240b20bb4d549f1abfde7991d89ff4c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:06.104720 29166 raft_consensus.cc:993] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da: : Instructing follower f240b20bb4d549f1abfde7991d89ff4c to start an election
I20260709 13:11:06.105206 29166 raft_consensus.cc:1081] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da [term 1 LEADER]: Signalling peer f240b20bb4d549f1abfde7991d89ff4c to start an election
I20260709 13:11:06.107292 28947 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d98145f080424a68b9868bae7ba47a5a"
dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c"
 from {username='slave'} at 127.0.0.1:52896
I20260709 13:11:06.108006 28947 raft_consensus.cc:493] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:06.108404 28947 raft_consensus.cc:3060] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:06.113972 28947 raft_consensus.cc:515] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:06.116191 28947 leader_election.cc:290] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c [CANDIDATE]: Term 2 election: Requested vote from peers 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909), cc7720d1626a4ef88af4b3319ba703da (127.27.146.131:34903)
I20260709 13:11:06.117098 28874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d98145f080424a68b9868bae7ba47a5a" candidate_uuid: "f240b20bb4d549f1abfde7991d89ff4c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
I20260709 13:11:06.117559 29021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d98145f080424a68b9868bae7ba47a5a" candidate_uuid: "f240b20bb4d549f1abfde7991d89ff4c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc7720d1626a4ef88af4b3319ba703da"
I20260709 13:11:06.117718 28874 raft_consensus.cc:3060] T d98145f080424a68b9868bae7ba47a5a P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:06.118165 29021 raft_consensus.cc:3055] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:06.118487 29021 raft_consensus.cc:740] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc7720d1626a4ef88af4b3319ba703da, State: Running, Role: LEADER
I20260709 13:11:06.119428 29021 consensus_queue.cc:260] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:06.120579 29021 raft_consensus.cc:3060] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:06.123052 28874 raft_consensus.cc:2468] T d98145f080424a68b9868bae7ba47a5a P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f240b20bb4d549f1abfde7991d89ff4c in term 2.
I20260709 13:11:06.124186 28912 leader_election.cc:304] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c79e0ceee6c4fe9ab2850342122b291, f240b20bb4d549f1abfde7991d89ff4c; no voters: 
I20260709 13:11:06.124994 29170 raft_consensus.cc:2804] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:06.125397 29170 raft_consensus.cc:697] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c [term 2 LEADER]: Becoming Leader. State: Replica: f240b20bb4d549f1abfde7991d89ff4c, State: Running, Role: LEADER
I20260709 13:11:06.126670 29021 raft_consensus.cc:2468] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f240b20bb4d549f1abfde7991d89ff4c in term 2.
I20260709 13:11:06.126621 29170 consensus_queue.cc:237] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:06.134572 28771 catalog_manager.cc:5697] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c reported cstate change: term changed from 1 to 2, leader changed from cc7720d1626a4ef88af4b3319ba703da (127.27.146.131) to f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130). New cstate: current_term: 2 leader_uuid: "f240b20bb4d549f1abfde7991d89ff4c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:06.336849 29021 raft_consensus.cc:1275] T 0dbb162930114b59bfb5e51c599feb0b P cc7720d1626a4ef88af4b3319ba703da [term 2 FOLLOWER]: Refusing update from remote peer 9c79e0ceee6c4fe9ab2850342122b291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:06.338476 29069 consensus_queue.cc:1048] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:06.348114 28947 raft_consensus.cc:1275] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c [term 2 FOLLOWER]: Refusing update from remote peer 9c79e0ceee6c4fe9ab2850342122b291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:06.349766 29069 consensus_queue.cc:1048] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:06.356896 28949 raft_consensus.cc:1275] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c [term 2 FOLLOWER]: Refusing update from remote peer 9c79e0ceee6c4fe9ab2850342122b291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:06.358875 29069 consensus_queue.cc:1048] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:06.368970 29021 raft_consensus.cc:1275] T 5a9e932a762b44efa39af0a81206bf4e P cc7720d1626a4ef88af4b3319ba703da [term 2 FOLLOWER]: Refusing update from remote peer 9c79e0ceee6c4fe9ab2850342122b291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:06.370859 29164 consensus_queue.cc:1048] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:06.375852 29023 raft_consensus.cc:1275] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da [term 2 FOLLOWER]: Refusing update from remote peer f240b20bb4d549f1abfde7991d89ff4c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:06.377516 29170 consensus_queue.cc:1048] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:06.388794 28874 raft_consensus.cc:1275] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 FOLLOWER]: Refusing update from remote peer f240b20bb4d549f1abfde7991d89ff4c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:06.390458 29023 raft_consensus.cc:1275] T 698707b1216545c19dd7d883dfba7ac4 P cc7720d1626a4ef88af4b3319ba703da [term 2 FOLLOWER]: Refusing update from remote peer 9c79e0ceee6c4fe9ab2850342122b291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:06.392508 29159 consensus_queue.cc:1048] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:06.394440 29164 consensus_queue.cc:1048] T 698707b1216545c19dd7d883dfba7ac4 P 9c79e0ceee6c4fe9ab2850342122b291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:06.410316 28949 raft_consensus.cc:1275] T 698707b1216545c19dd7d883dfba7ac4 P f240b20bb4d549f1abfde7991d89ff4c [term 2 FOLLOWER]: Refusing update from remote peer 9c79e0ceee6c4fe9ab2850342122b291: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:06.411957 29069 consensus_queue.cc:1048] T 698707b1216545c19dd7d883dfba7ac4 P 9c79e0ceee6c4fe9ab2850342122b291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:06.420615 28874 raft_consensus.cc:1275] T 3932435a38f74cc59388d2b95bf0c1c9 P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 FOLLOWER]: Refusing update from remote peer f240b20bb4d549f1abfde7991d89ff4c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:06.422231 29159 consensus_queue.cc:1048] T 3932435a38f74cc59388d2b95bf0c1c9 P f240b20bb4d549f1abfde7991d89ff4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:06.435947 29023 raft_consensus.cc:1275] T 3932435a38f74cc59388d2b95bf0c1c9 P cc7720d1626a4ef88af4b3319ba703da [term 2 FOLLOWER]: Refusing update from remote peer f240b20bb4d549f1abfde7991d89ff4c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:06.437409 29159 consensus_queue.cc:1048] T 3932435a38f74cc59388d2b95bf0c1c9 P f240b20bb4d549f1abfde7991d89ff4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:06.480616 28872 raft_consensus.cc:1275] T bd7a00c612f44184878b8c93532bd49a P 9c79e0ceee6c4fe9ab2850342122b291 [term 3 FOLLOWER]: Refusing update from remote peer f240b20bb4d549f1abfde7991d89ff4c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:06.482141 29159 consensus_queue.cc:1048] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:06.491381 29023 raft_consensus.cc:1275] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [term 3 FOLLOWER]: Refusing update from remote peer f240b20bb4d549f1abfde7991d89ff4c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:06.493386 29073 consensus_queue.cc:1048] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:06.518389 29023 raft_consensus.cc:1275] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da [term 2 FOLLOWER]: Refusing update from remote peer f240b20bb4d549f1abfde7991d89ff4c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:06.519874 29073 consensus_queue.cc:1048] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:06.530213 28872 raft_consensus.cc:1275] T d98145f080424a68b9868bae7ba47a5a P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 FOLLOWER]: Refusing update from remote peer f240b20bb4d549f1abfde7991d89ff4c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:06.531819 29170 consensus_queue.cc:1048] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:08.764725 28234 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:11:08.765600 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:08.791281 28872 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0dbb162930114b59bfb5e51c599feb0b"
dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
mode: GRACEFUL
new_leader_uuid: "cc7720d1626a4ef88af4b3319ba703da"
 from {username='slave'} at 127.0.0.1:54832
I20260709 13:11:08.791944 28872 raft_consensus.cc:606] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 LEADER]: Received request to transfer leadership to TS cc7720d1626a4ef88af4b3319ba703da
I20260709 13:11:08.795307 28872 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a9e932a762b44efa39af0a81206bf4e"
dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
mode: GRACEFUL
new_leader_uuid: "cc7720d1626a4ef88af4b3319ba703da"
 from {username='slave'} at 127.0.0.1:54832
I20260709 13:11:08.795833 28872 raft_consensus.cc:606] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 LEADER]: Received request to transfer leadership to TS cc7720d1626a4ef88af4b3319ba703da
I20260709 13:11:08.797214 28234 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:11:08.797662 28234 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:09.188213 29192 raft_consensus.cc:993] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291: : Instructing follower cc7720d1626a4ef88af4b3319ba703da to start an election
I20260709 13:11:09.189405 29069 raft_consensus.cc:1081] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 LEADER]: Signalling peer cc7720d1626a4ef88af4b3319ba703da to start an election
I20260709 13:11:09.191715 29021 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0dbb162930114b59bfb5e51c599feb0b"
dest_uuid: "cc7720d1626a4ef88af4b3319ba703da"
 from {username='slave'} at 127.0.0.1:58356
I20260709 13:11:09.192685 29021 raft_consensus.cc:493] T 0dbb162930114b59bfb5e51c599feb0b P cc7720d1626a4ef88af4b3319ba703da [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:09.193070 29021 raft_consensus.cc:3060] T 0dbb162930114b59bfb5e51c599feb0b P cc7720d1626a4ef88af4b3319ba703da [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:09.201653 29021 raft_consensus.cc:515] T 0dbb162930114b59bfb5e51c599feb0b P cc7720d1626a4ef88af4b3319ba703da [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:09.204317 29021 leader_election.cc:290] T 0dbb162930114b59bfb5e51c599feb0b P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 3 election: Requested vote from peers 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909), f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889)
I20260709 13:11:09.205595 28874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbb162930114b59bfb5e51c599feb0b" candidate_uuid: "cc7720d1626a4ef88af4b3319ba703da" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
I20260709 13:11:09.206344 28949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbb162930114b59bfb5e51c599feb0b" candidate_uuid: "cc7720d1626a4ef88af4b3319ba703da" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c"
I20260709 13:11:09.206472 28874 raft_consensus.cc:3055] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:09.206770 28874 raft_consensus.cc:740] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9c79e0ceee6c4fe9ab2850342122b291, State: Running, Role: LEADER
I20260709 13:11:09.207041 28949 raft_consensus.cc:3060] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:09.207706 28874 consensus_queue.cc:260] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:09.209033 28874 raft_consensus.cc:3060] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:09.213632 28949 raft_consensus.cc:2468] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7720d1626a4ef88af4b3319ba703da in term 3.
I20260709 13:11:09.214619 28874 raft_consensus.cc:2468] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7720d1626a4ef88af4b3319ba703da in term 3.
I20260709 13:11:09.215389 28986 leader_election.cc:304] T 0dbb162930114b59bfb5e51c599feb0b P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc7720d1626a4ef88af4b3319ba703da, f240b20bb4d549f1abfde7991d89ff4c; no voters: 
I20260709 13:11:09.216570 29166 raft_consensus.cc:2804] T 0dbb162930114b59bfb5e51c599feb0b P cc7720d1626a4ef88af4b3319ba703da [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:09.218138 29166 raft_consensus.cc:697] T 0dbb162930114b59bfb5e51c599feb0b P cc7720d1626a4ef88af4b3319ba703da [term 3 LEADER]: Becoming Leader. State: Replica: cc7720d1626a4ef88af4b3319ba703da, State: Running, Role: LEADER
I20260709 13:11:09.219261 29166 consensus_queue.cc:237] T 0dbb162930114b59bfb5e51c599feb0b P cc7720d1626a4ef88af4b3319ba703da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:09.229938 28770 catalog_manager.cc:5697] T 0dbb162930114b59bfb5e51c599feb0b P cc7720d1626a4ef88af4b3319ba703da reported cstate change: term changed from 2 to 3, leader changed from 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129) to cc7720d1626a4ef88af4b3319ba703da (127.27.146.131). New cstate: current_term: 3 leader_uuid: "cc7720d1626a4ef88af4b3319ba703da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:09.296727 29192 raft_consensus.cc:993] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291: : Instructing follower cc7720d1626a4ef88af4b3319ba703da to start an election
I20260709 13:11:09.297353 29069 raft_consensus.cc:1081] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 LEADER]: Signalling peer cc7720d1626a4ef88af4b3319ba703da to start an election
I20260709 13:11:09.299156 29021 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a9e932a762b44efa39af0a81206bf4e"
dest_uuid: "cc7720d1626a4ef88af4b3319ba703da"
 from {username='slave'} at 127.0.0.1:58356
I20260709 13:11:09.299743 29021 raft_consensus.cc:493] T 5a9e932a762b44efa39af0a81206bf4e P cc7720d1626a4ef88af4b3319ba703da [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:09.300079 29021 raft_consensus.cc:3060] T 5a9e932a762b44efa39af0a81206bf4e P cc7720d1626a4ef88af4b3319ba703da [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:09.305447 29021 raft_consensus.cc:515] T 5a9e932a762b44efa39af0a81206bf4e P cc7720d1626a4ef88af4b3319ba703da [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:09.307135 29021 leader_election.cc:290] T 5a9e932a762b44efa39af0a81206bf4e P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 3 election: Requested vote from peers 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909), f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889)
I20260709 13:11:09.308357 28874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a9e932a762b44efa39af0a81206bf4e" candidate_uuid: "cc7720d1626a4ef88af4b3319ba703da" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
I20260709 13:11:09.308581 28949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a9e932a762b44efa39af0a81206bf4e" candidate_uuid: "cc7720d1626a4ef88af4b3319ba703da" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c"
I20260709 13:11:09.308970 28874 raft_consensus.cc:3055] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:09.309289 28949 raft_consensus.cc:3060] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:09.309300 28874 raft_consensus.cc:740] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9c79e0ceee6c4fe9ab2850342122b291, State: Running, Role: LEADER
I20260709 13:11:09.310496 28874 consensus_queue.cc:260] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:09.311753 28874 raft_consensus.cc:3060] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:09.315623 28949 raft_consensus.cc:2468] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7720d1626a4ef88af4b3319ba703da in term 3.
I20260709 13:11:09.317049 28986 leader_election.cc:304] T 5a9e932a762b44efa39af0a81206bf4e P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc7720d1626a4ef88af4b3319ba703da, f240b20bb4d549f1abfde7991d89ff4c; no voters: 
I20260709 13:11:09.317891 29166 raft_consensus.cc:2804] T 5a9e932a762b44efa39af0a81206bf4e P cc7720d1626a4ef88af4b3319ba703da [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:09.318325 29166 raft_consensus.cc:697] T 5a9e932a762b44efa39af0a81206bf4e P cc7720d1626a4ef88af4b3319ba703da [term 3 LEADER]: Becoming Leader. State: Replica: cc7720d1626a4ef88af4b3319ba703da, State: Running, Role: LEADER
I20260709 13:11:09.318619 28874 raft_consensus.cc:2468] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7720d1626a4ef88af4b3319ba703da in term 3.
I20260709 13:11:09.319175 29166 consensus_queue.cc:237] T 5a9e932a762b44efa39af0a81206bf4e P cc7720d1626a4ef88af4b3319ba703da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:09.326563 28770 catalog_manager.cc:5697] T 5a9e932a762b44efa39af0a81206bf4e P cc7720d1626a4ef88af4b3319ba703da reported cstate change: term changed from 2 to 3, leader changed from 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129) to cc7720d1626a4ef88af4b3319ba703da (127.27.146.131). New cstate: current_term: 3 leader_uuid: "cc7720d1626a4ef88af4b3319ba703da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:09.656526 28949 raft_consensus.cc:1275] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c [term 3 FOLLOWER]: Refusing update from remote peer cc7720d1626a4ef88af4b3319ba703da: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:09.657771 29166 consensus_queue.cc:1048] T 0dbb162930114b59bfb5e51c599feb0b P cc7720d1626a4ef88af4b3319ba703da [LEADER]: Connected to new peer: Peer: permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:09.673110 28874 raft_consensus.cc:1275] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291 [term 3 FOLLOWER]: Refusing update from remote peer cc7720d1626a4ef88af4b3319ba703da: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:09.675132 29166 consensus_queue.cc:1048] T 0dbb162930114b59bfb5e51c599feb0b P cc7720d1626a4ef88af4b3319ba703da [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:09.798636 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:09.805768 28949 raft_consensus.cc:1275] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c [term 3 FOLLOWER]: Refusing update from remote peer cc7720d1626a4ef88af4b3319ba703da: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:09.806517 28874 raft_consensus.cc:1275] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291 [term 3 FOLLOWER]: Refusing update from remote peer cc7720d1626a4ef88af4b3319ba703da: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:09.807621 29166 consensus_queue.cc:1048] T 5a9e932a762b44efa39af0a81206bf4e P cc7720d1626a4ef88af4b3319ba703da [LEADER]: Connected to new peer: Peer: permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:09.808539 29194 consensus_queue.cc:1048] T 5a9e932a762b44efa39af0a81206bf4e P cc7720d1626a4ef88af4b3319ba703da [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:09.821798 29021 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a9e932a762b44efa39af0a81206bf4e"
dest_uuid: "cc7720d1626a4ef88af4b3319ba703da"
mode: GRACEFUL
new_leader_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
 from {username='slave'} at 127.0.0.1:58368
I20260709 13:11:09.822428 29021 raft_consensus.cc:606] T 5a9e932a762b44efa39af0a81206bf4e P cc7720d1626a4ef88af4b3319ba703da [term 3 LEADER]: Received request to transfer leadership to TS 9c79e0ceee6c4fe9ab2850342122b291
I20260709 13:11:09.825955 29166 raft_consensus.cc:993] T 5a9e932a762b44efa39af0a81206bf4e P cc7720d1626a4ef88af4b3319ba703da: : Instructing follower 9c79e0ceee6c4fe9ab2850342122b291 to start an election
I20260709 13:11:09.826452 29166 raft_consensus.cc:1081] T 5a9e932a762b44efa39af0a81206bf4e P cc7720d1626a4ef88af4b3319ba703da [term 3 LEADER]: Signalling peer 9c79e0ceee6c4fe9ab2850342122b291 to start an election
I20260709 13:11:09.831698 28874 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a9e932a762b44efa39af0a81206bf4e"
dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
 from {username='slave'} at 127.0.0.1:54798
I20260709 13:11:09.832492 28874 raft_consensus.cc:493] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:09.832990 28874 raft_consensus.cc:3060] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:09.835005 29021 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0dbb162930114b59bfb5e51c599feb0b"
dest_uuid: "cc7720d1626a4ef88af4b3319ba703da"
mode: GRACEFUL
new_leader_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
 from {username='slave'} at 127.0.0.1:58368
I20260709 13:11:09.835741 29021 raft_consensus.cc:606] T 0dbb162930114b59bfb5e51c599feb0b P cc7720d1626a4ef88af4b3319ba703da [term 3 LEADER]: Received request to transfer leadership to TS 9c79e0ceee6c4fe9ab2850342122b291
I20260709 13:11:09.845896 28874 raft_consensus.cc:515] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:09.849327 28874 leader_election.cc:290] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291 [CANDIDATE]: Term 4 election: Requested vote from peers f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889), cc7720d1626a4ef88af4b3319ba703da (127.27.146.131:34903)
I20260709 13:11:09.849725 28949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a9e932a762b44efa39af0a81206bf4e" candidate_uuid: "9c79e0ceee6c4fe9ab2850342122b291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c"
I20260709 13:11:09.850585 29021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a9e932a762b44efa39af0a81206bf4e" candidate_uuid: "9c79e0ceee6c4fe9ab2850342122b291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "cc7720d1626a4ef88af4b3319ba703da"
I20260709 13:11:09.850665 28949 raft_consensus.cc:3060] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:09.851464 29021 raft_consensus.cc:3055] T 5a9e932a762b44efa39af0a81206bf4e P cc7720d1626a4ef88af4b3319ba703da [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:09.851915 29021 raft_consensus.cc:740] T 5a9e932a762b44efa39af0a81206bf4e P cc7720d1626a4ef88af4b3319ba703da [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cc7720d1626a4ef88af4b3319ba703da, State: Running, Role: LEADER
I20260709 13:11:09.852957 29021 consensus_queue.cc:260] T 5a9e932a762b44efa39af0a81206bf4e P cc7720d1626a4ef88af4b3319ba703da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:09.856105 28947 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3932435a38f74cc59388d2b95bf0c1c9"
dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c"
mode: GRACEFUL
new_leader_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
 from {username='slave'} at 127.0.0.1:52910
I20260709 13:11:09.856554 29021 raft_consensus.cc:3060] T 5a9e932a762b44efa39af0a81206bf4e P cc7720d1626a4ef88af4b3319ba703da [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:09.856840 28947 raft_consensus.cc:606] T 3932435a38f74cc59388d2b95bf0c1c9 P f240b20bb4d549f1abfde7991d89ff4c [term 2 LEADER]: Received request to transfer leadership to TS 9c79e0ceee6c4fe9ab2850342122b291
I20260709 13:11:09.860854 28949 raft_consensus.cc:2468] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c79e0ceee6c4fe9ab2850342122b291 in term 4.
I20260709 13:11:09.862805 28837 leader_election.cc:304] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c79e0ceee6c4fe9ab2850342122b291, f240b20bb4d549f1abfde7991d89ff4c; no voters: 
I20260709 13:11:09.863821 29069 raft_consensus.cc:2804] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:09.865826 28949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc3a7e97dac54e96a71f171e9c7782c5"
dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c"
mode: GRACEFUL
new_leader_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
 from {username='slave'} at 127.0.0.1:52910
I20260709 13:11:09.866112 29069 raft_consensus.cc:697] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291 [term 4 LEADER]: Becoming Leader. State: Replica: 9c79e0ceee6c4fe9ab2850342122b291, State: Running, Role: LEADER
I20260709 13:11:09.866575 28949 raft_consensus.cc:606] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c [term 2 LEADER]: Received request to transfer leadership to TS 9c79e0ceee6c4fe9ab2850342122b291
I20260709 13:11:09.866763 29021 raft_consensus.cc:2468] T 5a9e932a762b44efa39af0a81206bf4e P cc7720d1626a4ef88af4b3319ba703da [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c79e0ceee6c4fe9ab2850342122b291 in term 4.
I20260709 13:11:09.867233 29069 consensus_queue.cc:237] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:09.872838 28949 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d98145f080424a68b9868bae7ba47a5a"
dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c"
mode: GRACEFUL
new_leader_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
 from {username='slave'} at 127.0.0.1:52910
I20260709 13:11:09.873562 28949 raft_consensus.cc:606] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c [term 2 LEADER]: Received request to transfer leadership to TS 9c79e0ceee6c4fe9ab2850342122b291
I20260709 13:11:09.875866 28770 catalog_manager.cc:5697] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291 reported cstate change: term changed from 3 to 4, leader changed from cc7720d1626a4ef88af4b3319ba703da (127.27.146.131) to 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129). New cstate: current_term: 4 leader_uuid: "9c79e0ceee6c4fe9ab2850342122b291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:10.064036 29208 raft_consensus.cc:993] T 0dbb162930114b59bfb5e51c599feb0b P cc7720d1626a4ef88af4b3319ba703da: : Instructing follower 9c79e0ceee6c4fe9ab2850342122b291 to start an election
I20260709 13:11:10.064610 29208 raft_consensus.cc:1081] T 0dbb162930114b59bfb5e51c599feb0b P cc7720d1626a4ef88af4b3319ba703da [term 3 LEADER]: Signalling peer 9c79e0ceee6c4fe9ab2850342122b291 to start an election
I20260709 13:11:10.066490 28874 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0dbb162930114b59bfb5e51c599feb0b"
dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
 from {username='slave'} at 127.0.0.1:54798
I20260709 13:11:10.067003 28874 raft_consensus.cc:493] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:10.067377 28874 raft_consensus.cc:3060] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:10.072911 28874 raft_consensus.cc:515] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:10.074626 28874 leader_election.cc:290] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291 [CANDIDATE]: Term 4 election: Requested vote from peers f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889), cc7720d1626a4ef88af4b3319ba703da (127.27.146.131:34903)
I20260709 13:11:10.076224 28949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbb162930114b59bfb5e51c599feb0b" candidate_uuid: "9c79e0ceee6c4fe9ab2850342122b291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c"
I20260709 13:11:10.076313 29021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbb162930114b59bfb5e51c599feb0b" candidate_uuid: "9c79e0ceee6c4fe9ab2850342122b291" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "cc7720d1626a4ef88af4b3319ba703da"
I20260709 13:11:10.076943 28949 raft_consensus.cc:3060] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:10.077107 29021 raft_consensus.cc:3055] T 0dbb162930114b59bfb5e51c599feb0b P cc7720d1626a4ef88af4b3319ba703da [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:10.077457 29021 raft_consensus.cc:740] T 0dbb162930114b59bfb5e51c599feb0b P cc7720d1626a4ef88af4b3319ba703da [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cc7720d1626a4ef88af4b3319ba703da, State: Running, Role: LEADER
I20260709 13:11:10.078084 29021 consensus_queue.cc:260] T 0dbb162930114b59bfb5e51c599feb0b P cc7720d1626a4ef88af4b3319ba703da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:10.079160 29021 raft_consensus.cc:3060] T 0dbb162930114b59bfb5e51c599feb0b P cc7720d1626a4ef88af4b3319ba703da [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:10.082885 28949 raft_consensus.cc:2468] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c79e0ceee6c4fe9ab2850342122b291 in term 4.
I20260709 13:11:10.084266 29021 raft_consensus.cc:2468] T 0dbb162930114b59bfb5e51c599feb0b P cc7720d1626a4ef88af4b3319ba703da [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c79e0ceee6c4fe9ab2850342122b291 in term 4.
I20260709 13:11:10.084383 28837 leader_election.cc:304] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c79e0ceee6c4fe9ab2850342122b291, f240b20bb4d549f1abfde7991d89ff4c; no voters: 
I20260709 13:11:10.085461 29069 raft_consensus.cc:2804] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:10.086113 29069 raft_consensus.cc:697] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291 [term 4 LEADER]: Becoming Leader. State: Replica: 9c79e0ceee6c4fe9ab2850342122b291, State: Running, Role: LEADER
I20260709 13:11:10.086937 29069 consensus_queue.cc:237] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:10.093590 28770 catalog_manager.cc:5697] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291 reported cstate change: term changed from 3 to 4, leader changed from cc7720d1626a4ef88af4b3319ba703da (127.27.146.131) to 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129). New cstate: current_term: 4 leader_uuid: "9c79e0ceee6c4fe9ab2850342122b291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:10.098191 29213 raft_consensus.cc:993] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c: : Instructing follower 9c79e0ceee6c4fe9ab2850342122b291 to start an election
I20260709 13:11:10.098886 29159 raft_consensus.cc:1081] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c [term 2 LEADER]: Signalling peer 9c79e0ceee6c4fe9ab2850342122b291 to start an election
I20260709 13:11:10.100638 28874 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d98145f080424a68b9868bae7ba47a5a"
dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
 from {username='slave'} at 127.0.0.1:54812
I20260709 13:11:10.101208 28874 raft_consensus.cc:493] T d98145f080424a68b9868bae7ba47a5a P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:10.101514 28874 raft_consensus.cc:3060] T d98145f080424a68b9868bae7ba47a5a P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:10.108417 28874 raft_consensus.cc:515] T d98145f080424a68b9868bae7ba47a5a P 9c79e0ceee6c4fe9ab2850342122b291 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:10.110646 28874 leader_election.cc:290] T d98145f080424a68b9868bae7ba47a5a P 9c79e0ceee6c4fe9ab2850342122b291 [CANDIDATE]: Term 3 election: Requested vote from peers f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889), cc7720d1626a4ef88af4b3319ba703da (127.27.146.131:34903)
I20260709 13:11:10.110989 29159 raft_consensus.cc:993] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c: : Instructing follower 9c79e0ceee6c4fe9ab2850342122b291 to start an election
I20260709 13:11:10.111310 28949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d98145f080424a68b9868bae7ba47a5a" candidate_uuid: "9c79e0ceee6c4fe9ab2850342122b291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c"
I20260709 13:11:10.111474 29159 raft_consensus.cc:1081] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c [term 2 LEADER]: Signalling peer 9c79e0ceee6c4fe9ab2850342122b291 to start an election
I20260709 13:11:10.111706 29021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d98145f080424a68b9868bae7ba47a5a" candidate_uuid: "9c79e0ceee6c4fe9ab2850342122b291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cc7720d1626a4ef88af4b3319ba703da"
I20260709 13:11:10.112001 28949 raft_consensus.cc:3055] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:10.112212 29021 raft_consensus.cc:3060] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:10.112322 28949 raft_consensus.cc:740] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f240b20bb4d549f1abfde7991d89ff4c, State: Running, Role: LEADER
I20260709 13:11:10.113430 28874 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc3a7e97dac54e96a71f171e9c7782c5"
dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
 from {username='slave'} at 127.0.0.1:54812
I20260709 13:11:10.113162 28949 consensus_queue.cc:260] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:10.113960 28874 raft_consensus.cc:493] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:10.114300 28874 raft_consensus.cc:3060] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:10.114367 28949 raft_consensus.cc:3060] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:10.118638 29021 raft_consensus.cc:2468] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c79e0ceee6c4fe9ab2850342122b291 in term 3.
I20260709 13:11:10.119481 28874 raft_consensus.cc:515] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:10.119994 28839 leader_election.cc:304] T d98145f080424a68b9868bae7ba47a5a P 9c79e0ceee6c4fe9ab2850342122b291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c79e0ceee6c4fe9ab2850342122b291, cc7720d1626a4ef88af4b3319ba703da; no voters: 
I20260709 13:11:10.120770 28949 raft_consensus.cc:2468] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c79e0ceee6c4fe9ab2850342122b291 in term 3.
I20260709 13:11:10.120850 29069 raft_consensus.cc:2804] T d98145f080424a68b9868bae7ba47a5a P 9c79e0ceee6c4fe9ab2850342122b291 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:10.121565 29069 raft_consensus.cc:697] T d98145f080424a68b9868bae7ba47a5a P 9c79e0ceee6c4fe9ab2850342122b291 [term 3 LEADER]: Becoming Leader. State: Replica: 9c79e0ceee6c4fe9ab2850342122b291, State: Running, Role: LEADER
I20260709 13:11:10.122181 28874 leader_election.cc:290] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [CANDIDATE]: Term 3 election: Requested vote from peers f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889), cc7720d1626a4ef88af4b3319ba703da (127.27.146.131:34903)
I20260709 13:11:10.122491 28947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3a7e97dac54e96a71f171e9c7782c5" candidate_uuid: "9c79e0ceee6c4fe9ab2850342122b291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c"
I20260709 13:11:10.122581 29069 consensus_queue.cc:237] T d98145f080424a68b9868bae7ba47a5a P 9c79e0ceee6c4fe9ab2850342122b291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:10.123185 28947 raft_consensus.cc:3055] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:10.123200 29021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3a7e97dac54e96a71f171e9c7782c5" candidate_uuid: "9c79e0ceee6c4fe9ab2850342122b291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cc7720d1626a4ef88af4b3319ba703da"
I20260709 13:11:10.123699 28947 raft_consensus.cc:740] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f240b20bb4d549f1abfde7991d89ff4c, State: Running, Role: LEADER
I20260709 13:11:10.123836 29021 raft_consensus.cc:3060] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:10.124619 28947 consensus_queue.cc:260] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:10.125938 28947 raft_consensus.cc:3060] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:10.130780 29021 raft_consensus.cc:2468] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c79e0ceee6c4fe9ab2850342122b291 in term 3.
I20260709 13:11:10.132120 28839 leader_election.cc:304] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c79e0ceee6c4fe9ab2850342122b291, cc7720d1626a4ef88af4b3319ba703da; no voters: 
I20260709 13:11:10.132952 29069 raft_consensus.cc:2804] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:10.133524 29069 raft_consensus.cc:697] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [term 3 LEADER]: Becoming Leader. State: Replica: 9c79e0ceee6c4fe9ab2850342122b291, State: Running, Role: LEADER
I20260709 13:11:10.133435 28947 raft_consensus.cc:2468] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c79e0ceee6c4fe9ab2850342122b291 in term 3.
I20260709 13:11:10.133044 28770 catalog_manager.cc:5697] T d98145f080424a68b9868bae7ba47a5a P 9c79e0ceee6c4fe9ab2850342122b291 reported cstate change: term changed from 2 to 3, leader changed from f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130) to 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129). New cstate: current_term: 3 leader_uuid: "9c79e0ceee6c4fe9ab2850342122b291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:10.134645 29069 consensus_queue.cc:237] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:10.148226 28770 catalog_manager.cc:5697] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 reported cstate change: term changed from 2 to 3, leader changed from f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130) to 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129). New cstate: current_term: 3 leader_uuid: "9c79e0ceee6c4fe9ab2850342122b291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:10.158834 29213 raft_consensus.cc:993] T 3932435a38f74cc59388d2b95bf0c1c9 P f240b20bb4d549f1abfde7991d89ff4c: : Instructing follower 9c79e0ceee6c4fe9ab2850342122b291 to start an election
I20260709 13:11:10.159509 29159 raft_consensus.cc:1081] T 3932435a38f74cc59388d2b95bf0c1c9 P f240b20bb4d549f1abfde7991d89ff4c [term 2 LEADER]: Signalling peer 9c79e0ceee6c4fe9ab2850342122b291 to start an election
I20260709 13:11:10.161448 28874 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3932435a38f74cc59388d2b95bf0c1c9"
dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
 from {username='slave'} at 127.0.0.1:54812
I20260709 13:11:10.162045 28874 raft_consensus.cc:493] T 3932435a38f74cc59388d2b95bf0c1c9 P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:10.162364 28874 raft_consensus.cc:3060] T 3932435a38f74cc59388d2b95bf0c1c9 P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:10.169160 28874 raft_consensus.cc:515] T 3932435a38f74cc59388d2b95bf0c1c9 P 9c79e0ceee6c4fe9ab2850342122b291 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:10.171011 28874 leader_election.cc:290] T 3932435a38f74cc59388d2b95bf0c1c9 P 9c79e0ceee6c4fe9ab2850342122b291 [CANDIDATE]: Term 3 election: Requested vote from peers f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889), cc7720d1626a4ef88af4b3319ba703da (127.27.146.131:34903)
I20260709 13:11:10.172061 28947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3932435a38f74cc59388d2b95bf0c1c9" candidate_uuid: "9c79e0ceee6c4fe9ab2850342122b291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c"
I20260709 13:11:10.172394 29021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3932435a38f74cc59388d2b95bf0c1c9" candidate_uuid: "9c79e0ceee6c4fe9ab2850342122b291" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cc7720d1626a4ef88af4b3319ba703da"
I20260709 13:11:10.172740 28947 raft_consensus.cc:3055] T 3932435a38f74cc59388d2b95bf0c1c9 P f240b20bb4d549f1abfde7991d89ff4c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:10.172863 29021 raft_consensus.cc:3060] T 3932435a38f74cc59388d2b95bf0c1c9 P cc7720d1626a4ef88af4b3319ba703da [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:10.173137 28947 raft_consensus.cc:740] T 3932435a38f74cc59388d2b95bf0c1c9 P f240b20bb4d549f1abfde7991d89ff4c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f240b20bb4d549f1abfde7991d89ff4c, State: Running, Role: LEADER
I20260709 13:11:10.174016 28947 consensus_queue.cc:260] T 3932435a38f74cc59388d2b95bf0c1c9 P f240b20bb4d549f1abfde7991d89ff4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:10.175220 28947 raft_consensus.cc:3060] T 3932435a38f74cc59388d2b95bf0c1c9 P f240b20bb4d549f1abfde7991d89ff4c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:10.179921 29021 raft_consensus.cc:2468] T 3932435a38f74cc59388d2b95bf0c1c9 P cc7720d1626a4ef88af4b3319ba703da [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c79e0ceee6c4fe9ab2850342122b291 in term 3.
I20260709 13:11:10.181854 28947 raft_consensus.cc:2468] T 3932435a38f74cc59388d2b95bf0c1c9 P f240b20bb4d549f1abfde7991d89ff4c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c79e0ceee6c4fe9ab2850342122b291 in term 3.
I20260709 13:11:10.182262 28839 leader_election.cc:304] T 3932435a38f74cc59388d2b95bf0c1c9 P 9c79e0ceee6c4fe9ab2850342122b291 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c79e0ceee6c4fe9ab2850342122b291, cc7720d1626a4ef88af4b3319ba703da; no voters: 
I20260709 13:11:10.183384 29209 raft_consensus.cc:2804] T 3932435a38f74cc59388d2b95bf0c1c9 P 9c79e0ceee6c4fe9ab2850342122b291 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:10.183969 29209 raft_consensus.cc:697] T 3932435a38f74cc59388d2b95bf0c1c9 P 9c79e0ceee6c4fe9ab2850342122b291 [term 3 LEADER]: Becoming Leader. State: Replica: 9c79e0ceee6c4fe9ab2850342122b291, State: Running, Role: LEADER
I20260709 13:11:10.184860 29209 consensus_queue.cc:237] T 3932435a38f74cc59388d2b95bf0c1c9 P 9c79e0ceee6c4fe9ab2850342122b291 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:10.193269 28770 catalog_manager.cc:5697] T 3932435a38f74cc59388d2b95bf0c1c9 P 9c79e0ceee6c4fe9ab2850342122b291 reported cstate change: term changed from 2 to 3, leader changed from f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130) to 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129). New cstate: current_term: 3 leader_uuid: "9c79e0ceee6c4fe9ab2850342122b291" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:10.363919 28947 raft_consensus.cc:1275] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c [term 4 FOLLOWER]: Refusing update from remote peer 9c79e0ceee6c4fe9ab2850342122b291: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:10.365674 29209 consensus_queue.cc:1048] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:10.366716 29021 raft_consensus.cc:1275] T 5a9e932a762b44efa39af0a81206bf4e P cc7720d1626a4ef88af4b3319ba703da [term 4 FOLLOWER]: Refusing update from remote peer 9c79e0ceee6c4fe9ab2850342122b291: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:10.368271 29209 consensus_queue.cc:1048] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:10.504362 28947 raft_consensus.cc:1275] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c [term 3 FOLLOWER]: Refusing update from remote peer 9c79e0ceee6c4fe9ab2850342122b291: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:10.505988 29209 consensus_queue.cc:1048] T d98145f080424a68b9868bae7ba47a5a P 9c79e0ceee6c4fe9ab2850342122b291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:10.518358 29021 raft_consensus.cc:1275] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da [term 3 FOLLOWER]: Refusing update from remote peer 9c79e0ceee6c4fe9ab2850342122b291: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:10.520900 29069 consensus_queue.cc:1048] T d98145f080424a68b9868bae7ba47a5a P 9c79e0ceee6c4fe9ab2850342122b291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:10.543751 29021 raft_consensus.cc:1275] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da [term 3 FOLLOWER]: Refusing update from remote peer 9c79e0ceee6c4fe9ab2850342122b291: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:10.545017 29069 consensus_queue.cc:1048] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:10.555938 28947 raft_consensus.cc:1275] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c [term 3 FOLLOWER]: Refusing update from remote peer 9c79e0ceee6c4fe9ab2850342122b291: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:10.557557 29209 consensus_queue.cc:1048] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:10.569155 28949 raft_consensus.cc:1275] T 3932435a38f74cc59388d2b95bf0c1c9 P f240b20bb4d549f1abfde7991d89ff4c [term 3 FOLLOWER]: Refusing update from remote peer 9c79e0ceee6c4fe9ab2850342122b291: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:10.570465 29069 consensus_queue.cc:1048] T 3932435a38f74cc59388d2b95bf0c1c9 P 9c79e0ceee6c4fe9ab2850342122b291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:10.581869 29021 raft_consensus.cc:1275] T 3932435a38f74cc59388d2b95bf0c1c9 P cc7720d1626a4ef88af4b3319ba703da [term 3 FOLLOWER]: Refusing update from remote peer 9c79e0ceee6c4fe9ab2850342122b291: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:10.583575 29069 consensus_queue.cc:1048] T 3932435a38f74cc59388d2b95bf0c1c9 P 9c79e0ceee6c4fe9ab2850342122b291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:10.646525 28949 raft_consensus.cc:1275] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c [term 4 FOLLOWER]: Refusing update from remote peer 9c79e0ceee6c4fe9ab2850342122b291: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:10.648483 29069 consensus_queue.cc:1048] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:10.659447 29021 raft_consensus.cc:1275] T 0dbb162930114b59bfb5e51c599feb0b P cc7720d1626a4ef88af4b3319ba703da [term 4 FOLLOWER]: Refusing update from remote peer 9c79e0ceee6c4fe9ab2850342122b291: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:10.662393 29069 consensus_queue.cc:1048] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:12.884493 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:12.893458 28874 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2185b9a3133c45849577db9fd53cc3da"
dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
mode: GRACEFUL
new_leader_uuid: "f240b20bb4d549f1abfde7991d89ff4c"
 from {username='slave'} at 127.0.0.1:54832
I20260709 13:11:12.894063 28874 raft_consensus.cc:606] T 2185b9a3133c45849577db9fd53cc3da P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 LEADER]: Received request to transfer leadership to TS f240b20bb4d549f1abfde7991d89ff4c
I20260709 13:11:12.897599 28874 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d98145f080424a68b9868bae7ba47a5a"
dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
mode: GRACEFUL
new_leader_uuid: "f240b20bb4d549f1abfde7991d89ff4c"
 from {username='slave'} at 127.0.0.1:54832
I20260709 13:11:12.898226 28874 raft_consensus.cc:606] T d98145f080424a68b9868bae7ba47a5a P 9c79e0ceee6c4fe9ab2850342122b291 [term 3 LEADER]: Received request to transfer leadership to TS f240b20bb4d549f1abfde7991d89ff4c
I20260709 13:11:12.901276 28874 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e457a1d9027b4083bb5f457451a06215"
dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
mode: GRACEFUL
new_leader_uuid: "cc7720d1626a4ef88af4b3319ba703da"
 from {username='slave'} at 127.0.0.1:54832
I20260709 13:11:12.901834 28874 raft_consensus.cc:606] T e457a1d9027b4083bb5f457451a06215 P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 LEADER]: Received request to transfer leadership to TS cc7720d1626a4ef88af4b3319ba703da
I20260709 13:11:12.904711 28874 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc3a7e97dac54e96a71f171e9c7782c5"
dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
mode: GRACEFUL
new_leader_uuid: "cc7720d1626a4ef88af4b3319ba703da"
 from {username='slave'} at 127.0.0.1:54832
I20260709 13:11:12.905256 28874 raft_consensus.cc:606] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [term 3 LEADER]: Received request to transfer leadership to TS cc7720d1626a4ef88af4b3319ba703da
I20260709 13:11:12.906448 28234 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:11:12.907020 28234 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:13.009774 29069 raft_consensus.cc:993] T e457a1d9027b4083bb5f457451a06215 P 9c79e0ceee6c4fe9ab2850342122b291: : Instructing follower cc7720d1626a4ef88af4b3319ba703da to start an election
I20260709 13:11:13.010221 29069 raft_consensus.cc:1081] T e457a1d9027b4083bb5f457451a06215 P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 LEADER]: Signalling peer cc7720d1626a4ef88af4b3319ba703da to start an election
I20260709 13:11:13.012130 29021 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e457a1d9027b4083bb5f457451a06215"
dest_uuid: "cc7720d1626a4ef88af4b3319ba703da"
 from {username='slave'} at 127.0.0.1:58356
I20260709 13:11:13.012637 29021 raft_consensus.cc:493] T e457a1d9027b4083bb5f457451a06215 P cc7720d1626a4ef88af4b3319ba703da [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:13.013074 29021 raft_consensus.cc:3060] T e457a1d9027b4083bb5f457451a06215 P cc7720d1626a4ef88af4b3319ba703da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:13.018834 29021 raft_consensus.cc:515] T e457a1d9027b4083bb5f457451a06215 P cc7720d1626a4ef88af4b3319ba703da [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:13.020793 29021 leader_election.cc:290] T e457a1d9027b4083bb5f457451a06215 P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 2 election: Requested vote from peers 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909), f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889)
I20260709 13:11:13.021842 28874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e457a1d9027b4083bb5f457451a06215" candidate_uuid: "cc7720d1626a4ef88af4b3319ba703da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
I20260709 13:11:13.022076 28947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e457a1d9027b4083bb5f457451a06215" candidate_uuid: "cc7720d1626a4ef88af4b3319ba703da" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c"
I20260709 13:11:13.022526 28874 raft_consensus.cc:3055] T e457a1d9027b4083bb5f457451a06215 P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:13.022722 28947 raft_consensus.cc:3060] T e457a1d9027b4083bb5f457451a06215 P f240b20bb4d549f1abfde7991d89ff4c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:13.022930 28874 raft_consensus.cc:740] T e457a1d9027b4083bb5f457451a06215 P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9c79e0ceee6c4fe9ab2850342122b291, State: Running, Role: LEADER
I20260709 13:11:13.024008 28874 consensus_queue.cc:260] T e457a1d9027b4083bb5f457451a06215 P 9c79e0ceee6c4fe9ab2850342122b291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:13.025178 28874 raft_consensus.cc:3060] T e457a1d9027b4083bb5f457451a06215 P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:13.030143 28874 raft_consensus.cc:2468] T e457a1d9027b4083bb5f457451a06215 P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7720d1626a4ef88af4b3319ba703da in term 2.
I20260709 13:11:13.030174 28947 raft_consensus.cc:2468] T e457a1d9027b4083bb5f457451a06215 P f240b20bb4d549f1abfde7991d89ff4c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7720d1626a4ef88af4b3319ba703da in term 2.
I20260709 13:11:13.031481 28986 leader_election.cc:304] T e457a1d9027b4083bb5f457451a06215 P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c79e0ceee6c4fe9ab2850342122b291, cc7720d1626a4ef88af4b3319ba703da; no voters: 
I20260709 13:11:13.032359 29208 raft_consensus.cc:2804] T e457a1d9027b4083bb5f457451a06215 P cc7720d1626a4ef88af4b3319ba703da [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:13.033563 29208 raft_consensus.cc:697] T e457a1d9027b4083bb5f457451a06215 P cc7720d1626a4ef88af4b3319ba703da [term 2 LEADER]: Becoming Leader. State: Replica: cc7720d1626a4ef88af4b3319ba703da, State: Running, Role: LEADER
I20260709 13:11:13.034749 29208 consensus_queue.cc:237] T e457a1d9027b4083bb5f457451a06215 P cc7720d1626a4ef88af4b3319ba703da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:13.043112 28770 catalog_manager.cc:5697] T e457a1d9027b4083bb5f457451a06215 P cc7720d1626a4ef88af4b3319ba703da reported cstate change: term changed from 1 to 2, leader changed from 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129) to cc7720d1626a4ef88af4b3319ba703da (127.27.146.131). New cstate: current_term: 2 leader_uuid: "cc7720d1626a4ef88af4b3319ba703da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:13.142225 29069 raft_consensus.cc:993] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291: : Instructing follower cc7720d1626a4ef88af4b3319ba703da to start an election
I20260709 13:11:13.142760 29227 raft_consensus.cc:1081] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [term 3 LEADER]: Signalling peer cc7720d1626a4ef88af4b3319ba703da to start an election
I20260709 13:11:13.144517 29023 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc3a7e97dac54e96a71f171e9c7782c5"
dest_uuid: "cc7720d1626a4ef88af4b3319ba703da"
 from {username='slave'} at 127.0.0.1:58356
I20260709 13:11:13.145124 29023 raft_consensus.cc:493] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:13.145394 29023 raft_consensus.cc:3060] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:13.150683 29023 raft_consensus.cc:515] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:13.152308 29023 leader_election.cc:290] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 4 election: Requested vote from peers 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909), f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889)
I20260709 13:11:13.153488 28874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3a7e97dac54e96a71f171e9c7782c5" candidate_uuid: "cc7720d1626a4ef88af4b3319ba703da" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
I20260709 13:11:13.153971 28949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc3a7e97dac54e96a71f171e9c7782c5" candidate_uuid: "cc7720d1626a4ef88af4b3319ba703da" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c"
I20260709 13:11:13.154026 28874 raft_consensus.cc:3055] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:13.154513 28874 raft_consensus.cc:740] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9c79e0ceee6c4fe9ab2850342122b291, State: Running, Role: LEADER
I20260709 13:11:13.154594 28949 raft_consensus.cc:3060] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:13.155236 28874 consensus_queue.cc:260] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:13.156261 28874 raft_consensus.cc:3060] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:13.160521 28949 raft_consensus.cc:2468] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7720d1626a4ef88af4b3319ba703da in term 4.
I20260709 13:11:13.161509 28874 raft_consensus.cc:2468] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc7720d1626a4ef88af4b3319ba703da in term 4.
I20260709 13:11:13.162134 28986 leader_election.cc:304] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc7720d1626a4ef88af4b3319ba703da, f240b20bb4d549f1abfde7991d89ff4c; no voters: 
I20260709 13:11:13.163013 29208 raft_consensus.cc:2804] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:13.163561 29208 raft_consensus.cc:697] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da [term 4 LEADER]: Becoming Leader. State: Replica: cc7720d1626a4ef88af4b3319ba703da, State: Running, Role: LEADER
I20260709 13:11:13.164391 29208 consensus_queue.cc:237] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:13.171260 28770 catalog_manager.cc:5697] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da reported cstate change: term changed from 3 to 4, leader changed from 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129) to cc7720d1626a4ef88af4b3319ba703da (127.27.146.131). New cstate: current_term: 4 leader_uuid: "cc7720d1626a4ef88af4b3319ba703da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:13.257040 29069 raft_consensus.cc:993] T 2185b9a3133c45849577db9fd53cc3da P 9c79e0ceee6c4fe9ab2850342122b291: : Instructing follower f240b20bb4d549f1abfde7991d89ff4c to start an election
I20260709 13:11:13.257521 29227 raft_consensus.cc:1081] T 2185b9a3133c45849577db9fd53cc3da P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 LEADER]: Signalling peer f240b20bb4d549f1abfde7991d89ff4c to start an election
I20260709 13:11:13.259632 28949 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2185b9a3133c45849577db9fd53cc3da"
dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c"
 from {username='slave'} at 127.0.0.1:52906
I20260709 13:11:13.260185 28949 raft_consensus.cc:493] T 2185b9a3133c45849577db9fd53cc3da P f240b20bb4d549f1abfde7991d89ff4c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:13.260478 28949 raft_consensus.cc:3060] T 2185b9a3133c45849577db9fd53cc3da P f240b20bb4d549f1abfde7991d89ff4c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:13.265100 28949 raft_consensus.cc:515] T 2185b9a3133c45849577db9fd53cc3da P f240b20bb4d549f1abfde7991d89ff4c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:13.266721 28949 leader_election.cc:290] T 2185b9a3133c45849577db9fd53cc3da P f240b20bb4d549f1abfde7991d89ff4c [CANDIDATE]: Term 2 election: Requested vote from peers 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909), cc7720d1626a4ef88af4b3319ba703da (127.27.146.131:34903)
I20260709 13:11:13.267838 28874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2185b9a3133c45849577db9fd53cc3da" candidate_uuid: "f240b20bb4d549f1abfde7991d89ff4c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
I20260709 13:11:13.268433 28874 raft_consensus.cc:3055] T 2185b9a3133c45849577db9fd53cc3da P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:13.268205 29023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2185b9a3133c45849577db9fd53cc3da" candidate_uuid: "f240b20bb4d549f1abfde7991d89ff4c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc7720d1626a4ef88af4b3319ba703da"
I20260709 13:11:13.268746 28874 raft_consensus.cc:740] T 2185b9a3133c45849577db9fd53cc3da P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9c79e0ceee6c4fe9ab2850342122b291, State: Running, Role: LEADER
I20260709 13:11:13.269007 29023 raft_consensus.cc:3060] T 2185b9a3133c45849577db9fd53cc3da P cc7720d1626a4ef88af4b3319ba703da [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:13.269586 28874 consensus_queue.cc:260] T 2185b9a3133c45849577db9fd53cc3da P 9c79e0ceee6c4fe9ab2850342122b291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:13.270608 28874 raft_consensus.cc:3060] T 2185b9a3133c45849577db9fd53cc3da P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:13.274369 29023 raft_consensus.cc:2468] T 2185b9a3133c45849577db9fd53cc3da P cc7720d1626a4ef88af4b3319ba703da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f240b20bb4d549f1abfde7991d89ff4c in term 2.
I20260709 13:11:13.275843 28914 leader_election.cc:304] T 2185b9a3133c45849577db9fd53cc3da P f240b20bb4d549f1abfde7991d89ff4c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc7720d1626a4ef88af4b3319ba703da, f240b20bb4d549f1abfde7991d89ff4c; no voters: 
I20260709 13:11:13.276458 28874 raft_consensus.cc:2468] T 2185b9a3133c45849577db9fd53cc3da P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f240b20bb4d549f1abfde7991d89ff4c in term 2.
I20260709 13:11:13.276717 29159 raft_consensus.cc:2804] T 2185b9a3133c45849577db9fd53cc3da P f240b20bb4d549f1abfde7991d89ff4c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:13.278319 29159 raft_consensus.cc:697] T 2185b9a3133c45849577db9fd53cc3da P f240b20bb4d549f1abfde7991d89ff4c [term 2 LEADER]: Becoming Leader. State: Replica: f240b20bb4d549f1abfde7991d89ff4c, State: Running, Role: LEADER
I20260709 13:11:13.279361 29159 consensus_queue.cc:237] T 2185b9a3133c45849577db9fd53cc3da P f240b20bb4d549f1abfde7991d89ff4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:13.288702 29227 raft_consensus.cc:993] T d98145f080424a68b9868bae7ba47a5a P 9c79e0ceee6c4fe9ab2850342122b291: : Instructing follower f240b20bb4d549f1abfde7991d89ff4c to start an election
I20260709 13:11:13.289263 29069 raft_consensus.cc:1081] T d98145f080424a68b9868bae7ba47a5a P 9c79e0ceee6c4fe9ab2850342122b291 [term 3 LEADER]: Signalling peer f240b20bb4d549f1abfde7991d89ff4c to start an election
I20260709 13:11:13.289738 28770 catalog_manager.cc:5697] T 2185b9a3133c45849577db9fd53cc3da P f240b20bb4d549f1abfde7991d89ff4c reported cstate change: term changed from 1 to 2, leader changed from 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129) to f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130). New cstate: current_term: 2 leader_uuid: "f240b20bb4d549f1abfde7991d89ff4c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:13.290966 28949 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d98145f080424a68b9868bae7ba47a5a"
dest_uuid: "f240b20bb4d549f1abfde7991d89ff4c"
 from {username='slave'} at 127.0.0.1:52906
I20260709 13:11:13.291458 28949 raft_consensus.cc:493] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:13.291810 28949 raft_consensus.cc:3060] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:13.296113 28949 raft_consensus.cc:515] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:13.298327 28949 leader_election.cc:290] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c [CANDIDATE]: Term 4 election: Requested vote from peers 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909), cc7720d1626a4ef88af4b3319ba703da (127.27.146.131:34903)
I20260709 13:11:13.299238 28874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d98145f080424a68b9868bae7ba47a5a" candidate_uuid: "f240b20bb4d549f1abfde7991d89ff4c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9c79e0ceee6c4fe9ab2850342122b291"
I20260709 13:11:13.299238 29023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d98145f080424a68b9868bae7ba47a5a" candidate_uuid: "f240b20bb4d549f1abfde7991d89ff4c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "cc7720d1626a4ef88af4b3319ba703da"
I20260709 13:11:13.300038 28874 raft_consensus.cc:3055] T d98145f080424a68b9868bae7ba47a5a P 9c79e0ceee6c4fe9ab2850342122b291 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:13.300498 28874 raft_consensus.cc:740] T d98145f080424a68b9868bae7ba47a5a P 9c79e0ceee6c4fe9ab2850342122b291 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9c79e0ceee6c4fe9ab2850342122b291, State: Running, Role: LEADER
I20260709 13:11:13.300576 29023 raft_consensus.cc:3060] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:13.301402 28874 consensus_queue.cc:260] T d98145f080424a68b9868bae7ba47a5a P 9c79e0ceee6c4fe9ab2850342122b291 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:13.302812 28874 raft_consensus.cc:3060] T d98145f080424a68b9868bae7ba47a5a P 9c79e0ceee6c4fe9ab2850342122b291 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:13.308990 29023 raft_consensus.cc:2468] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f240b20bb4d549f1abfde7991d89ff4c in term 4.
I20260709 13:11:13.310676 28914 leader_election.cc:304] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc7720d1626a4ef88af4b3319ba703da, f240b20bb4d549f1abfde7991d89ff4c; no voters: 
I20260709 13:11:13.311000 28874 raft_consensus.cc:2468] T d98145f080424a68b9868bae7ba47a5a P 9c79e0ceee6c4fe9ab2850342122b291 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f240b20bb4d549f1abfde7991d89ff4c in term 4.
I20260709 13:11:13.311697 29159 raft_consensus.cc:2804] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:13.312309 29159 raft_consensus.cc:697] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c [term 4 LEADER]: Becoming Leader. State: Replica: f240b20bb4d549f1abfde7991d89ff4c, State: Running, Role: LEADER
I20260709 13:11:13.313241 29159 consensus_queue.cc:237] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } }
I20260709 13:11:13.320160 28770 catalog_manager.cc:5697] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c reported cstate change: term changed from 3 to 4, leader changed from 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129) to f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130). New cstate: current_term: 4 leader_uuid: "f240b20bb4d549f1abfde7991d89ff4c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:13.505265 28949 raft_consensus.cc:1275] T e457a1d9027b4083bb5f457451a06215 P f240b20bb4d549f1abfde7991d89ff4c [term 2 FOLLOWER]: Refusing update from remote peer cc7720d1626a4ef88af4b3319ba703da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:13.506878 29208 consensus_queue.cc:1048] T e457a1d9027b4083bb5f457451a06215 P cc7720d1626a4ef88af4b3319ba703da [LEADER]: Connected to new peer: Peer: permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:13.525791 28874 raft_consensus.cc:1275] T e457a1d9027b4083bb5f457451a06215 P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 FOLLOWER]: Refusing update from remote peer cc7720d1626a4ef88af4b3319ba703da: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:13.531558 29208 consensus_queue.cc:1048] T e457a1d9027b4083bb5f457451a06215 P cc7720d1626a4ef88af4b3319ba703da [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:13.655310 28947 raft_consensus.cc:1275] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c [term 4 FOLLOWER]: Refusing update from remote peer cc7720d1626a4ef88af4b3319ba703da: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:13.657210 29208 consensus_queue.cc:1048] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da [LEADER]: Connected to new peer: Peer: permanent_uuid: "f240b20bb4d549f1abfde7991d89ff4c" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:13.668277 28874 raft_consensus.cc:1275] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [term 4 FOLLOWER]: Refusing update from remote peer cc7720d1626a4ef88af4b3319ba703da: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:13.669910 29241 consensus_queue.cc:1048] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:13.696622 29023 raft_consensus.cc:1275] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da [term 4 FOLLOWER]: Refusing update from remote peer f240b20bb4d549f1abfde7991d89ff4c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:13.698032 29159 consensus_queue.cc:1048] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:13.710170 28874 raft_consensus.cc:1275] T d98145f080424a68b9868bae7ba47a5a P 9c79e0ceee6c4fe9ab2850342122b291 [term 4 FOLLOWER]: Refusing update from remote peer f240b20bb4d549f1abfde7991d89ff4c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:13.711853 29248 consensus_queue.cc:1048] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:13.805545 28874 raft_consensus.cc:1275] T 2185b9a3133c45849577db9fd53cc3da P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 FOLLOWER]: Refusing update from remote peer f240b20bb4d549f1abfde7991d89ff4c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:13.807276 29248 consensus_queue.cc:1048] T 2185b9a3133c45849577db9fd53cc3da P f240b20bb4d549f1abfde7991d89ff4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c79e0ceee6c4fe9ab2850342122b291" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 45909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:13.818775 29023 raft_consensus.cc:1275] T 2185b9a3133c45849577db9fd53cc3da P cc7720d1626a4ef88af4b3319ba703da [term 2 FOLLOWER]: Refusing update from remote peer f240b20bb4d549f1abfde7991d89ff4c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:13.820488 29159 consensus_queue.cc:1048] T 2185b9a3133c45849577db9fd53cc3da P f240b20bb4d549f1abfde7991d89ff4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc7720d1626a4ef88af4b3319ba703da" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:13.908192 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:13.915441 28234 tablet_server.cc:179] TabletServer@127.27.146.129:0 shutting down...
I20260709 13:11:13.946167 28234 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:13.947299 28234 tablet_replica.cc:333] T 698707b1216545c19dd7d883dfba7ac4 P 9c79e0ceee6c4fe9ab2850342122b291: stopping tablet replica
I20260709 13:11:13.948567 28234 raft_consensus.cc:2243] T 698707b1216545c19dd7d883dfba7ac4 P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:13.949611 28234 raft_consensus.cc:2272] T 698707b1216545c19dd7d883dfba7ac4 P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:13.952777 28234 tablet_replica.cc:333] T bd7a00c612f44184878b8c93532bd49a P 9c79e0ceee6c4fe9ab2850342122b291: stopping tablet replica
I20260709 13:11:13.953601 28234 raft_consensus.cc:2243] T bd7a00c612f44184878b8c93532bd49a P 9c79e0ceee6c4fe9ab2850342122b291 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:13.954277 28234 raft_consensus.cc:2272] T bd7a00c612f44184878b8c93532bd49a P 9c79e0ceee6c4fe9ab2850342122b291 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:13.957022 28234 tablet_replica.cc:333] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291: stopping tablet replica
I20260709 13:11:13.957747 28234 raft_consensus.cc:2243] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:11:13.958691 28234 raft_consensus.cc:2272] T 0dbb162930114b59bfb5e51c599feb0b P 9c79e0ceee6c4fe9ab2850342122b291 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:13.960866 28234 tablet_replica.cc:333] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291: stopping tablet replica
I20260709 13:11:13.961457 28234 raft_consensus.cc:2243] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:13.961896 28234 raft_consensus.cc:2272] T fc3a7e97dac54e96a71f171e9c7782c5 P 9c79e0ceee6c4fe9ab2850342122b291 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:13.964560 28234 tablet_replica.cc:333] T 2185b9a3133c45849577db9fd53cc3da P 9c79e0ceee6c4fe9ab2850342122b291: stopping tablet replica
I20260709 13:11:13.965220 28234 raft_consensus.cc:2243] T 2185b9a3133c45849577db9fd53cc3da P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:13.965718 28234 raft_consensus.cc:2272] T 2185b9a3133c45849577db9fd53cc3da P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:13.968070 28234 tablet_replica.cc:333] T f14fb4bd1ed04f3794d9445e51d8c620 P 9c79e0ceee6c4fe9ab2850342122b291: stopping tablet replica
I20260709 13:11:13.968812 28234 raft_consensus.cc:2243] T f14fb4bd1ed04f3794d9445e51d8c620 P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:13.969337 28234 raft_consensus.cc:2272] T f14fb4bd1ed04f3794d9445e51d8c620 P 9c79e0ceee6c4fe9ab2850342122b291 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:13.971387 28234 tablet_replica.cc:333] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291: stopping tablet replica
I20260709 13:11:13.971982 28234 raft_consensus.cc:2243] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:11:13.972752 28234 raft_consensus.cc:2272] T 5a9e932a762b44efa39af0a81206bf4e P 9c79e0ceee6c4fe9ab2850342122b291 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:13.974653 28234 tablet_replica.cc:333] T d98145f080424a68b9868bae7ba47a5a P 9c79e0ceee6c4fe9ab2850342122b291: stopping tablet replica
I20260709 13:11:13.975113 28234 raft_consensus.cc:2243] T d98145f080424a68b9868bae7ba47a5a P 9c79e0ceee6c4fe9ab2850342122b291 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:13.975639 28234 raft_consensus.cc:2272] T d98145f080424a68b9868bae7ba47a5a P 9c79e0ceee6c4fe9ab2850342122b291 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:13.977926 28234 tablet_replica.cc:333] T e457a1d9027b4083bb5f457451a06215 P 9c79e0ceee6c4fe9ab2850342122b291: stopping tablet replica
I20260709 13:11:13.978451 28234 raft_consensus.cc:2243] T e457a1d9027b4083bb5f457451a06215 P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:13.978874 28234 raft_consensus.cc:2272] T e457a1d9027b4083bb5f457451a06215 P 9c79e0ceee6c4fe9ab2850342122b291 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:13.981299 28234 tablet_replica.cc:333] T 3932435a38f74cc59388d2b95bf0c1c9 P 9c79e0ceee6c4fe9ab2850342122b291: stopping tablet replica
I20260709 13:11:13.981894 28234 raft_consensus.cc:2243] T 3932435a38f74cc59388d2b95bf0c1c9 P 9c79e0ceee6c4fe9ab2850342122b291 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:13.982766 28234 raft_consensus.cc:2272] T 3932435a38f74cc59388d2b95bf0c1c9 P 9c79e0ceee6c4fe9ab2850342122b291 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:14.006635 28234 tablet_server.cc:196] TabletServer@127.27.146.129:0 shutdown complete.
I20260709 13:11:14.032877 28234 tablet_server.cc:179] TabletServer@127.27.146.130:0 shutting down...
W20260709 13:11:14.050113 28986 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.146.129:45909: connect: Connection refused (error 111) [suppressed 5 similar messages]
W20260709 13:11:14.055346 28986 consensus_peers.cc:597] T f14fb4bd1ed04f3794d9445e51d8c620 P cc7720d1626a4ef88af4b3319ba703da -> Peer 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909): Couldn't send request to peer 9c79e0ceee6c4fe9ab2850342122b291. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:45909: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:14.062988 28986 consensus_peers.cc:597] T f14fb4bd1ed04f3794d9445e51d8c620 P cc7720d1626a4ef88af4b3319ba703da -> Peer f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889): Couldn't send request to peer f240b20bb4d549f1abfde7991d89ff4c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:14.081681 28234 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:14.082733 28234 tablet_replica.cc:333] T 3932435a38f74cc59388d2b95bf0c1c9 P f240b20bb4d549f1abfde7991d89ff4c: stopping tablet replica
I20260709 13:11:14.083580 28234 raft_consensus.cc:2243] T 3932435a38f74cc59388d2b95bf0c1c9 P f240b20bb4d549f1abfde7991d89ff4c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:14.084115 28234 raft_consensus.cc:2272] T 3932435a38f74cc59388d2b95bf0c1c9 P f240b20bb4d549f1abfde7991d89ff4c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:14.086153 28234 tablet_replica.cc:333] T 2185b9a3133c45849577db9fd53cc3da P f240b20bb4d549f1abfde7991d89ff4c: stopping tablet replica
I20260709 13:11:14.086776 28234 raft_consensus.cc:2243] T 2185b9a3133c45849577db9fd53cc3da P f240b20bb4d549f1abfde7991d89ff4c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:14.087778 28234 raft_consensus.cc:2272] T 2185b9a3133c45849577db9fd53cc3da P f240b20bb4d549f1abfde7991d89ff4c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:14.090667 28234 tablet_replica.cc:333] T 698707b1216545c19dd7d883dfba7ac4 P f240b20bb4d549f1abfde7991d89ff4c: stopping tablet replica
I20260709 13:11:14.091421 28234 raft_consensus.cc:2243] T 698707b1216545c19dd7d883dfba7ac4 P f240b20bb4d549f1abfde7991d89ff4c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:14.092065 28234 raft_consensus.cc:2272] T 698707b1216545c19dd7d883dfba7ac4 P f240b20bb4d549f1abfde7991d89ff4c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:14.094251 28234 tablet_replica.cc:333] T f14fb4bd1ed04f3794d9445e51d8c620 P f240b20bb4d549f1abfde7991d89ff4c: stopping tablet replica
I20260709 13:11:14.095093 28234 raft_consensus.cc:2243] T f14fb4bd1ed04f3794d9445e51d8c620 P f240b20bb4d549f1abfde7991d89ff4c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:14.095759 28234 raft_consensus.cc:2272] T f14fb4bd1ed04f3794d9445e51d8c620 P f240b20bb4d549f1abfde7991d89ff4c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:14.097795 28234 tablet_replica.cc:333] T e457a1d9027b4083bb5f457451a06215 P f240b20bb4d549f1abfde7991d89ff4c: stopping tablet replica
I20260709 13:11:14.098402 28234 raft_consensus.cc:2243] T e457a1d9027b4083bb5f457451a06215 P f240b20bb4d549f1abfde7991d89ff4c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:14.098857 28234 raft_consensus.cc:2272] T e457a1d9027b4083bb5f457451a06215 P f240b20bb4d549f1abfde7991d89ff4c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:14.102046 28234 tablet_replica.cc:333] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c: stopping tablet replica
I20260709 13:11:14.102721 28234 raft_consensus.cc:2243] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:14.103293 28234 raft_consensus.cc:2272] T 0dbb162930114b59bfb5e51c599feb0b P f240b20bb4d549f1abfde7991d89ff4c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:14.105826 28234 tablet_replica.cc:333] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c: stopping tablet replica
I20260709 13:11:14.106402 28234 raft_consensus.cc:2243] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:14.106858 28234 raft_consensus.cc:2272] T fc3a7e97dac54e96a71f171e9c7782c5 P f240b20bb4d549f1abfde7991d89ff4c [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:14.107590 28986 consensus_peers.cc:597] T e457a1d9027b4083bb5f457451a06215 P cc7720d1626a4ef88af4b3319ba703da -> Peer 9c79e0ceee6c4fe9ab2850342122b291 (127.27.146.129:45909): Couldn't send request to peer 9c79e0ceee6c4fe9ab2850342122b291. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:45909: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:14.109776 28234 tablet_replica.cc:333] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c: stopping tablet replica
I20260709 13:11:14.110376 28234 raft_consensus.cc:2243] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:14.111155 28234 raft_consensus.cc:2272] T bd7a00c612f44184878b8c93532bd49a P f240b20bb4d549f1abfde7991d89ff4c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:14.113199 28234 tablet_replica.cc:333] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c: stopping tablet replica
I20260709 13:11:14.113726 28234 raft_consensus.cc:2243] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:14.114185 28234 raft_consensus.cc:2272] T 5a9e932a762b44efa39af0a81206bf4e P f240b20bb4d549f1abfde7991d89ff4c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:14.116096 28234 tablet_replica.cc:333] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c: stopping tablet replica
I20260709 13:11:14.116905 28234 raft_consensus.cc:2243] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:11:14.118006 28234 raft_consensus.cc:2272] T d98145f080424a68b9868bae7ba47a5a P f240b20bb4d549f1abfde7991d89ff4c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:14.151243 28234 tablet_server.cc:196] TabletServer@127.27.146.130:0 shutdown complete.
W20260709 13:11:14.161067 28986 consensus_peers.cc:597] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da -> Peer f240b20bb4d549f1abfde7991d89ff4c (127.27.146.130:37889): Couldn't send request to peer f240b20bb4d549f1abfde7991d89ff4c. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:37889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:14.175179 28234 tablet_server.cc:179] TabletServer@127.27.146.131:0 shutting down...
I20260709 13:11:14.209400 28234 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:14.210135 28234 tablet_replica.cc:333] T 3932435a38f74cc59388d2b95bf0c1c9 P cc7720d1626a4ef88af4b3319ba703da: stopping tablet replica
I20260709 13:11:14.210807 28234 raft_consensus.cc:2243] T 3932435a38f74cc59388d2b95bf0c1c9 P cc7720d1626a4ef88af4b3319ba703da [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:14.211356 28234 raft_consensus.cc:2272] T 3932435a38f74cc59388d2b95bf0c1c9 P cc7720d1626a4ef88af4b3319ba703da [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:14.213487 28234 tablet_replica.cc:333] T 0dbb162930114b59bfb5e51c599feb0b P cc7720d1626a4ef88af4b3319ba703da: stopping tablet replica
I20260709 13:11:14.214071 28234 raft_consensus.cc:2243] T 0dbb162930114b59bfb5e51c599feb0b P cc7720d1626a4ef88af4b3319ba703da [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:14.214615 28234 raft_consensus.cc:2272] T 0dbb162930114b59bfb5e51c599feb0b P cc7720d1626a4ef88af4b3319ba703da [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:14.216789 28234 tablet_replica.cc:333] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da: stopping tablet replica
I20260709 13:11:14.217383 28234 raft_consensus.cc:2243] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:11:14.218222 28234 raft_consensus.cc:2272] T fc3a7e97dac54e96a71f171e9c7782c5 P cc7720d1626a4ef88af4b3319ba703da [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:14.220525 28234 tablet_replica.cc:333] T e457a1d9027b4083bb5f457451a06215 P cc7720d1626a4ef88af4b3319ba703da: stopping tablet replica
I20260709 13:11:14.221119 28234 raft_consensus.cc:2243] T e457a1d9027b4083bb5f457451a06215 P cc7720d1626a4ef88af4b3319ba703da [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:14.221948 28234 raft_consensus.cc:2272] T e457a1d9027b4083bb5f457451a06215 P cc7720d1626a4ef88af4b3319ba703da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:14.224661 28234 tablet_replica.cc:333] T f14fb4bd1ed04f3794d9445e51d8c620 P cc7720d1626a4ef88af4b3319ba703da: stopping tablet replica
I20260709 13:11:14.225273 28234 raft_consensus.cc:2243] T f14fb4bd1ed04f3794d9445e51d8c620 P cc7720d1626a4ef88af4b3319ba703da [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:14.226186 28234 raft_consensus.cc:2272] T f14fb4bd1ed04f3794d9445e51d8c620 P cc7720d1626a4ef88af4b3319ba703da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:14.228139 28234 tablet_replica.cc:333] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da: stopping tablet replica
I20260709 13:11:14.228893 28234 raft_consensus.cc:2243] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:14.229401 28234 raft_consensus.cc:2272] T bd7a00c612f44184878b8c93532bd49a P cc7720d1626a4ef88af4b3319ba703da [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:14.231346 28234 tablet_replica.cc:333] T 698707b1216545c19dd7d883dfba7ac4 P cc7720d1626a4ef88af4b3319ba703da: stopping tablet replica
I20260709 13:11:14.231989 28234 raft_consensus.cc:2243] T 698707b1216545c19dd7d883dfba7ac4 P cc7720d1626a4ef88af4b3319ba703da [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:14.232478 28234 raft_consensus.cc:2272] T 698707b1216545c19dd7d883dfba7ac4 P cc7720d1626a4ef88af4b3319ba703da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:14.234603 28234 tablet_replica.cc:333] T 5a9e932a762b44efa39af0a81206bf4e P cc7720d1626a4ef88af4b3319ba703da: stopping tablet replica
I20260709 13:11:14.235153 28234 raft_consensus.cc:2243] T 5a9e932a762b44efa39af0a81206bf4e P cc7720d1626a4ef88af4b3319ba703da [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:14.235666 28234 raft_consensus.cc:2272] T 5a9e932a762b44efa39af0a81206bf4e P cc7720d1626a4ef88af4b3319ba703da [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:14.237525 28234 tablet_replica.cc:333] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da: stopping tablet replica
I20260709 13:11:14.238045 28234 raft_consensus.cc:2243] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:14.238520 28234 raft_consensus.cc:2272] T d98145f080424a68b9868bae7ba47a5a P cc7720d1626a4ef88af4b3319ba703da [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:14.241034 28234 tablet_replica.cc:333] T 2185b9a3133c45849577db9fd53cc3da P cc7720d1626a4ef88af4b3319ba703da: stopping tablet replica
I20260709 13:11:14.241533 28234 raft_consensus.cc:2243] T 2185b9a3133c45849577db9fd53cc3da P cc7720d1626a4ef88af4b3319ba703da [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:14.241971 28234 raft_consensus.cc:2272] T 2185b9a3133c45849577db9fd53cc3da P cc7720d1626a4ef88af4b3319ba703da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:14.272325 28234 tablet_server.cc:196] TabletServer@127.27.146.131:0 shutdown complete.
I20260709 13:11:14.298615 28234 master.cc:562] Master@127.27.146.190:43467 shutting down...
I20260709 13:11:14.333946 28234 raft_consensus.cc:2243] T 00000000000000000000000000000000 P dc19e5facfda45d7a754de977e1f0daf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:14.334628 28234 raft_consensus.cc:2272] T 00000000000000000000000000000000 P dc19e5facfda45d7a754de977e1f0daf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:14.334990 28234 tablet_replica.cc:333] T 00000000000000000000000000000000 P dc19e5facfda45d7a754de977e1f0daf: stopping tablet replica
I20260709 13:11:14.356777 28234 master.cc:584] Master@127.27.146.190:43467 shutdown complete.
9c79e0ceee6c4fe9ab2850342122b291  5
cc7720d1626a4ef88af4b3319ba703da  1
f240b20bb4d549f1abfde7991d89ff4c  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (12184 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:11:14.405810 28234 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.27.146.190:37499
I20260709 13:11:14.407455 28234 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:14.414507 29254 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:14.414842 29255 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:14.415987 29257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:14.416299 28234 server_base.cc:1061] running on GCE node
I20260709 13:11:14.417380 28234 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:14.417582 28234 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:14.417802 28234 hybrid_clock.cc:648] HybridClock initialized: now 1783602674417765 us; error 0 us; skew 500 ppm
I20260709 13:11:14.418448 28234 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:14.421947 28234 webserver.cc:533] Webserver started at http://127.27.146.190:39775/ using document root <none> and password file <none>
I20260709 13:11:14.422523 28234 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:14.422715 28234 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:14.423049 28234 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:14.424568 28234 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/master-0-root/instance:
uuid: "4fe079bd41744b15a21e1f8c8d83890b"
format_stamp: "Formatted at 2026-07-09 13:11:14 on dist-test-slave-clfv"
I20260709 13:11:14.429538 28234 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:11:14.433370 29262 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:14.434340 28234 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:11:14.434607 28234 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/master-0-root
uuid: "4fe079bd41744b15a21e1f8c8d83890b"
format_stamp: "Formatted at 2026-07-09 13:11:14 on dist-test-slave-clfv"
I20260709 13:11:14.434861 28234 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:14.447113 28234 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:14.449019 28234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:14.498420 28234 rpc_server.cc:307] RPC server started. Bound to: 127.27.146.190:37499
I20260709 13:11:14.498559 29313 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.146.190:37499 every 8 connection(s)
I20260709 13:11:14.503813 29314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:14.516882 29314 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b: Bootstrap starting.
I20260709 13:11:14.522954 29314 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:14.528661 29314 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b: No bootstrap required, opened a new log
I20260709 13:11:14.531338 29314 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe079bd41744b15a21e1f8c8d83890b" member_type: VOTER }
I20260709 13:11:14.532272 29314 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:14.532522 29314 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fe079bd41744b15a21e1f8c8d83890b, State: Initialized, Role: FOLLOWER
I20260709 13:11:14.533216 29314 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe079bd41744b15a21e1f8c8d83890b" member_type: VOTER }
I20260709 13:11:14.533736 29314 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:11:14.533955 29314 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:11:14.534482 29314 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:14.541301 29314 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe079bd41744b15a21e1f8c8d83890b" member_type: VOTER }
I20260709 13:11:14.542135 29314 leader_election.cc:304] T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4fe079bd41744b15a21e1f8c8d83890b; no voters: 
I20260709 13:11:14.543965 29314 leader_election.cc:290] T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:11:14.544492 29317 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:14.546037 29317 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b [term 1 LEADER]: Becoming Leader. State: Replica: 4fe079bd41744b15a21e1f8c8d83890b, State: Running, Role: LEADER
I20260709 13:11:14.546828 29317 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe079bd41744b15a21e1f8c8d83890b" member_type: VOTER }
I20260709 13:11:14.547884 29314 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:11:14.552030 29319 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4fe079bd41744b15a21e1f8c8d83890b. Latest consensus state: current_term: 1 leader_uuid: "4fe079bd41744b15a21e1f8c8d83890b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe079bd41744b15a21e1f8c8d83890b" member_type: VOTER } }
I20260709 13:11:14.553251 29319 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:14.553275 29318 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4fe079bd41744b15a21e1f8c8d83890b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fe079bd41744b15a21e1f8c8d83890b" member_type: VOTER } }
I20260709 13:11:14.554436 29318 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:14.558671 29324 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:11:14.568583 29324 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:11:14.569839 28234 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:11:14.580206 29324 catalog_manager.cc:1383] Generated new cluster ID: a8ddec3a995e40eb9d7232160d86ed89
I20260709 13:11:14.580580 29324 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:11:14.609508 29324 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:11:14.611476 29324 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:11:14.630932 29324 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b: Generated new TSK 0
I20260709 13:11:14.631947 29324 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:11:14.637661 28234 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:14.644868 29335 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:14.646020 29336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:14.648196 29338 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:14.649307 28234 server_base.cc:1061] running on GCE node
I20260709 13:11:14.650414 28234 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:14.650681 28234 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:14.650830 28234 hybrid_clock.cc:648] HybridClock initialized: now 1783602674650815 us; error 0 us; skew 500 ppm
I20260709 13:11:14.651412 28234 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:14.654395 28234 webserver.cc:533] Webserver started at http://127.27.146.129:41391/ using document root <none> and password file <none>
I20260709 13:11:14.654906 28234 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:14.655074 28234 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:14.655294 28234 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:14.656621 28234 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/ts-0-root/instance:
uuid: "429e58eb058349e3bf72b5a870c8f6e5"
format_stamp: "Formatted at 2026-07-09 13:11:14 on dist-test-slave-clfv"
I20260709 13:11:14.662024 28234 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:11:14.666316 29343 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:14.667309 28234 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:11:14.667706 28234 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/ts-0-root
uuid: "429e58eb058349e3bf72b5a870c8f6e5"
format_stamp: "Formatted at 2026-07-09 13:11:14 on dist-test-slave-clfv"
I20260709 13:11:14.668071 28234 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:14.683586 28234 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:14.685379 28234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:14.687254 28234 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:14.690383 28234 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:14.690680 28234 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:14.690994 28234 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:14.691198 28234 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:14.753153 28234 rpc_server.cc:307] RPC server started. Bound to: 127.27.146.129:42127
I20260709 13:11:14.753302 29405 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.146.129:42127 every 8 connection(s)
I20260709 13:11:14.760528 28234 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:14.769232 29410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:14.770308 29411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:14.780562 28234 server_base.cc:1061] running on GCE node
W20260709 13:11:14.781623 29413 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:14.782570 29406 heartbeater.cc:344] Connected to a master server at 127.27.146.190:37499
I20260709 13:11:14.782945 28234 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:11:14.783066 29406 heartbeater.cc:461] Registering TS with master...
W20260709 13:11:14.783239 28234 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:14.783458 28234 hybrid_clock.cc:648] HybridClock initialized: now 1783602674783437 us; error 0 us; skew 500 ppm
I20260709 13:11:14.784124 29406 heartbeater.cc:507] Master 127.27.146.190:37499 requested a full tablet report, sending...
I20260709 13:11:14.784353 28234 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:14.787403 29279 ts_manager.cc:194] Registered new tserver with Master: 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127)
I20260709 13:11:14.787829 28234 webserver.cc:533] Webserver started at http://127.27.146.130:33343/ using document root <none> and password file <none>
I20260709 13:11:14.788815 28234 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:14.789039 28234 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:14.789386 28234 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:14.790081 29279 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37586
I20260709 13:11:14.791996 28234 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/ts-1-root/instance:
uuid: "183db85c071f489fbc8de63a9edd8a3a"
format_stamp: "Formatted at 2026-07-09 13:11:14 on dist-test-slave-clfv"
I20260709 13:11:14.798190 28234 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:11:14.802932 29418 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:14.804221 28234 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 13:11:14.804708 28234 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/ts-1-root
uuid: "183db85c071f489fbc8de63a9edd8a3a"
format_stamp: "Formatted at 2026-07-09 13:11:14 on dist-test-slave-clfv"
I20260709 13:11:14.805308 28234 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:14.831370 28234 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:14.832975 28234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:14.834728 28234 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:14.837407 28234 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:14.837652 28234 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:14.837924 28234 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:14.838107 28234 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:14.893301 28234 rpc_server.cc:307] RPC server started. Bound to: 127.27.146.130:40551
I20260709 13:11:14.893304 29480 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.146.130:40551 every 8 connection(s)
I20260709 13:11:14.899127 28234 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:14.909041 29485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:14.909423 29484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:14.910490 29487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:14.913247 28234 server_base.cc:1061] running on GCE node
I20260709 13:11:14.914851 28234 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:14.915288 28234 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:14.915560 28234 hybrid_clock.cc:648] HybridClock initialized: now 1783602674915539 us; error 0 us; skew 500 ppm
I20260709 13:11:14.916544 28234 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:14.916911 29481 heartbeater.cc:344] Connected to a master server at 127.27.146.190:37499
I20260709 13:11:14.917408 29481 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:14.918237 29481 heartbeater.cc:507] Master 127.27.146.190:37499 requested a full tablet report, sending...
I20260709 13:11:14.920137 28234 webserver.cc:533] Webserver started at http://127.27.146.131:33067/ using document root <none> and password file <none>
I20260709 13:11:14.920750 28234 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:14.920982 28234 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:14.921293 28234 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:14.921360 29279 ts_manager.cc:194] Registered new tserver with Master: 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:14.922796 28234 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/ts-2-root/instance:
uuid: "71aa3578fd924765ab9ac0729c8d1483"
format_stamp: "Formatted at 2026-07-09 13:11:14 on dist-test-slave-clfv"
I20260709 13:11:14.923342 29279 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37594
I20260709 13:11:14.930015 28234 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.002s
I20260709 13:11:14.936311 29492 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:14.937489 28234 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:11:14.937876 28234 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/ts-2-root
uuid: "71aa3578fd924765ab9ac0729c8d1483"
format_stamp: "Formatted at 2026-07-09 13:11:14 on dist-test-slave-clfv"
I20260709 13:11:14.938228 28234 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:14.961436 28234 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:14.962908 28234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:14.964727 28234 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:14.967262 28234 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:14.967537 28234 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:11:14.967815 28234 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:14.968007 28234 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:15.025915 28234 rpc_server.cc:307] RPC server started. Bound to: 127.27.146.131:35367
I20260709 13:11:15.026074 29554 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.146.131:35367 every 8 connection(s)
I20260709 13:11:15.042973 29555 heartbeater.cc:344] Connected to a master server at 127.27.146.190:37499
I20260709 13:11:15.043545 29555 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:15.044486 29555 heartbeater.cc:507] Master 127.27.146.190:37499 requested a full tablet report, sending...
I20260709 13:11:15.046981 29279 ts_manager.cc:194] Registered new tserver with Master: 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:15.047480 28234 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01791808s
I20260709 13:11:15.048616 29279 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37608
I20260709 13:11:15.079766 29279 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37618:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:11:15.086519 29279 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:11:15.308952 29446 tablet_service.cc:1511] Processing CreateTablet for tablet 77157470a53245d7b1b307fba4d73aad (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:11:15.309917 29445 tablet_service.cc:1511] Processing CreateTablet for tablet c7f35dbd870d4883ac2ca7cf62f3cd06 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:11:15.311218 29446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77157470a53245d7b1b307fba4d73aad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.311997 29445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7f35dbd870d4883ac2ca7cf62f3cd06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.319579 29444 tablet_service.cc:1511] Processing CreateTablet for tablet f0059c790a85426c96a8b0fe40c16532 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:11:15.321432 29444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0059c790a85426c96a8b0fe40c16532. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.325263 29371 tablet_service.cc:1511] Processing CreateTablet for tablet 77157470a53245d7b1b307fba4d73aad (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:11:15.326984 29371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77157470a53245d7b1b307fba4d73aad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.339152 29370 tablet_service.cc:1511] Processing CreateTablet for tablet c7f35dbd870d4883ac2ca7cf62f3cd06 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:11:15.341051 29370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7f35dbd870d4883ac2ca7cf62f3cd06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.351485 29570 tablet_bootstrap.cc:492] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:15.352792 29369 tablet_service.cc:1511] Processing CreateTablet for tablet f0059c790a85426c96a8b0fe40c16532 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:11:15.354518 29369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0059c790a85426c96a8b0fe40c16532. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.362216 29570 tablet_bootstrap.cc:654] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:15.365676 29368 tablet_service.cc:1511] Processing CreateTablet for tablet ae9322ad5c2448f5bbe70c893b323d98 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:11:15.367852 29368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae9322ad5c2448f5bbe70c893b323d98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.368463 29520 tablet_service.cc:1511] Processing CreateTablet for tablet 77157470a53245d7b1b307fba4d73aad (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:11:15.369944 29520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77157470a53245d7b1b307fba4d73aad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.380592 29446 tablet_service.cc:1511] Processing CreateTablet for tablet ae9322ad5c2448f5bbe70c893b323d98 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:11:15.382375 29446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae9322ad5c2448f5bbe70c893b323d98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.386008 29445 tablet_service.cc:1511] Processing CreateTablet for tablet 40c0d06e6f284af29109e961ff953c5f (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:11:15.387616 29445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40c0d06e6f284af29109e961ff953c5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.387111 29367 tablet_service.cc:1511] Processing CreateTablet for tablet 40c0d06e6f284af29109e961ff953c5f (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:11:15.390031 29367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40c0d06e6f284af29109e961ff953c5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.398147 29366 tablet_service.cc:1511] Processing CreateTablet for tablet 9890585c37da4d4fb7b4a3bfa21d48d7 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:11:15.400336 29443 tablet_service.cc:1511] Processing CreateTablet for tablet dc82f5f689ca4adaa719b36a68dc3531 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:11:15.400766 29442 tablet_service.cc:1511] Processing CreateTablet for tablet 6847a37cf6234a13a2fb53ac3cefaa64 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:11:15.402593 29443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc82f5f689ca4adaa719b36a68dc3531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.398005 29444 tablet_service.cc:1511] Processing CreateTablet for tablet 9890585c37da4d4fb7b4a3bfa21d48d7 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:11:15.404071 29441 tablet_service.cc:1511] Processing CreateTablet for tablet 26f8335857fe499492a3115b9258c1a4 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:11:15.404706 29444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9890585c37da4d4fb7b4a3bfa21d48d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.405846 29441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26f8335857fe499492a3115b9258c1a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.408505 29440 tablet_service.cc:1511] Processing CreateTablet for tablet ee77cbd588da45af9d5274a642fd28a5 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:11:15.410117 29440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee77cbd588da45af9d5274a642fd28a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.410419 29438 tablet_service.cc:1511] Processing CreateTablet for tablet 86d17089efa841fb8a1c4bfae4950ef6 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:11:15.412989 29439 tablet_service.cc:1511] Processing CreateTablet for tablet f5f9acbb73364212a42eaa5004f5aba9 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:11:15.414214 29437 tablet_service.cc:1511] Processing CreateTablet for tablet 5a13b0d97aec4ead9f25e62f8dcb36cf (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:11:15.416298 29366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9890585c37da4d4fb7b4a3bfa21d48d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.416301 29438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86d17089efa841fb8a1c4bfae4950ef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.421283 29519 tablet_service.cc:1511] Processing CreateTablet for tablet c7f35dbd870d4883ac2ca7cf62f3cd06 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:11:15.423223 29519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7f35dbd870d4883ac2ca7cf62f3cd06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.424414 29365 tablet_service.cc:1511] Processing CreateTablet for tablet dc82f5f689ca4adaa719b36a68dc3531 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:11:15.425480 29518 tablet_service.cc:1511] Processing CreateTablet for tablet f0059c790a85426c96a8b0fe40c16532 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:11:15.426954 29518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0059c790a85426c96a8b0fe40c16532. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.427728 29364 tablet_service.cc:1511] Processing CreateTablet for tablet 6847a37cf6234a13a2fb53ac3cefaa64 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:11:15.427976 29512 tablet_service.cc:1511] Processing CreateTablet for tablet 26f8335857fe499492a3115b9258c1a4 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:11:15.428898 29517 tablet_service.cc:1511] Processing CreateTablet for tablet ae9322ad5c2448f5bbe70c893b323d98 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:11:15.429487 29512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26f8335857fe499492a3115b9258c1a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.430339 29517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae9322ad5c2448f5bbe70c893b323d98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.430739 29363 tablet_service.cc:1511] Processing CreateTablet for tablet 26f8335857fe499492a3115b9258c1a4 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:11:15.432412 29516 tablet_service.cc:1511] Processing CreateTablet for tablet 40c0d06e6f284af29109e961ff953c5f (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:11:15.433918 29516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40c0d06e6f284af29109e961ff953c5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.436949 29515 tablet_service.cc:1511] Processing CreateTablet for tablet 9890585c37da4d4fb7b4a3bfa21d48d7 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:11:15.438642 29515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9890585c37da4d4fb7b4a3bfa21d48d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.441140 29362 tablet_service.cc:1511] Processing CreateTablet for tablet ee77cbd588da45af9d5274a642fd28a5 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:11:15.441170 29514 tablet_service.cc:1511] Processing CreateTablet for tablet dc82f5f689ca4adaa719b36a68dc3531 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:11:15.442662 29513 tablet_service.cc:1511] Processing CreateTablet for tablet 6847a37cf6234a13a2fb53ac3cefaa64 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:11:15.443922 29437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a13b0d97aec4ead9f25e62f8dcb36cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.444001 29514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc82f5f689ca4adaa719b36a68dc3531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.444919 29511 tablet_service.cc:1511] Processing CreateTablet for tablet ee77cbd588da45af9d5274a642fd28a5 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:11:15.446496 29511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee77cbd588da45af9d5274a642fd28a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.447889 29439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5f9acbb73364212a42eaa5004f5aba9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.425930 29365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc82f5f689ca4adaa719b36a68dc3531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.449122 29442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6847a37cf6234a13a2fb53ac3cefaa64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.464095 29364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6847a37cf6234a13a2fb53ac3cefaa64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.466815 29363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26f8335857fe499492a3115b9258c1a4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:11:15.470288 29265 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 46026.3us
I20260709 13:11:15.475980 29513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6847a37cf6234a13a2fb53ac3cefaa64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.479208 29371 tablet_service.cc:1511] Processing CreateTablet for tablet f5f9acbb73364212a42eaa5004f5aba9 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:11:15.479947 29362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee77cbd588da45af9d5274a642fd28a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.494567 29371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5f9acbb73364212a42eaa5004f5aba9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.496753 29443 tablet_service.cc:1511] Processing CreateTablet for tablet 66ee3283bb6d4ef28061d053b1bde164 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:11:15.506597 29443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66ee3283bb6d4ef28061d053b1bde164. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.548724 29572 tablet_bootstrap.cc:492] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:15.561934 29511 tablet_service.cc:1511] Processing CreateTablet for tablet 86d17089efa841fb8a1c4bfae4950ef6 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:11:15.490329 29445 tablet_service.cc:1511] Processing CreateTablet for tablet b0e9dda7e26f4762beef2df7e4b8b8b2 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:11:15.563640 29570 tablet_bootstrap.cc:492] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:15.564170 29570 ts_tablet_manager.cc:1403] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.213s	user 0.015s	sys 0.042s
I20260709 13:11:15.563845 29370 tablet_service.cc:1511] Processing CreateTablet for tablet 5a13b0d97aec4ead9f25e62f8dcb36cf (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:11:15.565613 29370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a13b0d97aec4ead9f25e62f8dcb36cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.567651 29369 tablet_service.cc:1511] Processing CreateTablet for tablet 86d17089efa841fb8a1c4bfae4950ef6 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:11:15.569954 29369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86d17089efa841fb8a1c4bfae4950ef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.570062 29445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0e9dda7e26f4762beef2df7e4b8b8b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.572772 29517 tablet_service.cc:1511] Processing CreateTablet for tablet 5a13b0d97aec4ead9f25e62f8dcb36cf (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:11:15.574640 29519 tablet_service.cc:1511] Processing CreateTablet for tablet f5f9acbb73364212a42eaa5004f5aba9 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:11:15.576589 29570 raft_consensus.cc:359] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:15.577078 29327 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:15.577420 29570 raft_consensus.cc:385] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:15.577708 29570 raft_consensus.cc:740] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:15.578483 29570 consensus_queue.cc:260] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:15.597118 29437 tablet_service.cc:1511] Processing CreateTablet for tablet eea24afe5d794a069e28297bbb74cf5a (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:11:15.598059 29570 ts_tablet_manager.cc:1434] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:11:15.600117 29481 heartbeater.cc:499] Master 127.27.146.190:37499 was elected leader, sending a full tablet report...
I20260709 13:11:15.612112 29439 tablet_service.cc:1511] Processing CreateTablet for tablet abd2ad92265844ca9eb9012eb76e7789 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:11:15.616369 29518 tablet_service.cc:1511] Processing CreateTablet for tablet 66ee3283bb6d4ef28061d053b1bde164 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:11:15.613245 29573 tablet_bootstrap.cc:492] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:15.563411 29511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86d17089efa841fb8a1c4bfae4950ef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.621176 29442 tablet_service.cc:1511] Processing CreateTablet for tablet 4cced75430d1485689f4eff61c816af0 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:11:15.621990 29517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a13b0d97aec4ead9f25e62f8dcb36cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.599419 29437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eea24afe5d794a069e28297bbb74cf5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.613998 29444 tablet_service.cc:1511] Processing CreateTablet for tablet 93659d173b6a4dbe9938c612cc5f14e0 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:11:15.636582 29519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5f9acbb73364212a42eaa5004f5aba9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.624823 29570 tablet_bootstrap.cc:492] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:15.641021 29518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66ee3283bb6d4ef28061d053b1bde164. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.626623 29446 tablet_service.cc:1511] Processing CreateTablet for tablet f05e651bcfb64af6a9b5e97f9e40229f (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:11:15.627156 29520 tablet_service.cc:1511] Processing CreateTablet for tablet b0e9dda7e26f4762beef2df7e4b8b8b2 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:11:15.646636 29520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0e9dda7e26f4762beef2df7e4b8b8b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.632174 29516 tablet_service.cc:1511] Processing CreateTablet for tablet abd2ad92265844ca9eb9012eb76e7789 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:11:15.636767 29444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93659d173b6a4dbe9938c612cc5f14e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.661511 29570 tablet_bootstrap.cc:654] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:15.662619 29442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cced75430d1485689f4eff61c816af0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.623917 29365 tablet_service.cc:1511] Processing CreateTablet for tablet b0e9dda7e26f4762beef2df7e4b8b8b2 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:11:15.666040 29572 tablet_bootstrap.cc:654] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:15.666754 29365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0e9dda7e26f4762beef2df7e4b8b8b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.671687 29439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abd2ad92265844ca9eb9012eb76e7789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.672387 29368 tablet_service.cc:1511] Processing CreateTablet for tablet abd2ad92265844ca9eb9012eb76e7789 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:11:15.674299 29368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abd2ad92265844ca9eb9012eb76e7789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.664888 29511 tablet_service.cc:1511] Processing CreateTablet for tablet 4cced75430d1485689f4eff61c816af0 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:11:15.677213 29511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cced75430d1485689f4eff61c816af0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.679440 29367 tablet_service.cc:1511] Processing CreateTablet for tablet eea24afe5d794a069e28297bbb74cf5a (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:11:15.680444 29515 tablet_service.cc:1511] Processing CreateTablet for tablet eea24afe5d794a069e28297bbb74cf5a (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:11:15.681490 29367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eea24afe5d794a069e28297bbb74cf5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.682163 29515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eea24afe5d794a069e28297bbb74cf5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.684548 29516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abd2ad92265844ca9eb9012eb76e7789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.685127 29514 tablet_service.cc:1511] Processing CreateTablet for tablet 93659d173b6a4dbe9938c612cc5f14e0 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:11:15.686560 29514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93659d173b6a4dbe9938c612cc5f14e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.686691 29371 tablet_service.cc:1511] Processing CreateTablet for tablet 93659d173b6a4dbe9938c612cc5f14e0 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:11:15.690382 29371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93659d173b6a4dbe9938c612cc5f14e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.696058 29362 tablet_service.cc:1511] Processing CreateTablet for tablet 4cced75430d1485689f4eff61c816af0 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:11:15.697678 29362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cced75430d1485689f4eff61c816af0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.701933 29369 tablet_service.cc:1511] Processing CreateTablet for tablet f05e651bcfb64af6a9b5e97f9e40229f (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:11:15.702293 29366 tablet_service.cc:1511] Processing CreateTablet for tablet b5c4a6169e564566927a70e27f4af6f6 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:11:15.703438 29369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f05e651bcfb64af6a9b5e97f9e40229f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:11:15.705565 29263 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 91202.6us
I20260709 13:11:15.687637 29446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f05e651bcfb64af6a9b5e97f9e40229f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.706396 29363 tablet_service.cc:1511] Processing CreateTablet for tablet d7c3c09667374b9aa86861c27221f6d3 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
W20260709 13:11:15.687059 29265 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 75646.5us
I20260709 13:11:15.711524 29520 tablet_service.cc:1511] Processing CreateTablet for tablet f05e651bcfb64af6a9b5e97f9e40229f (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:11:15.713050 29520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f05e651bcfb64af6a9b5e97f9e40229f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.718470 29573 tablet_bootstrap.cc:654] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:15.724707 29512 tablet_service.cc:1511] Processing CreateTablet for tablet d7c3c09667374b9aa86861c27221f6d3 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:11:15.726249 29512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7c3c09667374b9aa86861c27221f6d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.732753 29443 tablet_service.cc:1511] Processing CreateTablet for tablet e66f47d21a0c4572ac5357c6cf623284 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:11:15.734468 29443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e66f47d21a0c4572ac5357c6cf623284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.750952 29440 tablet_service.cc:1511] Processing CreateTablet for tablet b5c4a6169e564566927a70e27f4af6f6 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:11:15.719287 29513 tablet_service.cc:1511] Processing CreateTablet for tablet b5c4a6169e564566927a70e27f4af6f6 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:11:15.758013 29570 tablet_bootstrap.cc:492] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:15.768121 29570 ts_tablet_manager.cc:1403] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.144s	user 0.009s	sys 0.008s
I20260709 13:11:15.768484 29513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5c4a6169e564566927a70e27f4af6f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.771456 29570 raft_consensus.cc:359] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:15.772284 29570 raft_consensus.cc:385] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:15.671072 29364 tablet_service.cc:1511] Processing CreateTablet for tablet 66ee3283bb6d4ef28061d053b1bde164 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:11:15.723062 29438 tablet_service.cc:1511] Processing CreateTablet for tablet d7c3c09667374b9aa86861c27221f6d3 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:11:15.745347 29366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5c4a6169e564566927a70e27f4af6f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.772605 29570 raft_consensus.cc:740] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:15.731272 29441 tablet_service.cc:1511] Processing CreateTablet for tablet f06f688759cd438a95541a7639513cec (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:11:15.795857 29406 heartbeater.cc:499] Master 127.27.146.190:37499 was elected leader, sending a full tablet report...
I20260709 13:11:15.799790 29363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7c3c09667374b9aa86861c27221f6d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.800331 29573 tablet_bootstrap.cc:492] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:15.800889 29573 ts_tablet_manager.cc:1403] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.188s	user 0.007s	sys 0.012s
I20260709 13:11:15.803906 29364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66ee3283bb6d4ef28061d053b1bde164. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.804548 29573 raft_consensus.cc:359] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:15.805365 29573 raft_consensus.cc:385] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:15.805681 29573 raft_consensus.cc:740] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:15.818149 29440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5c4a6169e564566927a70e27f4af6f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.806691 29573 consensus_queue.cc:260] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:15.811844 29570 consensus_queue.cc:260] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:15.845008 29570 ts_tablet_manager.cc:1434] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.076s	user 0.007s	sys 0.000s
I20260709 13:11:15.846119 29570 tablet_bootstrap.cc:492] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:15.845472 29519 tablet_service.cc:1511] Processing CreateTablet for tablet c2aced39aead4259aa7f2a9995ec3ea5 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:11:15.850283 29519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2aced39aead4259aa7f2a9995ec3ea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.850800 29445 tablet_service.cc:1511] Processing CreateTablet for tablet c2aced39aead4259aa7f2a9995ec3ea5 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:11:15.854712 29366 tablet_service.cc:1511] Processing CreateTablet for tablet e66f47d21a0c4572ac5357c6cf623284 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:11:15.856078 29366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e66f47d21a0c4572ac5357c6cf623284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.866552 29511 tablet_service.cc:1511] Processing CreateTablet for tablet e66f47d21a0c4572ac5357c6cf623284 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:11:15.868208 29511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e66f47d21a0c4572ac5357c6cf623284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.837759 29368 tablet_service.cc:1511] Processing CreateTablet for tablet f06f688759cd438a95541a7639513cec (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:11:15.871718 29368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f06f688759cd438a95541a7639513cec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.883292 29574 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.884151 29574 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:15.888144 29442 tablet_service.cc:1511] Processing CreateTablet for tablet f07124b3443042c0b07f5833ed54ce53 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:11:15.888144 29439 tablet_service.cc:1511] Processing CreateTablet for tablet f8f882eb054d4655a776901e6e22c617 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:11:15.817368 29520 tablet_service.cc:1511] Processing CreateTablet for tablet f06f688759cd438a95541a7639513cec (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:11:15.896149 29438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7c3c09667374b9aa86861c27221f6d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.899945 29574 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:15.923431 29572 tablet_bootstrap.cc:492] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:15.924154 29572 ts_tablet_manager.cc:1403] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.376s	user 0.020s	sys 0.023s
I20260709 13:11:15.927245 29572 raft_consensus.cc:359] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:15.928623 29572 raft_consensus.cc:385] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:15.929011 29572 raft_consensus.cc:740] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:15.929332 29365 tablet_service.cc:1511] Processing CreateTablet for tablet ab0baf9ea21a4fe78401601893e7ff66 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:11:15.930869 29365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab0baf9ea21a4fe78401601893e7ff66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.929872 29572 consensus_queue.cc:260] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:15.954614 29441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f06f688759cd438a95541a7639513cec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.963291 29578 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.957108 29520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f06f688759cd438a95541a7639513cec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.911023 29517 tablet_service.cc:1511] Processing CreateTablet for tablet f8f882eb054d4655a776901e6e22c617 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:11:15.977275 29369 tablet_service.cc:1511] Processing CreateTablet for tablet f8f882eb054d4655a776901e6e22c617 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:11:15.979043 29369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8f882eb054d4655a776901e6e22c617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.963779 29555 heartbeater.cc:499] Master 127.27.146.190:37499 was elected leader, sending a full tablet report...
I20260709 13:11:15.968317 29578 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:15.984205 29370 tablet_service.cc:1511] Processing CreateTablet for tablet c2aced39aead4259aa7f2a9995ec3ea5 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:11:15.985725 29370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2aced39aead4259aa7f2a9995ec3ea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:15.986382 29578 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127)
I20260709 13:11:15.995378 29445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2aced39aead4259aa7f2a9995ec3ea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.000046 29442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f07124b3443042c0b07f5833ed54ce53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.004097 29371 tablet_service.cc:1511] Processing CreateTablet for tablet 84bd3c1c6a8b4dd19afbdd78dae37427 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:11:16.005659 29371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84bd3c1c6a8b4dd19afbdd78dae37427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.004134 29439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8f882eb054d4655a776901e6e22c617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.010097 29517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8f882eb054d4655a776901e6e22c617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.024748 29364 tablet_service.cc:1511] Processing CreateTablet for tablet 8e9b44184de046118890bc6cd6e1dc18 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:11:16.026382 29364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e9b44184de046118890bc6cd6e1dc18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.035921 29572 ts_tablet_manager.cc:1434] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.111s	user 0.030s	sys 0.044s
I20260709 13:11:15.973326 29573 ts_tablet_manager.cc:1434] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.172s	user 0.012s	sys 0.021s
I20260709 13:11:16.053341 29574 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.053905 29574 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:16.060905 29574 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:16.050311 29572 tablet_bootstrap.cc:492] T 77157470a53245d7b1b307fba4d73aad P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:16.068951 29444 tablet_service.cc:1511] Processing CreateTablet for tablet 84bd3c1c6a8b4dd19afbdd78dae37427 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:11:16.070508 29444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84bd3c1c6a8b4dd19afbdd78dae37427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.044020 29362 tablet_service.cc:1511] Processing CreateTablet for tablet f07124b3443042c0b07f5833ed54ce53 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:11:16.096123 29573 tablet_bootstrap.cc:492] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:16.101824 29437 tablet_service.cc:1511] Processing CreateTablet for tablet 8e9b44184de046118890bc6cd6e1dc18 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:11:16.110255 29516 tablet_service.cc:1511] Processing CreateTablet for tablet 84bd3c1c6a8b4dd19afbdd78dae37427 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:11:16.107236 29439 tablet_service.cc:1511] Processing CreateTablet for tablet ab0baf9ea21a4fe78401601893e7ff66 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:11:16.123704 29371 tablet_service.cc:1511] Processing CreateTablet for tablet cbdb7b3723ea4c6ea492ee857ca224d6 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:11:16.123423 29443 tablet_service.cc:1511] Processing CreateTablet for tablet b3604a2976f84b96882e8983ba5b3fd7 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:11:16.140777 29362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f07124b3443042c0b07f5833ed54ce53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.103343 29437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e9b44184de046118890bc6cd6e1dc18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.152889 29371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbdb7b3723ea4c6ea492ee857ca224d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.134228 29511 tablet_service.cc:1511] Processing CreateTablet for tablet f07124b3443042c0b07f5833ed54ce53 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:11:16.136848 29446 tablet_service.cc:1511] Processing CreateTablet for tablet cbdb7b3723ea4c6ea492ee857ca224d6 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:11:16.147039 29570 tablet_bootstrap.cc:654] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:16.126024 29366 tablet_service.cc:1511] Processing CreateTablet for tablet b3604a2976f84b96882e8983ba5b3fd7 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:11:16.166826 29572 tablet_bootstrap.cc:654] T 77157470a53245d7b1b307fba4d73aad P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:16.166612 29363 tablet_service.cc:1511] Processing CreateTablet for tablet bf5703156380472bb793863fd4fd7544 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:11:16.165165 29366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3604a2976f84b96882e8983ba5b3fd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.177953 29439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab0baf9ea21a4fe78401601893e7ff66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.179126 29446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbdb7b3723ea4c6ea492ee857ca224d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.179790 29517 tablet_service.cc:1511] Processing CreateTablet for tablet cbdb7b3723ea4c6ea492ee857ca224d6 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:11:16.170779 29516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84bd3c1c6a8b4dd19afbdd78dae37427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.188203 29515 tablet_service.cc:1511] Processing CreateTablet for tablet ab0baf9ea21a4fe78401601893e7ff66 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:11:16.190737 29367 tablet_service.cc:1511] Processing CreateTablet for tablet 4962756209e1496ca6cb92e47ee866b3 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:11:16.192055 29443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3604a2976f84b96882e8983ba5b3fd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.192611 29520 tablet_service.cc:1511] Processing CreateTablet for tablet b3604a2976f84b96882e8983ba5b3fd7 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:11:16.203008 29363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf5703156380472bb793863fd4fd7544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.214031 29518 tablet_service.cc:1511] Processing CreateTablet for tablet bf5703156380472bb793863fd4fd7544 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:11:16.222155 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:16.224445 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:16.225234 29380 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 0.
W20260709 13:11:16.227021 29421 leader_election.cc:343] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:16.227874 29421 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:16.228757 29574 raft_consensus.cc:2804] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:16.229152 29574 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:16.229583 29574 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:16.232712 29570 tablet_bootstrap.cc:492] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:16.233913 29514 tablet_service.cc:1511] Processing CreateTablet for tablet 47da517282ee462792de545e40119636 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:11:16.235944 29515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab0baf9ea21a4fe78401601893e7ff66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.135254 29519 tablet_service.cc:1511] Processing CreateTablet for tablet 8e9b44184de046118890bc6cd6e1dc18 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:11:16.215296 29513 tablet_service.cc:1511] Processing CreateTablet for tablet 4962756209e1496ca6cb92e47ee866b3 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:11:16.246075 29573 tablet_bootstrap.cc:654] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:16.247902 29511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f07124b3443042c0b07f5833ed54ce53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.253908 29364 tablet_service.cc:1511] Processing CreateTablet for tablet 47da517282ee462792de545e40119636 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:11:16.254150 29512 tablet_service.cc:1511] Processing CreateTablet for tablet f645a08329404baabcc745299ee2efd3 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:11:16.255189 29520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3604a2976f84b96882e8983ba5b3fd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.259716 29367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4962756209e1496ca6cb92e47ee866b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.261664 29364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47da517282ee462792de545e40119636. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.262178 29440 tablet_service.cc:1511] Processing CreateTablet for tablet bf5703156380472bb793863fd4fd7544 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:11:16.263646 29368 tablet_service.cc:1511] Processing CreateTablet for tablet f343c91124ea4cd5b19e26f3530e1247 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:11:16.268159 29440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf5703156380472bb793863fd4fd7544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.269943 29438 tablet_service.cc:1511] Processing CreateTablet for tablet 4962756209e1496ca6cb92e47ee866b3 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:11:16.271925 29438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4962756209e1496ca6cb92e47ee866b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.274787 29517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbdb7b3723ea4c6ea492ee857ca224d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.265937 29570 ts_tablet_manager.cc:1403] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.420s	user 0.015s	sys 0.020s
I20260709 13:11:16.286092 29518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf5703156380472bb793863fd4fd7544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.288335 29519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e9b44184de046118890bc6cd6e1dc18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.290483 29512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f645a08329404baabcc745299ee2efd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.286262 29368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f343c91124ea4cd5b19e26f3530e1247. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.290266 29365 tablet_service.cc:1511] Processing CreateTablet for tablet f645a08329404baabcc745299ee2efd3 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:11:16.292846 29365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f645a08329404baabcc745299ee2efd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.293063 29513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4962756209e1496ca6cb92e47ee866b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.295823 29514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47da517282ee462792de545e40119636. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.308624 29572 tablet_bootstrap.cc:492] T 77157470a53245d7b1b307fba4d73aad P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:16.309265 29572 ts_tablet_manager.cc:1403] T 77157470a53245d7b1b307fba4d73aad P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.272s	user 0.013s	sys 0.014s
I20260709 13:11:16.312644 29572 raft_consensus.cc:359] T 77157470a53245d7b1b307fba4d73aad P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:16.313455 29572 raft_consensus.cc:385] T 77157470a53245d7b1b307fba4d73aad P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:16.313760 29572 raft_consensus.cc:740] T 77157470a53245d7b1b307fba4d73aad P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:16.314687 29572 consensus_queue.cc:260] T 77157470a53245d7b1b307fba4d73aad P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:16.319254 29572 ts_tablet_manager.cc:1434] T 77157470a53245d7b1b307fba4d73aad P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:11:16.319659 29370 tablet_service.cc:1511] Processing CreateTablet for tablet 843654f7a60942bd9feee060ac9d2dfe (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:11:16.321161 29572 tablet_bootstrap.cc:492] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:16.321506 29370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 843654f7a60942bd9feee060ac9d2dfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.345721 29445 tablet_service.cc:1511] Processing CreateTablet for tablet 47da517282ee462792de545e40119636 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:11:16.346995 29442 tablet_service.cc:1511] Processing CreateTablet for tablet f645a08329404baabcc745299ee2efd3 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:11:16.348773 29371 tablet_service.cc:1511] Processing CreateTablet for tablet 829dc08ee0ca4212a3b2c870b0ea1b35 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:11:16.357894 29441 tablet_service.cc:1511] Processing CreateTablet for tablet 829dc08ee0ca4212a3b2c870b0ea1b35 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:11:16.365568 29366 tablet_service.cc:1511] Processing CreateTablet for tablet 7184e7b71b434f6fa4689f1d12f276f2 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:11:16.374198 29572 tablet_bootstrap.cc:654] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:16.366681 29371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 829dc08ee0ca4212a3b2c870b0ea1b35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.391469 29364 tablet_service.cc:1511] Processing CreateTablet for tablet 3cece22da76441f5a3d309c5cb454c42 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:11:16.392701 29366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7184e7b71b434f6fa4689f1d12f276f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.401237 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:11:16.412362 29419 leader_election.cc:343] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:16.413028 29419 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:16.362515 29570 raft_consensus.cc:359] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:16.402266 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:16.403079 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:16.419845 29381 raft_consensus.cc:2468] T 77157470a53245d7b1b307fba4d73aad P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 0.
I20260709 13:11:16.426213 29495 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:16.427410 29578 raft_consensus.cc:2804] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:16.427847 29578 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:16.428253 29578 raft_consensus.cc:3060] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:16.440202 29574 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:16.444450 29592 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:16.445586 29578 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:16.446336 29573 tablet_bootstrap.cc:492] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:16.452257 29570 raft_consensus.cc:385] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:16.453048 29364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cece22da76441f5a3d309c5cb454c42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.444592 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:16.411090 29369 tablet_service.cc:1511] Processing CreateTablet for tablet b3d43afcf4e94172a4b40f6c25261ea0 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:11:16.473616 29381 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:16.474174 29369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3d43afcf4e94172a4b40f6c25261ea0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.475819 29578 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127)
I20260709 13:11:16.459426 29445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47da517282ee462792de545e40119636. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.488659 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:16.489384 29380 raft_consensus.cc:3060] T 77157470a53245d7b1b307fba4d73aad P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:16.444556 29419 leader_election.cc:343] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:16.490662 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 46144.9us
I20260709 13:11:16.470553 29573 ts_tablet_manager.cc:1403] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.375s	user 0.026s	sys 0.031s
I20260709 13:11:16.495105 29362 tablet_service.cc:1511] Processing CreateTablet for tablet eb6a9a102eba49209ddf2bdf286077e8 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:11:16.497295 29362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb6a9a102eba49209ddf2bdf286077e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.470392 29570 raft_consensus.cc:740] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:16.500674 29570 consensus_queue.cc:260] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:16.502091 29381 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 1.
I20260709 13:11:16.499138 29573 raft_consensus.cc:359] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:16.502712 29573 raft_consensus.cc:385] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:16.503232 29573 raft_consensus.cc:740] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:16.503527 29421 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:16.504735 29592 raft_consensus.cc:2804] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:16.504410 29573 consensus_queue.cc:260] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:16.507736 29573 ts_tablet_manager.cc:1434] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:11:16.512470 29570 ts_tablet_manager.cc:1434] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.229s	user 0.008s	sys 0.001s
I20260709 13:11:16.513052 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:16.513784 29455 raft_consensus.cc:3060] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:16.517998 29438 tablet_service.cc:1511] Processing CreateTablet for tablet 843654f7a60942bd9feee060ac9d2dfe (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:11:16.521674 29444 tablet_service.cc:1511] Processing CreateTablet for tablet f343c91124ea4cd5b19e26f3530e1247 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:11:16.523416 29368 tablet_service.cc:1511] Processing CreateTablet for tablet 4195dd8da2fa4e9a9a0f134c2d81f95a (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:11:16.524996 29368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4195dd8da2fa4e9a9a0f134c2d81f95a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.525055 29439 tablet_service.cc:1511] Processing CreateTablet for tablet 7184e7b71b434f6fa4689f1d12f276f2 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:11:16.511178 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:16.529158 29570 tablet_bootstrap.cc:492] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:16.529600 29438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 843654f7a60942bd9feee060ac9d2dfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.532572 29574 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:16.535427 29444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f343c91124ea4cd5b19e26f3530e1247. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.535689 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:16.536701 29529 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:16.511140 29380 raft_consensus.cc:2468] T 77157470a53245d7b1b307fba4d73aad P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:16.542263 29365 tablet_service.cc:1511] Processing CreateTablet for tablet 74cf9b558ac94704b5cb527efdc594ca (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:11:16.560539 29365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74cf9b558ac94704b5cb527efdc594ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.561991 29592 raft_consensus.cc:697] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:16.563537 29529 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 1.
I20260709 13:11:16.564275 29573 tablet_bootstrap.cc:492] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:16.544147 29495 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:16.554930 29572 tablet_bootstrap.cc:492] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:16.566042 29572 ts_tablet_manager.cc:1403] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.245s	user 0.034s	sys 0.069s
I20260709 13:11:16.543883 29441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 829dc08ee0ca4212a3b2c870b0ea1b35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.567340 29578 raft_consensus.cc:2804] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:16.563282 29592 consensus_queue.cc:237] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:16.569623 29442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f645a08329404baabcc745299ee2efd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.571964 29439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7184e7b71b434f6fa4689f1d12f276f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.561560 29455 raft_consensus.cc:2468] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
W20260709 13:11:16.580389 29327 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:16.567369 29515 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37954 (request call id 29) took 1014 ms. Trace:
I20260709 13:11:16.582584 29515 rpcz_store.cc:276] 0709 13:11:15.552672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.141876 (+589204us) service_pool.cc:224] Handling call
0709 13:11:16.189390 (+ 47514us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:16.190531 (+  1141us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:16.342473 (+151942us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:16.511316 (+168843us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:16.567238 (+ 55922us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:16.595016 29437 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45780 (request call id 28) took 1006 ms. Trace:
I20260709 13:11:16.622956 29437 rpcz_store.cc:276] 0709 13:11:15.588736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.100677 (+511941us) service_pool.cc:224] Handling call
0709 13:11:16.102802 (+  2125us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:16.102922 (+   120us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:16.296860 (+193938us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:16.530682 (+233822us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:16.594869 (+ 64187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:16.626212 29437 tablet_service.cc:1511] Processing CreateTablet for tablet 3cece22da76441f5a3d309c5cb454c42 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:11:16.632447 29366 tablet_service.cc:1511] Processing CreateTablet for tablet 3eb760d2a128422684c16e20d11a9e82 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:11:16.604444 29512 tablet_service.cc:1511] Processing CreateTablet for tablet 843654f7a60942bd9feee060ac9d2dfe (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:11:16.606395 29446 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45780 (request call id 30) took 1006 ms. Trace:
I20260709 13:11:16.608050 29371 tablet_service.cc:1511] Processing CreateTablet for tablet 88a3c543fca4406fae61f154055aeb79 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:11:16.608834 29572 raft_consensus.cc:359] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:16.609030 29440 tablet_service.cc:1511] Processing CreateTablet for tablet b3d43afcf4e94172a4b40f6c25261ea0 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:11:16.599473 29519 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37954 (request call id 28) took 1090 ms. Trace:
I20260709 13:11:16.642987 29446 rpcz_store.cc:276] 0709 13:11:15.600538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.116113 (+515575us) service_pool.cc:224] Handling call
0709 13:11:16.157087 (+ 40974us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:16.157199 (+   112us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:16.393581 (+236382us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:16.605861 (+212280us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:16.606324 (+   463us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:16.652042 29443 tablet_service.cc:1511] Processing CreateTablet for tablet 4195dd8da2fa4e9a9a0f134c2d81f95a (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:11:16.651831 29519 rpcz_store.cc:276] 0709 13:11:15.508705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.134065 (+625360us) service_pool.cc:224] Handling call
0709 13:11:16.253830 (+119765us) spinlock_profiling.cc:243] Waited 5.66 ms on lock 0x7b5800060c98. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61b71 00007f6a78c61a22 00007f6a81b7ac09 00007f6a80cd4ee0 00007f6a80dba831 00007f6a80d97ac3 00007f6a80d46400 00007f6a7a1cbaf4 00007f6a7a1cba82 00007f6a7a1cb9b1
0709 13:11:16.268824 (+ 14994us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b5800060c98. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61e9c 00007f6a78c61a5b 00007f6a81b7ac09 00007f6a80cd4ee0 00007f6a80dba831 00007f6a80d97ac3 00007f6a80d46400 00007f6a7a1cbaf4 00007f6a7a1cba82 00007f6a7a1cb9b1
0709 13:11:16.278377 (+  9553us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:16.282708 (+  4331us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:16.387256 (+104548us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:16.598752 (+211496us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:16.599400 (+   648us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38232320}
I20260709 13:11:16.654346 29446 tablet_service.cc:1511] Processing CreateTablet for tablet 3eb760d2a128422684c16e20d11a9e82 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:11:16.657080 29519 tablet_service.cc:1511] Processing CreateTablet for tablet f343c91124ea4cd5b19e26f3530e1247 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:11:16.659469 29437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cece22da76441f5a3d309c5cb454c42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.661173 29446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eb760d2a128422684c16e20d11a9e82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.663105 29570 tablet_bootstrap.cc:654] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:16.666235 29573 tablet_bootstrap.cc:654] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:16.684154 29440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3d43afcf4e94172a4b40f6c25261ea0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.696465 29512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 843654f7a60942bd9feee060ac9d2dfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.697516 29519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f343c91124ea4cd5b19e26f3530e1247. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.702032 29514 tablet_service.cc:1511] Processing CreateTablet for tablet 7184e7b71b434f6fa4689f1d12f276f2 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:11:16.704025 29443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4195dd8da2fa4e9a9a0f134c2d81f95a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.638965 29515 tablet_service.cc:1511] Processing CreateTablet for tablet 829dc08ee0ca4212a3b2c870b0ea1b35 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:11:16.718360 29371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88a3c543fca4406fae61f154055aeb79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.726544 29364 tablet_service.cc:1511] Processing CreateTablet for tablet 132eb7648165463b83338075a7b2e683 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:11:16.728964 29364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 132eb7648165463b83338075a7b2e683. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.725263 29370 tablet_service.cc:1511] Processing CreateTablet for tablet 5d440001d38e4a58becc5e57e767a12f (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:11:16.735082 29370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d440001d38e4a58becc5e57e767a12f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.772289 29578 raft_consensus.cc:697] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:16.773527 29362 tablet_service.cc:1511] Processing CreateTablet for tablet 95122b0f733946aba19edf1d98467467 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:11:16.773418 29578 consensus_queue.cc:237] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:16.648036 29572 raft_consensus.cc:385] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:16.782403 29520 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37954 (request call id 31) took 1074 ms. Trace:
I20260709 13:11:16.782953 29520 rpcz_store.cc:276] 0709 13:11:15.707900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.169301 (+461401us) service_pool.cc:224] Handling call
0709 13:11:16.208070 (+ 38769us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:16.208216 (+   146us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:16.476518 (+268302us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:16.647018 (+170500us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:16.782298 (+135280us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14073}
I20260709 13:11:16.800094 29518 tablet_service.cc:1511] Processing CreateTablet for tablet 3cece22da76441f5a3d309c5cb454c42 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:11:16.801869 29517 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37954 (request call id 30) took 1218 ms. Trace:
I20260709 13:11:16.802311 29517 rpcz_store.cc:276] 0709 13:11:15.579824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.168208 (+588384us) service_pool.cc:224] Handling call
0709 13:11:16.180840 (+ 12632us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:16.180950 (+   110us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:16.448498 (+267548us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:16.715859 (+267361us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:16.783012 (+ 67153us) spinlock_profiling.cc:243] Waited 60.9 ms on lock 0x7b5800060c98. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61b71 00007f6a78c621a2 00007f6a81ba3bb9 00007f6a80cd4d88 00007f6a80d9b973 00007f6a80d9770f 00007f6a80d97ecd 00007f6a80d46400 00007f6a7a1cbaf4 00007f6a7a1cba82
0709 13:11:16.797801 (+ 14789us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27239,"spinlock_wait_cycles":140023552}
I20260709 13:11:16.804816 29517 tablet_service.cc:1511] Processing CreateTablet for tablet 88a3c543fca4406fae61f154055aeb79 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:11:16.780838 29572 raft_consensus.cc:740] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:16.789814 29514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7184e7b71b434f6fa4689f1d12f276f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.824550 29278 catalog_manager.cc:5697] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 0 to 1, leader changed from <none> to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 1 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:16.829432 29520 tablet_service.cc:1511] Processing CreateTablet for tablet 74cf9b558ac94704b5cb527efdc594ca (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:11:16.829493 29445 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45780 (request call id 34) took 1043 ms. Trace:
I20260709 13:11:16.834712 29445 rpcz_store.cc:276] 0709 13:11:15.787934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.343847 (+555913us) service_pool.cc:224] Handling call
0709 13:11:16.347380 (+  3533us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:16.455989 (+108609us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:16.792198 (+336209us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:16.828857 (+ 36659us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:16.829415 (+   558us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:16.847424 29511 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37954 (request call id 27) took 1339 ms. Trace:
I20260709 13:11:16.848119 29511 rpcz_store.cc:276] 0709 13:11:15.508396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.130963 (+622567us) service_pool.cc:224] Handling call
0709 13:11:16.155698 (+ 24735us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:16.155812 (+   114us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:16.482107 (+326295us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:16.732729 (+250622us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:16.846932 (+114203us) spinlock_profiling.cc:243] Waited 44.3 ms on lock 0x7b5800060c98. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61b71 00007f6a78c621a2 00007f6a81ba3bb9 00007f6a80cd4d88 00007f6a80d9b973 00007f6a80d9770f 00007f6a80d97ecd 00007f6a80d46400 00007f6a7a1cbaf4 00007f6a7a1cba82
0709 13:11:16.847329 (+   397us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41759,"spinlock_wait_cycles":101876096}
I20260709 13:11:16.849751 29365 tablet_service.cc:1511] Processing CreateTablet for tablet 954309d5d9c549439adda625fbaa6b96 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:11:16.836691 29516 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37954 (request call id 26) took 1309 ms. Trace:
I20260709 13:11:16.850754 29511 tablet_service.cc:1511] Processing CreateTablet for tablet 4195dd8da2fa4e9a9a0f134c2d81f95a (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:11:16.831188 29572 consensus_queue.cc:260] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:16.854187 29513 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37954 (request call id 33) took 1098 ms. Trace:
I20260709 13:11:16.862062 29367 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52164 (request call id 33) took 1092 ms. Trace:
I20260709 13:11:16.875777 29367 rpcz_store.cc:276] 0709 13:11:15.769760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.189619 (+419859us) service_pool.cc:224] Handling call
0709 13:11:16.223646 (+ 34027us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:16.223759 (+   113us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:16.460107 (+236348us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:16.823117 (+363010us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:16.861979 (+ 38862us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:16.861716 29445 tablet_service.cc:1511] Processing CreateTablet for tablet 74cf9b558ac94704b5cb527efdc594ca (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:11:16.877990 29445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74cf9b558ac94704b5cb527efdc594ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.878438 29367 tablet_service.cc:1511] Processing CreateTablet for tablet 6b7b1911380a4f0e9a8d9584662a3dce (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:11:16.861768 29365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 954309d5d9c549439adda625fbaa6b96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.869778 29517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88a3c543fca4406fae61f154055aeb79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.890527 29362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95122b0f733946aba19edf1d98467467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.891338 29366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eb760d2a128422684c16e20d11a9e82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.867810 29513 rpcz_store.cc:276] 0709 13:11:15.754442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.214030 (+459588us) service_pool.cc:224] Handling call
0709 13:11:16.292416 (+ 78386us) spinlock_profiling.cc:243] Waited 5.22 ms on lock 0x7b5800060c98. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61b71 00007f6a78c61a22 00007f6a81b7ac09 00007f6a80cd4ee0 00007f6a80dba831 00007f6a80d97ac3 00007f6a80d46400 00007f6a7a1cbaf4 00007f6a7a1cba82 00007f6a7a1cb9b1
0709 13:11:16.292596 (+   180us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:16.292687 (+    91us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:16.365999 (+ 73312us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:16.681719 (+315720us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:16.838462 (+156743us) spinlock_profiling.cc:243] Waited 60.7 ms on lock 0x7b5800060c98. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61b71 00007f6a78c621a2 00007f6a81ba3bb9 00007f6a80cd4d88 00007f6a80d9b973 00007f6a80d9770f 00007f6a80d97ecd 00007f6a80d46400 00007f6a7a1cbaf4 00007f6a7a1cba82
0709 13:11:16.853075 (+ 14613us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48445,"spinlock_wait_cycles":151537280}
I20260709 13:11:16.894016 29513 tablet_service.cc:1511] Processing CreateTablet for tablet 3eb760d2a128422684c16e20d11a9e82 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:11:16.893187 29368 tablet_service.cc:1511] Processing CreateTablet for tablet f3ea78f0332644d3b941842ae07c5d95 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:11:16.900620 29367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b7b1911380a4f0e9a8d9584662a3dce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.905154 29368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3ea78f0332644d3b941842ae07c5d95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.850862 29516 rpcz_store.cc:276] 0709 13:11:15.508062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.109162 (+601100us) service_pool.cc:224] Handling call
0709 13:11:16.111299 (+  2137us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:16.111413 (+   114us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:16.454592 (+343179us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:16.777694 (+323102us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:16.816991 (+ 39297us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:16.927099 29520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74cf9b558ac94704b5cb527efdc594ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.923133 29369 tablet_service.cc:1511] Processing CreateTablet for tablet 1e3b77a777d14f819c6bc72128621f93 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:11:16.928537 29511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4195dd8da2fa4e9a9a0f134c2d81f95a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.929641 29513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eb760d2a128422684c16e20d11a9e82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.931645 29518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cece22da76441f5a3d309c5cb454c42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.935513 29515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 829dc08ee0ca4212a3b2c870b0ea1b35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.936144 29369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e3b77a777d14f819c6bc72128621f93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.945425 29573 tablet_bootstrap.cc:492] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:16.946171 29573 ts_tablet_manager.cc:1403] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.382s	user 0.010s	sys 0.034s
I20260709 13:11:16.953114 29439 tablet_service.cc:1511] Processing CreateTablet for tablet 5d440001d38e4a58becc5e57e767a12f (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:11:16.954967 29439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d440001d38e4a58becc5e57e767a12f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.967010 29441 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45780 (request call id 37) took 1085 ms. Trace:
I20260709 13:11:16.971215 29444 tablet_service.cc:1511] Processing CreateTablet for tablet 88a3c543fca4406fae61f154055aeb79 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:11:16.973212 29444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88a3c543fca4406fae61f154055aeb79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.975100 29443 tablet_service.cc:1511] Processing CreateTablet for tablet eb6a9a102eba49209ddf2bdf286077e8 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:11:16.976503 29443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb6a9a102eba49209ddf2bdf286077e8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:11:16.980376 29595 log.cc:927] Time spent T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:11:16.984208 29441 rpcz_store.cc:276] 0709 13:11:15.881802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.356788 (+474986us) service_pool.cc:224] Handling call
0709 13:11:16.528023 (+171235us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:16.528128 (+   105us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:16.852732 (+324604us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:16.966410 (+113678us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:16.966927 (+   517us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:16.985555 29516 tablet_service.cc:1511] Processing CreateTablet for tablet b3d43afcf4e94172a4b40f6c25261ea0 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:11:16.986474 29441 tablet_service.cc:1511] Processing CreateTablet for tablet 132eb7648165463b83338075a7b2e683 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:11:16.987880 29516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3d43afcf4e94172a4b40f6c25261ea0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.987900 29513 tablet_service.cc:1511] Processing CreateTablet for tablet eb6a9a102eba49209ddf2bdf286077e8 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:11:16.997797 29363 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52164 (request call id 32) took 1244 ms. Trace:
I20260709 13:11:17.001264 29363 rpcz_store.cc:276] 0709 13:11:15.753539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.163705 (+410166us) service_pool.cc:224] Handling call
0709 13:11:16.167821 (+  4116us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:16.175916 (+  8095us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:16.451183 (+275267us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:16.996716 (+545533us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:16.997691 (+   975us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:17.002978 29437 tablet_service.cc:1511] Processing CreateTablet for tablet 95122b0f733946aba19edf1d98467467 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:11:17.004987 29437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95122b0f733946aba19edf1d98467467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:16.914584 29519 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37954 (request call id 38) took 1118 ms. Trace:
I20260709 13:11:17.004907 29363 tablet_service.cc:1511] Processing CreateTablet for tablet 74a1f9233b9e4fcb989ab4963d6a7ad1 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:11:17.049297 29363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74a1f9233b9e4fcb989ab4963d6a7ad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.019917 29513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb6a9a102eba49209ddf2bdf286077e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.023389 29518 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37954 (request call id 40) took 1185 ms. Trace:
I20260709 13:11:17.065248 29518 rpcz_store.cc:276] 0709 13:11:15.837436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.783050 (+945614us) service_pool.cc:224] Handling call
0709 13:11:16.801033 (+ 17983us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:16.801136 (+   103us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:16.948312 (+147176us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:17.022408 (+ 74096us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:17.023189 (+   781us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:17.044404 29519 rpcz_store.cc:276] 0709 13:11:15.795720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.654236 (+858516us) service_pool.cc:224] Handling call
0709 13:11:16.696002 (+ 41766us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:16.696149 (+   147us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:16.825447 (+129298us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:16.901969 (+ 76522us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:16.913514 (+ 11545us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:17.024622 29442 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45780 (request call id 35) took 1187 ms. Trace:
I20260709 13:11:17.069242 29442 rpcz_store.cc:276] 0709 13:11:15.837433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.345990 (+508557us) service_pool.cc:224] Handling call
0709 13:11:16.527643 (+181653us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:16.527758 (+   115us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:16.781340 (+253582us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:17.016546 (+235206us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:17.024533 (+  7987us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:17.030488 29364 tablet_service.cc:1511] Processing CreateTablet for tablet 75d2e96638024243b35d8c06dcc28486 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:11:17.072999 29364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75d2e96638024243b35d8c06dcc28486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.077214 29442 tablet_service.cc:1511] Processing CreateTablet for tablet 954309d5d9c549439adda625fbaa6b96 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:11:17.079666 29442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 954309d5d9c549439adda625fbaa6b96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.093444 29600 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.093753 29518 tablet_service.cc:1511] Processing CreateTablet for tablet 132eb7648165463b83338075a7b2e683 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:11:17.094291 29600 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:17.083820 29519 tablet_service.cc:1511] Processing CreateTablet for tablet 5d440001d38e4a58becc5e57e767a12f (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:11:17.106611 29441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 132eb7648165463b83338075a7b2e683. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.115473 29592 consensus_queue.cc:1048] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:17.141625 29573 raft_consensus.cc:359] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:17.142611 29573 raft_consensus.cc:385] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.142788 29512 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37954 (request call id 36) took 1362 ms. Trace:
W20260709 13:11:17.143170 29265 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 117853us
I20260709 13:11:17.148008 29572 ts_tablet_manager.cc:1434] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.582s	user 0.024s	sys 0.012s
I20260709 13:11:17.148185 29592 consensus_queue.cc:1048] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:17.152456 29515 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37954 (request call id 37) took 1360 ms. Trace:
I20260709 13:11:17.162989 29443 tablet_service.cc:1511] Processing CreateTablet for tablet 6b7b1911380a4f0e9a8d9584662a3dce (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:11:17.164106 29365 tablet_service.cc:1511] Processing CreateTablet for tablet 7c4e4c7715074c3f984153e428f3a4f1 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:11:17.196561 29512 rpcz_store.cc:276] 0709 13:11:15.789517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.603357 (+813840us) service_pool.cc:224] Handling call
0709 13:11:16.695579 (+ 92222us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:16.695831 (+   252us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:16.891968 (+196137us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:17.142167 (+250199us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:17.142714 (+   547us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:17.163131 29511 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37954 (request call id 43) took 1188 ms. Trace:
I20260709 13:11:17.175835 29439 tablet_service.cc:1511] Processing CreateTablet for tablet 1e3b77a777d14f819c6bc72128621f93 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:11:17.178326 29600 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:17.184075 29518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 132eb7648165463b83338075a7b2e683. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.171706 29570 tablet_bootstrap.cc:492] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:17.207669 29570 ts_tablet_manager.cc:1403] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.679s	user 0.018s	sys 0.030s
I20260709 13:11:17.208587 29443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b7b1911380a4f0e9a8d9584662a3dce. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:11:17.198843 29572 ts_tablet_manager.cc:1467] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5: Tablet startup took 632ms
I20260709 13:11:17.195485 29573 raft_consensus.cc:740] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.207036 29365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c4e4c7715074c3f984153e428f3a4f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.197719 29371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52164 (request call id 42) took 1216 ms. Trace:
W20260709 13:11:17.212703 29572 ts_tablet_manager.cc:1469] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5: Trace:
0709 13:11:15.350095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.350271 (+   176us) service_pool.cc:224] Handling call
0709 13:11:15.353824 (+  3553us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:15.353949 (+   125us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:15.378175 (+ 24226us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:15.528858 (+150683us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:15.529443 (+   585us) inbound_call.cc:177] Queueing success response
0709 13:11:16.320774 (+791331us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:11:16.566373 (+245599us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:11:16.567024 (+   651us) tablet_replica.cc:261] Starting instrumentation
0709 13:11:16.606819 (+ 39795us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":197574,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":5493,"tablet-open.queue_time_us":791449,"thread_start_us":57354,"threads_started":1}
I20260709 13:11:17.198323 29515 rpcz_store.cc:276] 0709 13:11:15.792364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.636009 (+843645us) service_pool.cc:224] Handling call
0709 13:11:16.780643 (+144634us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:16.785316 (+  4673us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:16.955474 (+170158us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:17.151876 (+196402us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:17.152382 (+   506us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:17.224707 29578 consensus_queue.cc:1048] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:17.225154 29573 consensus_queue.cc:260] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:17.227813 29512 tablet_service.cc:1511] Processing CreateTablet for tablet 95122b0f733946aba19edf1d98467467 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:11:17.232976 29512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95122b0f733946aba19edf1d98467467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.215282 29371 rpcz_store.cc:276] 0709 13:11:15.980608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.607025 (+626417us) service_pool.cc:224] Handling call
0709 13:11:16.711766 (+104741us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:16.717715 (+  5949us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:16.873771 (+156056us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:17.158847 (+285076us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:17.195740 (+ 36893us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:17.242451 29515 tablet_service.cc:1511] Processing CreateTablet for tablet 954309d5d9c549439adda625fbaa6b96 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:11:17.247736 29439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e3b77a777d14f819c6bc72128621f93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.249845 29515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 954309d5d9c549439adda625fbaa6b96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.204301 29511 rpcz_store.cc:276] 0709 13:11:16.031814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.849626 (+817812us) service_pool.cc:224] Handling call
0709 13:11:16.863343 (+ 13717us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:16.867691 (+  4348us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:16.966721 (+ 99030us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:17.162434 (+195713us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:17.162948 (+   514us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:17.252406 29519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d440001d38e4a58becc5e57e767a12f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.251705 29371 tablet_service.cc:1511] Processing CreateTablet for tablet 2bc9dbd3a80e4fc79ffab716891c275b (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:11:17.253089 29511 tablet_service.cc:1511] Processing CreateTablet for tablet 6b7b1911380a4f0e9a8d9584662a3dce (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:11:17.254035 29371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bc9dbd3a80e4fc79ffab716891c275b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.254379 29511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b7b1911380a4f0e9a8d9584662a3dce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.216848 29570 raft_consensus.cc:359] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:17.255774 29573 ts_tablet_manager.cc:1434] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.309s	user 0.013s	sys 0.006s
I20260709 13:11:17.256048 29570 raft_consensus.cc:385] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.256539 29570 raft_consensus.cc:740] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.257562 29573 tablet_bootstrap.cc:492] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:17.257685 29570 consensus_queue.cc:260] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:17.244974 29370 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52164 (request call id 48) took 1138 ms. Trace:
I20260709 13:11:17.247604 29572 tablet_bootstrap.cc:492] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
W20260709 13:11:17.232628 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 70519.4us
I20260709 13:11:17.270685 29446 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45780 (request call id 44) took 1215 ms. Trace:
I20260709 13:11:17.271202 29446 rpcz_store.cc:276] 0709 13:11:16.054963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.653011 (+598048us) service_pool.cc:224] Handling call
0709 13:11:16.655358 (+  2347us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:16.655484 (+   126us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:16.984121 (+328637us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:17.236077 (+251956us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:17.270607 (+ 34530us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:17.273504 29446 tablet_service.cc:1511] Processing CreateTablet for tablet f3ea78f0332644d3b941842ae07c5d95 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:11:17.275048 29446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3ea78f0332644d3b941842ae07c5d95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.279963 29578 consensus_queue.cc:1048] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:17.282909 29520 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37954 (request call id 41) took 1434 ms. Trace:
I20260709 13:11:17.320943 29445 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45780 (request call id 41) took 1267 ms. Trace:
I20260709 13:11:17.321337 29366 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52164 (request call id 44) took 1340 ms. Trace:
I20260709 13:11:17.321983 29366 rpcz_store.cc:276] 0709 13:11:15.981432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.631281 (+649849us) service_pool.cc:224] Handling call
0709 13:11:16.783458 (+152177us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b5800010298. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61b71 00007f6a78c61a22 00007f6a81b7ac09 00007f6a80cd4ee0 00007f6a80dba831 00007f6a80d97ac3 00007f6a80d46400 00007f6a7a1cbaf4 00007f6a7a1cba82 00007f6a7a1cb9b1
0709 13:11:16.842649 (+ 59191us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b5800010298. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61e9c 00007f6a78c61a5b 00007f6a81b7ac09 00007f6a80cd4ee0 00007f6a80dba831 00007f6a80d97ac3 00007f6a80d46400 00007f6a7a1cbaf4 00007f6a7a1cba82 00007f6a7a1cb9b1
0709 13:11:16.854276 (+ 11627us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:16.856678 (+  2402us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:17.152477 (+295799us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:17.320740 (+168263us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:17.321268 (+   528us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":290580480}
I20260709 13:11:17.286976 29514 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37954 (request call id 39) took 1450 ms. Trace:
I20260709 13:11:17.321448 29445 rpcz_store.cc:276] 0709 13:11:16.054022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.838394 (+784372us) service_pool.cc:224] Handling call
0709 13:11:16.877202 (+ 38808us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:16.877526 (+   324us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:16.934718 (+ 57192us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:17.320305 (+385587us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:17.320853 (+   548us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:17.346526 29573 tablet_bootstrap.cc:654] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.325572 29369 tablet_service.cc:1511] Processing CreateTablet for tablet f352c5b8ac3f411ba5fc4901bc7e66a5 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:11:17.348363 29440 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45780 (request call id 45) took 1293 ms. Trace:
I20260709 13:11:17.285955 29520 rpcz_store.cc:276] 0709 13:11:15.848849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.807009 (+958160us) service_pool.cc:224] Handling call
0709 13:11:16.830809 (+ 23800us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:16.830999 (+   190us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:17.160307 (+329308us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:17.282352 (+122045us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:17.282839 (+   487us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:17.357172 29517 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37954 (request call id 42) took 1491 ms. Trace:
I20260709 13:11:17.424122 29517 rpcz_store.cc:276] 0709 13:11:15.865657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.803577 (+937920us) service_pool.cc:224] Handling call
0709 13:11:16.805858 (+  2281us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:16.805981 (+   123us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:17.295421 (+489440us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:17.356555 (+ 61134us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:17.357093 (+   538us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:17.426389 29517 tablet_service.cc:1511] Processing CreateTablet for tablet f3ea78f0332644d3b941842ae07c5d95 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:11:17.260609 29370 rpcz_store.cc:276] 0709 13:11:16.106083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.723620 (+617537us) service_pool.cc:224] Handling call
0709 13:11:16.734283 (+ 10663us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:16.734439 (+   156us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:16.962216 (+227777us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:17.244204 (+281988us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:17.244896 (+   692us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:17.405107 29445 tablet_service.cc:1511] Processing CreateTablet for tablet 75d2e96638024243b35d8c06dcc28486 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:11:17.428494 29445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75d2e96638024243b35d8c06dcc28486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.428833 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:17.429190 29369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f352c5b8ac3f411ba5fc4901bc7e66a5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:11:17.430804 29344 leader_election.cc:343] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:17.414311 29440 rpcz_store.cc:276] 0709 13:11:16.055250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.608097 (+552847us) service_pool.cc:224] Handling call
0709 13:11:16.683379 (+ 75282us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:16.683549 (+   170us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:17.170277 (+486728us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:17.347743 (+177466us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:17.348287 (+   544us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:17.433269 29362 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52164 (request call id 49) took 1259 ms. Trace:
I20260709 13:11:17.433703 29362 rpcz_store.cc:276] 0709 13:11:16.173631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.772371 (+598740us) service_pool.cc:224] Handling call
0709 13:11:16.857018 (+ 84647us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b5800010298. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61b71 00007f6a78c621a2 00007f6a81ba3bb9 00007f6a80cd4d88 00007f6a80d97b80 00007f6a80d46400 00007f6a7a1cbaf4 00007f6a7a1cba82 00007f6a7a1cb9b1 00007f6a7a1cb92c
0709 13:11:16.857102 (+    84us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:16.857203 (+   101us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:16.973491 (+116288us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:17.414692 (+441201us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:17.433185 (+ 18493us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6737152}
I20260709 13:11:17.434437 29440 tablet_service.cc:1511] Processing CreateTablet for tablet 74a1f9233b9e4fcb989ab4963d6a7ad1 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
W20260709 13:11:17.421738 29438 consensus_meta.cc:287] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.554s	user 0.017s	sys 0.012s
I20260709 13:11:17.436888 29440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74a1f9233b9e4fcb989ab4963d6a7ad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.437036 29438 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45780 (request call id 36) took 1556 ms. Trace:
I20260709 13:11:17.437613 29438 rpcz_store.cc:276] 0709 13:11:15.881048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.516838 (+635790us) service_pool.cc:224] Handling call
0709 13:11:16.518970 (+  2132us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:16.519078 (+   108us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:16.841984 (+322906us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:17.435966 (+593982us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:17.436944 (+   978us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:17.422653 29520 tablet_service.cc:1511] Processing CreateTablet for tablet 1e3b77a777d14f819c6bc72128621f93 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:11:17.441009 29520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e3b77a777d14f819c6bc72128621f93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.443037 29518 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37954 (request call id 47) took 1335 ms. Trace:
I20260709 13:11:17.445235 29438 tablet_service.cc:1511] Processing CreateTablet for tablet f352c5b8ac3f411ba5fc4901bc7e66a5 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:11:17.447111 29438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f352c5b8ac3f411ba5fc4901bc7e66a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.450332 29572 tablet_bootstrap.cc:654] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.453217 29441 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45780 (request call id 47) took 1243 ms. Trace:
I20260709 13:11:17.453660 29441 rpcz_store.cc:276] 0709 13:11:16.209853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.985506 (+775653us) service_pool.cc:224] Handling call
0709 13:11:16.987317 (+  1811us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:16.987423 (+   106us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:17.409366 (+421943us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:17.452574 (+ 43208us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:17.453142 (+   568us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:17.456046 29517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3ea78f0332644d3b941842ae07c5d95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.443449 29518 rpcz_store.cc:276] 0709 13:11:16.107983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.067793 (+959810us) service_pool.cc:224] Handling call
0709 13:11:17.095359 (+ 27566us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:17.095539 (+   180us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:17.320229 (+224690us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:17.442477 (+122248us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:17.442969 (+   492us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:17.477360 29518 tablet_service.cc:1511] Processing CreateTablet for tablet 75d2e96638024243b35d8c06dcc28486 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:11:17.478814 29518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75d2e96638024243b35d8c06dcc28486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.465188 29444 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45780 (request call id 42) took 1409 ms. Trace:
I20260709 13:11:17.483786 29444 rpcz_store.cc:276] 0709 13:11:16.054339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.851921 (+797582us) service_pool.cc:224] Handling call
0709 13:11:16.972596 (+120675us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:16.972725 (+   129us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:17.328657 (+355932us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:17.446856 (+118199us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:17.463601 (+ 16745us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:17.486680 29444 tablet_service.cc:1511] Processing CreateTablet for tablet 7c4e4c7715074c3f984153e428f3a4f1 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:11:17.501010 29570 ts_tablet_manager.cc:1434] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.293s	user 0.029s	sys 0.042s
I20260709 13:11:17.502274 29570 tablet_bootstrap.cc:492] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:17.510653 29437 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45780 (request call id 49) took 1300 ms. Trace:
I20260709 13:11:17.400360 29514 rpcz_store.cc:276] 0709 13:11:15.836312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.700490 (+864178us) service_pool.cc:224] Handling call
0709 13:11:16.703428 (+  2938us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:16.712887 (+  9459us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:16.981984 (+269097us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:17.232805 (+250821us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:17.286364 (+ 53559us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:17.519765 29367 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52164 (request call id 51) took 1146 ms. Trace:
I20260709 13:11:17.526157 29367 rpcz_store.cc:276] 0709 13:11:16.373125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.877184 (+504059us) service_pool.cc:224] Handling call
0709 13:11:16.879446 (+  2262us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:16.886686 (+  7240us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:17.408748 (+522062us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:17.447471 (+ 38723us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:17.518348 (+ 70877us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:17.490479 29512 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37954 (request call id 49) took 1202 ms. Trace:
I20260709 13:11:17.519325 29519 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37954 (request call id 48) took 1340 ms. Trace:
I20260709 13:11:17.546178 29578 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.547096 29578 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:17.547371 29514 tablet_service.cc:1511] Processing CreateTablet for tablet 74a1f9233b9e4fcb989ab4963d6a7ad1 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:11:17.551317 29573 tablet_bootstrap.cc:492] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:17.548142 29519 rpcz_store.cc:276] 0709 13:11:16.178749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.082314 (+903565us) service_pool.cc:224] Handling call
0709 13:11:17.105215 (+ 22901us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:17.105379 (+   164us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:17.454412 (+349033us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:17.506946 (+ 52534us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:17.517683 (+ 10737us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:17.563009 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:17.566294 29446 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45780 (request call id 53) took 1075 ms. Trace:
I20260709 13:11:17.566805 29444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c4e4c7715074c3f984153e428f3a4f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.585515 29514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74a1f9233b9e4fcb989ab4963d6a7ad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.586733 29511 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37954 (request call id 51) took 1121 ms. Trace:
I20260709 13:11:17.587141 29511 rpcz_store.cc:276] 0709 13:11:16.465805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.252066 (+786261us) service_pool.cc:224] Handling call
0709 13:11:17.253905 (+  1839us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:17.254001 (+    96us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:17.472145 (+218144us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:17.586086 (+113941us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:17.586661 (+   575us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:17.587924 29279 catalog_manager.cc:5697] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 0 to 1, leader changed from <none> to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 1 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:17.589638 29511 tablet_service.cc:1511] Processing CreateTablet for tablet 7c4e4c7715074c3f984153e428f3a4f1 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:11:17.591002 29511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c4e4c7715074c3f984153e428f3a4f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.569299 29368 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52164 (request call id 53) took 1077 ms. Trace:
I20260709 13:11:17.535823 29512 rpcz_store.cc:276] 0709 13:11:16.287796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.226503 (+938707us) service_pool.cc:224] Handling call
0709 13:11:17.228869 (+  2366us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:17.229104 (+   235us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:17.312158 (+ 83054us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:17.435319 (+123161us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:17.473821 (+ 38502us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:17.573611 29515 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37954 (request call id 50) took 1202 ms. Trace:
I20260709 13:11:17.576622 29513 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37954 (request call id 46) took 1539 ms. Trace:
I20260709 13:11:17.520830 29441 tablet_service.cc:1511] Processing CreateTablet for tablet 2bc9dbd3a80e4fc79ffab716891c275b (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:11:17.579330 29570 tablet_bootstrap.cc:654] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.584949 29455 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:17.592233 29368 rpcz_store.cc:276] 0709 13:11:16.492038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.890485 (+398447us) service_pool.cc:224] Handling call
0709 13:11:16.901118 (+ 10633us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:16.901944 (+   826us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:17.319364 (+417420us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:17.568692 (+249328us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:17.569225 (+   533us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:17.511405 29437 rpcz_store.cc:276] 0709 13:11:16.210514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.001724 (+791210us) service_pool.cc:224] Handling call
0709 13:11:17.004212 (+  2488us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:17.004362 (+   150us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:17.272415 (+268053us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:17.510055 (+237640us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:17.510579 (+   524us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:17.602566 29327 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:17.603585 29441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bc9dbd3a80e4fc79ffab716891c275b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.591977 29446 rpcz_store.cc:276] 0709 13:11:16.490840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.272357 (+781517us) service_pool.cc:224] Handling call
0709 13:11:17.274469 (+  2112us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:17.274593 (+   124us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:17.493651 (+219058us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:17.565682 (+ 72031us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:17.566218 (+   536us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:17.593947 29573 ts_tablet_manager.cc:1403] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.337s	user 0.046s	sys 0.015s
I20260709 13:11:17.600066 29513 rpcz_store.cc:276] 0709 13:11:16.037023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.986791 (+949768us) service_pool.cc:224] Handling call
0709 13:11:17.000609 (+ 13818us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:17.000763 (+   154us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:17.365656 (+364893us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:17.575144 (+209488us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:17.576531 (+  1387us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:17.618537 29513 tablet_service.cc:1511] Processing CreateTablet for tablet 2bc9dbd3a80e4fc79ffab716891c275b (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:11:17.620008 29346 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:17.624046 29517 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37954 (request call id 53) took 1013 ms. Trace:
I20260709 13:11:17.624907 29578 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:17.624930 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:17.582263 29443 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45780 (request call id 51) took 1207 ms. Trace:
I20260709 13:11:17.628973 29519 tablet_service.cc:1511] Processing CreateTablet for tablet f352c5b8ac3f411ba5fc4901bc7e66a5 (DEFAULT_TABLE table=test-workload [id=364c32d53f7748a2857a4a9acd17c671]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:11:17.630359 29442 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45780 (request call id 50) took 1262 ms. Trace:
I20260709 13:11:17.639634 29442 rpcz_store.cc:276] 0709 13:11:16.368253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.075650 (+707397us) service_pool.cc:224] Handling call
0709 13:11:17.078694 (+  3044us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:17.079032 (+   338us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:17.471398 (+392366us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:17.629785 (+158387us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:17.630296 (+   511us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:17.640406 29495 leader_election.cc:343] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:17.641010 29602 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:17.641011 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:17.641693 29602 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.642266 29602 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:17.643651 29495 leader_election.cc:343] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:17.644337 29495 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:17.645377 29578 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:17.638492 29443 rpcz_store.cc:276] 0709 13:11:16.374933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.161397 (+786464us) service_pool.cc:224] Handling call
0709 13:11:17.207923 (+ 46526us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:17.208099 (+   176us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:17.294671 (+ 86572us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:17.530606 (+235935us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:17.572318 (+ 41712us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:17.593439 29515 rpcz_store.cc:276] 0709 13:11:16.370770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.241213 (+870443us) service_pool.cc:224] Handling call
0709 13:11:17.248166 (+  6953us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:17.248271 (+   105us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:17.483599 (+235328us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:17.573047 (+ 89448us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:17.573538 (+   491us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:17.632962 29439 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45780 (request call id 52) took 1144 ms. Trace:
I20260709 13:11:17.649310 29439 rpcz_store.cc:276] 0709 13:11:16.488596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.174448 (+685852us) service_pool.cc:224] Handling call
0709 13:11:17.217110 (+ 42662us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:17.232618 (+ 15508us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:17.473833 (+241215us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:17.632441 (+158608us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:17.632909 (+   468us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2533}
I20260709 13:11:17.634438 29573 raft_consensus.cc:359] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:17.650971 29573 raft_consensus.cc:385] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.648196 29513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bc9dbd3a80e4fc79ffab716891c275b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.651340 29573 raft_consensus.cc:740] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.652174 29519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f352c5b8ac3f411ba5fc4901bc7e66a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:17.637070 29517 rpcz_store.cc:276] 0709 13:11:16.610422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.425252 (+814830us) service_pool.cc:224] Handling call
0709 13:11:17.427316 (+  2064us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:17.427433 (+   117us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:17.609227 (+181794us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:17.623418 (+ 14191us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:17.623972 (+   554us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:17.652460 29573 consensus_queue.cc:260] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:17.664122 29516 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37954 (request call id 45) took 1631 ms. Trace:
I20260709 13:11:17.664650 29516 rpcz_store.cc:276] 0709 13:11:16.032831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.964060 (+931229us) service_pool.cc:224] Handling call
0709 13:11:16.986918 (+ 22858us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:16.987037 (+   119us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:17.491519 (+504482us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:17.663522 (+172003us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:17.664044 (+   522us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:17.671085 29573 ts_tablet_manager.cc:1434] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.002s
I20260709 13:11:17.672407 29573 tablet_bootstrap.cc:492] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:17.682426 29573 tablet_bootstrap.cc:654] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.683947 29572 tablet_bootstrap.cc:492] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:17.684551 29572 ts_tablet_manager.cc:1403] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.437s	user 0.014s	sys 0.015s
I20260709 13:11:17.688309 29602 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:17.697009 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:17.697806 29455 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:17.705430 29572 raft_consensus.cc:359] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:17.712108 29572 raft_consensus.cc:385] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.708920 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:17.709499 29602 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:17.712466 29570 tablet_bootstrap.cc:492] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:17.715128 29570 ts_tablet_manager.cc:1403] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.213s	user 0.019s	sys 0.005s
I20260709 13:11:17.706229 29455 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
W20260709 13:11:17.715294 29344 leader_election.cc:343] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:17.716488 29346 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:17.717505 29602 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:17.720762 29570 raft_consensus.cc:359] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:17.721820 29570 raft_consensus.cc:385] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.722244 29570 raft_consensus.cc:740] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.713454 29572 raft_consensus.cc:740] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.724426 29572 consensus_queue.cc:260] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:17.726233 29570 consensus_queue.cc:260] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:17.728924 29573 tablet_bootstrap.cc:492] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:17.730093 29572 ts_tablet_manager.cc:1434] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.006s
I20260709 13:11:17.730748 29573 ts_tablet_manager.cc:1403] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.059s	user 0.017s	sys 0.001s
I20260709 13:11:17.732690 29613 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.733271 29613 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:17.735587 29570 ts_tablet_manager.cc:1434] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:11:17.736043 29602 raft_consensus.cc:697] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:17.737062 29570 tablet_bootstrap.cc:492] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:17.737416 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:17.737766 29613 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:11:17.741920 29421 leader_election.cc:343] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:17.739023 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:17.737129 29602 consensus_queue.cc:237] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:17.744607 29419 leader_election.cc:343] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:17.745095 29419 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:17.746254 29613 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:17.732728 29572 tablet_bootstrap.cc:492] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:17.744408 29573 raft_consensus.cc:359] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:17.748452 29573 raft_consensus.cc:385] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.748816 29573 raft_consensus.cc:740] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.749614 29573 consensus_queue.cc:260] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:17.735513 29520 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37954 (request call id 52) took 1248 ms. Trace:
I20260709 13:11:17.751912 29520 rpcz_store.cc:276] 0709 13:11:16.487431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.421456 (+934025us) service_pool.cc:224] Handling call
0709 13:11:17.440316 (+ 18860us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:17.440443 (+   127us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:17.669609 (+229166us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:17.734603 (+ 64994us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:17.735409 (+   806us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:17.753111 29573 ts_tablet_manager.cc:1434] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.001s
I20260709 13:11:17.754559 29570 tablet_bootstrap.cc:654] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.762641 29573 tablet_bootstrap.cc:492] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:17.764494 29572 tablet_bootstrap.cc:654] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.773547 29279 catalog_manager.cc:5697] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:17.775580 29570 tablet_bootstrap.cc:492] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:17.776168 29573 tablet_bootstrap.cc:654] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.777108 29570 ts_tablet_manager.cc:1403] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.040s	user 0.020s	sys 0.010s
I20260709 13:11:17.781546 29572 tablet_bootstrap.cc:492] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:17.780962 29570 raft_consensus.cc:359] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:17.782097 29572 ts_tablet_manager.cc:1403] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.050s	user 0.013s	sys 0.007s
I20260709 13:11:17.782007 29570 raft_consensus.cc:385] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.782725 29570 raft_consensus.cc:740] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.784488 29578 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.784168 29570 consensus_queue.cc:260] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:17.785256 29578 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:17.787340 29570 ts_tablet_manager.cc:1434] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:11:17.787786 29578 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:17.789249 29570 tablet_bootstrap.cc:492] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:17.789270 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:17.790485 29572 raft_consensus.cc:359] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:17.791216 29572 raft_consensus.cc:385] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.791570 29572 raft_consensus.cc:740] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
W20260709 13:11:17.791877 29495 leader_election.cc:343] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:17.792484 29572 consensus_queue.cc:260] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:17.793319 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:17.795707 29602 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:17.795770 29495 leader_election.cc:343] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:17.796634 29495 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:17.796459 29602 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:17.797756 29578 raft_consensus.cc:2749] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:17.800411 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:17.801843 29602 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:11:17.802060 29344 leader_election.cc:343] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:17.803139 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:17.803426 29572 ts_tablet_manager.cc:1434] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.001s
I20260709 13:11:17.806950 29572 tablet_bootstrap.cc:492] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
W20260709 13:11:17.807428 29346 leader_election.cc:343] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:17.808180 29346 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:17.809474 29602 raft_consensus.cc:2749] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:17.818508 29572 tablet_bootstrap.cc:654] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.818638 29573 tablet_bootstrap.cc:492] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:17.819622 29613 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.819289 29570 tablet_bootstrap.cc:654] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.820219 29613 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:17.823772 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:11:17.826110 29419 leader_election.cc:343] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:17.826766 29613 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:17.819617 29573 ts_tablet_manager.cc:1403] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.057s	user 0.040s	sys 0.005s
I20260709 13:11:17.828990 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:17.830147 29381 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 0.
I20260709 13:11:17.833110 29421 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:17.832459 29573 raft_consensus.cc:359] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:17.834281 29573 raft_consensus.cc:385] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.834780 29573 raft_consensus.cc:740] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.835389 29613 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:17.835814 29613 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.836426 29613 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:17.835919 29573 consensus_queue.cc:260] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:17.839918 29573 ts_tablet_manager.cc:1434] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.012s	user 0.011s	sys 0.001s
I20260709 13:11:17.841162 29573 tablet_bootstrap.cc:492] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:17.848898 29573 tablet_bootstrap.cc:654] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.854104 29613 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:17.859313 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:17.860354 29381 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:17.872402 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:11:17.875697 29419 leader_election.cc:343] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:17.877161 29613 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:17.882525 29381 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 1.
I20260709 13:11:17.886910 29421 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:17.888202 29613 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:17.888793 29613 raft_consensus.cc:697] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:17.889099 29572 tablet_bootstrap.cc:492] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:17.889319 29573 tablet_bootstrap.cc:492] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:17.889802 29573 ts_tablet_manager.cc:1403] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.049s	user 0.029s	sys 0.015s
I20260709 13:11:17.889642 29572 ts_tablet_manager.cc:1403] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.083s	user 0.031s	sys 0.025s
I20260709 13:11:17.889696 29613 consensus_queue.cc:237] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:17.891484 29570 tablet_bootstrap.cc:492] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:17.892107 29570 ts_tablet_manager.cc:1403] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.103s	user 0.034s	sys 0.045s
I20260709 13:11:17.893215 29573 raft_consensus.cc:359] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:17.894107 29573 raft_consensus.cc:385] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.893993 29572 raft_consensus.cc:359] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:17.894613 29573 raft_consensus.cc:740] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.894887 29572 raft_consensus.cc:385] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.895253 29572 raft_consensus.cc:740] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.896288 29570 raft_consensus.cc:359] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:17.897089 29570 raft_consensus.cc:385] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.895886 29573 consensus_queue.cc:260] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:17.897480 29570 raft_consensus.cc:740] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.896178 29572 consensus_queue.cc:260] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:17.898551 29570 consensus_queue.cc:260] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:17.899748 29573 ts_tablet_manager.cc:1434] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260709 13:11:17.899749 29572 ts_tablet_manager.cc:1434] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:11:17.901162 29573 tablet_bootstrap.cc:492] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:17.901081 29570 ts_tablet_manager.cc:1434] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:11:17.902454 29570 tablet_bootstrap.cc:492] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:17.906052 29572 tablet_bootstrap.cc:492] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:17.909953 29573 tablet_bootstrap.cc:654] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.910212 29570 tablet_bootstrap.cc:654] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.915820 29572 tablet_bootstrap.cc:654] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.917241 29278 catalog_manager.cc:5697] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 0 to 1, leader changed from <none> to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 1 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:17.921882 29573 tablet_bootstrap.cc:492] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:17.922420 29573 ts_tablet_manager.cc:1403] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.008s
I20260709 13:11:17.925810 29573 raft_consensus.cc:359] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:17.926550 29573 raft_consensus.cc:385] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.926812 29573 raft_consensus.cc:740] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.927758 29573 consensus_queue.cc:260] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:17.933475 29573 ts_tablet_manager.cc:1434] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:11:17.934882 29573 tablet_bootstrap.cc:492] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:17.944628 29572 tablet_bootstrap.cc:492] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:17.945250 29572 ts_tablet_manager.cc:1403] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.027s
I20260709 13:11:17.948567 29572 raft_consensus.cc:359] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:17.949380 29572 raft_consensus.cc:385] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.952728 29572 raft_consensus.cc:740] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.952454 29573 tablet_bootstrap.cc:654] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.956517 29572 consensus_queue.cc:260] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:17.959548 29572 ts_tablet_manager.cc:1434] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:11:17.960805 29572 tablet_bootstrap.cc:492] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:17.963092 29573 tablet_bootstrap.cc:492] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:17.963675 29573 ts_tablet_manager.cc:1403] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.003s
I20260709 13:11:17.965839 29573 raft_consensus.cc:359] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:17.966817 29573 raft_consensus.cc:385] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.967034 29573 raft_consensus.cc:740] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.967808 29572 tablet_bootstrap.cc:654] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.967692 29573 consensus_queue.cc:260] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:17.969911 29570 tablet_bootstrap.cc:492] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:17.970481 29570 ts_tablet_manager.cc:1403] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.068s	user 0.028s	sys 0.032s
I20260709 13:11:17.970566 29573 ts_tablet_manager.cc:1434] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:17.971755 29573 tablet_bootstrap.cc:492] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:17.973680 29570 raft_consensus.cc:359] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:17.974618 29570 raft_consensus.cc:385] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:17.974932 29570 raft_consensus.cc:740] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:17.975868 29613 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.976392 29613 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:17.978682 29573 tablet_bootstrap.cc:654] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.979209 29613 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:17.981380 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:17.982066 29570 consensus_queue.cc:260] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:17.984896 29419 leader_election.cc:343] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:17.985136 29570 ts_tablet_manager.cc:1434] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 13:11:17.986238 29570 tablet_bootstrap.cc:492] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:17.988425 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:11:17.990883 29421 leader_election.cc:343] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:17.991730 29421 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:17.994129 29570 tablet_bootstrap.cc:654] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:17.994426 29613 raft_consensus.cc:2749] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:18.000241 29572 tablet_bootstrap.cc:492] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:18.000834 29572 ts_tablet_manager.cc:1403] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.022s
I20260709 13:11:18.004518 29572 raft_consensus.cc:359] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.005479 29572 raft_consensus.cc:385] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.005837 29572 raft_consensus.cc:740] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.006776 29572 consensus_queue.cc:260] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.010123 29572 ts_tablet_manager.cc:1434] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:11:18.012029 29572 tablet_bootstrap.cc:492] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:18.010155 29573 tablet_bootstrap.cc:492] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:18.015986 29573 ts_tablet_manager.cc:1403] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.044s	user 0.007s	sys 0.010s
I20260709 13:11:18.021049 29573 raft_consensus.cc:359] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.021727 29572 tablet_bootstrap.cc:654] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.022131 29573 raft_consensus.cc:385] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.022528 29573 raft_consensus.cc:740] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.023833 29573 consensus_queue.cc:260] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.037776 29570 tablet_bootstrap.cc:492] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:18.038717 29570 ts_tablet_manager.cc:1403] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.053s	user 0.017s	sys 0.024s
I20260709 13:11:18.038838 29573 ts_tablet_manager.cc:1434] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.004s
I20260709 13:11:18.040382 29573 tablet_bootstrap.cc:492] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:18.044004 29572 tablet_bootstrap.cc:492] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:18.044658 29572 ts_tablet_manager.cc:1403] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.033s	user 0.019s	sys 0.011s
I20260709 13:11:18.047129 29573 tablet_bootstrap.cc:654] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.047699 29572 raft_consensus.cc:359] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.048525 29572 raft_consensus.cc:385] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.048821 29572 raft_consensus.cc:740] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.049883 29572 consensus_queue.cc:260] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.052217 29570 raft_consensus.cc:359] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.053354 29570 raft_consensus.cc:385] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.053728 29570 raft_consensus.cc:740] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.054695 29570 consensus_queue.cc:260] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.057135 29578 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.057958 29570 ts_tablet_manager.cc:1434] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.002s
I20260709 13:11:18.057648 29578 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.058385 29572 ts_tablet_manager.cc:1434] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 13:11:18.059425 29572 tablet_bootstrap.cc:492] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:18.060031 29578 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:18.061467 29570 tablet_bootstrap.cc:492] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:18.062776 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:18.064684 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:18.065807 29455 raft_consensus.cc:2393] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 1: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:18.068444 29495 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:18.069602 29578 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.093640 29570 tablet_bootstrap.cc:654] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.093869 29578 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:18.096801 29572 tablet_bootstrap.cc:654] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.098356 29573 tablet_bootstrap.cc:492] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:18.098958 29573 ts_tablet_manager.cc:1403] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.059s	user 0.005s	sys 0.021s
I20260709 13:11:18.099310 29570 tablet_bootstrap.cc:492] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:18.099854 29570 ts_tablet_manager.cc:1403] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.011s
I20260709 13:11:18.102396 29572 tablet_bootstrap.cc:492] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:18.102175 29573 raft_consensus.cc:359] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.102862 29572 ts_tablet_manager.cc:1403] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.000s
I20260709 13:11:18.103327 29573 raft_consensus.cc:385] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.102960 29570 raft_consensus.cc:359] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.103812 29573 raft_consensus.cc:740] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.104311 29570 raft_consensus.cc:385] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.104774 29570 raft_consensus.cc:740] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.105882 29602 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.105067 29573 consensus_queue.cc:260] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.105711 29570 consensus_queue.cc:260] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.106415 29602 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.108609 29573 ts_tablet_manager.cc:1434] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.003s
I20260709 13:11:18.110409 29625 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.110786 29573 tablet_bootstrap.cc:492] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:18.110963 29625 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.113207 29625 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:18.113950 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:18.114938 29529 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:18.116392 29602 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:18.120471 29344 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:18.117172 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:18.121569 29530 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:18.122681 29602 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:18.123123 29570 ts_tablet_manager.cc:1434] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.003s
I20260709 13:11:18.123015 29344 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:18.117786 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:18.122203 29573 tablet_bootstrap.cc:654] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.124511 29570 tablet_bootstrap.cc:492] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:18.118773 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:18.126413 29455 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:18.123106 29602 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:18.125598 29346 leader_election.cc:343] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:18.127432 29602 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.130738 29626 raft_consensus.cc:2804] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:18.131199 29626 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.131575 29626 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.118448 29572 raft_consensus.cc:359] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.135481 29572 raft_consensus.cc:385] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.136567 29572 raft_consensus.cc:740] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.137439 29572 consensus_queue.cc:260] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.152408 29625 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.153278 29625 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.160817 29602 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.161216 29570 tablet_bootstrap.cc:654] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.164136 29602 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:18.165939 29649 consensus_queue.cc:1048] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:18.166498 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:18.167225 29530 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.173008 29573 tablet_bootstrap.cc:492] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:18.173800 29573 ts_tablet_manager.cc:1403] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.063s	user 0.020s	sys 0.004s
I20260709 13:11:18.178691 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:18.180269 29455 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.183022 29602 consensus_queue.cc:1048] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:18.183936 29613 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.184659 29613 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.188244 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:18.189417 29454 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:18.192185 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:18.193049 29528 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:18.188230 29613 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:18.194519 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:18.194814 29344 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:18.195399 29528 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 0.
I20260709 13:11:18.195981 29602 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:18.196497 29602 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.196923 29602 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.197715 29419 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:18.203467 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:18.204507 29381 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 0.
I20260709 13:11:18.206517 29613 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:18.207098 29613 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.207628 29613 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.207259 29602 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.210191 29602 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:18.212085 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:18.213110 29528 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.197724 29625 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:18.224206 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:18.225148 29454 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.177798 29573 raft_consensus.cc:359] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.227123 29573 raft_consensus.cc:385] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.229600 29573 raft_consensus.cc:740] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.233232 29573 consensus_queue.cc:260] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.234042 29592 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.234637 29592 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.237408 29592 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:18.240662 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:18.254408 29527 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 0.
I20260709 13:11:18.243820 29625 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.256323 29625 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.257920 29592 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.258430 29592 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.258611 29419 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:18.260973 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:18.261520 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:18.262202 29453 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:18.262203 29594 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:18.263108 29344 leader_election.cc:343] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:18.263235 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:18.267895 29572 ts_tablet_manager.cc:1434] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.164s	user 0.043s	sys 0.031s
I20260709 13:11:18.207327 29626 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.263634 29594 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.271056 29594 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:11:18.272434 29419 leader_election.cc:343] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:18.272725 29530 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:18.267041 29625 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:18.260854 29592 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:18.285230 29572 tablet_bootstrap.cc:492] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:18.267400 29454 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:18.284663 29346 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:18.291677 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:18.354210 29578 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.354921 29578 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.311592 29573 ts_tablet_manager.cc:1434] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.137s	user 0.014s	sys 0.002s
I20260709 13:11:18.358422 29573 tablet_bootstrap.cc:492] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:18.286834 29592 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:18.363147 29625 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:18.301821 29594 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.363428 29578 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:18.364681 29625 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.365276 29625 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.365097 29594 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.291775 29344 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:18.348368 29626 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:18.298830 29613 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.342839 29455 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
W20260709 13:11:18.367988 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 89047.8us
W20260709 13:11:18.371587 29495 leader_election.cc:343] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:18.361335 29592 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.371781 29529 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.378401 29592 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.371191 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:11:18.380810 29495 leader_election.cc:343] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:18.381882 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:18.382797 29381 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 0.
I20260709 13:11:18.383970 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:18.384469 29626 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:18.385931 29626 raft_consensus.cc:697] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:18.386317 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:18.372761 29572 tablet_bootstrap.cc:654] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.374269 29528 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:18.374958 29625 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.377947 29570 tablet_bootstrap.cc:492] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:18.392503 29570 ts_tablet_manager.cc:1403] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.268s	user 0.066s	sys 0.140s
W20260709 13:11:18.377265 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 85600.7us
I20260709 13:11:18.402503 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:18.410595 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:18.411696 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:18.412302 29346 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:18.410717 29381 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.416353 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:18.386991 29626 consensus_queue.cc:237] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.423050 29594 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:18.425329 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:18.425344 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:18.423121 29648 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:18.426743 29648 raft_consensus.cc:697] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:18.425731 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:18.418493 29613 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:18.427713 29648 consensus_queue.cc:237] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.430958 29530 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.426270 29528 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:18.435835 29495 leader_election.cc:343] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:18.437986 29613 consensus_queue.cc:1048] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:18.443219 29570 raft_consensus.cc:359] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.446489 29570 raft_consensus.cc:385] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.446895 29570 raft_consensus.cc:740] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.449327 29570 consensus_queue.cc:260] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.456075 29570 ts_tablet_manager.cc:1434] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.063s	user 0.014s	sys 0.003s
I20260709 13:11:18.455214 29594 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.465546 29572 tablet_bootstrap.cc:492] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:18.466288 29572 ts_tablet_manager.cc:1403] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.189s	user 0.030s	sys 0.026s
W20260709 13:11:18.464622 29346 leader_election.cc:343] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:18.474110 29495 leader_election.cc:343] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:18.474648 29421 leader_election.cc:343] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:18.475200 29421 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:18.447575 29592 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.476187 29613 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:18.474648 29495 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:18.478804 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:18.479687 29578 raft_consensus.cc:2749] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:18.479794 29455 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:18.481009 29495 leader_election.cc:343] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:18.481495 29495 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:11:18.482686 29495 leader_election.cc:343] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:18.482999 29592 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:18.484476 29578 raft_consensus.cc:2749] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:18.485030 29573 tablet_bootstrap.cc:654] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.483135 29495 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:18.496534 29570 tablet_bootstrap.cc:492] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:18.487056 29578 raft_consensus.cc:2749] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:18.467535 29594 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.499680 29625 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:18.482996 29381 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 1.
I20260709 13:11:18.506729 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:18.506516 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:18.507342 29526 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.507192 29455 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:18.506492 29592 consensus_queue.cc:1048] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:11:18.510041 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:18.510844 29380 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:18.511754 29344 leader_election.cc:343] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:18.516880 29530 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 1.
I20260709 13:11:18.522092 29421 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:18.524431 29346 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:18.525557 29602 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:18.526190 29602 raft_consensus.cc:697] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:18.523005 29613 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:18.529547 29613 raft_consensus.cc:697] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:18.530633 29613 consensus_queue.cc:237] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.528184 29572 raft_consensus.cc:359] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.533504 29572 raft_consensus.cc:385] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.534206 29572 raft_consensus.cc:740] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.540670 29526 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 1.
I20260709 13:11:18.545399 29528 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:18.565735 29380 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 1.
I20260709 13:11:18.585446 29421 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:18.593967 29654 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:18.594686 29654 raft_consensus.cc:697] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:18.595952 29654 consensus_queue.cc:237] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.627735 29572 consensus_queue.cc:260] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.634173 29344 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:18.635623 29572 ts_tablet_manager.cc:1434] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.169s	user 0.020s	sys 0.005s
I20260709 13:11:18.635663 29626 raft_consensus.cc:2804] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:18.636574 29626 raft_consensus.cc:697] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:18.637136 29572 tablet_bootstrap.cc:492] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:18.637387 29626 consensus_queue.cc:237] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.641119 29570 tablet_bootstrap.cc:654] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:18.632296 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 94942.5us
I20260709 13:11:18.634001 29602 consensus_queue.cc:237] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:18.650436 29327 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:18.650455 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:18.655694 29279 catalog_manager.cc:5697] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 0 to 1, leader changed from <none> to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 1 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:18.673770 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:18.671118 29594 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:18.676651 29495 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:18.678053 29573 tablet_bootstrap.cc:492] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:18.678581 29573 ts_tablet_manager.cc:1403] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.322s	user 0.041s	sys 0.019s
I20260709 13:11:18.682653 29573 raft_consensus.cc:359] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.679335 29594 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:18.682224 29278 catalog_manager.cc:5697] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:18.683475 29573 raft_consensus.cc:385] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.685597 29573 raft_consensus.cc:740] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.687117 29573 consensus_queue.cc:260] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.700728 29572 tablet_bootstrap.cc:654] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.717285 29573 ts_tablet_manager.cc:1434] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.038s	user 0.000s	sys 0.008s
I20260709 13:11:18.718639 29573 tablet_bootstrap.cc:492] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:18.726208 29572 tablet_bootstrap.cc:492] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:18.726619 29570 tablet_bootstrap.cc:492] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:18.727072 29572 ts_tablet_manager.cc:1403] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.090s	user 0.021s	sys 0.009s
I20260709 13:11:18.727101 29570 ts_tablet_manager.cc:1403] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.234s	user 0.012s	sys 0.004s
I20260709 13:11:18.732548 29573 tablet_bootstrap.cc:654] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.734400 29570 raft_consensus.cc:359] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.741578 29570 raft_consensus.cc:385] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.741921 29570 raft_consensus.cc:740] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.742633 29570 consensus_queue.cc:260] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.739984 29572 raft_consensus.cc:359] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.743661 29572 raft_consensus.cc:385] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.744001 29572 raft_consensus.cc:740] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.744731 29572 consensus_queue.cc:260] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.746081 29573 tablet_bootstrap.cc:492] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:18.746686 29573 ts_tablet_manager.cc:1403] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.005s
I20260709 13:11:18.747750 29570 ts_tablet_manager.cc:1434] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.001s
I20260709 13:11:18.748893 29570 tablet_bootstrap.cc:492] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:18.751942 29572 ts_tablet_manager.cc:1434] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.003s
I20260709 13:11:18.752169 29573 raft_consensus.cc:359] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.753067 29572 tablet_bootstrap.cc:492] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:18.753077 29573 raft_consensus.cc:385] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.753652 29573 raft_consensus.cc:740] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.754601 29573 consensus_queue.cc:260] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.756999 29573 ts_tablet_manager.cc:1434] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.005s
I20260709 13:11:18.758106 29573 tablet_bootstrap.cc:492] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:18.758893 29279 catalog_manager.cc:5697] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:18.761349 29279 catalog_manager.cc:5697] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:18.762982 29570 tablet_bootstrap.cc:654] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.763214 29279 catalog_manager.cc:5697] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:18.764454 29572 tablet_bootstrap.cc:654] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.765759 29573 tablet_bootstrap.cc:654] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.769853 29572 tablet_bootstrap.cc:492] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:18.770304 29572 ts_tablet_manager.cc:1403] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.000s
I20260709 13:11:18.773332 29572 raft_consensus.cc:359] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.773949 29572 raft_consensus.cc:385] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.774220 29572 raft_consensus.cc:740] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.774848 29573 tablet_bootstrap.cc:492] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:18.775398 29573 ts_tablet_manager.cc:1403] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.018s	user 0.003s	sys 0.011s
I20260709 13:11:18.775056 29572 consensus_queue.cc:260] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.778055 29572 ts_tablet_manager.cc:1434] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:11:18.779399 29572 tablet_bootstrap.cc:492] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:18.781949 29573 raft_consensus.cc:359] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.782689 29573 raft_consensus.cc:385] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.783299 29573 raft_consensus.cc:740] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.784279 29573 consensus_queue.cc:260] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.784874 29572 tablet_bootstrap.cc:654] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.786163 29573 ts_tablet_manager.cc:1434] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.003s
I20260709 13:11:18.786912 29573 tablet_bootstrap.cc:492] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:18.790046 29278 catalog_manager.cc:5697] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 0 to 1, leader changed from <none> to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 1 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:18.794765 29573 tablet_bootstrap.cc:654] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.801573 29573 tablet_bootstrap.cc:492] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:18.802182 29573 ts_tablet_manager.cc:1403] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 13:11:18.801385 29572 tablet_bootstrap.cc:492] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:18.804287 29572 ts_tablet_manager.cc:1403] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.004s
I20260709 13:11:18.805636 29573 raft_consensus.cc:359] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.806514 29573 raft_consensus.cc:385] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.806495 29572 raft_consensus.cc:359] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.807058 29573 raft_consensus.cc:740] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.807359 29572 raft_consensus.cc:385] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.807690 29572 raft_consensus.cc:740] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.808339 29573 consensus_queue.cc:260] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.808642 29572 consensus_queue.cc:260] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.809645 29570 tablet_bootstrap.cc:492] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:18.810186 29570 ts_tablet_manager.cc:1403] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.062s	user 0.005s	sys 0.008s
I20260709 13:11:18.811434 29573 ts_tablet_manager.cc:1434] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.001s
I20260709 13:11:18.812608 29573 tablet_bootstrap.cc:492] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:18.813208 29570 raft_consensus.cc:359] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.814287 29570 raft_consensus.cc:385] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.814586 29570 raft_consensus.cc:740] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.815424 29570 consensus_queue.cc:260] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.818487 29570 ts_tablet_manager.cc:1434] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:11:18.819921 29570 tablet_bootstrap.cc:492] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:18.821503 29573 tablet_bootstrap.cc:654] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.821795 29572 ts_tablet_manager.cc:1434] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:11:18.822865 29572 tablet_bootstrap.cc:492] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:18.827513 29570 tablet_bootstrap.cc:654] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.831180 29572 tablet_bootstrap.cc:654] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.834622 29613 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.835376 29613 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.835418 29573 tablet_bootstrap.cc:492] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:18.837201 29573 ts_tablet_manager.cc:1403] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.004s
I20260709 13:11:18.839470 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:18.841332 29573 raft_consensus.cc:359] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:18.842000 29421 leader_election.cc:343] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:18.842207 29573 raft_consensus.cc:385] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.842782 29573 raft_consensus.cc:740] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.843933 29573 consensus_queue.cc:260] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.845890 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:18.846732 29573 ts_tablet_manager.cc:1434] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:11:18.847932 29573 tablet_bootstrap.cc:492] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:18.848373 29613 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:11:18.848085 29419 leader_election.cc:343] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:18.849524 29419 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:18.850822 29613 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:18.852873 29570 tablet_bootstrap.cc:492] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:18.854104 29572 tablet_bootstrap.cc:492] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:18.855324 29572 ts_tablet_manager.cc:1403] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.033s	user 0.020s	sys 0.008s
I20260709 13:11:18.856838 29570 ts_tablet_manager.cc:1403] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.008s
I20260709 13:11:18.858597 29572 raft_consensus.cc:359] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.859395 29572 raft_consensus.cc:385] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.859740 29572 raft_consensus.cc:740] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.860476 29572 consensus_queue.cc:260] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.861152 29573 tablet_bootstrap.cc:654] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.862764 29572 ts_tablet_manager.cc:1434] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:11:18.861049 29570 raft_consensus.cc:359] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.863564 29570 raft_consensus.cc:385] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.863871 29570 raft_consensus.cc:740] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.865033 29570 consensus_queue.cc:260] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.866925 29594 raft_consensus.cc:493] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.867441 29594 raft_consensus.cc:515] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.868016 29570 ts_tablet_manager.cc:1434] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:11:18.869071 29570 tablet_bootstrap.cc:492] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:18.869704 29594 leader_election.cc:290] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:18.872067 29572 tablet_bootstrap.cc:492] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:18.872254 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:18.872866 29380 raft_consensus.cc:2468] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 0.
I20260709 13:11:18.873958 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:18.875541 29570 tablet_bootstrap.cc:654] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:18.876523 29495 leader_election.cc:343] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:18.877342 29495 leader_election.cc:304] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:18.879381 29594 raft_consensus.cc:2804] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:18.880056 29594 raft_consensus.cc:493] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.880586 29594 raft_consensus.cc:3060] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.881660 29626 consensus_queue.cc:1048] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:18.881868 29602 consensus_queue.cc:1048] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:18.892951 29594 raft_consensus.cc:515] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.880602 29572 tablet_bootstrap.cc:654] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.903344 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:18.904067 29380 raft_consensus.cc:3060] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.904997 29573 tablet_bootstrap.cc:492] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:18.905519 29573 ts_tablet_manager.cc:1403] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.058s	user 0.023s	sys 0.003s
I20260709 13:11:18.908723 29573 raft_consensus.cc:359] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.909441 29573 raft_consensus.cc:385] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.909698 29573 raft_consensus.cc:740] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.910950 29573 consensus_queue.cc:260] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.912009 29648 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.914440 29570 tablet_bootstrap.cc:492] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:18.915148 29570 ts_tablet_manager.cc:1403] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.046s	user 0.018s	sys 0.006s
I20260709 13:11:18.914999 29648 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.917126 29626 consensus_queue.cc:1048] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:18.917588 29648 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:18.918867 29570 raft_consensus.cc:359] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.919673 29570 raft_consensus.cc:385] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.919983 29570 raft_consensus.cc:740] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.920332 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:18.920722 29570 consensus_queue.cc:260] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.921218 29453 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:18.924108 29346 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:18.924549 29573 ts_tablet_manager.cc:1434] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:11:18.925659 29573 tablet_bootstrap.cc:492] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:18.926060 29648 raft_consensus.cc:2804] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:18.926467 29648 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.928304 29380 raft_consensus.cc:2468] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:18.928799 29570 ts_tablet_manager.cc:1434] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:11:18.934095 29573 tablet_bootstrap.cc:654] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.935068 29570 tablet_bootstrap.cc:492] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:18.940213 29594 leader_election.cc:290] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:18.947290 29573 tablet_bootstrap.cc:492] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:18.947888 29573 ts_tablet_manager.cc:1403] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.011s
I20260709 13:11:18.949848 29572 tablet_bootstrap.cc:492] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:18.932984 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:18.949569 29613 consensus_queue.cc:1048] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:18.951920 29573 raft_consensus.cc:359] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.946683 29495 leader_election.cc:304] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:18.952699 29573 raft_consensus.cc:385] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.953007 29573 raft_consensus.cc:740] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.953444 29687 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:18.953531 29495 leader_election.cc:343] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:18.954002 29687 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.953820 29573 consensus_queue.cc:260] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.955966 29578 raft_consensus.cc:2804] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:18.956284 29572 ts_tablet_manager.cc:1403] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.084s	user 0.014s	sys 0.007s
I20260709 13:11:18.956720 29687 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:18.962122 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:18.962909 29572 raft_consensus.cc:359] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.965163 29572 raft_consensus.cc:385] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.965644 29572 raft_consensus.cc:740] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.964689 29573 ts_tablet_manager.cc:1434] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:11:18.964740 29570 tablet_bootstrap.cc:654] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.967733 29573 tablet_bootstrap.cc:492] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:18.966671 29572 consensus_queue.cc:260] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.926872 29648 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.971096 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:18.974591 29526 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:18.977037 29572 ts_tablet_manager.cc:1434] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:11:18.978713 29572 tablet_bootstrap.cc:492] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:18.983865 29613 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.985015 29613 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.987739 29578 raft_consensus.cc:697] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:18.989115 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:18.988875 29578 consensus_queue.cc:237] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:18.992004 29570 tablet_bootstrap.cc:492] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:18.992684 29570 ts_tablet_manager.cc:1403] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.058s	user 0.008s	sys 0.009s
I20260709 13:11:18.995230 29573 tablet_bootstrap.cc:654] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.996665 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:11:18.998416 29495 leader_election.cc:343] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:18.999809 29495 leader_election.cc:343] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:19.001585 29691 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.003279 29691 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:19.006554 29613 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:19.007090 29648 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:19.010993 29572 tablet_bootstrap.cc:654] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.000540 29495 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:19.018961 29648 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:19.019313 29578 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:19.018229 29570 raft_consensus.cc:359] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:19.020282 29570 raft_consensus.cc:385] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.020608 29570 raft_consensus.cc:740] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
W20260709 13:11:19.053548 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 55618.8us
W20260709 13:11:19.064435 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 64521.3us
I20260709 13:11:19.063329 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:19.084005 29455 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.070855 29573 tablet_bootstrap.cc:492] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:19.085597 29573 ts_tablet_manager.cc:1403] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.118s	user 0.020s	sys 0.010s
I20260709 13:11:19.074541 29648 consensus_queue.cc:1048] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:19.091006 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:19.092777 29528 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.091069 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:19.099166 29573 raft_consensus.cc:359] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:19.100140 29573 raft_consensus.cc:385] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.100481 29573 raft_consensus.cc:740] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.103296 29570 consensus_queue.cc:260] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:19.104010 29573 consensus_queue.cc:260] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:19.109216 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:19.112006 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:19.115646 29454 raft_consensus.cc:2468] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 0.
I20260709 13:11:19.114372 29626 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.115849 29526 raft_consensus.cc:2393] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 1: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:19.125519 29495 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:19.023285 29691 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:19.113912 29570 ts_tablet_manager.cc:1434] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.121s	user 0.006s	sys 0.006s
I20260709 13:11:19.126349 29654 consensus_queue.cc:1048] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:11:19.127058 29613 consensus_queue.cc:1048] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:11:19.145054 29687 raft_consensus.cc:2804] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:19.145557 29687 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.145942 29687 raft_consensus.cc:3060] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.146543 29455 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:19.147850 29572 tablet_bootstrap.cc:492] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:19.149163 29572 ts_tablet_manager.cc:1403] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.171s	user 0.016s	sys 0.005s
I20260709 13:11:19.149758 29346 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:19.151907 29625 raft_consensus.cc:2804] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:11:19.136840 29495 leader_election.cc:343] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:19.134689 29626 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:19.156773 29602 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.156805 29570 tablet_bootstrap.cc:492] T abd2ad92265844ca9eb9012eb76e7789 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:19.161940 29691 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.162951 29691 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:19.163393 29602 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:19.165369 29573 ts_tablet_manager.cc:1434] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.079s	user 0.008s	sys 0.006s
I20260709 13:11:19.166070 29691 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:19.166105 29602 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:19.161329 29528 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:19.167862 29419 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:19.169113 29613 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.172369 29573 tablet_bootstrap.cc:492] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:19.177043 29626 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:19.180922 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:19.184087 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:19.184976 29526 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:19.178263 29602 consensus_queue.cc:1048] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 13:11:19.187362 29648 consensus_queue.cc:1048] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
W20260709 13:11:19.205369 29344 leader_election.cc:343] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:19.203612 29625 raft_consensus.cc:697] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:19.222031 29528 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.223912 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:11:19.225680 29699 log.cc:927] Time spent T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 13:11:19.221235 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 60415.4us
I20260709 13:11:19.230247 29625 consensus_queue.cc:237] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:19.220620 29344 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:19.234885 29703 raft_consensus.cc:2804] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:19.235397 29572 raft_consensus.cc:359] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:19.236313 29572 raft_consensus.cc:385] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.236683 29572 raft_consensus.cc:740] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
W20260709 13:11:19.246986 29495 leader_election.cc:343] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:19.249425 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:19.250932 29648 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.245051 29572 consensus_queue.cc:260] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:19.237648 29703 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.259708 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:19.259864 29700 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.262081 29572 ts_tablet_manager.cc:1434] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.113s	user 0.011s	sys 0.000s
I20260709 13:11:19.261739 29700 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:19.268324 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:11:19.258625 29495 leader_election.cc:343] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:19.257606 29703 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.251616 29648 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:19.259246 29613 raft_consensus.cc:2749] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:19.287715 29453 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:19.314487 29602 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.280434 29495 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:19.320827 29602 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:19.329497 29572 tablet_bootstrap.cc:492] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:19.333374 29594 raft_consensus.cc:2749] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:19.327747 29346 leader_election.cc:343] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:19.338703 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 82943.1us
I20260709 13:11:19.355198 29602 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:19.343720 29346 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:19.346964 29700 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:19.344568 29279 catalog_manager.cc:5697] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 0 to 1, leader changed from <none> to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 1 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:19.359755 29602 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:19.361181 29691 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.361917 29626 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.366981 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:19.371753 29527 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:19.367727 29602 consensus_queue.cc:1048] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:11:19.369527 29626 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:19.379828 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:19.380340 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:19.380594 29453 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:19.382035 29626 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:19.386377 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:19.387338 29524 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:19.369313 29691 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:19.390618 29702 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.391687 29702 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:19.394268 29691 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:19.394615 29702 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:19.378108 29700 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.395776 29700 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:19.396628 29573 tablet_bootstrap.cc:654] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.398811 29344 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:19.402679 29626 raft_consensus.cc:2804] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:19.408915 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:19.409868 29524 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:19.410219 29687 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:19.411151 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:11:19.514539 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 65181.9us
I20260709 13:11:19.516633 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:19.449859 29703 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:19.447788 29570 tablet_bootstrap.cc:654] T abd2ad92265844ca9eb9012eb76e7789 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.519209 29687 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:19.401095 29648 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:19.405632 29626 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:19.499760 29705 log.cc:927] Time spent T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:11:19.525535 29572 tablet_bootstrap.cc:654] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.411334 29344 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:19.525506 29626 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.531427 29700 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:19.535225 29703 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:11:19.523625 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 73518.6us
W20260709 13:11:19.537978 29704 log.cc:927] Time spent T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:11:19.542017 29625 raft_consensus.cc:2804] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:11:19.542678 29495 leader_election.cc:343] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:19.546325 29703 consensus_queue.cc:1048] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260709 13:11:19.542441 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 129800us
I20260709 13:11:19.552829 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:19.553644 29452 raft_consensus.cc:3060] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.546850 29625 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.563448 29592 consensus_queue.cc:1048] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:19.565495 29573 tablet_bootstrap.cc:492] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:19.566383 29573 ts_tablet_manager.cc:1403] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.399s	user 0.011s	sys 0.024s
I20260709 13:11:19.569212 29654 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.569809 29654 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:19.571404 29573 raft_consensus.cc:359] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:19.572330 29573 raft_consensus.cc:385] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.572701 29573 raft_consensus.cc:740] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.555344 29625 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.564896 29344 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:19.573043 29654 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:19.573750 29573 consensus_queue.cc:260] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:19.581367 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:19.582202 29713 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:19.582511 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:19.589820 29456 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:19.592344 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:19.593134 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:19.594449 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:19.597090 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:19.597925 29451 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.598518 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:19.628737 29626 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:19.630209 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:19.631063 29524 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.599099 29713 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.678200 29713 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.707523 29573 ts_tablet_manager.cc:1434] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.140s	user 0.010s	sys 0.000s
W20260709 13:11:19.745321 29495 leader_election.cc:343] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:19.780624 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:19.782714 29570 tablet_bootstrap.cc:492] T abd2ad92265844ca9eb9012eb76e7789 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:19.782979 29495 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:19.783412 29570 ts_tablet_manager.cc:1403] T abd2ad92265844ca9eb9012eb76e7789 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.633s	user 0.026s	sys 0.091s
I20260709 13:11:19.783663 29573 tablet_bootstrap.cc:492] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:19.787385 29572 tablet_bootstrap.cc:492] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:19.788040 29572 ts_tablet_manager.cc:1403] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.473s	user 0.023s	sys 0.019s
I20260709 13:11:19.790198 29700 raft_consensus.cc:2749] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:19.788280 29687 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.791381 29687 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:19.791530 29625 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:19.793047 29377 raft_consensus.cc:2393] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 1: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:19.793896 29687 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:19.749281 29451 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:19.774431 29452 raft_consensus.cc:2468] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
W20260709 13:11:19.795708 29327 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:19.798553 29625 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:19.803177 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:19.776007 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:11:19.805306 29495 leader_election.cc:343] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:19.811391 29495 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:19.812785 29687 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:19.802704 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:19.813946 29526 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 0.
I20260709 13:11:19.814936 29700 consensus_queue.cc:1048] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:19.799300 29713 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:19.818429 29626 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:19.818909 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:19.821415 29713 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:19.823344 29377 raft_consensus.cc:2393] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 1: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:19.809551 29524 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:19.816296 29570 raft_consensus.cc:359] T abd2ad92265844ca9eb9012eb76e7789 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:19.832435 29570 raft_consensus.cc:385] T abd2ad92265844ca9eb9012eb76e7789 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.832754 29570 raft_consensus.cc:740] T abd2ad92265844ca9eb9012eb76e7789 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.832037 29572 raft_consensus.cc:359] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:19.833258 29572 raft_consensus.cc:385] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.833590 29572 raft_consensus.cc:740] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.833518 29570 consensus_queue.cc:260] T abd2ad92265844ca9eb9012eb76e7789 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:19.834372 29572 consensus_queue.cc:260] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:19.834676 29346 leader_election.cc:343] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:19.836050 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:19.836493 29495 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:19.837673 29700 raft_consensus.cc:2804] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:11:19.837858 29495 consensus_peers.cc:597] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:19.838272 29700 raft_consensus.cc:697] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
W20260709 13:11:19.838632 29495 leader_election.cc:343] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:19.839097 29570 ts_tablet_manager.cc:1434] T abd2ad92265844ca9eb9012eb76e7789 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260709 13:11:19.839831 29572 ts_tablet_manager.cc:1434] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 13:11:19.840338 29570 tablet_bootstrap.cc:492] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:19.836683 29524 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.839983 29700 consensus_queue.cc:237] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:19.842479 29654 raft_consensus.cc:493] T abd2ad92265844ca9eb9012eb76e7789 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.843170 29654 raft_consensus.cc:515] T abd2ad92265844ca9eb9012eb76e7789 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:19.840334 29346 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:19.845654 29654 leader_election.cc:290] T abd2ad92265844ca9eb9012eb76e7789 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:19.847687 29625 raft_consensus.cc:2804] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:19.848235 29625 raft_consensus.cc:697] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:11:19.848346 29495 leader_election.cc:343] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:19.849493 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:19.849686 29495 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:19.851392 29687 raft_consensus.cc:2749] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:19.843196 29572 tablet_bootstrap.cc:492] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:19.852487 29648 consensus_queue.cc:1048] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:19.851979 29495 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:19.849715 29625 consensus_queue.cc:237] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:19.855978 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:19.856633 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:19.857348 29525 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.858064 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:19.858748 29454 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.859413 29526 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.869488 29526 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
W20260709 13:11:19.855238 29495 leader_election.cc:343] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:19.871534 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:19.874675 29455 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.875571 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:19.876740 29377 raft_consensus.cc:2393] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 1: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:11:19.873508 29524 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:19.878391 29687 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:19.882179 29454 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:19.882532 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:19.886520 29344 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:19.889062 29626 raft_consensus.cc:2804] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:19.889665 29626 raft_consensus.cc:697] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:19.889664 29419 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:19.890897 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:19.890842 29626 consensus_queue.cc:237] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:19.906033 29570 tablet_bootstrap.cc:654] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.910368 29572 tablet_bootstrap.cc:654] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.910202 29455 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:19.912569 29525 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:19.922600 29573 tablet_bootstrap.cc:654] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.928889 29421 leader_election.cc:304] T abd2ad92265844ca9eb9012eb76e7789 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:11:19.924396 29495 leader_election.cc:343] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:19.913008 29344 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:19.931869 29613 raft_consensus.cc:3060] T abd2ad92265844ca9eb9012eb76e7789 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.935779 29495 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:19.936892 29344 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:19.937753 29713 raft_consensus.cc:2804] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:19.938271 29713 raft_consensus.cc:697] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:11:19.938369 29346 leader_election.cc:343] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:19.918011 29654 raft_consensus.cc:2764] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:11:19.941155 29687 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:19.941238 29713 consensus_queue.cc:237] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:19.942042 29701 consensus_queue.cc:1048] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:19.939611 29711 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:19.947690 29701 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.946210 29711 raft_consensus.cc:697] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:19.948246 29701 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:19.949364 29711 consensus_queue.cc:237] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:19.953127 29701 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:19.966372 29573 tablet_bootstrap.cc:492] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:19.967016 29573 ts_tablet_manager.cc:1403] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.186s	user 0.011s	sys 0.010s
I20260709 13:11:19.967203 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:19.968456 29453 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:19.970712 29573 raft_consensus.cc:359] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:19.971632 29573 raft_consensus.cc:385] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.971941 29573 raft_consensus.cc:740] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.957281 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:19.955742 29276 catalog_manager.cc:5697] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:19.977629 29573 consensus_queue.cc:260] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:19.979843 29346 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:11:19.980703 29344 leader_election.cc:343] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:19.981807 29703 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:19.982971 29703 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.983330 29703 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:19.984367 29573 ts_tablet_manager.cc:1434] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.003s
I20260709 13:11:19.988582 29613 raft_consensus.cc:2749] T abd2ad92265844ca9eb9012eb76e7789 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:19.992094 29573 tablet_bootstrap.cc:492] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:20.049504 29572 tablet_bootstrap.cc:492] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:20.045802 29703 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.071111 29570 tablet_bootstrap.cc:492] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:20.063074 29277 catalog_manager.cc:5697] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 0 to 1, leader changed from <none> to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 1 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:20.071640 29572 ts_tablet_manager.cc:1403] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.229s	user 0.011s	sys 0.012s
I20260709 13:11:20.073190 29703 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:20.075366 29570 ts_tablet_manager.cc:1403] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.235s	user 0.032s	sys 0.010s
I20260709 13:11:20.074795 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:11:20.077843 29344 leader_election.cc:343] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:20.081336 29572 raft_consensus.cc:359] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.081955 29572 raft_consensus.cc:385] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:20.082226 29572 raft_consensus.cc:740] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:20.082944 29572 consensus_queue.cc:260] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.085636 29572 ts_tablet_manager.cc:1434] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:11:20.086859 29572 tablet_bootstrap.cc:492] T 4cced75430d1485689f4eff61c816af0 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:20.097050 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:20.098410 29453 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:20.091861 29573 tablet_bootstrap.cc:654] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:20.097258 29570 raft_consensus.cc:359] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.104596 29570 raft_consensus.cc:385] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:20.104894 29570 raft_consensus.cc:740] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:20.110528 29453 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:20.113003 29572 tablet_bootstrap.cc:654] T 4cced75430d1485689f4eff61c816af0 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:20.114427 29570 consensus_queue.cc:260] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.115660 29346 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:20.117362 29570 ts_tablet_manager.cc:1434] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 13:11:20.118834 29570 tablet_bootstrap.cc:492] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:20.123855 29703 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:20.128187 29703 raft_consensus.cc:697] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:20.129419 29703 consensus_queue.cc:237] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.144272 29570 tablet_bootstrap.cc:654] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:20.146265 29592 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.146776 29573 tablet_bootstrap.cc:492] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:20.147475 29573 ts_tablet_manager.cc:1403] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.156s	user 0.017s	sys 0.016s
I20260709 13:11:20.147063 29592 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.154531 29573 raft_consensus.cc:359] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.155529 29573 raft_consensus.cc:385] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:20.155864 29573 raft_consensus.cc:740] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:20.161098 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:20.162237 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:20.162684 29573 consensus_queue.cc:260] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:20.163195 29419 leader_election.cc:343] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:20.151381 29592 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:20.165161 29573 ts_tablet_manager.cc:1434] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:11:20.166291 29573 tablet_bootstrap.cc:492] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:20.166901 29279 catalog_manager.cc:5697] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:20.170183 29279 catalog_manager.cc:5697] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:20.173403 29572 tablet_bootstrap.cc:492] T 4cced75430d1485689f4eff61c816af0 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:20.173975 29572 ts_tablet_manager.cc:1403] T 4cced75430d1485689f4eff61c816af0 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.087s	user 0.014s	sys 0.011s
I20260709 13:11:20.163142 29377 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 0.
I20260709 13:11:20.178625 29421 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:20.181205 29592 raft_consensus.cc:2804] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:20.181810 29592 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.181512 29279 catalog_manager.cc:5697] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:20.182245 29592 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:20.185086 29572 raft_consensus.cc:359] T 4cced75430d1485689f4eff61c816af0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.186026 29572 raft_consensus.cc:385] T 4cced75430d1485689f4eff61c816af0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:20.186363 29572 raft_consensus.cc:740] T 4cced75430d1485689f4eff61c816af0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:20.185701 29279 catalog_manager.cc:5697] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:20.191278 29573 tablet_bootstrap.cc:654] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:20.187323 29572 consensus_queue.cc:260] T 4cced75430d1485689f4eff61c816af0 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.194847 29700 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.195518 29700 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.196314 29572 ts_tablet_manager.cc:1434] T 4cced75430d1485689f4eff61c816af0 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 13:11:20.197480 29572 tablet_bootstrap.cc:492] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:20.198091 29592 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.200927 29592 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:20.201609 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:20.201956 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:20.202519 29380 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:20.203919 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:11:20.206249 29495 leader_election.cc:343] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:20.207266 29419 leader_election.cc:343] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:20.208995 29700 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:20.211030 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:20.215420 29570 tablet_bootstrap.cc:492] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:20.216022 29570 ts_tablet_manager.cc:1403] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.098s	user 0.020s	sys 0.030s
I20260709 13:11:20.219556 29572 tablet_bootstrap.cc:654] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:20.224713 29495 leader_election.cc:343] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:20.224853 29380 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 1.
I20260709 13:11:20.224577 29570 raft_consensus.cc:359] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.225579 29570 raft_consensus.cc:385] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:20.225842 29570 raft_consensus.cc:740] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:20.225521 29495 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:20.227725 29700 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:20.228175 29570 consensus_queue.cc:260] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.229290 29421 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:20.230924 29570 ts_tablet_manager.cc:1434] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.002s
I20260709 13:11:20.230958 29654 raft_consensus.cc:2804] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:20.231739 29654 raft_consensus.cc:697] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:20.232374 29570 tablet_bootstrap.cc:492] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:20.232722 29654 consensus_queue.cc:237] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.249395 29573 tablet_bootstrap.cc:492] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:20.252136 29573 ts_tablet_manager.cc:1403] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.086s	user 0.012s	sys 0.013s
I20260709 13:11:20.258661 29573 raft_consensus.cc:359] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.261111 29573 raft_consensus.cc:385] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:20.262868 29573 raft_consensus.cc:740] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:20.265244 29570 tablet_bootstrap.cc:654] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:20.269562 29573 consensus_queue.cc:260] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.277134 29279 catalog_manager.cc:5697] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:20.279084 29573 ts_tablet_manager.cc:1434] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.002s
I20260709 13:11:20.281736 29573 tablet_bootstrap.cc:492] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:20.283381 29700 consensus_queue.cc:1048] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:20.300984 29573 tablet_bootstrap.cc:654] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:20.305176 29703 consensus_queue.cc:1048] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:20.310438 29572 tablet_bootstrap.cc:492] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:20.312512 29572 ts_tablet_manager.cc:1403] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.115s	user 0.011s	sys 0.009s
I20260709 13:11:20.316324 29572 raft_consensus.cc:359] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:20.316507 29346 consensus_peers.cc:597] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:20.319741 29572 raft_consensus.cc:385] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:20.320642 29570 tablet_bootstrap.cc:492] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:20.321063 29700 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.322799 29572 raft_consensus.cc:740] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:20.322925 29700 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.324004 29570 ts_tablet_manager.cc:1403] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.092s	user 0.028s	sys 0.014s
I20260709 13:11:20.328068 29700 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:20.329166 29572 consensus_queue.cc:260] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.330036 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:20.330856 29453 raft_consensus.cc:2393] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 1: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:20.330715 29570 raft_consensus.cc:359] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.331449 29572 ts_tablet_manager.cc:1434] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:11:20.331420 29570 raft_consensus.cc:385] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:20.331975 29570 raft_consensus.cc:740] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:20.332962 29572 tablet_bootstrap.cc:492] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:20.333755 29570 consensus_queue.cc:260] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.337734 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:20.338168 29573 tablet_bootstrap.cc:492] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:20.338681 29573 ts_tablet_manager.cc:1403] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.057s	user 0.013s	sys 0.000s
I20260709 13:11:20.340328 29572 tablet_bootstrap.cc:654] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:20.342010 29573 raft_consensus.cc:359] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.343050 29573 raft_consensus.cc:385] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:20.343405 29573 raft_consensus.cc:740] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:20.347399 29573 consensus_queue.cc:260] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.349328 29573 ts_tablet_manager.cc:1434] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:11:20.349159 29703 consensus_queue.cc:1048] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:20.345271 29570 ts_tablet_manager.cc:1434] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.002s
I20260709 13:11:20.354645 29495 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:20.356634 29573 tablet_bootstrap.cc:492] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:20.356729 29700 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:20.329166 29276 catalog_manager.cc:5697] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 0 to 1, leader changed from <none> to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 1 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:20.375202 29703 consensus_queue.cc:1048] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:20.376451 29380 raft_consensus.cc:3060] T 4cced75430d1485689f4eff61c816af0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:20.389854 29700 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:20.400722 29570 tablet_bootstrap.cc:492] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:20.416181 29572 tablet_bootstrap.cc:492] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:20.416844 29572 ts_tablet_manager.cc:1403] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.084s	user 0.028s	sys 0.013s
I20260709 13:11:20.400060 29711 consensus_queue.cc:1048] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:11:20.412055 29703 consensus_queue.cc:1048] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:11:20.432545 29572 raft_consensus.cc:359] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.433490 29572 raft_consensus.cc:385] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:20.433846 29572 raft_consensus.cc:740] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:20.434743 29572 consensus_queue.cc:260] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.441871 29573 tablet_bootstrap.cc:654] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:20.454537 29572 ts_tablet_manager.cc:1434] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.037s	user 0.009s	sys 0.000s
I20260709 13:11:20.458539 29700 consensus_queue.cc:1048] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:20.459405 29572 tablet_bootstrap.cc:492] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:20.461493 29713 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.462553 29713 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.478221 29713 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:20.487020 29570 tablet_bootstrap.cc:654] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:20.493964 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:11:20.502244 29344 leader_election.cc:343] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:20.506886 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:20.515336 29573 tablet_bootstrap.cc:492] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:20.515910 29573 ts_tablet_manager.cc:1403] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.160s	user 0.012s	sys 0.011s
I20260709 13:11:20.528256 29572 tablet_bootstrap.cc:654] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:20.532081 29346 leader_election.cc:343] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:20.537678 29573 raft_consensus.cc:359] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.539409 29573 raft_consensus.cc:385] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:20.539842 29573 raft_consensus.cc:740] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:20.544405 29573 consensus_queue.cc:260] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.544421 29346 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:20.549444 29726 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:20.552839 29711 consensus_queue.cc:1048] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:20.557053 29711 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.557588 29711 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.559850 29711 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:20.565279 29671 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.567088 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:20.567394 29573 ts_tablet_manager.cc:1434] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.051s	user 0.009s	sys 0.000s
I20260709 13:11:20.567642 29746 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.570392 29746 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.569702 29671 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.573784 29746 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:20.573793 29671 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:20.577415 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:20.575783 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:11:20.579228 29421 leader_election.cc:343] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:20.569779 29525 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:20.581470 29344 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:20.582690 29703 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:20.583072 29703 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.575671 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:20.583523 29703 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:20.584002 29377 raft_consensus.cc:2393] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 1: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:11:20.585404 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:20.588438 29573 tablet_bootstrap.cc:492] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:20.589960 29711 consensus_queue.cc:1048] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:20.590154 29495 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:20.591444 29746 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:20.595779 29570 tablet_bootstrap.cc:492] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:20.596257 29570 ts_tablet_manager.cc:1403] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.242s	user 0.038s	sys 0.028s
I20260709 13:11:20.608887 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:20.609768 29526 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 0.
I20260709 13:11:20.613236 29419 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:20.614164 29671 raft_consensus.cc:2804] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:20.614578 29671 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.615000 29671 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:20.648341 29570 raft_consensus.cc:359] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.649176 29570 raft_consensus.cc:385] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:20.649472 29570 raft_consensus.cc:740] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:20.650240 29570 consensus_queue.cc:260] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.651963 29570 ts_tablet_manager.cc:1434] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.055s	user 0.010s	sys 0.010s
I20260709 13:11:20.653014 29570 tablet_bootstrap.cc:492] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:20.654899 29573 tablet_bootstrap.cc:654] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:20.619791 29711 consensus_queue.cc:1048] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
W20260709 13:11:20.657335 29346 leader_election.cc:343] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:20.658674 29703 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.664139 29572 tablet_bootstrap.cc:492] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:20.664657 29572 ts_tablet_manager.cc:1403] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.206s	user 0.032s	sys 0.020s
I20260709 13:11:20.662539 29700 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.665416 29671 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.668095 29700 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.675602 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:20.676900 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:20.677629 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:20.678342 29380 raft_consensus.cc:2468] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 0.
W20260709 13:11:20.678826 29495 leader_election.cc:343] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:20.678864 29592 consensus_queue.cc:1048] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:11:20.679410 29421 leader_election.cc:343] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:20.681358 29700 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:20.682665 29671 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:20.685372 29703 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:20.686113 29495 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:20.687693 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:20.688380 29529 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:20.690229 29746 raft_consensus.cc:2749] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:20.693974 29700 raft_consensus.cc:2804] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:20.695016 29700 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.695561 29700 raft_consensus.cc:3060] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:20.695616 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:20.696590 29525 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:20.705734 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:11:20.710877 29346 leader_election.cc:343] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:20.712247 29573 tablet_bootstrap.cc:492] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:20.712868 29573 ts_tablet_manager.cc:1403] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.125s	user 0.013s	sys 0.003s
I20260709 13:11:20.725263 29573 raft_consensus.cc:359] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.726233 29573 raft_consensus.cc:385] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:20.726603 29573 raft_consensus.cc:740] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:20.727432 29573 consensus_queue.cc:260] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.707858 29529 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:20.707861 29700 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.731581 29570 tablet_bootstrap.cc:654] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:20.731756 29573 ts_tablet_manager.cc:1434] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:11:20.733881 29573 tablet_bootstrap.cc:492] T 8e9b44184de046118890bc6cd6e1dc18 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:20.739441 29344 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:20.744309 29572 raft_consensus.cc:359] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.745231 29572 raft_consensus.cc:385] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:20.745560 29572 raft_consensus.cc:740] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:20.745782 29711 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:20.746403 29711 raft_consensus.cc:697] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:20.747813 29711 consensus_queue.cc:237] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.751911 29654 consensus_queue.cc:1048] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:20.757277 29572 consensus_queue.cc:260] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.762233 29572 ts_tablet_manager.cc:1434] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.097s	user 0.009s	sys 0.002s
I20260709 13:11:20.742655 29525 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 1.
I20260709 13:11:20.793442 29654 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.793735 29700 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:20.794152 29654 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.801448 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:20.802187 29378 raft_consensus.cc:3060] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:20.802944 29572 tablet_bootstrap.cc:492] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:20.803150 29419 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:20.804956 29671 raft_consensus.cc:2804] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:20.802026 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:20.805861 29671 raft_consensus.cc:697] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:20.806571 29703 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.806806 29671 consensus_queue.cc:237] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.807071 29703 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.808775 29726 consensus_queue.cc:1048] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:20.809293 29703 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:20.811962 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:20.812191 29592 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.812289 29654 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:20.812704 29592 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.815049 29592 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:20.816701 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:20.817353 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:11:20.818207 29346 leader_election.cc:343] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:20.829077 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:11:20.829631 29421 leader_election.cc:343] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:20.829957 29525 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
W20260709 13:11:20.845865 29495 leader_election.cc:343] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:20.849033 29344 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:20.849609 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:20.850291 29525 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 0.
I20260709 13:11:20.851003 29703 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:20.851428 29703 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.851908 29703 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:20.852830 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:20.856317 29419 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:20.857658 29572 tablet_bootstrap.cc:654] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:20.857812 29419 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:20.859649 29573 tablet_bootstrap.cc:654] T 8e9b44184de046118890bc6cd6e1dc18 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:20.860608 29592 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:20.860997 29592 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.861541 29592 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:20.863674 29654 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:20.857842 29378 raft_consensus.cc:2468] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:20.876825 29570 tablet_bootstrap.cc:492] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:20.877389 29570 ts_tablet_manager.cc:1403] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.225s	user 0.013s	sys 0.022s
I20260709 13:11:20.878118 29495 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:20.880380 29703 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.883311 29455 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:20.883632 29700 raft_consensus.cc:2804] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:20.884143 29700 raft_consensus.cc:697] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:20.885015 29700 consensus_queue.cc:237] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.885492 29703 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:11:20.885967 29327 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:20.897511 29570 raft_consensus.cc:359] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.908059 29570 raft_consensus.cc:385] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:20.908449 29570 raft_consensus.cc:740] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:20.923892 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:20.924589 29524 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:20.922763 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:20.936780 29592 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.939797 29572 tablet_bootstrap.cc:492] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:20.940497 29572 ts_tablet_manager.cc:1403] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.177s	user 0.023s	sys 0.012s
I20260709 13:11:20.947300 29570 consensus_queue.cc:260] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.948488 29453 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:20.949232 29570 ts_tablet_manager.cc:1434] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.072s	user 0.007s	sys 0.005s
I20260709 13:11:20.950440 29570 tablet_bootstrap.cc:492] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:20.958420 29453 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:20.958516 29277 catalog_manager.cc:5697] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 0 to 1, leader changed from <none> to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 1 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:20.961670 29346 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:20.967376 29703 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:20.967947 29703 raft_consensus.cc:697] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:20.969573 29572 raft_consensus.cc:359] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:20.970065 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:20.970383 29572 raft_consensus.cc:385] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:20.970675 29572 raft_consensus.cc:740] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:20.971446 29572 consensus_queue.cc:260] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:20.978048 29421 leader_election.cc:343] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:20.990046 29572 ts_tablet_manager.cc:1434] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.001s
I20260709 13:11:20.968829 29703 consensus_queue.cc:237] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.003078 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:21.003903 29529 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:21.007472 29572 tablet_bootstrap.cc:492] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:20.993355 29592 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:21.015223 29746 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.016526 29746 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.018746 29746 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:21.014228 29524 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:21.021216 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:21.022152 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:11:21.024012 29495 leader_election.cc:343] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:21.024794 29495 leader_election.cc:343] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:21.025228 29495 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:21.028723 29570 tablet_bootstrap.cc:654] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.029758 29746 raft_consensus.cc:2749] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:21.029260 29529 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 1.
I20260709 13:11:21.036275 29573 tablet_bootstrap.cc:492] T 8e9b44184de046118890bc6cd6e1dc18 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:21.036484 29419 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:21.036834 29573 ts_tablet_manager.cc:1403] T 8e9b44184de046118890bc6cd6e1dc18 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.303s	user 0.029s	sys 0.015s
I20260709 13:11:21.037794 29592 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:21.038349 29592 raft_consensus.cc:697] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:21.039240 29592 consensus_queue.cc:237] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.041901 29573 raft_consensus.cc:359] T 8e9b44184de046118890bc6cd6e1dc18 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.043130 29573 raft_consensus.cc:385] T 8e9b44184de046118890bc6cd6e1dc18 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.043812 29573 raft_consensus.cc:740] T 8e9b44184de046118890bc6cd6e1dc18 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.045291 29573 consensus_queue.cc:260] T 8e9b44184de046118890bc6cd6e1dc18 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.047593 29572 tablet_bootstrap.cc:654] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.054242 29570 tablet_bootstrap.cc:492] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:21.054970 29570 ts_tablet_manager.cc:1403] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.105s	user 0.014s	sys 0.006s
I20260709 13:11:21.055770 29573 ts_tablet_manager.cc:1434] T 8e9b44184de046118890bc6cd6e1dc18 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 13:11:21.057152 29573 tablet_bootstrap.cc:492] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:21.058279 29570 raft_consensus.cc:359] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.058967 29570 raft_consensus.cc:385] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.059226 29570 raft_consensus.cc:740] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.060036 29570 consensus_queue.cc:260] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.063400 29570 ts_tablet_manager.cc:1434] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:11:21.064610 29570 tablet_bootstrap.cc:492] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:21.069419 29279 catalog_manager.cc:5697] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:21.076185 29573 tablet_bootstrap.cc:654] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.080016 29570 tablet_bootstrap.cc:654] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.102864 29572 tablet_bootstrap.cc:492] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:21.103368 29572 ts_tablet_manager.cc:1403] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.096s	user 0.015s	sys 0.013s
I20260709 13:11:21.106379 29572 raft_consensus.cc:359] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.107133 29572 raft_consensus.cc:385] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.107412 29572 raft_consensus.cc:740] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.108098 29572 consensus_queue.cc:260] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.110474 29572 ts_tablet_manager.cc:1434] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:11:21.110134 29277 catalog_manager.cc:5697] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 0 to 1, leader changed from <none> to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 1 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:21.111764 29572 tablet_bootstrap.cc:492] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:21.118412 29572 tablet_bootstrap.cc:654] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.120909 29573 tablet_bootstrap.cc:492] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:21.121433 29573 ts_tablet_manager.cc:1403] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.065s	user 0.010s	sys 0.011s
I20260709 13:11:21.122965 29570 tablet_bootstrap.cc:492] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:21.123689 29570 ts_tablet_manager.cc:1403] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.059s	user 0.010s	sys 0.017s
I20260709 13:11:21.124755 29573 raft_consensus.cc:359] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.124400 29276 catalog_manager.cc:5697] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 0 to 1, leader changed from <none> to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 1 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:21.125703 29573 raft_consensus.cc:385] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.126011 29573 raft_consensus.cc:740] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.126703 29573 consensus_queue.cc:260] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.127290 29570 raft_consensus.cc:359] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.128013 29570 raft_consensus.cc:385] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.128269 29570 raft_consensus.cc:740] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.129563 29573 ts_tablet_manager.cc:1434] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:11:21.129153 29570 consensus_queue.cc:260] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.131410 29570 ts_tablet_manager.cc:1434] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:21.132571 29570 tablet_bootstrap.cc:492] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:21.133294 29573 tablet_bootstrap.cc:492] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:21.141855 29279 catalog_manager.cc:5697] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:21.155414 29570 tablet_bootstrap.cc:654] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.156852 29573 tablet_bootstrap.cc:654] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.162755 29572 tablet_bootstrap.cc:492] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:21.163278 29572 ts_tablet_manager.cc:1403] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.052s	user 0.020s	sys 0.008s
I20260709 13:11:21.166249 29572 raft_consensus.cc:359] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.167168 29572 raft_consensus.cc:385] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.167443 29572 raft_consensus.cc:740] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.170063 29572 consensus_queue.cc:260] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.175074 29572 ts_tablet_manager.cc:1434] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:11:21.176286 29572 tablet_bootstrap.cc:492] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:21.194276 29572 tablet_bootstrap.cc:654] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.206353 29572 tablet_bootstrap.cc:492] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:21.207022 29572 ts_tablet_manager.cc:1403] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.003s
I20260709 13:11:21.209110 29570 tablet_bootstrap.cc:492] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:21.210158 29572 raft_consensus.cc:359] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.210956 29572 raft_consensus.cc:385] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.211685 29570 ts_tablet_manager.cc:1403] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.079s	user 0.037s	sys 0.023s
I20260709 13:11:21.213712 29573 tablet_bootstrap.cc:492] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:21.214258 29573 ts_tablet_manager.cc:1403] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.081s	user 0.009s	sys 0.020s
I20260709 13:11:21.215445 29570 raft_consensus.cc:359] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.216565 29570 raft_consensus.cc:385] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.217214 29570 raft_consensus.cc:740] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.217465 29573 raft_consensus.cc:359] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.218420 29573 raft_consensus.cc:385] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.218796 29573 raft_consensus.cc:740] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.218047 29570 consensus_queue.cc:260] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.220865 29570 ts_tablet_manager.cc:1434] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:11:21.221946 29573 consensus_queue.cc:260] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.222792 29570 tablet_bootstrap.cc:492] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:21.224243 29573 ts_tablet_manager.cc:1434] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:11:21.211225 29572 raft_consensus.cc:740] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.225214 29572 consensus_queue.cc:260] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.226883 29573 tablet_bootstrap.cc:492] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:21.231426 29570 tablet_bootstrap.cc:654] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.234655 29573 tablet_bootstrap.cc:654] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.237651 29572 ts_tablet_manager.cc:1434] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.001s
I20260709 13:11:21.239002 29572 tablet_bootstrap.cc:492] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:21.248072 29572 tablet_bootstrap.cc:654] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.248543 29570 tablet_bootstrap.cc:492] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:21.249101 29570 ts_tablet_manager.cc:1403] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.002s
I20260709 13:11:21.255906 29570 raft_consensus.cc:359] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.256902 29570 raft_consensus.cc:385] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.257295 29570 raft_consensus.cc:740] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.258039 29570 consensus_queue.cc:260] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.259337 29455 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:21.260390 29573 tablet_bootstrap.cc:492] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:21.261598 29570 ts_tablet_manager.cc:1434] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.003s
I20260709 13:11:21.261757 29573 ts_tablet_manager.cc:1403] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.004s
I20260709 13:11:21.262837 29570 tablet_bootstrap.cc:492] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:21.264652 29573 raft_consensus.cc:359] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.265455 29573 raft_consensus.cc:385] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.265718 29573 raft_consensus.cc:740] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.266491 29573 consensus_queue.cc:260] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.270028 29570 tablet_bootstrap.cc:654] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.275231 29378 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:21.287552 29572 tablet_bootstrap.cc:492] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:21.288118 29572 ts_tablet_manager.cc:1403] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.004s
I20260709 13:11:21.291028 29572 raft_consensus.cc:359] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.297469 29572 raft_consensus.cc:385] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.298102 29572 raft_consensus.cc:740] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.297444 29671 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.299893 29573 ts_tablet_manager.cc:1434] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.038s	user 0.004s	sys 0.003s
I20260709 13:11:21.300225 29671 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.301532 29573 tablet_bootstrap.cc:492] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:21.306042 29671 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:21.309509 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:21.310565 29524 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 1.
I20260709 13:11:21.311348 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:21.298854 29572 consensus_queue.cc:260] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.314776 29419 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:21.313201 29654 consensus_queue.cc:1048] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:21.316522 29572 ts_tablet_manager.cc:1434] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:11:21.317837 29654 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:21.318269 29654 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.318594 29654 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:21.324164 29703 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.324920 29703 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.328956 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:21.329880 29529 raft_consensus.cc:2468] T 8e9b44184de046118890bc6cd6e1dc18 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:21.331426 29344 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:21.332521 29711 raft_consensus.cc:2804] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:21.333081 29711 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.333125 29703 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:21.333707 29711 raft_consensus.cc:3060] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:21.336124 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:21.340267 29700 consensus_queue.cc:1048] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:21.353863 29572 tablet_bootstrap.cc:492] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
W20260709 13:11:21.374902 29346 leader_election.cc:343] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:21.380972 29703 consensus_queue.cc:1048] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:21.383874 29455 raft_consensus.cc:3060] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:21.380056 29573 tablet_bootstrap.cc:654] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.398341 29753 consensus_queue.cc:1048] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:21.403250 29671 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.404039 29671 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.406345 29671 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:21.423585 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:21.424465 29378 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 0.
I20260709 13:11:21.426360 29421 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:21.430075 29786 consensus_queue.cc:1048] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:11:21.428423 29654 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.431095 29592 raft_consensus.cc:2804] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:21.442912 29592 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.444409 29451 raft_consensus.cc:1240] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:11:21.444751 29592 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:21.450150 29700 consensus_queue.cc:1048] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:21.450544 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:21.451550 29524 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 0.
I20260709 13:11:21.452970 29626 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.453507 29626 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.457744 29654 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:21.458303 29626 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:21.457195 29711 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.469794 29671 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.472901 29572 tablet_bootstrap.cc:654] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.469106 29700 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.474579 29671 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.486207 29671 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:21.473029 29626 consensus_queue.cc:1048] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:11:21.489437 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:21.490440 29529 raft_consensus.cc:3060] T 8e9b44184de046118890bc6cd6e1dc18 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:21.490442 29592 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.492677 29746 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.476732 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:21.493513 29746 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.478271 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:21.538952 29573 tablet_bootstrap.cc:492] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:21.560196 29573 ts_tablet_manager.cc:1403] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.259s	user 0.028s	sys 0.021s
I20260709 13:11:21.481731 29700 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.563263 29573 raft_consensus.cc:359] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.565050 29573 raft_consensus.cc:385] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.565330 29573 raft_consensus.cc:740] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.553844 29726 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.501639 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:21.556187 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:21.556407 29746 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:21.569447 29573 consensus_queue.cc:260] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.500051 29711 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:21.596045 29570 tablet_bootstrap.cc:492] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:21.499182 29592 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:21.596685 29570 ts_tablet_manager.cc:1403] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.334s	user 0.083s	sys 0.081s
I20260709 13:11:21.563221 29700 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:21.573419 29703 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.601954 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:21.596295 29726 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.622099 29700 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.636948 29381 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:21.621097 29703 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.644239 29700 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.665272 29380 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 0.
I20260709 13:11:21.666616 29700 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:21.669607 29381 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 1.
I20260709 13:11:21.644680 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:21.650038 29572 tablet_bootstrap.cc:492] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:21.672096 29572 ts_tablet_manager.cc:1403] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.319s	user 0.020s	sys 0.017s
I20260709 13:11:21.658195 29726 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:21.659916 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:21.660995 29570 raft_consensus.cc:359] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.670717 29711 consensus_queue.cc:1048] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:21.671033 29703 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:21.648914 29573 ts_tablet_manager.cc:1434] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.088s	user 0.012s	sys 0.010s
I20260709 13:11:21.673305 29570 raft_consensus.cc:385] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.677004 29570 raft_consensus.cc:740] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.741750 29570 consensus_queue.cc:260] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.680451 29626 consensus_queue.cc:1059] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.060s
I20260709 13:11:21.744109 29573 tablet_bootstrap.cc:492] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
W20260709 13:11:21.744745 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 61742.5us
I20260709 13:11:21.748886 29570 ts_tablet_manager.cc:1434] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.152s	user 0.026s	sys 0.012s
W20260709 13:11:21.740550 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 58999.1us
I20260709 13:11:21.753750 29346 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:21.754665 29799 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:21.755112 29421 consensus_peers.cc:597] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:21.754025 29798 raft_consensus.cc:3055] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:21.755831 29798 raft_consensus.cc:740] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:21.755896 29421 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:21.756860 29798 consensus_queue.cc:260] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:21.758092 29793 log.cc:927] Time spent T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.196s	user 0.000s	sys 0.002s
I20260709 13:11:21.758533 29796 raft_consensus.cc:2804] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:21.759172 29796 raft_consensus.cc:697] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:21.763094 29796 consensus_queue.cc:237] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.749647 29529 raft_consensus.cc:2468] T 8e9b44184de046118890bc6cd6e1dc18 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:21.765072 29572 raft_consensus.cc:359] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.766999 29572 raft_consensus.cc:385] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.767194 29572 raft_consensus.cc:740] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.758374 29798 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:21.765937 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:21.767859 29572 consensus_queue.cc:260] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.775000 29572 ts_tablet_manager.cc:1434] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.102s	user 0.005s	sys 0.002s
I20260709 13:11:21.779098 29572 tablet_bootstrap.cc:492] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:21.781782 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:21.784544 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:21.794080 29421 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:21.796105 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:21.798223 29570 tablet_bootstrap.cc:492] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:21.803076 29524 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:21.803982 29786 raft_consensus.cc:2804] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:21.804450 29786 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.804814 29786 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:21.810200 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:21.810987 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:21.812546 29573 tablet_bootstrap.cc:654] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:21.814793 29346 leader_election.cc:343] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:21.810971 29524 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:21.820205 29346 leader_election.cc:343] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:21.821244 29572 tablet_bootstrap.cc:654] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.825834 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:21.827075 29530 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:21.814565 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:21.831035 29529 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 0.
I20260709 13:11:21.833388 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:21.835312 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:21.835798 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:21.837826 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:21.843021 29344 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:21.844908 29703 raft_consensus.cc:2804] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:21.851699 29703 raft_consensus.cc:697] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:11:21.852240 29495 leader_election.cc:343] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:21.853242 29495 leader_election.cc:343] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:21.860669 29703 consensus_queue.cc:237] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:21.872493 29495 leader_election.cc:343] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:21.885133 29495 leader_election.cc:343] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:21.885727 29495 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:21.887732 29344 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:21.887217 29419 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:21.888931 29804 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:21.889894 29592 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:21.890868 29654 consensus_queue.cc:1048] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:21.894316 29573 tablet_bootstrap.cc:492] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:21.894882 29573 ts_tablet_manager.cc:1403] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.151s	user 0.021s	sys 0.013s
W20260709 13:11:21.895655 29495 leader_election.cc:343] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:21.896677 29799 raft_consensus.cc:2804] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:21.897097 29799 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.897434 29799 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:21.898138 29573 raft_consensus.cc:359] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.898924 29573 raft_consensus.cc:385] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.899106 29573 raft_consensus.cc:740] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.899719 29573 consensus_queue.cc:260] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.889586 29524 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 1.
I20260709 13:11:21.896157 29495 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:21.930219 29796 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.930864 29796 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.931723 29804 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:21.942880 29786 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.944412 29452 raft_consensus.cc:2393] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 1: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
W20260709 13:11:21.958515 29327 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:21.959576 29786 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:21.960343 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:21.961112 29378 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:21.978439 29799 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:21.981312 29799 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:21.981665 29796 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:11:21.982015 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 94390.2us
I20260709 13:11:21.983837 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:11:21.985509 29421 leader_election.cc:343] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:21.986653 29344 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:21.987901 29573 ts_tablet_manager.cc:1434] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.093s	user 0.013s	sys 0.026s
I20260709 13:11:21.915280 29279 catalog_manager.cc:5697] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 0 to 1, leader changed from <none> to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 1 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:21.995064 29570 tablet_bootstrap.cc:654] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:22.002409 29573 tablet_bootstrap.cc:492] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:22.015312 29378 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 1.
I20260709 13:11:22.016193 29703 raft_consensus.cc:2764] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:11:22.020709 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:22.021718 29525 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:22.003437 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 107821us
W20260709 13:11:22.024456 29495 leader_election.cc:343] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:22.025014 29495 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:22.026158 29804 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:22.027310 29573 tablet_bootstrap.cc:654] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:22.033164 29421 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:22.029814 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:22.031908 29572 tablet_bootstrap.cc:492] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:22.044020 29572 ts_tablet_manager.cc:1403] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.267s	user 0.021s	sys 0.021s
W20260709 13:11:22.044699 29346 leader_election.cc:343] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:22.045677 29796 raft_consensus.cc:2804] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:22.046686 29796 raft_consensus.cc:697] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:22.047681 29796 consensus_queue.cc:237] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.048941 29570 tablet_bootstrap.cc:492] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:22.049650 29570 ts_tablet_manager.cc:1403] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.262s	user 0.010s	sys 0.009s
I20260709 13:11:22.050028 29573 tablet_bootstrap.cc:492] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:22.050547 29573 ts_tablet_manager.cc:1403] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.001s
I20260709 13:11:22.053128 29573 raft_consensus.cc:359] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.053876 29573 raft_consensus.cc:385] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:22.054157 29573 raft_consensus.cc:740] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
W20260709 13:11:22.054217 29407 tablet.cc:2406] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:11:22.058633 29703 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.058701 29573 consensus_queue.cc:260] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.059327 29703 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.060539 29570 raft_consensus.cc:359] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.061316 29570 raft_consensus.cc:385] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:22.061358 29573 ts_tablet_manager.cc:1434] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:11:22.061691 29570 raft_consensus.cc:740] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.062505 29573 tablet_bootstrap.cc:492] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:22.062426 29570 consensus_queue.cc:260] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.062530 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:11:22.064465 29346 leader_election.cc:343] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:22.065021 29572 raft_consensus.cc:359] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.060814 29525 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:22.066725 29344 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:22.067744 29726 raft_consensus.cc:2804] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:22.068270 29726 raft_consensus.cc:697] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:22.069169 29726 consensus_queue.cc:237] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.069702 29573 tablet_bootstrap.cc:654] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:22.072093 29703 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:22.072798 29572 raft_consensus.cc:385] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:22.073149 29572 raft_consensus.cc:740] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.073966 29572 consensus_queue.cc:260] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.075691 29572 ts_tablet_manager.cc:1434] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 13:11:22.078437 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:22.079327 29525 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:22.078843 29570 ts_tablet_manager.cc:1434] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:11:22.080866 29344 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:22.081704 29572 tablet_bootstrap.cc:492] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:22.081948 29726 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:22.082312 29726 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.082624 29726 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.080870 29570 tablet_bootstrap.cc:492] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:22.098194 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:22.098973 29524 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.100241 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:11:22.110502 29419 leader_election.cc:343] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:22.111143 29419 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:22.111712 29573 tablet_bootstrap.cc:492] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:22.112250 29573 ts_tablet_manager.cc:1403] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.050s	user 0.016s	sys 0.005s
I20260709 13:11:22.112684 29786 raft_consensus.cc:2749] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:22.120047 29572 tablet_bootstrap.cc:654] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:22.115464 29726 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.124581 29524 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 1.
I20260709 13:11:22.127629 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:11:22.129195 29346 leader_election.cc:343] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:22.128554 29726 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:22.147213 29804 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.147965 29804 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.149427 29573 raft_consensus.cc:359] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.150254 29573 raft_consensus.cc:385] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:22.150954 29804 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:22.150648 29573 raft_consensus.cc:740] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.150180 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:22.153671 29524 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.153365 29573 consensus_queue.cc:260] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.153424 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:22.154628 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:22.155331 29378 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 0.
W20260709 13:11:22.155396 29495 leader_election.cc:343] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:22.158524 29573 ts_tablet_manager.cc:1434] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.046s	user 0.009s	sys 0.000s
I20260709 13:11:22.158399 29495 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:22.160058 29573 tablet_bootstrap.cc:492] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:22.160818 29795 raft_consensus.cc:2804] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:22.161320 29795 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.161708 29795 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.161541 29278 catalog_manager.cc:5697] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:22.165836 29278 catalog_manager.cc:5697] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:22.171695 29570 tablet_bootstrap.cc:654] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:22.195773 29572 tablet_bootstrap.cc:492] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:22.196403 29572 ts_tablet_manager.cc:1403] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.120s	user 0.019s	sys 0.014s
I20260709 13:11:22.197193 29573 tablet_bootstrap.cc:654] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:22.202474 29570 tablet_bootstrap.cc:492] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:22.203300 29570 ts_tablet_manager.cc:1403] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.123s	user 0.011s	sys 0.007s
I20260709 13:11:22.212716 29524 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:22.212993 29795 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.214130 29344 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:22.216279 29703 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:22.216559 29795 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:22.216841 29703 raft_consensus.cc:697] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:22.218189 29703 consensus_queue.cc:237] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.220216 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:22.220227 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:22.220942 29378 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.220118 29276 catalog_manager.cc:5697] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 0 to 1, leader changed from <none> to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 1 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:22.224510 29495 leader_election.cc:343] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:22.229090 29570 raft_consensus.cc:359] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.230008 29570 raft_consensus.cc:385] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:22.230336 29570 raft_consensus.cc:740] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.231109 29570 consensus_queue.cc:260] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.239087 29570 ts_tablet_manager.cc:1434] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 13:11:22.241916 29378 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:22.244643 29573 tablet_bootstrap.cc:492] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:22.245913 29573 ts_tablet_manager.cc:1403] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.086s	user 0.020s	sys 0.012s
I20260709 13:11:22.244346 29572 raft_consensus.cc:359] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.246819 29572 raft_consensus.cc:385] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:22.247166 29572 raft_consensus.cc:740] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.247342 29495 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:22.248385 29795 raft_consensus.cc:2804] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:22.248594 29570 tablet_bootstrap.cc:492] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:22.249049 29795 raft_consensus.cc:697] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:22.248162 29572 consensus_queue.cc:260] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.250696 29573 raft_consensus.cc:359] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.251538 29573 raft_consensus.cc:385] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:22.251871 29573 raft_consensus.cc:740] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.252738 29573 consensus_queue.cc:260] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.251364 29795 consensus_queue.cc:237] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.253834 29572 ts_tablet_manager.cc:1434] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.057s	user 0.010s	sys 0.000s
W20260709 13:11:22.254261 29346 consensus_peers.cc:597] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:22.255151 29572 tablet_bootstrap.cc:492] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:22.255184 29573 ts_tablet_manager.cc:1434] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:11:22.256824 29573 tablet_bootstrap.cc:492] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:22.261023 29279 catalog_manager.cc:5697] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:22.263942 29573 tablet_bootstrap.cc:654] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:22.270821 29799 consensus_queue.cc:1048] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:22.286936 29804 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.287739 29804 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.294315 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:22.295691 29378 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 0.
I20260709 13:11:22.297683 29495 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:22.304791 29805 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:22.305413 29805 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.305823 29805 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.320108 29804 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:22.321064 29572 tablet_bootstrap.cc:654] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:22.322645 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:22.326818 29573 tablet_bootstrap.cc:492] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:22.331856 29573 ts_tablet_manager.cc:1403] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.075s	user 0.042s	sys 0.027s
I20260709 13:11:22.337231 29455 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 0.
I20260709 13:11:22.330448 29786 consensus_queue.cc:1048] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:11:22.338373 29570 tablet_bootstrap.cc:654] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:22.350793 29276 catalog_manager.cc:5697] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 0 to 1, leader changed from <none> to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 1 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:22.364995 29573 raft_consensus.cc:359] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.367472 29573 raft_consensus.cc:385] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:22.367892 29573 raft_consensus.cc:740] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.368623 29573 consensus_queue.cc:260] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.371099 29573 ts_tablet_manager.cc:1434] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 13:11:22.372383 29573 tablet_bootstrap.cc:492] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:22.381249 29804 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.381939 29804 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.384423 29573 tablet_bootstrap.cc:654] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:22.387348 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:22.388849 29796 consensus_queue.cc:1048] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:11:22.389178 29495 leader_election.cc:343] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:22.389104 29805 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.384344 29804 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:22.394717 29570 tablet_bootstrap.cc:492] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:22.395278 29570 ts_tablet_manager.cc:1403] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.147s	user 0.011s	sys 0.002s
I20260709 13:11:22.398255 29570 raft_consensus.cc:359] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.398805 29573 tablet_bootstrap.cc:492] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:22.399012 29570 raft_consensus.cc:385] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:22.399593 29573 ts_tablet_manager.cc:1403] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.001s
I20260709 13:11:22.401257 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:22.401929 29452 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.403861 29573 raft_consensus.cc:359] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.404925 29573 raft_consensus.cc:385] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:22.405298 29573 raft_consensus.cc:740] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.406553 29573 consensus_queue.cc:260] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.407137 29805 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:22.408418 29573 ts_tablet_manager.cc:1434] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:11:22.409626 29573 tablet_bootstrap.cc:492] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:22.417413 29573 tablet_bootstrap.cc:654] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:22.422619 29572 tablet_bootstrap.cc:492] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:22.399379 29570 raft_consensus.cc:740] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.426187 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:22.427089 29572 ts_tablet_manager.cc:1403] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.172s	user 0.014s	sys 0.040s
I20260709 13:11:22.428267 29570 consensus_queue.cc:260] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.431798 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:22.432524 29378 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.433684 29570 ts_tablet_manager.cc:1434] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:11:22.430157 29452 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:22.435624 29570 tablet_bootstrap.cc:492] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:22.439460 29495 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:11:22.440625 29495 leader_election.cc:343] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:22.441087 29495 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:22.442361 29805 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:22.442874 29805 raft_consensus.cc:697] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:22.443708 29795 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:22.443933 29805 consensus_queue.cc:237] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.445077 29573 tablet_bootstrap.cc:492] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:22.446105 29573 ts_tablet_manager.cc:1403] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.011s
I20260709 13:11:22.450527 29654 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.451187 29654 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.449370 29573 raft_consensus.cc:359] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.456825 29573 raft_consensus.cc:385] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:22.457249 29573 raft_consensus.cc:740] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.458913 29572 raft_consensus.cc:359] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.455528 29795 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.460361 29795 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.460233 29654 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:22.460736 29573 consensus_queue.cc:260] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.461848 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:22.462515 29525 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 0.
I20260709 13:11:22.459802 29572 raft_consensus.cc:385] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:22.463735 29572 raft_consensus.cc:740] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.464530 29572 consensus_queue.cc:260] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.469033 29572 ts_tablet_manager.cc:1434] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 13:11:22.470482 29572 tablet_bootstrap.cc:492] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:22.463234 29573 ts_tablet_manager.cc:1434] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.017s	user 0.001s	sys 0.004s
I20260709 13:11:22.479171 29419 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:22.481242 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:22.481844 29796 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:22.482389 29796 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.482869 29573 tablet_bootstrap.cc:492] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:22.483435 29795 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:22.491328 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:22.494719 29378 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:22.482918 29796 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:22.500183 29421 leader_election.cc:343] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:22.500029 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:11:22.503072 29495 leader_election.cc:343] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:22.511072 29495 leader_election.cc:343] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:22.511680 29495 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:22.512923 29795 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:22.529850 29654 consensus_queue.cc:1048] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:22.530385 29570 tablet_bootstrap.cc:654] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:22.534814 29452 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.536993 29572 tablet_bootstrap.cc:654] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:22.539100 29573 tablet_bootstrap.cc:654] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:22.540581 29654 consensus_queue.cc:1048] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:22.541290 29278 catalog_manager.cc:5697] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 0 to 1, leader changed from <none> to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 1 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:22.542665 29796 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.552068 29805 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.552743 29805 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.557305 29572 tablet_bootstrap.cc:492] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:22.558497 29572 ts_tablet_manager.cc:1403] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.088s	user 0.015s	sys 0.005s
I20260709 13:11:22.561553 29572 raft_consensus.cc:359] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.562291 29572 raft_consensus.cc:385] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:22.562561 29572 raft_consensus.cc:740] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.563287 29572 consensus_queue.cc:260] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.563687 29805 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:22.565878 29572 ts_tablet_manager.cc:1434] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:11:22.566421 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:22.566828 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:22.567103 29572 tablet_bootstrap.cc:492] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
W20260709 13:11:22.569805 29495 leader_election.cc:343] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:22.576210 29495 leader_election.cc:343] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:22.576845 29495 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:22.578739 29805 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:22.592856 29703 consensus_queue.cc:1048] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:22.589887 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:11:22.600389 29421 leader_election.cc:343] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:22.604539 29798 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.605114 29796 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:22.605463 29798 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.624727 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:22.625777 29530 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.633526 29798 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:22.636263 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:22.637213 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:22.637936 29525 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:22.638098 29455 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:22.639611 29346 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:22.640594 29380 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.643747 29799 raft_consensus.cc:2804] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:22.644484 29799 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.645031 29799 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.661798 29703 consensus_queue.cc:1048] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:22.675765 29573 tablet_bootstrap.cc:492] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:22.676517 29573 ts_tablet_manager.cc:1403] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.194s	user 0.012s	sys 0.011s
I20260709 13:11:22.681254 29530 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 1.
I20260709 13:11:22.684178 29419 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:22.685854 29796 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:22.686546 29796 raft_consensus.cc:697] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:22.688280 29796 consensus_queue.cc:237] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.706324 29573 raft_consensus.cc:359] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.717163 29572 tablet_bootstrap.cc:654] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:22.707443 29573 raft_consensus.cc:385] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:22.721191 29573 raft_consensus.cc:740] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.722447 29573 consensus_queue.cc:260] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.729384 29570 tablet_bootstrap.cc:492] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:22.730114 29570 ts_tablet_manager.cc:1403] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.295s	user 0.052s	sys 0.068s
I20260709 13:11:22.738755 29570 raft_consensus.cc:359] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.739687 29570 raft_consensus.cc:385] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:22.739974 29570 raft_consensus.cc:740] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.740679 29570 consensus_queue.cc:260] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.744215 29573 ts_tablet_manager.cc:1434] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.067s	user 0.009s	sys 0.004s
I20260709 13:11:22.747298 29703 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.747963 29703 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.768173 29570 ts_tablet_manager.cc:1434] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.003s
I20260709 13:11:22.769629 29703 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:22.769794 29570 tablet_bootstrap.cc:492] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:22.771548 29798 consensus_queue.cc:1048] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:22.774128 29573 tablet_bootstrap.cc:492] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:22.775460 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:22.760964 29799 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:22.806238 29346 leader_election.cc:343] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:22.809845 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:22.810608 29455 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.812167 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:22.819926 29530 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:22.821166 29572 tablet_bootstrap.cc:492] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:22.825590 29572 ts_tablet_manager.cc:1403] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.259s	user 0.022s	sys 0.021s
I20260709 13:11:22.826036 29573 tablet_bootstrap.cc:654] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:22.827256 29452 raft_consensus.cc:3060] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.825385 29455 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
W20260709 13:11:22.833518 29346 consensus_peers.cc:597] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:22.834959 29346 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:22.838881 29799 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:11:22.847388 29495 consensus_peers.cc:597] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:22.852840 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:22.842900 29798 raft_consensus.cc:2804] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:22.853657 29524 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.853914 29798 raft_consensus.cc:697] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:22.855227 29798 consensus_queue.cc:237] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.859385 29795 consensus_queue.cc:1048] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:22.865900 29570 tablet_bootstrap.cc:654] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:22.875830 29572 raft_consensus.cc:359] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.880451 29572 raft_consensus.cc:385] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:22.881987 29572 raft_consensus.cc:740] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.904177 29344 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:22.908771 29626 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:22.917726 29524 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:22.921245 29626 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.921867 29626 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.928081 29279 catalog_manager.cc:5697] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 0 to 1, leader changed from <none> to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 1 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:22.930346 29572 consensus_queue.cc:260] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.933495 29573 tablet_bootstrap.cc:492] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:22.934129 29573 ts_tablet_manager.cc:1403] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.168s	user 0.021s	sys 0.006s
I20260709 13:11:22.941718 29573 raft_consensus.cc:359] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.942508 29573 raft_consensus.cc:385] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:22.942783 29573 raft_consensus.cc:740] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.943524 29573 consensus_queue.cc:260] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.943869 29626 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.945753 29573 ts_tablet_manager.cc:1434] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:11:22.946790 29573 tablet_bootstrap.cc:492] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:22.955591 29278 catalog_manager.cc:5697] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:22.963922 29572 ts_tablet_manager.cc:1434] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.136s	user 0.008s	sys 0.004s
I20260709 13:11:22.967615 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:22.968132 29795 consensus_queue.cc:1048] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:22.967602 29572 tablet_bootstrap.cc:492] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:22.969777 29795 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:22.971119 29795 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:22.975556 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:11:22.976301 29346 leader_election.cc:343] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:22.976305 29381 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
I20260709 13:11:22.977463 29626 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:22.978593 29795 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:22.978752 29495 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:22.980648 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:22.981622 29455 raft_consensus.cc:2393] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 2: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:11:22.979612 29795 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:22.983397 29795 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:22.983780 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:22.984092 29795 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:22.984409 29530 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.008818 29570 tablet_bootstrap.cc:492] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:23.009397 29570 ts_tablet_manager.cc:1403] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.240s	user 0.013s	sys 0.003s
I20260709 13:11:23.011881 29795 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.019971 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:23.013432 29530 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:23.021652 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:23.022133 29344 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:23.022423 29455 raft_consensus.cc:2393] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 2: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:11:23.023800 29853 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:23.024797 29853 raft_consensus.cc:697] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:23.025395 29795 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:23.026544 29572 tablet_bootstrap.cc:654] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.031106 29804 consensus_queue.cc:1048] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:11:23.035018 29378 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
I20260709 13:11:23.027070 29570 raft_consensus.cc:359] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.042936 29495 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:23.043439 29570 raft_consensus.cc:385] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.044014 29804 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:23.025748 29853 consensus_queue.cc:237] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.044477 29804 raft_consensus.cc:697] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:23.045487 29804 consensus_queue.cc:237] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.044035 29570 raft_consensus.cc:740] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.048524 29570 consensus_queue.cc:260] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.050534 29570 ts_tablet_manager.cc:1434] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.003s
I20260709 13:11:23.051690 29570 tablet_bootstrap.cc:492] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:23.054805 29573 tablet_bootstrap.cc:654] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.076165 29279 catalog_manager.cc:5697] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 1 to 2, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 2 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:23.072157 29804 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.096100 29798 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.096753 29798 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.099627 29798 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:23.099963 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:11:23.101797 29346 leader_election.cc:343] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:23.086515 29804 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.104993 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:23.106019 29530 raft_consensus.cc:2468] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:23.108783 29344 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:23.110344 29804 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:23.111742 29798 raft_consensus.cc:2804] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:23.112893 29798 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.120127 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:23.121855 29796 consensus_queue.cc:1048] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:23.123654 29573 tablet_bootstrap.cc:492] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:23.124210 29573 ts_tablet_manager.cc:1403] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.178s	user 0.013s	sys 0.001s
I20260709 13:11:23.126344 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:23.127135 29573 raft_consensus.cc:359] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.127902 29573 raft_consensus.cc:385] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.126317 29278 catalog_manager.cc:5697] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:23.128317 29573 raft_consensus.cc:740] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.129132 29573 consensus_queue.cc:260] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:23.131032 29495 leader_election.cc:343] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:23.131817 29495 leader_election.cc:343] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:23.132200 29495 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:23.117686 29798 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.134806 29573 ts_tablet_manager.cc:1434] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:11:23.136473 29573 tablet_bootstrap.cc:492] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:23.133865 29855 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:23.148983 29327 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:23.149469 29572 tablet_bootstrap.cc:492] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:23.153767 29572 ts_tablet_manager.cc:1403] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.187s	user 0.019s	sys 0.028s
I20260709 13:11:23.154999 29798 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.156527 29573 tablet_bootstrap.cc:654] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.157306 29798 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:23.158119 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:23.158486 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:23.159029 29530 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:23.159829 29346 leader_election.cc:343] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:23.152272 29570 tablet_bootstrap.cc:654] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.164281 29572 raft_consensus.cc:359] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.165146 29572 raft_consensus.cc:385] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.165472 29572 raft_consensus.cc:740] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.166252 29572 consensus_queue.cc:260] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.168709 29572 ts_tablet_manager.cc:1434] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:11:23.169808 29572 tablet_bootstrap.cc:492] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
W20260709 13:11:23.176403 29421 consensus_peers.cc:597] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:23.177053 29572 tablet_bootstrap.cc:654] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.180514 29570 tablet_bootstrap.cc:492] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:23.181190 29570 ts_tablet_manager.cc:1403] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.130s	user 0.013s	sys 0.008s
I20260709 13:11:23.196274 29570 raft_consensus.cc:359] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.198144 29570 raft_consensus.cc:385] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.198781 29570 raft_consensus.cc:740] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.199925 29570 consensus_queue.cc:260] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.203123 29570 ts_tablet_manager.cc:1434] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 13:11:23.204880 29570 tablet_bootstrap.cc:492] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:23.205229 29530 raft_consensus.cc:2468] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:23.206548 29344 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:23.207669 29798 raft_consensus.cc:2804] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:23.208199 29798 raft_consensus.cc:697] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:23.209365 29798 consensus_queue.cc:237] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.215174 29570 tablet_bootstrap.cc:654] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.222358 29570 tablet_bootstrap.cc:492] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:23.222879 29570 ts_tablet_manager.cc:1403] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.007s
I20260709 13:11:23.223749 29572 tablet_bootstrap.cc:492] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:23.224294 29572 ts_tablet_manager.cc:1403] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.055s	user 0.016s	sys 0.035s
I20260709 13:11:23.227986 29572 raft_consensus.cc:359] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.228868 29572 raft_consensus.cc:385] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.229139 29572 raft_consensus.cc:740] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.229822 29572 consensus_queue.cc:260] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.230984 29570 raft_consensus.cc:359] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.231750 29570 raft_consensus.cc:385] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.231989 29572 ts_tablet_manager.cc:1434] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:11:23.232035 29570 raft_consensus.cc:740] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.232899 29570 consensus_queue.cc:260] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.235399 29570 ts_tablet_manager.cc:1434] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:11:23.235863 29572 tablet_bootstrap.cc:492] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:23.236508 29570 tablet_bootstrap.cc:492] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:23.236584 29278 catalog_manager.cc:5697] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:23.247283 29572 tablet_bootstrap.cc:654] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.247769 29570 tablet_bootstrap.cc:654] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.265626 29570 tablet_bootstrap.cc:492] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:23.266289 29570 ts_tablet_manager.cc:1403] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.010s
I20260709 13:11:23.268055 29573 tablet_bootstrap.cc:492] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:23.269232 29573 ts_tablet_manager.cc:1403] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.133s	user 0.013s	sys 0.003s
I20260709 13:11:23.270254 29572 tablet_bootstrap.cc:492] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:23.270186 29570 raft_consensus.cc:359] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.270852 29572 ts_tablet_manager.cc:1403] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.035s	user 0.018s	sys 0.003s
I20260709 13:11:23.271145 29570 raft_consensus.cc:385] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.271466 29570 raft_consensus.cc:740] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.272207 29570 consensus_queue.cc:260] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.272715 29573 raft_consensus.cc:359] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.273392 29573 raft_consensus.cc:385] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.273654 29573 raft_consensus.cc:740] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.274454 29573 consensus_queue.cc:260] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.274812 29572 raft_consensus.cc:359] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.275513 29572 raft_consensus.cc:385] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.275770 29572 raft_consensus.cc:740] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.276429 29572 consensus_queue.cc:260] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.276921 29573 ts_tablet_manager.cc:1434] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:23.278134 29570 ts_tablet_manager.cc:1434] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.003s
I20260709 13:11:23.279421 29570 tablet_bootstrap.cc:492] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:23.279171 29573 tablet_bootstrap.cc:492] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:23.284821 29572 ts_tablet_manager.cc:1434] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.003s
I20260709 13:11:23.286180 29572 tablet_bootstrap.cc:492] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:23.286965 29570 tablet_bootstrap.cc:654] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.287885 29804 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.288439 29804 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.293973 29804 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:23.295636 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:23.297147 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:11:23.297698 29495 leader_election.cc:343] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:23.298588 29495 leader_election.cc:343] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:23.299080 29495 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:23.300005 29855 raft_consensus.cc:2749] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:23.301118 29450 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.305428 29572 tablet_bootstrap.cc:654] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.306953 29573 tablet_bootstrap.cc:654] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.318594 29572 tablet_bootstrap.cc:492] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:23.319067 29570 tablet_bootstrap.cc:492] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:23.319209 29572 ts_tablet_manager.cc:1403] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.000s
I20260709 13:11:23.319691 29570 ts_tablet_manager.cc:1403] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.004s
I20260709 13:11:23.322492 29798 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.322525 29572 raft_consensus.cc:359] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.323011 29570 raft_consensus.cc:359] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.323114 29798 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.323753 29572 raft_consensus.cc:385] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.324230 29572 raft_consensus.cc:740] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.324973 29572 consensus_queue.cc:260] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.325521 29864 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.326004 29864 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.327085 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:23.327709 29572 ts_tablet_manager.cc:1434] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:11:23.323820 29570 raft_consensus.cc:385] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.328982 29796 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.329162 29570 raft_consensus.cc:740] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.329639 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:23.329555 29796 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.330334 29530 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:23.330189 29570 consensus_queue.cc:260] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.332149 29796 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:23.332613 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:23.333117 29570 ts_tablet_manager.cc:1434] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:11:23.333899 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:23.334492 29570 tablet_bootstrap.cc:492] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:23.337236 29864 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:23.328984 29572 tablet_bootstrap.cc:492] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:23.341938 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:23.342586 29570 tablet_bootstrap.cc:654] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.345378 29573 tablet_bootstrap.cc:492] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:23.345799 29853 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.346138 29573 ts_tablet_manager.cc:1403] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.009s
I20260709 13:11:23.346410 29853 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.349383 29344 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:23.350699 29626 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:23.351089 29626 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.351406 29626 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.354198 29573 raft_consensus.cc:359] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.355767 29573 raft_consensus.cc:385] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.356251 29573 raft_consensus.cc:740] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
W20260709 13:11:23.357061 29346 leader_election.cc:343] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:23.357424 29573 consensus_queue.cc:260] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.359674 29573 ts_tablet_manager.cc:1434] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.013s	user 0.012s	sys 0.001s
I20260709 13:11:23.360052 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:23.360177 29855 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.345852 29572 tablet_bootstrap.cc:654] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.368942 29573 tablet_bootstrap.cc:492] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:23.360908 29530 raft_consensus.cc:2393] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 1: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:23.360898 29855 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.373373 29703 consensus_queue.cc:1048] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:23.375631 29855 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:23.367511 29798 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:23.386130 29626 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.401163 29626 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:23.411131 29570 tablet_bootstrap.cc:492] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:23.411778 29570 ts_tablet_manager.cc:1403] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.078s	user 0.021s	sys 0.014s
I20260709 13:11:23.414340 29570 raft_consensus.cc:359] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.411149 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:23.414921 29570 raft_consensus.cc:385] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.415223 29570 raft_consensus.cc:740] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.415328 29530 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.415907 29570 consensus_queue.cc:260] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.417534 29570 ts_tablet_manager.cc:1434] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:11:23.417646 29853 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:23.418495 29570 tablet_bootstrap.cc:492] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:23.392046 29421 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:11:23.419446 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 60961.4us
I20260709 13:11:23.404606 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:23.420141 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:11:23.423866 29495 leader_election.cc:343] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:23.425450 29626 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.425978 29626 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.428789 29573 tablet_bootstrap.cc:654] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.421993 29786 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:23.429898 29380 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 0.
I20260709 13:11:23.453531 29572 tablet_bootstrap.cc:492] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:23.454329 29572 ts_tablet_manager.cc:1403] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.126s	user 0.020s	sys 0.012s
I20260709 13:11:23.456434 29530 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:23.435262 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:23.458587 29495 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
W20260709 13:11:23.461460 29346 leader_election.cc:343] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:23.435030 29421 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:23.467475 29786 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:23.467783 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 45174.6us
I20260709 13:11:23.468410 29855 raft_consensus.cc:2804] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:23.468842 29855 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.469718 29855 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.469928 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:23.475082 29530 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:23.500996 29572 raft_consensus.cc:359] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.502068 29572 raft_consensus.cc:385] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.502386 29572 raft_consensus.cc:740] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
W20260709 13:11:23.503896 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 45431.1us
I20260709 13:11:23.503136 29572 consensus_queue.cc:260] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.506503 29455 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.513865 29572 ts_tablet_manager.cc:1434] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.059s	user 0.009s	sys 0.001s
I20260709 13:11:23.518589 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:23.516386 29626 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:23.512120 29805 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.547026 29864 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.555687 29864 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.556056 29805 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.558243 29864 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:23.558740 29786 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:23.555709 29879 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.512796 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:23.560201 29879 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.558233 29805 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:23.563066 29855 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.565202 29855 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:23.565299 29879 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:11:23.565828 29346 leader_election.cc:343] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:23.567623 29572 tablet_bootstrap.cc:492] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:23.573752 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:23.574774 29525 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:23.581135 29570 tablet_bootstrap.cc:654] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.585131 29451 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:23.593022 29786 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.596261 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:23.596585 29378 raft_consensus.cc:1275] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:23.598450 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:23.604382 29346 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:23.607708 29381 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.608058 29786 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.608644 29798 raft_consensus.cc:2804] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:23.609061 29798 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.609380 29798 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.610425 29786 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:23.601497 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:23.607471 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:23.614286 29529 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 0.
I20260709 13:11:23.616042 29344 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:23.617192 29344 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:23.617939 29626 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:23.618506 29626 raft_consensus.cc:697] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:23.624403 29853 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:23.628479 29853 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.628897 29853 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.625450 29877 consensus_queue.cc:1048] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:11:23.629212 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:23.633502 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:23.636097 29573 tablet_bootstrap.cc:492] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:23.636649 29573 ts_tablet_manager.cc:1403] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.268s	user 0.011s	sys 0.015s
I20260709 13:11:23.625507 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:23.638151 29419 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:23.641769 29786 raft_consensus.cc:2804] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:23.642468 29786 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.642820 29786 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.638206 29526 raft_consensus.cc:2393] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 1: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:23.648752 29879 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:23.651242 29495 leader_election.cc:343] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:23.652037 29495 leader_election.cc:343] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:23.657032 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:23.657456 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:23.658408 29378 raft_consensus.cc:2410] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 13:11:23.641738 29726 consensus_queue.cc:1048] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:11:23.652535 29879 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.682796 29805 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.682327 29626 consensus_queue.cc:237] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.683338 29805 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.685420 29805 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:23.671447 29799 consensus_queue.cc:1048] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:11:23.694129 29573 raft_consensus.cc:359] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.714705 29573 raft_consensus.cc:385] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.715222 29573 raft_consensus.cc:740] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.722692 29879 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:23.723086 29786 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.723601 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:23.724629 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:23.725310 29454 raft_consensus.cc:2468] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 0.
I20260709 13:11:23.728749 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:11:23.729156 29495 leader_election.cc:343] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:23.729538 29530 raft_consensus.cc:2468] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 0.
I20260709 13:11:23.730973 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:23.661090 29883 consensus_queue.cc:1048] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 13:11:23.727671 29786 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:23.748555 29495 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:23.749753 29419 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:23.751756 29573 consensus_queue.cc:260] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.732347 29524 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.728756 29421 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:23.754858 29879 raft_consensus.cc:2804] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:23.755245 29879 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.755590 29879 raft_consensus.cc:3060] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.755802 29573 ts_tablet_manager.cc:1434] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.119s	user 0.009s	sys 0.000s
I20260709 13:11:23.772396 29573 tablet_bootstrap.cc:492] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:23.756007 29421 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:23.768460 29855 raft_consensus.cc:2804] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:23.769287 29882 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.779575 29864 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:23.776590 29855 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.786936 29855 raft_consensus.cc:3060] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.782312 29853 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.812039 29853 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:23.807118 29798 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.808624 29381 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:23.832579 29798 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:23.838742 29377 raft_consensus.cc:2393] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 1: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:23.833086 29805 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.855697 29495 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:23.863785 29570 tablet_bootstrap.cc:492] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:23.864651 29570 ts_tablet_manager.cc:1403] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.446s	user 0.022s	sys 0.039s
I20260709 13:11:23.850283 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:23.865492 29881 raft_consensus.cc:2804] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:23.882035 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:23.869105 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:23.856531 29805 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.871867 29626 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.887393 29449 raft_consensus.cc:2393] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 1: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:11:23.892176 29573 tablet_bootstrap.cc:654] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.897869 29626 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.904598 29626 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:11:23.907171 29346 leader_election.cc:343] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:23.912555 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:23.912645 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:23.916168 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:23.916378 29805 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:23.920388 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:23.921927 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:11:23.922478 29495 leader_election.cc:343] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:23.927064 29495 leader_election.cc:343] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:23.927601 29495 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:23.926980 29570 raft_consensus.cc:359] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.928314 29570 raft_consensus.cc:385] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.928601 29570 raft_consensus.cc:740] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.929270 29570 consensus_queue.cc:260] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:23.929271 29495 leader_election.cc:343] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:23.929596 29346 leader_election.cc:343] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:23.898667 29881 raft_consensus.cc:697] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:23.895435 29524 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 1.
I20260709 13:11:23.930919 29495 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:23.930493 29795 raft_consensus.cc:2749] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:23.934926 29804 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:23.942448 29570 ts_tablet_manager.cc:1434] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.077s	user 0.007s	sys 0.002s
I20260709 13:11:23.943861 29419 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:23.950008 29796 raft_consensus.cc:2804] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:23.950744 29796 raft_consensus.cc:697] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:23.951632 29572 tablet_bootstrap.cc:654] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.937821 29881 consensus_queue.cc:237] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.951900 29796 consensus_queue.cc:237] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.959193 29855 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:23.995847 29277 catalog_manager.cc:5697] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.002022 29855 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:11:23.998692 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 44618.1us
I20260709 13:11:23.987042 29882 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:24.008138 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:11:24.049000 29421 leader_election.cc:343] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.004035 29879 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:24.072695 29449 raft_consensus.cc:2393] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 1: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:11:24.079356 29572 tablet_bootstrap.cc:492] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:24.080163 29572 ts_tablet_manager.cc:1403] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.513s	user 0.019s	sys 0.008s
I20260709 13:11:24.099049 29879 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:24.102779 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:24.104357 29526 raft_consensus.cc:2393] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 1: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:11:24.105010 29572 raft_consensus.cc:359] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:24.113369 29573 tablet_bootstrap.cc:492] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:24.113965 29573 ts_tablet_manager.cc:1403] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.347s	user 0.024s	sys 0.009s
I20260709 13:11:24.125170 29573 raft_consensus.cc:359] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:24.126547 29573 raft_consensus.cc:385] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.132130 29570 tablet_bootstrap.cc:492] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:24.126945 29573 raft_consensus.cc:740] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.139833 29573 consensus_queue.cc:260] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:24.143580 29573 ts_tablet_manager.cc:1434] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.029s	user 0.013s	sys 0.000s
I20260709 13:11:24.151635 29798 consensus_queue.cc:1048] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:24.152145 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:24.154959 29573 tablet_bootstrap.cc:492] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
W20260709 13:11:24.159408 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 75257.5us
W20260709 13:11:24.161195 29495 leader_election.cc:343] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.169337 29879 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.169816 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:24.169907 29879 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:24.170629 29530 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.171888 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:24.105901 29572 raft_consensus.cc:385] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.173074 29572 raft_consensus.cc:740] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.175061 29879 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:24.176898 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:24.177945 29526 raft_consensus.cc:2393] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 1: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:24.180452 29572 consensus_queue.cc:260] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:24.176796 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:24.185101 29495 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:11:24.175071 29421 leader_election.cc:343] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.186894 29453 raft_consensus.cc:1275] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:24.187064 29421 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:24.187944 29456 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.188762 29804 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:24.190802 29885 consensus_queue.cc:1048] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:24.191529 29572 ts_tablet_manager.cc:1434] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.111s	user 0.006s	sys 0.001s
I20260709 13:11:24.192691 29572 tablet_bootstrap.cc:492] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:24.193346 29786 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:24.196311 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:24.202762 29421 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:24.212174 29573 tablet_bootstrap.cc:654] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.185009 29528 raft_consensus.cc:2393] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 1: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:11:24.222975 29572 tablet_bootstrap.cc:654] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.230937 29573 tablet_bootstrap.cc:492] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:24.231441 29573 ts_tablet_manager.cc:1403] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.077s	user 0.014s	sys 0.000s
I20260709 13:11:24.234978 29573 raft_consensus.cc:359] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:24.235731 29573 raft_consensus.cc:385] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.235986 29573 raft_consensus.cc:740] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.236187 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:24.236935 29528 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:24.236836 29573 consensus_queue.cc:260] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:24.238777 29573 ts_tablet_manager.cc:1434] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:24.239984 29573 tablet_bootstrap.cc:492] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:24.249024 29572 tablet_bootstrap.cc:492] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:24.249620 29572 ts_tablet_manager.cc:1403] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.057s	user 0.011s	sys 0.002s
I20260709 13:11:24.250658 29530 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:24.252544 29572 raft_consensus.cc:359] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:24.253281 29572 raft_consensus.cc:385] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.253665 29572 raft_consensus.cc:740] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.256372 29570 tablet_bootstrap.cc:654] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.257009 29572 consensus_queue.cc:260] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:24.259728 29572 ts_tablet_manager.cc:1434] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:11:24.260854 29572 tablet_bootstrap.cc:492] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:24.264245 29573 tablet_bootstrap.cc:654] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.280022 29885 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.288659 29885 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:24.291545 29885 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:24.294672 29344 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:24.297227 29798 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:24.298062 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:11:24.302398 29495 leader_election.cc:343] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.306372 29344 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:24.308255 29853 raft_consensus.cc:2804] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:24.308671 29853 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.309010 29853 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.312930 29344 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:24.314059 29703 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:24.317821 29570 tablet_bootstrap.cc:492] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:24.318394 29570 ts_tablet_manager.cc:1403] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.187s	user 0.012s	sys 0.005s
I20260709 13:11:24.321846 29570 raft_consensus.cc:359] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:24.322625 29570 raft_consensus.cc:385] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.306404 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:24.325348 29703 raft_consensus.cc:697] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:24.323222 29570 raft_consensus.cc:740] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.326587 29703 consensus_queue.cc:237] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:24.335971 29495 leader_election.cc:343] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.336750 29495 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:24.339797 29570 consensus_queue.cc:260] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:24.338991 29898 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:24.347924 29786 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:24.348186 29572 tablet_bootstrap.cc:654] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.350561 29570 ts_tablet_manager.cc:1434] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.001s
W20260709 13:11:24.361231 29327 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:11:24.365363 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 50865.6us
I20260709 13:11:24.353803 29570 tablet_bootstrap.cc:492] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:24.369789 29853 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:24.376348 29573 tablet_bootstrap.cc:492] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:24.374449 29912 consensus_queue.cc:1048] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:11:24.377076 29573 ts_tablet_manager.cc:1403] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.137s	user 0.022s	sys 0.000s
I20260709 13:11:24.377708 29853 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:24.378230 29726 consensus_queue.cc:1048] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:24.380941 29573 raft_consensus.cc:359] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:24.381803 29573 raft_consensus.cc:385] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.382108 29726 consensus_queue.cc:1048] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:24.382131 29573 raft_consensus.cc:740] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.383549 29573 consensus_queue.cc:260] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:24.389552 29279 catalog_manager.cc:5697] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 0 to 1, leader changed from <none> to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 1 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:24.399597 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:24.400743 29524 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.408181 29277 catalog_manager.cc:5697] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 0 to 1, leader changed from <none> to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 1 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.410665 29573 ts_tablet_manager.cc:1434] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:11:24.415119 29572 tablet_bootstrap.cc:492] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:24.415788 29572 ts_tablet_manager.cc:1403] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.155s	user 0.021s	sys 0.018s
I20260709 13:11:24.419085 29572 raft_consensus.cc:359] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:24.420059 29572 raft_consensus.cc:385] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.420413 29572 raft_consensus.cc:740] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.421263 29572 consensus_queue.cc:260] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:24.423774 29572 ts_tablet_manager.cc:1434] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:11:24.425014 29572 tablet_bootstrap.cc:492] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:24.427600 29573 tablet_bootstrap.cc:492] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:24.429745 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:24.440335 29524 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:24.442929 29570 tablet_bootstrap.cc:654] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.443306 29899 consensus_queue.cc:1048] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
W20260709 13:11:24.457520 29346 leader_election.cc:343] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.460676 29912 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.445788 29881 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.465161 29912 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:24.468307 29344 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:24.469406 29572 tablet_bootstrap.cc:654] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.469357 29853 raft_consensus.cc:2804] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:24.472527 29853 raft_consensus.cc:697] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:24.474890 29853 consensus_queue.cc:237] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:24.471549 29881 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:24.492046 29573 tablet_bootstrap.cc:654] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.494071 29881 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:24.498940 29277 catalog_manager.cc:5697] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.499972 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:11:24.502524 29495 leader_election.cc:343] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.525707 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:24.526415 29524 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:24.531699 29881 raft_consensus.cc:493] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.532302 29881 raft_consensus.cc:515] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:24.515556 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:24.535534 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:24.548269 29344 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:11:24.559221 29346 leader_election.cc:343] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.519811 29912 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:24.564216 29911 raft_consensus.cc:2804] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:24.575366 29911 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.575871 29911 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:24.570480 29495 leader_election.cc:343] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.576339 29495 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:24.555588 29853 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:24.601402 29917 log.cc:927] Time spent T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.132s	user 0.002s	sys 0.000s
I20260709 13:11:24.600539 29898 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:24.624948 29570 tablet_bootstrap.cc:492] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:24.625509 29570 ts_tablet_manager.cc:1403] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.272s	user 0.006s	sys 0.013s
I20260709 13:11:24.609084 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:24.607234 29853 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:24.650260 29879 consensus_queue.cc:1048] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:11:24.656002 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:11:24.652666 29919 log.cc:927] Time spent T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:11:24.629889 29881 leader_election.cc:290] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:24.672640 29570 raft_consensus.cc:359] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:24.684058 29570 raft_consensus.cc:385] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.684533 29570 raft_consensus.cc:740] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.685504 29570 consensus_queue.cc:260] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:24.703534 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 77163.9us
I20260709 13:11:24.711377 29570 ts_tablet_manager.cc:1434] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.086s	user 0.007s	sys 0.002s
I20260709 13:11:24.746711 29279 catalog_manager.cc:5697] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.745090 29786 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.757840 29786 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:24.763576 29572 tablet_bootstrap.cc:492] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:24.764139 29572 ts_tablet_manager.cc:1403] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.339s	user 0.018s	sys 0.013s
I20260709 13:11:24.769742 29572 raft_consensus.cc:359] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:24.770520 29572 raft_consensus.cc:385] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.770797 29572 raft_consensus.cc:740] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.771520 29572 consensus_queue.cc:260] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:24.773864 29572 ts_tablet_manager.cc:1434] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:11:24.777745 29853 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:24.760676 29786 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:24.788000 29703 consensus_queue.cc:1048] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:24.792104 29572 tablet_bootstrap.cc:492] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:24.796025 29911 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:24.805016 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:11:24.813486 29495 leader_election.cc:343] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.808022 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:11:24.817059 29344 leader_election.cc:343] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.830529 29570 tablet_bootstrap.cc:492] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:24.835163 29573 tablet_bootstrap.cc:492] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:24.837101 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:24.838673 29530 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.845310 29573 ts_tablet_manager.cc:1403] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.418s	user 0.015s	sys 0.017s
I20260709 13:11:24.829422 29911 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:24.864473 29573 raft_consensus.cc:359] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:24.865077 29573 raft_consensus.cc:385] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.865355 29573 raft_consensus.cc:740] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.865734 29530 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:24.867327 29573 consensus_queue.cc:260] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:24.869614 29344 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:24.872339 29573 ts_tablet_manager.cc:1434] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:11:24.874562 29573 tablet_bootstrap.cc:492] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:24.873034 29929 raft_consensus.cc:2804] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:24.878599 29929 raft_consensus.cc:697] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:24.879140 29898 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.879675 29898 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:24.879573 29929 consensus_queue.cc:237] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:24.881883 29898 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:24.875166 29453 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.883010 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:11:24.884416 29495 leader_election.cc:343] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.890221 29570 tablet_bootstrap.cc:654] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:24.894259 29495 leader_election.cc:343] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.894759 29495 leader_election.cc:304] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:24.898133 29898 raft_consensus.cc:2749] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:24.905958 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:24.914155 29929 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.921700 29929 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:24.925149 29929 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:24.913570 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:24.935022 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:24.935226 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:24.893420 29911 consensus_queue.cc:1048] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:11:24.941426 29930 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.942070 29930 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:24.943755 29572 tablet_bootstrap.cc:654] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.951608 29277 catalog_manager.cc:5697] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.967764 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:24.963197 29930 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:24.969894 29528 raft_consensus.cc:2468] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 0.
I20260709 13:11:24.972047 29419 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:24.974957 29930 raft_consensus.cc:2804] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:24.987406 29421 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:24.980149 29933 consensus_queue.cc:1048] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:11:24.975445 29930 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:24.997581 29346 leader_election.cc:343] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.999446 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:25.000021 29346 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:25.001210 29879 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:25.001356 29626 raft_consensus.cc:2749] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:24.980171 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:25.005489 29376 raft_consensus.cc:2468] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 0.
I20260709 13:11:25.007526 29930 raft_consensus.cc:3060] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:25.014166 29346 consensus_peers.cc:597] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:25.008805 29898 consensus_queue.cc:1048] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:11:25.029182 29573 tablet_bootstrap.cc:654] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.032476 29570 tablet_bootstrap.cc:492] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:25.033070 29570 ts_tablet_manager.cc:1403] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.203s	user 0.023s	sys 0.006s
W20260709 13:11:25.034121 29346 leader_election.cc:343] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.036597 29930 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.044214 29930 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:25.047940 29573 tablet_bootstrap.cc:492] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:25.048601 29573 ts_tablet_manager.cc:1403] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.174s	user 0.014s	sys 0.011s
I20260709 13:11:25.051714 29573 raft_consensus.cc:359] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.052649 29573 raft_consensus.cc:385] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.053125 29573 raft_consensus.cc:740] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.054234 29573 consensus_queue.cc:260] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.058938 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:25.060639 29527 raft_consensus.cc:3060] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:25.061484 29573 ts_tablet_manager.cc:1434] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.003s
I20260709 13:11:25.061527 29572 tablet_bootstrap.cc:492] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:25.062793 29572 ts_tablet_manager.cc:1403] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.271s	user 0.013s	sys 0.014s
I20260709 13:11:25.062922 29573 tablet_bootstrap.cc:492] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:25.060452 29570 raft_consensus.cc:359] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.064178 29570 raft_consensus.cc:385] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.065150 29570 raft_consensus.cc:740] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.066200 29570 consensus_queue.cc:260] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.069026 29527 raft_consensus.cc:2468] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 1.
I20260709 13:11:25.070206 29573 tablet_bootstrap.cc:654] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.070482 29419 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:25.071254 29570 ts_tablet_manager.cc:1434] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.001s
I20260709 13:11:25.073179 29570 tablet_bootstrap.cc:492] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:25.071540 29930 raft_consensus.cc:2804] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:25.076246 29930 raft_consensus.cc:697] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:25.077847 29930 consensus_queue.cc:237] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:25.083647 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 48182.2us
I20260709 13:11:25.085539 29346 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:25.087353 29626 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:25.095291 29570 tablet_bootstrap.cc:654] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.104470 29572 raft_consensus.cc:359] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.105415 29572 raft_consensus.cc:385] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.105945 29572 raft_consensus.cc:740] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.106820 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:25.109186 29572 consensus_queue.cc:260] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.114550 29573 tablet_bootstrap.cc:492] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:25.115298 29573 ts_tablet_manager.cc:1403] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.053s	user 0.016s	sys 0.002s
I20260709 13:11:25.120431 29573 raft_consensus.cc:359] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.121172 29573 raft_consensus.cc:385] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.121464 29573 raft_consensus.cc:740] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.122164 29573 consensus_queue.cc:260] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:25.123569 29495 leader_election.cc:343] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.124054 29495 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:25.126439 29572 ts_tablet_manager.cc:1434] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.001s
I20260709 13:11:25.127900 29572 tablet_bootstrap.cc:492] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:25.128293 29379 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:25.148820 29346 consensus_peers.cc:597] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:25.132164 29899 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:25.144236 29881 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.171054 29881 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.171913 29573 ts_tablet_manager.cc:1434] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.056s	user 0.001s	sys 0.006s
I20260709 13:11:25.172003 29572 tablet_bootstrap.cc:654] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.173179 29573 tablet_bootstrap.cc:492] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:25.164530 29804 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.175952 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:25.176661 29381 raft_consensus.cc:3060] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:25.176000 29804 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.210340 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:25.211071 29378 raft_consensus.cc:2468] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 0.
I20260709 13:11:25.224715 29804 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:25.207697 29881 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:25.230310 29495 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:25.231985 29881 raft_consensus.cc:2804] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:25.232402 29881 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.232738 29881 raft_consensus.cc:3060] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:25.234910 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:11:25.241760 29495 leader_election.cc:343] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.243233 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:11:25.248057 29495 leader_election.cc:343] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.250595 29449 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:25.252781 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:11:25.255214 29495 leader_election.cc:343] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.256179 29495 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:25.218566 29381 raft_consensus.cc:2468] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 1.
I20260709 13:11:25.262894 29573 tablet_bootstrap.cc:654] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.263430 29279 catalog_manager.cc:5697] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 0 to 1, leader changed from <none> to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 1 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:25.264614 29899 raft_consensus.cc:2749] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:25.279991 29570 tablet_bootstrap.cc:492] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:25.280573 29570 ts_tablet_manager.cc:1403] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.208s	user 0.034s	sys 0.027s
I20260709 13:11:25.291679 29570 raft_consensus.cc:359] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.293397 29570 raft_consensus.cc:385] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.293814 29570 raft_consensus.cc:740] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.295724 29570 consensus_queue.cc:260] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.300652 29570 ts_tablet_manager.cc:1434] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.003s
I20260709 13:11:25.302119 29570 tablet_bootstrap.cc:492] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:25.298806 29881 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.307415 29881 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:25.308809 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:25.309518 29450 raft_consensus.cc:3060] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:25.310433 29572 tablet_bootstrap.cc:492] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:25.311105 29572 ts_tablet_manager.cc:1403] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.184s	user 0.017s	sys 0.014s
I20260709 13:11:25.317093 29450 raft_consensus.cc:2468] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:25.316972 29572 raft_consensus.cc:359] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.319998 29572 raft_consensus.cc:385] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.320358 29572 raft_consensus.cc:740] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.321044 29572 consensus_queue.cc:260] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.322698 29572 ts_tablet_manager.cc:1434] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:11:25.322870 29495 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:25.323773 29572 tablet_bootstrap.cc:492] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:25.323688 29881 raft_consensus.cc:2804] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:25.328238 29881 raft_consensus.cc:697] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:25.329797 29881 consensus_queue.cc:237] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.334376 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:25.335333 29377 raft_consensus.cc:3060] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:25.338531 29573 tablet_bootstrap.cc:492] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:25.338887 29572 tablet_bootstrap.cc:654] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.339138 29573 ts_tablet_manager.cc:1403] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.166s	user 0.013s	sys 0.005s
I20260709 13:11:25.347121 29573 raft_consensus.cc:359] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.348227 29573 raft_consensus.cc:385] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.348534 29573 raft_consensus.cc:740] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.351133 29377 raft_consensus.cc:2468] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:25.354979 29573 consensus_queue.cc:260] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.357662 29573 ts_tablet_manager.cc:1434] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.000s
I20260709 13:11:25.360420 29573 tablet_bootstrap.cc:492] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:25.366766 29572 tablet_bootstrap.cc:492] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:25.367271 29572 ts_tablet_manager.cc:1403] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.044s	user 0.029s	sys 0.002s
I20260709 13:11:25.370760 29570 tablet_bootstrap.cc:654] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.393009 29573 tablet_bootstrap.cc:654] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.402130 29572 raft_consensus.cc:359] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.402967 29572 raft_consensus.cc:385] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.403249 29572 raft_consensus.cc:740] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.404090 29572 consensus_queue.cc:260] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:25.406040 29327 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:25.410461 29278 catalog_manager.cc:5697] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 0 to 1, leader changed from <none> to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 1 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:25.427570 29626 consensus_queue.cc:1048] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:25.431001 29572 ts_tablet_manager.cc:1434] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.063s	user 0.010s	sys 0.000s
I20260709 13:11:25.432564 29572 tablet_bootstrap.cc:492] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:25.442078 29570 tablet_bootstrap.cc:492] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:25.442818 29570 ts_tablet_manager.cc:1403] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.141s	user 0.016s	sys 0.024s
I20260709 13:11:25.448369 29572 tablet_bootstrap.cc:654] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.453223 29573 tablet_bootstrap.cc:492] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:25.453778 29573 ts_tablet_manager.cc:1403] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.094s	user 0.012s	sys 0.010s
I20260709 13:11:25.456065 29881 raft_consensus.cc:493] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.456696 29573 raft_consensus.cc:359] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.456720 29881 raft_consensus.cc:515] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.457826 29573 raft_consensus.cc:385] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.458158 29573 raft_consensus.cc:740] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.458873 29573 consensus_queue.cc:260] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.461174 29573 ts_tablet_manager.cc:1434] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:11:25.462025 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:25.462262 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:11:25.464654 29495 leader_election.cc:343] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.464861 29570 raft_consensus.cc:359] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.465678 29570 raft_consensus.cc:385] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.465893 29881 leader_election.cc:290] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:25.466663 29573 tablet_bootstrap.cc:492] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:25.465979 29570 raft_consensus.cc:740] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.468128 29570 consensus_queue.cc:260] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.473868 29570 ts_tablet_manager.cc:1434] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.031s	user 0.010s	sys 0.002s
I20260709 13:11:25.476533 29570 tablet_bootstrap.cc:492] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:25.482649 29573 tablet_bootstrap.cc:654] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:25.486832 29346 consensus_peers.cc:597] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:25.495343 29570 tablet_bootstrap.cc:654] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:25.497846 29495 leader_election.cc:343] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.498174 29899 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.498875 29899 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.501561 29899 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:25.498567 29495 leader_election.cc:304] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:25.510203 29573 tablet_bootstrap.cc:492] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:25.510782 29573 ts_tablet_manager.cc:1403] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.044s	user 0.008s	sys 0.007s
I20260709 13:11:25.511044 29881 raft_consensus.cc:2749] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:25.512180 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:25.516629 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:25.497846 29572 tablet_bootstrap.cc:492] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:25.519284 29572 ts_tablet_manager.cc:1403] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.087s	user 0.027s	sys 0.019s
I20260709 13:11:25.513708 29573 raft_consensus.cc:359] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.521526 29573 raft_consensus.cc:385] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.521947 29573 raft_consensus.cc:740] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
W20260709 13:11:25.522233 29495 leader_election.cc:343] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.522702 29573 consensus_queue.cc:260] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.524682 29573 ts_tablet_manager.cc:1434] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
W20260709 13:11:25.525267 29495 leader_election.cc:343] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.525684 29495 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:25.526355 29899 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:25.528048 29572 raft_consensus.cc:359] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.528769 29572 raft_consensus.cc:385] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.529071 29572 raft_consensus.cc:740] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.529731 29572 consensus_queue.cc:260] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.532004 29572 ts_tablet_manager.cc:1434] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:11:25.534766 29570 tablet_bootstrap.cc:492] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:25.535300 29570 ts_tablet_manager.cc:1403] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.060s	user 0.014s	sys 0.004s
I20260709 13:11:25.538077 29570 raft_consensus.cc:359] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.538600 29572 tablet_bootstrap.cc:492] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:25.540299 29573 tablet_bootstrap.cc:492] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:25.547312 29573 tablet_bootstrap.cc:654] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.552666 29572 tablet_bootstrap.cc:654] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.552340 29864 consensus_queue.cc:1048] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:25.576159 29572 tablet_bootstrap.cc:492] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:25.576836 29572 ts_tablet_manager.cc:1403] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.038s	user 0.018s	sys 0.002s
I20260709 13:11:25.538878 29570 raft_consensus.cc:385] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.580154 29570 raft_consensus.cc:740] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.581739 29572 raft_consensus.cc:359] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.582151 29895 consensus_queue.cc:1048] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:25.582567 29572 raft_consensus.cc:385] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.581699 29570 consensus_queue.cc:260] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.583158 29572 raft_consensus.cc:740] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.585778 29570 ts_tablet_manager.cc:1434] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.000s
I20260709 13:11:25.589613 29572 consensus_queue.cc:260] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.586808 29570 tablet_bootstrap.cc:492] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:25.600703 29626 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.601948 29572 ts_tablet_manager.cc:1434] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.002s
I20260709 13:11:25.604810 29626 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.608354 29572 tablet_bootstrap.cc:492] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:25.611678 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:25.612263 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:11:25.614269 29346 leader_election.cc:343] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.614909 29626 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:25.619676 29573 tablet_bootstrap.cc:492] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:25.620540 29573 ts_tablet_manager.cc:1403] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.080s	user 0.029s	sys 0.025s
I20260709 13:11:25.615586 29527 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:25.623243 29344 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:25.625646 29925 raft_consensus.cc:2804] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:25.626228 29925 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.626556 29925 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:25.634528 29570 tablet_bootstrap.cc:654] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.637625 29626 raft_consensus.cc:493] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.639057 29626 raft_consensus.cc:515] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.639995 29572 tablet_bootstrap.cc:654] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.643136 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:11:25.644769 29346 leader_election.cc:343] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.646092 29925 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.646772 29626 leader_election.cc:290] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:25.647357 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:25.648079 29527 raft_consensus.cc:2468] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:25.648363 29925 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:25.672603 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:25.673659 29527 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:25.679610 29726 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.680267 29726 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.682439 29726 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:25.684419 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:11:25.686241 29346 leader_election.cc:343] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.687754 29344 leader_election.cc:304] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:25.688520 29924 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.689203 29626 raft_consensus.cc:2804] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:25.688990 29924 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.691155 29924 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:25.692469 29626 raft_consensus.cc:493] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.692934 29626 raft_consensus.cc:3060] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:25.693164 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:25.697149 29526 raft_consensus.cc:2468] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:25.693774 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:25.698341 29454 raft_consensus.cc:2393] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 1: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:11:25.694111 29573 raft_consensus.cc:359] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.699041 29573 raft_consensus.cc:385] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.703469 29573 raft_consensus.cc:740] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.706326 29573 consensus_queue.cc:260] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.716799 29570 tablet_bootstrap.cc:492] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:25.717361 29570 ts_tablet_manager.cc:1403] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.131s	user 0.014s	sys 0.013s
I20260709 13:11:25.707643 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:25.709606 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:25.719237 29528 raft_consensus.cc:2393] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 1: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:11:25.713114 29344 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:25.713460 29572 tablet_bootstrap.cc:492] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:25.720803 29925 raft_consensus.cc:2804] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:25.721220 29925 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.721356 29572 ts_tablet_manager.cc:1403] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.113s	user 0.019s	sys 0.007s
I20260709 13:11:25.721576 29925 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:25.722095 29346 leader_election.cc:343] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.722455 29344 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:25.723217 29726 raft_consensus.cc:3060] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:25.727416 29527 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:25.729161 29573 ts_tablet_manager.cc:1434] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.108s	user 0.003s	sys 0.007s
I20260709 13:11:25.730358 29925 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.733191 29626 raft_consensus.cc:515] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.733479 29925 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:25.734313 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:11:25.736279 29346 leader_election.cc:343] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.720357 29570 raft_consensus.cc:359] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.737349 29570 raft_consensus.cc:385] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.737658 29570 raft_consensus.cc:740] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.737705 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:25.738641 29925 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.738379 29570 consensus_queue.cc:260] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:25.739317 29346 leader_election.cc:343] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.739285 29925 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.741715 29726 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:25.739871 29344 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:25.742097 29925 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:25.742796 29925 raft_consensus.cc:2804] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:25.743075 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:11:25.744448 29346 leader_election.cc:343] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.741411 29573 tablet_bootstrap.cc:492] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:25.747712 29925 raft_consensus.cc:697] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:25.747954 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:25.748689 29530 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:25.748776 29572 raft_consensus.cc:359] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.749822 29572 raft_consensus.cc:385] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.750146 29572 raft_consensus.cc:740] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.750716 29344 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:25.750896 29572 consensus_queue.cc:260] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.749053 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:25.752187 29726 raft_consensus.cc:2804] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:25.752480 29527 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:25.752772 29726 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.753173 29573 tablet_bootstrap.cc:654] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.753386 29572 ts_tablet_manager.cc:1434] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:11:25.753484 29726 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:25.755016 29572 tablet_bootstrap.cc:492] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:25.760056 29881 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.760954 29626 leader_election.cc:290] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:25.762071 29570 ts_tablet_manager.cc:1434] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.003s
I20260709 13:11:25.760876 29881 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.763190 29570 tablet_bootstrap.cc:492] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:25.762863 29925 consensus_queue.cc:237] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.768785 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:25.769663 29530 raft_consensus.cc:3060] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:25.780890 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:25.782029 29881 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:11:25.782614 29495 leader_election.cc:343] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.783377 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:11:25.785121 29495 leader_election.cc:343] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.785661 29495 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:25.786597 29881 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:25.789119 29530 raft_consensus.cc:2468] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:25.789378 29864 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.796952 29570 tablet_bootstrap.cc:654] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.797327 29864 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.794265 29572 tablet_bootstrap.cc:654] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.796025 29726 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.800457 29864 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:25.801193 29344 leader_election.cc:304] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:25.802048 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:25.804104 29524 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 0.
I20260709 13:11:25.804454 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:25.804909 29924 raft_consensus.cc:2804] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:25.805135 29374 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 0.
I20260709 13:11:25.806056 29419 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:25.805491 29924 raft_consensus.cc:697] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:25.807585 29864 raft_consensus.cc:2804] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:25.808199 29864 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.808640 29924 consensus_queue.cc:237] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.808652 29864 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:25.817188 29726 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:25.818017 29527 raft_consensus.cc:2468] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:25.826588 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:25.827384 29526 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:25.835695 29344 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:25.839483 29924 raft_consensus.cc:2804] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:25.840384 29924 raft_consensus.cc:697] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:25.840708 29278 catalog_manager.cc:5697] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:25.841490 29924 consensus_queue.cc:237] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.843984 29526 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:25.839046 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:25.845710 29344 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:11:25.846558 29346 leader_election.cc:343] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.847317 29572 tablet_bootstrap.cc:492] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:25.835891 29899 consensus_queue.cc:1048] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:11:25.847316 29573 tablet_bootstrap.cc:492] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:25.847905 29572 ts_tablet_manager.cc:1403] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.093s	user 0.013s	sys 0.003s
I20260709 13:11:25.848094 29573 ts_tablet_manager.cc:1403] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.107s	user 0.018s	sys 0.012s
I20260709 13:11:25.850157 29726 raft_consensus.cc:2804] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:25.850801 29726 raft_consensus.cc:697] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:25.851747 29726 consensus_queue.cc:237] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.852855 29864 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.856621 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:25.857528 29374 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:25.860150 29570 tablet_bootstrap.cc:492] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:25.860812 29570 ts_tablet_manager.cc:1403] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.098s	user 0.020s	sys 0.011s
I20260709 13:11:25.860507 29572 raft_consensus.cc:359] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.861915 29572 raft_consensus.cc:385] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.862295 29572 raft_consensus.cc:740] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.864372 29572 consensus_queue.cc:260] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.870186 29864 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:25.878427 29572 ts_tablet_manager.cc:1434] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.000s
I20260709 13:11:25.876657 29573 raft_consensus.cc:359] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.879633 29573 raft_consensus.cc:385] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.879882 29573 raft_consensus.cc:740] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.880720 29573 consensus_queue.cc:260] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.887122 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:25.889073 29572 tablet_bootstrap.cc:492] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:25.891333 29570 raft_consensus.cc:359] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.892455 29570 raft_consensus.cc:385] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.893079 29570 raft_consensus.cc:740] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.895563 29526 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:25.902456 29570 consensus_queue.cc:260] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.908793 29573 ts_tablet_manager.cc:1434] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.060s	user 0.005s	sys 0.003s
I20260709 13:11:25.929117 29573 tablet_bootstrap.cc:492] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:25.927310 29526 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 1.
I20260709 13:11:25.960901 29419 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:25.961553 29374 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 1.
I20260709 13:11:25.962322 29895 raft_consensus.cc:2804] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:25.962947 29895 raft_consensus.cc:697] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:25.964018 29895 consensus_queue.cc:237] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.965421 29864 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.966198 29864 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.969789 29864 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:25.972289 29570 ts_tablet_manager.cc:1434] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.111s	user 0.007s	sys 0.000s
I20260709 13:11:25.972613 29947 consensus_queue.cc:1048] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:25.973371 29570 tablet_bootstrap.cc:492] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:25.973709 29572 tablet_bootstrap.cc:654] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.976730 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:25.977579 29527 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 0.
I20260709 13:11:25.979924 29419 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:25.981019 29864 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:25.983893 29864 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.985648 29864 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:25.983304 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 44465.6us
I20260709 13:11:25.988312 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:25.993286 29947 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.993909 29947 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:25.997857 29947 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:25.998644 29570 tablet_bootstrap.cc:654] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.010288 29279 catalog_manager.cc:5697] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:26.012189 29570 tablet_bootstrap.cc:492] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:26.012993 29570 ts_tablet_manager.cc:1403] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.040s	user 0.019s	sys 0.001s
I20260709 13:11:26.016505 29570 raft_consensus.cc:359] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.017304 29570 raft_consensus.cc:385] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.017642 29570 raft_consensus.cc:740] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.017913 29864 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.018206 29279 catalog_manager.cc:5697] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:26.019622 29421 leader_election.cc:343] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.020298 29864 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:26.012091 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:26.023524 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:26.028510 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:11:26.028733 29495 leader_election.cc:343] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.029268 29526 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.034710 29279 catalog_manager.cc:5697] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:26.037066 29570 consensus_queue.cc:260] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.042303 29570 ts_tablet_manager.cc:1434] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:11:26.037601 29526 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 1.
I20260709 13:11:26.043756 29570 tablet_bootstrap.cc:492] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:26.044088 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:11:26.044620 29495 leader_election.cc:343] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.039352 29573 tablet_bootstrap.cc:654] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.045101 29495 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:26.045878 29947 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:26.049867 29454 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.051852 29570 tablet_bootstrap.cc:654] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.056116 29419 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:26.057281 29864 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:26.058153 29864 raft_consensus.cc:697] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:26.059041 29864 consensus_queue.cc:237] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:26.065461 29421 leader_election.cc:343] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.068068 29276 catalog_manager.cc:5697] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 0 to 1, leader changed from <none> to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 1 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:26.073669 29572 tablet_bootstrap.cc:492] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:26.074347 29572 ts_tablet_manager.cc:1403] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.186s	user 0.006s	sys 0.018s
I20260709 13:11:26.078874 29572 raft_consensus.cc:359] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.079759 29572 raft_consensus.cc:385] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.080045 29572 raft_consensus.cc:740] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.106695 29453 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.107102 29276 catalog_manager.cc:5697] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 0 to 1, leader changed from <none> to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 1 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:26.082434 29572 consensus_queue.cc:260] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.122634 29572 ts_tablet_manager.cc:1434] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 13:11:26.124310 29572 tablet_bootstrap.cc:492] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:26.161026 29911 consensus_queue.cc:1048] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:26.162093 29573 tablet_bootstrap.cc:492] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:26.162650 29573 ts_tablet_manager.cc:1403] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.234s	user 0.017s	sys 0.036s
I20260709 13:11:26.164628 29570 tablet_bootstrap.cc:492] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:26.165244 29570 ts_tablet_manager.cc:1403] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.122s	user 0.045s	sys 0.044s
I20260709 13:11:26.167275 29572 tablet_bootstrap.cc:654] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.167203 29573 raft_consensus.cc:359] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.168195 29570 raft_consensus.cc:359] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.168556 29573 raft_consensus.cc:385] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.168980 29573 raft_consensus.cc:740] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.169728 29573 consensus_queue.cc:260] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.172757 29573 ts_tablet_manager.cc:1434] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.004s
I20260709 13:11:26.173738 29804 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.174238 29570 raft_consensus.cc:385] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.174330 29804 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.174603 29570 raft_consensus.cc:740] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.177011 29804 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:26.177007 29570 consensus_queue.cc:260] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.179661 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:26.173941 29573 tablet_bootstrap.cc:492] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
I20260709 13:11:26.183562 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:11:26.186365 29495 leader_election.cc:343] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:26.187335 29495 leader_election.cc:343] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.187871 29495 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:26.188112 29573 tablet_bootstrap.cc:654] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.196308 29933 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.196882 29933 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.199256 29933 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:26.200570 29947 raft_consensus.cc:2749] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:26.203255 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:26.204967 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:26.207089 29419 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:26.208998 29933 raft_consensus.cc:2749] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:26.216419 29570 ts_tablet_manager.cc:1434] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.051s	user 0.010s	sys 0.000s
I20260709 13:11:26.217928 29804 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.217950 29570 tablet_bootstrap.cc:492] T 132eb7648165463b83338075a7b2e683 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:26.218485 29804 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.221453 29626 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.221927 29626 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.224629 29626 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:26.226212 29573 tablet_bootstrap.cc:492] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:26.226164 29804 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:26.231315 29573 ts_tablet_manager.cc:1403] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.058s	user 0.017s	sys 0.007s
I20260709 13:11:26.225936 29454 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.232728 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:26.225744 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:26.235275 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:26.237128 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:26.239544 29573 raft_consensus.cc:359] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.240290 29573 raft_consensus.cc:385] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.240557 29573 raft_consensus.cc:740] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
W20260709 13:11:26.239928 29346 leader_election.cc:343] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.223465 29925 consensus_queue.cc:1048] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:11:26.241261 29573 consensus_queue.cc:260] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:26.243088 29344 leader_election.cc:343] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.243579 29344 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:26.244472 29573 ts_tablet_manager.cc:1434] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:11:26.245551 29573 tablet_bootstrap.cc:492] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483: Bootstrap starting.
W20260709 13:11:26.247740 29495 leader_election.cc:343] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:26.248776 29495 leader_election.cc:343] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.249167 29495 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:26.245618 29911 raft_consensus.cc:2749] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:26.252784 29804 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:26.255525 29573 tablet_bootstrap.cc:654] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:26.261979 29346 consensus_peers.cc:597] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:26.275254 29346 consensus_peers.cc:597] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:26.278815 29925 consensus_queue.cc:1048] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:26.283748 29572 tablet_bootstrap.cc:492] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:26.284370 29572 ts_tablet_manager.cc:1403] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.160s	user 0.022s	sys 0.026s
I20260709 13:11:26.287277 29572 raft_consensus.cc:359] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.289752 29572 raft_consensus.cc:385] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.290100 29572 raft_consensus.cc:740] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.290171 29911 consensus_queue.cc:1048] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:26.290920 29572 consensus_queue.cc:260] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.302511 29572 ts_tablet_manager.cc:1434] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:11:26.303779 29572 tablet_bootstrap.cc:492] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:26.308357 29626 consensus_queue.cc:1048] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:26.317284 29933 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.317983 29573 tablet_bootstrap.cc:492] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483: No bootstrap required, opened a new log
I20260709 13:11:26.317926 29933 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.318806 29573 ts_tablet_manager.cc:1403] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483: Time spent bootstrapping tablet: real 0.073s	user 0.027s	sys 0.022s
I20260709 13:11:26.320439 29933 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:26.321257 29804 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.321802 29804 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.322384 29573 raft_consensus.cc:359] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.323057 29573 raft_consensus.cc:385] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.324095 29570 tablet_bootstrap.cc:654] T 132eb7648165463b83338075a7b2e683 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.324963 29804 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:26.323282 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:26.326937 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:26.327472 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:26.329113 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:26.323391 29573 raft_consensus.cc:740] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.328567 29572 tablet_bootstrap.cc:654] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.335785 29528 raft_consensus.cc:2468] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 1.
I20260709 13:11:26.335747 29374 raft_consensus.cc:2468] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 1.
I20260709 13:11:26.340740 29573 consensus_queue.cc:260] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.341388 29421 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:26.342428 29933 raft_consensus.cc:2804] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:26.342808 29933 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.343075 29573 ts_tablet_manager.cc:1434] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:11:26.350798 29895 consensus_queue.cc:1048] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:26.343132 29933 raft_consensus.cc:3060] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:26.358328 29495 leader_election.cc:343] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:26.364703 29495 leader_election.cc:343] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.365134 29495 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:26.367192 29947 raft_consensus.cc:2749] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:26.368247 29933 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.372448 29933 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:26.375923 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:26.376590 29381 raft_consensus.cc:3060] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:26.377038 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:26.377600 29526 raft_consensus.cc:3060] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:26.393738 29572 tablet_bootstrap.cc:492] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:26.394337 29572 ts_tablet_manager.cc:1403] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.091s	user 0.019s	sys 0.016s
I20260709 13:11:26.397035 29526 raft_consensus.cc:2468] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 2.
I20260709 13:11:26.397133 29572 raft_consensus.cc:359] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.398023 29572 raft_consensus.cc:385] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.398348 29419 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:26.398346 29572 raft_consensus.cc:740] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.399343 29933 raft_consensus.cc:2804] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:26.400018 29933 raft_consensus.cc:697] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 2 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:26.401501 29570 tablet_bootstrap.cc:492] T 132eb7648165463b83338075a7b2e683 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:26.401984 29570 ts_tablet_manager.cc:1403] T 132eb7648165463b83338075a7b2e683 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.184s	user 0.020s	sys 0.017s
I20260709 13:11:26.402741 29381 raft_consensus.cc:2468] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 2.
I20260709 13:11:26.400974 29933 consensus_queue.cc:237] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.404976 29570 raft_consensus.cc:359] T 132eb7648165463b83338075a7b2e683 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.405748 29570 raft_consensus.cc:385] T 132eb7648165463b83338075a7b2e683 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.405999 29570 raft_consensus.cc:740] T 132eb7648165463b83338075a7b2e683 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.406665 29570 consensus_queue.cc:260] T 132eb7648165463b83338075a7b2e683 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.399895 29572 consensus_queue.cc:260] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.409423 29453 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.409891 29572 ts_tablet_manager.cc:1434] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:11:26.411172 29572 tablet_bootstrap.cc:492] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:26.413831 29570 ts_tablet_manager.cc:1434] T 132eb7648165463b83338075a7b2e683 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:11:26.415150 29570 tablet_bootstrap.cc:492] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:26.426635 29572 tablet_bootstrap.cc:654] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.434165 29570 tablet_bootstrap.cc:654] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.448118 29570 tablet_bootstrap.cc:492] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:26.448719 29570 ts_tablet_manager.cc:1403] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.004s
I20260709 13:11:26.449062 29572 tablet_bootstrap.cc:492] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:26.449723 29572 ts_tablet_manager.cc:1403] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.039s	user 0.002s	sys 0.014s
I20260709 13:11:26.452013 29570 raft_consensus.cc:359] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.452353 29572 raft_consensus.cc:359] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.452836 29570 raft_consensus.cc:385] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.452981 29572 raft_consensus.cc:385] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.453150 29570 raft_consensus.cc:740] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.453305 29572 raft_consensus.cc:740] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.453874 29570 consensus_queue.cc:260] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.456235 29570 ts_tablet_manager.cc:1434] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:11:26.457713 29570 tablet_bootstrap.cc:492] T 6b7b1911380a4f0e9a8d9584662a3dce P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:26.460371 29930 consensus_queue.cc:1048] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:26.456219 29572 consensus_queue.cc:260] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.463129 29572 ts_tablet_manager.cc:1434] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:11:26.467469 29626 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.468197 29626 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.468716 29570 tablet_bootstrap.cc:654] T 6b7b1911380a4f0e9a8d9584662a3dce P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.469712 29968 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.470297 29626 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:26.470221 29968 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.471701 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:26.472900 29968 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:26.472851 29528 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:26.476413 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:26.477093 29527 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:26.478963 29344 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:26.481472 29572 tablet_bootstrap.cc:492] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:26.481700 29925 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:26.482106 29925 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.482441 29925 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.484162 29344 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:26.485287 29911 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:26.485652 29911 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.485984 29911 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.491395 29572 tablet_bootstrap.cc:654] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.491328 29925 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.494800 29925 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:26.497176 29911 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.499200 29911 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:26.500401 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:26.501031 29524 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.503115 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:26.503314 29572 tablet_bootstrap.cc:492] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:26.503756 29530 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.503957 29572 ts_tablet_manager.cc:1403] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.007s
I20260709 13:11:26.508162 29524 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:26.507858 29572 raft_consensus.cc:359] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.510255 29572 raft_consensus.cc:385] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.510649 29572 raft_consensus.cc:740] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.511564 29572 consensus_queue.cc:260] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.513319 29530 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:26.513598 29570 tablet_bootstrap.cc:492] T 6b7b1911380a4f0e9a8d9584662a3dce P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:26.514344 29344 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:26.515410 29570 ts_tablet_manager.cc:1403] T 6b7b1911380a4f0e9a8d9584662a3dce P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.058s	user 0.011s	sys 0.003s
I20260709 13:11:26.515865 29925 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:26.517256 29925 raft_consensus.cc:697] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:26.519690 29572 ts_tablet_manager.cc:1434] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.003s
I20260709 13:11:26.522574 29572 tablet_bootstrap.cc:492] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:26.522305 29925 consensus_queue.cc:237] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:26.522954 29327 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:26.529995 29572 tablet_bootstrap.cc:654] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.519819 29570 raft_consensus.cc:359] T 6b7b1911380a4f0e9a8d9584662a3dce P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.521268 29344 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:26.531770 29570 raft_consensus.cc:385] T 6b7b1911380a4f0e9a8d9584662a3dce P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.532127 29570 raft_consensus.cc:740] T 6b7b1911380a4f0e9a8d9584662a3dce P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.532512 29626 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:26.532966 29626 raft_consensus.cc:697] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:26.532846 29570 consensus_queue.cc:260] T 6b7b1911380a4f0e9a8d9584662a3dce P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.535601 29570 ts_tablet_manager.cc:1434] T 6b7b1911380a4f0e9a8d9584662a3dce P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.003s
I20260709 13:11:26.536823 29968 consensus_queue.cc:1048] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:26.544296 29570 tablet_bootstrap.cc:492] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:26.533124 29279 catalog_manager.cc:5697] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 0 to 2, leader changed from <none> to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 2 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:26.538695 29626 consensus_queue.cc:237] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.555549 29570 tablet_bootstrap.cc:654] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.564167 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:26.564158 29911 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.565274 29911 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.571681 29911 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:26.572762 29968 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.575268 29968 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.576297 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:26.578236 29968 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:26.573582 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:26.579744 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:26.579800 29526 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:26.581784 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:26.582163 29344 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:26.583040 29968 raft_consensus.cc:2804] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:26.583617 29968 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.584240 29968 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.586129 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:26.597657 29374 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.602255 29924 raft_consensus.cc:493] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.602937 29924 raft_consensus.cc:515] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.623857 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:26.624820 29449 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
W20260709 13:11:26.659190 29346 leader_election.cc:343] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:26.662132 29346 leader_election.cc:343] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:26.664173 29346 leader_election.cc:343] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:26.666828 29346 leader_election.cc:343] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.625499 29864 consensus_queue.cc:1048] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.051s
I20260709 13:11:26.709453 29924 leader_election.cc:290] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:26.712131 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:26.713207 29530 raft_consensus.cc:2468] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:26.715358 29344 leader_election.cc:304] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:26.727057 29924 raft_consensus.cc:2804] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:26.727523 29924 raft_consensus.cc:493] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.727912 29924 raft_consensus.cc:3060] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.678480 29968 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.745589 30014 raft_consensus.cc:493] T 132eb7648165463b83338075a7b2e683 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:26.752530 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 126296us
I20260709 13:11:26.757587 29572 tablet_bootstrap.cc:492] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:26.758468 29572 ts_tablet_manager.cc:1403] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.236s	user 0.027s	sys 0.042s
W20260709 13:11:26.769292 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 84657.1us
I20260709 13:11:26.769292 30014 raft_consensus.cc:515] T 132eb7648165463b83338075a7b2e683 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.794855 29570 tablet_bootstrap.cc:492] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:26.795756 29570 ts_tablet_manager.cc:1403] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.252s	user 0.029s	sys 0.029s
I20260709 13:11:26.800120 29864 consensus_queue.cc:1048] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:26.804649 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:26.838526 30016 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.860754 29968 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:26.865582 30016 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.873922 30014 leader_election.cc:290] T 132eb7648165463b83338075a7b2e683 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:26.903736 29570 raft_consensus.cc:359] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.905223 29570 raft_consensus.cc:385] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.905669 29570 raft_consensus.cc:740] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.906929 29570 consensus_queue.cc:260] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.907809 29572 raft_consensus.cc:359] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.908676 29572 raft_consensus.cc:385] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.909086 29572 raft_consensus.cc:740] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.911645 29572 consensus_queue.cc:260] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:26.925628 29570 ts_tablet_manager.cc:1434] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.129s	user 0.009s	sys 0.001s
I20260709 13:11:26.916326 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:26.935760 29572 ts_tablet_manager.cc:1434] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.177s	user 0.015s	sys 0.021s
I20260709 13:11:26.942943 29570 tablet_bootstrap.cc:492] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:26.941900 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:26.948500 29530 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.969383 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:27.058384 29346 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:27.077677 29279 catalog_manager.cc:5697] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:27.097323 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:27.099012 29450 raft_consensus.cc:2468] T 6b7b1911380a4f0e9a8d9584662a3dce P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:27.117925 29572 tablet_bootstrap.cc:492] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:27.079365 29279 catalog_manager.cc:5697] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:27.053028 29456 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:27.169448 29530 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:27.062331 30016 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:27.173628 29447 raft_consensus.cc:3060] T 132eb7648165463b83338075a7b2e683 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:27.181528 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:27.380532 30037 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:27.416188 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 110363us
I20260709 13:11:27.417018 29456 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:27.434892 30043 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.436923 30043 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:27.439361 29572 tablet_bootstrap.cc:654] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:27.439379 29924 consensus_meta.cc:287] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.711s	user 0.011s	sys 0.005s
I20260709 13:11:27.445878 29570 tablet_bootstrap.cc:654] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:27.448395 29924 raft_consensus.cc:515] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:27.457188 29374 raft_consensus.cc:1275] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:11:27.457548 29924 leader_election.cc:290] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:11:27.461923 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 382779us
I20260709 13:11:27.462792 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:27.465698 30043 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:27.469620 29947 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:27.470727 30034 log.cc:927] Time spent T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.067s	user 0.004s	sys 0.000s
I20260709 13:11:27.470351 29947 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:27.523082 29899 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.524032 29899 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:27.526372 29899 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:11:27.502924 29495 leader_election.cc:343] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:27.473119 29947 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:11:27.592087 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 58527.5us
I20260709 13:11:27.611294 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:27.596386 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:27.620639 29570 tablet_bootstrap.cc:492] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:27.621256 29570 ts_tablet_manager.cc:1403] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.679s	user 0.045s	sys 0.028s
I20260709 13:11:27.628474 29572 tablet_bootstrap.cc:492] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:27.629549 29572 ts_tablet_manager.cc:1403] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.512s	user 0.032s	sys 0.064s
I20260709 13:11:27.630949 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:11:27.631737 29495 leader_election.cc:343] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:27.632591 29570 raft_consensus.cc:359] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:27.633368 29570 raft_consensus.cc:385] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:27.631765 29453 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 0.
I20260709 13:11:27.633975 29570 raft_consensus.cc:740] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:27.635897 29570 consensus_queue.cc:260] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:27.636881 29495 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:27.637121 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:27.638077 30029 raft_consensus.cc:2804] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:27.638816 30029 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.639284 30029 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:27.639616 29570 ts_tablet_manager.cc:1434] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.003s
I20260709 13:11:27.644210 29570 tablet_bootstrap.cc:492] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:27.643956 29572 raft_consensus.cc:359] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:27.644832 29572 raft_consensus.cc:385] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:27.645138 29572 raft_consensus.cc:740] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:27.638053 29376 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 0.
I20260709 13:11:27.646474 29572 consensus_queue.cc:260] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:27.649629 29572 ts_tablet_manager.cc:1434] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:11:27.644107 30011 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:27.650767 30011 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:27.654708 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:27.659440 29570 tablet_bootstrap.cc:654] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:27.664193 30011 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:27.672883 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:11:27.673659 29495 leader_election.cc:343] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:27.672487 29344 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:27.663478 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:27.678642 30037 raft_consensus.cc:2804] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:27.685339 30037 raft_consensus.cc:697] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:27.686324 30037 consensus_queue.cc:237] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:27.668849 29864 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:27.693743 29495 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:27.695911 30032 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:11:27.699055 29495 leader_election.cc:343] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:27.699667 29495 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:27.701707 29495 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:27.696655 30032 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:27.704512 30013 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:27.707981 30036 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:27.688089 29864 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:27.710006 30016 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:27.714290 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:27.710559 30016 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:27.715188 29526 raft_consensus.cc:3060] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:27.687425 30015 consensus_queue.cc:1048] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:11:27.705942 29899 raft_consensus.cc:2749] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:27.723320 30032 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:27.728060 30016 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:27.730559 29864 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:27.731213 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:27.713821 30013 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.740571 29526 raft_consensus.cc:2468] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:27.764089 29419 leader_election.cc:304] T 132eb7648165463b83338075a7b2e683 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:27.760941 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:27.764302 29522 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:27.770157 29572 tablet_bootstrap.cc:492] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:27.753280 30013 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:27.787664 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 71690.8us
I20260709 13:11:27.791432 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:27.794909 29527 raft_consensus.cc:1275] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:11:27.801451 30018 raft_consensus.cc:2749] T 132eb7648165463b83338075a7b2e683 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:27.801185 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:27.798895 30044 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.829697 29570 tablet_bootstrap.cc:492] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:27.830437 29570 ts_tablet_manager.cc:1403] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.187s	user 0.012s	sys 0.015s
I20260709 13:11:27.833276 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:27.803930 30044 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:27.844031 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:27.844636 29455 raft_consensus.cc:3060] T 6b7b1911380a4f0e9a8d9584662a3dce P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:27.848295 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:27.849028 30044 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:27.849604 29895 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:27.850348 29895 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:27.855346 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:27.856065 29895 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:27.861392 29344 leader_election.cc:304] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:27.875926 30027 raft_consensus.cc:2804] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:27.877106 29495 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:27.880745 30011 raft_consensus.cc:2749] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:27.881711 29344 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:27.883805 30024 consensus_queue.cc:1048] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:11:27.884398 30044 raft_consensus.cc:2804] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:27.884804 30044 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.885154 30044 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:27.883997 30027 raft_consensus.cc:697] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:27.864544 29279 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37586 (request call id 91) took 1154 ms. Trace:
I20260709 13:11:27.895573 29279 rpcz_store.cc:276] 0709 13:11:26.691120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.691486 (+   366us) service_pool.cc:224] Handling call
0709 13:11:27.840183 (+1148697us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:27.440047 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:27.462497 (+ 22450us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:27.462713 (+   216us) write_op.cc:435] Acquired schema lock
0709 13:11:27.462740 (+    27us) tablet.cc:662] Decoding operations
0709 13:11:27.463240 (+   500us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:27.463298 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:27.463324 (+    26us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:11:27.464382 (+  1058us) tablet.cc:701] Row locks acquired
0709 13:11:27.464411 (+    29us) write_op.cc:260] PREPARE: finished
0709 13:11:27.465755 (+  1344us) write_op.cc:270] Start()
0709 13:11:27.465917 (+   162us) write_op.cc:276] Timestamp: P: 1783602687465675 usec, L: 0
0709 13:11:27.465946 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:11:27.466829 (+   883us) log.cc:844] Serialized 934 byte log entry
0709 13:11:27.613986 (+147157us) op_driver.cc:464] REPLICATION: finished
0709 13:11:27.650169 (+ 36183us) write_op.cc:301] APPLY: starting
0709 13:11:27.650237 (+    68us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:27.650331 (+    94us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:27.653970 (+  3639us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:27.664260 (+ 10290us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:27.664451 (+   191us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:11:27.664496 (+    45us) write_op.cc:312] APPLY: finished
0709 13:11:27.688563 (+ 24067us) log.cc:844] Serialized 28 byte log entry
0709 13:11:27.689075 (+   512us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:27.689196 (+   121us) write_op.cc:454] Released schema lock
0709 13:11:27.689460 (+   264us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:27.694876 (+  5416us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:27.697920 (+  3044us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":35926,"apply.run_cpu_time_us":3265,"apply.run_wall_time_us":40404,"num_ops":2,"prepare.queue_time_us":252371,"prepare.run_cpu_time_us":5041,"prepare.run_wall_time_us":52906,"replication_time_us":144488,"thread_start_us":168266,"threads_started":2}]]}
I20260709 13:11:27.904750 29455 raft_consensus.cc:2468] T 6b7b1911380a4f0e9a8d9584662a3dce P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:27.909394 29572 tablet_bootstrap.cc:654] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:27.912981 29570 raft_consensus.cc:359] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:27.914052 29570 raft_consensus.cc:385] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:27.914350 29570 raft_consensus.cc:740] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:27.917893 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:27.886737 29911 consensus_queue.cc:1048] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.033s
I20260709 13:11:27.920674 29570 consensus_queue.cc:260] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:27.929199 29495 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:27.953239 30036 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:27.926977 30013 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:27.966238 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:27.975716 30019 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:27.980458 29570 ts_tablet_manager.cc:1434] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.150s	user 0.010s	sys 0.004s
I20260709 13:11:27.972915 29447 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:27.983626 29327 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:27.983657 29570 tablet_bootstrap.cc:492] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:27.965061 30027 consensus_queue.cc:237] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:27.976344 29521 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:27.992434 30044 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:27.976470 30029 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:28.015944 30029 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:28.029094 30044 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:28.040951 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:28.029641 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:28.043927 29452 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.030077 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:28.036373 29344 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:27.976337 30019 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:28.060760 29346 consensus_peers.cc:597] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:28.063669 29572 tablet_bootstrap.cc:492] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:28.065411 30022 consensus_queue.cc:1048] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:11:28.064555 30024 raft_consensus.cc:2804] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:28.067353 29572 ts_tablet_manager.cc:1403] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.295s	user 0.017s	sys 0.011s
I20260709 13:11:28.067757 30024 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.069796 30019 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:28.064759 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:28.070338 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:28.059051 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:28.077423 30013 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:28.078811 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:28.079985 30024 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:28.080717 29495 leader_election.cc:343] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:28.100823 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:28.109447 29521 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:28.112962 29346 leader_election.cc:343] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:28.118793 30022 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.130066 29570 tablet_bootstrap.cc:654] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.133464 29572 raft_consensus.cc:359] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:28.134619 29572 raft_consensus.cc:385] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.134987 29572 raft_consensus.cc:740] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.137421 30022 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:28.159339 29572 consensus_queue.cc:260] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:28.170192 29495 leader_election.cc:343] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:28.176494 29452 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:28.180672 29495 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:28.182374 30022 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:11:28.184018 30058 log.cc:927] Time spent T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:11:28.183863 30029 raft_consensus.cc:2804] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:28.184957 30029 raft_consensus.cc:697] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:28.185984 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:28.186132 30029 consensus_queue.cc:237] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:28.188670 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:28.189606 29381 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:28.173081 30056 log.cc:927] Time spent T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.101s	user 0.000s	sys 0.002s
I20260709 13:11:28.196141 29572 ts_tablet_manager.cc:1434] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.112s	user 0.009s	sys 0.000s
I20260709 13:11:28.197062 30044 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.194295 29895 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.198912 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:28.213671 29895 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:28.222195 29895 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:28.221841 30044 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:28.229977 29279 catalog_manager.cc:5697] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:28.231834 29572 tablet_bootstrap.cc:492] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5: Bootstrap starting.
I20260709 13:11:28.233038 29279 catalog_manager.cc:5697] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:28.233006 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 165873us
I20260709 13:11:28.239571 29419 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:28.232131 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:28.234071 29381 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:28.244637 30044 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:28.241979 30015 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:28.247668 30020 consensus_queue.cc:1048] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:11:28.248519 29495 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:28.249426 30029 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:28.251572 30029 raft_consensus.cc:697] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:28.252823 30029 consensus_queue.cc:237] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:28.256678 29570 tablet_bootstrap.cc:492] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:28.257871 29570 ts_tablet_manager.cc:1403] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.274s	user 0.024s	sys 0.000s
I20260709 13:11:28.242477 29419 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:28.260767 30022 raft_consensus.cc:2749] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:28.262107 29277 catalog_manager.cc:5697] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 0 to 1, leader changed from <none> to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 1 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:28.234867 30024 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:28.272017 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:28.273416 29570 raft_consensus.cc:359] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:28.277583 29570 raft_consensus.cc:385] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.278103 29570 raft_consensus.cc:740] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.281025 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:28.281422 29521 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
W20260709 13:11:28.284204 29346 leader_election.cc:343] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:28.284861 30024 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:11:28.286132 29346 leader_election.cc:343] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:28.287607 30037 consensus_queue.cc:1048] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:28.289332 29344 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:28.294348 30038 raft_consensus.cc:2804] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:28.293063 29570 consensus_queue.cc:260] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:28.307256 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:28.316272 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:28.316999 29523 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.296089 30038 raft_consensus.cc:697] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:28.318495 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:28.318810 30038 consensus_queue.cc:237] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:28.338567 29572 tablet_bootstrap.cc:654] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:28.343150 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 46939.1us
I20260709 13:11:28.350065 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:28.351275 29455 raft_consensus.cc:2393] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 1: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:11:28.394340 29570 ts_tablet_manager.cc:1434] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.136s	user 0.008s	sys 0.003s
I20260709 13:11:28.407591 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:28.415632 29570 tablet_bootstrap.cc:492] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:28.418551 29448 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.420311 29419 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:28.434459 30008 consensus_queue.cc:1048] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 13:11:28.460520 29895 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:28.470397 29570 tablet_bootstrap.cc:654] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.472510 29419 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:28.488689 30018 raft_consensus.cc:2749] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:28.495702 29419 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:28.505621 29346 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:28.533435 30043 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:28.570967 29346 leader_election.cc:343] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:28.579661 30038 consensus_queue.cc:1048] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:28.577610 29523 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:28.618120 29572 tablet_bootstrap.cc:492] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5: No bootstrap required, opened a new log
I20260709 13:11:28.619088 29572 ts_tablet_manager.cc:1403] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent bootstrapping tablet: real 0.392s	user 0.033s	sys 0.018s
I20260709 13:11:28.626353 29570 tablet_bootstrap.cc:492] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:28.627002 29570 ts_tablet_manager.cc:1403] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.212s	user 0.014s	sys 0.011s
I20260709 13:11:28.630375 29570 raft_consensus.cc:359] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:28.631214 29570 raft_consensus.cc:385] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.631553 29570 raft_consensus.cc:740] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.632288 29570 consensus_queue.cc:260] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:28.633844 29572 raft_consensus.cc:359] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:28.634663 29572 raft_consensus.cc:385] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.634944 29572 raft_consensus.cc:740] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.635656 29572 consensus_queue.cc:260] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:28.638810 29572 ts_tablet_manager.cc:1434] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:11:28.639688 29570 ts_tablet_manager.cc:1434] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:11:28.640800 29570 tablet_bootstrap.cc:492] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:28.640664 29344 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:28.641984 30020 raft_consensus.cc:2804] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:28.642584 30020 raft_consensus.cc:697] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:28.643625 30020 consensus_queue.cc:237] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:28.677359 30016 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:28.678655 30016 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:28.682757 30016 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:28.693375 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:11:28.702363 30072 log.cc:927] Time spent T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:11:28.703128 30016 consensus_queue.cc:1048] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:28.720165 30015 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.721184 30015 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:28.722883 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:28.721452 30043 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:28.730213 30015 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:28.730609 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:28.732182 29378 raft_consensus.cc:2393] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 1: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:11:28.740499 29864 raft_consensus.cc:2749] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:28.744215 29570 tablet_bootstrap.cc:654] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.752075 29495 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:28.761404 30016 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:28.775089 30037 consensus_queue.cc:1048] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:11:28.793002 29453 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.806758 29449 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.798152 30036 consensus_queue.cc:1048] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:11:28.881178 30044 consensus_queue.cc:1048] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:11:28.902652 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 108235us
I20260709 13:11:28.927188 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:28.937723 30089 consensus_queue.cc:1048] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:28.938308 29570 tablet_bootstrap.cc:492] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:28.938819 29570 ts_tablet_manager.cc:1403] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.298s	user 0.023s	sys 0.019s
I20260709 13:11:28.941932 29570 raft_consensus.cc:359] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:28.942685 29570 raft_consensus.cc:385] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.942981 29570 raft_consensus.cc:740] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.962337 29977 consensus_queue.cc:1048] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:11:29.013564 29570 consensus_queue.cc:260] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:29.024642 30094 consensus_queue.cc:1048] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:29.036474 29419 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:29.024029 29570 ts_tablet_manager.cc:1434] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.085s	user 0.008s	sys 0.002s
I20260709 13:11:29.042116 29570 tablet_bootstrap.cc:492] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:29.055946 29570 tablet_bootstrap.cc:654] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:29.088299 29570 tablet_bootstrap.cc:492] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:29.088887 29570 ts_tablet_manager.cc:1403] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.005s
W20260709 13:11:29.107343 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 48049.2us
I20260709 13:11:29.106175 30015 raft_consensus.cc:2749] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:29.137923 29570 raft_consensus.cc:359] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:29.136504 30044 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.138731 29570 raft_consensus.cc:385] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:29.140422 29570 raft_consensus.cc:740] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
W20260709 13:11:29.142102 29327 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:29.139247 30044 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:29.145756 29570 consensus_queue.cc:260] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:29.144865 30044 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:29.155584 29570 ts_tablet_manager.cc:1434] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.065s	user 0.008s	sys 0.001s
I20260709 13:11:29.162817 29570 tablet_bootstrap.cc:492] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a: Bootstrap starting.
I20260709 13:11:29.170849 29570 tablet_bootstrap.cc:654] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:29.190601 29570 tablet_bootstrap.cc:492] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a: No bootstrap required, opened a new log
I20260709 13:11:29.298969 29570 ts_tablet_manager.cc:1403] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a: Time spent bootstrapping tablet: real 0.136s	user 0.010s	sys 0.017s
W20260709 13:11:29.229813 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 80702.5us
I20260709 13:11:29.250079 29279 catalog_manager.cc:5697] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 0 to 1, leader changed from <none> to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:11:29.284201 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:29.300921 29454 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:29.301642 29279 catalog_manager.cc:5697] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 0 to 1, leader changed from <none> to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 1 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:29.308952 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:29.313125 29523 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 0.
I20260709 13:11:29.329002 29570 raft_consensus.cc:359] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:29.330396 29570 raft_consensus.cc:385] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:29.330775 29570 raft_consensus.cc:740] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Initialized, Role: FOLLOWER
I20260709 13:11:29.351420 29570 consensus_queue.cc:260] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:29.355964 29570 ts_tablet_manager.cc:1434] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.007s
I20260709 13:11:29.378551 29344 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:29.380244 29911 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:29.380837 29911 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.381349 29911 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:29.394315 30101 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.395224 30101 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:29.406818 29451 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:29.421941 30101 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:29.434038 30101 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.435792 30101 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:29.441155 30027 consensus_queue.cc:1048] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:11:29.466493 29911 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:29.469926 29911 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:29.479300 30101 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:29.495260 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:29.496098 29522 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:29.517174 29522 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:29.518743 29344 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:29.519707 29911 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:29.520263 29911 raft_consensus.cc:697] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:29.520639 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:29.521447 29911 consensus_queue.cc:237] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:29.522949 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:29.543339 29277 catalog_manager.cc:5697] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:29.560451 30043 consensus_queue.cc:1048] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:29.586251 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:29.588222 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:29.593706 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:29.594597 29453 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:29.605356 29421 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:29.607479 30064 raft_consensus.cc:2749] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:29.607764 29421 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:29.608731 30064 raft_consensus.cc:2749] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:29.622402 29455 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:29.643119 29276 catalog_manager.cc:5697] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:29.663551 29453 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:29.810449 28234 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:29.828573 30110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:29.833995 30113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:29.862128 30111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:29.864507 28234 server_base.cc:1061] running on GCE node
I20260709 13:11:29.865741 28234 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:29.866123 28234 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:29.866382 28234 hybrid_clock.cc:648] HybridClock initialized: now 1783602689866361 us; error 0 us; skew 500 ppm
I20260709 13:11:29.867023 28234 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:29.872373 28234 webserver.cc:533] Webserver started at http://127.27.146.132:42853/ using document root <none> and password file <none>
I20260709 13:11:29.873313 28234 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:29.873587 28234 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:29.874099 28234 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:29.876428 28234 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/ts-3-root/instance:
uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
format_stamp: "Formatted at 2026-07-09 13:11:29 on dist-test-slave-clfv"
I20260709 13:11:29.884469 28234 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.002s	sys 0.006s
I20260709 13:11:29.888615 30118 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:29.889627 28234 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:11:29.890094 28234 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/ts-3-root
uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
format_stamp: "Formatted at 2026-07-09 13:11:29 on dist-test-slave-clfv"
I20260709 13:11:29.890462 28234 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:29.917798 28234 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:29.920133 28234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:29.920033 30027 consensus_queue.cc:1048] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:29.924039 28234 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:29.927356 28234 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:29.927747 28234 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:11:29.928113 28234 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:29.928450 28234 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:11:29.949091 29968 consensus_queue.cc:1048] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:30.233023 30182 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.146.132:44671 every 8 connection(s)
I20260709 13:11:30.233839 28234 rpc_server.cc:307] RPC server started. Bound to: 127.27.146.132:44671
I20260709 13:11:30.263484 28234 auto_leader_rebalancer-test.cc:384] add a tserver: ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:11:30.276789 30183 heartbeater.cc:344] Connected to a master server at 127.27.146.190:37499
I20260709 13:11:30.277321 30183 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:30.278272 30183 heartbeater.cc:507] Master 127.27.146.190:37499 requested a full tablet report, sending...
I20260709 13:11:30.281132 29279 ts_manager.cc:194] Registered new tserver with Master: ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:11:30.282831 29279 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35182
I20260709 13:11:31.286559 30183 heartbeater.cc:499] Master 127.27.146.190:37499 was elected leader, sending a full tablet report...
I20260709 13:11:31.369673 29377 consensus_queue.cc:237] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:11:31.376403 29523 raft_consensus.cc:1275] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:31.376529 29453 raft_consensus.cc:1275] T 132eb7648165463b83338075a7b2e683 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:31.383880 29968 consensus_queue.cc:1048] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:31.385159 30027 consensus_queue.cc:1048] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:31.401230 29968 raft_consensus.cc:2955] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
W20260709 13:11:31.401212 29344 consensus_peers.cc:597] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 -> Peer ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671): Couldn't send request to peer ca041dab9b2f44409ed7bf4c6cf66ab2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 132eb7648165463b83338075a7b2e683. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:31.406562 29453 raft_consensus.cc:2955] T 132eb7648165463b83338075a7b2e683 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:11:31.408052 29523 raft_consensus.cc:2955] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:11:31.427325 29279 catalog_manager.cc:5697] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: config changed from index -1 to 2, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:31.441262 29455 consensus_queue.cc:237] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:11:31.463315 29377 raft_consensus.cc:1275] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:31.463562 29523 raft_consensus.cc:1275] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:31.465572 29864 consensus_queue.cc:1048] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:31.466691 30064 consensus_queue.cc:1048] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:11:31.481630 29419 consensus_peers.cc:597] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a -> Peer ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671): Couldn't send request to peer ca041dab9b2f44409ed7bf4c6cf66ab2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bf5703156380472bb793863fd4fd7544. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:31.487087 30064 raft_consensus.cc:2955] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:11:31.489606 29523 raft_consensus.cc:2955] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:11:31.495523 29377 raft_consensus.cc:2955] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:11:31.514922 29277 catalog_manager.cc:5697] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: config changed from index -1 to 2, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New cstate: current_term: 2 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:31.589767 29523 consensus_queue.cc:237] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:11:31.599372 29380 raft_consensus.cc:1275] T 77157470a53245d7b1b307fba4d73aad P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:31.601508 29453 raft_consensus.cc:1275] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:31.603164 30187 consensus_queue.cc:1048] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:31.606518 30187 consensus_queue.cc:1048] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:31.615468 30207 raft_consensus.cc:2955] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:11:31.620666 29380 raft_consensus.cc:2955] T 77157470a53245d7b1b307fba4d73aad P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:11:31.648710 29380 consensus_queue.cc:237] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
W20260709 13:11:31.654907 29493 consensus_peers.cc:597] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 -> Peer ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671): Couldn't send request to peer ca041dab9b2f44409ed7bf4c6cf66ab2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77157470a53245d7b1b307fba4d73aad. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:31.654556 29277 catalog_manager.cc:5697] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: config changed from index -1 to 2, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New cstate: current_term: 1 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:31.663678 29455 raft_consensus.cc:2955] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:11:31.703634 29523 raft_consensus.cc:1275] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:11:31.704171 29344 consensus_peers.cc:597] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 -> Peer ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671): Couldn't send request to peer ca041dab9b2f44409ed7bf4c6cf66ab2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6b7b1911380a4f0e9a8d9584662a3dce. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:31.705156 29455 raft_consensus.cc:1275] T 6b7b1911380a4f0e9a8d9584662a3dce P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:31.706935 30027 consensus_queue.cc:1048] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:31.707990 29977 consensus_queue.cc:1048] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:31.733640 29968 raft_consensus.cc:2955] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:11:31.737396 29523 raft_consensus.cc:2955] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:11:31.740226 29455 raft_consensus.cc:2955] T 6b7b1911380a4f0e9a8d9584662a3dce P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:11:31.763444 29276 catalog_manager.cc:5697] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: config changed from index -1 to 2, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:11:31.870975 30217 ts_tablet_manager.cc:933] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2: Initiating tablet copy from peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127)
I20260709 13:11:31.873971 30217 tablet_copy_client.cc:323] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Beginning tablet copy session from remote peer at address 127.27.146.129:42127
I20260709 13:11:31.894307 29391 tablet_copy_service.cc:140] P 429e58eb058349e3bf72b5a870c8f6e5: Received BeginTabletCopySession request for tablet 132eb7648165463b83338075a7b2e683 from peer ca041dab9b2f44409ed7bf4c6cf66ab2 ({username='slave'} at 127.0.0.1:58422)
I20260709 13:11:31.894991 29391 tablet_copy_service.cc:161] P 429e58eb058349e3bf72b5a870c8f6e5: Beginning new tablet copy session on tablet 132eb7648165463b83338075a7b2e683 from peer ca041dab9b2f44409ed7bf4c6cf66ab2 at {username='slave'} at 127.0.0.1:58422: session id = ca041dab9b2f44409ed7bf4c6cf66ab2-132eb7648165463b83338075a7b2e683
I20260709 13:11:31.903216 29391 tablet_copy_source_session.cc:215] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:31.907949 30217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 132eb7648165463b83338075a7b2e683. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:31.926539 30217 tablet_copy_client.cc:806] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:31.927361 30217 tablet_copy_client.cc:670] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:31.933564 30217 tablet_copy_client.cc:538] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:31.948875 30217 tablet_bootstrap.cc:492] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap starting.
I20260709 13:11:31.980448 30217 tablet_bootstrap.cc:492] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:31.982678 30217 tablet_bootstrap.cc:492] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap complete.
I20260709 13:11:31.983404 30217 ts_tablet_manager.cc:1403] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.011s
I20260709 13:11:31.987789 30217 raft_consensus.cc:359] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:11:31.988751 30217 raft_consensus.cc:740] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Initialized, Role: LEARNER
I20260709 13:11:31.989452 30217 consensus_queue.cc:260] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:11:32.001387 30217 ts_tablet_manager.cc:1434] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent starting tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:11:32.003554 29391 tablet_copy_service.cc:342] P 429e58eb058349e3bf72b5a870c8f6e5: Request end of tablet copy session ca041dab9b2f44409ed7bf4c6cf66ab2-132eb7648165463b83338075a7b2e683 received from {username='slave'} at 127.0.0.1:58422
I20260709 13:11:32.004102 29391 tablet_copy_service.cc:434] P 429e58eb058349e3bf72b5a870c8f6e5: ending tablet copy session ca041dab9b2f44409ed7bf4c6cf66ab2-132eb7648165463b83338075a7b2e683 on tablet 132eb7648165463b83338075a7b2e683 with peer ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:11:32.041112 30217 ts_tablet_manager.cc:933] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2: Initiating tablet copy from peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:32.043630 30217 tablet_copy_client.cc:323] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Beginning tablet copy session from remote peer at address 127.27.146.130:40551
I20260709 13:11:32.058615 29466 tablet_copy_service.cc:140] P 183db85c071f489fbc8de63a9edd8a3a: Received BeginTabletCopySession request for tablet bf5703156380472bb793863fd4fd7544 from peer ca041dab9b2f44409ed7bf4c6cf66ab2 ({username='slave'} at 127.0.0.1:36436)
I20260709 13:11:32.059331 29466 tablet_copy_service.cc:161] P 183db85c071f489fbc8de63a9edd8a3a: Beginning new tablet copy session on tablet bf5703156380472bb793863fd4fd7544 from peer ca041dab9b2f44409ed7bf4c6cf66ab2 at {username='slave'} at 127.0.0.1:36436: session id = ca041dab9b2f44409ed7bf4c6cf66ab2-bf5703156380472bb793863fd4fd7544
I20260709 13:11:32.068607 29466 tablet_copy_source_session.cc:215] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:32.071568 30217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf5703156380472bb793863fd4fd7544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:32.090809 30225 ts_tablet_manager.cc:933] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2: Initiating tablet copy from peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:32.099879 30225 tablet_copy_client.cc:323] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Beginning tablet copy session from remote peer at address 127.27.146.131:35367
I20260709 13:11:32.113776 30217 tablet_copy_client.cc:806] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:32.114540 30217 tablet_copy_client.cc:670] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:32.118933 30217 tablet_copy_client.cc:538] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:32.139760 30217 tablet_bootstrap.cc:492] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap starting.
I20260709 13:11:32.140100 29540 tablet_copy_service.cc:140] P 71aa3578fd924765ab9ac0729c8d1483: Received BeginTabletCopySession request for tablet 77157470a53245d7b1b307fba4d73aad from peer ca041dab9b2f44409ed7bf4c6cf66ab2 ({username='slave'} at 127.0.0.1:53428)
I20260709 13:11:32.140762 29540 tablet_copy_service.cc:161] P 71aa3578fd924765ab9ac0729c8d1483: Beginning new tablet copy session on tablet 77157470a53245d7b1b307fba4d73aad from peer ca041dab9b2f44409ed7bf4c6cf66ab2 at {username='slave'} at 127.0.0.1:53428: session id = ca041dab9b2f44409ed7bf4c6cf66ab2-77157470a53245d7b1b307fba4d73aad
I20260709 13:11:32.150017 29540 tablet_copy_source_session.cc:215] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:32.157723 30225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77157470a53245d7b1b307fba4d73aad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:32.177810 30217 tablet_bootstrap.cc:492] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:32.178884 30217 tablet_bootstrap.cc:492] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap complete.
I20260709 13:11:32.179642 30217 ts_tablet_manager.cc:1403] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent bootstrapping tablet: real 0.040s	user 0.019s	sys 0.012s
I20260709 13:11:32.183389 30217 raft_consensus.cc:359] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:11:32.184614 30217 raft_consensus.cc:740] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Initialized, Role: LEARNER
I20260709 13:11:32.185487 30217 consensus_queue.cc:260] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:11:32.189011 30217 ts_tablet_manager.cc:1434] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:11:32.191308 30225 tablet_copy_client.cc:806] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:32.191965 30225 tablet_copy_client.cc:670] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:32.192972 29466 tablet_copy_service.cc:342] P 183db85c071f489fbc8de63a9edd8a3a: Request end of tablet copy session ca041dab9b2f44409ed7bf4c6cf66ab2-bf5703156380472bb793863fd4fd7544 received from {username='slave'} at 127.0.0.1:36436
I20260709 13:11:32.193498 29466 tablet_copy_service.cc:434] P 183db85c071f489fbc8de63a9edd8a3a: ending tablet copy session ca041dab9b2f44409ed7bf4c6cf66ab2-bf5703156380472bb793863fd4fd7544 on tablet bf5703156380472bb793863fd4fd7544 with peer ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:11:32.194422 30228 ts_tablet_manager.cc:933] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2: Initiating tablet copy from peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127)
I20260709 13:11:32.196924 30228 tablet_copy_client.cc:323] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Beginning tablet copy session from remote peer at address 127.27.146.129:42127
I20260709 13:11:32.197243 30225 tablet_copy_client.cc:538] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:32.198827 29391 tablet_copy_service.cc:140] P 429e58eb058349e3bf72b5a870c8f6e5: Received BeginTabletCopySession request for tablet 6b7b1911380a4f0e9a8d9584662a3dce from peer ca041dab9b2f44409ed7bf4c6cf66ab2 ({username='slave'} at 127.0.0.1:58422)
I20260709 13:11:32.199405 29391 tablet_copy_service.cc:161] P 429e58eb058349e3bf72b5a870c8f6e5: Beginning new tablet copy session on tablet 6b7b1911380a4f0e9a8d9584662a3dce from peer ca041dab9b2f44409ed7bf4c6cf66ab2 at {username='slave'} at 127.0.0.1:58422: session id = ca041dab9b2f44409ed7bf4c6cf66ab2-6b7b1911380a4f0e9a8d9584662a3dce
I20260709 13:11:32.208102 29391 tablet_copy_source_session.cc:215] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:32.209503 30225 tablet_bootstrap.cc:492] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap starting.
I20260709 13:11:32.211850 30228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b7b1911380a4f0e9a8d9584662a3dce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:32.232625 30228 tablet_copy_client.cc:806] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:32.233258 30228 tablet_copy_client.cc:670] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:32.237810 30228 tablet_copy_client.cc:538] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:32.416455 30225 tablet_bootstrap.cc:492] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:32.417644 30225 tablet_bootstrap.cc:492] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap complete.
I20260709 13:11:32.449936 30225 ts_tablet_manager.cc:1403] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent bootstrapping tablet: real 0.241s	user 0.021s	sys 0.021s
I20260709 13:11:32.460696 30225 raft_consensus.cc:359] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:11:32.473467 30225 raft_consensus.cc:740] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Initialized, Role: LEARNER
I20260709 13:11:32.477465 30228 tablet_bootstrap.cc:492] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap starting.
I20260709 13:11:32.475975 30225 consensus_queue.cc:260] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:11:32.489725 30225 ts_tablet_manager.cc:1434] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent starting tablet: real 0.039s	user 0.004s	sys 0.002s
I20260709 13:11:32.514397 30158 raft_consensus.cc:1217] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:32.520045 29540 tablet_copy_service.cc:342] P 71aa3578fd924765ab9ac0729c8d1483: Request end of tablet copy session ca041dab9b2f44409ed7bf4c6cf66ab2-77157470a53245d7b1b307fba4d73aad received from {username='slave'} at 127.0.0.1:53428
I20260709 13:11:32.520581 29540 tablet_copy_service.cc:434] P 71aa3578fd924765ab9ac0729c8d1483: ending tablet copy session ca041dab9b2f44409ed7bf4c6cf66ab2-77157470a53245d7b1b307fba4d73aad on tablet 77157470a53245d7b1b307fba4d73aad with peer ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:11:32.525484 30158 raft_consensus.cc:1217] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:11:32.562001 30228 tablet_bootstrap.cc:492] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:32.563889 30228 tablet_bootstrap.cc:492] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap complete.
I20260709 13:11:32.564795 30228 ts_tablet_manager.cc:1403] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent bootstrapping tablet: real 0.088s	user 0.023s	sys 0.008s
I20260709 13:11:32.567934 30228 raft_consensus.cc:359] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:11:32.568861 30228 raft_consensus.cc:740] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Initialized, Role: LEARNER
I20260709 13:11:32.569609 30228 consensus_queue.cc:260] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:11:32.572190 30228 ts_tablet_manager.cc:1434] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:32.574117 29391 tablet_copy_service.cc:342] P 429e58eb058349e3bf72b5a870c8f6e5: Request end of tablet copy session ca041dab9b2f44409ed7bf4c6cf66ab2-6b7b1911380a4f0e9a8d9584662a3dce received from {username='slave'} at 127.0.0.1:58422
I20260709 13:11:32.574579 29391 tablet_copy_service.cc:434] P 429e58eb058349e3bf72b5a870c8f6e5: ending tablet copy session ca041dab9b2f44409ed7bf4c6cf66ab2-6b7b1911380a4f0e9a8d9584662a3dce on tablet 6b7b1911380a4f0e9a8d9584662a3dce with peer ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:11:32.590281 30158 raft_consensus.cc:1217] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:32.675779 30158 raft_consensus.cc:1217] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:33.007193 30239 raft_consensus.cc:1064] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483: attempting to promote NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 to VOTER
I20260709 13:11:33.010483 30239 consensus_queue.cc:237] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:33.023299 30242 raft_consensus.cc:1064] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5: attempting to promote NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 to VOTER
I20260709 13:11:33.028064 30242 consensus_queue.cc:237] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:33.057469 29523 raft_consensus.cc:1275] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:11:33.065507 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 59221.3us
I20260709 13:11:33.069439 30158 raft_consensus.cc:1275] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 LEARNER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:33.072140 30214 consensus_queue.cc:1048] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:11:33.075320 30235 raft_consensus.cc:1064] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a: attempting to promote NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 to VOTER
I20260709 13:11:33.075199 30241 consensus_queue.cc:1048] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:33.078200 30235 consensus_queue.cc:237] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:33.092890 30157 raft_consensus.cc:1275] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 LEARNER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:33.094980 30234 consensus_queue.cc:1048] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:33.104672 30156 raft_consensus.cc:1275] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 LEARNER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:11:33.112089 29451 raft_consensus.cc:1275] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:33.120257 30235 consensus_queue.cc:1048] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:33.127041 29523 raft_consensus.cc:1275] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:11:33.129036 29453 raft_consensus.cc:1275] T 132eb7648165463b83338075a7b2e683 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:33.132815 29377 raft_consensus.cc:1275] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:11:33.135667 29379 raft_consensus.cc:1275] T 77157470a53245d7b1b307fba4d73aad P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:33.124801 30239 consensus_queue.cc:1048] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:11:33.143826 30251 consensus_queue.cc:1048] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:33.146790 30214 consensus_queue.cc:1048] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:11:33.167264 30241 raft_consensus.cc:2955] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:33.173990 30158 raft_consensus.cc:2955] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:33.195020 30235 consensus_queue.cc:1048] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:33.196900 30233 raft_consensus.cc:2955] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:33.201439 29379 raft_consensus.cc:2955] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:33.214278 30212 consensus_queue.cc:1048] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:33.218168 29523 raft_consensus.cc:2955] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:33.260764 29279 catalog_manager.cc:5697] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:33.288787 30157 raft_consensus.cc:2955] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:33.256301 29454 raft_consensus.cc:2955] T 132eb7648165463b83338075a7b2e683 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:33.303597 29524 raft_consensus.cc:2955] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
W20260709 13:11:33.333288 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 49237.6us
I20260709 13:11:33.348812 29276 catalog_manager.cc:5697] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:33.379370 30242 raft_consensus.cc:1064] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5: attempting to promote NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 to VOTER
I20260709 13:11:33.382304 30242 consensus_queue.cc:237] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:33.391006 30239 raft_consensus.cc:2955] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:33.405781 29456 raft_consensus.cc:2955] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:33.428025 29377 raft_consensus.cc:2955] T 77157470a53245d7b1b307fba4d73aad P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:33.431730 29524 raft_consensus.cc:1275] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:33.433261 30158 raft_consensus.cc:1275] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 LEARNER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:33.430943 30157 raft_consensus.cc:2955] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:33.434871 30246 consensus_queue.cc:1048] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:33.443035 30241 consensus_queue.cc:1048] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:33.446202 29451 raft_consensus.cc:1275] T 6b7b1911380a4f0e9a8d9584662a3dce P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:33.452973 30241 consensus_queue.cc:1048] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:33.516572 30214 raft_consensus.cc:2955] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:33.517895 29456 consensus_queue.cc:237] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:33.533943 29279 catalog_manager.cc:5697] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:33.538431 29524 raft_consensus.cc:2955] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:33.538280 30157 raft_consensus.cc:2955] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:33.549446 30158 raft_consensus.cc:1275] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:11:33.556305 29377 raft_consensus.cc:1275] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:11:33.562263 29276 catalog_manager.cc:5697] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:33.567020 30233 consensus_queue.cc:1048] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:33.568960 29522 consensus_queue.cc:237] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:33.571130 29377 consensus_queue.cc:237] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:33.578446 30262 consensus_queue.cc:1048] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:33.579020 29454 raft_consensus.cc:2955] T 6b7b1911380a4f0e9a8d9584662a3dce P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:33.588464 30156 raft_consensus.cc:1275] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:33.595053 30212 consensus_queue.cc:1048] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:33.608876 30233 raft_consensus.cc:2955] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:33.613065 30156 raft_consensus.cc:1275] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:33.610782 29380 consensus_queue.cc:237] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:33.621727 30244 raft_consensus.cc:2955] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:33.625141 29522 raft_consensus.cc:1275] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:33.627948 29265 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bf5703156380472bb793863fd4fd7544 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:33.628569 30260 consensus_queue.cc:1048] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:33.629429 30156 raft_consensus.cc:2955] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:33.633972 30214 consensus_queue.cc:1048] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:33.637120 29377 raft_consensus.cc:2955] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:33.648952 30158 raft_consensus.cc:1275] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:33.649660 29454 raft_consensus.cc:1275] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:33.650368 30260 raft_consensus.cc:2955] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:33.652045 29521 raft_consensus.cc:1275] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:33.660208 30214 consensus_queue.cc:1048] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:33.661235 30158 raft_consensus.cc:2955] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:33.663951 30214 consensus_queue.cc:1048] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:33.670955 29265 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 132eb7648165463b83338075a7b2e683 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:33.675297 29528 raft_consensus.cc:2955] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:33.692708 29263 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 77157470a53245d7b1b307fba4d73aad with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:33.696707 29278 catalog_manager.cc:5697] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: config changed from index 3 to 4, VOTER 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) evicted. New cstate: current_term: 1 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:33.702610 30244 consensus_queue.cc:1048] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:33.708945 30241 raft_consensus.cc:2955] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:33.722882 29450 raft_consensus.cc:2955] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:33.725512 29277 catalog_manager.cc:5697] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: config changed from index 3 to 4, VOTER 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) evicted. New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:33.727766 29265 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6b7b1911380a4f0e9a8d9584662a3dce with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:33.731329 30158 raft_consensus.cc:2955] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:33.746197 29524 raft_consensus.cc:2955] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:33.748363 30156 raft_consensus.cc:2955] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:33.783037 29278 catalog_manager.cc:5697] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: config changed from index 3 to 4, VOTER 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) evicted. New cstate: current_term: 2 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:33.798102 29441 tablet_service.cc:1558] Processing DeleteTablet for tablet 132eb7648165463b83338075a7b2e683 with delete_type TABLET_DATA_TOMBSTONED (TS 183db85c071f489fbc8de63a9edd8a3a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45780
I20260709 13:11:33.809477 29368 tablet_service.cc:1558] Processing DeleteTablet for tablet 77157470a53245d7b1b307fba4d73aad with delete_type TABLET_DATA_TOMBSTONED (TS 429e58eb058349e3bf72b5a870c8f6e5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52164
I20260709 13:11:33.822592 30274 tablet_replica.cc:333] T 77157470a53245d7b1b307fba4d73aad P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:11:33.824358 30274 raft_consensus.cc:2243] T 77157470a53245d7b1b307fba4d73aad P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.827049 29520 tablet_service.cc:1558] Processing DeleteTablet for tablet bf5703156380472bb793863fd4fd7544 with delete_type TABLET_DATA_TOMBSTONED (TS 71aa3578fd924765ab9ac0729c8d1483 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37954
I20260709 13:11:33.834280 30273 tablet_replica.cc:333] T 132eb7648165463b83338075a7b2e683 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:11:33.835602 30273 raft_consensus.cc:2243] T 132eb7648165463b83338075a7b2e683 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.836344 30273 raft_consensus.cc:2272] T 132eb7648165463b83338075a7b2e683 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.838939 30274 raft_consensus.cc:2272] T 77157470a53245d7b1b307fba4d73aad P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.853909 29277 catalog_manager.cc:5697] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: config changed from index 3 to 4, VOTER 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) evicted. New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:33.867870 30274 ts_tablet_manager.cc:1916] T 77157470a53245d7b1b307fba4d73aad P 429e58eb058349e3bf72b5a870c8f6e5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:33.872819 30275 tablet_replica.cc:333] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:11:33.874078 30275 raft_consensus.cc:2243] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.857384 30273 ts_tablet_manager.cc:1916] T 132eb7648165463b83338075a7b2e683 P 183db85c071f489fbc8de63a9edd8a3a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:33.884859 29441 tablet_service.cc:1558] Processing DeleteTablet for tablet 6b7b1911380a4f0e9a8d9584662a3dce with delete_type TABLET_DATA_TOMBSTONED (TS 183db85c071f489fbc8de63a9edd8a3a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45780
I20260709 13:11:33.888782 30275 raft_consensus.cc:2272] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.894914 30275 ts_tablet_manager.cc:1916] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:33.904263 30274 ts_tablet_manager.cc:1929] T 77157470a53245d7b1b307fba4d73aad P 429e58eb058349e3bf72b5a870c8f6e5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:33.905030 30274 log.cc:1199] T 77157470a53245d7b1b307fba4d73aad P 429e58eb058349e3bf72b5a870c8f6e5: Deleting WAL directory at /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/ts-0-root/wals/77157470a53245d7b1b307fba4d73aad
I20260709 13:11:33.904263 30273 ts_tablet_manager.cc:1929] T 132eb7648165463b83338075a7b2e683 P 183db85c071f489fbc8de63a9edd8a3a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:33.905957 30273 log.cc:1199] T 132eb7648165463b83338075a7b2e683 P 183db85c071f489fbc8de63a9edd8a3a: Deleting WAL directory at /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/ts-1-root/wals/132eb7648165463b83338075a7b2e683
I20260709 13:11:33.907924 29265 catalog_manager.cc:5028] TS 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): tablet 77157470a53245d7b1b307fba4d73aad (table test-workload [id=364c32d53f7748a2857a4a9acd17c671]) successfully deleted
I20260709 13:11:33.908509 30273 tablet_replica.cc:333] T 6b7b1911380a4f0e9a8d9584662a3dce P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:11:33.908859 29265 catalog_manager.cc:5028] TS 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): tablet 132eb7648165463b83338075a7b2e683 (table test-workload [id=364c32d53f7748a2857a4a9acd17c671]) successfully deleted
I20260709 13:11:33.909648 30273 raft_consensus.cc:2243] T 6b7b1911380a4f0e9a8d9584662a3dce P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.910355 30273 raft_consensus.cc:2272] T 6b7b1911380a4f0e9a8d9584662a3dce P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.914089 30273 ts_tablet_manager.cc:1916] T 6b7b1911380a4f0e9a8d9584662a3dce P 183db85c071f489fbc8de63a9edd8a3a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:33.918810 30275 ts_tablet_manager.cc:1929] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 13:11:33.919440 30275 log.cc:1199] T bf5703156380472bb793863fd4fd7544 P 71aa3578fd924765ab9ac0729c8d1483: Deleting WAL directory at /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/ts-2-root/wals/bf5703156380472bb793863fd4fd7544
I20260709 13:11:33.921335 29263 catalog_manager.cc:5028] TS 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): tablet bf5703156380472bb793863fd4fd7544 (table test-workload [id=364c32d53f7748a2857a4a9acd17c671]) successfully deleted
I20260709 13:11:33.929446 30273 ts_tablet_manager.cc:1929] T 6b7b1911380a4f0e9a8d9584662a3dce P 183db85c071f489fbc8de63a9edd8a3a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:33.929909 30273 log.cc:1199] T 6b7b1911380a4f0e9a8d9584662a3dce P 183db85c071f489fbc8de63a9edd8a3a: Deleting WAL directory at /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/ts-1-root/wals/6b7b1911380a4f0e9a8d9584662a3dce
I20260709 13:11:33.931710 29265 catalog_manager.cc:5028] TS 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): tablet 6b7b1911380a4f0e9a8d9584662a3dce (table test-workload [id=364c32d53f7748a2857a4a9acd17c671]) successfully deleted
I20260709 13:11:34.956393 29380 consensus_queue.cc:237] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:11:34.964907 29524 raft_consensus.cc:1275] T 8e9b44184de046118890bc6cd6e1dc18 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:34.966343 29450 raft_consensus.cc:1275] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:34.967676 30272 consensus_queue.cc:1048] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:34.969411 30214 consensus_queue.cc:1048] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:11:34.972083 29344 consensus_peers.cc:597] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 -> Peer ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671): Couldn't send request to peer ca041dab9b2f44409ed7bf4c6cf66ab2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8e9b44184de046118890bc6cd6e1dc18. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:34.981468 30272 raft_consensus.cc:2955] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:11:34.983865 29450 raft_consensus.cc:2955] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:11:34.985141 29521 raft_consensus.cc:2955] T 8e9b44184de046118890bc6cd6e1dc18 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:11:35.004408 29524 consensus_queue.cc:237] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:11:35.006268 29277 catalog_manager.cc:5697] T 8e9b44184de046118890bc6cd6e1dc18 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: config changed from index -1 to 2, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:11:35.025851 29451 raft_consensus.cc:1275] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:35.026427 29380 raft_consensus.cc:1275] T 4cced75430d1485689f4eff61c816af0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:11:35.027782 29493 consensus_peers.cc:597] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671): Couldn't send request to peer ca041dab9b2f44409ed7bf4c6cf66ab2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4cced75430d1485689f4eff61c816af0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.028292 30234 consensus_queue.cc:1048] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:35.029487 30244 consensus_queue.cc:1048] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:35.053735 30284 raft_consensus.cc:2955] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:11:35.063030 29380 raft_consensus.cc:2955] T 4cced75430d1485689f4eff61c816af0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:11:35.063978 29451 raft_consensus.cc:2955] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:11:35.076804 29524 consensus_queue.cc:237] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:11:35.086231 29377 raft_consensus.cc:1275] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:11:35.087865 29493 consensus_peers.cc:597] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671): Couldn't send request to peer ca041dab9b2f44409ed7bf4c6cf66ab2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: abd2ad92265844ca9eb9012eb76e7789. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.091392 30284 consensus_queue.cc:1048] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:35.089082 29279 catalog_manager.cc:5697] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: config changed from index -1 to 2, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New cstate: current_term: 1 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:35.094877 29451 raft_consensus.cc:1275] T abd2ad92265844ca9eb9012eb76e7789 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:35.096462 30234 consensus_queue.cc:1048] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:35.104928 30234 raft_consensus.cc:2955] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:11:35.125847 29456 consensus_queue.cc:237] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:11:35.127089 29451 raft_consensus.cc:2955] T abd2ad92265844ca9eb9012eb76e7789 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:11:35.128203 29380 raft_consensus.cc:2955] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:11:35.155912 29279 catalog_manager.cc:5697] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: config changed from index -1 to 2, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New cstate: current_term: 1 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:35.163259 29524 raft_consensus.cc:1275] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:35.165252 30238 consensus_queue.cc:1048] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:11:35.166786 29419 consensus_peers.cc:597] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a -> Peer ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671): Couldn't send request to peer ca041dab9b2f44409ed7bf4c6cf66ab2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4195dd8da2fa4e9a9a0f134c2d81f95a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.173568 29380 raft_consensus.cc:1275] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:35.175288 30238 consensus_queue.cc:1048] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:35.184088 30235 raft_consensus.cc:2955] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:11:35.186574 29524 raft_consensus.cc:2955] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:11:35.204000 29377 raft_consensus.cc:2955] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:11:35.214246 29278 catalog_manager.cc:5697] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: config changed from index -1 to 2, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New cstate: current_term: 1 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:11:35.467631 30298 ts_tablet_manager.cc:933] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2: Initiating tablet copy from peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127)
I20260709 13:11:35.469878 30298 tablet_copy_client.cc:323] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Beginning tablet copy session from remote peer at address 127.27.146.129:42127
I20260709 13:11:35.471771 29391 tablet_copy_service.cc:140] P 429e58eb058349e3bf72b5a870c8f6e5: Received BeginTabletCopySession request for tablet 8e9b44184de046118890bc6cd6e1dc18 from peer ca041dab9b2f44409ed7bf4c6cf66ab2 ({username='slave'} at 127.0.0.1:58422)
I20260709 13:11:35.472318 29391 tablet_copy_service.cc:161] P 429e58eb058349e3bf72b5a870c8f6e5: Beginning new tablet copy session on tablet 8e9b44184de046118890bc6cd6e1dc18 from peer ca041dab9b2f44409ed7bf4c6cf66ab2 at {username='slave'} at 127.0.0.1:58422: session id = ca041dab9b2f44409ed7bf4c6cf66ab2-8e9b44184de046118890bc6cd6e1dc18
I20260709 13:11:35.481443 29391 tablet_copy_source_session.cc:215] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:35.485103 30298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e9b44184de046118890bc6cd6e1dc18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:35.507443 30298 tablet_copy_client.cc:806] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:35.508163 30298 tablet_copy_client.cc:670] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:35.513070 30298 tablet_copy_client.cc:538] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:35.523444 30298 tablet_bootstrap.cc:492] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap starting.
I20260709 13:11:35.543422 30298 tablet_bootstrap.cc:492] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:35.544811 30298 tablet_bootstrap.cc:492] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap complete.
I20260709 13:11:35.545554 30298 ts_tablet_manager.cc:1403] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.008s
I20260709 13:11:35.550122 30298 raft_consensus.cc:359] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:11:35.550904 30298 raft_consensus.cc:740] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Initialized, Role: LEARNER
I20260709 13:11:35.551558 30298 consensus_queue.cc:260] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:11:35.555092 30298 ts_tablet_manager.cc:1434] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:11:35.558353 29391 tablet_copy_service.cc:342] P 429e58eb058349e3bf72b5a870c8f6e5: Request end of tablet copy session ca041dab9b2f44409ed7bf4c6cf66ab2-8e9b44184de046118890bc6cd6e1dc18 received from {username='slave'} at 127.0.0.1:58422
I20260709 13:11:35.558871 29391 tablet_copy_service.cc:434] P 429e58eb058349e3bf72b5a870c8f6e5: ending tablet copy session ca041dab9b2f44409ed7bf4c6cf66ab2-8e9b44184de046118890bc6cd6e1dc18 on tablet 8e9b44184de046118890bc6cd6e1dc18 with peer ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:11:35.575433 30298 ts_tablet_manager.cc:933] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2: Initiating tablet copy from peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:35.577353 30298 tablet_copy_client.cc:323] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Beginning tablet copy session from remote peer at address 127.27.146.130:40551
I20260709 13:11:35.579103 29466 tablet_copy_service.cc:140] P 183db85c071f489fbc8de63a9edd8a3a: Received BeginTabletCopySession request for tablet 4195dd8da2fa4e9a9a0f134c2d81f95a from peer ca041dab9b2f44409ed7bf4c6cf66ab2 ({username='slave'} at 127.0.0.1:36436)
I20260709 13:11:35.579732 29466 tablet_copy_service.cc:161] P 183db85c071f489fbc8de63a9edd8a3a: Beginning new tablet copy session on tablet 4195dd8da2fa4e9a9a0f134c2d81f95a from peer ca041dab9b2f44409ed7bf4c6cf66ab2 at {username='slave'} at 127.0.0.1:36436: session id = ca041dab9b2f44409ed7bf4c6cf66ab2-4195dd8da2fa4e9a9a0f134c2d81f95a
I20260709 13:11:35.588167 29466 tablet_copy_source_session.cc:215] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:35.591825 30298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4195dd8da2fa4e9a9a0f134c2d81f95a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:35.610877 30298 tablet_copy_client.cc:806] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:35.611644 30298 tablet_copy_client.cc:670] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:35.614133 30303 ts_tablet_manager.cc:933] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2: Initiating tablet copy from peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:35.617919 30303 tablet_copy_client.cc:323] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Beginning tablet copy session from remote peer at address 127.27.146.131:35367
I20260709 13:11:35.620110 30298 tablet_copy_client.cc:538] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:35.620165 29540 tablet_copy_service.cc:140] P 71aa3578fd924765ab9ac0729c8d1483: Received BeginTabletCopySession request for tablet abd2ad92265844ca9eb9012eb76e7789 from peer ca041dab9b2f44409ed7bf4c6cf66ab2 ({username='slave'} at 127.0.0.1:53428)
I20260709 13:11:35.620797 29540 tablet_copy_service.cc:161] P 71aa3578fd924765ab9ac0729c8d1483: Beginning new tablet copy session on tablet abd2ad92265844ca9eb9012eb76e7789 from peer ca041dab9b2f44409ed7bf4c6cf66ab2 at {username='slave'} at 127.0.0.1:53428: session id = ca041dab9b2f44409ed7bf4c6cf66ab2-abd2ad92265844ca9eb9012eb76e7789
I20260709 13:11:35.629546 29540 tablet_copy_source_session.cc:215] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:35.632618 30298 tablet_bootstrap.cc:492] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap starting.
I20260709 13:11:35.633386 30303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abd2ad92265844ca9eb9012eb76e7789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:35.654738 30303 tablet_copy_client.cc:806] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:35.655655 30303 tablet_copy_client.cc:670] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:35.669430 30298 tablet_bootstrap.cc:492] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:35.670655 30298 tablet_bootstrap.cc:492] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap complete.
I20260709 13:11:35.671479 30298 ts_tablet_manager.cc:1403] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent bootstrapping tablet: real 0.039s	user 0.028s	sys 0.007s
I20260709 13:11:35.674849 30298 raft_consensus.cc:359] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:11:35.676083 30298 raft_consensus.cc:740] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Initialized, Role: LEARNER
I20260709 13:11:35.676932 30298 consensus_queue.cc:260] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:11:35.681174 30303 tablet_copy_client.cc:538] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:35.684774 30298 ts_tablet_manager.cc:1434] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:11:35.686990 29466 tablet_copy_service.cc:342] P 183db85c071f489fbc8de63a9edd8a3a: Request end of tablet copy session ca041dab9b2f44409ed7bf4c6cf66ab2-4195dd8da2fa4e9a9a0f134c2d81f95a received from {username='slave'} at 127.0.0.1:36436
I20260709 13:11:35.687527 29466 tablet_copy_service.cc:434] P 183db85c071f489fbc8de63a9edd8a3a: ending tablet copy session ca041dab9b2f44409ed7bf4c6cf66ab2-4195dd8da2fa4e9a9a0f134c2d81f95a on tablet 4195dd8da2fa4e9a9a0f134c2d81f95a with peer ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:11:35.690588 30298 ts_tablet_manager.cc:933] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2: Initiating tablet copy from peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:35.726697 30303 tablet_bootstrap.cc:492] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap starting.
I20260709 13:11:35.749872 30298 tablet_copy_client.cc:323] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Beginning tablet copy session from remote peer at address 127.27.146.131:35367
I20260709 13:11:35.752440 29540 tablet_copy_service.cc:140] P 71aa3578fd924765ab9ac0729c8d1483: Received BeginTabletCopySession request for tablet 4cced75430d1485689f4eff61c816af0 from peer ca041dab9b2f44409ed7bf4c6cf66ab2 ({username='slave'} at 127.0.0.1:53428)
I20260709 13:11:35.753084 29540 tablet_copy_service.cc:161] P 71aa3578fd924765ab9ac0729c8d1483: Beginning new tablet copy session on tablet 4cced75430d1485689f4eff61c816af0 from peer ca041dab9b2f44409ed7bf4c6cf66ab2 at {username='slave'} at 127.0.0.1:53428: session id = ca041dab9b2f44409ed7bf4c6cf66ab2-4cced75430d1485689f4eff61c816af0
I20260709 13:11:35.766779 29540 tablet_copy_source_session.cc:215] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:35.771210 30298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cced75430d1485689f4eff61c816af0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:35.777988 30303 tablet_bootstrap.cc:492] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:35.779620 30303 tablet_bootstrap.cc:492] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap complete.
I20260709 13:11:35.780483 30303 ts_tablet_manager.cc:1403] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent bootstrapping tablet: real 0.060s	user 0.025s	sys 0.012s
I20260709 13:11:35.785190 30303 raft_consensus.cc:359] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:11:35.786087 30303 raft_consensus.cc:740] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Initialized, Role: LEARNER
I20260709 13:11:35.786788 30303 consensus_queue.cc:260] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:11:35.790282 30303 ts_tablet_manager.cc:1434] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:11:35.796295 29540 tablet_copy_service.cc:342] P 71aa3578fd924765ab9ac0729c8d1483: Request end of tablet copy session ca041dab9b2f44409ed7bf4c6cf66ab2-abd2ad92265844ca9eb9012eb76e7789 received from {username='slave'} at 127.0.0.1:53428
I20260709 13:11:35.797036 29540 tablet_copy_service.cc:434] P 71aa3578fd924765ab9ac0729c8d1483: ending tablet copy session ca041dab9b2f44409ed7bf4c6cf66ab2-abd2ad92265844ca9eb9012eb76e7789 on tablet abd2ad92265844ca9eb9012eb76e7789 with peer ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:11:35.809598 30298 tablet_copy_client.cc:806] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:35.810411 30298 tablet_copy_client.cc:670] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:35.816386 30298 tablet_copy_client.cc:538] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:35.830811 30298 tablet_bootstrap.cc:492] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap starting.
I20260709 13:11:35.857445 30298 tablet_bootstrap.cc:492] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:35.858798 30298 tablet_bootstrap.cc:492] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap complete.
I20260709 13:11:35.859659 30298 ts_tablet_manager.cc:1403] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent bootstrapping tablet: real 0.029s	user 0.026s	sys 0.001s
I20260709 13:11:35.862830 30298 raft_consensus.cc:359] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:11:35.864212 30298 raft_consensus.cc:740] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Initialized, Role: LEARNER
I20260709 13:11:35.864826 30298 consensus_queue.cc:260] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:11:35.867271 30298 ts_tablet_manager.cc:1434] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 13:11:35.869478 29540 tablet_copy_service.cc:342] P 71aa3578fd924765ab9ac0729c8d1483: Request end of tablet copy session ca041dab9b2f44409ed7bf4c6cf66ab2-4cced75430d1485689f4eff61c816af0 received from {username='slave'} at 127.0.0.1:53428
I20260709 13:11:35.870055 29540 tablet_copy_service.cc:434] P 71aa3578fd924765ab9ac0729c8d1483: ending tablet copy session ca041dab9b2f44409ed7bf4c6cf66ab2-4cced75430d1485689f4eff61c816af0 on tablet 4cced75430d1485689f4eff61c816af0 with peer ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:11:35.954698 30158 raft_consensus.cc:1217] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:36.068534 30158 raft_consensus.cc:1217] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:36.112385 30158 raft_consensus.cc:1217] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:36.136179 30158 raft_consensus.cc:1217] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:36.392997 30281 raft_consensus.cc:1064] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5: attempting to promote NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 to VOTER
I20260709 13:11:36.395958 30281 consensus_queue.cc:237] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:36.404522 29524 raft_consensus.cc:1275] T 8e9b44184de046118890bc6cd6e1dc18 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:36.404551 30158 raft_consensus.cc:1275] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 LEARNER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:36.405761 30281 consensus_queue.cc:1048] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:36.406708 30277 consensus_queue.cc:1048] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:36.407565 29450 raft_consensus.cc:1275] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:36.409986 30281 consensus_queue.cc:1048] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:36.444546 30281 raft_consensus.cc:2955] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:36.447691 29521 raft_consensus.cc:2955] T 8e9b44184de046118890bc6cd6e1dc18 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:36.460695 30158 raft_consensus.cc:2955] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:36.482703 29279 catalog_manager.cc:5697] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:36.484287 29450 raft_consensus.cc:2955] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:36.529717 29380 consensus_queue.cc:237] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:36.536010 30158 raft_consensus.cc:1275] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:36.536161 29451 raft_consensus.cc:1275] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:36.537714 30272 consensus_queue.cc:1048] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:36.538928 30281 consensus_queue.cc:1048] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:36.545755 30311 raft_consensus.cc:1064] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a: attempting to promote NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 to VOTER
I20260709 13:11:36.550359 30272 raft_consensus.cc:2955] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:36.562685 30306 raft_consensus.cc:1064] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483: attempting to promote NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 to VOTER
I20260709 13:11:36.562441 30156 raft_consensus.cc:2955] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:36.565550 30306 consensus_queue.cc:237] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:36.572468 29265 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8e9b44184de046118890bc6cd6e1dc18 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:36.551613 30311 consensus_queue.cc:237] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:36.583215 30158 raft_consensus.cc:1275] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 LEARNER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:36.585260 30290 consensus_queue.cc:1048] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:36.591531 29379 raft_consensus.cc:1275] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:36.592767 29451 raft_consensus.cc:1275] T abd2ad92265844ca9eb9012eb76e7789 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:36.592999 29450 raft_consensus.cc:2955] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:36.594805 30290 consensus_queue.cc:1048] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:36.597232 30290 consensus_queue.cc:1048] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:36.609804 30234 raft_consensus.cc:2955] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:36.611819 29379 raft_consensus.cc:2955] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:36.643092 29521 raft_consensus.cc:1275] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:36.643996 29379 raft_consensus.cc:1275] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:36.632445 29278 catalog_manager.cc:5697] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: config changed from index 3 to 4, VOTER 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) evicted. New cstate: current_term: 1 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:36.658870 30312 consensus_queue.cc:1048] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:36.663261 30158 raft_consensus.cc:1275] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 LEARNER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:36.667253 30296 consensus_queue.cc:1048] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:36.682624 30327 consensus_queue.cc:1048] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:36.703799 29520 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e9b44184de046118890bc6cd6e1dc18 with delete_type TABLET_DATA_TOMBSTONED (TS 71aa3578fd924765ab9ac0729c8d1483 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37954
I20260709 13:11:36.711041 30290 raft_consensus.cc:1064] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483: attempting to promote NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 to VOTER
I20260709 13:11:36.729203 29277 catalog_manager.cc:5697] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:36.766778 30158 raft_consensus.cc:2955] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:36.771376 30333 tablet_replica.cc:333] T 8e9b44184de046118890bc6cd6e1dc18 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:11:36.714247 30290 consensus_queue.cc:237] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:36.773535 30333 raft_consensus.cc:2243] T 8e9b44184de046118890bc6cd6e1dc18 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:36.776046 30333 raft_consensus.cc:2272] T 8e9b44184de046118890bc6cd6e1dc18 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:36.779349 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 44781.1us
W20260709 13:11:36.821753 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 142498us
I20260709 13:11:36.880945 30157 raft_consensus.cc:1275] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 LEARNER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:36.884176 30334 consensus_queue.cc:1048] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:36.873592 30333 ts_tablet_manager.cc:1916] T 8e9b44184de046118890bc6cd6e1dc18 P 71aa3578fd924765ab9ac0729c8d1483: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:36.917171 29524 consensus_queue.cc:237] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:36.929149 29450 raft_consensus.cc:2955] T abd2ad92265844ca9eb9012eb76e7789 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:36.942929 30158 raft_consensus.cc:1275] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:36.945097 30339 consensus_queue.cc:1048] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:36.989779 29450 raft_consensus.cc:1275] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:36.992553 29379 raft_consensus.cc:1275] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:36.994091 29377 raft_consensus.cc:1275] T 4cced75430d1485689f4eff61c816af0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:37.001818 30330 raft_consensus.cc:2955] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:37.004974 30158 raft_consensus.cc:2955] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:37.023185 30290 consensus_queue.cc:1048] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:37.022172 30329 raft_consensus.cc:2955] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:37.027745 29277 catalog_manager.cc:5697] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: config changed from index 3 to 4, VOTER 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) evicted. New cstate: current_term: 1 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:37.035387 30334 consensus_queue.cc:1048] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:11:37.040056 30340 consensus_queue.cc:1048] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:11:37.042779 29263 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet abd2ad92265844ca9eb9012eb76e7789 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:37.078063 29441 tablet_service.cc:1558] Processing DeleteTablet for tablet abd2ad92265844ca9eb9012eb76e7789 with delete_type TABLET_DATA_TOMBSTONED (TS 183db85c071f489fbc8de63a9edd8a3a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45780
I20260709 13:11:37.072281 29377 raft_consensus.cc:2955] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
W20260709 13:11:37.168177 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 44079.4us
I20260709 13:11:37.186756 30333 ts_tablet_manager.cc:1929] T 8e9b44184de046118890bc6cd6e1dc18 P 71aa3578fd924765ab9ac0729c8d1483: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:37.253968 30333 log.cc:1199] T 8e9b44184de046118890bc6cd6e1dc18 P 71aa3578fd924765ab9ac0729c8d1483: Deleting WAL directory at /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/ts-2-root/wals/8e9b44184de046118890bc6cd6e1dc18
I20260709 13:11:37.240442 29375 raft_consensus.cc:2955] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:37.257675 30340 raft_consensus.cc:2955] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:37.270176 29524 raft_consensus.cc:2955] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:37.280081 29277 catalog_manager.cc:5697] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:37.301934 29263 catalog_manager.cc:5028] TS 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): tablet 8e9b44184de046118890bc6cd6e1dc18 (table test-workload [id=364c32d53f7748a2857a4a9acd17c671]) successfully deleted
I20260709 13:11:37.302832 29377 raft_consensus.cc:2955] T 4cced75430d1485689f4eff61c816af0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:37.322816 30157 raft_consensus.cc:2955] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:37.333894 29453 raft_consensus.cc:2955] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:37.343532 30156 raft_consensus.cc:2955] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:37.347601 29277 catalog_manager.cc:5697] T 4cced75430d1485689f4eff61c816af0 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:37.349078 30347 tablet_replica.cc:333] T abd2ad92265844ca9eb9012eb76e7789 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:11:37.350193 30347 raft_consensus.cc:2243] T abd2ad92265844ca9eb9012eb76e7789 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:37.357164 30347 raft_consensus.cc:2272] T abd2ad92265844ca9eb9012eb76e7789 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:37.373881 30347 ts_tablet_manager.cc:1916] T abd2ad92265844ca9eb9012eb76e7789 P 183db85c071f489fbc8de63a9edd8a3a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:37.394729 29524 consensus_queue.cc:237] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:37.393987 29449 consensus_queue.cc:237] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:37.414686 30156 raft_consensus.cc:1275] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:37.416604 30349 consensus_queue.cc:1048] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:37.420593 29379 raft_consensus.cc:1275] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:37.423436 30296 consensus_queue.cc:1048] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:37.429236 30350 raft_consensus.cc:2955] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:37.433643 30157 raft_consensus.cc:1275] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:37.434299 29453 raft_consensus.cc:1275] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:11:37.435781 30306 consensus_queue.cc:1048] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:37.437812 30306 consensus_queue.cc:1048] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:37.444165 30157 raft_consensus.cc:2955] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:37.445863 30340 raft_consensus.cc:2955] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:37.447949 30158 raft_consensus.cc:2955] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:37.452617 29450 raft_consensus.cc:2955] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:37.470312 29278 catalog_manager.cc:5697] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: config changed from index 3 to 4, VOTER 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) evicted. New cstate: current_term: 1 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:37.471235 29265 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4195dd8da2fa4e9a9a0f134c2d81f95a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:37.481803 29375 raft_consensus.cc:2955] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:37.489934 29263 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4cced75430d1485689f4eff61c816af0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:37.491565 29368 tablet_service.cc:1558] Processing DeleteTablet for tablet 4cced75430d1485689f4eff61c816af0 with delete_type TABLET_DATA_TOMBSTONED (TS 429e58eb058349e3bf72b5a870c8f6e5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52164
I20260709 13:11:37.514266 30351 tablet_replica.cc:333] T 4cced75430d1485689f4eff61c816af0 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:11:37.522208 29276 catalog_manager.cc:5697] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: config changed from index 3 to 4, VOTER 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) evicted. New cstate: current_term: 1 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:37.529443 30347 ts_tablet_manager.cc:1929] T abd2ad92265844ca9eb9012eb76e7789 P 183db85c071f489fbc8de63a9edd8a3a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:37.537889 30347 log.cc:1199] T abd2ad92265844ca9eb9012eb76e7789 P 183db85c071f489fbc8de63a9edd8a3a: Deleting WAL directory at /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/ts-1-root/wals/abd2ad92265844ca9eb9012eb76e7789
I20260709 13:11:37.539971 29265 catalog_manager.cc:5028] TS 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): tablet abd2ad92265844ca9eb9012eb76e7789 (table test-workload [id=364c32d53f7748a2857a4a9acd17c671]) successfully deleted
I20260709 13:11:37.543072 30351 raft_consensus.cc:2243] T 4cced75430d1485689f4eff61c816af0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:37.543987 30351 raft_consensus.cc:2272] T 4cced75430d1485689f4eff61c816af0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:37.548004 30351 ts_tablet_manager.cc:1916] T 4cced75430d1485689f4eff61c816af0 P 429e58eb058349e3bf72b5a870c8f6e5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:37.558943 29520 tablet_service.cc:1558] Processing DeleteTablet for tablet 4195dd8da2fa4e9a9a0f134c2d81f95a with delete_type TABLET_DATA_TOMBSTONED (TS 71aa3578fd924765ab9ac0729c8d1483 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37954
I20260709 13:11:37.560168 30333 tablet_replica.cc:333] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:11:37.561350 30333 raft_consensus.cc:2243] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:37.562204 30333 raft_consensus.cc:2272] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:37.573879 30351 ts_tablet_manager.cc:1929] T 4cced75430d1485689f4eff61c816af0 P 429e58eb058349e3bf72b5a870c8f6e5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:37.574405 30351 log.cc:1199] T 4cced75430d1485689f4eff61c816af0 P 429e58eb058349e3bf72b5a870c8f6e5: Deleting WAL directory at /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/ts-0-root/wals/4cced75430d1485689f4eff61c816af0
I20260709 13:11:37.574584 30333 ts_tablet_manager.cc:1916] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 71aa3578fd924765ab9ac0729c8d1483: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:37.577849 29265 catalog_manager.cc:5028] TS 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): tablet 4cced75430d1485689f4eff61c816af0 (table test-workload [id=364c32d53f7748a2857a4a9acd17c671]) successfully deleted
I20260709 13:11:37.597245 30333 ts_tablet_manager.cc:1929] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 71aa3578fd924765ab9ac0729c8d1483: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:11:37.597788 30333 log.cc:1199] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 71aa3578fd924765ab9ac0729c8d1483: Deleting WAL directory at /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/ts-2-root/wals/4195dd8da2fa4e9a9a0f134c2d81f95a
I20260709 13:11:37.599567 29263 catalog_manager.cc:5028] TS 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): tablet 4195dd8da2fa4e9a9a0f134c2d81f95a (table test-workload [id=364c32d53f7748a2857a4a9acd17c671]) successfully deleted
I20260709 13:11:39.508826 30356 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:39.509552 30356 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.516330 30356 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:39.513500 30357 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:39.514003 30354 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:39.517175 30354 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.519337 30354 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:39.520170 30354 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:39.520808 30354 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.522900 30354 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:39.520344 30357 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.525801 30357 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:11:39.557060 29402 debug-util.cc:398] Leaking SignalData structure 0x7b080010c180 after lost signal to thread 28237
I20260709 13:11:39.568728 30357 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:39.569482 30354 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:39.570604 30354 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.570652 30357 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.575038 30357 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:39.575078 30354 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:39.581058 30359 raft_consensus.cc:493] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:39.583941 30359 raft_consensus.cc:515] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:39.588917 30359 leader_election.cc:290] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:39.610528 30354 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:39.611730 30354 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.615075 30354 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:39.615869 30362 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:39.616840 30362 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.618855 30354 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:39.619786 30354 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.623327 30362 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:39.623513 30354 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:39.642249 30359 raft_consensus.cc:493] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:39.643853 30361 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:39.643536 30359 raft_consensus.cc:515] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:39.644670 30361 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.647099 30361 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:39.652213 30357 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:39.653851 30357 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.679353 30354 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:39.707561 30354 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.710554 30354 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:39.717285 30340 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:39.718247 30340 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.721303 30340 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:39.721498 30357 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:39.647130 30359 leader_election.cc:290] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:39.726040 30359 raft_consensus.cc:493] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:39.727181 30359 raft_consensus.cc:515] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:39.746104 30354 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:39.757402 30359 leader_election.cc:290] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:39.764025 30354 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.773801 30357 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:39.779573 30357 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.782305 30357 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:39.772473 30339 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:39.794260 30360 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:39.795606 30360 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.798817 30360 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:39.801441 30339 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.805058 30364 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:39.807807 30361 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:39.809105 30362 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:39.787716 30350 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:39.809942 30362 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.810281 30350 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:39.812911 30363 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:39.813939 30363 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.812971 30350 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:11:39.829942 30365 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:39.830399 30329 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:39.834802 30352 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:39.835635 30367 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:39.806249 30364 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.809151 30361 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.821542 30360 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:39.839449 30365 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.841344 30329 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.839916 30352 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.848672 30354 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:39.856232 30364 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:39.857712 30281 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:39.858717 30363 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:39.858645 30355 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:39.859886 30362 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:39.859470 30360 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.843629 30367 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.861752 30339 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:39.861889 30361 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:11:39.862385 29345 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.261s	user 0.007s	sys 0.009s
I20260709 13:11:39.863211 30329 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:39.857882 30352 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:39.867751 30359 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:39.878031 30363 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:39.882670 30359 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:39.867946 30370 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:39.868341 30358 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:11:39.883839 29345 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.283s	user 0.007s	sys 0.010s
I20260709 13:11:39.875886 30340 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:39.882884 30363 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.879755 30354 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:39.887431 30340 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.883790 30281 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.885246 30339 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:39.890070 30329 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:39.890677 30361 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:39.909138 30360 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:39.910372 30361 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.910684 30339 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.913086 30361 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:39.913225 30363 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:39.913278 30339 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:39.914152 30329 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.899780 30365 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:39.872859 30355 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.891181 30358 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.901221 30367 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:39.904290 30359 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:39.904062 30354 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.920722 30358 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:39.910794 30281 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:39.891247 30364 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:39.920444 30355 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:39.924348 30373 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:39.928378 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:11:39.920560 30368 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:39.929710 30158 raft_consensus.cc:2468] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 1.
I20260709 13:11:39.938357 30340 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:39.942567 30339 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:39.946014 30339 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.939134 30364 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.947379 30317 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:39.951640 30366 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:39.924495 30370 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.930516 30368 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:39.951928 30317 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.947825 30354 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:39.942879 30358 raft_consensus.cc:493] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:39.953580 30367 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:39.966440 30355 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:11:39.976342 29402 debug-util.cc:398] Leaking SignalData structure 0x7b08001bf960 after lost signal to thread 29313
I20260709 13:11:39.977036 30281 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:39.977833 30281 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.973076 30340 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:39.978837 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:39.979218 30340 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.980278 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:39.981086 29380 raft_consensus.cc:2468] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 1.
I20260709 13:11:39.981657 30340 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:39.982429 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:39.932147 30373 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.989974 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:39.952497 30366 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:39.991943 30281 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:39.994120 30367 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.976413 30355 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:39.991621 30340 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:40.018639 30340 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.019804 30352 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:40.020217 30355 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:40.020548 30352 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:39.993214 29402 debug-util.cc:398] Leaking SignalData structure 0x7b080031ffa0 after lost signal to thread 29405
I20260709 13:11:40.023754 30354 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
W20260709 13:11:40.024345 29402 debug-util.cc:398] Leaking SignalData structure 0x7b08002a9b40 after lost signal to thread 29480
I20260709 13:11:40.024639 30354 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:40.026144 29402 debug-util.cc:398] Leaking SignalData structure 0x7b0800293240 after lost signal to thread 29554
I20260709 13:11:40.027637 30354 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:39.993970 30336 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:40.013440 30377 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:40.030043 30362 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:40.014583 30317 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.015100 30364 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.003810 30378 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:39.990757 30363 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:39.994329 30375 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:39.994117 30369 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:40.008361 30376 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:40.016000 29377 raft_consensus.cc:2468] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 2.
I20260709 13:11:40.020948 30340 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:40.040827 30372 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:40.030031 30357 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:39.983177 30339 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:40.032649 30377 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.029958 30329 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.020255 30367 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.004858 30358 raft_consensus.cc:515] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:40.047712 30371 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:40.048368 30371 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.049026 30370 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:11:40.039933 29402 debug-util.cc:398] Leaking SignalData structure 0x7b08001da7e0 after lost signal to thread 30182
I20260709 13:11:40.034788 30352 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.044782 30350 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:40.049288 30358 leader_election.cc:290] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:11:40.043460 30379 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:40.033272 30362 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.053681 30366 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:11:40.029058 30374 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:40.039045 30355 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:40.046722 30354 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:40.041931 30373 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:40.043907 30376 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.069123 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.045233 30368 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:40.075275 30380 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:40.029953 30121 leader_election.cc:304] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:11:40.050101 30357 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.050020 30363 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.060564 30329 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:40.085615 30329 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.088269 30329 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.075047 30375 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.088876 30360 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:40.088961 30366 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:40.089277 30354 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.055153 30378 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.089627 30360 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.090121 30366 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.096254 30354 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:40.096467 30360 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.096701 30366 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.097704 30357 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:40.079630 30350 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.041626 30372 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:40.099706 30380 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.116175 30376 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:40.116467 30356 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:40.116876 30376 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:40.117177 30356 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.109901 29523 consensus_queue.cc:237] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:11:40.117509 30376 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.109845 30354 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:40.096300 30363 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.121505 30356 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:40.054313 30369 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.128600 30363 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:11:40.122215 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 94236.9us
I20260709 13:11:40.122987 30366 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:40.090303 30374 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.125692 30368 raft_consensus.cc:2804] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:40.126178 30371 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.100274 30350 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.113327 30365 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:40.128623 30383 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:40.116890 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.129313 30363 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.121506 30375 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.110693 30355 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.153844 30361 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:40.154573 30372 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:11:40.132539 30317 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:40.126645 30377 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.132426 30368 raft_consensus.cc:493] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:40.102211 30379 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.155707 30378 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:40.150426 30354 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.079856 30336 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.160570 29524 raft_consensus.cc:2468] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 1.
I20260709 13:11:40.158635 30329 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:40.164402 30363 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.165190 30372 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:40.165405 30362 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.159809 30356 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:40.154793 30383 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.156484 30364 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:40.155298 30366 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.156644 30360 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:40.155740 30350 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:40.170701 30361 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.164397 30369 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.161834 30368 raft_consensus.cc:3060] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:40.158893 30384 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:40.180604 30371 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:40.179072 30356 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.159237 30365 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.165958 30121 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:11:40.190585 30350 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.192219 30377 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:40.181458 30363 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:40.192734 30383 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.192667 30378 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:40.182891 30317 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.206214 30364 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.206626 30377 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.206995 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:11:40.200503 30359 raft_consensus.cc:2804] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:40.207731 30359 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:40.207873 30317 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.208189 30359 raft_consensus.cc:3060] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:40.208405 30364 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.208871 30377 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.211279 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.212040 30157 raft_consensus.cc:2468] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:40.213562 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.193245 30354 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:40.200448 30119 leader_election.cc:304] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:40.200773 30374 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:40.201545 30360 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.201944 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.201707 30371 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.221974 30356 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:40.230304 30371 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.205900 30379 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:40.197981 30384 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.220834 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.235996 29374 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:40.184965 30329 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.190603 30336 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.186304 30372 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.227015 29522 raft_consensus.cc:2468] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 1.
I20260709 13:11:40.203676 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.198468 30380 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:40.238358 29493 leader_election.cc:304] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:11:40.239593 30385 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:40.241158 30360 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.212044 30376 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:40.264740 30366 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.244125 30355 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:40.244210 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.249620 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.251752 30363 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.201587 30361 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.256630 29381 raft_consensus.cc:2468] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 1.
I20260709 13:11:40.262403 30380 raft_consensus.cc:2804] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:40.264034 30350 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.242456 30378 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:40.280459 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 86355.8us
I20260709 13:11:40.282426 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.284755 30121 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:11:40.265305 30372 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.270701 30380 raft_consensus.cc:493] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:40.294369 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.297008 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.297785 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.298748 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.300441 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.262212 30385 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.297879 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.307907 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.314617 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.301209 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.303925 30380 raft_consensus.cc:3060] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:40.278621 30366 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:40.308157 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.278383 30359 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:40.291837 30384 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:40.303167 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.386957 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.324575 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.320118 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.391064 29522 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:40.391480 29376 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:40.392773 30359 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 3 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:40.319479 30329 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.393643 30359 raft_consensus.cc:2804] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:40.394107 30359 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:40.394570 30359 raft_consensus.cc:3060] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:40.315382 29379 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:40.291582 30119 leader_election.cc:304] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:40.310477 30363 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:11:40.396466 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 110559us
I20260709 13:11:40.397226 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:40.317567 29374 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:40.385035 29529 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:40.386188 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.398756 29528 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:40.398077 29449 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:40.401520 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:40.403854 29453 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:40.400720 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:40.404987 29454 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:40.400844 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:11:40.401338 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:40.399899 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:11:40.389822 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 105201us
I20260709 13:11:40.400327 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:40.410053 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.407572 29455 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:40.411221 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.411402 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:40.412846 29529 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:40.413300 29447 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:40.310367 30386 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:40.414403 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:40.415109 29375 raft_consensus.cc:3060] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:40.419400 30390 raft_consensus.cc:2804] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:40.414884 30386 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.424708 30378 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:40.425194 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.425717 30368 raft_consensus.cc:515] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:40.412261 30366 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.451898 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.451457 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.425994 29521 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:40.452509 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.426164 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:40.435875 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.473981 29455 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:40.476003 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.476580 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:40.484143 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.457764 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.459156 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:11:40.475798 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:40.477298 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:40.436280 29456 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:40.486572 29447 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:40.432057 30390 raft_consensus.cc:493] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:40.488024 30390 raft_consensus.cc:3060] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:40.458082 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:11:40.486069 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:40.490450 30158 raft_consensus.cc:1240] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:40.492234 30366 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.453624 30392 raft_consensus.cc:2804] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:40.492839 30392 raft_consensus.cc:493] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:40.492918 29375 raft_consensus.cc:2468] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 3.
I20260709 13:11:40.493441 30392 raft_consensus.cc:3060] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:40.433955 29493 consensus_peers.cc:597] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671): Couldn't send request to peer ca041dab9b2f44409ed7bf4c6cf66ab2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b5c4a6169e564566927a70e27f4af6f6. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:40.494668 29493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 61029us
I20260709 13:11:40.422683 30365 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.493368 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:40.498410 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.467351 30386 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.497498 30329 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:40.496313 30363 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:40.500775 30363 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.500883 30329 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.503455 30329 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.490844 30380 raft_consensus.cc:515] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:40.459017 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.454457 30385 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.497349 29379 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:40.511909 29372 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:40.504225 30363 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.504180 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:40.513688 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.507805 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:40.503614 30355 consensus_queue.cc:1059] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:40.508165 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.508596 30121 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:11:40.511279 30329 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:40.514860 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.514623 29450 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:40.519810 30378 raft_consensus.cc:3055] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:40.520473 29525 raft_consensus.cc:1240] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:40.522014 30378 raft_consensus.cc:740] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:40.522815 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.525615 30378 consensus_queue.cc:260] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:40.526850 30378 raft_consensus.cc:3060] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:40.527889 30329 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.530509 30329 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.533030 30386 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:40.537742 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:40.538633 29456 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:40.543097 30329 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:40.544073 30329 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.550132 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:40.535079 30386 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.543351 30359 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:40.555352 30157 raft_consensus.cc:2393] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 2: Already voted for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in this term.
I20260709 13:11:40.557010 30329 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.559821 30386 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.559402 30359 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:40.549188 30368 leader_election.cc:290] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.568372 30359 raft_consensus.cc:2804] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:11:40.569746 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 61266.5us
I20260709 13:11:40.569176 30386 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:40.585538 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.566458 30390 raft_consensus.cc:515] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:40.595361 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:40.596143 29451 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:40.596503 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:40.581722 30359 raft_consensus.cc:697] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:11:40.598826 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.594100 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:40.609251 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.609591 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.602089 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.591096 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:40.611368 30380 leader_election.cc:290] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:11:40.611512 29447 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:40.591776 30386 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.604915 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.605891 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.606806 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.614421 30386 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.608021 29524 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:40.607082 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.627992 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.628029 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:40.628034 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.632736 29447 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:40.632571 30392 raft_consensus.cc:515] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:40.638707 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:40.640225 30392 leader_election.cc:290] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.626060 30390 leader_election.cc:290] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.642503 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.646054 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.646833 29522 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:40.650153 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.651062 29524 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:40.656488 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:40.659159 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.662230 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:40.663056 29344 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:40.664093 29526 raft_consensus.cc:2393] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in current term 2: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:11:40.665161 30389 raft_consensus.cc:2804] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:40.670174 30389 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:40.670661 30389 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:40.671017 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:40.664476 29521 raft_consensus.cc:2468] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 2.
I20260709 13:11:40.668576 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:11:40.642820 30359 consensus_queue.cc:237] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:40.675877 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.669557 29344 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:40.674070 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:11:40.674983 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:40.677245 29456 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:40.675617 30157 raft_consensus.cc:1240] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:40.678067 30385 raft_consensus.cc:2804] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:40.678499 30385 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:40.678884 30385 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:40.677362 29344 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:40.680864 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:40.682482 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:40.682672 30119 leader_election.cc:304] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:40.686868 29344 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:40.689211 30365 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:40.689743 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.689966 30365 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:40.690836 30365 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:40.691954 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.692803 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:40.693373 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:40.693405 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:40.691954 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:40.694867 29419 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:11:40.695938 30386 raft_consensus.cc:2804] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:40.696599 30386 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:40.697024 30386 raft_consensus.cc:3060] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:40.696981 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.698592 30366 raft_consensus.cc:2804] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:40.699091 30366 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:40.699481 30366 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:40.688575 30390 raft_consensus.cc:2804] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:40.705571 29344 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:40.715039 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.726284 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.702538 30121 leader_election.cc:304] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:40.733357 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:40.707110 30329 consensus_queue.cc:1059] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:11:40.760015 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.759152 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:40.790566 30329 raft_consensus.cc:3055] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:40.790750 29447 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:40.791016 30158 raft_consensus.cc:1240] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:40.791225 30329 raft_consensus.cc:740] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:40.753134 30392 raft_consensus.cc:2749] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:40.725751 30390 raft_consensus.cc:697] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:11:40.792331 30329 consensus_queue.cc:260] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:40.793809 30390 consensus_queue.cc:237] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:40.794148 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.747768 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.734443 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.794039 30329 raft_consensus.cc:3060] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:40.807126 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:40.810961 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.811946 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:40.801769 29456 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:40.819561 29447 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
W20260709 13:11:40.821944 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 116497us
W20260709 13:11:40.829802 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:40.839715 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.827546 30382 raft_consensus.cc:2804] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:40.843539 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.863474 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.868669 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.870774 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.872057 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.872205 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:11:40.872952 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:40.874186 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.874964 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.875380 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.874964 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.842761 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:40.843190 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.844549 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.875811 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.878759 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.873171 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.884107 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.840104 30381 consensus_queue.cc:1059] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:40.867380 30366 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.895099 29344 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:11:40.828686 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 127991us
I20260709 13:11:40.844439 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.847908 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.869936 30382 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:40.902107 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.902129 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.902364 30382 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:40.900817 30377 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:40.889756 30386 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:40.901600 29344 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:40.835595 30393 consensus_queue.cc:1059] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:11:40.904520 30377 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:40.907748 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.909778 30377 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:40.909850 30393 consensus_queue.cc:1243] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer ca041dab9b2f44409ed7bf4c6cf66ab2 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:11:40.909897 30281 raft_consensus.cc:3055] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:40.910956 30281 raft_consensus.cc:740] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:40.907855 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.908051 30387 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:40.908668 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.912894 29344 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:40.922353 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.913928 30389 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.914278 30281 consensus_queue.cc:260] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:40.916572 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.916807 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.917200 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.917363 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.917503 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.928565 30381 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:40.917821 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.931414 30381 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:40.918042 30387 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:40.918708 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.904086 30385 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.932386 30387 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:40.919200 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.920032 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.923403 30363 raft_consensus.cc:3055] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:40.911274 29376 raft_consensus.cc:1240] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:40.919938 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.925071 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.926321 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.942626 30281 raft_consensus.cc:3060] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:40.933624 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.941018 30389 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.931880 30381 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:40.946589 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:40.949585 30157 raft_consensus.cc:1240] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:40.950054 30365 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.934664 30363 raft_consensus.cc:740] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:40.951928 29378 raft_consensus.cc:1240] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:40.928790 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:40.907169 30121 leader_election.cc:304] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:40.957758 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.942026 29373 raft_consensus.cc:1240] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:40.961890 30385 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.972455 30390 raft_consensus.cc:2749] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:40.959702 30363 consensus_queue.cc:260] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:40.965938 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.977994 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:11:40.965695 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.967132 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.967278 30386 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:11:40.968067 29456 raft_consensus.cc:1240] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:40.948645 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:11:40.968215 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 67292.3us
I20260709 13:11:40.968426 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.969899 30389 consensus_queue.cc:1059] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:40.970956 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.970093 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.972666 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:40.973701 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.974359 30366 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.962482 29278 catalog_manager.cc:5697] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 2 to 3, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132). New cstate: current_term: 3 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:40.965633 30377 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:40.988372 30121 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:40.989672 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:41.009455 30390 raft_consensus.cc:2749] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:40.992390 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:40.993125 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:41.015225 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:41.015913 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:40.993554 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:41.015321 29455 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:40.989809 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:40.996186 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:41.017946 29456 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
W20260709 13:11:40.995815 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:40.990854 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:40.998996 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.985038 30363 raft_consensus.cc:3060] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:41.016086 30387 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:41.000818 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:40.985947 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:41.022017 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:40.992448 30365 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:41.014626 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:40.996407 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:41.003389 29278 catalog_manager.cc:5697] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 1 to 2, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132). New cstate: current_term: 2 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:41.025925 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:41.026429 29451 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:41.016484 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:40.988322 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:41.007995 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.996407 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:40.995265 30371 raft_consensus.cc:3055] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:41.002333 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:40.983453 30382 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:41.030326 30371 raft_consensus.cc:740] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:41.030741 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:41.031598 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:41.031328 30371 consensus_queue.cc:260] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:41.004773 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:41.034435 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:41.034902 29454 raft_consensus.cc:1275] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:41.036073 30371 raft_consensus.cc:3060] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.004216 30377 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:40.990716 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:41.016459 30381 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:41.047050 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:41.051312 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:41.047767 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:41.052078 30381 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:41.032338 30382 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:41.057447 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:41.062721 30397 ts_tablet_manager.cc:933] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2: Initiating tablet copy from peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:41.063349 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:41.062319 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:41.065006 29527 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:41.068274 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.070333 30387 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:41.075532 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:41.078500 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:41.072427 29495 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:41.080567 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:41.080992 30378 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.081286 29455 raft_consensus.cc:2468] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
I20260709 13:11:41.081413 30378 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:41.082075 30378 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.085305 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:41.087658 29495 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:41.095618 30380 raft_consensus.cc:2804] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.096129 30380 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:41.096508 30380 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.109421 29495 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:41.109858 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:41.112160 29495 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:41.123064 29527 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
I20260709 13:11:41.125571 29344 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:41.126669 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:41.115347 30355 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.133577 30355 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:41.136220 30355 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.138752 30397 tablet_copy_client.cc:323] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Beginning tablet copy session from remote peer at address 127.27.146.131:35367
I20260709 13:11:41.131590 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:41.142810 29540 tablet_copy_service.cc:140] P 71aa3578fd924765ab9ac0729c8d1483: Received BeginTabletCopySession request for tablet b5c4a6169e564566927a70e27f4af6f6 from peer ca041dab9b2f44409ed7bf4c6cf66ab2 ({username='slave'} at 127.0.0.1:53428)
I20260709 13:11:41.143553 29540 tablet_copy_service.cc:161] P 71aa3578fd924765ab9ac0729c8d1483: Beginning new tablet copy session on tablet b5c4a6169e564566927a70e27f4af6f6 from peer ca041dab9b2f44409ed7bf4c6cf66ab2 at {username='slave'} at 127.0.0.1:53428: session id = ca041dab9b2f44409ed7bf4c6cf66ab2-b5c4a6169e564566927a70e27f4af6f6
I20260709 13:11:41.145120 30377 consensus_queue.cc:1059] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:41.145823 29346 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:41.146775 30377 raft_consensus.cc:3055] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:41.146895 30365 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:41.147199 30377 raft_consensus.cc:740] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:41.148586 30377 consensus_queue.cc:260] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:41.150672 30377 raft_consensus.cc:3060] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.152061 30387 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:41.153119 30387 raft_consensus.cc:697] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:41.154234 30387 consensus_queue.cc:237] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:41.157859 30355 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:41.160215 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 48138.1us
I20260709 13:11:41.162572 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:41.163295 30378 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:41.164261 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:41.165537 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:41.165932 30378 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:41.166730 30378 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.167141 30378 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:41.168237 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:41.168174 29527 raft_consensus.cc:1240] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:41.169298 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:41.169446 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:41.171680 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:41.161254 29495 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:41.184055 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:41.186187 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:41.187554 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:41.189316 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:41.189569 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:41.190644 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:41.190938 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:41.191426 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:41.191785 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:41.192615 29381 raft_consensus.cc:2393] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 2: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:41.189221 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:41.190758 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:41.201510 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:41.196730 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:41.192876 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:41.187361 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:41.176175 30378 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.205204 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:41.206540 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:41.207058 29419 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:41.208027 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:41.208184 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:41.186218 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:41.209280 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:41.208263 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:41.212306 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:41.212455 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:41.272696 30355 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:41.273639 29374 raft_consensus.cc:1275] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:41.218459 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:41.276396 30392 consensus_queue.cc:1048] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:41.184520 30380 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:41.280108 29540 tablet_copy_source_session.cc:215] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:11:41.258457 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 51485.1us
I20260709 13:11:41.281765 29346 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:11:41.206252 30381 consensus_queue.cc:1059] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:11:41.207808 30401 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.261637 30393 consensus_queue.cc:1059] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:41.265077 29376 raft_consensus.cc:1275] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:41.268939 29380 raft_consensus.cc:3060] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.271309 30363 consensus_queue.cc:1059] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:41.213157 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:41.285316 30401 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:41.289436 30281 raft_consensus.cc:2804] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.289851 30281 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:41.290169 30281 raft_consensus.cc:3060] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.290084 29346 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:41.291558 29378 raft_consensus.cc:2468] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
I20260709 13:11:41.262903 30329 raft_consensus.cc:2749] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.292027 29346 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:11:41.286547 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.295555 29346 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:41.281533 30380 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:41.285898 30381 raft_consensus.cc:3055] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:41.300750 29346 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:41.295253 30371 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.305788 30371 raft_consensus.cc:2749] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.291325 30401 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.295840 30385 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:41.312214 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 111360us
I20260709 13:11:41.313146 29495 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:41.314266 29495 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:41.315088 29495 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:41.301870 30381 raft_consensus.cc:740] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:41.319797 29377 raft_consensus.cc:2468] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 2.
I20260709 13:11:41.291330 30378 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:41.318508 30381 consensus_queue.cc:260] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:41.331336 29419 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:41.331261 30281 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:41.302982 30377 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.325438 30380 raft_consensus.cc:2804] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.343230 30380 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:41.343724 30380 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.325620 30355 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.356021 29495 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:41.359282 29380 raft_consensus.cc:1275] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:41.361166 30392 consensus_queue.cc:1048] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:41.335192 30404 raft_consensus.cc:2804] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.345142 30386 raft_consensus.cc:2749] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.369547 30397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5c4a6169e564566927a70e27f4af6f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:41.356627 30355 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:41.382392 29419 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:11:41.390153 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 87935.1us
I20260709 13:11:41.391754 30378 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:41.393486 30378 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.394022 30378 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:41.394497 30378 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.370678 30404 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:41.395821 30404 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.397796 29419 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:41.393505 30329 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.406117 30381 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.406623 29529 raft_consensus.cc:1275] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:41.406437 29419 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:41.413798 29419 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:41.397230 30355 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.406574 30329 raft_consensus.cc:2749] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.438120 30281 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:11:41.444427 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 143825us
W20260709 13:11:41.444118 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 88171us
I20260709 13:11:41.446165 29346 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:41.446619 30406 raft_consensus.cc:3055] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:41.447096 30281 raft_consensus.cc:2749] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:41.447862 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.448151 30329 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.450722 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:11:41.451642 30158 raft_consensus.cc:2393] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 2: Already voted for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in this term.
I20260709 13:11:41.426527 30392 consensus_queue.cc:1048] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:11:41.454229 29346 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:41.460790 29529 raft_consensus.cc:1240] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:41.447190 30406 raft_consensus.cc:740] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:41.464509 29495 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:41.440863 30412 raft_consensus.cc:2749] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.467190 29495 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:41.469920 29346 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:41.469727 30382 raft_consensus.cc:2749] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.473995 29346 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:41.472810 30382 consensus_queue.cc:1059] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:41.469208 30409 raft_consensus.cc:3055] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:41.477945 30409 raft_consensus.cc:740] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:41.477218 30385 raft_consensus.cc:2749] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.469820 30415 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.487720 30415 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:41.490199 30415 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.501444 29495 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:41.505128 30417 raft_consensus.cc:2804] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.505736 30417 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:41.506155 30417 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.510596 30409 consensus_queue.cc:260] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:41.512696 30409 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.514523 30405 raft_consensus.cc:2804] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.517381 30406 consensus_queue.cc:260] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:41.515043 30405 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:41.523114 30406 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.536305 29495 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:41.516461 30385 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.521142 30405 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.554303 29521 raft_consensus.cc:1240] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:41.558732 30281 consensus_queue.cc:1059] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:41.539188 30420 raft_consensus.cc:2804] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.586166 30420 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:41.590569 30420 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.598054 30378 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:41.601354 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 187667us
I20260709 13:11:41.555786 30355 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:41.603559 29419 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:41.604254 29421 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:11:41.567842 30401 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:41.606479 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 70485.7us
I20260709 13:11:41.614236 29419 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:41.616747 29495 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:41.602605 30365 raft_consensus.cc:3055] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:41.619532 29495 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:41.619587 29419 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:41.611575 30399 raft_consensus.cc:2749] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.618851 30363 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.616710 30386 raft_consensus.cc:2804] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:41.627564 30408 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.629271 30410 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.631168 30410 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:41.626045 29419 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:41.625181 29495 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:41.634200 30378 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:41.632781 29495 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:41.620316 30365 raft_consensus.cc:740] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:41.624212 29522 raft_consensus.cc:1240] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:41.625686 29527 raft_consensus.cc:1240] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:41.634935 30378 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.638967 30386 raft_consensus.cc:697] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 2 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:41.642375 29495 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:41.643381 29495 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:41.631652 30410 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.645584 29419 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:41.644057 30386 consensus_queue.cc:237] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:41.639261 30408 raft_consensus.cc:2749] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.654119 29419 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:41.652853 30399 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.641811 30378 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:41.652082 30355 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:41.644200 30401 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:41.659934 30401 raft_consensus.cc:2804] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.660789 30378 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.661850 30408 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.662847 30355 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.663290 30355 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:41.660367 30401 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:41.671839 30401 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.663723 30355 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.660735 29419 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:41.659005 30387 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:41.669555 30365 consensus_queue.cc:260] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:41.713856 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.716295 30387 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:41.760828 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 117542us
I20260709 13:11:41.753119 30365 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.754844 30407 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:41.770833 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 105876us
I20260709 13:11:41.767409 29495 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:41.772946 29419 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:41.783284 29419 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:41.785058 29419 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:41.787616 29419 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:41.786787 30408 raft_consensus.cc:2749] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.771271 30426 raft_consensus.cc:2804] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.791954 29419 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:41.803764 29419 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:41.793867 30426 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:41.813046 30426 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.787453 30399 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.777386 30423 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.782703 30422 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.814917 29419 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:11:41.821255 30399 raft_consensus.cc:2749] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.826853 29419 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:41.816308 30407 raft_consensus.cc:2749] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.794543 30408 raft_consensus.cc:2749] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.815572 30418 raft_consensus.cc:2749] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.831709 30432 raft_consensus.cc:2804] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:41.831768 30363 raft_consensus.cc:2749] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.833223 29419 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:41.837504 30410 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:41.834437 30380 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:41.858433 30415 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:41.823348 30423 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:41.860536 30412 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.862408 29419 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:41.867292 30385 raft_consensus.cc:3055] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:41.873624 29419 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:41.822538 30417 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:41.878450 29419 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:41.849591 30432 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:41.882227 29419 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:41.883226 29419 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:41.893877 29526 raft_consensus.cc:1240] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:41.893541 29419 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:41.869597 30387 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:41.897557 30399 raft_consensus.cc:2749] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.899665 29419 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:41.877208 30418 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.903173 29419 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:41.874815 30385 raft_consensus.cc:740] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:41.874761 30423 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.907174 29419 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:41.880761 30408 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.905175 30393 raft_consensus.cc:2749] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.892544 30407 raft_consensus.cc:2749] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:41.913782 29493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 129599us
I20260709 13:11:41.868659 30378 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:41.895309 30432 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:41.911077 29524 raft_consensus.cc:1240] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:41.902719 30329 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.920333 29419 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:41.928496 29521 raft_consensus.cc:1240] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:41.931759 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:41.933063 30410 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:41.894868 30363 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.943447 29419 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:41.939716 30355 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:41.947284 29522 raft_consensus.cc:1275] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:41.948577 30355 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:11:41.950435 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.960578 29528 raft_consensus.cc:1240] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:41.963383 29377 raft_consensus.cc:1240] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:41.922447 30399 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.969511 30281 consensus_queue.cc:1059] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:41.916057 30412 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:41.949283 30408 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.949781 30377 consensus_queue.cc:1059] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:41.962288 29380 raft_consensus.cc:1240] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:41.962720 29378 raft_consensus.cc:1240] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:41.965260 29419 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:11:41.970989 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.971736 29381 raft_consensus.cc:1240] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 1. Current term is 2. Ops: []
W20260709 13:11:41.973620 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 206275us
W20260709 13:11:41.975323 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.974308 30281 raft_consensus.cc:3055] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:41.978044 30281 raft_consensus.cc:740] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:41.978602 29524 raft_consensus.cc:1240] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:41.969923 30407 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.985342 29346 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:41.912696 30385 consensus_queue.cc:260] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:41.974406 29527 raft_consensus.cc:1240] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:41.989862 30281 consensus_queue.cc:260] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:41.979938 30428 consensus_queue.cc:1059] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
W20260709 13:11:41.993760 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.964917 30420 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:41.967199 30405 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:42.002137 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:41.987854 30393 raft_consensus.cc:2749] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:41.998870 29377 raft_consensus.cc:1240] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:41.973618 30430 consensus_queue.cc:1059] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:11:42.007691 30281 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.005815 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:42.014500 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:42.016198 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:42.030711 29523 raft_consensus.cc:1240] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:41.992619 30412 consensus_queue.cc:1059] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:11:42.016268 30415 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:42.032378 29454 raft_consensus.cc:1275] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:41.986362 30363 consensus_queue.cc:1059] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:11:42.013235 30428 raft_consensus.cc:3055] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:42.011927 30382 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:42.012938 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:42.020777 30385 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.050237 30378 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:41.997510 30386 consensus_queue.cc:1059] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:11:42.012650 30434 consensus_queue.cc:1048] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:11:42.052591 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:42.034801 30422 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:42.056417 30399 raft_consensus.cc:3055] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:42.056870 30399 raft_consensus.cc:740] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:42.056572 30422 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:42.057794 30399 consensus_queue.cc:260] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:42.059160 30399 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.048425 30355 raft_consensus.cc:493] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:42.050352 30336 raft_consensus.cc:3055] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:42.013872 30430 raft_consensus.cc:3055] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:42.018806 30380 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:42.043288 30426 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:42.076695 29527 raft_consensus.cc:1240] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 1. Current term is 2. Ops: []
W20260709 13:11:42.077037 30409 consensus_meta.cc:287] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.564s	user 0.016s	sys 0.005s
I20260709 13:11:42.077627 30426 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:42.057166 29376 raft_consensus.cc:1240] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:42.048951 30401 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:42.055859 30386 consensus_queue.cc:1243] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer 429e58eb058349e3bf72b5a870c8f6e5 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:11:42.080070 30382 consensus_queue.cc:1059] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:42.080892 30401 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:42.081148 30371 raft_consensus.cc:3055] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:42.042246 30428 raft_consensus.cc:740] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:42.090051 29524 raft_consensus.cc:1240] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:42.090312 30393 raft_consensus.cc:3055] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:42.090735 30393 raft_consensus.cc:740] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:42.083320 29528 raft_consensus.cc:1240] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:42.086822 30382 consensus_queue.cc:1048] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:42.088531 30420 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:42.074618 30430 raft_consensus.cc:740] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:42.061551 30417 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:42.097441 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:42.096576 30393 consensus_queue.cc:260] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:42.081533 30371 raft_consensus.cc:740] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:42.100672 29453 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:42.059298 30422 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:42.070065 30336 raft_consensus.cc:740] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:42.105559 30392 consensus_queue.cc:1048] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:42.119786 30405 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:11:42.120810 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.074970 30355 raft_consensus.cc:515] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:42.123907 30355 leader_election.cc:290] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:11:42.116516 30430 consensus_queue.cc:260] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:42.125006 30430 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.117973 30393 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.090391 30428 consensus_queue.cc:260] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:42.129462 29454 raft_consensus.cc:2468] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
I20260709 13:11:42.119024 30363 raft_consensus.cc:3055] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:11:42.101158 30404 consensus_meta.cc:287] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.704s	user 0.011s	sys 0.006s
I20260709 13:11:42.126147 29419 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:42.135865 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:11:42.118290 30432 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:42.131711 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:42.135012 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:42.139460 30377 consensus_queue.cc:1059] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:42.137620 30389 consensus_queue.cc:1059] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:11:42.140280 30336 consensus_queue.cc:260] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:42.141570 30336 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.136737 30158 raft_consensus.cc:2393] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 2: Already voted for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in this term.
I20260709 13:11:42.136664 29419 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:11:42.137620 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 152520us
I20260709 13:11:42.137821 30281 consensus_queue.cc:1059] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:42.145155 29419 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:42.145093 30329 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:42.147693 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:42.152547 29346 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:42.133623 30363 raft_consensus.cc:740] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:42.160511 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:42.150866 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:42.143175 30422 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:42.137585 30404 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:42.165992 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:42.166790 29377 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 1.
I20260709 13:11:42.167078 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:42.167932 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:42.168727 29381 raft_consensus.cc:1240] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:42.169092 29530 raft_consensus.cc:1240] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:42.128695 30387 consensus_queue.cc:1059] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:11:42.170023 29346 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:42.147207 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:42.156536 30412 raft_consensus.cc:2749] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:42.173471 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:42.176385 29374 raft_consensus.cc:1240] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:42.177711 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:42.178956 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:42.160622 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:42.180184 30389 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:42.180974 30389 raft_consensus.cc:3055] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:42.181339 30389 raft_consensus.cc:740] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:42.173651 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:42.186370 29378 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
I20260709 13:11:42.167143 30404 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:42.160815 29525 raft_consensus.cc:1240] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:42.190579 29346 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:42.196301 29528 raft_consensus.cc:1240] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:42.198457 30281 raft_consensus.cc:2749] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:42.199764 29346 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:42.182134 30428 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.156157 30386 consensus_queue.cc:1059] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:11:42.193349 30414 raft_consensus.cc:3055] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:42.202742 29523 raft_consensus.cc:1240] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:42.209133 29346 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:42.193710 30387 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:42.210964 29346 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:42.213281 30366 consensus_queue.cc:1059] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:42.220377 30366 raft_consensus.cc:3055] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:42.214787 30281 consensus_queue.cc:1059] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:42.215469 29346 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:42.213342 30429 raft_consensus.cc:2749] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:42.162053 30371 consensus_queue.cc:260] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:42.205724 30377 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:42.220849 30366 raft_consensus.cc:740] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:42.220774 30363 consensus_queue.cc:260] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:42.225914 30439 raft_consensus.cc:3055] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:42.226393 30281 raft_consensus.cc:3055] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:42.215111 30414 raft_consensus.cc:740] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:42.228924 29346 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:11:42.225208 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.227464 30432 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:42.231155 30387 consensus_queue.cc:1059] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:11:42.220537 30381 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:42.202479 30382 consensus_queue.cc:1059] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:11:42.235719 30281 raft_consensus.cc:740] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:42.214323 30389 consensus_queue.cc:260] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:42.211144 30436 consensus_queue.cc:1059] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 13:11:42.247174 30281 consensus_queue.cc:260] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:42.248549 30281 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.251336 30158 raft_consensus.cc:3060] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.253383 30365 raft_consensus.cc:3055] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:42.253892 30365 raft_consensus.cc:740] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:42.254269 30381 raft_consensus.cc:3055] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:42.254676 30381 raft_consensus.cc:740] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:42.255666 30381 consensus_queue.cc:260] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:42.257057 30381 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.257388 30366 consensus_queue.cc:260] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:42.239902 30371 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.246213 30440 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:42.243548 30363 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.239341 30439 raft_consensus.cc:740] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:42.244800 30429 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:42.242707 30377 consensus_queue.cc:1059] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:11:42.254969 30365 consensus_queue.cc:260] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:42.304906 30397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:54234 (request call id 52) took 1317 ms. Trace:
I20260709 13:11:42.288503 30389 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.309487 30439 consensus_queue.cc:260] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:42.312856 30439 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.318347 30158 raft_consensus.cc:1275] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:42.305642 30397 rpcz_store.cc:276] 0709 13:11:40.987222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:40.987344 (+   122us) service_pool.cc:224] Handling call
0709 13:11:41.063249 (+ 75905us) ts_tablet_manager.cc:934] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2: Initiating tablet copy from peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
0709 13:11:41.367757 (+304508us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:11:42.117218 (+749461us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:42.117360 (+   142us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:11:42.297177 (+179817us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:11:42.304184 (+  7007us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:42.304689 (+   505us) ts_tablet_manager.cc:989] Replica registered.
0709 13:11:42.304788 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":27739,"tablet-copy.queue_time_us":74567,"thread_start_us":84818,"threads_started":2}
I20260709 13:11:42.297729 30436 raft_consensus.cc:3055] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:42.323957 30414 consensus_queue.cc:260] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:42.325574 30409 raft_consensus.cc:3055] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:42.325742 30365 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.326894 30366 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.342259 30436 raft_consensus.cc:740] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:42.359809 29380 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
I20260709 13:11:42.347424 30397 tablet_copy_client.cc:806] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:42.348341 30412 consensus_queue.cc:1048] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:11:42.348435 30409 raft_consensus.cc:740] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
W20260709 13:11:42.353695 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 195235us
I20260709 13:11:42.365995 30414 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.374929 30397 tablet_copy_client.cc:670] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Starting download of 1 WAL segments...
W20260709 13:11:42.378458 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 362531us
I20260709 13:11:42.380268 29495 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:42.387403 30436 consensus_queue.cc:260] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:42.404469 30397 tablet_copy_client.cc:538] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:11:42.411721 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 182056us
W20260709 13:11:42.413525 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:42.423332 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.394819 30404 raft_consensus.cc:2804] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:42.418824 30436 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.431517 29495 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:42.428326 30404 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
W20260709 13:11:42.436147 30423 consensus_meta.cc:287] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.524s	user 0.004s	sys 0.009s
I20260709 13:11:42.445108 30444 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:42.451349 29495 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:42.454802 29495 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:42.458478 29495 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:42.464183 29377 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
I20260709 13:11:42.447680 30404 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.428071 30409 consensus_queue.cc:260] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:42.475207 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.473829 30420 raft_consensus.cc:2804] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:42.476647 30420 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:42.477068 30420 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.478101 30385 raft_consensus.cc:3055] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:42.478526 30385 raft_consensus.cc:740] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:42.479396 30385 consensus_queue.cc:260] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:42.465574 30417 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:42.489820 30417 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
W20260709 13:11:42.491191 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:42.492236 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:42.499322 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.452448 30430 consensus_queue.cc:1059] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:11:42.449151 30423 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:42.474004 30405 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:42.490357 30417 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.505113 29495 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:42.506078 30443 raft_consensus.cc:493] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.506721 30443 raft_consensus.cc:515] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:42.511544 30443 leader_election.cc:290] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:42.514456 29448 raft_consensus.cc:1275] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:42.515120 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:11:42.515753 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.515909 29525 raft_consensus.cc:2468] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 1.
I20260709 13:11:42.521665 30382 raft_consensus.cc:3055] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:42.522219 30382 raft_consensus.cc:740] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:42.524880 30382 consensus_queue.cc:260] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:42.500273 30409 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.527940 29526 raft_consensus.cc:1240] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:42.544545 29495 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:42.547225 29495 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:42.504773 30405 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:42.549208 30401 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:11:42.552024 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.558642 29495 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
W20260709 13:11:42.566421 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.508977 30442 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.540978 30382 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:42.568271 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:42.568955 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.568807 29495 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:11:42.576613 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 307317us
I20260709 13:11:42.549758 30415 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:42.578887 29495 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:42.559818 30405 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.580747 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:42.582193 29377 raft_consensus.cc:2468] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 2.
I20260709 13:11:42.558353 29373 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
I20260709 13:11:42.581346 30444 raft_consensus.cc:2749] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:42.559046 30401 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:42.583885 29495 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:11:42.585558 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.576097 30432 raft_consensus.cc:2804] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:42.593592 29495 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:42.597252 29495 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:42.595054 30380 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.567896 30448 consensus_queue.cc:1059] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:11:42.581847 30355 raft_consensus.cc:2749] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:42.598356 30426 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:42.556396 30119 leader_election.cc:304] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:11:42.627372 30428 raft_consensus.cc:3055] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:42.628008 30428 raft_consensus.cc:740] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:42.628187 30419 raft_consensus.cc:2804] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:42.628772 30419 raft_consensus.cc:493] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:42.609748 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.629535 30397 tablet_bootstrap.cc:492] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap starting.
I20260709 13:11:42.629246 30428 consensus_queue.cc:260] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:42.576228 30442 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:42.595896 30432 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:42.630805 30428 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.614570 30448 raft_consensus.cc:3055] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:42.631670 30448 raft_consensus.cc:740] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:42.598305 30415 raft_consensus.cc:2749] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:42.626446 29278 catalog_manager.cc:5697] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 1 to 2, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 2 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:42.632696 30442 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:42.629448 30419 raft_consensus.cc:3060] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:42.603217 29495 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:42.635887 29495 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:42.621803 30385 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.632602 30448 consensus_queue.cc:260] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:42.639741 30448 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.598117 30441 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:42.594321 30401 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.630864 30432 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.637283 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:42.647720 30426 raft_consensus.cc:2749] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:42.615003 30405 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:42.649168 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.650735 30405 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:42.619835 29346 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:42.641994 30355 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:42.628242 30423 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:11:42.641260 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 85005.2us
I20260709 13:11:42.641920 29495 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:42.651957 30453 raft_consensus.cc:2804] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:42.657867 30453 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:42.658407 30453 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.663389 29495 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:42.664774 29346 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:11:42.664834 29495 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:42.666854 29495 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:42.669077 29495 leader_election.cc:304] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:11:42.667956 30355 raft_consensus.cc:2749] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:42.674463 30429 raft_consensus.cc:2804] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:42.662200 30423 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:42.679476 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:42.683413 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:42.682397 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:42.676756 30429 raft_consensus.cc:697] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:42.668074 30405 raft_consensus.cc:2749] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:42.687386 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:42.689620 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:11:42.693094 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.693572 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:42.694675 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:42.695953 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:11:42.696323 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.697273 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:42.697432 30429 consensus_queue.cc:237] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:42.668262 30415 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:42.699370 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:42.678351 30404 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:42.677212 30441 raft_consensus.cc:2804] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:42.672526 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:42.703624 29421 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:42.706992 30380 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:42.672379 30426 consensus_queue.cc:1048] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:11:42.717685 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:42.717280 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:42.722692 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:42.710287 30363 consensus_queue.cc:1059] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:11:42.724655 30363 raft_consensus.cc:3055] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:42.710435 30441 raft_consensus.cc:697] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:42.725471 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:42.726050 30441 consensus_queue.cc:237] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:42.713153 30386 consensus_queue.cc:1059] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:11:42.722911 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:42.725029 30363 raft_consensus.cc:740] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:42.733378 29381 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
I20260709 13:11:42.760547 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:42.761269 29381 raft_consensus.cc:2468] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
I20260709 13:11:42.733995 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:42.764204 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:42.747212 29530 raft_consensus.cc:1240] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:42.709347 30409 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:42.765213 30409 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:42.744287 29528 raft_consensus.cc:1240] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:42.765744 30409 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.753703 29372 raft_consensus.cc:1240] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:42.766661 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:42.752111 29495 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:42.692596 30420 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:42.708189 30389 consensus_queue.cc:1048] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:11:42.757511 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:42.713533 29373 raft_consensus.cc:2468] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 2.
I20260709 13:11:42.778394 29380 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
I20260709 13:11:42.781620 29495 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:42.781761 29381 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
I20260709 13:11:42.782800 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:42.782851 29495 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:42.752267 29378 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
I20260709 13:11:42.784786 29495 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:42.708521 30417 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:42.766780 30453 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:42.787412 29495 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:42.745623 30419 raft_consensus.cc:515] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:42.804252 29377 raft_consensus.cc:1240] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:42.804888 29525 raft_consensus.cc:1240] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:42.800217 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:42.807042 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:42.771947 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:42.786118 30405 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:42.807723 30363 consensus_queue.cc:260] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:42.784827 30426 raft_consensus.cc:2749] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:42.821179 30432 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:42.816279 29529 raft_consensus.cc:1240] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:42.796101 30355 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:42.801545 30392 raft_consensus.cc:493] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:42.822361 30426 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:42.824422 30392 raft_consensus.cc:515] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:42.827904 30393 raft_consensus.cc:3055] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:42.828318 30393 raft_consensus.cc:740] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:42.828840 29526 raft_consensus.cc:1240] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:42.828951 30392 leader_election.cc:290] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:42.824363 30432 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:42.825448 30417 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:42.830819 30121 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:42.832773 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:42.801641 30444 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:42.834659 30444 raft_consensus.cc:697] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:42.835862 30444 consensus_queue.cc:237] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:42.837109 30420 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:11:42.838722 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.838788 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:42.839661 29377 raft_consensus.cc:2468] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 2.
I20260709 13:11:42.829260 30393 consensus_queue.cc:260] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:42.841117 29377 raft_consensus.cc:1240] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:42.847281 30419 leader_election.cc:290] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 3 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:42.805608 29375 raft_consensus.cc:1275] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:42.847743 29374 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
I20260709 13:11:42.849315 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:42.850049 29523 raft_consensus.cc:3060] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:11:42.853801 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:42.850775 30392 raft_consensus.cc:2804] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:42.918175 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:42.921499 30393 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.929044 29456 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
I20260709 13:11:42.937111 29374 raft_consensus.cc:2393] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 2: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:42.937858 29376 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
I20260709 13:11:42.930663 29380 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
I20260709 13:11:42.939105 30363 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.970817 29523 raft_consensus.cc:2468] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 3.
I20260709 13:11:42.931948 30392 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:42.974506 29381 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
W20260709 13:11:42.977607 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.985113 29377 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
I20260709 13:11:42.959484 29379 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
I20260709 13:11:42.960109 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:11:42.989035 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 201757us
I20260709 13:11:42.989802 29495 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:42.990530 30417 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:42.991034 30417 raft_consensus.cc:697] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
W20260709 13:11:42.997306 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 69099.1us
W20260709 13:11:42.999158 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:42.984273 30392 raft_consensus.cc:3060] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:42.990937 29495 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:42.983983 30404 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:42.986207 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:43.006006 30420 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:43.024160 30420 raft_consensus.cc:697] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:43.025503 30420 consensus_queue.cc:237] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:43.026373 30453 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:42.993026 30119 leader_election.cc:304] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:11:43.007102 30409 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:43.008635 30401 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:43.027962 30419 raft_consensus.cc:2804] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:43.028512 30419 raft_consensus.cc:697] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:11:43.009845 30417 consensus_queue.cc:237] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:43.031034 29378 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
I20260709 13:11:43.031141 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:43.011459 29495 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:43.037297 30409 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:43.038107 29522 raft_consensus.cc:1240] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:43.040284 29344 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:42.986272 30121 leader_election.cc:304] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:43.058597 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:43.052551 29495 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:43.030896 29376 raft_consensus.cc:3060] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:43.053359 30404 raft_consensus.cc:2804] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:43.054036 30336 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:43.066751 29495 leader_election.cc:304] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:11:43.070441 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.073453 29495 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:43.048522 30447 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:43.081426 29495 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:43.064811 30401 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:43.072746 30444 raft_consensus.cc:2764] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:11:43.069516 30459 raft_consensus.cc:2804] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:43.069741 30336 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:43.102296 30336 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:43.076298 30404 raft_consensus.cc:697] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
W20260709 13:11:43.103662 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 135387us
I20260709 13:11:43.103961 30404 consensus_queue.cc:237] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:43.104286 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:43.105931 30390 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.106508 30390 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:43.110980 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:43.117153 29346 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:43.120443 30390 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:43.074882 30442 raft_consensus.cc:2804] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:43.065085 30409 consensus_queue.cc:1048] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:11:43.113651 30380 raft_consensus.cc:2804] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:43.125979 29495 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:43.112672 30459 raft_consensus.cc:697] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:43.112293 30462 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:43.126730 30442 raft_consensus.cc:493] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.144726 29495 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:43.125905 30448 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:43.129252 30412 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.156785 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:43.146394 30380 raft_consensus.cc:697] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:43.162365 30380 consensus_queue.cc:237] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:43.150081 30462 raft_consensus.cc:697] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:43.150942 30426 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:43.167228 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:43.168321 29456 raft_consensus.cc:2468] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 2.
I20260709 13:11:43.170260 30121 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:43.147817 30432 consensus_queue.cc:1059] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:11:43.125445 30419 consensus_queue.cc:237] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:43.173887 30443 raft_consensus.cc:2804] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:43.174317 30443 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.174674 30443 raft_consensus.cc:3060] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:43.167191 30462 consensus_queue.cc:237] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:43.143713 30441 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:43.182659 29495 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:43.147995 30442 raft_consensus.cc:3060] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:43.158191 30412 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:43.190403 30459 consensus_queue.cc:237] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:43.208465 30432 raft_consensus.cc:3055] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:43.216194 29456 raft_consensus.cc:1275] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:11:43.215175 30397 tablet_bootstrap.cc:492] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:11:43.218266 30397 tablet_bootstrap.cc:492] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap complete.
I20260709 13:11:43.219244 30397 ts_tablet_manager.cc:1403] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent bootstrapping tablet: real 0.590s	user 0.018s	sys 0.029s
I20260709 13:11:43.222635 29495 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:43.202795 30426 raft_consensus.cc:697] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:43.226084 29495 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:43.224196 30429 consensus_queue.cc:1048] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:11:43.227319 30405 raft_consensus.cc:2804] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:43.222160 29372 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
I20260709 13:11:43.227893 30405 raft_consensus.cc:697] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:43.229447 30405 consensus_queue.cc:237] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:43.225788 30423 raft_consensus.cc:2804] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:43.230808 30423 raft_consensus.cc:697] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:43.231798 30423 consensus_queue.cc:237] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:43.228178 30415 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:43.209021 30432 raft_consensus.cc:740] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:43.235962 29495 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:43.221627 30441 raft_consensus.cc:697] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:43.263543 29495 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:43.266247 29495 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:43.268968 30459 raft_consensus.cc:2804] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:43.281769 29495 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:43.242110 30415 raft_consensus.cc:697] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:43.283399 30459 raft_consensus.cc:697] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:43.242211 29376 raft_consensus.cc:2468] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 3.
I20260709 13:11:43.264814 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:43.305459 30441 consensus_queue.cc:237] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:43.238186 30412 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:43.232615 30426 consensus_queue.cc:237] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:43.282737 30401 raft_consensus.cc:2804] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:11:43.311084 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:43.323738 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:43.322137 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:43.293118 30462 raft_consensus.cc:2804] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:43.348932 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:43.350350 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:43.299018 30397 raft_consensus.cc:359] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:43.349001 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:43.351989 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:43.308547 30355 raft_consensus.cc:2804] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:43.352787 29380 raft_consensus.cc:2393] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 2: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:43.352825 29377 raft_consensus.cc:2393] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 2: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:43.301301 30392 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:43.399449 30409 consensus_queue.cc:1059] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:43.354245 30363 consensus_queue.cc:1059] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:11:43.367046 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:43.310694 30432 consensus_queue.cc:260] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:43.323760 29372 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 2.
I20260709 13:11:43.364279 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:43.357045 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:43.401854 29450 raft_consensus.cc:1240] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:43.353168 30401 raft_consensus.cc:697] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:43.381608 30415 consensus_queue.cc:237] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:43.395903 30442 raft_consensus.cc:515] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:43.364768 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:11:43.425316 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 75673us
I20260709 13:11:43.367257 30459 consensus_queue.cc:237] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:43.443022 29522 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 2.
W20260709 13:11:43.401886 30469 log.cc:927] Time spent T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:11:43.452937 29421 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:43.431310 29456 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
I20260709 13:11:43.436426 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:43.438607 30158 raft_consensus.cc:1240] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:43.434655 30355 raft_consensus.cc:697] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:43.427652 30397 raft_consensus.cc:740] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Initialized, Role: LEARNER
I20260709 13:11:43.427582 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:43.445119 30363 raft_consensus.cc:3055] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:43.445582 30392 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 3 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:43.467424 29495 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:43.468516 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:43.437026 30443 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:43.449381 30462 raft_consensus.cc:697] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:43.461709 30432 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:43.478672 29374 raft_consensus.cc:2393] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 2: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:43.473767 30460 raft_consensus.cc:2804] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:43.490170 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:43.470745 30363 raft_consensus.cc:740] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:43.496145 30355 consensus_queue.cc:237] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:43.501066 30443 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 3 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:43.501921 30417 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:43.504215 30442 leader_election.cc:290] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 3 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:43.492769 30460 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.504783 30155 raft_consensus.cc:1240] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:43.513801 29455 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
I20260709 13:11:43.503640 30397 consensus_queue.cc:260] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:11:43.523741 30401 consensus_queue.cc:237] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:43.449309 30380 consensus_queue.cc:1175] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "183db85c071f489fbc8de63a9edd8a3a" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
W20260709 13:11:43.531731 30484 log.cc:927] Time spent T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.070s	user 0.002s	sys 0.000s
I20260709 13:11:43.542086 29448 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
I20260709 13:11:43.542248 30363 consensus_queue.cc:260] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:43.529276 30460 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:43.546819 30481 log.cc:927] Time spent T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:11:43.530285 30417 raft_consensus.cc:697] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:43.540369 30409 consensus_queue.cc:1059] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:11:43.540519 30386 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:43.549021 30409 raft_consensus.cc:3055] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:43.554447 30409 raft_consensus.cc:740] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:43.555449 30409 consensus_queue.cc:260] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:43.556237 30407 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:43.557076 30407 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:43.557614 30409 raft_consensus.cc:3060] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:43.559286 30465 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:43.560204 30465 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:43.559219 30363 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:43.553292 30397 ts_tablet_manager.cc:1434] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent starting tablet: real 0.331s	user 0.010s	sys 0.001s
I20260709 13:11:43.551092 29276 catalog_manager.cc:5697] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 1 to 2, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 2 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:43.540123 30393 raft_consensus.cc:3055] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:43.509909 30462 consensus_queue.cc:237] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:43.593541 30393 raft_consensus.cc:740] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:43.597519 30465 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:43.598677 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:43.554270 30444 raft_consensus.cc:2955] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:11:43.604090 29381 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 2.
I20260709 13:11:43.582986 30412 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:43.612705 29421 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:43.617146 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:43.618052 29381 raft_consensus.cc:3060] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:43.551921 30386 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:43.548218 30417 consensus_queue.cc:237] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:43.593803 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:43.591261 30407 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:43.614020 30465 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:43.646435 29381 raft_consensus.cc:2468] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 3.
I20260709 13:11:43.616235 30412 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:43.631289 30407 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:43.670243 29540 tablet_copy_service.cc:342] P 71aa3578fd924765ab9ac0729c8d1483: Request end of tablet copy session ca041dab9b2f44409ed7bf4c6cf66ab2-b5c4a6169e564566927a70e27f4af6f6 received from {username='slave'} at 127.0.0.1:53428
I20260709 13:11:43.681172 29540 tablet_copy_service.cc:434] P 71aa3578fd924765ab9ac0729c8d1483: ending tablet copy session ca041dab9b2f44409ed7bf4c6cf66ab2-b5c4a6169e564566927a70e27f4af6f6 on tablet b5c4a6169e564566927a70e27f4af6f6 with peer ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:11:43.682108 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:43.688892 30386 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:43.689572 30386 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:43.690274 30386 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:43.692636 30412 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:43.692786 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:43.693780 29374 raft_consensus.cc:2393] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 2: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:11:43.639372 30121 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:11:43.695390 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 64564us
I20260709 13:11:43.698597 30443 raft_consensus.cc:2749] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:43.633670 30465 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:43.701929 30465 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:43.702555 30465 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:43.703094 29522 raft_consensus.cc:1275] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:43.704301 30363 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:43.693609 30412 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:43.705641 30473 consensus_queue.cc:1048] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:11:43.704916 30363 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:43.634109 30393 consensus_queue.cc:260] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:43.737696 30363 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:43.738036 30393 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:43.668146 30407 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:43.703052 30465 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:43.712694 30412 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:43.769268 30412 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:43.786378 30155 raft_consensus.cc:1240] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:43.777868 30371 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:43.810602 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 334820us
W20260709 13:11:43.822429 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 359707us
I20260709 13:11:43.825938 29381 raft_consensus.cc:1275] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:43.807358 30371 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:43.819016 30363 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:43.857760 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:43.858727 29381 raft_consensus.cc:2393] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 2: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:11:43.859026 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:43.860213 29380 raft_consensus.cc:2393] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 2: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:11:43.860946 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:43.861805 29377 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 2.
I20260709 13:11:43.840930 30465 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:43.866207 30386 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:43.840353 30363 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:43.871057 30488 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.871336 30428 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.850415 30460 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:43.909461 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 68213.8us
I20260709 13:11:43.893256 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:43.920707 29421 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:43.891554 30465 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:43.871183 30496 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:43.955008 30496 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:43.956097 30486 consensus_queue.cc:1059] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:43.891160 30499 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:43.957027 29495 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:43.876437 30121 leader_election.cc:304] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:43.906417 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:43.899930 30491 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.918748 30386 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:43.958324 29495 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:43.930518 30407 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:43.928380 30501 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:43.985576 29495 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:11:43.994282 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 51474.1us
I20260709 13:11:43.928992 30428 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:43.963869 30486 raft_consensus.cc:3055] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:43.970371 30459 raft_consensus.cc:2804] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:43.926296 30488 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:44.020551 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 96630.9us
I20260709 13:11:43.994251 29372 raft_consensus.cc:2393] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 2: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:11:44.024343 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.026654 29495 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:43.967064 30465 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:43.991991 30443 raft_consensus.cc:2804] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:11:44.098258 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 168641us
W20260709 13:11:44.105974 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 61825.6us
I20260709 13:11:43.993747 30426 raft_consensus.cc:2804] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:43.995965 30441 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:11:44.018669 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 158518us
I20260709 13:11:43.994624 30407 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:44.021775 30448 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.020196 30486 raft_consensus.cc:740] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:44.122658 30429 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.970453 30499 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:43.994338 30386 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:44.108029 30459 raft_consensus.cc:697] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:44.017638 30336 consensus_queue.cc:1059] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.108s
I20260709 13:11:44.030628 30495 raft_consensus.cc:2749] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:44.137910 30336 raft_consensus.cc:3055] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:44.114068 30496 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:44.124799 30443 raft_consensus.cc:697] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:11:44.127030 30441 raft_consensus.cc:697] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:43.984382 30491 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:44.021123 30501 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:44.155879 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:44.124274 30473 consensus_queue.cc:1048] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:11:44.133651 30497 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.159224 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:44.165796 29377 raft_consensus.cc:2393] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 2: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:11:44.156984 29374 raft_consensus.cc:2393] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 2: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:11:44.157884 29495 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:44.167330 29455 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.128252 30429 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:44.130681 30448 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:44.127254 30407 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:44.143260 30336 raft_consensus.cc:740] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:11:44.173630 30502 log.cc:927] Time spent T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
W20260709 13:11:44.175189 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 58186.6us
I20260709 13:11:44.175554 29377 raft_consensus.cc:1275] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:44.161372 30387 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.164232 30496 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:44.187207 29381 raft_consensus.cc:1275] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:44.193493 29381 raft_consensus.cc:1275] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:44.188184 29378 raft_consensus.cc:1275] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:44.190006 29377 raft_consensus.cc:1275] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:44.169831 30513 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:44.170305 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:11:44.167456 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 56626us
I20260709 13:11:44.232175 30507 raft_consensus.cc:2749] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:44.232970 29455 raft_consensus.cc:1275] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:44.177964 30363 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:44.196846 29456 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.196043 30488 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:44.197206 30387 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:44.186437 29379 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 2.
I20260709 13:11:44.191867 30496 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:11:44.248294 30492 log.cc:927] Time spent T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.207s	user 0.000s	sys 0.000s
I20260709 13:11:44.254611 29449 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:44.258836 30498 log.cc:927] Time spent T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.294s	user 0.001s	sys 0.001s
I20260709 13:11:44.234274 29448 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.234817 30428 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:44.194674 30371 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:44.258299 30496 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.171965 30497 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:44.237067 29447 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.288229 30497 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:11:44.294840 30493 log.cc:927] Time spent T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.289s	user 0.001s	sys 0.001s
I20260709 13:11:44.233349 30506 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:44.278460 29372 raft_consensus.cc:2393] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 2: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:11:44.293942 30497 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:11:44.312057 30504 log.cc:927] Time spent T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.288s	user 0.001s	sys 0.001s
I20260709 13:11:44.312307 30497 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:44.312863 29456 raft_consensus.cc:1275] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:44.300010 30371 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.248673 30499 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:44.293816 29375 raft_consensus.cc:1275] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:44.292078 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:44.326611 30355 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:44.326838 29376 raft_consensus.cc:2393] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 2: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:11:44.327183 30355 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:44.244376 30423 consensus_queue.cc:1048] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 13:11:44.299337 30514 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:11:44.325938 30487 log.cc:927] Time spent T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.299s	user 0.002s	sys 0.000s
I20260709 13:11:44.336112 30512 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.317997 29373 raft_consensus.cc:1275] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:44.327852 29449 raft_consensus.cc:1275] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:44.245699 30459 consensus_queue.cc:237] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:44.315150 30371 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:44.305212 30404 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:44.321028 30465 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:44.324005 30429 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:44.196673 30486 consensus_queue.cc:260] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:44.346930 30371 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:44.344282 30510 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.347414 30404 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:44.351063 30448 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:44.351217 30497 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:44.300693 30441 consensus_queue.cc:237] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:44.352691 30503 log.cc:927] Time spent T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260709 13:11:44.354317 30155 raft_consensus.cc:1217] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:11:44.247411 30513 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:44.255721 30443 consensus_queue.cc:237] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:44.293195 30336 consensus_queue.cc:260] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:44.380844 30155 raft_consensus.cc:2955] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 LEARNER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:11:44.385543 29448 raft_consensus.cc:1275] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:11:44.385730 30444 consensus_meta.cc:287] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.763s	user 0.012s	sys 0.004s
I20260709 13:11:44.342038 30432 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:44.315347 30506 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:44.361332 30409 consensus_meta.cc:287] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.803s	user 0.016s	sys 0.001s
I20260709 13:11:44.357230 30386 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:44.336880 30512 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:44.377957 30393 consensus_meta.cc:287] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.639s	user 0.008s	sys 0.007s
I20260709 13:11:44.377200 30510 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:44.385856 30336 raft_consensus.cc:3060] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:44.417989 30448 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.358690 30514 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:11:44.439766 29452 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.478283 30511 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:44.457669 30486 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.465574 30380 consensus_queue.cc:1059] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:11:44.438979 30432 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:44.461987 30387 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:44.479203 30511 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:44.462965 30448 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:44.507149 30517 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.515324 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:44.519482 30517 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:44.519976 29377 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 2.
I20260709 13:11:44.509447 30355 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:44.510272 30512 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:44.529289 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:44.511107 30432 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:44.511618 30506 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:44.514006 30495 raft_consensus.cc:3055] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:44.484625 30491 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:44.515823 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:44.555363 29378 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 2.
I20260709 13:11:44.557132 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:44.558337 29378 raft_consensus.cc:2393] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 2: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:11:44.506443 30412 consensus_meta.cc:287] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.696s	user 0.016s	sys 0.000s
I20260709 13:11:44.514859 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:44.518396 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:44.518776 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:44.530447 29377 raft_consensus.cc:2393] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 2: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:11:44.547394 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.567236 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:44.529026 30513 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:44.571545 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:44.572925 29377 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 2.
I20260709 13:11:44.553804 30495 raft_consensus.cc:740] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:44.553966 30393 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:11:44.585312 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 343971us
I20260709 13:11:44.568295 29378 raft_consensus.cc:2393] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 2: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:11:44.560840 30519 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:44.589937 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:44.581660 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:44.570590 29374 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:44.562805 30412 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:44.592406 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:44.568293 30510 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:44.575714 30453 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:44.600847 29493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 240033us
I20260709 13:11:44.572474 30404 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:44.593067 29376 raft_consensus.cc:2393] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 2: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:11:44.598367 29373 raft_consensus.cc:2393] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 2: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:11:44.581158 30447 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:44.611661 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 409129us
I20260709 13:11:44.589526 30514 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:44.590874 30511 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:44.596256 30401 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.637701 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:44.638594 29523 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
I20260709 13:11:44.593667 30393 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:44.639636 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:44.640918 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:44.627532 30426 raft_consensus.cc:697] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
W20260709 13:11:44.645679 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:44.599601 30519 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:44.649609 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:44.650249 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:44.653093 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:44.654201 30524 consensus_queue.cc:1048] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:44.655746 30524 consensus_queue.cc:1048] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:44.666143 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:44.667791 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:44.668800 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:44.669463 29528 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:44.670737 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:44.670743 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:44.614444 30453 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:44.669286 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:44.687460 29527 raft_consensus.cc:2393] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 2: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:11:44.673961 29528 raft_consensus.cc:2393] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 2: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:11:44.626549 30495 consensus_queue.cc:260] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:44.644963 30491 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.691915 29419 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:44.647049 30511 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.696807 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:44.631388 30401 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:44.700801 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:44.651783 30514 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:11:44.713256 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:44.709614 30491 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:44.707598 29526 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
I20260709 13:11:44.710779 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:44.712407 29527 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 1.
I20260709 13:11:44.704893 29344 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:44.709955 30496 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:44.731987 30444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:53424 (request call id 3) took 4609 ms. Trace:
I20260709 13:11:44.714100 30511 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:44.781895 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:44.782021 30444 rpcz_store.cc:276] 0709 13:11:40.098127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:40.098356 (+   229us) service_pool.cc:224] Handling call
0709 13:11:40.196622 (+ 98266us) log.cc:844] Serialized 513 byte log entry
0709 13:11:40.381668 (+185046us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b180022ea60. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c13c0a 00007f6a82353219 00007f6a78c9ba40 00007f6a78c964e4 00007f6a78c96455 00007f6a7bcdfb0b 00007f6a7bd64b63 00007f6a7bd8c752 00007f6a80d4cd29
0709 13:11:40.388596 (+  6928us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b180022ea60. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c13c0a 00007f6a82353219 00007f6a78c9ba40 00007f6a78c964e4 00007f6a78c96455 00007f6a7bcdfb0b 00007f6a7bd64b63 00007f6a7bd8c752 00007f6a80d4cd29
0709 13:11:40.392871 (+  4275us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b54001f8c20. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bcff142 00007f6a7bcdfeaa 00007f6a7bce6d53 00007f6a7bce6cd9 00007f6a7bce6c69 00007f6a7bce6c31 00007f6a7bce5dfd 000000000038f354 000000000038f199 00007f6a78c99475
0709 13:11:44.707476 (+4314605us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":765,"raft.queue_time_us":72626,"raft.run_cpu_time_us":10081,"raft.run_wall_time_us":116648,"spinlock_wait_cycles":14179840,"thread_start_us":63746,"threads_started":1,"wal-append.queue_time_us":176693,"wal-append.run_cpu_time_us":2841,"wal-append.run_wall_time_us":1003930}
I20260709 13:11:44.783720 30511 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:44.706842 30517 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:44.713706 30386 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:44.785302 30386 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:44.785169 30426 consensus_queue.cc:237] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:44.786249 30453 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:44.733865 29377 raft_consensus.cc:2393] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 2: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:11:44.787655 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:44.788520 29449 raft_consensus.cc:3060] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:44.789328 30515 log.cc:927] Time spent T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
I20260709 13:11:44.792685 30491 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:44.697760 30513 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.709420 30506 raft_consensus.cc:2749] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:44.628422 30447 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:44.652683 30417 consensus_queue.cc:1048] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:11:44.704789 30520 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:44.687187 30524 consensus_queue.cc:1048] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:11:44.692104 30512 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:44.756353 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:44.762410 30448 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:44.779811 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:44.780831 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:44.780939 30514 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:44.779469 30412 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:11:44.797505 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 92748.5us
I20260709 13:11:44.799151 30393 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:44.794978 30513 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:44.803669 29378 raft_consensus.cc:2393] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 2: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:11:44.690447 30510 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:44.811776 29523 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
I20260709 13:11:44.703634 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:44.812192 30491 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:44.810817 30386 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:44.815603 30453 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.834288 29344 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:44.814342 30447 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:44.818795 30506 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:44.773259 30523 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.829499 30499 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:44.838971 30491 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:44.861909 29344 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:44.837710 30393 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:44.861832 30517 raft_consensus.cc:2804] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:44.826895 30512 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:44.871730 29527 consensus_queue.cc:237] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:11:44.840378 30510 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:44.848551 30453 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:44.868011 30363 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:11:44.980695 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 50142.7us
I20260709 13:11:44.884413 30497 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:44.984308 30497 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:44.984858 30401 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:44.984956 30512 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:44.981305 30371 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:44.984309 29374 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
I20260709 13:11:44.986040 30371 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:44.932754 30387 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:44.986917 30387 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:44.987365 30387 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:44.988255 30371 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:44.973359 30524 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.987732 30363 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:44.814101 30520 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:44.888419 30447 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.888557 30491 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:44.884759 30511 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:44.889160 30336 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:44.963222 30386 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.990000 29449 raft_consensus.cc:2410] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ca041dab9b2f44409ed7bf4c6cf66ab2 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:11:44.972743 30517 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.009261 30517 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:45.008841 30511 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:45.009969 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:45.010689 29449 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
I20260709 13:11:45.011631 30336 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:11:44.976270 30412 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:45.012451 30447 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:45.013300 30412 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:45.013981 30336 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:45.014626 30447 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:45.015251 30511 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:45.015985 30336 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:45.016129 29346 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:44.885535 30499 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:44.978077 30429 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.017091 30336 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:45.018570 30520 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:45.020018 30496 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:45.035913 30496 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.036180 30499 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:45.036715 30497 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:45.036514 30496 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:45.036967 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:45.038236 30510 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:45.038650 30496 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:11:45.008149 29447 consensus_meta.cc:287] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.724s	user 0.012s	sys 0.004s
I20260709 13:11:45.041707 29447 raft_consensus.cc:1275] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:45.042807 30336 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:45.027242 30511 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:45.044015 30511 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.043933 30121 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:45.045243 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:45.021675 30453 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:44.896222 30393 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:45.046291 30412 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:45.015205 30447 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:45.044600 30511 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:44.868995 30506 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:45.047912 30393 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:11:45.048581 30486 consensus_meta.cc:287] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.547s	user 0.013s	sys 0.000s
I20260709 13:11:45.004889 30513 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:11:45.007220 29452 consensus_meta.cc:287] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.532s	user 0.016s	sys 0.000s
I20260709 13:11:45.028977 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:45.049728 30363 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:11:45.050395 29449 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:45.021318 30380 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.051527 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:45.051179 30380 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:45.052285 29449 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
I20260709 13:11:45.053598 29374 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 2.
I20260709 13:11:45.054204 30380 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:45.054692 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:45.030840 30429 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:45.055603 29376 raft_consensus.cc:2393] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 2: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:45.057403 30429 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:45.029304 30386 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:45.015792 30409 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.058183 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:44.989998 30524 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:45.048877 30506 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:45.030496 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:45.058468 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:45.045400 30528 raft_consensus.cc:2749] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:45.006183 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:11:44.873623 30523 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:45.046999 30447 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:45.158455 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:45.130821 30524 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:45.108950 30520 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:45.139194 30519 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:45.049850 29452 raft_consensus.cc:1275] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:45.058333 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:11:45.164747 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.108783 29447 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
I20260709 13:11:45.137959 30460 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:45.061061 30448 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.130577 30513 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:45.134200 30386 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:45.058926 30409 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:45.109172 30363 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:45.157706 30155 raft_consensus.cc:2468] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
I20260709 13:11:45.172268 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:45.132548 30517 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:45.164301 30520 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:45.171037 29373 raft_consensus.cc:2468] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 2.
I20260709 13:11:45.175908 29378 raft_consensus.cc:1275] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:45.168426 30523 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:11:45.394517 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.402074 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:11:45.408835 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:45.406311 29493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 249363us
I20260709 13:11:45.417183 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:45.417907 29380 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 2.
I20260709 13:11:45.418651 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:45.419147 29380 raft_consensus.cc:2468] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 1.
W20260709 13:11:45.390291 30537 log.cc:927] Time spent T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 13:11:45.374188 30460 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:45.423959 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:45.185926 30517 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:45.441989 29450 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:45.376541 30513 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:45.402259 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:45.393977 30428 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.444041 30428 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:45.444820 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:45.445487 29375 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 1.
W20260709 13:11:45.446048 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.378155 30512 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.413682 30387 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:45.428510 29421 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:45.447670 29380 raft_consensus.cc:2393] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 2: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:11:45.452256 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:45.393628 30407 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:45.406060 30447 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:45.450692 29421 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:45.420286 30429 raft_consensus.cc:493] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.455382 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:45.419837 30382 raft_consensus.cc:493] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:11:45.178651 30363 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:45.446637 30523 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.460354 30540 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.475180 30540 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:45.476431 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:45.454466 30386 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:45.470670 30520 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:45.177606 30448 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:45.468794 29421 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:45.469795 30382 raft_consensus.cc:515] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:45.465888 30407 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:45.459810 30409 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:11:45.471663 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:45.449620 30460 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:45.454936 30512 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:45.475059 30523 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:45.480826 30386 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:45.484997 30517 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.483476 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:45.472451 30429 raft_consensus.cc:515] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:45.488914 30407 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.498811 29421 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:45.489194 30520 raft_consensus.cc:2804] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:45.484483 30428 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:45.486452 30473 consensus_queue.cc:1048] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:11:45.507768 30517 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:45.818329 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.685527 29530 raft_consensus.cc:1240] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:45.516371 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:45.769055 29377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52172 (request call id 659) took 1241 ms. Trace:
I20260709 13:11:45.681037 30363 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:45.861778 29377 rpcz_store.cc:276] 0709 13:11:44.527789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.581141 (+ 53352us) service_pool.cc:224] Handling call
0709 13:11:45.768700 (+1187559us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54003dd954. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:11:45.768956 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":323778816}
I20260709 13:11:45.525146 30417 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:45.865515 30417 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:45.854714 29493 consensus_peers.cc:597] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671): Couldn't send request to peer ca041dab9b2f44409ed7bf4c6cf66ab2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eb6a9a102eba49209ddf2bdf286077e8. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:45.859315 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 360563us
I20260709 13:11:45.759316 29449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1162) took 1108 ms. Trace:
I20260709 13:11:45.756202 29453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1156) took 1121 ms. Trace:
I20260709 13:11:45.868347 29421 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:45.869122 29453 rpcz_store.cc:276] 0709 13:11:44.634940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.635082 (+   142us) service_pool.cc:224] Handling call
0709 13:11:45.754897 (+1119815us) spinlock_profiling.cc:243] Waited 8.76 ms on lock 0x7b5800193598. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61b71 00007f6a78c61a22 00007f6a81b7ac09 00007f6a80cd4ee0 00007f6a80d9e0ab 00007f6a80d9e131 00007f6a80d5ffc0 00007f6a80d4a929 00007f6a80d4a3d2 00007f6a7a2c1bd4
0709 13:11:45.755235 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:45.755700 (+   465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:45.755745 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:45.755817 (+    72us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:45.755863 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:45.755957 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:45.756127 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20147584}
I20260709 13:11:45.871673 30545 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.872287 30545 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:45.874140 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:45.758169 29448 raft_consensus.cc:1240] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:45.875228 30514 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:11:45.876016 30514 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:45.876542 30514 raft_consensus.cc:697] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 2 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:45.877661 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:11:45.877740 30514 consensus_queue.cc:237] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:45.875303 29447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 18) took 1212 ms. Trace:
I20260709 13:11:45.879966 29447 rpcz_store.cc:276] 0709 13:11:44.662935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.390964 (+728029us) service_pool.cc:224] Handling call
0709 13:11:45.391418 (+   454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:45.873974 (+482556us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:45.874013 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:45.874078 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:45.874113 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:45.875038 (+   925us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b54002530d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:11:45.875085 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:45.875231 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1109246848}
I20260709 13:11:45.881273 29276 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37586 (request call id 131) took 2843 ms. Trace:
I20260709 13:11:45.868381 29449 rpcz_store.cc:276] 0709 13:11:44.650718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.062850 (+412132us) service_pool.cc:224] Handling call
0709 13:11:45.130544 (+ 67694us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:45.491021 (+360477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:45.493422 (+  2401us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:45.496322 (+  2900us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:45.498497 (+  2175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:45.758944 (+260447us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b5400260a54. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:11:45.759029 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:45.759224 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":817800576}
I20260709 13:11:45.859401 30407 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:45.633181 30460 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:11:45.653148 30542 log.cc:927] Time spent T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2: Append to log took a long time: real 0.167s	user 0.001s	sys 0.001s
I20260709 13:11:45.887809 30520 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.888396 30520 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:45.633143 30495 raft_consensus.cc:3060] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:45.875425 29448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1150) took 1253 ms. Trace:
I20260709 13:11:45.892378 30417 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:45.595999 29450 raft_consensus.cc:1275] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:45.894423 29450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 516) took 1706 ms. Trace:
I20260709 13:11:45.495059 29373 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 1.
I20260709 13:11:45.894989 29450 rpcz_store.cc:276] 0709 13:11:44.187882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.187995 (+   113us) service_pool.cc:224] Handling call
0709 13:11:45.441471 (+1253476us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b5800193598. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61b71 00007f6a78c61a22 00007f6a81b7ac09 00007f6a80cd4ee0 00007f6a80d9e0ab 00007f6a80d9e131 00007f6a80d5ffc0 00007f6a80d4a929 00007f6a80d4a3d2 00007f6a7a2c1bd4
0709 13:11:45.441712 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:45.894008 (+452296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:45.894337 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6541184}
I20260709 13:11:45.654023 30423 raft_consensus.cc:493] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:11:45.872732 29421 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:45.898624 30540 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:45.899290 30540 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:45.899457 29421 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:45.892138 29448 rpcz_store.cc:276] 0709 13:11:44.622664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.625342 (+  2678us) service_pool.cc:224] Handling call
0709 13:11:45.757569 (+1132227us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b5800193598. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61e9c 00007f6a78c61a5b 00007f6a81b7ac09 00007f6a80cd4ee0 00007f6a80d9e0ab 00007f6a80d9e131 00007f6a80d5ffc0 00007f6a80d4a929 00007f6a80d4a3d2 00007f6a7a2c1bd4
0709 13:11:45.757863 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:45.875157 (+117294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:45.875367 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30082304}
I20260709 13:11:45.900434 30363 raft_consensus.cc:2804] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:45.901026 30363 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.901232 30512 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:45.901556 30363 raft_consensus.cc:3060] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:45.901079 30460 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:45.902310 30460 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:45.902697 30460 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:45.737973 29452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 512) took 1574 ms. Trace:
I20260709 13:11:45.903563 29452 rpcz_store.cc:276] 0709 13:11:44.163834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.164828 (+   994us) service_pool.cc:224] Handling call
0709 13:11:44.197085 (+ 32257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:45.166950 (+969865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:45.737394 (+570444us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b54000c35d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:11:45.737800 (+   406us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":546219264}
I20260709 13:11:45.906123 29375 raft_consensus.cc:2468] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
I20260709 13:11:45.900576 29421 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:11:45.917178 29493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 49010.1us
W20260709 13:11:45.909932 29346 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 1.659s (SENT) [suppressed 3 similar messages]
I20260709 13:11:45.919984 29450 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:45.740665 30511 consensus_meta.cc:287] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.689s	user 0.011s	sys 0.003s
W20260709 13:11:45.590766 29379 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52172 (request call id 641) took 1726 ms (client timeout 1627 ms). Trace:
I20260709 13:11:45.911237 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:11:45.911828 30513 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:45.541208 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:45.917035 29421 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:45.499303 30386 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:45.923084 29453 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:45.898139 30423 raft_consensus.cc:515] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:45.857203 30519 raft_consensus.cc:2804] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:45.931557 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:11:45.755882 30491 consensus_meta.cc:287] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.752s	user 0.015s	sys 0.000s
I20260709 13:11:45.912220 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:11:45.858178 30442 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:45.916210 30432 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.922669 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:45.965147 30432 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:45.932340 29523 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 2.
I20260709 13:11:45.899991 30540 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:45.941457 29421 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:45.881709 29276 rpcz_store.cc:276] 0709 13:11:43.037877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:43.071937 (+ 34060us) service_pool.cc:224] Handling call
0709 13:11:45.881156 (+2809219us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:43.764245 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:43.764986 (+   741us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:43.765034 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:11:43.765062 (+    28us) tablet.cc:662] Decoding operations
0709 13:11:43.765523 (+   461us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:43.765612 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:43.765641 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:11:43.765858 (+   217us) tablet.cc:701] Row locks acquired
0709 13:11:43.765881 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:11:43.766152 (+   271us) write_op.cc:270] Start()
0709 13:11:43.766369 (+   217us) write_op.cc:276] Timestamp: P: 1783602703766018 usec, L: 0
0709 13:11:43.766407 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:11:43.782311 (+ 15904us) log.cc:844] Serialized 543 byte log entry
0709 13:11:44.296641 (+514330us) op_driver.cc:464] REPLICATION: finished
0709 13:11:44.697247 (+400606us) write_op.cc:301] APPLY: starting
0709 13:11:44.705460 (+  8213us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:44.714971 (+  9511us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:44.754405 (+ 39434us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:44.779702 (+ 25297us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:44.779913 (+   211us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:11:44.779991 (+    78us) write_op.cc:312] APPLY: finished
0709 13:11:44.780270 (+   279us) log.cc:844] Serialized 22 byte log entry
0709 13:11:44.780521 (+   251us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:44.780638 (+   117us) write_op.cc:454] Released schema lock
0709 13:11:44.780695 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:44.781112 (+   417us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:44.781149 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":32170,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":345324,"apply.run_cpu_time_us":2736,"apply.run_wall_time_us":94119,"num_ops":1,"prepare.queue_time_us":153018,"prepare.run_cpu_time_us":3843,"prepare.run_wall_time_us":27685,"replication_time_us":511736,"thread_start_us":436848,"threads_started":2}]]}
I20260709 13:11:45.925400 30415 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:45.973523 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:11:45.976174 30415 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:45.980782 30423 leader_election.cc:290] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:11:45.978904 30415 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:45.923084 30538 raft_consensus.cc:2804] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:45.984867 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:11:45.990681 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:45.994673 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:11:46.004259 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 63736.5us
I20260709 13:11:46.005584 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:45.970479 30363 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:46.008428 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:46.010152 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:46.010878 30387 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:46.005640 29421 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:46.001513 30514 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:46.013087 30545 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:46.013230 30514 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:46.014662 30382 leader_election.cc:290] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:11:46.016099 30514 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:46.016203 30429 leader_election.cc:290] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:11:46.016979 30514 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:46.017445 30514 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:46.017849 30514 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:45.987221 30538 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:46.007228 30519 raft_consensus.cc:697] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 3 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:46.020321 30501 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:46.021044 30501 raft_consensus.cc:2804] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:46.021414 30501 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.021806 30501 raft_consensus.cc:3060] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:46.021282 30519 consensus_queue.cc:237] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:46.024307 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:46.025127 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:46.019057 29449 raft_consensus.cc:2955] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:11:46.026000 29453 raft_consensus.cc:1275] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:46.025902 29521 raft_consensus.cc:2393] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 2: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:11:46.025839 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:46.027201 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:46.027781 29451 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:46.029376 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:46.030330 29521 raft_consensus.cc:2393] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 2: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:11:46.033409 29450 raft_consensus.cc:1275] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:46.037290 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:46.039006 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:45.952724 30524 raft_consensus.cc:493] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
W20260709 13:11:45.921967 29379 rpcz_store.cc:269] 0709 13:11:43.857936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:43.862964 (+  5028us) service_pool.cc:224] Handling call
0709 13:11:45.557765 (+1694801us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b54001ee954. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:11:45.584424 (+ 26659us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":477155712}
I20260709 13:11:46.020399 30538 raft_consensus.cc:3060] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:46.010432 30363 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:11:46.040195 29452 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:45.939646 30513 raft_consensus.cc:2804] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:46.056993 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:45.922752 30511 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:46.076727 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:46.078126 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:46.085215 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:46.027123 30448 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:46.052814 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:45.985626 30442 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:46.035842 30491 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:46.127157 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:46.126678 29277 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35182 (request call id 46) took 3415 ms. Trace:
I20260709 13:11:46.147480 29530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 599) took 1479 ms. Trace:
I20260709 13:11:46.153023 30432 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:11:46.169113 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.153646 30511 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:45.929247 30157 raft_consensus.cc:2468] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
I20260709 13:11:46.119860 30513 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.115468 30523 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:46.127352 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:46.115933 29528 raft_consensus.cc:2393] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 2: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:11:46.162209 30460 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:46.151170 30546 log.cc:927] Time spent T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
I20260709 13:11:46.172401 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:46.193063 29527 raft_consensus.cc:2393] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 2: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:11:46.194036 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:46.194705 29527 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
I20260709 13:11:46.195765 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:46.196897 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:46.197429 29527 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:46.173760 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:46.159009 29277 rpcz_store.cc:276] 0709 13:11:42.710972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.715682 (+  4710us) service_pool.cc:224] Handling call
0709 13:11:46.126081 (+3410399us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b2400379a48. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61b71 00007f6a78c61a22 00007f6a81b7ac09 00007f6a78e31970 00007f6a78e3ea8f 00007f6a81c43e14 00007f6a801042a4 00007f6a80104232 00007f6a80104161 00007f6a801040dc
0709 13:11:46.126445 (+   364us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":424099,"reported_tablets":2,"spinlock_wait_cycles":6372608}
I20260709 13:11:46.176043 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:46.153986 29376 raft_consensus.cc:2368] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 2. Current term is 3.
I20260709 13:11:46.126533 29448 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:46.177992 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:46.180799 30429 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:46.216348 30429 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:46.217953 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 241222us
I20260709 13:11:46.218621 30429 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:46.220027 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:11:46.124732 30544 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:46.221616 30544 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:46.159747 29530 rpcz_store.cc:276] 0709 13:11:44.665429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.665600 (+   171us) service_pool.cc:224] Handling call
0709 13:11:44.666035 (+   435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:45.860419 (+1194384us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:46.143965 (+283546us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54003584d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:11:46.144286 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2343711488}
I20260709 13:11:46.223248 29455 raft_consensus.cc:1240] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:46.183537 30155 raft_consensus.cc:2468] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 1.
I20260709 13:11:46.235921 30417 raft_consensus.cc:493] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.236567 30417 raft_consensus.cc:515] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:46.188906 30513 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:46.242887 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:46.244279 29376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52172 (request call id 666) took 1187 ms. Trace:
I20260709 13:11:46.200654 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:46.242475 29278 catalog_manager.cc:5697] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 1 to 2, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 2 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
W20260709 13:11:46.252311 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 342394us
I20260709 13:11:46.258265 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:46.258458 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:46.259593 29528 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:46.261150 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:46.261893 29453 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
I20260709 13:11:46.263132 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:46.263787 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:46.264115 29453 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:46.264379 29523 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:46.264995 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:46.265690 29346 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:46.268067 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:46.268855 29449 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
I20260709 13:11:46.269867 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:46.270032 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:46.270547 29449 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:46.271562 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:46.272329 29449 raft_consensus.cc:2393] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 2: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:11:46.273188 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:46.273802 29449 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:46.273972 30417 leader_election.cc:290] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:11:46.274920 30429 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:46.275022 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:46.275458 30429 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.275542 29346 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:46.275940 30429 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:46.276503 30511 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:46.202916 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:46.277948 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:46.163538 30494 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:46.201385 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:46.207659 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:46.209720 29344 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:46.279304 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:46.282050 29451 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
W20260709 13:11:46.282485 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 72827.3us
I20260709 13:11:46.283452 30523 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:46.214426 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:46.283953 30523 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:46.284428 30523 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:46.285109 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:46.285681 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:46.286517 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:46.215684 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:46.286896 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:46.214648 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:46.287446 29526 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:46.287701 29521 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:11:46.288496 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:46.289179 29526 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
I20260709 13:11:46.224001 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:46.291476 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:46.292843 29527 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
I20260709 13:11:46.162038 30491 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:46.229285 30460 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:46.229501 30442 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:46.230008 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:11:46.230512 30544 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:46.222997 30432 raft_consensus.cc:1064] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483: attempting to promote NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 to VOTER
I20260709 13:11:46.233634 30386 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:46.276366 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:46.310563 29523 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
I20260709 13:11:46.279934 30494 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:46.283221 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:46.312983 29451 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:46.229122 30517 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:46.274887 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:46.314081 29449 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
I20260709 13:11:46.301471 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:46.316250 29530 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:46.297398 29346 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:46.072652 30524 raft_consensus.cc:515] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:46.283195 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:46.304245 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:46.312871 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:46.171386 30448 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:46.233664 30540 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:46.303390 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:46.328229 29454 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
I20260709 13:11:46.317834 30460 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:11:46.318338 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 312886us
I20260709 13:11:46.213460 30514 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:46.326210 29522 raft_consensus.cc:2410] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:11:46.322638 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:46.334218 29451 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
I20260709 13:11:46.323225 29450 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
I20260709 13:11:46.323925 29419 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:11:46.325281 29521 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
I20260709 13:11:46.335172 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:46.328367 29526 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:46.316452 29344 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:46.337054 29344 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:46.337433 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:46.318728 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:46.224804 30407 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:46.244766 29376 rpcz_store.cc:276] 0709 13:11:45.057045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.057883 (+   838us) service_pool.cc:224] Handling call
0709 13:11:46.244043 (+1186160us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54000d9dd4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:11:46.244206 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2512250240}
I20260709 13:11:46.337749 29377 raft_consensus.cc:1275] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:46.338495 29381 raft_consensus.cc:2393] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 2: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:46.284389 30511 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.329193 30517 raft_consensus.cc:2804] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:46.349749 30511 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:46.352027 30386 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:46.354199 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:46.355880 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:46.356681 29374 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:46.357086 30524 leader_election.cc:290] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:11:46.357949 30407 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:46.358182 29456 raft_consensus.cc:2368] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3.
I20260709 13:11:46.358492 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:46.333602 30460 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:46.360738 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:46.360809 30520 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:46.361876 29456 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
I20260709 13:11:46.362277 30460 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:11:46.363059 29454 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45798 (request call id 1155) took 1698 ms (client timeout 1659 ms). Trace:
I20260709 13:11:46.341459 29449 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:46.342104 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:46.343717 30387 raft_consensus.cc:2804] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:46.345860 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:11:46.339982 30540 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:46.385365 30540 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:46.367249 30432 consensus_queue.cc:237] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:46.388659 29344 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:46.376457 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:46.390408 29450 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:46.385046 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:46.392343 29378 raft_consensus.cc:1240] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:46.347467 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:11:46.363236 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:46.377470 29455 raft_consensus.cc:2393] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 2: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:11:46.359192 29374 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 1.
W20260709 13:11:46.382150 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 58521.9us
I20260709 13:11:46.380730 29380 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:46.402588 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:46.403069 29346 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:46.355244 29452 raft_consensus.cc:1275] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:46.413587 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:46.414512 29380 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
I20260709 13:11:46.391479 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:46.377527 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:46.394555 29456 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
I20260709 13:11:46.416814 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:46.417498 29456 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:11:46.364697 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:46.398442 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:46.410351 29495 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:46.420075 29378 raft_consensus.cc:3060] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:11:46.390916 30517 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.381927 30387 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.331073 30448 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:46.412287 29525 raft_consensus.cc:1275] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:11:46.374161 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:46.392521 29451 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:46.443198 29419 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:46.443807 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:11:46.444080 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 107866us
I20260709 13:11:46.366724 29373 raft_consensus.cc:1275] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:11:46.363552 29454 rpcz_store.cc:269] 0709 13:11:44.634657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.635778 (+  1121us) service_pool.cc:224] Handling call
0709 13:11:45.873964 (+1238186us) spinlock_profiling.cc:243] Waited 7.79 ms on lock 0x7b5800193598. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61b71 00007f6a78c61a22 00007f6a81b7ac09 00007f6a80cd4ee0 00007f6a80d9e0ab 00007f6a80d9e131 00007f6a80d4c0a0 00007f6a80d4b984 00007f6a7a2c66d4 00007f6a7a2c6662
0709 13:11:46.333198 (+459234us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b54000195d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:11:46.333333 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1060489728}
W20260709 13:11:46.444655 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.412568 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:46.370639 30447 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:46.427942 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:46.449860 29450 raft_consensus.cc:2393] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 3: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:11:46.427994 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:46.371606 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:46.413455 30554 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.370769 30514 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:46.432237 29378 raft_consensus.cc:2468] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 4.
I20260709 13:11:46.372227 30494 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:46.416630 30507 consensus_queue.cc:1048] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:11:46.460080 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:46.460335 30494 raft_consensus.cc:2804] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:46.460880 30494 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.461367 30494 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:46.461524 30507 consensus_queue.cc:1048] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:46.442186 30495 consensus_queue.cc:1048] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:11:46.454319 29421 leader_election.cc:400] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 2. Current term is 3.
I20260709 13:11:46.434538 29377 raft_consensus.cc:1275] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:46.397397 30544 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:11:46.437256 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.445358 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:46.387835 30540 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:46.445200 29419 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:46.450619 29455 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
I20260709 13:11:46.452390 29456 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
I20260709 13:11:46.453701 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:46.363445 30520 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:46.393889 30551 raft_consensus.cc:2804] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:46.457652 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:11:46.454845 30501 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:46.459064 30385 raft_consensus.cc:2804] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:46.459276 30447 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.442859 29525 pending_rounds.cc:85] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 4
I20260709 13:11:46.485641 29525 pending_rounds.cc:107] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:11:46.486055 29525 raft_consensus.cc:2889] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:46.464123 29421 leader_election.cc:403] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:11:46.435863 30517 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:46.492123 29377 raft_consensus.cc:1275] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:11:46.468149 29454 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
I20260709 13:11:46.470958 29450 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
I20260709 13:11:46.471418 29419 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:11:46.518882 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 47580.7us
I20260709 13:11:46.493496 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:46.446612 30363 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:46.416895 30423 consensus_queue.cc:1048] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
W20260709 13:11:46.475364 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 78206.8us
I20260709 13:11:46.426645 30415 consensus_queue.cc:1048] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:11:46.446622 30519 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.467417 30554 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:46.478811 29528 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
I20260709 13:11:46.446795 30547 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:46.441953 30555 consensus_queue.cc:1048] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:11:46.369113 29372 raft_consensus.cc:2955] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:11:46.447154 30405 consensus_queue.cc:1048] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:11:46.441004 30387 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:46.498482 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:46.520728 29419 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:46.446975 30444 consensus_queue.cc:1048] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:11:46.477866 30409 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:46.578974 29448 raft_consensus.cc:1275] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:46.534426 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:46.584028 29450 raft_consensus.cc:2393] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 3: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:11:46.444916 30538 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:46.520802 29455 raft_consensus.cc:2393] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 3: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:11:46.534953 30407 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:46.538160 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 92363.7us
W20260709 13:11:46.605161 29493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 215504us
I20260709 13:11:46.605585 29421 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:11:46.475731 30544 raft_consensus.cc:697] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:46.539744 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:46.608212 29454 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:46.609548 29454 raft_consensus.cc:1275] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:11:46.614356 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.615782 29454 raft_consensus.cc:1275] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:11:46.540148 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 137221us
I20260709 13:11:46.537856 30460 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.488263 30385 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:46.488807 30154 raft_consensus.cc:3060] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:46.487069 30447 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:46.488487 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:11:46.523252 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:46.473043 30429 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:46.466992 29376 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:46.478363 30551 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:46.543457 30520 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:46.476663 29378 raft_consensus.cc:1275] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:11:46.571040 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 125177us
I20260709 13:11:46.571550 29344 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:11:46.573318 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.537078 30513 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:46.635138 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:46.636271 29378 raft_consensus.cc:2368] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 2. Current term is 3.
I20260709 13:11:46.636456 30501 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:11:46.637401 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:46.637715 30540 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:46.638396 30540 raft_consensus.cc:697] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:11:46.576298 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 55773.1us
I20260709 13:11:46.639681 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:46.640144 29419 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:46.640511 29373 raft_consensus.cc:3060] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:46.632474 30551 raft_consensus.cc:3060] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:46.643847 29453 raft_consensus.cc:2368] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 2. Current term is 3.
I20260709 13:11:46.639751 30511 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:46.576851 30386 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:46.645654 30538 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:46.646638 30538 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:46.587373 29450 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:46.627525 30385 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:46.635156 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 66774.8us
I20260709 13:11:46.649300 29344 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:46.650722 29344 leader_election.cc:304] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:11:46.589741 30547 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:46.651207 30494 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:46.624761 30448 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:46.652468 30544 consensus_queue.cc:237] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:46.653488 30547 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:46.655079 29495 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:46.655094 30563 consensus_queue.cc:1048] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:46.655678 30540 consensus_queue.cc:237] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:46.657004 29495 leader_election.cc:400] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3.
I20260709 13:11:46.657310 29495 leader_election.cc:403] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:46.655687 29377 raft_consensus.cc:1240] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:46.630467 30460 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:46.640457 30473 consensus_queue.cc:1048] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:11:46.660137 30517 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:46.623588 29381 raft_consensus.cc:1275] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:46.571256 30519 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:46.660615 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:46.615895 30514 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:46.584339 30523 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:46.598940 30554 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:46.637428 30513 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:46.653455 30494 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:46.677438 29450 raft_consensus.cc:1275] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:46.631537 29346 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:46.645653 30511 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:46.660511 30460 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:46.657320 30563 consensus_queue.cc:1059] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:11:46.715955 30563 raft_consensus.cc:3055] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:46.716341 30563 raft_consensus.cc:740] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:46.661692 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:46.657502 30555 raft_consensus.cc:2764] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:11:46.662883 30519 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:46.663406 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:46.619428 29421 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:46.662319 30429 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:46.638463 29378 raft_consensus.cc:2368] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 2. Current term is 3.
I20260709 13:11:46.664135 29495 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:46.726161 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:46.727254 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:46.657716 30387 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:46.667142 29344 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:11:46.729884 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 62831.9us
I20260709 13:11:46.730671 29344 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:46.732264 29344 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:46.661638 29377 raft_consensus.cc:2393] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 3: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
W20260709 13:11:46.670238 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:46.697696 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:46.632371 29447 raft_consensus.cc:1240] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:46.674472 30444 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:11:46.705260 30409 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:46.709715 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:46.676622 30560 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:46.676915 30491 raft_consensus.cc:2749] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:46.713304 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 81907.2us
I20260709 13:11:46.727936 30460 raft_consensus.cc:2804] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:46.677667 29452 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
W20260709 13:11:46.721746 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 102534us
I20260709 13:11:46.722537 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:46.779740 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:46.780975 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:46.734823 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:11:46.735836 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 71779.2us
I20260709 13:11:46.738770 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:46.750927 30511 raft_consensus.cc:2804] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:46.788669 29344 leader_election.cc:304] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:11:46.712538 30517 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:46.747684 30428 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:46.740736 30563 consensus_queue.cc:260] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:46.748998 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:46.750257 30485 raft_consensus.cc:2804] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:11:46.836876 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 51039.3us
I20260709 13:11:46.755057 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:46.758978 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:46.761431 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:46.764138 29455 raft_consensus.cc:1275] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:46.766659 29346 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:46.713856 30448 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:46.751194 29454 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
I20260709 13:11:46.781155 29421 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:46.738933 29378 raft_consensus.cc:1275] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:46.762758 30429 raft_consensus.cc:2804] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:46.739562 29448 raft_consensus.cc:1240] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:46.761380 30560 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:46.771346 30460 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:11:46.844115 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 63064.3us
I20260709 13:11:46.784879 30514 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:46.788226 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:11:46.893314 29375 raft_consensus.cc:2393] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 3: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:46.836103 30579 raft_consensus.cc:2749] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:46.838606 30485 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:46.839061 30511 raft_consensus.cc:697] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:46.842531 30448 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:46.845234 30429 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:46.790082 30524 consensus_queue.cc:1048] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.123s
I20260709 13:11:46.846163 29525 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:46.906657 30501 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:46.913429 30560 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:46.903672 30513 raft_consensus.cc:2804] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:46.842247 30417 consensus_queue.cc:1048] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.086s
I20260709 13:11:46.915767 30460 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:46.977896 30387 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:46.982065 29448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 536) took 1002 ms. Trace:
I20260709 13:11:46.846251 30495 consensus_queue.cc:1048] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.085s
I20260709 13:11:46.909078 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:46.924677 30157 raft_consensus.cc:3060] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:46.904215 30423 consensus_queue.cc:1048] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:11:46.919893 30517 raft_consensus.cc:2804] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:46.972929 30154 raft_consensus.cc:2468] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 4.
I20260709 13:11:46.932780 30485 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:46.978790 30511 consensus_queue.cc:237] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:46.970402 30386 raft_consensus.cc:2749] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:46.926546 30514 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:46.950075 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 111387us
I20260709 13:11:46.845883 30405 consensus_queue.cc:1048] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.086s
W20260709 13:11:46.998766 30568 log.cc:927] Time spent T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:11:46.916754 30494 consensus_queue.cc:1048] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:11:46.921402 30563 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:46.973819 30158 raft_consensus.cc:1275] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 LEARNER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:46.989028 29455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 537) took 1003 ms. Trace:
I20260709 13:11:47.066529 30513 raft_consensus.cc:697] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 4 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
W20260709 13:11:46.987123 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:46.996829 30571 log.cc:927] Time spent T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b: Append to log took a long time: real 0.207s	user 0.000s	sys 0.000s
I20260709 13:11:46.939949 30448 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:46.942950 30429 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:47.028131 30520 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 2. Current term is 3.
I20260709 13:11:47.084391 29495 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
W20260709 13:11:47.084762 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 269499us
I20260709 13:11:47.063215 30523 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:47.079319 30385 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:47.079030 30573 log.cc:927] Time spent T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:11:46.969282 30576 ts_tablet_manager.cc:933] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2: Initiating tablet copy from peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:47.071684 30517 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.062556 30501 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:47.071002 30428 raft_consensus.cc:697] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:47.078991 29373 raft_consensus.cc:2468] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 4.
I20260709 13:11:47.087759 29455 rpcz_store.cc:276] 0709 13:11:45.985927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.603190 (+617263us) service_pool.cc:224] Handling call
0709 13:11:46.603573 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:46.840937 (+237364us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:46.988741 (+147804us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54001c2854. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:11:46.988943 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":368214272}
I20260709 13:11:47.134371 29450 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
I20260709 13:11:47.129163 29495 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:47.137260 29495 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:47.115909 30494 consensus_queue.cc:1048] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
W20260709 13:11:47.143870 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 53952.5us
I20260709 13:11:47.117764 30405 raft_consensus.cc:2804] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:47.066773 29448 rpcz_store.cc:276] 0709 13:11:45.979305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.594389 (+615084us) service_pool.cc:224] Handling call
0709 13:11:46.739328 (+144939us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:46.910717 (+171389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:46.981821 (+ 71104us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b540001a9d0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd858ad 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:11:46.981993 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":332277120}
I20260709 13:11:47.149755 30385 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:47.147243 30580 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:47.150709 29454 raft_consensus.cc:1275] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:47.164462 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.140130 30507 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:47.152207 30415 consensus_queue.cc:1048] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:47.169570 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:11:47.152711 30578 log.cc:927] Time spent T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.184s	user 0.002s	sys 0.001s
I20260709 13:11:47.149070 30405 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:47.172763 30405 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:47.134694 30417 consensus_queue.cc:1048] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:11:47.117380 30517 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:47.167316 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.152877 30423 consensus_queue.cc:1048] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:47.161222 30495 consensus_queue.cc:1048] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:47.127694 29376 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
I20260709 13:11:47.166338 30507 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:47.179832 30507 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:47.179334 30448 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:47.172875 30501 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:47.162775 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.102480 30581 consensus_queue.cc:1048] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.079s
I20260709 13:11:47.184481 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.186095 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.190753 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.193485 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.196117 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.196971 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.199081 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:47.199723 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:47.200127 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.201488 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:47.163846 30580 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.190254 30385 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.163610 30513 consensus_queue.cc:237] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:47.203293 30428 consensus_queue.cc:237] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:47.209134 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 442550us
I20260709 13:11:47.203469 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.203837 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.214689 29346 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:47.203893 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.216477 29346 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:47.218798 29346 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:47.204286 30385 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:47.218590 30405 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:47.216631 29527 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 2.
I20260709 13:11:47.221241 30385 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:47.223299 29346 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:47.226747 29526 raft_consensus.cc:2368] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 2. Current term is 3.
I20260709 13:11:47.225310 30385 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:47.230368 30584 raft_consensus.cc:2804] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:47.205981 30157 raft_consensus.cc:2468] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 4.
I20260709 13:11:47.230989 30584 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:47.231149 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.204159 30580 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:47.227227 30448 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:47.232175 29521 raft_consensus.cc:2368] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 2. Current term is 3.
I20260709 13:11:47.226725 29346 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:47.211966 30517 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:47.230301 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:47.235723 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.231431 30584 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:47.205615 30570 log.cc:927] Time spent T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.359s	user 0.005s	sys 0.000s
I20260709 13:11:47.242121 29346 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:11:47.206566 30577 log.cc:927] Time spent T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.201s	user 0.004s	sys 0.004s
I20260709 13:11:47.238588 29530 raft_consensus.cc:2368] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 2. Current term is 3.
I20260709 13:11:47.243906 29346 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:47.244230 29419 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:11:47.245034 29346 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:47.246129 29346 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:47.249051 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.250224 29346 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:47.221268 30405 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:47.258538 30585 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:47.206902 30514 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:11:47.241317 30447 consensus_meta.cc:287] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.604s	user 0.012s	sys 0.001s
I20260709 13:11:47.225996 30544 raft_consensus.cc:2749] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:47.252574 30551 consensus_meta.cc:287] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.608s	user 0.013s	sys 0.000s
I20260709 13:11:47.250952 30448 raft_consensus.cc:2804] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:47.251955 30501 raft_consensus.cc:2804] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:47.251204 30385 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:47.273211 30448 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.283322 30514 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:47.283404 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.283984 30514 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:47.255406 30586 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:47.224377 30444 raft_consensus.cc:2749] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3.
I20260709 13:11:47.252666 29346 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:47.225837 30523 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:47.259922 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:47.255352 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.267796 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:47.269080 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:47.251786 30491 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:47.251071 30387 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:47.206212 30460 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:47.248030 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:47.283183 30448 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:47.276034 29527 raft_consensus.cc:1240] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 1. Current term is 2. Ops: []
W20260709 13:11:47.282480 30363 consensus_meta.cc:287] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.749s	user 0.014s	sys 0.001s
I20260709 13:11:47.299201 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.289343 30586 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.260223 29344 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:47.287961 30385 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:47.293288 29529 raft_consensus.cc:2393] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 3: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:11:47.293761 29346 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:47.294713 30387 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.303843 30387 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:47.305589 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:47.292546 30523 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:47.274349 30551 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:47.307844 30523 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:47.308431 29449 raft_consensus.cc:2393] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in current term 2: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:11:47.309855 30460 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:47.310222 30551 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 election: Requested vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:11:47.289525 30560 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:47.286201 30501 raft_consensus.cc:697] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 4 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:47.307268 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.312574 29378 raft_consensus.cc:1240] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:47.287009 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.288736 30576 tablet_copy_client.cc:323] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Beginning tablet copy session from remote peer at address 127.27.146.131:35367
I20260709 13:11:47.292707 30491 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.291795 29523 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:47.291764 30511 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:47.272456 30447 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:47.324883 30491 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:47.328649 29381 raft_consensus.cc:2393] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 3: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:47.314393 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:11:47.322964 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 62810.9us
I20260709 13:11:47.321458 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.332329 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:47.302444 30586 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:47.325793 29346 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:47.326740 30562 raft_consensus.cc:2804] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:47.327423 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:11:47.327421 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.307928 29522 raft_consensus.cc:2393] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 3: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:47.336768 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.338994 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.341385 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.314319 30363 raft_consensus.cc:2749] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:47.316809 30385 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:47.321013 30560 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:47.337787 30562 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:47.354116 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.352738 30567 raft_consensus.cc:2804] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:47.356499 29456 raft_consensus.cc:1240] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:47.363471 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:47.363982 29451 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
I20260709 13:11:47.364152 29530 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:47.331080 30540 raft_consensus.cc:2804] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:47.365671 29456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 529) took 1388 ms. Trace:
I20260709 13:11:47.362485 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:47.348356 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.364460 29378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52172 (request call id 682) took 1014 ms. Trace:
I20260709 13:11:47.366125 29456 rpcz_store.cc:276] 0709 13:11:45.977038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.578509 (+601471us) service_pool.cc:224] Handling call
0709 13:11:47.356222 (+777713us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:47.363275 (+  7053us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:47.365484 (+  2209us) spinlock_profiling.cc:243] Waited 777 ms on lock 0x7b54001c1950. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd858ad 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:11:47.365611 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1787811712}
I20260709 13:11:47.369355 29451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45798 (request call id 1197) took 1059 ms. Trace:
I20260709 13:11:47.369086 29378 rpcz_store.cc:276] 0709 13:11:46.350408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.909044 (+558636us) service_pool.cc:224] Handling call
0709 13:11:46.909691 (+   647us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:47.312958 (+403267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:47.364215 (+ 51257us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b54003bbd54. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:11:47.364399 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":926117120}
I20260709 13:11:47.311971 30501 consensus_queue.cc:237] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:11:47.355400 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:47.373442 30121 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:47.367756 29346 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:47.374918 30560 raft_consensus.cc:2804] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:47.374717 30580 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:47.375286 30514 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:47.375312 30560 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:47.375977 30560 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:47.376536 30473 raft_consensus.cc:3060] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:47.369999 29451 rpcz_store.cc:276] 0709 13:11:46.309988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.443461 (+133473us) service_pool.cc:224] Handling call
0709 13:11:47.369193 (+925732us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b5400261e54. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:11:47.369297 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2114311552}
I20260709 13:11:47.372762 29528 raft_consensus.cc:2410] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:47.378464 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:47.366571 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.379606 29346 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:47.363157 30562 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:47.382419 29346 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:47.363037 30567 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.382941 29540 tablet_copy_service.cc:140] P 71aa3578fd924765ab9ac0729c8d1483: Received BeginTabletCopySession request for tablet eb6a9a102eba49209ddf2bdf286077e8 from peer ca041dab9b2f44409ed7bf4c6cf66ab2 ({username='slave'} at 127.0.0.1:53428)
I20260709 13:11:47.391845 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.384922 29346 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:47.393162 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.383646 30544 raft_consensus.cc:2804] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:47.394109 30517 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:47.394410 30544 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:47.394495 30366 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:47.394933 30544 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:47.394212 29540 tablet_copy_service.cc:161] P 71aa3578fd924765ab9ac0729c8d1483: Beginning new tablet copy session on tablet eb6a9a102eba49209ddf2bdf286077e8 from peer ca041dab9b2f44409ed7bf4c6cf66ab2 at {username='slave'} at 127.0.0.1:53428: session id = ca041dab9b2f44409ed7bf4c6cf66ab2-eb6a9a102eba49209ddf2bdf286077e8
I20260709 13:11:47.365870 30540 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:47.396790 30584 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:47.397558 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:47.385092 30585 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:47.397132 30567 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:47.399830 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.404217 29528 raft_consensus.cc:2410] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:47.405768 29346 leader_election.cc:400] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 2. Current term is 3.
I20260709 13:11:47.406160 29346 leader_election.cc:403] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:47.400501 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.401034 29524 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
I20260709 13:11:47.401881 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:47.408739 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.409451 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.406857 29529 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 2.
I20260709 13:11:47.396938 30540 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:47.410607 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:11:47.388064 30591 log.cc:927] Time spent T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:11:47.406955 29523 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
I20260709 13:11:47.411062 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.409961 29525 raft_consensus.cc:1240] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:47.420054 29540 tablet_copy_source_session.cc:215] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:47.420316 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.419341 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:47.421859 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.422506 29525 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
I20260709 13:11:47.410676 30514 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:47.423693 29344 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:47.388317 30447 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:47.415374 29524 raft_consensus.cc:2368] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 2. Current term is 3.
I20260709 13:11:47.417518 30366 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:11:47.412595 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.399539 30511 raft_consensus.cc:2804] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:47.420424 30429 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:47.412118 29522 raft_consensus.cc:2393] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 3: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:47.415071 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.424029 30514 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:47.432001 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.433846 30584 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:47.436506 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:47.389989 30507 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:47.447198 29521 raft_consensus.cc:2393] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 2: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:11:47.460952 29528 raft_consensus.cc:1240] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:47.466473 29346 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:47.431591 30511 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.470636 29346 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:47.471628 29530 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
I20260709 13:11:47.469143 29526 raft_consensus.cc:1275] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:47.389555 30586 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:47.473065 30517 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:47.473259 30511 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:47.474879 29372 raft_consensus.cc:1240] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:47.481477 29372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52172 (request call id 688) took 1129 ms. Trace:
I20260709 13:11:47.481880 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.450258 30576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb6a9a102eba49209ddf2bdf286077e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:47.475459 30473 raft_consensus.cc:2749] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:47.453750 30485 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:47.476632 30523 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:47.447813 30507 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:47.478416 29523 raft_consensus.cc:1275] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:47.483848 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.484524 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.481544 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:47.481904 29372 rpcz_store.cc:276] 0709 13:11:46.352134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.968761 (+616627us) service_pool.cc:224] Handling call
0709 13:11:46.969064 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:47.480518 (+511454us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:47.481167 (+   649us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b54003bb854. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:11:47.481405 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1155299200}
I20260709 13:11:47.493610 29527 raft_consensus.cc:2368] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 2. Current term is 3.
I20260709 13:11:47.478343 30584 raft_consensus.cc:2749] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:47.489233 29278 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37594 (request call id 130) took 1562 ms. Trace:
I20260709 13:11:47.489363 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.497397 30158 raft_consensus.cc:1240] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:47.485656 30514 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:47.490200 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.488438 29276 catalog_manager.cc:5697] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: config changed from index -1 to 2, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New cstate: current_term: 1 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:47.488087 29346 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:47.432582 30428 raft_consensus.cc:2804] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:47.455098 30560 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:47.505154 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:47.516222 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:47.519481 30579 raft_consensus.cc:2804] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:47.520264 30579 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.520654 30579 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:47.522029 30584 consensus_queue.cc:1048] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:47.522733 30567 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:47.515475 30428 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.524019 30428 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:47.524902 30544 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:47.527101 30544 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:47.527590 30507 consensus_queue.cc:1059] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:47.528396 30580 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:47.528779 30507 raft_consensus.cc:3055] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:47.529143 30507 raft_consensus.cc:740] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:47.530122 30507 consensus_queue.cc:260] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:47.453071 30491 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:47.483408 30448 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:47.558285 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.576591 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:47.563390 29451 raft_consensus.cc:1275] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:47.599058 29419 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:47.512701 29276 catalog_manager.cc:5697] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 1 to 2, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 2 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:47.600924 29276 catalog_manager.cc:5697] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 1 to 2, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 2 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:47.601634 29452 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:47.559729 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:47.559818 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.531641 29525 raft_consensus.cc:1240] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:47.536341 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.566224 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:47.607678 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:47.609100 29456 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
I20260709 13:11:47.565750 29450 raft_consensus.cc:1240] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:47.557850 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.531360 30507 raft_consensus.cc:3060] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:47.614677 29448 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:47.607445 30363 raft_consensus.cc:2749] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:47.614082 30448 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:47.532766 30485 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:47.533838 30586 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:47.535034 30523 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:47.608804 29454 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
I20260709 13:11:47.622447 30366 raft_consensus.cc:2749] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 2. Current term is 3.
I20260709 13:11:47.496163 29278 rpcz_store.cc:276] 0709 13:11:45.927075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:45.927294 (+   219us) service_pool.cc:224] Handling call
0709 13:11:47.489103 (+1561809us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:46.412620 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:46.575056 (+162436us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:46.588167 (+ 13111us) write_op.cc:435] Acquired schema lock
0709 13:11:46.589717 (+  1550us) tablet.cc:662] Decoding operations
0709 13:11:46.599741 (+ 10024us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:46.599829 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:46.599863 (+    34us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:11:46.600086 (+   223us) tablet.cc:701] Row locks acquired
0709 13:11:46.600105 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:11:46.600271 (+   166us) write_op.cc:270] Start()
0709 13:11:46.600415 (+   144us) write_op.cc:276] Timestamp: P: 1783602706600225 usec, L: 0
0709 13:11:46.600442 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:11:46.601503 (+  1061us) log.cc:844] Serialized 538 byte log entry
0709 13:11:47.286233 (+684730us) op_driver.cc:464] REPLICATION: finished
0709 13:11:47.390513 (+104280us) write_op.cc:301] APPLY: starting
0709 13:11:47.390612 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:47.390717 (+   105us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:47.390860 (+   143us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:47.427035 (+ 36175us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:47.431333 (+  4298us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:11:47.431396 (+    63us) write_op.cc:312] APPLY: finished
0709 13:11:47.446429 (+ 15033us) log.cc:844] Serialized 22 byte log entry
0709 13:11:47.446704 (+   275us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:47.446845 (+   141us) write_op.cc:454] Released schema lock
0709 13:11:47.446912 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:47.447469 (+   557us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:47.447543 (+    74us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":82,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":97315,"apply.run_cpu_time_us":3093,"apply.run_wall_time_us":56901,"num_ops":1,"prepare.queue_time_us":160616,"prepare.run_cpu_time_us":18880,"prepare.run_wall_time_us":287228,"raft.queue_time_us":157838,"raft.run_cpu_time_us":47268,"raft.run_wall_time_us":54090,"replication_time_us":685605,"thread_start_us":349460,"threads_started":4,"wal-append.queue_time_us":130202}]]}
I20260709 13:11:47.624455 30385 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:47.627441 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:47.565114 29449 raft_consensus.cc:1275] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:11:47.556533 30593 log.cc:927] Time spent T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:11:47.629709 29276 catalog_manager.cc:5697] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 1 to 2, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 2 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:47.638703 29419 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:47.639762 29276 catalog_manager.cc:5697] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 1 to 2, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 2 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:47.642093 29276 catalog_manager.cc:5697] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 1 to 2, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 2 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:47.645696 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 157719us
I20260709 13:11:47.647051 29346 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:47.555658 30560 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:47.561813 30429 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:47.652802 29419 leader_election.cc:400] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 2. Current term is 3.
I20260709 13:11:47.655854 29419 leader_election.cc:403] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:47.656174 29421 leader_election.cc:400] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 2. Current term is 3.
I20260709 13:11:47.656523 29421 leader_election.cc:403] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:11:47.646869 29276 catalog_manager.cc:5697] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 1 to 2, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 2 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:47.534637 30567 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:47.560672 30562 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:47.531306 30511 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:47.516242 30387 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:47.666647 29419 leader_election.cc:400] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 2. Current term is 3.
I20260709 13:11:47.658605 29276 catalog_manager.cc:5697] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 1 to 2, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 2 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:47.533766 30428 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:47.675683 29276 catalog_manager.cc:5697] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 1 to 2, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 2 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:47.557051 30540 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:47.669734 29448 raft_consensus.cc:1275] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:47.663559 30595 raft_consensus.cc:2804] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:47.679637 29276 catalog_manager.cc:5697] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 1 to 2, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 2 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:47.668279 29419 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:47.670204 30501 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 2. Current term is 3.
I20260709 13:11:47.652774 30514 raft_consensus.cc:2749] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:47.665189 30551 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:47.686947 29419 leader_election.cc:400] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 2. Current term is 3.
I20260709 13:11:47.672330 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:47.694396 29449 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:11:47.694839 29419 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:11:47.686576 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 162916us
I20260709 13:11:47.685117 29276 catalog_manager.cc:5697] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 1 to 2, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 2 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:47.705137 29421 leader_election.cc:400] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 2. Current term is 3.
I20260709 13:11:47.706431 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:47.707322 29521 raft_consensus.cc:2393] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 2: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:11:47.709177 29419 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:47.714395 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:47.687538 30595 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.705586 29276 catalog_manager.cc:5697] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 1 to 2, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 2 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:47.707054 29421 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:47.720924 29419 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:47.729660 29421 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:11:47.731168 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:47.732218 29449 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:11:47.732611 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:47.733036 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:47.733475 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:47.722687 29276 catalog_manager.cc:5697] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 1 to 2, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 2 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:47.737826 29276 catalog_manager.cc:5697] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 1 to 2, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 2 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:47.739356 29276 catalog_manager.cc:5697] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 1 to 2, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 2 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:47.741796 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:47.742069 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:47.734990 30514 consensus_queue.cc:1059] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:11:47.772274 30524 consensus_queue.cc:1048] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:11:47.760509 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:47.771003 29495 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:47.779206 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:47.780228 30485 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:47.780756 30485 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.780998 29448 raft_consensus.cc:1275] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:47.781209 30485 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:47.769534 29523 raft_consensus.cc:2468] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 2.
I20260709 13:11:47.728754 30595 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:47.783950 29495 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:47.759941 30540 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:47.716454 30501 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:47.771342 30444 consensus_queue.cc:1048] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:11:47.766412 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:47.790102 29495 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:47.720686 30520 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:47.748781 29276 catalog_manager.cc:5697] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 1 to 2, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 2 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:47.809614 30423 consensus_queue.cc:1059] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:47.810986 30507 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:47.811215 30444 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:47.811718 30444 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:47.811527 30507 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:47.812839 30563 consensus_queue.cc:1048] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:47.812400 30444 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:47.813879 30507 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:47.820930 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:47.822005 29378 raft_consensus.cc:2368] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 3. Current term is 4.
I20260709 13:11:47.823413 29377 raft_consensus.cc:1240] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:47.827878 29378 raft_consensus.cc:1240] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:47.829525 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:47.821384 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:47.833046 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:47.833221 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:47.833899 29381 raft_consensus.cc:2393] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 2: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:47.834625 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:47.835301 29381 raft_consensus.cc:2393] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 2: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:47.836256 29380 raft_consensus.cc:1275] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:11:47.836222 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 100811us
I20260709 13:11:47.837556 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:47.733662 30513 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:47.734144 30460 raft_consensus.cc:2749] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:47.845736 29378 raft_consensus.cc:2393] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 3: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:47.828907 29276 catalog_manager.cc:5697] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 1 to 2, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 2 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:47.840693 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:47.826068 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:47.848125 29381 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:47.848459 29377 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
I20260709 13:11:47.850786 29276 catalog_manager.cc:5697] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 1 to 2, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 2 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:47.771308 30562 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:47.762501 30511 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:47.764707 30385 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:47.770337 30387 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:47.761605 30428 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:47.788262 30501 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:47.729709 30580 consensus_queue.cc:1048] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.119s
I20260709 13:11:47.811409 30423 raft_consensus.cc:3055] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:47.771873 30491 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:47.863814 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:47.940155 29380 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
I20260709 13:11:47.864684 29377 raft_consensus.cc:1275] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:11:47.865904 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:47.853420 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:47.879578 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:47.881628 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:11:47.948212 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 216818us
I20260709 13:11:47.897083 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:47.914660 29381 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:11:47.950320 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:47.841502 30363 raft_consensus.cc:2749] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:47.952234 29421 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:47.959051 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:47.933939 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:47.936673 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:47.960368 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:47.760509 30599 consensus_queue.cc:1059] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.130s
I20260709 13:11:47.945348 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:47.969769 29526 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:47.946745 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:11:47.970151 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 152573us
I20260709 13:11:47.752264 30581 consensus_queue.cc:1059] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.104s
W20260709 13:11:47.952292 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:47.953015 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 232170us
I20260709 13:11:48.110821 29419 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:47.961398 29381 raft_consensus.cc:2393] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 3: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:48.113668 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:47.889909 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:48.117220 29373 raft_consensus.cc:1240] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:11:47.948861 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:48.121294 29375 raft_consensus.cc:1240] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:11:48.118918 29378 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
I20260709 13:11:47.968559 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:48.135164 29377 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 2.
I20260709 13:11:47.970974 29495 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:47.939438 30423 raft_consensus.cc:740] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:47.858954 30405 consensus_queue.cc:1048] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.096s
I20260709 13:11:47.960484 30524 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:48.083652 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 112880us
I20260709 13:11:48.112195 29419 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:47.965518 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:48.115168 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:48.088877 30460 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:48.084575 29376 raft_consensus.cc:1240] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: []
W20260709 13:11:48.136550 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 165709us
I20260709 13:11:48.138491 29421 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:48.145330 29381 raft_consensus.cc:2393] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 3: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:48.151330 29381 raft_consensus.cc:1240] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 1. Current term is 2. Ops: []
W20260709 13:11:48.156144 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 44049.6us
I20260709 13:11:48.157029 29419 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:48.157950 29381 raft_consensus.cc:1240] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:48.123440 29375 raft_consensus.cc:1240] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:11:48.158726 29419 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:48.165369 29421 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:48.166069 29381 raft_consensus.cc:1240] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:48.137465 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:48.108700 30520 consensus_queue.cc:1059] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:11:48.168339 29381 raft_consensus.cc:1275] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:48.176378 29524 raft_consensus.cc:1275] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:48.147883 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:48.133544 30485 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:48.162998 30460 raft_consensus.cc:697] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 3 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:48.143818 30514 consensus_queue.cc:1059] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:11:48.162446 30607 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:48.216250 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 50979.8us
I20260709 13:11:48.154991 30524 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:48.235373 29421 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:48.240409 29530 raft_consensus.cc:2368] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 2. Current term is 3.
W20260709 13:11:48.248504 30605 log.cc:927] Time spent T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
W20260709 13:11:48.248762 30602 log.cc:927] Time spent T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
W20260709 13:11:48.250317 30606 log.cc:927] Time spent T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.296s	user 0.000s	sys 0.000s
I20260709 13:11:48.242561 30622 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:48.252068 30607 raft_consensus.cc:2749] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:48.253026 30607 raft_consensus.cc:2804] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:48.253490 30607 raft_consensus.cc:697] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 3 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:48.254062 30501 raft_consensus.cc:2749] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:48.254467 30607 consensus_queue.cc:237] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:48.256858 30600 log.cc:927] Time spent T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.308s	user 0.003s	sys 0.000s
W20260709 13:11:48.257334 30604 log.cc:927] Time spent T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
W20260709 13:11:48.258157 30579 consensus_meta.cc:287] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.737s	user 0.015s	sys 0.000s
I20260709 13:11:48.258617 30579 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:48.259162 30540 raft_consensus.cc:3055] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:48.259554 29454 raft_consensus.cc:1240] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:48.211622 30611 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:48.265059 29380 raft_consensus.cc:2393] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 3: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:48.212829 30596 consensus_queue.cc:1048] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:11:48.274488 30485 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:48.259699 30540 raft_consensus.cc:740] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:48.292830 30540 consensus_queue.cc:260] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:48.294783 30540 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:48.290338 29377 raft_consensus.cc:1240] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:11:48.307824 30611 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:48.308635 30611 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:48.309108 30611 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:48.309479 30576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:54234 (request call id 81) took 1680 ms. Trace:
I20260709 13:11:48.254084 29379 raft_consensus.cc:1240] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:48.310004 30576 rpcz_store.cc:276] 0709 13:11:46.662811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.674122 (+ 11311us) service_pool.cc:224] Handling call
0709 13:11:47.112261 (+438139us) ts_tablet_manager.cc:934] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2: Initiating tablet copy from peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
0709 13:11:47.448772 (+336511us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:11:47.832164 (+383392us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:47.855078 (+ 22914us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:11:48.308476 (+453398us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:11:48.308859 (+   383us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:48.309322 (+   463us) ts_tablet_manager.cc:989] Replica registered.
0709 13:11:48.309402 (+    80us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":26496,"tablet-copy.queue_time_us":263336,"thread_start_us":316225,"threads_started":2}
I20260709 13:11:48.312808 30579 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:48.308125 30513 raft_consensus.cc:3055] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:48.246755 30405 raft_consensus.cc:2804] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:48.324569 30405 raft_consensus.cc:697] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:48.324270 30460 consensus_queue.cc:237] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:48.325806 30405 consensus_queue.cc:237] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:48.315661 30513 raft_consensus.cc:740] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:48.330875 30524 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:11:48.331350 30507 consensus_meta.cc:287] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.517s	user 0.013s	sys 0.000s
I20260709 13:11:48.331845 30507 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:48.334062 30507 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:11:48.271971 30551 consensus_meta.cc:287] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.572s	user 0.008s	sys 0.004s
I20260709 13:11:48.337145 30551 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 2. Current term is 3.
I20260709 13:11:48.240882 30423 consensus_queue.cc:260] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:48.339442 30423 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:48.344707 30580 raft_consensus.cc:3055] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:48.345350 30580 raft_consensus.cc:740] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
W20260709 13:11:48.346822 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 197328us
W20260709 13:11:48.303328 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 68090.3us
I20260709 13:11:48.348109 29527 raft_consensus.cc:1275] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:48.360015 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:48.364823 29344 leader_election.cc:400] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 2. Current term is 3.
I20260709 13:11:48.365165 29344 leader_election.cc:403] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:11:48.366689 30363 consensus_queue.cc:1048] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:48.364535 30507 consensus_queue.cc:1048] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:11:48.373646 29526 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
I20260709 13:11:48.383419 29344 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:48.364215 30576 tablet_copy_client.cc:806] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:48.397994 30576 tablet_copy_client.cc:670] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:48.373270 30551 consensus_queue.cc:1059] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:11:48.401011 30511 raft_consensus.cc:2804] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:48.382236 30596 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:48.371256 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 47299.2us
W20260709 13:11:48.404001 30595 consensus_meta.cc:287] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.619s	user 0.010s	sys 0.004s
I20260709 13:11:48.380649 30610 consensus_queue.cc:1059] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:11:48.398783 30429 consensus_queue.cc:1048] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:11:48.372886 30580 consensus_queue.cc:260] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:11:48.420004 30511 raft_consensus.cc:697] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:48.436581 30511 consensus_queue.cc:237] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:48.425045 30444 consensus_meta.cc:287] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.611s	user 0.011s	sys 0.004s
I20260709 13:11:48.373131 30513 consensus_queue.cc:260] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:48.445948 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 287278us
W20260709 13:11:48.450948 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:48.446882 29419 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:48.458529 29419 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:48.460261 29419 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:48.427300 30616 consensus_queue.cc:1059] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:11:48.444087 30444 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:48.468912 30514 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:48.455556 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 292139us
I20260709 13:11:48.427978 30595 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:48.480064 29419 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:48.490752 29419 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:11:48.491343 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 110121us
W20260709 13:11:48.493634 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:48.488745 29448 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.003s	sys 0.019s
I20260709 13:11:48.483407 30513 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:48.497318 30460 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:48.504648 29419 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:48.507745 29522 raft_consensus.cc:1240] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:48.480406 30607 raft_consensus.cc:2749] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:48.491879 30613 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:48.525620 29419 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:11:48.508082 29448 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.003s	sys 0.019s
I20260709 13:11:48.542850 29419 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:48.546437 30611 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:48.551985 29419 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:48.537918 30520 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:48.564502 30624 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.564675 29374 raft_consensus.cc:1240] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:11:48.540942 29373 raft_consensus.cc:1240] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:11:48.573325 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 77341.4us
I20260709 13:11:48.570012 29419 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:48.575949 29419 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:48.559037 30608 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:48.555683 30613 raft_consensus.cc:2749] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:48.582221 29419 leader_election.cc:400] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 2. Current term is 3.
I20260709 13:11:48.585289 29419 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:48.588035 29419 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:48.560685 30595 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:48.572713 30610 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:48.596300 29377 raft_consensus.cc:1240] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:48.573920 30607 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:11:48.607089 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:48.618360 29419 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:48.590505 30514 raft_consensus.cc:2749] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:48.577916 30630 raft_consensus.cc:2749] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:48.619328 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:11:48.635106 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:48.623077 30613 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:48.637305 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:48.595513 30629 consensus_queue.cc:1059] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 13:11:48.649000 29376 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:48.650028 30611 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:48.577612 30624 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:48.643069 30576 tablet_copy_client.cc:538] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:48.660066 30630 consensus_queue.cc:1059] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:48.662958 30596 raft_consensus.cc:2749] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 2. Current term is 3.
I20260709 13:11:48.666067 30624 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:48.657567 30629 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:48.668757 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:48.669703 29452 raft_consensus.cc:2393] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 3: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:11:48.672441 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:48.673348 29452 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:48.689168 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:48.647246 29375 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:11:48.653501 30514 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:48.705534 29452 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:11:48.710597 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:11:48.731351 30615 log.cc:927] Time spent T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.419s	user 0.004s	sys 0.000s
I20260709 13:11:48.733423 29449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 564) took 1042 ms. Trace:
I20260709 13:11:48.733943 29449 rpcz_store.cc:276] 0709 13:11:47.690736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.833983 (+143247us) service_pool.cc:224] Handling call
0709 13:11:47.888000 (+ 54017us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:47.888486 (+   486us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:47.888528 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:47.889156 (+   628us) log.cc:844] Serialized 26 byte log entry
0709 13:11:48.163956 (+274800us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:48.164011 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:48.164100 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:48.253623 (+ 89523us) spinlock_profiling.cc:243] Waited 5.06 ms on lock 0x7b480012e7d8. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a80cafaa1 00007f6a80ca6b37 00007f6a80ca69ca 00007f6a80d9e26f 00007f6a80d9df37 00007f6a80db255c 00007f6a80db2508 00007f6a80db2488 00007f6a80db2443 00007f6a80db16ec 00007f6a7fcdba96
0709 13:11:48.730160 (+476537us) spinlock_profiling.cc:243] Waited 1.29 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:11:48.733106 (+  2946us) raft_consensus.cc:1685] finished
0709 13:11:48.733137 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:48.733336 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":182330,"raft.run_cpu_time_us":3123,"raft.run_wall_time_us":174462,"spinlock_wait_cycles":14618624,"thread_start_us":203655,"threads_started":1,"wal-append.queue_time_us":343122}
I20260709 13:11:48.743425 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:48.777928 29530 raft_consensus.cc:1275] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:48.794358 30599 consensus_queue.cc:1048] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:48.834636 30540 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:48.844573 30649 log.cc:927] Time spent T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
W20260709 13:11:48.846976 30423 consensus_meta.cc:287] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.507s	user 0.012s	sys 0.002s
W20260709 13:11:48.766587 30631 log.cc:927] Time spent T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:11:48.764751 30520 raft_consensus.cc:2749] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:11:48.844794 30628 log.cc:927] Time spent T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:11:48.850685 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:48.879956 29455 raft_consensus.cc:1240] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:11:48.876185 30599 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:48.851944 30540 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:11:48.898895 30635 log.cc:927] Time spent T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.334s	user 0.000s	sys 0.002s
I20260709 13:11:48.892071 29447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 566) took 1193 ms. Trace:
I20260709 13:11:48.909154 29447 rpcz_store.cc:276] 0709 13:11:47.692429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.252344 (+559915us) service_pool.cc:224] Handling call
0709 13:11:48.252717 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:48.253134 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:48.253168 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:48.253729 (+   561us) log.cc:844] Serialized 26 byte log entry
0709 13:11:48.500776 (+247047us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:48.508293 (+  7517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:48.513371 (+  5078us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:48.875812 (+362441us) raft_consensus.cc:1685] finished
0709 13:11:48.875859 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:48.885396 (+  9537us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":135,"raft.queue_time_us":8891,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":3037,"thread_start_us":231784,"threads_started":1,"wal-append.queue_time_us":465546}
W20260709 13:11:48.923161 30644 log.cc:927] Time spent T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:11:48.891286 30580 raft_consensus.cc:3060] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:48.939900 29448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 563) took 1252 ms. Trace:
I20260709 13:11:48.940577 30520 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:11:48.941270 30520 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:48.940623 29448 rpcz_store.cc:276] 0709 13:11:47.687188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.782911 (+ 95723us) service_pool.cc:224] Handling call
0709 13:11:47.783234 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:47.788597 (+  5363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:47.788631 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:47.789201 (+   570us) log.cc:844] Serialized 26 byte log entry
0709 13:11:48.558704 (+769503us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:48.561063 (+  2359us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:48.571797 (+ 10734us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:48.937226 (+365429us) raft_consensus.cc:1685] finished
0709 13:11:48.939554 (+  2328us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:48.939804 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":166990,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":105735,"thread_start_us":746964,"threads_started":1,"wal-append.queue_time_us":854571}
I20260709 13:11:48.971338 30501 raft_consensus.cc:3055] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:48.972523 30501 raft_consensus.cc:740] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:48.973547 30551 raft_consensus.cc:3055] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:48.974009 30551 raft_consensus.cc:740] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:48.973718 30501 consensus_queue.cc:260] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:48.974921 30551 consensus_queue.cc:260] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:48.975958 30551 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:48.980690 30366 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:48.981410 30366 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:11:48.982414 30363 raft_consensus.cc:3055] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:48.982985 30363 raft_consensus.cc:740] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:48.983189 30540 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:11:48.908049 30599 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:48.984128 30363 consensus_queue.cc:260] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:48.985783 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:11:48.986006 30599 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:48.986482 30158 raft_consensus.cc:2468] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
I20260709 13:11:48.987084 30520 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:11:48.988409 29450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 569) took 1269 ms. Trace:
I20260709 13:11:48.989094 29344 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:11:48.988873 29450 rpcz_store.cc:276] 0709 13:11:47.719197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.260310 (+541113us) service_pool.cc:224] Handling call
0709 13:11:48.260657 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:48.261014 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:48.261045 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:48.261572 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 13:11:48.313125 (+ 51553us) spinlock_profiling.cc:243] Waited 24.5 ms on lock 0x7b480012e7d8. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a80cafaa1 00007f6a80ca6b37 00007f6a80ca69ca 00007f6a80d9e26f 00007f6a80d9df37 00007f6a80db255c 00007f6a80db2508 00007f6a80db2488 00007f6a80db2443 00007f6a80db16ec 00007f6a7fcdba96
0709 13:11:48.484132 (+171007us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:48.484199 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:48.484307 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:48.898081 (+413774us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:11:48.988146 (+ 90065us) raft_consensus.cc:1685] finished
0709 13:11:48.988171 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:48.988322 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10415,"raft.run_cpu_time_us":1510,"raft.run_wall_time_us":25465,"spinlock_wait_cycles":62460544,"thread_start_us":222103,"threads_started":1,"wal-append.queue_time_us":287429}
W20260709 13:11:48.991319 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:48.991899 30366 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:48.992515 30366 raft_consensus.cc:2804] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:48.992955 30366 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:48.993379 30366 raft_consensus.cc:3060] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:48.995342 30576 tablet_bootstrap.cc:492] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap starting.
I20260709 13:11:49.001395 30444 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:48.975148 30501 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:49.022683 30608 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:49.027376 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:48.987094 29376 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
W20260709 13:11:49.050513 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 427946us
I20260709 13:11:49.053649 29419 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:49.080250 29419 leader_election.cc:400] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 2. Current term is 3.
I20260709 13:11:49.081424 29419 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:49.066380 30366 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:11:49.086175 30625 log.cc:927] Time spent T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.521s	user 0.002s	sys 0.002s
I20260709 13:11:49.088752 30366 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:11:49.090184 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:11:49.090821 29372 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
W20260709 13:11:49.093101 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.106344 30158 raft_consensus.cc:3060] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:49.112663 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.118569 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:49.121004 29378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 551) took 1290 ms. Trace:
I20260709 13:11:49.121567 29378 rpcz_store.cc:276] 0709 13:11:47.830779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.154333 (+323554us) service_pool.cc:224] Handling call
0709 13:11:48.155475 (+  1142us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:48.156010 (+   535us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:48.156054 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:48.157486 (+  1432us) log.cc:844] Serialized 513 byte log entry
0709 13:11:48.514253 (+356767us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:48.514308 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:48.514412 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:49.044706 (+530294us) spinlock_profiling.cc:243] Waited 7.42 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:11:49.094606 (+ 49900us) raft_consensus.cc:1685] finished
0709 13:11:49.094638 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:49.120841 (+ 26203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17074560,"thread_start_us":280384,"threads_started":1,"wal-append.queue_time_us":374513}
I20260709 13:11:49.122836 29419 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:11:49.134042 30158 raft_consensus.cc:2468] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
W20260709 13:11:49.136009 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.084885 30513 raft_consensus.cc:2749] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:49.138409 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 500769us
I20260709 13:11:49.154397 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:11:49.157809 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.139513 29419 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:49.178351 29344 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:11:49.126169 30551 raft_consensus.cc:2749] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:49.185371 29451 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.022s	sys 0.019s
W20260709 13:11:49.188117 29495 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.006s	sys 0.027s
I20260709 13:11:49.124961 30610 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:49.125048 30607 raft_consensus.cc:697] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 3 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
W20260709 13:11:49.197182 29451 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.022s	sys 0.021s
W20260709 13:11:49.198659 29495 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.007s	sys 0.027s
W20260709 13:11:49.199388 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 577945us
I20260709 13:11:49.148574 30520 raft_consensus.cc:2749] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:49.165380 30616 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.003s	sys 0.003s
W20260709 13:11:49.210507 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 71110us
I20260709 13:11:49.126976 30540 consensus_queue.cc:1059] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 13:11:49.187861 30653 raft_consensus.cc:2749] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:49.219302 30563 consensus_queue.cc:1048] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
W20260709 13:11:49.213397 30616 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.004s	sys 0.004s
W20260709 13:11:49.227025 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.217062 30443 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.204813 29373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 548) took 1354 ms. Trace:
I20260709 13:11:49.236507 30443 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:49.208164 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:49.236567 29419 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:11:49.223596 29456 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.019s	sys 0.020s
W20260709 13:11:49.239163 29456 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.019s	sys 0.020s
I20260709 13:11:49.240248 29419 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:11:49.218245 30595 raft_consensus.cc:2804] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:49.212116 30619 consensus_queue.cc:1048] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:11:49.208256 30610 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:49.216941 30581 consensus_queue.cc:1059] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:11:49.253448 29380 raft_consensus.cc:1275] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:49.255452 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:49.267732 29378 raft_consensus.cc:2393] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 3: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:11:49.250303 30614 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.009s	sys 0.027s
I20260709 13:11:49.219444 30444 consensus_queue.cc:1048] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:11:49.240810 30608 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:49.236956 29373 rpcz_store.cc:276] 0709 13:11:47.829671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.118326 (+288655us) service_pool.cc:224] Handling call
0709 13:11:48.118757 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:48.576903 (+458146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.137731 (+560828us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b54003dd454. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:11:49.184306 (+ 46575us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":901524864}
I20260709 13:11:49.271078 30607 consensus_queue.cc:237] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:49.272403 30661 raft_consensus.cc:2749] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:11:49.269963 30614 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.010s	sys 0.027s
I20260709 13:11:49.274901 30443 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:49.274972 30581 raft_consensus.cc:3055] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:49.282027 29495 leader_election.cc:400] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 3. Current term is 4.
I20260709 13:11:49.260349 30595 raft_consensus.cc:697] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:49.285710 29495 leader_election.cc:403] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:11:49.286862 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 46746.2us
I20260709 13:11:49.298951 29419 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:11:49.239272 30643 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.005s	sys 0.033s
W20260709 13:11:49.303387 30643 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.005s	sys 0.034s
W20260709 13:11:49.289176 30511 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.008s	sys 0.023s
I20260709 13:11:49.298079 30581 raft_consensus.cc:740] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:49.304297 30608 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:49.336673 30511 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.008s	sys 0.023s
I20260709 13:11:49.301326 29419 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:11:49.353467 29493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 499735us
I20260709 13:11:49.345569 30563 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 3. Current term is 4.
I20260709 13:11:49.388183 29495 leader_election.cc:304] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:11:49.388394 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 87170.1us
I20260709 13:11:49.395640 29495 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:49.395908 29419 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:49.387633 30501 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.402803 30658 raft_consensus.cc:2749] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:49.407541 29495 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:49.395850 30608 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:49.408964 30423 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.005s	sys 0.012s
I20260709 13:11:49.401806 30616 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:49.397894 30563 consensus_queue.cc:1059] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:11:49.409534 30676 raft_consensus.cc:2749] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:49.410533 30610 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:49.375746 30595 consensus_queue.cc:237] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:49.430483 30158 raft_consensus.cc:1275] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:49.432934 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:49.442086 29528 raft_consensus.cc:2468] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 2.
I20260709 13:11:49.417479 30612 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:49.406361 30501 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:49.425307 29495 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:49.410856 30641 consensus_queue.cc:1048] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
W20260709 13:11:49.452095 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 245362us
I20260709 13:11:49.453889 30654 consensus_queue.cc:1048] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:49.454272 30610 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.430923 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:11:49.474252 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:49.474663 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:49.475345 29455 raft_consensus.cc:2468] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 2.
W20260709 13:11:49.475518 29452 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.000s	sys 0.021s
W20260709 13:11:49.476033 29452 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.000s	sys 0.021s
I20260709 13:11:49.476568 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:49.478812 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:49.409277 30581 consensus_queue.cc:260] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:49.426882 30423 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.006s	sys 0.013s
I20260709 13:11:49.482991 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:49.486891 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:11:49.490248 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 65690.2us
W20260709 13:11:49.456725 30663 log.cc:927] Time spent T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:11:49.493808 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:49.495913 29450 raft_consensus.cc:2393] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 3: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:11:49.494517 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:11:49.499675 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.454810 30610 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:49.505187 29375 raft_consensus.cc:1240] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:11:49.493155 29495 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:49.496475 29456 raft_consensus.cc:2368] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 2. Current term is 3.
I20260709 13:11:49.509258 30640 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:49.509935 30640 raft_consensus.cc:697] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:49.511813 30612 consensus_queue.cc:1048] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:49.512224 29379 raft_consensus.cc:2393] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 3: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:49.527593 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:49.528481 29456 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:49.512406 29495 leader_election.cc:304] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:11:49.538133 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 359903us
I20260709 13:11:49.495333 30423 raft_consensus.cc:2749] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:49.532143 29455 raft_consensus.cc:1275] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:11:49.554759 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:49.569619 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.510952 30640 consensus_queue.cc:237] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:49.528677 30658 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.531913 30540 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:49.582077 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:49.585719 29455 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:49.590488 29456 raft_consensus.cc:2410] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:49.589895 29495 leader_election.cc:304] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:11:49.608247 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.608263 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:49.611254 29450 raft_consensus.cc:2410] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:49.595357 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:49.569099 30637 raft_consensus.cc:2749] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:49.531865 30119 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:11:49.613389 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:49.661289 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:49.587558 30652 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:49.614809 30654 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.668955 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:49.617801 30671 raft_consensus.cc:2749] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:49.671052 29452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 582) took 1064 ms. Trace:
I20260709 13:11:49.701794 29452 rpcz_store.cc:276] 0709 13:11:48.606429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.715776 (+109347us) service_pool.cc:224] Handling call
0709 13:11:48.716129 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:48.716409 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:11:49.481014 (+764605us) log.cc:844] Serialized 14 byte log entry
0709 13:11:49.670724 (+189710us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:49.670777 (+    53us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:49.670814 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.670883 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:49.670997 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17417,"prepare.queue_time_us":784485,"prepare.run_cpu_time_us":4880,"prepare.run_wall_time_us":16653,"raft.queue_time_us":3172,"thread_start_us":913065,"threads_started":2}
I20260709 13:11:49.607745 30423 consensus_queue.cc:1059] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 13:11:49.587487 30658 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:49.594244 30540 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:49.706897 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:49.705948 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:49.670140 29448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 585) took 1028 ms. Trace:
I20260709 13:11:49.707031 29455 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
I20260709 13:11:49.671715 29456 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:49.670289 29495 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:11:49.749333 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 79138.1us
I20260709 13:11:49.671226 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:49.665750 30511 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:49.750662 29452 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
W20260709 13:11:49.700719 30660 log.cc:927] Time spent T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
W20260709 13:11:49.667986 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 167971us
I20260709 13:11:49.752974 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:49.672034 30614 consensus_queue.cc:1059] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.082s
I20260709 13:11:49.754385 30423 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:49.720427 29379 raft_consensus.cc:1240] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:49.671308 30624 raft_consensus.cc:2804] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:49.671360 30676 consensus_queue.cc:1059] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.088s
I20260709 13:11:49.705423 30612 consensus_queue.cc:1059] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:11:49.742677 29447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 584) took 1135 ms. Trace:
I20260709 13:11:49.670043 30637 consensus_queue.cc:1059] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.104s
I20260709 13:11:49.668525 30669 consensus_queue.cc:1059] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.094s
W20260709 13:11:49.762905 30677 log.cc:927] Time spent T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:11:49.762959 29454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 578) took 1161 ms. Trace:
W20260709 13:11:49.763738 30673 log.cc:927] Time spent T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 13:11:49.750092 29495 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:49.659904 30672 consensus_queue.cc:1059] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.146s
I20260709 13:11:49.701445 30654 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:49.761716 30668 log.cc:927] Time spent T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
I20260709 13:11:49.768916 30363 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:49.673955 30652 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:49.768095 30501 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:11:49.788481 30670 log.cc:927] Time spent T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.356s	user 0.000s	sys 0.002s
I20260709 13:11:49.763918 30511 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:49.781116 30650 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:49.853597 30650 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:49.854615 30667 log.cc:927] Time spent T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b: Append to log took a long time: real 0.442s	user 0.000s	sys 0.003s
I20260709 13:11:49.855340 30650 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:11:49.848817 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:49.805215 30624 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:49.856774 30540 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:49.857208 30624 raft_consensus.cc:3060] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:49.857511 30485 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.858119 30485 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:11:49.782471 30423 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:49.848270 30610 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:49.868831 30651 raft_consensus.cc:3055] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:49.869426 30651 raft_consensus.cc:740] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:49.870344 30637 raft_consensus.cc:3055] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:49.870836 30637 raft_consensus.cc:740] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:49.871269 30658 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:49.871837 30637 consensus_queue.cc:260] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:49.868943 30485 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:49.870523 30651 consensus_queue.cc:260] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:49.874614 30651 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:49.859746 30688 log.cc:927] Time spent T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:11:49.851666 30620 raft_consensus.cc:3055] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:49.882225 30620 raft_consensus.cc:740] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:49.873219 30637 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:49.883307 30687 log.cc:927] Time spent T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:11:49.896376 30646 raft_consensus.cc:3055] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:11:49.905311 30690 log.cc:927] Time spent T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.102s	user 0.001s	sys 0.001s
I20260709 13:11:49.906023 30654 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:49.906724 30664 raft_consensus.cc:3055] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:49.906952 30671 raft_consensus.cc:3055] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:49.907167 30664 raft_consensus.cc:740] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:49.907433 30671 raft_consensus.cc:740] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:49.908179 30664 consensus_queue.cc:260] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:49.908285 30671 consensus_queue.cc:260] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:49.909255 30664 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:49.909312 30671 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:49.904258 30646 raft_consensus.cc:740] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:49.913125 30646 consensus_queue.cc:260] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:49.914217 30646 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:49.919039 30652 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:49.980304 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:49.982561 29375 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 2.
I20260709 13:11:49.988121 29372 raft_consensus.cc:1240] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:49.988384 29374 raft_consensus.cc:1275] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:11:50.004695 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.011844 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:50.012563 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:50.013348 29421 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:50.013820 29380 raft_consensus.cc:2393] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 3: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:50.011873 29378 raft_consensus.cc:1275] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:50.019168 29346 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:50.018965 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:50.023288 29372 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 2.
I20260709 13:11:50.027292 29447 rpcz_store.cc:276] 0709 13:11:48.616558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.915697 (+299139us) service_pool.cc:224] Handling call
0709 13:11:48.916269 (+   572us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:48.917102 (+   833us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:11:49.406634 (+489532us) log.cc:844] Serialized 14 byte log entry
0709 13:11:49.665163 (+258529us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:49.667580 (+  2417us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:49.672796 (+  5216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.707182 (+ 34386us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:49.740840 (+ 33658us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12619,"prepare.queue_time_us":587856,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":4247,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":2675,"thread_start_us":689780,"threads_started":2,"wal-append.queue_time_us":350374}
I20260709 13:11:50.034754 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:50.036271 29447 raft_consensus.cc:2376] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3. Re-sending same reply.
I20260709 13:11:50.038707 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:49.747972 29448 rpcz_store.cc:276] 0709 13:11:48.669550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.946980 (+277430us) service_pool.cc:224] Handling call
0709 13:11:48.947405 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:48.947756 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:11:49.399246 (+451490us) log.cc:844] Serialized 14 byte log entry
0709 13:11:49.610237 (+210991us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:49.618905 (+  8668us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:49.628291 (+  9386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.660177 (+ 31886us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:49.667830 (+  7653us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5777,"prepare.queue_time_us":557456,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":20947,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":11916,"spinlock_wait_cycles":33536,"thread_start_us":622631,"threads_started":2,"wal-append.queue_time_us":360692}
I20260709 13:11:49.765220 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:50.043416 29449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 583) took 1436 ms. Trace:
I20260709 13:11:50.044811 29453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 574) took 1446 ms. Trace:
I20260709 13:11:50.043421 29451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 576) took 1442 ms. Trace:
I20260709 13:11:50.043907 29454 rpcz_store.cc:276] 0709 13:11:48.601646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.602793 (+  1147us) service_pool.cc:224] Handling call
0709 13:11:48.603429 (+   636us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:49.094178 (+490749us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:49.094214 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:49.125629 (+ 31415us) log.cc:844] Serialized 26 byte log entry
0709 13:11:49.475331 (+349702us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:49.475368 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.475444 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:49.762691 (+287247us) raft_consensus.cc:1685] finished
0709 13:11:49.762715 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:49.762890 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5173,"raft.queue_time_us":52675,"raft.run_cpu_time_us":525,"raft.run_wall_time_us":511,"thread_start_us":745384,"threads_started":2,"wal-append.queue_time_us":517934}
I20260709 13:11:49.768801 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:49.768214 29456 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
W20260709 13:11:50.048467 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 298223us
W20260709 13:11:50.053339 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:50.055004 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:50.057289 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.069176 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:50.095655 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:50.070375 29452 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:50.070639 29449 rpcz_store.cc:276] 0709 13:11:48.607110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.844970 (+237860us) service_pool.cc:224] Handling call
0709 13:11:48.845682 (+   712us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:48.846081 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:48.846113 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:48.847124 (+  1011us) log.cc:844] Serialized 572 byte log entry
0709 13:11:49.250000 (+402876us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:49.250119 (+   119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.250198 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:50.042687 (+792489us) raft_consensus.cc:1685] finished
0709 13:11:50.042733 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:50.043117 (+   384us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":402557,"threads_started":1,"wal-append.queue_time_us":585104}
I20260709 13:11:50.070793 29453 rpcz_store.cc:276] 0709 13:11:48.598095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.598287 (+   192us) service_pool.cc:224] Handling call
0709 13:11:48.607798 (+  9511us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:48.620359 (+ 12561us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:48.620391 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:48.625662 (+  5271us) log.cc:844] Serialized 26 byte log entry
0709 13:11:49.055719 (+430057us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:49.055769 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.055851 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:50.044234 (+988383us) raft_consensus.cc:1685] finished
0709 13:11:50.044276 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:50.044543 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":47955,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":164,"thread_start_us":416236,"threads_started":2,"wal-append.queue_time_us":746624}
I20260709 13:11:50.070963 29451 rpcz_store.cc:276] 0709 13:11:48.600609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.600761 (+   152us) service_pool.cc:224] Handling call
0709 13:11:48.601095 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:49.198008 (+596913us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:49.198049 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:49.205155 (+  7106us) log.cc:844] Serialized 26 byte log entry
0709 13:11:49.587204 (+382049us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:49.587267 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.589211 (+  1944us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:50.042687 (+453476us) raft_consensus.cc:1685] finished
0709 13:11:50.042732 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:50.043117 (+   385us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6894,"raft.queue_time_us":54998,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"thread_start_us":933810,"threads_started":2,"wal-append.queue_time_us":474199}
I20260709 13:11:50.071473 29524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 1351) took 1330 ms. Trace:
I20260709 13:11:50.119640 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:50.103624 29419 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:11:50.124153 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.072378 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:50.124797 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:50.125912 29454 raft_consensus.cc:2368] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 2. Current term is 3.
I20260709 13:11:50.125957 29451 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:50.127218 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:50.128624 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:50.129364 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:50.129772 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:50.130748 29454 raft_consensus.cc:2410] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:50.130813 29453 raft_consensus.cc:2410] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:50.074709 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:50.077505 29450 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
I20260709 13:11:50.122082 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:50.116079 29524 rpcz_store.cc:276] 0709 13:11:48.741310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.741503 (+   193us) service_pool.cc:224] Handling call
0709 13:11:48.847360 (+105857us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:48.847748 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:48.847787 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:48.848251 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 13:11:49.351913 (+503662us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:49.351992 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:49.352138 (+   146us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:50.059238 (+707100us) raft_consensus.cc:1685] finished
0709 13:11:50.059288 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:50.071147 (+ 11859us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":67377,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":143,"thread_start_us":472856,"threads_started":1,"wal-append.queue_time_us":633571}
I20260709 13:11:50.132658 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:50.078356 29495 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:11:50.134838 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 56838.3us
I20260709 13:11:50.136101 29450 raft_consensus.cc:1275] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:50.136322 29448 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:50.076874 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:50.065164 30121 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:50.139708 29447 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:50.142172 30520 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:50.143078 30520 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:49.879827 30423 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:50.145884 30366 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.148039 30501 consensus_queue.cc:1059] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:50.148773 30485 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:50.153258 30610 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:50.154083 30610 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:50.157437 29456 raft_consensus.cc:1275] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:11:50.158994 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 75897.2us
I20260709 13:11:50.161943 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:50.146931 30366 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:50.177222 29452 raft_consensus.cc:2410] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:50.148041 30428 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.154582 30610 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:50.188122 30658 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.188902 30658 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:50.163288 30607 consensus_queue.cc:1048] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:11:50.162957 30599 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:11:50.206038 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 68758.3us
W20260709 13:11:50.207227 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 115387us
I20260709 13:11:50.230093 30654 consensus_queue.cc:1048] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:11:50.234571 30443 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:50.235949 30443 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:50.237772 30550 raft_consensus.cc:2749] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:50.241254 30656 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:50.233222 30652 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.258910 30669 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.260392 30669 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:50.259053 30659 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:50.268110 30428 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:50.162545 30620 consensus_queue.cc:260] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:50.276180 29455 raft_consensus.cc:1275] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:50.278123 30620 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:50.279385 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 260587us
I20260709 13:11:50.223658 30485 raft_consensus.cc:697] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:50.293109 30485 consensus_queue.cc:237] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:50.295838 30664 consensus_queue.cc:1059] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:50.297554 30664 raft_consensus.cc:3055] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:50.298099 30664 raft_consensus.cc:740] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:50.312562 30676 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:50.313644 30676 raft_consensus.cc:697] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:50.333175 30366 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:50.334775 30562 raft_consensus.cc:3055] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:50.335623 30562 raft_consensus.cc:740] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:50.337779 30563 raft_consensus.cc:3055] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:50.338516 30563 raft_consensus.cc:740] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:50.337617 30562 consensus_queue.cc:260] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:50.344437 29525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 1361) took 1535 ms. Trace:
I20260709 13:11:50.344712 30563 consensus_queue.cc:260] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:50.346140 30563 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:50.345045 29525 rpcz_store.cc:276] 0709 13:11:48.808925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.811103 (+  2178us) service_pool.cc:224] Handling call
0709 13:11:48.811698 (+   595us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:49.304277 (+492579us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:49.304315 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:50.052309 (+747994us) spinlock_profiling.cc:243] Waited 23.3 ms on lock 0x7b2c001231f8. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7a67fa11 00007f6a7a68f372 00007f6a7bdc1a01 00007f6a7bd8643a 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2
0709 13:11:50.053621 (+  1312us) log.cc:844] Serialized 26 byte log entry
0709 13:11:50.184157 (+130536us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:50.184229 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:50.184344 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:50.343752 (+159408us) raft_consensus.cc:1685] finished
0709 13:11:50.343773 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:50.344196 (+   423us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":85063,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":17967,"spinlock_wait_cycles":53492480,"thread_start_us":621419,"threads_started":2,"wal-append.queue_time_us":285942}
I20260709 13:11:50.364593 29449 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
I20260709 13:11:50.319648 30520 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:50.373601 30669 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:11:50.379827 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:50.411424 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.416510 29346 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:11:50.424836 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 60840.7us
I20260709 13:11:50.425233 30641 raft_consensus.cc:3055] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:50.426143 30641 raft_consensus.cc:740] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:50.428247 30507 raft_consensus.cc:3055] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:11:50.428524 30363 consensus_meta.cc:287] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.578s	user 0.009s	sys 0.010s
I20260709 13:11:50.428593 30443 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:50.430382 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:50.431268 29450 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:50.433557 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:50.435199 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:50.436267 29453 raft_consensus.cc:2410] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:50.421293 30652 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:50.440428 30581 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:50.440681 29455 raft_consensus.cc:2376] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2. Re-sending same reply.
I20260709 13:11:50.440996 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:50.442567 30652 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:11:50.427277 30608 consensus_meta.cc:287] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 1.005s	user 0.010s	sys 0.011s
I20260709 13:11:50.443183 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:50.443809 30608 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:50.442961 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:50.446487 29456 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:50.447786 30562 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:50.424968 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 360792us
I20260709 13:11:50.452836 30608 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:50.243233 30656 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:50.458407 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:50.458467 30656 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:50.454399 30608 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:50.464115 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:50.459834 29455 raft_consensus.cc:2410] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:50.315393 30676 consensus_queue.cc:237] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:50.466364 30641 consensus_queue.cc:260] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:50.469039 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:50.470870 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:50.475200 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:50.475616 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:50.484865 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:11:50.476620 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 50763.8us
W20260709 13:11:50.433560 30624 consensus_meta.cc:287] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent flushing consensus metadata: real 0.575s	user 0.009s	sys 0.005s
I20260709 13:11:50.489727 30624 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:50.492970 30703 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:11:50.493666 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.495538 29454 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:50.497025 29450 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
W20260709 13:11:50.466012 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 383068us
W20260709 13:11:50.500962 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.501111 29455 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:50.483789 29456 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
I20260709 13:11:50.503925 29451 raft_consensus.cc:2410] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:50.474591 30661 raft_consensus.cc:3055] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:50.497578 30624 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 3 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:50.474682 30641 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:50.359283 30664 consensus_queue.cc:260] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:50.511627 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.467618 30507 raft_consensus.cc:740] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:50.512876 29452 raft_consensus.cc:2376] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3. Re-sending same reply.
I20260709 13:11:50.501842 29453 raft_consensus.cc:2376] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2. Re-sending same reply.
I20260709 13:11:50.473780 30658 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:50.522457 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:50.522712 29449 raft_consensus.cc:2393] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 2: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:11:50.524628 29456 raft_consensus.cc:1240] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:50.505504 30659 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.509102 30661 raft_consensus.cc:740] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:50.508502 30511 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:50.520092 30650 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.533401 30650 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:50.534119 29524 raft_consensus.cc:3060] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:50.531247 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:11:50.537396 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.541210 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:50.542184 29380 raft_consensus.cc:2468] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 1.
W20260709 13:11:50.544134 30637 consensus_meta.cc:287] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.621s	user 0.007s	sys 0.010s
I20260709 13:11:50.547631 30659 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:50.552063 29451 raft_consensus.cc:1240] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:50.558207 30423 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:50.561725 30661 consensus_queue.cc:260] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:50.562668 29447 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
I20260709 13:11:50.533452 30428 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:50.567687 30576 tablet_bootstrap.cc:492] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:11:50.569067 30650 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:50.570585 30659 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:50.571388 30507 consensus_queue.cc:260] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:50.578073 30610 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:50.580004 29454 raft_consensus.cc:2410] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:50.580883 30664 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:50.588068 30157 raft_consensus.cc:1240] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:50.590318 29450 raft_consensus.cc:1240] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:50.593549 30661 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:50.591977 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:50.592209 29455 raft_consensus.cc:2410] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:50.525777 29448 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
I20260709 13:11:50.598178 29449 raft_consensus.cc:1240] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:50.600785 29524 raft_consensus.cc:2468] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 3.
I20260709 13:11:50.607465 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:50.622753 29455 raft_consensus.cc:1240] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:50.624579 29452 raft_consensus.cc:1240] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 1. Current term is 2. Ops: []
W20260709 13:11:50.609413 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.603385 30608 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:11:50.629244 30646 consensus_meta.cc:287] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.714s	user 0.011s	sys 0.005s
I20260709 13:11:50.632221 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:50.632848 30563 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:50.616566 30428 consensus_queue.cc:1048] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:11:50.636299 29453 raft_consensus.cc:1240] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:50.626875 30507 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:50.635207 30423 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:50.605363 30650 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:11:50.671754 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.640888 29448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45798 (request call id 1226) took 1045 ms. Trace:
I20260709 13:11:50.674472 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:50.677402 29450 raft_consensus.cc:2468] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
W20260709 13:11:50.679066 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:50.716099 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 72849.7us
I20260709 13:11:50.710867 29524 raft_consensus.cc:1240] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 1. Current term is 2. Ops: []
W20260709 13:11:50.699224 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:50.718739 30667 log.cc:927] Time spent T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b: Append to log took a long time: real 0.086s	user 0.000s	sys 0.002s
I20260709 13:11:50.719564 29450 raft_consensus.cc:1240] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:50.699700 29375 raft_consensus.cc:1240] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:50.719103 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:50.678575 29447 raft_consensus.cc:3060] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:50.739938 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.689946 30576 tablet_bootstrap.cc:492] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap complete.
I20260709 13:11:50.678874 30608 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.780164 29525 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
I20260709 13:11:50.696802 30599 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.673887 29448 rpcz_store.cc:276] 0709 13:11:49.595769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.094968 (+499199us) service_pool.cc:224] Handling call
0709 13:11:50.626166 (+531198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:50.698513 30658 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:50.690846 30659 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.688977 29376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52172 (request call id 719) took 1104 ms. Trace:
I20260709 13:11:50.707119 30607 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:50.799155 30501 consensus_queue.cc:1059] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:11:50.689978 30121 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:11:50.807721 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.695870 30429 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:50.706663 30562 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.810669 29346 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:50.683348 30119 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:11:50.712157 30563 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:50.707531 30650 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:50.805212 30608 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:50.817917 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:50.821584 29455 raft_consensus.cc:2393] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 3: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:11:50.818989 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:50.808403 30676 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:50.802911 30599 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:50.820861 30624 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:50.827333 30630 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.822826 30443 raft_consensus.cc:2804] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:11:50.836580 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.815102 30607 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:50.821188 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 143440us
I20260709 13:11:50.838333 30610 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:50.811453 30659 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:50.843259 30630 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:50.840601 30485 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:11:50.844460 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.823323 30562 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:50.823477 30429 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:11:50.847530 30686 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:50.840116 30443 raft_consensus.cc:697] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:11:50.829995 30576 ts_tablet_manager.cc:1403] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent bootstrapping tablet: real 1.835s	user 0.040s	sys 0.029s
I20260709 13:11:50.813369 30658 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:50.829983 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 140138us
I20260709 13:11:50.828446 30581 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:50.839656 30676 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:50.870378 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:50.871735 29346 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:50.876150 30686 raft_consensus.cc:697] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:11:50.894021 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.897517 29527 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
I20260709 13:11:50.889297 30669 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:50.806233 29376 rpcz_store.cc:276] 0709 13:11:49.568899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:49.570836 (+  1937us) service_pool.cc:224] Handling call
0709 13:11:49.626400 (+ 55564us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:49.719260 (+ 92860us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:49.738631 (+ 19371us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:49.981997 (+243366us) log.cc:844] Serialized 26 byte log entry
0709 13:11:50.233213 (+251216us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:50.233353 (+   140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:50.233533 (+   180us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:50.641240 (+407707us) raft_consensus.cc:1685] finished
0709 13:11:50.641279 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:50.672811 (+ 31532us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29879,"raft.queue_time_us":2388,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":19953,"thread_start_us":222581,"threads_started":1,"wal-append.queue_time_us":642280}
I20260709 13:11:50.912479 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:50.913106 29524 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
I20260709 13:11:50.886210 30485 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:50.899075 30501 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.903000 30428 raft_consensus.cc:2749] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:50.909441 30669 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:50.918062 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 55335.2us
I20260709 13:11:50.904078 30706 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.891844 30581 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:50.901543 30676 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:50.922492 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:50.919387 30610 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:50.909793 30443 consensus_queue.cc:237] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:50.924135 30610 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:50.926518 30610 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:50.908196 30607 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:50.904045 30423 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:50.894032 30686 consensus_queue.cc:237] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:50.948522 29346 leader_election.cc:400] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 2. Current term is 3.
I20260709 13:11:50.948668 29524 raft_consensus.cc:1240] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:11:50.930579 30650 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:50.935760 30563 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:50.953344 30707 raft_consensus.cc:3055] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:50.953490 30630 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:11:50.958369 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.947382 30423 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:50.945580 30706 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:50.964424 29344 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:50.944123 30501 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:50.960638 30707 raft_consensus.cc:740] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:50.976903 29344 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:50.979553 29344 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:11:51.001263 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.009264 29527 raft_consensus.cc:1275] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:51.012419 30702 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:51.015195 29530 raft_consensus.cc:1240] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:51.008011 30511 raft_consensus.cc:2804] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:51.016069 30511 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:51.016215 30501 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:51.016683 30511 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:51.018551 30706 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:11:51.019415 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 92024.5us
I20260709 13:11:51.000684 30703 raft_consensus.cc:2804] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:51.021659 30703 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.022060 30703 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:51.021883 29346 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:51.024629 30630 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:51.025281 30630 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.026247 30597 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:51.027421 30607 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:51.028100 30607 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.015278 30702 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.031991 30562 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:51.032361 30702 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:51.027698 30630 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:11:51.035240 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:51.038264 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.991283 30658 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:51.039618 30429 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:51.044483 30630 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:51.051427 30707 consensus_queue.cc:260] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:51.051630 30630 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.052641 30707 raft_consensus.cc:3060] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:51.045307 30485 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:51.056614 30423 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:51.061245 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:51.039763 30562 consensus_queue.cc:1048] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:11:51.079030 30158 raft_consensus.cc:1240] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 4. Current term is 5. Ops: [2.5-4.6]
I20260709 13:11:51.088667 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:51.066818 30630 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:11:51.096371 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.066285 29447 raft_consensus.cc:2468] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 3.
I20260709 13:11:51.098954 30607 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:51.100642 30599 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:51.097828 30501 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:51.104035 30501 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:51.108959 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 100330us
W20260709 13:11:51.113513 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.115899 30501 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:51.097659 30581 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:51.124636 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:11:51.128646 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 53179us
I20260709 13:11:51.112061 30630 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:51.130712 30630 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:51.131608 30715 log.cc:927] Time spent T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.442s	user 0.006s	sys 0.003s
I20260709 13:11:51.133888 30630 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:51.135756 29375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52172 (request call id 727) took 1124 ms. Trace:
I20260709 13:11:51.136227 29375 rpcz_store.cc:276] 0709 13:11:50.011560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.017749 (+  6189us) service_pool.cc:224] Handling call
0709 13:11:50.021182 (+  3433us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b5800010298. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61b71 00007f6a78c61a22 00007f6a81b7ac09 00007f6a80cd4ee0 00007f6a80d9e0ab 00007f6a80d9e131 00007f6a80d5ffc0 00007f6a80d4a929 00007f6a80d4a3d2 00007f6a7a2c1bd4
0709 13:11:50.021752 (+   570us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:50.797506 (+775754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:51.127333 (+329827us) spinlock_profiling.cc:243] Waited 660 ms on lock 0x7b5400190d54. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:11:51.135675 (+  8342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1521133824}
I20260709 13:11:51.140658 30659 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:51.141294 30659 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:51.141801 30659 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.118506 30658 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:51.125761 29525 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 2.
W20260709 13:11:51.137496 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.137027 29346 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:51.144706 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:51.151400 29526 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
I20260709 13:11:51.154237 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:51.154750 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:51.155840 29528 raft_consensus.cc:2468] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
I20260709 13:11:51.157037 30595 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:51.160526 29346 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:51.161962 30429 consensus_queue.cc:1048] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:51.164716 30562 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:51.167766 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:51.168515 29530 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
I20260709 13:11:51.169307 29529 raft_consensus.cc:1275] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:51.169749 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:51.170583 29521 raft_consensus.cc:2393] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 2: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:11:51.171036 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:51.144189 30658 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.165557 30703 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.175535 30669 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:51.176187 30669 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.176658 30669 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.178707 30669 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:11:51.138587 30664 consensus_meta.cc:287] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.534s	user 0.014s	sys 0.000s
I20260709 13:11:51.181593 30608 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:51.182268 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:51.169613 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:51.186460 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:51.186587 29344 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:51.187163 29525 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
W20260709 13:11:51.138377 30661 consensus_meta.cc:287] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.521s	user 0.012s	sys 0.001s
I20260709 13:11:51.182101 30562 consensus_queue.cc:1048] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:11:51.188431 29526 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 2.
I20260709 13:11:51.188470 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:11:51.189210 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.164637 30576 raft_consensus.cc:359] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.182225 30608 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.193114 30608 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.194432 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:51.199815 29344 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:51.195583 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:51.203869 30597 raft_consensus.cc:2804] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:51.204340 30597 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.204744 30597 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:51.205578 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:51.185169 30658 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:51.208598 29522 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
I20260709 13:11:51.194983 30429 raft_consensus.cc:2804] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:51.213764 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:51.211459 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:51.214692 29524 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
I20260709 13:11:51.215906 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:51.216503 29526 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
I20260709 13:11:51.213871 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:51.218557 29527 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
I20260709 13:11:51.192657 30511 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.220160 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:51.231941 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:51.232347 29525 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:51.233246 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:51.234642 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:51.222200 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:51.224833 30608 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:51.236155 29526 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:51.237088 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:51.238742 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:51.225487 29277 catalog_manager.cc:5697] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 2 to 3, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132). New cstate: current_term: 3 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:51.227265 29346 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:51.245601 30720 raft_consensus.cc:2804] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:51.245999 30658 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.246234 30720 raft_consensus.cc:697] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:51.246672 30658 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:51.247944 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 55450.5us
I20260709 13:11:51.248723 29346 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:51.249748 30596 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:51.250303 29346 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:51.250512 30658 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:51.228690 30158 raft_consensus.cc:1275] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:51.214030 30429 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:51.245631 29277 catalog_manager.cc:5697] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 1 to 3, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132). New cstate: current_term: 3 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:51.252354 30429 raft_consensus.cc:3060] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:51.254251 30658 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:51.250952 30511 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:51.255153 29529 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 1.
I20260709 13:11:51.254932 30658 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:11:51.256196 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.247295 30720 consensus_queue.cc:237] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.256450 30511 consensus_queue.cc:1048] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:51.259225 29526 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
I20260709 13:11:51.230899 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:51.227005 30659 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:11:51.236204 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:51.268318 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.225144 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:51.226356 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:51.235378 29521 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
I20260709 13:11:51.251159 30596 raft_consensus.cc:2804] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:51.254518 30597 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.260232 29525 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
I20260709 13:11:51.231009 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:51.256228 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:51.272305 29529 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
I20260709 13:11:51.272619 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:51.263881 29346 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:51.262009 29344 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:51.264685 29530 raft_consensus.cc:2393] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 2: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:11:51.265126 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:51.265349 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
W20260709 13:11:51.265718 30579 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.009s	sys 0.010s
I20260709 13:11:51.265833 30658 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:11:51.277200 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:51.216002 30703 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:51.287225 29524 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
W20260709 13:11:51.283515 30579 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.010s	sys 0.010s
I20260709 13:11:51.295006 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:51.283195 30686 raft_consensus.cc:2804] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:51.308784 29526 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
I20260709 13:11:51.313174 29344 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:51.288921 30596 raft_consensus.cc:697] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:11:51.321306 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.315131 29346 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:51.292629 30428 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:51.327906 30595 raft_consensus.cc:2804] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:51.335551 30702 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.337450 30641 consensus_queue.cc:1059] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:51.322556 30686 raft_consensus.cc:697] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:51.339136 30686 consensus_queue.cc:237] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.310143 30576 raft_consensus.cc:740] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Initialized, Role: LEARNER
I20260709 13:11:51.341182 30576 consensus_queue.cc:260] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:11:51.346626 30595 raft_consensus.cc:697] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:51.347959 30595 consensus_queue.cc:237] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.352125 30507 raft_consensus.cc:3055] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:51.352262 30579 raft_consensus.cc:2749] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:51.352931 30507 raft_consensus.cc:740] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:51.353327 29276 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37608 (request call id 149) took 5128 ms. Trace:
W20260709 13:11:51.352362 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 51702.7us
I20260709 13:11:51.359027 30702 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:51.360150 30596 consensus_queue.cc:237] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.356134 29346 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:51.374480 29529 raft_consensus.cc:1275] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:51.379598 30562 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:51.380818 30576 ts_tablet_manager.cc:1434] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent starting tablet: real 0.497s	user 0.009s	sys 0.003s
I20260709 13:11:51.375962 30664 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.381752 30706 consensus_queue.cc:1059] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:51.379693 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:51.392652 29525 raft_consensus.cc:2393] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 3: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:11:51.393309 29495 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:51.393390 30669 consensus_queue.cc:1059] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:51.394276 30485 consensus_queue.cc:1059] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:51.394479 30423 consensus_queue.cc:1059] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:51.395238 30485 raft_consensus.cc:2804] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:51.395470 30423 raft_consensus.cc:3055] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:51.395691 30485 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.395954 30423 raft_consensus.cc:740] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:51.396204 30485 raft_consensus.cc:3060] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:51.396999 29447 raft_consensus.cc:1275] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:11:51.397478 29447 pending_rounds.cc:85] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 1
I20260709 13:11:51.396953 30423 consensus_queue.cc:260] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.397747 29447 pending_rounds.cc:107] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:11:51.398082 29447 raft_consensus.cc:2889] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:51.398486 30423 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:51.398777 29419 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:51.395689 30676 raft_consensus.cc:3055] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:51.399987 30676 raft_consensus.cc:740] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:51.400146 30658 raft_consensus.cc:2749] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:51.400838 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:51.401109 30676 consensus_queue.cc:260] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.401507 29455 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:51.403391 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:51.390520 30641 consensus_queue.cc:1059] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:11:51.405128 30641 raft_consensus.cc:3055] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:51.391394 30664 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.405779 30669 raft_consensus.cc:3055] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:51.406306 30669 raft_consensus.cc:740] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:51.354729 30507 consensus_queue.cc:260] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.407264 30669 consensus_queue.cc:260] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.408931 30669 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:51.409049 30706 raft_consensus.cc:3055] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:51.404218 29448 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:11:51.409488 30706 raft_consensus.cc:740] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:51.410787 30706 consensus_queue.cc:260] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.412222 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:51.413087 29450 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:11:51.353752 29276 rpcz_store.cc:276] 0709 13:11:46.214536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.215095 (+   559us) service_pool.cc:224] Handling call
0709 13:11:51.326792 (+5111697us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:48.490442 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:48.547666 (+ 57224us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:48.547714 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:11:48.547726 (+    12us) tablet.cc:662] Decoding operations
0709 13:11:48.663780 (+116054us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:48.663853 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:48.663886 (+    33us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:11:48.665650 (+  1764us) tablet.cc:701] Row locks acquired
0709 13:11:48.665679 (+    29us) write_op.cc:260] PREPARE: finished
0709 13:11:48.665970 (+   291us) write_op.cc:270] Start()
0709 13:11:48.666135 (+   165us) write_op.cc:276] Timestamp: P: 1783602708665813 usec, L: 0
0709 13:11:48.666170 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:11:48.667060 (+   890us) log.cc:844] Serialized 7245 byte log entry
0709 13:11:49.906736 (+1239676us) op_driver.cc:464] REPLICATION: finished
0709 13:11:50.349024 (+442288us) write_op.cc:301] APPLY: starting
0709 13:11:50.349248 (+   224us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:50.350011 (+   763us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:50.382859 (+ 32848us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:50.629253 (+246394us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:50.629730 (+   477us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 13:11:50.629820 (+    90us) write_op.cc:312] APPLY: finished
0709 13:11:50.630426 (+   606us) log.cc:844] Serialized 124 byte log entry
0709 13:11:50.636875 (+  6449us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:50.637222 (+   347us) write_op.cc:454] Released schema lock
0709 13:11:50.637308 (+    86us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:50.715597 (+ 78289us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:50.715643 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7343,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":441788,"apply.run_cpu_time_us":17456,"apply.run_wall_time_us":329894,"num_ops":18,"prepare.queue_time_us":317242,"prepare.run_cpu_time_us":44881,"prepare.run_wall_time_us":702712,"raft.queue_time_us":49336,"raft.run_cpu_time_us":3748,"raft.run_wall_time_us":302601,"replication_time_us":1240360,"thread_start_us":1093459,"threads_started":4,"wal-append.queue_time_us":688860}]]}
I20260709 13:11:51.412344 30706 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:51.417582 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:51.421550 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:51.425354 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:51.426723 29455 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
I20260709 13:11:51.405706 30641 raft_consensus.cc:740] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
W20260709 13:11:51.446064 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 90000.9us
W20260709 13:11:51.389971 30576 ts_tablet_manager.cc:1467] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2: Tablet startup took 516ms
I20260709 13:11:51.453387 29346 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:11:51.454535 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.456497 29419 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:51.458614 30676 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:51.461971 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.420943 30658 consensus_queue.cc:1059] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:11:51.464301 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:51.450116 30507 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:51.450409 30664 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:51.452164 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:51.468005 29456 raft_consensus.cc:1275] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:51.468715 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:51.469408 29525 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 2.
I20260709 13:11:51.471107 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:51.471735 29526 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:51.472218 29495 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:51.473634 29495 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:51.477742 30646 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:51.478169 30646 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:51.478564 30646 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:51.483669 30581 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:51.484158 30581 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:51.484545 30581 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:51.487082 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.487957 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:51.488678 29456 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:11:51.460063 30705 consensus_queue.cc:1048] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
W20260709 13:11:51.500519 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 53275.6us
I20260709 13:11:51.500934 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:51.499961 29451 raft_consensus.cc:1240] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:51.466754 30659 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:51.504067 29455 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
W20260709 13:11:51.504326 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:51.505378 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 63276.9us
I20260709 13:11:51.505045 30620 raft_consensus.cc:2955] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:51.470587 30597 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:51.480597 29448 raft_consensus.cc:1275] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:51.491276 30658 consensus_queue.cc:1243] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer 71aa3578fd924765ab9ac0729c8d1483 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:11:51.499941 29449 raft_consensus.cc:2955] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:51.513803 29346 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:51.515189 29419 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:51.516453 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:51.501955 30579 raft_consensus.cc:2804] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:51.517163 29495 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:51.532912 29455 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
I20260709 13:11:51.536913 29346 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:51.542930 30710 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:51.543303 29346 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:51.543535 30710 raft_consensus.cc:697] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:51.544487 30686 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:51.545092 30686 raft_consensus.cc:697] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:11:51.545383 30731 log.cc:927] Time spent T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
W20260709 13:11:51.546420 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.545866 30641 consensus_queue.cc:260] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.546190 30686 consensus_queue.cc:237] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.547295 30641 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:51.514635 30429 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:11:51.550015 30429 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:51.550613 29346 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:51.551857 30562 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:51.552047 29346 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:51.485491 30664 consensus_queue.cc:1048] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:11:51.535537 29495 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:51.545131 30671 raft_consensus.cc:2804] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:51.554996 30671 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:51.555441 30671 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:51.555723 30428 raft_consensus.cc:2749] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:51.557401 30579 raft_consensus.cc:697] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:51.536484 30511 raft_consensus.cc:2804] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:51.560329 29495 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:11:51.450959 30576 ts_tablet_manager.cc:1469] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2: Trace:
0709 13:11:46.662811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.674122 (+ 11311us) service_pool.cc:224] Handling call
0709 13:11:47.112261 (+438139us) ts_tablet_manager.cc:934] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2: Initiating tablet copy from peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
0709 13:11:47.448772 (+336511us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:11:47.832164 (+383392us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:47.855078 (+ 22914us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:11:48.308476 (+453398us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:11:48.308859 (+   383us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:48.309322 (+   463us) ts_tablet_manager.cc:989] Replica registered.
0709 13:11:48.309402 (+    80us) inbound_call.cc:177] Queueing success response
0709 13:11:48.994952 (+685550us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:11:50.884235 (+1889283us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:11:51.147538 (+263303us) tablet_replica.cc:261] Starting instrumentation
0709 13:11:51.162120 (+ 14582us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":26496,"mutex_wait_us":3015,"raft.queue_time_us":12443,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":297,"tablet-copy.queue_time_us":263336,"tablet-download-pool.queue_time_us":25933,"tablet-download-pool.run_cpu_time_us":1988,"tablet-download-pool.run_wall_time_us":194143,"thread_start_us":316225,"threads_started":2}
I20260709 13:11:51.570364 29526 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
W20260709 13:11:51.570561 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:51.571478 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.573374 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:51.576294 29344 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:51.577364 30562 raft_consensus.cc:2804] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:51.577462 29495 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:51.577620 30745 consensus_queue.cc:1059] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:51.577944 30562 raft_consensus.cc:697] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:51.579059 30562 consensus_queue.cc:237] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.571982 30710 consensus_queue.cc:237] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.581823 30423 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:51.585480 30423 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:51.585891 30423 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:51.589870 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 80698.1us
I20260709 13:11:51.558887 30579 consensus_queue.cc:237] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.582556 30669 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:51.569214 30664 raft_consensus.cc:2804] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:51.574328 30659 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:51.604593 29421 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:51.574174 30511 raft_consensus.cc:697] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:51.595570 30669 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.612911 30669 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:51.616297 30511 consensus_queue.cc:237] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.569829 30563 consensus_queue.cc:1048] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:11:51.602051 30664 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
W20260709 13:11:51.624876 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 47508.9us
I20260709 13:11:51.626019 29495 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:51.626704 29540 tablet_copy_service.cc:342] P 71aa3578fd924765ab9ac0729c8d1483: Request end of tablet copy session ca041dab9b2f44409ed7bf4c6cf66ab2-eb6a9a102eba49209ddf2bdf286077e8 received from {username='slave'} at 127.0.0.1:53428
I20260709 13:11:51.626875 30676 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:51.627403 30676 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.627941 30676 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:51.625027 30664 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:51.635854 30676 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.637079 30608 raft_consensus.cc:3055] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:51.627439 29540 tablet_copy_service.cc:434] P 71aa3578fd924765ab9ac0729c8d1483: ending tablet copy session ca041dab9b2f44409ed7bf4c6cf66ab2-eb6a9a102eba49209ddf2bdf286077e8 on tablet eb6a9a102eba49209ddf2bdf286077e8 with peer ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:11:51.637579 30608 raft_consensus.cc:740] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:51.638566 30608 consensus_queue.cc:260] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.638994 30676 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:51.626780 30650 raft_consensus.cc:2804] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:51.653373 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:51.659811 29455 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:51.653759 30596 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:51.653846 30429 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.655871 30595 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
W20260709 13:11:51.657573 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.657508 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:51.658259 29376 raft_consensus.cc:1240] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:51.603356 30658 consensus_queue.cc:1048] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:11:51.652174 30661 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:51.670584 30507 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:51.686646 29523 raft_consensus.cc:1275] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:51.660548 30707 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:51.651098 30608 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:51.662370 30650 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:51.649513 30563 consensus_queue.cc:1048] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:11:51.649343 30581 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.699913 30650 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:51.690716 29421 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.682s (SENT) [suppressed 55 similar messages]
I20260709 13:11:51.672654 30595 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.708380 29374 raft_consensus.cc:1240] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:11:51.703866 30429 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.708382 29372 raft_consensus.cc:1240] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:11:51.692545 30661 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.690307 30423 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.732583 29455 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:11:51.699347 30707 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.736847 29495 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:51.739840 29378 raft_consensus.cc:1240] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:51.699623 30596 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:51.716142 30507 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.719707 30597 consensus_queue.cc:1048] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:11:51.746088 29526 raft_consensus.cc:1240] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:51.718699 30671 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.743314 30158 raft_consensus.cc:2955] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:51.751400 29376 raft_consensus.cc:1240] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:51.756417 29379 raft_consensus.cc:1240] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:51.770792 30707 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:51.770792 30429 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:51.773782 30507 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:51.739876 30745 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:51.728560 30646 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.784694 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:51.792663 29527 raft_consensus.cc:1240] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 3. Current term is 4. Ops: []
W20260709 13:11:51.796640 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 101804us
I20260709 13:11:51.806850 29528 raft_consensus.cc:1240] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:51.808727 29530 raft_consensus.cc:1275] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:51.810266 29530 raft_consensus.cc:1275] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:51.821964 29523 raft_consensus.cc:1240] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:51.747992 30485 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
W20260709 13:11:51.824443 30753 log.cc:927] Time spent T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.123s	user 0.002s	sys 0.000s
I20260709 13:11:51.802953 30745 raft_consensus.cc:697] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:51.852192 29530 raft_consensus.cc:1275] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:11:51.852873 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:51.795961 30664 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:51.859009 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 59808us
I20260709 13:11:51.860728 29530 pending_rounds.cc:85] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 1
I20260709 13:11:51.863095 29521 raft_consensus.cc:2368] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 2. Current term is 3.
I20260709 13:11:51.864323 29530 pending_rounds.cc:107] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:11:51.864979 29530 raft_consensus.cc:2889] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:51.820992 29448 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:51.880024 29380 raft_consensus.cc:1240] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:51.869254 29379 raft_consensus.cc:1240] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:51.884022 30423 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:51.884733 29377 raft_consensus.cc:1240] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:11:51.885423 30664 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:51.885895 30746 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.906023 30746 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.906134 30745 consensus_queue.cc:237] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.907685 30763 consensus_queue.cc:1048] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:51.910259 30485 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:51.882803 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:51.887135 30671 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:51.888382 30706 raft_consensus.cc:3055] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:11:51.892306 30751 log.cc:927] Time spent T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:11:51.902863 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.904174 29375 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
I20260709 13:11:51.875988 30595 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:51.924606 30706 raft_consensus.cc:740] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:51.937012 30706 consensus_queue.cc:260] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.938476 30706 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:51.938937 29379 raft_consensus.cc:1240] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:51.879426 30581 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:51.938964 30596 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:11:51.944500 30746 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:51.944809 30669 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.870029 30429 consensus_queue.cc:1059] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:11:51.934741 30661 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:51.947137 30669 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:51.915961 29376 raft_consensus.cc:2468] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
I20260709 13:11:51.960296 30429 raft_consensus.cc:3055] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:51.960541 29377 raft_consensus.cc:1275] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:51.960983 30429 raft_consensus.cc:740] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:11:51.961829 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.961942 30429 consensus_queue.cc:260] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:51.964272 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:11:51.964843 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.964969 30429 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:51.952955 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.966616 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:51.967054 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:51.967718 29450 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:51.968449 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:51.954591 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:51.972884 29455 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:51.966531 29376 raft_consensus.cc:1275] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:51.977383 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:51.978741 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:51.980634 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:51.981137 29277 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35182 (request call id 47) took 5496 ms. Trace:
I20260709 13:11:51.965590 29379 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:51.965700 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:51.989494 29419 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:51.935717 30646 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:11:51.935437 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 73080.3us
I20260709 13:11:51.964409 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:11:51.986464 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.989607 29455 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
I20260709 13:11:51.882007 30579 consensus_queue.cc:1048] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:11:52.005991 30766 consensus_queue.cc:1048] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:52.006399 29373 raft_consensus.cc:1240] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:11:51.997673 29450 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
I20260709 13:11:52.002935 30650 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:52.003463 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:52.004160 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:52.004873 29344 leader_election.cc:400] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 2. Current term is 3.
I20260709 13:11:52.020193 29344 leader_election.cc:403] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:11:51.971343 29372 raft_consensus.cc:1240] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:11:52.020449 29375 raft_consensus.cc:2393] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 3: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
W20260709 13:11:52.021598 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 430373us
I20260709 13:11:52.022744 29419 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:11:52.024564 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.026160 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:52.027472 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:52.028288 29455 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:52.029422 29377 raft_consensus.cc:2393] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 2: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:52.030216 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:52.030580 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:52.032591 29453 raft_consensus.cc:3060] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:52.033515 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 342808us
I20260709 13:11:52.036417 29419 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:52.043951 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:11:52.070402 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.074043 29521 raft_consensus.cc:2393] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 4: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:11:52.075173 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.032341 30562 raft_consensus.cc:3060] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:51.981805 29277 rpcz_store.cc:276] 0709 13:11:46.485215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.485387 (+   172us) service_pool.cc:224] Handling call
0709 13:11:51.975461 (+5490074us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:51.376372 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:51.408208 (+ 31836us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:51.408265 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:11:51.408284 (+    19us) tablet.cc:662] Decoding operations
0709 13:11:51.408883 (+   599us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:51.408971 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:51.409014 (+    43us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:11:51.409482 (+   468us) tablet.cc:701] Row locks acquired
0709 13:11:51.409535 (+    53us) write_op.cc:260] PREPARE: finished
0709 13:11:51.409734 (+   199us) write_op.cc:270] Start()
0709 13:11:51.409883 (+   149us) write_op.cc:276] Timestamp: P: 1783602711409670 usec, L: 0
0709 13:11:51.409901 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:11:51.410837 (+   936us) log.cc:844] Serialized 924 byte log entry
0709 13:11:51.592476 (+181639us) op_driver.cc:464] REPLICATION: finished
0709 13:11:51.744950 (+152474us) write_op.cc:301] APPLY: starting
0709 13:11:51.749332 (+  4382us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:51.757669 (+  8337us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:51.757835 (+   166us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:51.770577 (+ 12742us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:51.770788 (+   211us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:11:51.770851 (+    63us) write_op.cc:312] APPLY: finished
0709 13:11:51.771120 (+   269us) log.cc:844] Serialized 28 byte log entry
0709 13:11:51.771334 (+   214us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:51.771486 (+   152us) write_op.cc:454] Released schema lock
0709 13:11:51.771572 (+    86us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:51.772105 (+   533us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:51.772141 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":261776,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":135756,"apply.run_cpu_time_us":2978,"apply.run_wall_time_us":32195,"num_ops":2,"prepare.queue_time_us":99152,"prepare.run_cpu_time_us":3888,"prepare.run_wall_time_us":41739,"replication_time_us":182378,"thread_start_us":146003,"threads_started":2}]]}
W20260709 13:11:52.117084 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 80740.8us
I20260709 13:11:52.127648 29374 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
I20260709 13:11:52.145717 29455 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:11:52.032087 29376 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:11:52.123345 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:52.079507 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:52.032954 30630 raft_consensus.cc:2764] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:11:52.150780 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:11:52.035737 30608 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:11:52.107651 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:52.103587 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.092428 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:52.153774 29379 raft_consensus.cc:2410] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:11:52.095803 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:52.154726 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:52.156371 29450 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
I20260709 13:11:52.155997 29451 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:52.158046 29453 raft_consensus.cc:2468] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:11:52.160621 29381 raft_consensus.cc:2393] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 2: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:52.161649 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:52.150696 30658 consensus_queue.cc:1048] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:11:52.149405 30707 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:11:52.164199 30707 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:11:52.165866 30769 log.cc:927] Time spent T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.055s	user 0.003s	sys 0.000s
I20260709 13:11:52.166512 30707 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:11:52.092828 30659 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:52.120410 30650 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:52.168223 29380 raft_consensus.cc:1275] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:11:52.168452 30770 log.cc:927] Time spent T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:11:52.121467 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:52.171204 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:52.127921 29448 raft_consensus.cc:1240] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:52.171837 29449 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:52.152801 30608 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:52.173141 30608 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:52.079192 30579 consensus_queue.cc:1059] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.099s
I20260709 13:11:52.178719 29495 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:52.036820 30661 consensus_queue.cc:1048] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.116s
I20260709 13:11:52.179649 30706 raft_consensus.cc:2804] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:52.180063 30706 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:52.180415 30706 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:52.181370 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:52.182987 30579 raft_consensus.cc:3055] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:52.183575 30579 raft_consensus.cc:740] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:52.182900 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:52.185321 30579 consensus_queue.cc:260] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:52.121100 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:11:52.187805 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.193533 29495 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:52.198655 29495 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:52.200820 29449 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:11:52.186646 30579 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:52.206112 29379 raft_consensus.cc:1275] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:11:52.207363 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 55600.8us
I20260709 13:11:52.208979 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:52.210194 29419 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:11:52.215294 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.209776 29379 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:11:52.223510 29527 raft_consensus.cc:1275] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:52.225175 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:52.225868 29379 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:52.225932 29451 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:11:52.211838 29419 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:52.227835 30766 consensus_queue.cc:1059] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:52.222441 30686 consensus_queue.cc:1059] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:11:52.234975 30766 raft_consensus.cc:3055] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:52.219017 30646 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:52.235478 30686 raft_consensus.cc:3055] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:52.235929 30686 raft_consensus.cc:740] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:52.219264 30630 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:52.236743 30630 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:52.237190 30630 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:52.236937 30686 consensus_queue.cc:260] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:52.237771 30756 consensus_queue.cc:1048] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:52.228590 30581 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:52.229379 29495 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:52.238543 30686 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:52.230793 29279 catalog_manager.cc:5697] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:52.241647 29495 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:52.249828 29525 raft_consensus.cc:1275] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:52.251541 30581 raft_consensus.cc:697] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:52.252621 30581 consensus_queue.cc:237] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:52.255430 30669 raft_consensus.cc:2804] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:52.256258 30669 raft_consensus.cc:697] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:52.256430 30485 raft_consensus.cc:2804] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:52.256518 29495 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:52.257687 29379 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:11:52.235472 30766 raft_consensus.cc:740] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:52.260386 29527 raft_consensus.cc:1275] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:52.261997 30766 consensus_queue.cc:260] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:52.243153 30661 raft_consensus.cc:2804] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:52.240859 30646 raft_consensus.cc:697] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:52.257102 30485 raft_consensus.cc:697] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:52.241847 29419 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:52.260977 29279 catalog_manager.cc:5697] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:52.268009 30669 consensus_queue.cc:237] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:52.281369 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:11:52.309711 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 67922.1us
I20260709 13:11:52.310200 29379 raft_consensus.cc:2376] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2. Re-sending same reply.
I20260709 13:11:52.281805 29495 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:52.280385 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:52.267889 30766 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:52.310494 29419 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:52.307426 30630 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:52.310554 29279 catalog_manager.cc:5697] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:52.311825 29495 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:52.320833 29419 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:52.280926 30671 raft_consensus.cc:2804] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:52.281386 30661 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.331444 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:11:52.332532 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:52.335907 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.322170 29279 catalog_manager.cc:5697] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:11:52.300241 30562 raft_consensus.cc:2749] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 2. Current term is 3.
I20260709 13:11:52.344043 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:52.345074 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:52.349879 29377 raft_consensus.cc:2393] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 3: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
W20260709 13:11:52.351433 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.322382 29419 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:52.319257 30659 raft_consensus.cc:2804] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:52.355537 29419 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:52.344914 29279 catalog_manager.cc:5697] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 1 to 4, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 4 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:11:52.280826 30620 consensus_queue.cc:1059] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:11:52.319931 30745 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:52.271201 30706 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:52.323309 30650 raft_consensus.cc:2804] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:52.324579 30707 raft_consensus.cc:2764] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:11:52.368949 29279 catalog_manager.cc:5697] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:52.341629 30661 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:52.378098 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:52.380645 29381 raft_consensus.cc:1240] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:11:52.345273 30423 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:52.371695 30658 raft_consensus.cc:2804] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:52.356628 30671 raft_consensus.cc:697] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:52.368535 30659 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:52.376812 30650 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.405709 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:52.376724 30630 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:52.344532 30756 consensus_queue.cc:1048] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:11:52.413022 29523 raft_consensus.cc:3055] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:52.349191 30608 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:52.413650 29523 raft_consensus.cc:740] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:52.420346 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:52.426065 29523 consensus_queue.cc:260] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:52.434002 30608 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:52.401705 30658 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.407626 30659 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:52.455572 29523 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:52.450079 29377 raft_consensus.cc:2393] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 3: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:52.410679 30650 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:52.401988 30745 raft_consensus.cc:697] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:52.458069 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:52.460099 29379 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
W20260709 13:11:52.461962 30776 log.cc:927] Time spent T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:11:52.382827 29527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93"
dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
mode: GRACEFUL
new_leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
 from {username='slave'} at 127.0.0.1:52288
I20260709 13:11:52.416565 30707 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:52.458563 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:11:52.470608 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:52.473598 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:52.488860 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.403784 30703 consensus_queue.cc:1048] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:11:52.494626 29527 raft_consensus.cc:606] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 LEADER]: Received request to transfer leadership to TS 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:52.453310 30658 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:52.500237 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:52.502753 29379 raft_consensus.cc:2393] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 3: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
W20260709 13:11:52.511871 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:52.513770 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 158374us
I20260709 13:11:52.519352 29419 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:52.406462 30646 consensus_queue.cc:237] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:52.530048 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:52.499915 30707 raft_consensus.cc:697] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 3 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:52.531222 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:52.538982 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:52.443029 30485 consensus_queue.cc:237] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:52.551167 29374 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
W20260709 13:11:52.565742 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 176278us
I20260709 13:11:52.538981 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:52.593390 29378 raft_consensus.cc:2393] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 3: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:52.555022 30630 raft_consensus.cc:2804] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:11:52.594941 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.566669 29376 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
W20260709 13:11:52.608692 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.610330 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:52.612493 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:52.613291 29374 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 2.
I20260709 13:11:52.613384 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:52.615386 29377 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
I20260709 13:11:52.614606 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:52.615321 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:52.618158 29379 raft_consensus.cc:2393] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 3: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
W20260709 13:11:52.614472 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 63460.4us
I20260709 13:11:52.622149 29419 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:52.623114 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:52.624331 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:52.596434 30630 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:52.688958 29379 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
W20260709 13:11:52.643695 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.688319 29377 raft_consensus.cc:2393] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 2: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:11:52.539168 30671 consensus_queue.cc:237] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:11:52.691648 29380 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
W20260709 13:11:52.692821 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 66864.8us
W20260709 13:11:52.689502 30783 log.cc:927] Time spent T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.287s	user 0.002s	sys 0.000s
I20260709 13:11:52.703014 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:52.705892 29419 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:11:52.693413 30630 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:52.718550 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.700275 30581 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.704219 30608 raft_consensus.cc:2804] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:52.713088 30664 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:52.622006 30745 consensus_queue.cc:237] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:52.732264 30608 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.735324 30423 raft_consensus.cc:697] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:52.705693 30707 consensus_queue.cc:237] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:52.742133 30791 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.731701 30581 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:52.744726 30608 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:52.737679 30664 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:52.761435 30781 log.cc:927] Time spent T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 13:11:52.761384 30702 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:52.778196 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:52.770900 30579 consensus_meta.cc:287] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.564s	user 0.011s	sys 0.003s
W20260709 13:11:52.779031 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.764187 30791 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:52.788770 29378 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 2.
W20260709 13:11:52.800026 30788 log.cc:927] Time spent T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:11:52.784050 30702 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:52.802019 30773 log.cc:927] Time spent T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.440s	user 0.002s	sys 0.000s
I20260709 13:11:52.805063 30664 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:52.813506 30791 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:11:52.815634 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:52.816726 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 110977us
I20260709 13:11:52.819298 29419 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:52.819922 29523 raft_consensus.cc:1275] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:52.823411 30563 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.825584 29372 raft_consensus.cc:2468] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:11:52.825397 30563 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:52.827998 30563 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:52.830907 30706 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:52.832926 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:52.834339 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:52.835033 29450 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:11:52.835227 29448 raft_consensus.cc:1275] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:52.836408 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:52.837114 29449 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
I20260709 13:11:52.834399 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:52.841439 29451 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:52.843992 30686 consensus_meta.cc:287] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.594s	user 0.005s	sys 0.009s
I20260709 13:11:52.844959 29381 raft_consensus.cc:2410] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:52.854533 30795 raft_consensus.cc:2804] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:52.855897 30795 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.856515 30795 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:52.859694 29451 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
I20260709 13:11:52.815474 30702 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:52.850502 30791 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:52.803356 30661 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:52.876853 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 57697.4us
I20260709 13:11:52.879943 29451 raft_consensus.cc:1275] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:52.881300 30581 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:52.851289 30423 consensus_queue.cc:237] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:52.900177 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:52.901252 29381 raft_consensus.cc:2393] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 3: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:52.944736 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:52.951898 30671 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.102486 29527 raft_consensus.cc:1275] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:11:52.990751 30795 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:53.104522 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:52.934867 30707 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.105455 29521 raft_consensus.cc:2410] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:53.105855 30707 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:53.106196 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
W20260709 13:11:53.031759 30658 consensus_meta.cc:287] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.518s	user 0.008s	sys 0.005s
I20260709 13:11:53.105891 29523 raft_consensus.cc:1240] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:11:53.107342 30658 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:53.008049 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.111852 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:53.112082 30485 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:53.108999 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.108893 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:11:53.071525 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:52.996573 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:52.954434 30766 consensus_meta.cc:287] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.625s	user 0.009s	sys 0.003s
W20260709 13:11:53.116808 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.934547 30581 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.122362 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:52.984545 30745 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:53.122705 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:53.127166 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.124778 29526 raft_consensus.cc:1240] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:11:53.007686 30747 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:11:53.125626 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:52.953300 30630 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:53.175992 30630 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:53.176676 30630 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:53.021255 30608 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:53.177583 30630 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:53.121881 30485 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:53.126564 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:53.120451 30705 consensus_queue.cc:1048] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:11:53.050223 30641 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.162412 30745 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:53.115880 30661 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:11:53.164572 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.122434 30784 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.130486 30702 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.052452 30791 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.125972 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:53.166672 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:53.163192 30799 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.102295 30671 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:53.184429 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:53.188452 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.208022 29524 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 2.
I20260709 13:11:53.009279 30650 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:53.216435 30784 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:53.219744 30630 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:52.987244 30659 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:53.221535 30784 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:53.215828 30702 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:53.222675 30659 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:53.206539 30641 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:53.228863 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.232887 29525 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
W20260709 13:11:53.233165 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.129222 30581 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:53.219275 30650 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:11:53.254801 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:53.298280 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.235100 30608 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:53.247830 30747 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.226367 30686 consensus_queue.cc:1048] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.080s
I20260709 13:11:53.330443 30581 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:53.215291 30791 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:53.314550 30595 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:53.342496 29529 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
W20260709 13:11:53.307822 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 94103.1us
W20260709 13:11:53.359402 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.373471 30608 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.374168 30608 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:53.375269 30630 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.375622 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:53.375835 30630 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:53.376433 29455 raft_consensus.cc:2368] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 3. Current term is 4.
I20260709 13:11:53.375697 30595 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:53.376582 30659 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.377116 30659 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:53.378744 30595 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:11:53.379149 30659 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:11:53.379884 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:53.380208 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:53.380967 29448 raft_consensus.cc:2393] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 3: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:11:53.381266 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:53.376456 30650 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.382120 30650 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:53.226096 30799 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:53.412343 30630 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:53.442162 29451 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:11:53.443260 30671 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:53.444691 30658 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:53.445828 30799 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:11:53.335337 30747 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:53.446746 30745 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:53.415947 30707 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:53.484032 30608 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:53.448252 30641 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:53.483533 30650 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:53.485486 30791 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:53.487305 30747 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:53.492041 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:53.492272 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:53.494818 29453 raft_consensus.cc:2376] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2. Re-sending same reply.
I20260709 13:11:53.497030 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:53.497807 29450 raft_consensus.cc:2368] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 3. Current term is 4.
I20260709 13:11:53.497897 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:53.498386 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:53.498808 29447 raft_consensus.cc:2393] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 3: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:11:53.499003 29448 raft_consensus.cc:2376] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3. Re-sending same reply.
I20260709 13:11:53.500869 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:53.502713 29375 raft_consensus.cc:1240] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 3. Current term is 4. Ops: []
W20260709 13:11:53.636996 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.509657 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:11:53.604581 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.641448 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:53.641636 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:53.641904 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:53.504016 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:11:53.552906 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 352790us
W20260709 13:11:53.513091 30809 log.cc:927] Time spent T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.096s	user 0.000s	sys 0.003s
I20260709 13:11:53.513098 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:53.503706 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:53.643635 30579 consensus_queue.cc:1048] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:53.645128 29378 raft_consensus.cc:2468] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 1.
I20260709 13:11:53.516963 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:53.539649 30702 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:53.647639 29372 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 2.
I20260709 13:11:53.642267 29375 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
I20260709 13:11:53.648941 30563 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.507982 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:53.503538 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:53.649567 30563 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:53.650060 29380 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
I20260709 13:11:53.629650 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:53.620144 29448 raft_consensus.cc:1240] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:53.651175 29374 raft_consensus.cc:2393] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 3: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:53.503042 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:53.651788 30563 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:11:53.537806 30804 log.cc:927] Time spent T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b: Append to log took a long time: real 0.426s	user 0.001s	sys 0.021s
I20260709 13:11:53.652304 29453 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
W20260709 13:11:53.572436 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.535621 30485 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:11:53.559741 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:53.653532 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.502650 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:53.654385 29381 raft_consensus.cc:2468] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 1.
I20260709 13:11:53.655375 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:11:53.555253 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 425686us
I20260709 13:11:53.602358 30646 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.656358 29381 raft_consensus.cc:2410] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:53.656731 30646 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:53.657382 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:53.524780 30802 log.cc:927] Time spent T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.552s	user 0.000s	sys 0.012s
I20260709 13:11:53.541147 30795 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:53.652083 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:53.660022 30807 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:53.660854 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.630193 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:53.661720 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:53.661948 30791 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.662993 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:11:53.664947 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:53.665746 30766 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.666657 30808 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:53.667127 30702 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.670950 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:53.697780 29455 raft_consensus.cc:2368] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 2. Current term is 3.
W20260709 13:11:53.673660 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.681375 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:53.700042 29379 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 2.
W20260709 13:11:53.683386 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.681192 29421 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:53.701356 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:53.702996 29421 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:53.686666 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:53.686934 30807 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:53.704780 29381 raft_consensus.cc:2393] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 3: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:53.708454 29455 raft_consensus.cc:1240] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:53.707037 29344 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:11:53.709815 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:53.710696 29379 raft_consensus.cc:2393] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 3: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:53.696064 30646 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:53.712489 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:53.713852 29375 raft_consensus.cc:2393] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 3: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
W20260709 13:11:53.714510 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.710503 29421 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:53.720079 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:53.711485 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:53.722182 29375 raft_consensus.cc:2393] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 3: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:53.722115 29378 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 4.
I20260709 13:11:53.726318 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:53.727023 29378 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:53.732322 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:53.687414 30650 consensus_queue.cc:1059] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:11:53.733521 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:53.728811 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:53.734330 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:53.736850 29375 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:53.737560 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:53.738166 29379 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 2.
I20260709 13:11:53.710093 30707 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:53.707402 30702 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:53.745365 30702 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:53.689724 30791 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:53.730384 30595 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:53.729897 30795 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:53.708312 30766 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:53.768581 29453 raft_consensus.cc:1275] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:11:53.769308 29453 pending_rounds.cc:85] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 5
I20260709 13:11:53.769644 29453 pending_rounds.cc:107] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:11:53.769928 29453 raft_consensus.cc:2889] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:53.755841 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:53.754046 30485 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.712296 30808 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:53.756067 30650 consensus_queue.cc:1243] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer 429e58eb058349e3bf72b5a870c8f6e5 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:11:53.785764 30799 raft_consensus.cc:3055] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:53.786687 30799 raft_consensus.cc:740] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:53.786365 29381 raft_consensus.cc:2393] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 3: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:53.780385 29372 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
I20260709 13:11:53.787640 30766 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:53.780571 30485 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:53.788504 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:53.788847 29495 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:53.789310 29374 raft_consensus.cc:2393] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 3: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:53.789525 30791 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:53.789883 30485 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:53.790485 30485 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:11:53.780308 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.791028 30563 consensus_queue.cc:1048] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:53.790910 30485 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:53.791671 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:53.792265 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:53.790906 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:53.793239 29376 raft_consensus.cc:2393] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 3: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:53.793360 29373 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
I20260709 13:11:53.794665 30799 consensus_queue.cc:260] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:53.796098 30799 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:53.797385 29495 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:53.792430 29377 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
I20260709 13:11:53.799064 30669 raft_consensus.cc:2804] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:53.799466 30669 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:53.792191 30485 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:53.799753 30807 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:53.799950 30669 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:53.801152 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.802453 30808 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:53.803929 29495 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:53.804886 30784 raft_consensus.cc:2804] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:53.805536 30784 raft_consensus.cc:697] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:53.807895 29495 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:53.809054 29453 raft_consensus.cc:1240] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:11:53.806574 30784 consensus_queue.cc:237] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:53.818492 29453 pending_rounds.cc:85] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 1
W20260709 13:11:53.818576 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.818965 29453 pending_rounds.cc:107] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:11:53.819293 29453 raft_consensus.cc:2889] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:53.821460 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:53.822211 29455 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:11:53.821833 30485 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:53.832310 29455 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
W20260709 13:11:53.839613 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.843854 29455 raft_consensus.cc:1275] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:53.883535 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:53.891395 29455 raft_consensus.cc:1240] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:11:53.894771 29421 leader_election.cc:336] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.682s (SENT)
I20260709 13:11:53.896554 29378 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 4.
I20260709 13:11:53.906581 29375 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 4.
I20260709 13:11:53.900075 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:53.913271 29455 raft_consensus.cc:2393] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 4: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:11:53.918169 29455 raft_consensus.cc:1275] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:53.922684 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:53.925068 29450 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:11:53.896093 30703 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.927930 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:53.928864 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:53.941079 29451 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
W20260709 13:11:53.941519 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 228489us
I20260709 13:11:53.932271 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:53.942497 29456 raft_consensus.cc:2393] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 4: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:11:53.942871 30766 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.951608 29454 raft_consensus.cc:2393] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 4: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:11:53.901058 30799 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:53.954550 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:53.986631 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:53.987066 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:53.987551 29375 raft_consensus.cc:2393] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 3: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
W20260709 13:11:54.008670 29421 leader_election.cc:336] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.687s (SENT)
I20260709 13:11:54.019014 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:54.002168 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:54.020157 29375 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:11:53.994246 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:53.992620 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:54.024794 29450 raft_consensus.cc:2410] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:54.024561 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:53.982762 29455 raft_consensus.cc:2368] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 2. Current term is 3.
I20260709 13:11:53.987929 29524 raft_consensus.cc:2410] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:54.028777 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:54.020745 29379 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
W20260709 13:11:54.032341 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.037819 29448 raft_consensus.cc:1275] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:54.038239 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:54.039340 29378 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:11:54.039659 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:54.040467 29448 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:11:53.952620 30703 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:54.085106 29380 raft_consensus.cc:3055] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:54.243769 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:11:54.149005 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.059948 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:54.245272 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:54.245927 29375 raft_consensus.cc:2393] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 4: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
W20260709 13:11:54.229183 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 91720us
I20260709 13:11:54.231659 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:11:54.091974 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.247239 29454 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
W20260709 13:11:54.247654 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:54.230999 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.126696 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:54.249936 29374 raft_consensus.cc:2393] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 4: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:11:54.041281 29378 raft_consensus.cc:1275] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:11:54.185665 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.251266 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:54.252107 29378 raft_consensus.cc:2376] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4. Re-sending same reply.
W20260709 13:11:54.233161 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 224563us
I20260709 13:11:54.253260 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:54.136303 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:54.077088 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:11:54.258622 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.258944 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:54.260452 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:54.193362 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:11:54.189450 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.148699 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:54.112514 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:54.242805 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:11:54.043680 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 52606.2us
I20260709 13:11:54.259138 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:54.244158 29380 raft_consensus.cc:740] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:54.261204 29378 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:11:54.300400 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:54.084375 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:54.309439 29374 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:11:54.309986 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:54.310693 29375 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:11:54.311601 29452 raft_consensus.cc:2393] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 4: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:11:54.311512 29381 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
I20260709 13:11:54.313201 29451 raft_consensus.cc:2410] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:54.308001 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:11:54.265828 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:54.083885 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:54.315093 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.313921 29450 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
I20260709 13:11:54.315810 30158 raft_consensus.cc:3060] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 LEARNER]: Advancing to term 3
I20260709 13:11:54.316008 29378 raft_consensus.cc:1275] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:11:54.312633 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.264109 29455 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:11:54.263826 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:54.317128 29454 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
I20260709 13:11:54.318549 29455 raft_consensus.cc:1275] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:54.319347 29379 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:11:54.319751 29455 raft_consensus.cc:1240] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 2. Current term is 3. Ops: []
W20260709 13:11:54.316641 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.321688 29377 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:11:54.321593 29454 raft_consensus.cc:1240] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:53.987972 30599 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:54.260637 30829 log.cc:927] Time spent T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.276s	user 0.005s	sys 0.000s
I20260709 13:11:54.081032 29372 raft_consensus.cc:1275] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:54.321090 29455 raft_consensus.cc:1240] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:54.113410 30485 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:54.328577 29454 raft_consensus.cc:1240] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:53.982422 30766 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:54.336611 30599 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:54.148180 30646 consensus_queue.cc:1059] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.190s
I20260709 13:11:54.144909 30608 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:54.327193 29452 raft_consensus.cc:1275] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:54.316951 29380 consensus_queue.cc:260] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:54.352237 29380 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:54.041738 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:54.263005 30807 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:54.023833 30799 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:54.348552 30158 raft_consensus.cc:1275] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 LEARNER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:54.353511 29452 raft_consensus.cc:1275] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:54.354296 29374 raft_consensus.cc:1275] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:54.180806 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:53.988286 30669 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:54.340890 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:54.364192 29448 raft_consensus.cc:2410] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:54.352099 30596 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.366212 29376 raft_consensus.cc:1275] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:54.390805 29453 raft_consensus.cc:1275] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:54.388816 30599 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:54.407862 30703 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:54.386282 29447 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
W20260709 13:11:54.421159 30841 log.cc:927] Time spent T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:11:54.398434 30706 consensus_queue.cc:1048] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:11:54.423678 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:54.425076 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:54.426147 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:54.426906 29453 raft_consensus.cc:2410] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:54.385783 30563 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:54.370834 30807 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:54.464775 29451 raft_consensus.cc:1275] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:11:54.465332 29451 pending_rounds.cc:85] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 1
I20260709 13:11:54.465629 29451 pending_rounds.cc:107] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:11:54.466132 29451 raft_consensus.cc:2889] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:54.468250 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:11:54.458719 29380 raft_consensus.cc:1275] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:11:54.459530 29456 raft_consensus.cc:1275] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:54.418013 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:54.387102 30618 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:54.482194 29455 raft_consensus.cc:1275] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:54.482785 29375 raft_consensus.cc:1275] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:54.419390 30799 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:11:54.417335 30669 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:54.484210 29380 pending_rounds.cc:85] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5: Aborting all ops after (but not including) 1
I20260709 13:11:54.406694 30766 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:54.488937 29380 pending_rounds.cc:107] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:11:54.488767 30799 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:54.496688 30835 log.cc:927] Time spent T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:11:54.498199 30563 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:54.504204 30563 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:54.504456 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:11:54.504750 29456 raft_consensus.cc:1275] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:54.386780 30596 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:54.514285 29451 raft_consensus.cc:1275] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:54.490118 30618 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:54.489920 29448 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
I20260709 13:11:54.514686 30799 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:54.540086 29380 raft_consensus.cc:2889] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:54.538385 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 274172us
W20260709 13:11:54.550191 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 235407us
W20260709 13:11:54.555078 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.541688 30842 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:54.571385 29419 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:54.579588 30807 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:54.583539 30608 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.568528 30842 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:54.598229 30854 raft_consensus.cc:2804] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:54.599009 30854 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.600980 30854 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:54.584146 30608 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:54.601924 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:54.553167 29346 leader_election.cc:336] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 1.787s (SENT)
I20260709 13:11:54.614248 29525 raft_consensus.cc:1240] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:54.601459 30799 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:54.616843 29421 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:54.614401 29346 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:54.619761 29421 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:54.621184 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:54.619693 29495 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:54.622150 29380 raft_consensus.cc:2468] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 4.
W20260709 13:11:54.619848 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 48522.1us
I20260709 13:11:54.623425 29419 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:54.624349 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:54.618387 30596 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:54.632995 29421 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:54.621524 30799 raft_consensus.cc:2764] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:11:54.636576 30855 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:54.637179 30855 raft_consensus.cc:697] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 3 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:54.620471 30848 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:54.635658 29419 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:11:54.648670 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 95535.5us
I20260709 13:11:54.644950 30618 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:11:54.649405 29346 leader_election.cc:336] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 1.796s (SENT)
I20260709 13:11:54.649824 29346 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:54.639973 30855 consensus_queue.cc:237] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:54.652516 29279 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37594 (request call id 131) took 3262 ms. Trace:
I20260709 13:11:54.647861 29278 catalog_manager.cc:5697] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:54.627552 30646 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:54.662122 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:54.662880 29526 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
I20260709 13:11:54.652922 29279 rpcz_store.cc:276] 0709 13:11:51.391478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.391783 (+   305us) service_pool.cc:224] Handling call
0709 13:11:54.652408 (+3260625us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:52.770248 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:52.812720 (+ 42472us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:52.812766 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:11:52.812784 (+    18us) tablet.cc:662] Decoding operations
0709 13:11:52.813647 (+   863us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:52.813736 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:52.813769 (+    33us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:11:52.814322 (+   553us) tablet.cc:701] Row locks acquired
0709 13:11:52.814343 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:11:52.814509 (+   166us) write_op.cc:270] Start()
0709 13:11:52.814639 (+   130us) write_op.cc:276] Timestamp: P: 1783602712814455 usec, L: 0
0709 13:11:52.814663 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:11:52.847823 (+ 33160us) log.cc:844] Serialized 2494 byte log entry
0709 13:11:53.536702 (+688879us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:11:53.664810 (+128108us) op_driver.cc:464] REPLICATION: finished
0709 13:11:53.711875 (+ 47065us) write_op.cc:301] APPLY: starting
0709 13:11:53.729955 (+ 18080us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:53.766212 (+ 36257us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:53.766957 (+   745us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:53.827453 (+ 60496us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:53.828957 (+  1504us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:11:53.829011 (+    54us) write_op.cc:312] APPLY: finished
0709 13:11:53.829281 (+   270us) log.cc:844] Serialized 52 byte log entry
0709 13:11:53.830205 (+   924us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:53.830388 (+   183us) write_op.cc:454] Released schema lock
0709 13:11:53.830452 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:53.910815 (+ 80363us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:53.920281 (+  9466us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1049,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":34061,"apply.run_cpu_time_us":3672,"apply.run_wall_time_us":177369,"num_ops":6,"prepare.queue_time_us":283147,"prepare.run_cpu_time_us":47513,"prepare.run_wall_time_us":258879,"raft.queue_time_us":10931,"raft.run_cpu_time_us":7253,"raft.run_wall_time_us":34331,"replication_time_us":849997,"spinlock_wait_cycles":6375680,"thread_start_us":468720,"threads_started":4,"wal-append.queue_time_us":263992}]]}
I20260709 13:11:54.668273 29421 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:11:54.666728 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 48302us
I20260709 13:11:54.661242 30429 consensus_queue.cc:1059] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:11:54.667394 29278 catalog_manager.cc:5697] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 1 to 3, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 3 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:54.671530 30608 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:54.671566 30706 raft_consensus.cc:1027] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 LEADER]: attempt to promote peer ca041dab9b2f44409ed7bf4c6cf66ab2: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:11:54.672312 30121 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:11:54.638259 30856 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:54.673210 30856 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.673578 30856 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:54.673722 30711 raft_consensus.cc:2804] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:54.674207 30711 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:54.674580 30711 raft_consensus.cc:3060] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:54.660494 30848 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:54.677910 30848 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:54.678829 30854 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:54.681785 30853 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:54.683672 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 48160us
I20260709 13:11:54.683884 29421 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:54.683948 30608 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:54.657652 30851 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:54.685761 29421 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:54.629655 30852 consensus_queue.cc:1048] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 13:11:54.686636 30799 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:54.684116 30857 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:54.672701 29278 catalog_manager.cc:5697] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:54.640102 30485 raft_consensus.cc:3055] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:54.689759 29421 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:54.692153 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:11:54.694687 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.698176 29495 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:54.665807 30766 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:11:54.700672 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 51296.9us
W20260709 13:11:54.701607 29346 leader_election.cc:336] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 1.816s (SENT)
I20260709 13:11:54.702072 29346 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:54.627758 30847 consensus_queue.cc:1048] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 13:11:54.706204 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:54.710855 30853 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:54.713723 30646 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:11:54.716653 29346 leader_election.cc:336] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 2.119s (SENT)
I20260709 13:11:54.718216 30848 consensus_queue.cc:1048] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:54.712383 30807 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:54.718087 30563 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:54.718866 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:54.734762 30807 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:54.735857 29524 raft_consensus.cc:2410] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:54.719108 29495 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:54.738327 30807 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:54.738994 30807 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:54.708168 30851 raft_consensus.cc:3055] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:54.739743 30851 raft_consensus.cc:740] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:54.739929 30796 raft_consensus.cc:2749] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:54.740684 30796 consensus_queue.cc:1048] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:54.721053 30854 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:54.721585 29344 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:54.699131 30485 raft_consensus.cc:740] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:54.744663 30485 consensus_queue.cc:260] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:54.746043 30485 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:54.726424 30842 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:54.730157 29278 catalog_manager.cc:5697] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:54.740684 30851 consensus_queue.cc:260] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:54.749775 30851 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:54.732223 29346 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:54.727905 30686 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:54.744871 30846 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:54.752612 30846 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.753026 30846 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:54.753223 29346 leader_election.cc:336] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 2.140s (SENT)
I20260709 13:11:54.753700 29346 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:54.754781 30808 raft_consensus.cc:2749] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:54.752142 29495 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
W20260709 13:11:54.758183 29346 leader_election.cc:336] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 2.175s (SENT)
W20260709 13:11:54.765949 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.755820 30808 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:54.772225 30799 raft_consensus.cc:2749] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:54.757696 29495 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:54.739334 30807 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.758687 29346 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:11:54.792827 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 107916us
W20260709 13:11:54.793347 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 103633us
I20260709 13:11:54.795322 29421 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:54.796080 30596 raft_consensus.cc:2749] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:11:54.796221 29346 leader_election.cc:336] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 2.184s (SENT)
I20260709 13:11:54.796815 30848 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:54.800940 30859 raft_consensus.cc:2749] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:54.801232 29346 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:54.801542 30848 raft_consensus.cc:697] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
W20260709 13:11:54.802503 29346 leader_election.cc:336] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 2.212s (SENT)
I20260709 13:11:54.802940 29346 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:54.803542 29421 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:54.803120 30848 consensus_queue.cc:237] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:54.804186 30596 raft_consensus.cc:2749] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:54.804479 30859 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:54.804888 30859 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:54.803746 30703 raft_consensus.cc:2749] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:54.805230 30859 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:54.812837 29524 raft_consensus.cc:1240] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:54.814056 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:54.814220 29421 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:54.814921 29380 raft_consensus.cc:2393] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 3: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:54.815187 30596 consensus_queue.cc:1059] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:54.816004 30596 consensus_queue.cc:1243] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer 71aa3578fd924765ab9ac0729c8d1483 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:11:54.816392 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:54.816522 30596 raft_consensus.cc:3055] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:54.816619 30866 raft_consensus.cc:2804] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:54.816916 30596 raft_consensus.cc:740] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:54.817582 30866 raft_consensus.cc:697] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 4 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:54.818192 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:54.818115 30596 consensus_queue.cc:260] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:54.817015 29380 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:54.819033 29375 raft_consensus.cc:2393] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 3: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:54.818792 30866 consensus_queue.cc:237] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:54.820736 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:54.823894 29421 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:54.826165 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:54.826891 29454 raft_consensus.cc:2468] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 5.
I20260709 13:11:54.827641 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:54.827845 30853 raft_consensus.cc:2804] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:54.828069 30121 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:54.828713 30853 raft_consensus.cc:697] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 4 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:54.829612 30842 raft_consensus.cc:2804] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:54.829711 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:54.830260 30842 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:54.830427 30596 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:54.830787 30842 raft_consensus.cc:3060] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:54.832255 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:54.829806 30853 consensus_queue.cc:237] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:54.834025 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:54.838864 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:54.840910 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:54.826861 29380 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 4.
I20260709 13:11:54.841549 29379 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
I20260709 13:11:54.844758 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:54.845752 30842 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:54.846545 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:54.846885 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:54.847417 29380 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:54.848757 30842 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:54.849162 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:54.776961 30852 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:54.849917 29375 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
I20260709 13:11:54.853631 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:54.853789 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:11:54.868145 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 110557us
I20260709 13:11:54.793738 30807 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:54.837471 30859 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:54.849892 29376 raft_consensus.cc:1275] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:54.880460 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:54.887267 29495 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:54.887882 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:54.892251 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:54.891390 29380 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 4.
I20260709 13:11:54.852249 30852 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:54.852432 30857 raft_consensus.cc:697] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 3 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:54.902688 30857 consensus_queue.cc:237] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:54.867553 30703 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.893790 29495 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:54.904712 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:54.899637 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:54.901196 30859 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:54.906093 29495 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:54.892593 30646 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:54.914976 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:54.915643 29495 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:54.907846 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:54.917241 30581 raft_consensus.cc:2804] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:54.917889 30581 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.918267 30581 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:54.908821 30796 raft_consensus.cc:2804] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:54.916858 30848 raft_consensus.cc:2804] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:54.919018 30796 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.919473 30796 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:54.924023 29448 raft_consensus.cc:3060] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:54.924731 30711 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:54.926172 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:54.894212 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:11:54.904163 30852 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:54.932487 29453 raft_consensus.cc:1240] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:54.932894 29454 raft_consensus.cc:1275] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:54.911835 30703 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:54.934458 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:54.936192 30703 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:54.939047 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:54.939805 29375 raft_consensus.cc:3060] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:54.944080 29376 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 4.
I20260709 13:11:54.946792 29451 raft_consensus.cc:1275] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:54.948024 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:54.948923 29453 raft_consensus.cc:2393] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 3: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:11:54.927469 30563 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:54.955724 30856 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:54.956326 29453 raft_consensus.cc:1240] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:54.954277 30581 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:54.959059 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:54.962878 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:54.963179 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:54.963873 29381 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:54.965895 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:54.966562 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:54.966751 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:54.967170 29529 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:54.967321 29380 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 2.
I20260709 13:11:54.968775 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:54.969051 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:54.969893 29526 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 4.
I20260709 13:11:54.919332 30848 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.958346 30856 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:54.978418 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:54.985855 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:54.986868 29454 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:11:54.988094 29375 raft_consensus.cc:2468] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 5.
I20260709 13:11:54.989207 29378 raft_consensus.cc:1240] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:54.990283 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:54.979367 29377 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
I20260709 13:11:54.994253 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:54.991911 30121 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:54.995579 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:54.997560 29523 raft_consensus.cc:2368] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 3. Current term is 4.
I20260709 13:11:55.001117 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:55.002542 29453 raft_consensus.cc:2410] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:54.995204 29447 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
I20260709 13:11:55.004877 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:55.006055 29451 raft_consensus.cc:2368] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 2. Current term is 3.
I20260709 13:11:55.006619 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:55.007335 29449 raft_consensus.cc:2368] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 2. Current term is 3.
I20260709 13:11:55.008153 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:55.009606 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:55.010630 29452 raft_consensus.cc:2393] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 4: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:11:55.010468 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:55.010918 29421 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:54.973989 30859 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.020895 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:55.021796 29456 raft_consensus.cc:2368] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 2. Current term is 3.
I20260709 13:11:55.021662 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:55.008100 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:55.023046 29455 raft_consensus.cc:2376] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3. Re-sending same reply.
I20260709 13:11:55.021080 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:55.024236 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:54.969828 30711 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 5 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:55.024024 29529 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 4.
I20260709 13:11:54.928243 30796 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:55.024824 29527 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:55.025380 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:54.954141 29448 raft_consensus.cc:2468] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 6.
I20260709 13:11:55.029798 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:55.035692 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:55.036296 29530 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:55.036460 29529 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
W20260709 13:11:55.033035 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.036850 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:55.011945 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:55.043038 29373 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:54.960521 30846 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:54.975823 30848 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:55.038822 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:55.050971 29380 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:55.054044 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:55.054826 29448 raft_consensus.cc:2376] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3. Re-sending same reply.
I20260709 13:11:55.024248 30855 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:55.040642 29523 raft_consensus.cc:1275] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:55.057008 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:55.040740 30581 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:55.041721 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:55.063879 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:55.064642 29372 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
I20260709 13:11:55.065039 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:11:55.042595 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.066156 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:55.031069 30812 raft_consensus.cc:2804] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:55.067013 30812 raft_consensus.cc:697] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:11:55.067471 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:55.068280 29524 raft_consensus.cc:2393] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 3: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:11:55.068008 30812 consensus_queue.cc:237] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:55.050150 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:55.072330 30846 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:55.073194 29379 raft_consensus.cc:2368] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 2. Current term is 3.
I20260709 13:11:55.031212 30859 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:55.068387 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:55.062043 29526 raft_consensus.cc:2393] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 4: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:11:55.049762 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.075245 30859 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:55.075440 30852 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:55.072965 30121 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:55.077783 29521 raft_consensus.cc:1240] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:55.078684 29380 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 4.
I20260709 13:11:55.079044 30705 raft_consensus.cc:2804] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:55.081933 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:55.084332 29522 raft_consensus.cc:1240] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:55.085965 30705 raft_consensus.cc:697] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:11:55.086601 30596 consensus_queue.cc:1059] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:55.087723 30596 raft_consensus.cc:3055] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:55.088124 30596 raft_consensus.cc:740] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:55.046066 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:55.087208 30705 consensus_queue.cc:237] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:55.077664 30852 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:55.066206 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:55.089170 30596 consensus_queue.cc:260] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:55.092679 30596 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:55.095129 29527 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 4.
W20260709 13:11:55.096457 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.096841 30796 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:55.097729 29530 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 4.
I20260709 13:11:55.099066 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:55.099085 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:55.099205 29421 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:55.102624 29421 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:55.102718 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:55.105149 29453 raft_consensus.cc:2410] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:55.105088 29421 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:55.106236 29381 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 4.
I20260709 13:11:55.108237 29421 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:55.108381 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:55.110584 29421 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:55.111565 29379 raft_consensus.cc:1275] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:55.112221 29421 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:55.113106 29379 raft_consensus.cc:1275] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:55.110658 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:55.114091 29380 raft_consensus.cc:2393] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 2: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:55.109668 30857 raft_consensus.cc:2804] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:55.116834 30857 raft_consensus.cc:697] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 4 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:55.114559 30866 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:55.117532 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:55.117831 30866 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:55.118324 30866 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:55.117910 30857 consensus_queue.cc:237] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:55.120155 30807 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:55.121860 29373 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
I20260709 13:11:55.121275 29380 raft_consensus.cc:2955] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:55.122617 30807 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:55.123358 29376 raft_consensus.cc:1240] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:11:55.125305 30853 raft_consensus.cc:2749] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:55.107741 30855 raft_consensus.cc:2804] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:55.126236 30855 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.126582 30855 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:55.114732 30867 raft_consensus.cc:2749] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:55.106968 30859 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:55.129848 30848 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:55.131129 29525 raft_consensus.cc:2368] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 3. Current term is 4.
I20260709 13:11:55.131771 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:55.132234 29421 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:55.133059 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:55.151655 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:55.152397 29525 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:55.161463 29381 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:11:55.141347 29421 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:55.164367 29421 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:11:55.164979 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:55.166430 29346 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:11:55.168617 29346 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:55.172447 30595 raft_consensus.cc:2749] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:55.179618 30853 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:55.179984 30154 raft_consensus.cc:1240] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:55.183167 30853 consensus_queue.cc:1059] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:55.163179 30859 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:55.184036 30853 consensus_queue.cc:1243] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer ca041dab9b2f44409ed7bf4c6cf66ab2 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:11:55.185307 30807 raft_consensus.cc:3055] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:55.185777 30807 raft_consensus.cc:740] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:55.186750 30807 consensus_queue.cc:260] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:55.188503 30807 raft_consensus.cc:3060] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:55.192248 29421 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:55.192874 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:55.193518 29524 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:55.197837 29346 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:55.199559 29346 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:55.170729 30686 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:55.210204 29525 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 4.
I20260709 13:11:55.188519 30848 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:55.195362 30856 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:55.168987 30851 consensus_queue.cc:1048] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:11:55.189919 30867 raft_consensus.cc:2804] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:55.241583 29495 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:55.249742 29495 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:55.186764 30866 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:55.246198 29524 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:11:55.201793 30429 raft_consensus.cc:2764] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:11:55.250882 29495 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:55.254035 30581 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:55.254509 30581 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.254882 30581 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:55.255033 30157 raft_consensus.cc:1240] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 LEADER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:55.256671 30485 raft_consensus.cc:2804] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:55.257266 30485 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.257620 30485 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:55.208161 30579 raft_consensus.cc:2804] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:55.202105 30859 consensus_queue.cc:1048] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 13:11:55.246773 30595 consensus_queue.cc:1059] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:11:55.201557 30796 consensus_queue.cc:1048] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 13:11:55.247239 30856 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:55.288492 30848 consensus_queue.cc:1048] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:55.265144 30579 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.212956 30811 consensus_queue.cc:1048] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.070s
I20260709 13:11:55.244603 30852 consensus_queue.cc:1048] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:11:55.294152 30851 consensus_queue.cc:1059] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:55.266289 30646 raft_consensus.cc:2804] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:55.248960 30847 consensus_queue.cc:1048] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:11:55.296128 30703 raft_consensus.cc:3055] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:55.266978 30867 raft_consensus.cc:697] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 4 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:55.284052 30866 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:55.275421 30857 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:11:55.308207 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 95087.6us
I20260709 13:11:55.301254 30856 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:55.314785 29346 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:55.303162 30579 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:55.306185 30646 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:55.307894 30703 raft_consensus.cc:740] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:55.331293 29346 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:55.324747 30846 raft_consensus.cc:2749] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:55.336884 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 76485.4us
I20260709 13:11:55.320372 30851 consensus_queue.cc:1243] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer ca041dab9b2f44409ed7bf4c6cf66ab2 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:11:55.340960 29346 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:55.336023 30599 consensus_queue.cc:1048] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:11:55.333359 30596 consensus_queue.cc:1059] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:11:55.344659 30596 raft_consensus.cc:3055] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:55.345122 30596 raft_consensus.cc:740] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:55.346113 30596 consensus_queue.cc:260] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:55.334331 30646 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:55.348884 30867 consensus_queue.cc:237] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:55.344514 30884 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:55.355261 30851 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:55.357278 29346 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:11:55.359393 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.351368 30855 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:55.363755 30703 consensus_queue.cc:260] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:55.320173 30857 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:55.371675 30876 log.cc:927] Time spent T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:11:55.372186 30884 consensus_queue.cc:1048] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:55.371582 30851 raft_consensus.cc:2749] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:55.376626 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 113123us
I20260709 13:11:55.378075 29495 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:55.372102 30855 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:55.377663 30811 consensus_queue.cc:1048] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:11:55.380280 30852 consensus_queue.cc:1048] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:55.380570 30796 raft_consensus.cc:2764] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:11:55.377637 30599 consensus_queue.cc:1048] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
W20260709 13:11:55.385396 30879 log.cc:927] Time spent T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:11:55.379729 29346 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:55.374742 30596 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:55.376637 30846 consensus_queue.cc:1048] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
W20260709 13:11:55.390488 30877 log.cc:927] Time spent T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:11:55.376047 30857 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:55.401837 29346 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:55.403795 30846 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:55.404342 30846 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.404670 30846 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:55.404758 30837 raft_consensus.cc:3055] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:55.405297 30837 raft_consensus.cc:740] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:55.406229 30837 consensus_queue.cc:260] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:55.407616 30837 raft_consensus.cc:3060] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:55.407900 30579 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:55.410672 30581 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:55.417559 29346 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:55.415100 30686 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:55.415230 30886 log.cc:927] Time spent T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.060s	user 0.000s	sys 0.002s
I20260709 13:11:55.419627 30884 raft_consensus.cc:2804] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:55.432312 30884 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.432811 30884 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:55.428884 29346 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:55.436808 29346 leader_election.cc:400] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 2. Current term is 3.
I20260709 13:11:55.437671 29346 leader_election.cc:400] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 2. Current term is 3.
I20260709 13:11:55.438706 29346 leader_election.cc:400] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 2. Current term is 3.
I20260709 13:11:55.439322 29346 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:55.435653 30887 raft_consensus.cc:2749] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:55.441725 29346 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:55.440125 30599 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:55.443332 30811 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:55.432385 30686 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:11:55.444351 30888 consensus_queue.cc:1048] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:55.445745 30686 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:55.446837 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:55.449486 29346 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:55.450323 30851 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:55.450973 30851 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:55.452548 29421 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:55.453513 30867 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:55.453704 30579 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:55.453984 30867 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:55.454663 30867 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:55.454921 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:11:55.461272 29493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 44801.3us
I20260709 13:11:55.462898 29421 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:55.464838 29421 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:55.463541 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:55.465633 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:55.466233 29447 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:11:55.465672 30884 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:55.465569 30866 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:55.469414 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:55.469285 30646 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:55.469854 30857 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:55.470252 30857 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.470606 30857 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:55.471153 30884 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:55.473664 30485 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:55.475731 29524 raft_consensus.cc:1240] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:55.476181 29453 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
I20260709 13:11:55.480091 30856 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:55.482724 29449 raft_consensus.cc:1240] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:11:55.483052 30846 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:55.483811 30856 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:55.488237 29421 leader_election.cc:400] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 2. Current term is 3.
I20260709 13:11:55.469337 30866 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.490454 30686 consensus_queue.cc:1059] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:55.489995 29421 leader_election.cc:403] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:55.496646 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:55.497354 29454 raft_consensus.cc:2468] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
I20260709 13:11:55.491190 30485 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:55.492116 30811 raft_consensus.cc:3055] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:55.493332 30581 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:55.490774 30866 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:55.508689 29447 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
I20260709 13:11:55.510413 29421 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:55.521027 29421 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:55.522845 29421 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:55.489948 30646 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:55.527956 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:55.529084 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:55.539074 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:55.540169 29447 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:55.528505 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:55.541287 29376 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:55.541884 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:55.519034 29277 catalog_manager.cc:5697] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: config changed from index 2 to 3, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:55.543191 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:55.544055 29381 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:55.530690 29379 raft_consensus.cc:1275] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:55.545753 29380 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47da517282ee462792de545e40119636"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:11:55.546159 29379 raft_consensus.cc:1275] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:55.531476 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:55.532441 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:55.556887 29346 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:55.566593 29346 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:55.508574 30811 raft_consensus.cc:740] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:55.563908 29375 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:55.570456 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:55.571669 29454 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:55.546563 29380 raft_consensus.cc:606] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:55.577188 29380 raft_consensus.cc:614] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:55.579203 29378 raft_consensus.cc:2410] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:11:55.579106 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:55.544711 30799 raft_consensus.cc:2804] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:11:55.545830 30882 log.cc:927] Time spent T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.167s	user 0.002s	sys 0.001s
I20260709 13:11:55.539424 30859 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:55.563843 30855 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.542235 30853 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:55.560575 29447 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
I20260709 13:11:55.584210 29381 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
I20260709 13:11:55.567446 30846 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:55.611320 29375 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 4.
I20260709 13:11:55.574065 30686 raft_consensus.cc:2804] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:55.544158 30807 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 2. Current term is 3.
I20260709 13:11:55.605654 30811 consensus_queue.cc:260] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:55.583379 30599 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:55.597285 29346 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:55.616595 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:55.632591 29447 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:55.623575 29454 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:11:55.639679 29454 raft_consensus.cc:1275] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:11:55.641315 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 44271.7us
I20260709 13:11:55.628389 29372 raft_consensus.cc:1275] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:55.607403 30857 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:55.642390 30599 raft_consensus.cc:697] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:55.644918 30595 raft_consensus.cc:2804] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:55.642956 29381 raft_consensus.cc:1275] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:55.647840 29379 raft_consensus.cc:1275] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:55.618429 30686 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.625566 30799 raft_consensus.cc:697] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 3 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:55.650677 29451 raft_consensus.cc:1275] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:55.652768 29375 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
 from {username='slave'} at 127.0.0.1:41856
W20260709 13:11:55.655082 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.655186 29346 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:55.662542 29447 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
W20260709 13:11:55.663415 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 260539us
W20260709 13:11:55.669610 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 98078.3us
I20260709 13:11:55.689284 29376 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:11:55.611641 30855 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:55.690214 29375 raft_consensus.cc:606] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Received request to transfer leadership to TS ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:11:55.696785 29375 raft_consensus.cc:614] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:55.659191 30811 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:55.699302 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 44259.4us
I20260709 13:11:55.701646 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:55.705857 29419 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:55.709674 29451 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:55.709712 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:55.710858 29447 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:55.711845 29346 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:55.682753 30856 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.706647 29421 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:55.651214 30807 consensus_queue.cc:1048] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:11:55.724510 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:55.690512 30686 raft_consensus.cc:3060] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:55.735767 29419 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:55.738335 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:55.696143 30595 raft_consensus.cc:697] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:55.679661 30861 consensus_queue.cc:1048] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:11:55.706106 30596 raft_consensus.cc:2804] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:55.765604 29277 catalog_manager.cc:5697] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 1 to 3, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132). New cstate: current_term: 3 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:55.770952 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:55.771632 29454 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:55.774029 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:55.765621 29447 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:11:55.774884 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:55.775463 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:55.774899 29375 raft_consensus.cc:2393] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 4: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:11:55.776398 29447 raft_consensus.cc:1240] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:55.778285 29447 raft_consensus.cc:1240] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:11:55.778461 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:55.779435 29374 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:55.758987 29451 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:11:55.695644 30859 raft_consensus.cc:697] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 4 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:55.764178 29419 leader_election.cc:400] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 3. Current term is 4.
I20260709 13:11:55.770481 29277 catalog_manager.cc:5697] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:55.797190 29451 raft_consensus.cc:1240] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5. Ops: [3.2-4.3]
I20260709 13:11:55.782819 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:55.798581 29419 leader_election.cc:403] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:11:55.798709 29451 raft_consensus.cc:1240] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:11:55.799046 29380 raft_consensus.cc:2393] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 4: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:11:55.738770 30884 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.718953 30705 consensus_queue.cc:1048] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:11:55.718703 30848 consensus_queue.cc:1048] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:11:55.811169 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:55.811949 29379 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:55.719305 30646 consensus_queue.cc:1059] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:11:55.803714 30595 consensus_queue.cc:237] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:55.810889 29454 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:11:55.800436 29451 raft_consensus.cc:1240] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5. Ops: [3.2-4.3]
I20260709 13:11:55.757377 30808 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:55.737882 30853 raft_consensus.cc:697] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 4 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:55.837461 29278 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37586 (request call id 132) took 7661 ms. Trace:
W20260709 13:11:55.804852 30882 log.cc:927] Time spent T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:11:55.734923 30856 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:55.842702 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:55.843119 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:55.804061 30703 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:55.848727 29380 raft_consensus.cc:1275] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:55.849102 29379 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:11:55.825898 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:55.859872 30846 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.871711 30853 consensus_queue.cc:237] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:55.872342 30846 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:55.874477 30846 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:55.876313 29379 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:11:55.877081 29379 raft_consensus.cc:606] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
W20260709 13:11:55.880417 30906 log.cc:927] Time spent T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:11:55.876374 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:55.881613 29448 raft_consensus.cc:2393] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 4: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:11:55.882536 30861 consensus_queue.cc:1048] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:55.882947 29448 raft_consensus.cc:1240] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:55.884164 30913 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:55.884500 30915 raft_consensus.cc:2749] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:55.884951 30909 raft_consensus.cc:2749] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 3. Current term is 4.
I20260709 13:11:55.837922 30799 consensus_queue.cc:237] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:55.886214 30913 raft_consensus.cc:697] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 3 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:55.881511 30855 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:55.806666 30867 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:55.890793 29454 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:55.890753 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 303397us
I20260709 13:11:55.816704 30884 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:55.865172 30899 log.cc:927] Time spent T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:11:55.762580 30599 consensus_queue.cc:237] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:55.883074 30901 log.cc:927] Time spent T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:11:55.879267 30903 raft_consensus.cc:2749] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:55.913582 29454 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:11:55.847893 29278 rpcz_store.cc:276] 0709 13:11:48.175778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.176596 (+   818us) service_pool.cc:224] Handling call
0709 13:11:55.837383 (+7660787us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:54.890689 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:54.891335 (+   646us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:54.895073 (+  3738us) write_op.cc:435] Acquired schema lock
0709 13:11:54.895094 (+    21us) tablet.cc:662] Decoding operations
0709 13:11:54.895830 (+   736us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:54.895941 (+   111us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:54.895976 (+    35us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:11:54.896398 (+   422us) tablet.cc:701] Row locks acquired
0709 13:11:54.896417 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:11:54.896571 (+   154us) write_op.cc:270] Start()
0709 13:11:54.896706 (+   135us) write_op.cc:276] Timestamp: P: 1783602714896528 usec, L: 0
0709 13:11:54.896732 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:11:54.960551 (+ 63819us) log.cc:844] Serialized 1717 byte log entry
0709 13:11:55.341759 (+381208us) op_driver.cc:464] REPLICATION: finished
0709 13:11:55.443602 (+101843us) write_op.cc:301] APPLY: starting
0709 13:11:55.443696 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:55.443852 (+   156us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:55.443979 (+   127us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:55.444586 (+   607us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:55.444780 (+   194us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:11:55.444825 (+    45us) write_op.cc:312] APPLY: finished
0709 13:11:55.445066 (+   241us) log.cc:844] Serialized 40 byte log entry
0709 13:11:55.446707 (+  1641us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:55.446813 (+   106us) write_op.cc:454] Released schema lock
0709 13:11:55.446866 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:55.447232 (+   366us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:55.447483 (+   251us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":321403,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":100143,"apply.run_cpu_time_us":2202,"apply.run_wall_time_us":3641,"num_ops":4,"prepare.queue_time_us":139691,"prepare.run_cpu_time_us":15212,"prepare.run_wall_time_us":218484,"raft.queue_time_us":116518,"raft.run_cpu_time_us":9727,"raft.run_wall_time_us":112020,"replication_time_us":429019,"thread_start_us":394225,"threads_started":4,"wal-append.queue_time_us":220785}]]}
W20260709 13:11:55.995730 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 234980us
W20260709 13:11:55.995790 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 289237us
I20260709 13:11:55.996831 29421 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:55.997274 29419 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:56.000753 29421 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:11:56.001658 29419 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:55.847432 30910 consensus_queue.cc:1048] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 13:11:56.017709 29421 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:55.912391 30596 raft_consensus.cc:697] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:56.015751 30916 raft_consensus.cc:2749] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:56.027230 29419 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:11:56.029107 29419 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:56.030833 29419 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:56.012542 30915 raft_consensus.cc:2804] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:56.012825 30855 raft_consensus.cc:2749] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:56.110173 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:56.133554 29375 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:56.154227 30853 raft_consensus.cc:2749] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:56.166119 30596 consensus_queue.cc:237] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:56.166742 30705 consensus_queue.cc:1048] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:56.168680 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:56.169572 29376 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 2.
I20260709 13:11:56.033421 30807 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:56.176793 30866 consensus_meta.cc:287] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.638s	user 0.022s	sys 0.000s
I20260709 13:11:55.918294 30859 consensus_queue.cc:237] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:56.181542 30899 log.cc:927] Time spent T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
W20260709 13:11:56.245956 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 471550us
I20260709 13:11:56.269765 29495 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:56.271037 29495 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:56.271687 30893 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.271908 30894 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:56.272307 30893 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:56.271715 30581 consensus_queue.cc:1048] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:56.177608 30903 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:56.274354 30903 raft_consensus.cc:697] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:56.274910 30893 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:56.275307 30903 consensus_queue.cc:237] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:56.255993 30914 consensus_queue.cc:1048] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.037s
W20260709 13:11:56.257340 30896 log.cc:927] Time spent T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.266s	user 0.002s	sys 0.000s
I20260709 13:11:56.257649 30856 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:11:56.258683 30912 log.cc:927] Time spent T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
I20260709 13:11:56.171030 30922 consensus_queue.cc:1048] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.225s
I20260709 13:11:56.258956 30867 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:56.106655 30909 consensus_queue.cc:1048] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.138s
I20260709 13:11:56.281232 29495 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:56.220270 30853 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:56.260721 30884 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:56.282351 30888 raft_consensus.cc:3055] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:56.177268 30808 raft_consensus.cc:697] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:56.282760 30888 raft_consensus.cc:740] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:56.279157 30893 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:56.283424 30808 consensus_queue.cc:237] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:56.283635 30888 consensus_queue.cc:260] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:56.260466 30917 raft_consensus.cc:2749] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:56.219329 30915 raft_consensus.cc:697] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 4 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:56.132231 30913 consensus_queue.cc:237] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:56.314810 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:11:56.298671 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:56.237764 29375 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 4.
W20260709 13:11:56.324724 29374 consensus_meta.cc:287] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.531s	user 0.011s	sys 0.000s
I20260709 13:11:56.338364 29374 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:11:56.343770 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:56.345067 29525 raft_consensus.cc:2410] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:11:56.348121 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 317389us
I20260709 13:11:56.356854 29419 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:56.358806 29419 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:11:56.299917 30915 consensus_queue.cc:237] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:56.292207 30866 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:56.361593 30848 consensus_queue.cc:1048] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:11:56.374809 29451 raft_consensus.cc:1240] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:11:56.370700 29419 leader_election.cc:400] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 3. Current term is 4.
I20260709 13:11:56.379160 29419 leader_election.cc:403] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:11:56.381902 29419 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:56.307991 30581 consensus_queue.cc:1048] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 13:11:56.381655 30909 raft_consensus.cc:2749] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 3. Current term is 4.
W20260709 13:11:56.412482 30927 log.cc:927] Time spent T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.108s	user 0.004s	sys 0.000s
I20260709 13:11:56.375941 30848 consensus_queue.cc:1048] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:11:56.377280 30866 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:11:56.432606 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 50837.5us
I20260709 13:11:56.375643 30853 consensus_queue.cc:1059] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.062s
W20260709 13:11:56.412495 30119 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.010s	sys 0.008s
W20260709 13:11:56.373019 30811 consensus_meta.cc:287] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.652s	user 0.007s	sys 0.004s
W20260709 13:11:56.436262 29447 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.009s	sys 0.002s
W20260709 13:11:56.473058 29447 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.010s	sys 0.002s
I20260709 13:11:56.362195 30917 raft_consensus.cc:2749] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:56.434005 30703 consensus_meta.cc:287] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.567s	user 0.012s	sys 0.000s
I20260709 13:11:56.431388 30867 raft_consensus.cc:2749] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:11:56.471009 30119 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.010s	sys 0.008s
I20260709 13:11:56.478266 30703 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.479017 30703 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:56.474011 29277 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.014s	sys 0.031s
W20260709 13:11:56.443858 30686 consensus_meta.cc:287] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.680s	user 0.011s	sys 0.001s
I20260709 13:11:56.480891 30686 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:11:56.482079 30703 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:11:56.484122 29277 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.014s	sys 0.032s
W20260709 13:11:56.483863 30122 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.008s	sys 0.015s
I20260709 13:11:56.483712 30919 raft_consensus.cc:2749] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:56.488055 30122 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.009s	sys 0.015s
I20260709 13:11:56.497895 30867 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:56.474777 30846 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:56.498181 30919 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:56.507771 30890 raft_consensus.cc:2764] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:11:56.536675 29378 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
W20260709 13:11:56.528963 30902 log.cc:927] Time spent T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.241s	user 0.000s	sys 0.001s
I20260709 13:11:56.522681 30686 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:11:56.537283 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 125811us
I20260709 13:11:56.522135 30867 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:11:56.546100 30929 log.cc:927] Time spent T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:11:56.521456 30846 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:56.553710 30924 log.cc:927] Time spent T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 13:11:56.554296 30866 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:56.574352 30864 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:56.574160 30866 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:56.574968 30864 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:56.576853 30866 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:11:56.557699 30926 log.cc:927] Time spent T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.264s	user 0.001s	sys 0.001s
W20260709 13:11:56.578575 29373 consensus_meta.cc:287] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.685s	user 0.012s	sys 0.000s
I20260709 13:11:56.579000 29373 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:11:56.580199 30864 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:56.581126 30867 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:11:56.599841 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:56.601265 29524 raft_consensus.cc:2410] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:56.602011 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:56.535351 30919 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:56.622186 30919 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:56.596078 30799 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:56.624300 29377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52172 (request call id 824) took 1093 ms. Trace:
I20260709 13:11:56.628314 29377 rpcz_store.cc:276] 0709 13:11:55.530410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.530561 (+   151us) service_pool.cc:224] Handling call
0709 13:11:55.562858 (+ 32297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:55.563277 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:55.563318 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:55.737017 (+173699us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b18000c6880. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c672a6 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7a67fa11 00007f6a7a68f372 00007f6a7bdc1a01 00007f6a7bd8643a
0709 13:11:55.996251 (+259234us) spinlock_profiling.cc:243] Waited 993 us on lock 0x7b2c00062108. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7a67fa11 00007f6a7a68f372 00007f6a7bdc1a01 00007f6a7bd8643a 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2
0709 13:11:56.022302 (+ 26051us) log.cc:844] Serialized 26 byte log entry
0709 13:11:56.435547 (+413245us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:56.435592 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.435663 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:56.624049 (+188386us) raft_consensus.cc:1685] finished
0709 13:11:56.624070 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:56.624233 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":710,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":7374,"spinlock_wait_cycles":5112320,"thread_start_us":216209,"threads_started":1,"wal-append.queue_time_us":418210}
I20260709 13:11:56.624210 30799 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:56.641692 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 169267us
W20260709 13:11:56.651721 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 366073us
I20260709 13:11:56.624423 30940 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:56.671577 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:56.673506 29450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1343) took 1179 ms. Trace:
I20260709 13:11:56.673553 30940 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:56.674019 29450 rpcz_store.cc:276] 0709 13:11:55.494549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.494690 (+   141us) service_pool.cc:224] Handling call
0709 13:11:55.495029 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:55.498355 (+  3326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:55.498386 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:55.498831 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 13:11:56.012018 (+513187us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:56.152271 (+140253us) log.cc:844] Serialized 14 byte log entry
0709 13:11:56.167892 (+ 15621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.167972 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:56.494679 (+326707us) spinlock_profiling.cc:243] Waited 30.1 ms on lock 0x7b480012e7d8. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a80cafaa1 00007f6a80ca6b37 00007f6a80ca69ca 00007f6a80d9e26f 00007f6a80d9df37 00007f6a80db255c 00007f6a80db2508 00007f6a80db2488 00007f6a80db2443 00007f6a80db16ec 00007f6a7fcdba96
0709 13:11:56.556857 (+ 62178us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:11:56.673264 (+116407us) raft_consensus.cc:1685] finished
0709 13:11:56.673304 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:56.673445 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26504,"prepare.queue_time_us":22170,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":67,"raft.queue_time_us":102010,"raft.run_cpu_time_us":6100,"raft.run_wall_time_us":1000750,"spinlock_wait_cycles":100252800,"thread_start_us":448821,"threads_started":1,"wal-append.queue_time_us":767939}
I20260709 13:11:56.632990 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:11:56.678215 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:56.678865 29374 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:56.633116 30934 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:56.686959 29381 raft_consensus.cc:1275] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:56.730221 29453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1340) took 1241 ms. Trace:
I20260709 13:11:56.730870 29453 rpcz_store.cc:276] 0709 13:11:55.488706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.496234 (+  7528us) service_pool.cc:224] Handling call
0709 13:11:55.496539 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:55.518563 (+ 22024us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:55.518598 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:55.545080 (+ 26482us) log.cc:844] Serialized 26 byte log entry
0709 13:11:55.586769 (+ 41689us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:55.609716 (+ 22947us) log.cc:844] Serialized 14 byte log entry
0709 13:11:55.691965 (+ 82249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:55.692027 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:56.729940 (+1037913us) raft_consensus.cc:1685] finished
0709 13:11:56.729973 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:56.730138 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41330,"prepare.queue_time_us":29840,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":92145,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":31110,"spinlock_wait_cycles":7316864,"thread_start_us":86864,"threads_started":2,"wal-append.queue_time_us":346020}
W20260709 13:11:56.733660 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 47805.1us
I20260709 13:11:56.735898 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:56.737749 29374 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:11:56.736799 29381 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 2.
I20260709 13:11:56.747112 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:56.748517 29381 raft_consensus.cc:2393] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 4: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:11:56.683171 30595 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.754653 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:56.755128 29374 raft_consensus.cc:1275] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:56.727794 30942 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.744931 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:56.739135 30646 consensus_queue.cc:1048] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:11:56.740062 30890 consensus_queue.cc:1048] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:11:56.776459 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:56.777856 29374 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
W20260709 13:11:56.781498 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 101854us
I20260709 13:11:56.743973 30938 consensus_queue.cc:1048] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:11:56.744148 30934 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:56.761910 30595 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:56.801172 29381 raft_consensus.cc:2468] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 1.
W20260709 13:11:56.803857 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 69199.6us
I20260709 13:11:56.765566 30942 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:56.795836 29373 raft_consensus.cc:2393] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 4: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:11:56.807607 30940 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:56.797845 30846 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:56.818974 30799 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:56.821045 30595 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:56.813850 30890 consensus_queue.cc:1048] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:11:56.822129 30942 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:11:56.823202 30943 log.cc:927] Time spent T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:11:56.824698 30934 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:11:56.819250 30948 log.cc:927] Time spent T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:11:56.788686 30946 consensus_queue.cc:1048] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.030s
W20260709 13:11:56.857183 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 52021.1us
I20260709 13:11:56.867960 29495 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:56.869689 30946 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:56.870072 29495 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:56.869954 30959 consensus_queue.cc:1059] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:56.870947 30958 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:56.871591 29495 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:56.872476 30946 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:56.873996 30946 raft_consensus.cc:697] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:56.875597 30946 consensus_queue.cc:237] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:56.894381 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:56.894459 29524 raft_consensus.cc:1275] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:56.896931 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:56.897495 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:56.897810 29529 raft_consensus.cc:1275] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:56.896339 29525 raft_consensus.cc:1275] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:56.898370 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:56.897691 29527 raft_consensus.cc:2393] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 4: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:11:56.899999 29524 raft_consensus.cc:1275] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:56.900382 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:56.901167 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:56.901398 29527 raft_consensus.cc:1275] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:56.903821 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:56.904680 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:56.905525 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:56.907795 29450 raft_consensus.cc:1240] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:56.901199 29530 raft_consensus.cc:1275] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:56.912370 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:56.920820 29419 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:56.932464 29449 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:11:56.933357 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:56.934423 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:56.936062 29525 raft_consensus.cc:2393] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 4: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:11:56.936558 29449 raft_consensus.cc:2393] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 3: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:11:56.937625 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:56.939540 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:56.941486 29527 raft_consensus.cc:1240] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:56.947126 29450 raft_consensus.cc:1240] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:56.935132 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:56.945124 30646 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:56.956763 30853 raft_consensus.cc:2749] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:56.968168 29495 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:56.960032 30940 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.962594 30867 consensus_queue.cc:1048] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:11:56.955947 30930 consensus_queue.cc:1048] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:11:56.956228 30917 consensus_queue.cc:1048] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:11:56.977831 29419 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:56.969414 30646 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:56.990110 30853 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:56.990846 30853 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:56.995286 30853 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:56.991875 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:56.993309 30646 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:56.983042 30864 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:56.984424 30938 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.976619 30940 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:57.000100 29372 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:57.006223 30853 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:57.045835 29455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1339) took 1563 ms. Trace:
I20260709 13:11:57.015398 30938 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:57.046365 29455 rpcz_store.cc:276] 0709 13:11:55.481967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.484894 (+  2927us) service_pool.cc:224] Handling call
0709 13:11:55.485187 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:55.486983 (+  1796us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:11:55.626562 (+139579us) log.cc:844] Serialized 14 byte log entry
0709 13:11:55.797993 (+171431us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:55.804950 (+  6957us) log.cc:844] Serialized 26 byte log entry
0709 13:11:55.805163 (+   213us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:55.805448 (+   285us) log.cc:844] Serialized 14 byte log entry
0709 13:11:55.865698 (+ 60250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:55.865803 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:57.044131 (+1178328us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b24001c96b8. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78b1f9c4 00007f6a78b1dacb 00007f6a78cd8dc9 00007f6a78cd8a55 00007f6a78cd7fb0 00007f6a7b94e488 00007f6a7b94ebe8 00007f6a7b926398 00007f6a7b92176a 00007f6a7b920bb6
0709 13:11:57.045596 (+  1465us) raft_consensus.cc:1685] finished
0709 13:11:57.045620 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:57.045754 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58788,"prepare.queue_time_us":28118,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":88,"raft.queue_time_us":241502,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":1928,"spinlock_wait_cycles":29316864,"thread_start_us":289387,"threads_started":3,"wal-append.queue_time_us":251242}
W20260709 13:11:57.064848 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 97465.5us
I20260709 13:11:57.071883 29495 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:57.016125 30958 raft_consensus.cc:2749] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:11:57.051306 30941 log.cc:927] Time spent T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.299s	user 0.000s	sys 0.003s
I20260709 13:11:57.078225 29495 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:57.079875 30977 raft_consensus.cc:2749] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:57.081197 29495 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:57.082073 30977 consensus_queue.cc:1059] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:11:57.084853 30646 raft_consensus.cc:2804] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:57.085145 30974 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:57.038527 30853 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:57.080519 30958 consensus_queue.cc:1059] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:11:57.092671 30938 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:57.093436 30938 raft_consensus.cc:3055] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:57.093847 30938 raft_consensus.cc:740] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:57.094703 30938 consensus_queue.cc:260] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:57.079097 29372 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:11:57.094174 30857 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:57.103138 30958 raft_consensus.cc:1027] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 LEADER]: attempt to promote peer ca041dab9b2f44409ed7bf4c6cf66ab2: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:11:57.090808 30974 raft_consensus.cc:697] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:57.115964 30811 raft_consensus.cc:993] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5: : Instructing follower 183db85c071f489fbc8de63a9edd8a3a to start an election
I20260709 13:11:57.106266 30938 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:57.125943 29495 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:57.090360 30959 consensus_queue.cc:1059] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:11:57.110145 30940 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:57.106561 29372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 645) took 1326 ms. Trace:
I20260709 13:11:57.136811 30980 consensus_queue.cc:1059] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:11:57.134161 29495 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:57.132205 30894 consensus_queue.cc:1059] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
W20260709 13:11:57.137903 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 371770us
I20260709 13:11:57.136742 29372 rpcz_store.cc:276] 0709 13:11:55.773048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.782513 (+  9465us) service_pool.cc:224] Handling call
0709 13:11:56.991684 (+1209171us) spinlock_profiling.cc:243] Waited 5.59 ms on lock 0x7b5800010298. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61b71 00007f6a78c61a22 00007f6a81b7ac09 00007f6a80cd4ee0 00007f6a80d9e0ab 00007f6a80d9e131 00007f6a80d4c0a0 00007f6a80d4b984 00007f6a7a2c66d4 00007f6a7a2c6662
0709 13:11:57.099071 (+107387us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12850432}
I20260709 13:11:57.142856 30853 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:57.143945 30980 raft_consensus.cc:3055] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:57.144374 30980 raft_consensus.cc:740] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:57.144593 30894 raft_consensus.cc:3055] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:57.145023 30894 raft_consensus.cc:740] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:57.145298 30980 consensus_queue.cc:260] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:57.145875 30894 consensus_queue.cc:260] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:57.146798 30980 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:57.147171 30894 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:57.139142 30940 raft_consensus.cc:2804] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:57.153237 30940 raft_consensus.cc:697] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:57.110081 30974 consensus_queue.cc:237] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:57.139937 30944 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:57.149529 30853 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:57.149537 30851 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.173966 29380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52172 (request call id 830) took 1139 ms. Trace:
I20260709 13:11:57.158591 30811 raft_consensus.cc:1081] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Signalling peer 183db85c071f489fbc8de63a9edd8a3a to start an election
I20260709 13:11:57.181762 29381 raft_consensus.cc:1240] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:11:57.182893 30900 log.cc:927] Time spent T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 1.024s	user 0.003s	sys 0.000s
I20260709 13:11:57.158780 30944 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:57.183910 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:57.184700 29376 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:11:57.185503 30944 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:57.185889 29452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1338) took 1704 ms. Trace:
I20260709 13:11:57.176415 30958 raft_consensus.cc:3055] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:57.186630 30958 raft_consensus.cc:740] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:57.186378 29452 rpcz_store.cc:276] 0709 13:11:55.481634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.483703 (+  2069us) service_pool.cc:224] Handling call
0709 13:11:55.484019 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:55.484389 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:11:55.516231 (+ 31842us) log.cc:844] Serialized 14 byte log entry
0709 13:11:55.708711 (+192480us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:55.709580 (+   869us) log.cc:844] Serialized 26 byte log entry
0709 13:11:55.709729 (+   149us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:55.710261 (+   532us) log.cc:844] Serialized 14 byte log entry
0709 13:11:55.766349 (+ 56088us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:55.766469 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:57.182200 (+1415731us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:11:57.185655 (+  3455us) raft_consensus.cc:1685] finished
0709 13:11:57.185682 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:57.185822 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1259,"prepare.queue_time_us":32316,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":86,"raft.queue_time_us":249946,"raft.run_cpu_time_us":648,"raft.run_wall_time_us":22374,"spinlock_wait_cycles":27884288,"thread_start_us":279084,"threads_started":4,"wal-append.queue_time_us":478545}
I20260709 13:11:57.156584 30646 raft_consensus.cc:697] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:57.174248 30959 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:57.190317 29373 raft_consensus.cc:1240] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:11:57.190128 30938 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:57.189352 30958 consensus_queue.cc:260] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:57.174616 29380 rpcz_store.cc:276] 0709 13:11:56.035093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.151275 (+116182us) service_pool.cc:224] Handling call
0709 13:11:56.157130 (+  5855us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:56.430738 (+273608us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:56.430772 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:56.444091 (+ 13319us) log.cc:844] Serialized 52 byte log entry
0709 13:11:56.591414 (+147323us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:56.675383 (+ 83969us) log.cc:844] Serialized 14 byte log entry
0709 13:11:57.109962 (+434579us) spinlock_profiling.cc:243] Waited 44.1 ms on lock 0x7b18003ca180. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c13c0a 00007f6a82353219 00007f6a78c9ba40 00007f6a78c964e4 00007f6a78c96455 00007f6a7bd7e060 00007f6a7bd90716 00007f6a7bda1287 00007f6a7bda1208
0709 13:11:57.159186 (+ 49224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:57.159247 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:57.159281 (+    34us) raft_consensus.cc:1685] finished
0709 13:11:57.172989 (+ 13708us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:57.173253 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":117181,"prepare.queue_time_us":82624,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":561383,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":2115,"spinlock_wait_cycles":101317888,"thread_start_us":378324,"threads_started":4,"wal-append.queue_time_us":204123}
I20260709 13:11:57.173681 30851 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:57.158444 30853 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:57.173748 30857 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:57.188496 30977 consensus_queue.cc:1059] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:11:57.203238 30938 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:57.204407 30646 consensus_queue.cc:237] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:57.205472 30958 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:57.202714 30904 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:57.218016 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:57.221766 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:11:57.225626 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 70673.5us
I20260709 13:11:57.225687 29380 raft_consensus.cc:2376] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4. Re-sending same reply.
I20260709 13:11:57.226090 29521 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
I20260709 13:11:57.224198 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:57.227924 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:57.209421 29372 raft_consensus.cc:1240] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:57.229894 30812 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:57.230275 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:11:57.230532 30812 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:57.231981 29528 raft_consensus.cc:2393] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 4: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:11:57.233254 30982 raft_consensus.cc:3055] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:57.233364 30812 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:57.233801 30982 raft_consensus.cc:740] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:57.234362 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:57.235287 29523 raft_consensus.cc:2410] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:57.234758 30982 consensus_queue.cc:260] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:57.236025 30982 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:57.224646 30905 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.236708 30905 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:57.237448 29451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 692) took 1441 ms. Trace:
I20260709 13:11:57.237846 29451 rpcz_store.cc:276] 0709 13:11:55.795744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.858907 (+ 63163us) service_pool.cc:224] Handling call
0709 13:11:55.859270 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:56.378475 (+519205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:57.237154 (+858679us) spinlock_profiling.cc:243] Waited 515 ms on lock 0x7b54000190d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:11:57.237384 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1185060096}
I20260709 13:11:57.192073 30940 consensus_queue.cc:237] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:57.241293 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:57.241979 29521 raft_consensus.cc:3055] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:57.245569 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:57.242337 29521 raft_consensus.cc:740] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:57.252887 30851 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:57.225157 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:57.209436 30857 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:57.258286 29495 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:57.261801 30979 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:57.262938 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:57.264855 29372 raft_consensus.cc:2376] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4. Re-sending same reply.
I20260709 13:11:57.265427 30938 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:57.262488 30979 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:57.275954 30985 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:57.276192 30799 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.276384 30599 raft_consensus.cc:493] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:11:57.276741 30985 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:57.276754 30799 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:57.280272 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:57.288946 29376 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:11:57.277240 30599 raft_consensus.cc:515] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:57.300092 29376 raft_consensus.cc:1240] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:11:57.302654 29454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45796 (request call id 695) took 1466 ms. Trace:
I20260709 13:11:57.303153 29454 rpcz_store.cc:276] 0709 13:11:55.827526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.842598 (+ 15072us) service_pool.cc:224] Handling call
0709 13:11:57.293932 (+1451334us) spinlock_profiling.cc:243] Waited 30.7 ms on lock 0x7b54002909d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:11:57.294050 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70682880}
I20260709 13:11:57.293259 29373 raft_consensus.cc:2393] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 3: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:11:57.238969 30904 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:57.321810 30944 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.325659 30944 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:57.327945 30944 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:57.328130 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:57.329077 29377 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 2.
I20260709 13:11:57.330157 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:57.297874 30974 raft_consensus.cc:2804] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:57.292177 30905 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:57.332129 29381 raft_consensus.cc:1240] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:11:57.333077 30916 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:57.335681 30909 raft_consensus.cc:3055] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:57.331032 29374 raft_consensus.cc:1240] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:11:57.335840 30983 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.336294 30909 raft_consensus.cc:740] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:57.339553 29379 raft_consensus.cc:1240] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
W20260709 13:11:57.343578 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 52127us
I20260709 13:11:57.337605 30974 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:57.346972 30974 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:57.346344 30983 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:57.330564 30851 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.307751 30969 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:57.350740 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:57.313477 30970 consensus_queue.cc:1059] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:11:57.338732 30595 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.368062 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:57.363543 29421 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:57.372107 29421 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:57.373507 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:57.373965 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:57.375741 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:57.379264 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:57.380384 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:57.380887 29452 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
I20260709 13:11:57.381590 29453 raft_consensus.cc:2410] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:57.384111 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:57.385598 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:57.386458 29448 raft_consensus.cc:2393] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 4: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:11:57.334239 30980 consensus_queue.cc:1059] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:11:57.389371 29451 raft_consensus.cc:1275] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:57.370185 29344 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:57.393445 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:57.394366 29451 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
I20260709 13:11:57.390244 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:57.336716 30938 consensus_queue.cc:1059] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:11:57.387569 29421 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:57.401472 29453 raft_consensus.cc:1275] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:11:57.409442 29346 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:57.411638 29421 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:57.406566 29521 consensus_queue.cc:260] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:57.412743 29521 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:57.385946 30911 raft_consensus.cc:2804] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:57.335685 30916 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:11:57.433060 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:57.405210 30940 raft_consensus.cc:3055] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:57.408218 29344 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:11:57.432519 29448 raft_consensus.cc:1275] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:57.387658 30595 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:57.403669 30887 raft_consensus.cc:2804] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:57.359010 30851 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:57.449630 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:57.448835 30429 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:57.406111 29452 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6"
dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:45798
W20260709 13:11:57.452248 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 122307us
I20260709 13:11:57.452472 29380 raft_consensus.cc:1275] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:57.360790 30969 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:57.478715 30989 log.cc:927] Time spent T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:11:57.399832 30917 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:57.452302 29346 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:57.438730 30864 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:57.403129 30866 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:57.389273 29372 raft_consensus.cc:1240] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:11:57.465669 30990 raft_consensus.cc:3055] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:57.455693 30930 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:57.473946 29455 raft_consensus.cc:3060] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:57.476563 29495 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:57.403132 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:11:57.479288 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:57.497327 29452 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:57.522096 29380 raft_consensus.cc:1275] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:57.522568 29452 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:57.497784 30599 leader_election.cc:290] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:11:57.463016 30970 raft_consensus.cc:3055] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:11:57.498852 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 98716.5us
W20260709 13:11:57.499012 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 66050.5us
I20260709 13:11:57.454850 30911 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:57.408396 30903 consensus_queue.cc:1048] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:11:57.460448 30940 raft_consensus.cc:740] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:57.501385 29376 raft_consensus.cc:1275] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:57.508570 30930 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:57.500648 30579 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:57.474097 30887 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:57.518165 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:57.518878 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:57.519572 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:11:57.560720 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 46117.7us
W20260709 13:11:57.520025 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:57.561759 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:57.562129 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:57.521056 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:57.521400 29449 raft_consensus.cc:1240] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:11:57.497823 30904 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:57.503005 30986 raft_consensus.cc:2749] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:57.413812 30909 consensus_queue.cc:260] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:57.534437 29421 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:11:57.501789 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 49584us
I20260709 13:11:57.540416 30911 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:57.549379 29452 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:57.526973 30990 raft_consensus.cc:740] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:57.564121 29419 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:57.528501 30970 raft_consensus.cc:740] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:57.529982 30996 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:57.547163 29455 raft_consensus.cc:2410] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:11:57.530824 30979 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:57.577816 29373 raft_consensus.cc:2410] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:57.508318 30866 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:57.559057 30864 raft_consensus.cc:697] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
W20260709 13:11:57.591056 30991 log.cc:927] Time spent T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 13:11:57.592329 30998 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.574930 29495 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:57.568897 30983 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:57.583765 30909 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:57.581600 29521 raft_consensus.cc:1275] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
W20260709 13:11:57.582448 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 48094.3us
I20260709 13:11:57.566042 30887 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:57.573243 29346 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:11:57.600348 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 73845.5us
W20260709 13:11:57.587160 29378 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 650) took 1812 ms (client timeout 1783 ms). Trace:
I20260709 13:11:57.593876 30866 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:57.571445 29456 raft_consensus.cc:2393] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 4: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:11:57.556250 30930 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:57.600196 29521 pending_rounds.cc:85] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 1
W20260709 13:11:57.602587 29378 rpcz_store.cc:269] 0709 13:11:55.774502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.774649 (+   147us) service_pool.cc:224] Handling call
0709 13:11:57.586934 (+1812285us) spinlock_profiling.cc:243] Waited 710 ms on lock 0x7b54001d3654. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:11:57.587071 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1633324416}
I20260709 13:11:57.582484 30429 consensus_queue.cc:1048] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
W20260709 13:11:57.604362 30992 log.cc:927] Time spent T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:11:57.586635 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:11:57.581295 30904 consensus_queue.cc:1048] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:11:57.588588 30949 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.628197 30949 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:57.601854 29346 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:57.632143 30811 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:11:57.584578 30905 consensus_queue.cc:1175] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "429e58eb058349e3bf72b5a870c8f6e5" responder_term: 3 status { last_received { term: 3 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 3 index: 2 } }
I20260709 13:11:57.613678 30983 raft_consensus.cc:2804] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:57.616866 29419 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:57.617226 31002 raft_consensus.cc:2804] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:57.616938 30999 consensus_queue.cc:1048] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:11:57.617780 30997 consensus_queue.cc:1048] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:11:57.590253 30996 raft_consensus.cc:697] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:11:57.620369 29521 pending_rounds.cc:107] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:11:57.619792 29421 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:57.599632 30646 raft_consensus.cc:2804] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:57.593325 30998 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:57.590132 30969 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:57.639328 29346 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:57.605720 30958 consensus_queue.cc:1059] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:11:57.659237 29521 raft_consensus.cc:2889] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:57.649480 30851 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:57.649102 30983 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:57.586112 30940 consensus_queue.cc:260] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:57.673874 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:57.674484 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:57.655045 30916 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:57.699451 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:11:57.702979 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 63787.1us
I20260709 13:11:57.656617 31002 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:57.604511 30970 consensus_queue.cc:260] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:57.660728 30646 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:57.710973 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:57.691191 30859 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:57.715270 29523 raft_consensus.cc:1275] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:11:57.717900 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:57.718348 29523 pending_rounds.cc:85] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 1
I20260709 13:11:57.718679 29523 pending_rounds.cc:107] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:11:57.718747 29530 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:11:57.719033 29523 raft_consensus.cc:2889] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:57.716292 29525 raft_consensus.cc:2410] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:57.720871 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:57.694983 30983 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:57.714012 31001 raft_consensus.cc:2749] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:57.720887 30996 consensus_queue.cc:237] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:57.724547 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 125253us
I20260709 13:11:57.729920 29525 raft_consensus.cc:1275] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:11:57.730639 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 110951us
W20260709 13:11:57.731791 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:57.707878 30811 raft_consensus.cc:2749] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:57.734567 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:11:57.739444 29495 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.783s (SENT) [suppressed 45 similar messages]
I20260709 13:11:57.742695 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:57.744752 29522 raft_consensus.cc:1275] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:11:57.745157 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 90942.6us
I20260709 13:11:57.746140 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:57.746418 29419 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:57.746698 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:57.747592 29524 raft_consensus.cc:2410] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:57.717922 30646 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:57.706544 30969 consensus_queue.cc:1048] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:11:57.750849 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:57.751436 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:57.721151 30904 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:57.712386 31002 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:57.756346 29377 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:11:57.657809 30864 consensus_queue.cc:237] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:57.764412 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:57.765069 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:57.726399 30894 consensus_queue.cc:1059] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:11:57.715567 30984 consensus_queue.cc:1048] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:11:57.733544 30940 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:57.766440 29419 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:11:57.793866 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:11:57.761772 30946 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:11:57.732975 30429 consensus_queue.cc:1048] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:11:57.766664 30904 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:57.782042 30949 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:57.795431 30997 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:57.819584 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 53230.2us
I20260709 13:11:57.768349 30999 consensus_queue.cc:1048] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.045s
W20260709 13:11:57.827054 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 94267.3us
I20260709 13:11:57.829584 31004 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:57.816481 30904 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:57.805868 31010 consensus_queue.cc:1048] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.040s
W20260709 13:11:57.917725 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 73276.3us
W20260709 13:11:57.916133 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 85497.8us
W20260709 13:11:57.925426 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 96137.8us
W20260709 13:11:57.976941 31020 log.cc:927] Time spent T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:11:57.955586 29456 raft_consensus.cc:1240] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:57.984064 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:57.988131 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:57.989830 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:11:57.991886 31005 log.cc:927] Time spent T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 13:11:57.992955 30811 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:57.996134 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:57.997469 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:58.001461 29451 raft_consensus.cc:1275] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:11:57.925266 31001 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.025259 31001 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:58.030846 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:58.010957 31012 log.cc:927] Time spent T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 13:11:58.041592 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:58.042908 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:57.999087 31021 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.045542 29524 raft_consensus.cc:1275] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:57.993544 30811 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:58.022660 30998 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:58.047804 29419 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:58.061020 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:57.978717 31014 consensus_queue.cc:1048] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.088s
I20260709 13:11:58.044282 30999 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.064376 31015 consensus_queue.cc:1059] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:11:58.075467 30969 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:58.039243 30866 consensus_queue.cc:1048] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:11:58.104815 29453 raft_consensus.cc:1240] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:11:58.105460 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 57783.3us
I20260709 13:11:58.141419 29419 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:11:58.146341 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.094833 30998 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:11:58.162241 30909 consensus_meta.cc:287] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.557s	user 0.012s	sys 0.004s
I20260709 13:11:58.161196 30864 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:58.212426 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:58.218040 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:58.058852 31021 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:58.214178 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.218603 29447 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
I20260709 13:11:58.219697 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:58.221977 29380 raft_consensus.cc:2376] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4. Re-sending same reply.
I20260709 13:11:58.223692 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:58.095346 30999 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:58.224614 29380 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 4.
I20260709 13:11:58.076205 30969 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:58.186352 30890 raft_consensus.cc:493] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:11:58.197299 30955 raft_consensus.cc:493] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:11:58.225214 30909 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.231279 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:58.246404 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:58.199443 30979 consensus_queue.cc:1048] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:11:58.217407 30599 consensus_queue.cc:1048] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:11:58.256300 29373 raft_consensus.cc:2393] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 4: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:11:58.235838 30916 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:11:58.259287 30974 consensus_meta.cc:287] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.906s	user 0.012s	sys 0.003s
I20260709 13:11:58.233141 29421 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:58.280988 31001 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:11:58.277969 30930 consensus_meta.cc:287] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.656s	user 0.009s	sys 0.005s
W20260709 13:11:58.324085 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 91084.1us
I20260709 13:11:58.326504 29421 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:58.253990 30909 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:58.265570 30646 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:58.329840 29421 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:58.240434 30890 raft_consensus.cc:515] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:58.242499 30955 raft_consensus.cc:515] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:58.323184 30999 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:58.276515 30916 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:58.328861 30866 raft_consensus.cc:2749] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:58.332451 31001 raft_consensus.cc:2804] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:58.331153 30811 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:58.330495 30930 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:58.282109 30974 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:58.138604 30981 raft_consensus.cc:2955] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:11:58.339864 30979 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:58.354497 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.392117 30974 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:58.360975 30909 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:11:58.358403 31017 log.cc:927] Time spent T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.175s	user 0.000s	sys 0.002s
I20260709 13:11:58.349011 30646 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:11:58.392108 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.344523 31001 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:58.346240 29521 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
I20260709 13:11:58.395195 31001 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:58.355088 31002 consensus_meta.cc:287] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.560s	user 0.002s	sys 0.010s
I20260709 13:11:58.395958 31002 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:58.398147 29449 raft_consensus.cc:1240] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:58.367108 30930 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:58.365475 31021 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:58.401337 29377 raft_consensus.cc:606] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:58.401819 29377 raft_consensus.cc:614] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:11:58.377002 30940 consensus_meta.cc:287] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.579s	user 0.011s	sys 0.003s
I20260709 13:11:58.360985 30916 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:58.370520 30944 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.403430 29495 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:11:58.369027 30887 consensus_meta.cc:287] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.754s	user 0.005s	sys 0.008s
I20260709 13:11:58.410090 29421 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:58.419189 29495 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:11:58.369097 30859 consensus_meta.cc:287] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.638s	user 0.008s	sys 0.006s
I20260709 13:11:58.428064 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:58.366087 30969 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:11:58.405941 30944 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:58.420398 30983 consensus_meta.cc:287] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.677s	user 0.012s	sys 0.000s
I20260709 13:11:58.432312 29495 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:58.369702 30890 leader_election.cc:290] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:11:58.342527 30998 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:58.447708 30977 raft_consensus.cc:2749] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:58.448508 29495 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:58.426484 30996 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.398272 31002 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:58.471204 30119 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:58.427083 30848 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:58.478804 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:58.423811 30909 raft_consensus.cc:2749] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:58.481462 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:58.364421 30904 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:58.439121 31033 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:58.431285 30940 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:11:58.440497 30859 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:58.471396 30911 consensus_meta.cc:287] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.889s	user 0.012s	sys 0.004s
I20260709 13:11:58.492815 29522 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
I20260709 13:11:58.494370 31027 raft_consensus.cc:2749] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:58.508739 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:58.509913 29522 raft_consensus.cc:2410] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:58.491858 30996 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:58.511770 30853 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:58.512868 30904 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:58.420761 30887 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:58.491026 30959 raft_consensus.cc:2804] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:58.514430 29447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45798 (request call id 1361) took 1140 ms. Trace:
I20260709 13:11:58.518383 29447 rpcz_store.cc:276] 0709 13:11:57.373921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.375386 (+  1465us) service_pool.cc:224] Handling call
0709 13:11:58.514176 (+1138790us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b5400127354. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:11:58.514335 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1936229120}
W20260709 13:11:58.496417 30917 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.968s	user 0.008s	sys 0.049s
I20260709 13:11:58.470029 30983 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:58.515269 29448 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
I20260709 13:11:58.516934 30955 leader_election.cc:290] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:11:58.513192 30996 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:58.517594 30887 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:58.514781 30911 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:58.487758 30998 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:58.541903 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:58.543085 29374 raft_consensus.cc:2393] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 4: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:11:58.537824 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:58.548581 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:58.517719 30990 consensus_queue.cc:260] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:58.552583 30990 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:58.550153 31016 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:58.525071 30917 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.999s	user 0.008s	sys 0.049s
I20260709 13:11:58.557854 29447 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:58.508431 30940 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:58.536482 30959 raft_consensus.cc:697] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
W20260709 13:11:58.571645 31011 log.cc:927] Time spent T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.797s	user 0.004s	sys 0.000s
I20260709 13:11:58.572515 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:58.559048 30917 raft_consensus.cc:697] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 4 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:58.577597 30944 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:58.587196 29447 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
I20260709 13:11:58.589083 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:58.590025 29447 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
I20260709 13:11:58.586241 30998 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:11:58.597666 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:58.605613 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.555174 31016 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:58.600723 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:58.614880 29419 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:58.625170 31001 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:58.617625 30911 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:58.624150 30904 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:58.638588 29450 raft_consensus.cc:1240] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:58.643416 31046 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.619961 30959 consensus_queue.cc:237] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:58.644281 31046 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:58.648279 30983 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:58.648977 31046 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:58.622728 30917 consensus_queue.cc:237] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:58.656771 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:58.656955 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:58.640195 30904 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:58.657893 30904 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:58.658393 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:58.658100 29450 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:58.661233 31016 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:58.662669 30857 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:58.663969 31001 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:58.665194 30940 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:11:58.673418 29450 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
I20260709 13:11:58.673914 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:58.692876 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:58.691694 30981 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:53424 (request call id 4) took 13873 ms. Trace:
I20260709 13:11:58.703586 30904 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:58.706084 30904 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:58.701534 29377 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 4.
I20260709 13:11:58.709617 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:58.711937 29377 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:58.701651 30981 rpcz_store.cc:276] 0709 13:11:44.817292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:44.837521 (+ 20229us) service_pool.cc:224] Handling call
0709 13:11:44.997727 (+160206us) log.cc:844] Serialized 513 byte log entry
0709 13:11:45.405798 (+408071us) spinlock_profiling.cc:243] Waited 1.67 ms on lock 0x7b180022eac0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c13c0a 00007f6a82353219 00007f6a78c9ba40 00007f6a78c964e4 00007f6a78c96455 00007f6a7bcdfb0b 00007f6a7bd64b63 00007f6a7bd8c752 00007f6a80d4cd29
0709 13:11:58.684939 (+13279141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":226248,"raft.queue_time_us":251041,"raft.run_cpu_time_us":2613,"raft.run_wall_time_us":25918,"spinlock_wait_cycles":3841792,"thread_start_us":141439,"threads_started":1,"wal-append.queue_time_us":359671,"wal-append.run_cpu_time_us":3546,"wal-append.run_wall_time_us":1019551}
I20260709 13:11:58.715834 30595 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:11:58.720925 31039 log.cc:927] Time spent T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:11:58.722541 30888 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:58.729187 31046 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:58.730080 31046 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:58.736982 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:58.741250 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:58.744693 29380 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:58.742233 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:58.746295 29381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52172 (request call id 850) took 1417 ms. Trace:
I20260709 13:11:58.746677 29381 rpcz_store.cc:276] 0709 13:11:57.328735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.334788 (+  6053us) service_pool.cc:224] Handling call
0709 13:11:58.742037 (+1407249us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b5800010298. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61b71 00007f6a78c61a22 00007f6a81b7ac09 00007f6a80cd4ee0 00007f6a80d9e0ab 00007f6a80d9e131 00007f6a80d4c0a0 00007f6a80d4b984 00007f6a7a2c66d4 00007f6a7a2c6662
0709 13:11:58.746224 (+  4187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5435776}
I20260709 13:11:58.748342 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:58.749117 29381 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:11:58.750193 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:58.757527 30581 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:58.763115 29377 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:11:58.767030 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:58.768549 29381 raft_consensus.cc:2368] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 3. Current term is 4.
I20260709 13:11:58.769941 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:58.770864 29381 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:11:58.772713 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:58.777750 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:58.777835 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:58.780980 29377 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:11:58.781607 29380 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:11:58.782280 29377 raft_consensus.cc:606] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:58.779722 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:58.758760 31033 raft_consensus.cc:2749] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:58.786355 30904 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:11:58.806696 29448 raft_consensus.cc:1275] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:58.794369 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:58.795893 30799 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:58.776136 30938 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:58.797760 31046 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:58.758765 30581 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:58.799571 30940 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:58.761292 30959 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.812501 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:58.823169 29448 raft_consensus.cc:2368] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 3. Current term is 4.
I20260709 13:11:58.812537 29447 raft_consensus.cc:1240] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:58.820363 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:11:58.826351 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:58.827768 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:58.828402 29447 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:58.830647 29327 auto_rebalancer.cc:629] Failed to schedule move for tablet ab0baf9ea21a4fe78401601893e7ff66: Illegal state: Replica 71aa3578fd924765ab9ac0729c8d1483 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:11:58.813536 30961 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:58.846966 29447 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:11:58.849056 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:58.855075 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:11:58.812563 30904 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:58.816184 30938 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:58.862104 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:11:58.850028 29372 raft_consensus.cc:2410] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:11:58.863658 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:58.857580 30799 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.824514 30940 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:58.864625 29493 leader_election.cc:304] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:11:58.872236 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:58.871682 31010 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.873960 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:11:58.874078 31010 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:58.858250 30988 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.859390 30157 raft_consensus.cc:2955] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 LEARNER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:11:58.875006 30938 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:58.831456 30959 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:58.884189 29447 raft_consensus.cc:1240] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:58.886570 29447 raft_consensus.cc:1240] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:58.889672 29493 leader_election.cc:304] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:11:58.894240 31045 raft_consensus.cc:2749] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:58.896219 30940 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:58.878322 29372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 672) took 1133 ms. Trace:
I20260709 13:11:58.897135 29372 rpcz_store.cc:276] 0709 13:11:57.742627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.745327 (+  2700us) service_pool.cc:224] Handling call
0709 13:11:58.794154 (+1048827us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b5800010298. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61b71 00007f6a78c61a22 00007f6a81b7ac09 00007f6a80cd4ee0 00007f6a80d9e0ab 00007f6a80d9e131 00007f6a80d4c0a0 00007f6a80d4b984 00007f6a7a2c66d4 00007f6a7a2c6662
0709 13:11:58.876161 (+ 82007us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36479360}
I20260709 13:11:58.898465 29450 raft_consensus.cc:1240] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:58.904780 29447 raft_consensus.cc:1275] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:58.838212 30961 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:58.909682 30581 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:58.911289 29453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 715) took 1173 ms. Trace:
I20260709 13:11:58.911765 29453 rpcz_store.cc:276] 0709 13:11:57.738406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.738594 (+   188us) service_pool.cc:224] Handling call
0709 13:11:57.738987 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:58.139245 (+400258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:58.910996 (+771751us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b54000190d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:11:58.911222 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":821378944}
I20260709 13:11:58.875532 30988 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:58.876618 30799 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:58.909834 31009 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:58.910410 30959 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:58.906122 30981 raft_consensus.cc:3055] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:58.917630 30981 raft_consensus.cc:740] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
W20260709 13:11:58.918286 31055 log.cc:927] Time spent T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:11:58.917089 30904 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:11:58.910636 29372 raft_consensus.cc:1275] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:58.921993 29452 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:58.902565 30893 raft_consensus.cc:2749] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:58.907465 30911 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:58.929256 29452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:45798 (request call id 1368) took 1537 ms. Trace:
I20260709 13:11:58.929733 29452 rpcz_store.cc:276] 0709 13:11:57.392417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.401272 (+  8855us) service_pool.cc:224] Handling call
0709 13:11:58.918585 (+1517313us) spinlock_profiling.cc:243] Waited 3.11 ms on lock 0x7b54000523d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd7da3d 00007f6a80d4dcd0 00007f6a7a2d2254 00007f6a7a2d21e2 00007f6a7a2d2111 00007f6a7a2d208c 00007f6a7a2d1342 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:11:58.922575 (+  3990us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7151360}
W20260709 13:11:58.937561 31059 log.cc:927] Time spent T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:11:58.910749 31010 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:58.918668 30981 consensus_queue.cc:260] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:11:58.958559 30981 raft_consensus.cc:3060] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:58.960362 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:11:58.963722 30971 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:58.959746 31019 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:58.971908 29327 auto_rebalancer.cc:629] Failed to schedule move for tablet 6847a37cf6234a13a2fb53ac3cefaa64: Illegal state: Replica 183db85c071f489fbc8de63a9edd8a3a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:11:58.972555 30988 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:58.973379 30970 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:58.973256 31019 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:58.914978 31009 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:58.950392 30911 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:58.977415 29527 raft_consensus.cc:1275] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:11:58.981278 31063 log.cc:927] Time spent T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.086s	user 0.001s	sys 0.001s
I20260709 13:11:58.985394 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:58.969177 30971 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:58.995277 29455 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45798 (request call id 1360) took 1621 ms (client timeout 1709 ms). Trace:
I20260709 13:11:58.995764 29454 raft_consensus.cc:1240] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 3. Current term is 4. Ops: []
W20260709 13:11:58.995864 29455 rpcz_store.cc:269] 0709 13:11:57.373482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.373734 (+   252us) service_pool.cc:224] Handling call
0709 13:11:58.994971 (+1621237us) spinlock_profiling.cc:243] Waited 99.2 ms on lock 0x7b540001a9d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:11:58.995187 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":228248448}
I20260709 13:11:58.996888 29454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 711) took 1477 ms. Trace:
I20260709 13:11:58.997269 29454 rpcz_store.cc:276] 0709 13:11:57.519555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.521380 (+  1825us) service_pool.cc:224] Handling call
0709 13:11:58.995541 (+1474161us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:58.996111 (+   570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:58.996682 (+   571us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b540001a9d0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd858ad 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:11:58.996830 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3353964416}
I20260709 13:11:58.995414 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:59.001238 30119 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:59.001572 29379 raft_consensus.cc:1275] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:59.002323 29379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52172 (request call id 847) took 1674 ms. Trace:
I20260709 13:11:59.002619 29379 rpcz_store.cc:276] 0709 13:11:57.327827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.361007 (+ 33180us) service_pool.cc:224] Handling call
0709 13:11:59.000811 (+1639804us) spinlock_profiling.cc:243] Waited 6.48 ms on lock 0x7b5800010298. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61b71 00007f6a78c61a22 00007f6a81b7ac09 00007f6a80cd4ee0 00007f6a80d9e0ab 00007f6a80d9e131 00007f6a80d5ffc0 00007f6a80d4a929 00007f6a80d4a3d2 00007f6a7a2c1bd4
0709 13:11:59.001098 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:59.002043 (+   945us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:59.002263 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14899584}
I20260709 13:11:59.015012 29373 raft_consensus.cc:1275] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:59.001775 30961 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:59.014652 30985 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:59.031523 29421 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:59.032985 29421 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:59.037710 29373 raft_consensus.cc:1275] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:59.028209 30944 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:11:59.039989 30971 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:59.039573 30944 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:59.041452 30911 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:59.016474 30705 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:59.038542 31009 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:59.058157 28234 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 13:11:59.063783 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.026775 30986 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.061262 29421 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:59.072702 29346 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:59.058808 30866 raft_consensus.cc:2804] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:59.067039 30969 raft_consensus.cc:2749] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:59.057951 30971 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.074263 29380 raft_consensus.cc:1240] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:11:59.073592 31054 log.cc:927] Time spent T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.305s	user 0.004s	sys 0.000s
I20260709 13:11:59.075834 29346 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:59.068849 29421 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:59.072494 30911 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:59.090786 29528 raft_consensus.cc:1275] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:11:59.091264 29528 pending_rounds.cc:85] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 2
I20260709 13:11:59.091523 29528 pending_rounds.cc:107] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:11:59.091761 29528 raft_consensus.cc:2889] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:59.093850 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:59.086213 29421 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:59.096597 29524 raft_consensus.cc:1275] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:11:59.096966 29524 pending_rounds.cc:85] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 2
I20260709 13:11:59.097189 29524 pending_rounds.cc:107] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:11:59.097430 29524 raft_consensus.cc:2889] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:59.098855 29524 raft_consensus.cc:1240] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:59.072721 29373 raft_consensus.cc:1275] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:59.100806 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:59.070631 30944 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:11:59.076078 30866 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.072185 31021 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:11:59.076572 30949 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:59.103864 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:59.110617 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:59.106381 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
W20260709 13:11:59.107048 31026 log.cc:927] Time spent T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 1.032s	user 0.003s	sys 0.000s
I20260709 13:11:59.070824 30986 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:59.113997 29346 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:59.101481 30969 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:59.103443 31009 raft_consensus.cc:2804] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:59.126837 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:59.128047 29524 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:11:59.131510 30429 raft_consensus.cc:2804] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:59.132035 30429 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.132381 30429 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:59.133991 31008 log.cc:927] Time spent T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 1.359s	user 0.004s	sys 0.000s
I20260709 13:11:59.135754 30983 consensus_queue.cc:1059] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:59.138028 30595 raft_consensus.cc:3055] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:59.138478 30595 raft_consensus.cc:740] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:11:59.139179 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.139336 30595 consensus_queue.cc:260] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:59.141073 29524 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
I20260709 13:11:59.143031 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:59.144021 29524 raft_consensus.cc:2410] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:59.146481 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:59.108172 30866 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:59.114897 29344 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:59.107141 30851 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.116778 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:59.112226 30846 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.118306 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:59.124082 30987 raft_consensus.cc:2804] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:59.084285 30971 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:59.112721 30985 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:11:59.103574 30859 consensus_queue.cc:1048] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:11:59.112658 30949 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:59.156432 30686 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:59.158576 31009 raft_consensus.cc:697] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:11:59.164225 30985 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:59.119830 31021 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:59.168159 30971 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:59.163407 30887 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:59.173260 30949 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:59.199066 29530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 800) took 1464 ms. Trace:
I20260709 13:11:59.163143 30851 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:59.169773 30846 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:59.199626 29530 rpcz_store.cc:276] 0709 13:11:57.734489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.734678 (+   189us) service_pool.cc:224] Handling call
0709 13:11:57.735117 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:57.811036 (+ 75919us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:11:57.811082 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:57.818660 (+  7578us) log.cc:844] Serialized 26 byte log entry
0709 13:11:58.034569 (+215909us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:58.034631 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:58.034752 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:59.106426 (+1071674us) spinlock_profiling.cc:243] Waited 62.4 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:11:59.191872 (+ 85446us) raft_consensus.cc:1685] finished
0709 13:11:59.191898 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:59.198983 (+  7085us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":56006,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":4632,"spinlock_wait_cycles":143484800,"thread_start_us":196833,"threads_started":2,"wal-append.queue_time_us":240793}
W20260709 13:11:59.199174 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 66387.1us
I20260709 13:11:59.205015 29346 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:59.206918 29346 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:59.210884 30890 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:59.211858 30890 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:59.213001 30579 consensus_queue.cc:1048] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:59.214877 30890 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:59.218703 30986 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:59.219152 30846 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:59.219280 30851 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:59.227833 29376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52172 (request call id 852) took 1898 ms. Trace:
I20260709 13:11:59.228456 29376 rpcz_store.cc:276] 0709 13:11:57.329355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.473933 (+144578us) service_pool.cc:224] Handling call
0709 13:11:57.474316 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:57.542965 (+ 68649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:59.227446 (+1684481us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b54003c41d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:11:59.227748 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58832640}
I20260709 13:11:59.228988 30890 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:59.229647 30890 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:59.232720 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:59.233206 31021 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:11:59.233623 31009 consensus_queue.cc:237] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:59.236284 30985 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:11:59.236670 31073 raft_consensus.cc:2804] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:59.236851 30595 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:59.242259 29375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52172 (request call id 858) took 1039 ms. Trace:
W20260709 13:11:59.246003 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 93706us
I20260709 13:11:59.236054 30958 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:59.198010 30887 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:59.246665 29375 rpcz_store.cc:276] 0709 13:11:58.203195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.203462 (+   267us) service_pool.cc:224] Handling call
0709 13:11:59.232541 (+1029079us) spinlock_profiling.cc:243] Waited 4.13 ms on lock 0x7b5800010298. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61b71 00007f6a78c61a22 00007f6a81b7ac09 00007f6a80cd4ee0 00007f6a80d9e0ab 00007f6a80d9e131 00007f6a80d4c0a0 00007f6a80d4b984 00007f6a7a2c66d4 00007f6a7a2c6662
0709 13:11:59.242173 (+  9632us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9509248}
I20260709 13:11:59.241473 30846 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:59.241993 31007 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:59.258031 29379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52172 (request call id 871) took 1032 ms. Trace:
I20260709 13:11:59.263285 29379 rpcz_store.cc:276] 0709 13:11:58.225739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:59.005909 (+780170us) service_pool.cc:224] Handling call
0709 13:11:59.006517 (+   608us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:59.070517 (+ 64000us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:59.070578 (+    61us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:59.071258 (+   680us) log.cc:844] Serialized 52 byte log entry
0709 13:11:59.149560 (+ 78302us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:59.179620 (+ 30060us) log.cc:844] Serialized 14 byte log entry
0709 13:11:59.257582 (+ 77962us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:59.257667 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:59.257717 (+    50us) raft_consensus.cc:1685] finished
0709 13:11:59.257739 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:59.257944 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70569,"prepare.queue_time_us":47829,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":104998,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":181,"thread_start_us":155349,"threads_started":2,"wal-append.queue_time_us":132414}
I20260709 13:11:59.255805 30987 raft_consensus.cc:697] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:59.261042 30846 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.274682 30429 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:59.276443 31019 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:59.278247 31073 raft_consensus.cc:697] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:11:59.279021 30686 raft_consensus.cc:2749] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:59.263777 31007 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:59.258498 30958 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:59.281664 29521 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37968 (request call id 1553) took 1583 ms (client timeout 1883 ms). Trace:
W20260709 13:11:59.291388 29521 rpcz_store.cc:269] 0709 13:11:57.698838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.699038 (+   200us) service_pool.cc:224] Handling call
0709 13:11:59.281454 (+1582416us) spinlock_profiling.cc:243] Waited 646 ms on lock 0x7b5400303ed4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:11:59.281569 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1484990720}
I20260709 13:11:59.294740 30429 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:59.296566 30890 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:59.296079 31073 consensus_queue.cc:237] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:59.284860 30846 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:59.319833 29344 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:11:59.324882 29344 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:59.302738 30949 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:59.331306 29381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52172 (request call id 867) took 1116 ms. Trace:
I20260709 13:11:59.362087 29523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 815) took 1319 ms. Trace:
I20260709 13:11:59.360940 29381 rpcz_store.cc:276] 0709 13:11:58.215257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.823666 (+608409us) service_pool.cc:224] Handling call
0709 13:11:58.870872 (+ 47206us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:58.871086 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:11:58.891814 (+ 20728us) log.cc:844] Serialized 14 byte log entry
0709 13:11:59.074782 (+182968us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:59.074848 (+    66us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:59.074894 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:59.074960 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:59.331068 (+256108us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b54003f3750. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd858ad 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:11:59.331234 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":197933,"prepare.queue_time_us":8900,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":76,"raft.queue_time_us":161745,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":1732,"spinlock_wait_cycles":23284992,"thread_start_us":41695,"threads_started":2,"wal-append.queue_time_us":70543}
W20260709 13:11:59.366351 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.367401 30887 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:59.362529 29523 rpcz_store.cc:276] 0709 13:11:58.042888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.046273 (+  3385us) service_pool.cc:224] Handling call
0709 13:11:58.046639 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:58.075465 (+ 28826us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:11:58.075871 (+   406us) log.cc:844] Serialized 14 byte log entry
0709 13:11:58.327792 (+251921us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:59.230239 (+902447us) spinlock_profiling.cc:243] Waited 5.59 ms on lock 0x7b2c001231f8. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7a67fa11 00007f6a7a68f372 00007f6a7bdc1a01 00007f6a7bd8643a 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2
0709 13:11:59.230801 (+   562us) log.cc:844] Serialized 26 byte log entry
0709 13:11:59.231129 (+   328us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:59.231627 (+   498us) log.cc:844] Serialized 14 byte log entry
0709 13:11:59.231824 (+   197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:59.231908 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:59.258893 (+ 26985us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b18000646c0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c99522 00007f6a78c9b7c1 00007f6a78c9b779 00007f6a78c9b709 00007f6a78c9b6d1 00007f6a78c9a9cd 000000000038f354 000000000038f199 00007f6a78c7c83a
0709 13:11:59.259371 (+   478us) raft_consensus.cc:1685] finished
0709 13:11:59.338181 (+ 78810us) spinlock_profiling.cc:243] Waited 7.82 ms on lock 0x7b18000646c0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c672a6 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c993f3 00007f6a78c9b7c1
0709 13:11:59.338905 (+   724us) spinlock_profiling.cc:243] Waited 42.3 ms on lock 0x7b18000646c0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c993f3 00007f6a78c9b7c1 00007f6a78c9b779 00007f6a78c9b709 00007f6a78c9b6d1 00007f6a78c9a9cd 000000000038f354 000000000038f199 00007f6a78c7c83a
0709 13:11:59.361817 (+ 22912us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b1800064690. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78cb40fd 00007f6a78cb3f8f 00007f6a7bd87033 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2
0709 13:11:59.361868 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:59.362024 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43897,"prepare.queue_time_us":126778,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":66,"raft.queue_time_us":47616,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":62775,"spinlock_wait_cycles":186524672,"thread_start_us":251186,"threads_started":1,"wal-append.queue_time_us":261187}
I20260709 13:11:59.335876 29456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1381) took 1353 ms. Trace:
I20260709 13:11:59.372049 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:59.372298 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:59.372160 29456 rpcz_store.cc:276] 0709 13:11:57.982341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.998825 (+ 16484us) service_pool.cc:224] Handling call
0709 13:11:59.222573 (+1223748us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b5800193598. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61b71 00007f6a78c61a22 00007f6a81b7ac09 00007f6a80cd4ee0 00007f6a80d9e0ab 00007f6a80d9e131 00007f6a80d5ffc0 00007f6a80d4a929 00007f6a80d4a3d2 00007f6a7a2c1bd4
0709 13:11:59.222878 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:59.223390 (+   512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:59.223436 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:59.225448 (+  2012us) log.cc:844] Serialized 26 byte log entry
0709 13:11:59.297893 (+ 72445us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:59.297938 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:59.298010 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:59.335453 (+ 37443us) raft_consensus.cc:1685] finished
0709 13:11:59.335477 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:59.335803 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":707,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":8687,"spinlock_wait_cycles":3353984,"thread_start_us":41074,"threads_started":1,"wal-append.queue_time_us":64409}
I20260709 13:11:59.373589 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:59.327384 30429 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:59.374208 30429 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.374616 30429 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:59.374850 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:59.375447 29452 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:11:59.362962 30846 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:59.336102 30949 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:59.337077 30958 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:59.337973 30866 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:11:59.381598 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.381680 30866 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:59.341382 31007 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:59.382706 29451 raft_consensus.cc:1240] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:59.329054 30987 consensus_queue.cc:237] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:59.384956 31021 raft_consensus.cc:493] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:11:59.385360 30846 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:59.385536 31021 raft_consensus.cc:515] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:11:59.386727 30429 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:59.342396 29277 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35182 (request call id 48) took 7111 ms. Trace:
I20260709 13:11:59.343667 28234 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:59.334838 30799 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:59.347517 29527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 801) took 1612 ms. Trace:
I20260709 13:11:59.354931 30985 consensus_queue.cc:1048] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:59.346366 29449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 717) took 1388 ms. Trace:
I20260709 13:11:59.391109 29527 rpcz_store.cc:276] 0709 13:11:57.734845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.735468 (+   623us) service_pool.cc:224] Handling call
0709 13:11:57.735834 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:58.979967 (+1244133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:59.347205 (+367238us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54002bb954. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:11:59.347418 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2854573312}
I20260709 13:11:59.391453 29449 rpcz_store.cc:276] 0709 13:11:57.957780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.958019 (+   239us) service_pool.cc:224] Handling call
0709 13:11:57.958485 (+   466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:58.398756 (+440271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:59.346035 (+947279us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b54000c2bd4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:11:59.346284 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1010517248}
I20260709 13:11:59.358959 31076 raft_consensus.cc:2749] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:59.371111 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:59.359115 29344 leader_election.cc:304] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:11:59.393299 29448 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:59.394079 31076 raft_consensus.cc:2749] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:59.394766 31076 consensus_queue.cc:1048] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:59.395787 30887 consensus_queue.cc:1048] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:59.397344 29344 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:59.405047 31080 raft_consensus.cc:2749] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:59.388549 29277 rpcz_store.cc:276] 0709 13:11:52.230911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:52.231615 (+   704us) service_pool.cc:224] Handling call
0709 13:11:59.342319 (+7110704us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:56.641124 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:56.801757 (+160633us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:56.804236 (+  2479us) write_op.cc:435] Acquired schema lock
0709 13:11:56.806408 (+  2172us) tablet.cc:662] Decoding operations
0709 13:11:56.953640 (+147232us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:56.960899 (+  7259us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:56.962396 (+  1497us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:11:56.974156 (+ 11760us) tablet.cc:701] Row locks acquired
0709 13:11:56.974182 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:11:56.974351 (+   169us) write_op.cc:270] Start()
0709 13:11:56.974488 (+   137us) write_op.cc:276] Timestamp: P: 1783602716974305 usec, L: 0
0709 13:11:56.974512 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:11:56.985619 (+ 11107us) log.cc:844] Serialized 1370 byte log entry
0709 13:11:58.026411 (+1040792us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b1800060700. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c993f3 00007f6a78c9b7c1 00007f6a78c9b779 00007f6a78c9b709 00007f6a78c9b6d1 00007f6a78c9a9cd 000000000038f354 000000000038f199 00007f6a78c7c83a
0709 13:11:58.271774 (+245363us) op_driver.cc:464] REPLICATION: finished
0709 13:11:58.361026 (+ 89252us) write_op.cc:301] APPLY: starting
0709 13:11:58.361165 (+   139us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:58.361320 (+   155us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:58.361342 (+    22us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:58.361950 (+   608us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:58.362132 (+   182us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:11:58.362174 (+    42us) write_op.cc:312] APPLY: finished
0709 13:11:58.362468 (+   294us) log.cc:844] Serialized 34 byte log entry
0709 13:11:58.362663 (+   195us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:58.362772 (+   109us) write_op.cc:454] Released schema lock
0709 13:11:58.362813 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:58.368673 (+  5860us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:58.368729 (+    56us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":243154,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":75060,"apply.run_cpu_time_us":2237,"apply.run_wall_time_us":12480,"num_ops":3,"prepare.queue_time_us":758480,"prepare.run_cpu_time_us":35660,"prepare.run_wall_time_us":460410,"raft.queue_time_us":114050,"raft.run_cpu_time_us":39134,"raft.run_wall_time_us":58274,"replication_time_us":1297059,"spinlock_wait_cycles":3206400,"thread_start_us":856400,"threads_started":4,"wal-append.queue_time_us":102306,"wal-append.run_cpu_time_us":13283,"wal-append.run_wall_time_us":1339006}]]}
I20260709 13:11:59.382763 29278 catalog_manager.cc:5697] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 1 to 3, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 3 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:59.409153 31021 leader_election.cc:290] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:11:59.399194 30599 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:11:59.409958 29344 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:59.409505 29278 catalog_manager.cc:5697] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 1 to 4, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 4 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:59.413832 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 207078us
I20260709 13:11:59.415202 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:59.416571 29451 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:59.413880 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:59.418241 29449 raft_consensus.cc:2368] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 3. Current term is 4.
I20260709 13:11:59.417625 29278 catalog_manager.cc:5697] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 2 to 3, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 3 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:59.420655 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:59.421530 29344 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:59.422873 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:59.423779 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:59.424639 29346 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:59.426623 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:59.427122 29455 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:11:59.425426 29452 raft_consensus.cc:1275] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:59.412976 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:59.419452 29278 catalog_manager.cc:5697] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:59.436101 29344 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:59.441603 30958 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:59.441718 30970 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:59.410095 30599 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:59.442130 29344 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:59.447099 29495 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:59.451299 29451 raft_consensus.cc:1275] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:59.453171 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:59.453928 29450 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:11:59.444399 29278 catalog_manager.cc:5697] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 2 to 3, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 3 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:59.458231 29278 catalog_manager.cc:5697] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 1 to 2, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 2 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:11:59.445318 30958 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:59.461176 30599 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:59.462113 30958 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:59.464468 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:59.465770 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:59.466454 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:59.467056 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:59.468395 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:59.423223 31021 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:59.467342 29379 raft_consensus.cc:2410] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:11:59.448346 29495 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:59.469571 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:59.468680 29376 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
I20260709 13:11:59.442701 31077 raft_consensus.cc:2749] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:59.472755 29278 catalog_manager.cc:5697] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 4 to 5, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132). New cstate: current_term: 5 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:11:59.512182 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:59.513428 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:59.513304 29278 catalog_manager.cc:5697] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 2 to 4, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 4 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:59.474690 29377 raft_consensus.cc:1275] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:11:59.481532 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:59.484148 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:59.499032 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:59.516113 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:59.516884 29455 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
W20260709 13:11:59.504303 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 56071.5us
I20260709 13:11:59.518196 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:59.518751 29495 leader_election.cc:400] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 3. Current term is 4.
I20260709 13:11:59.519079 29495 leader_election.cc:403] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:11:59.505389 29376 raft_consensus.cc:1275] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:11:59.467056 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:59.459759 31075 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:59.437153 31007 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:59.454725 30851 raft_consensus.cc:2749] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:59.530905 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:59.519235 29453 raft_consensus.cc:2410] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:59.532598 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:59.520648 29521 raft_consensus.cc:2410] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:59.520821 29374 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 4.
I20260709 13:11:59.502426 30982 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:59.445318 30986 raft_consensus.cc:2749] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:59.523938 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:59.522405 29530 raft_consensus.cc:2393] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 4: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:11:59.542217 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:59.523676 29278 catalog_manager.cc:5697] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 2 to 4, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 4 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:59.521148 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:11:59.544759 29379 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:59.527118 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:59.456120 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:59.539311 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:59.467990 31016 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:59.551987 31019 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:59.454543 30970 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:59.526280 30890 raft_consensus.cc:2804] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:59.577437 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:59.577912 29373 raft_consensus.cc:1240] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:59.542054 31007 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:59.542248 30971 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.549342 30982 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:59.562156 31088 log.cc:927] Time spent T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:11:59.563012 31016 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:59.557751 30917 consensus_queue.cc:1048] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:11:59.571790 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:11:59.551199 29495 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:11:59.574250 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:59.558271 30977 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:59.560257 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:11:59.542362 30946 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:59.601874 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.601464 30946 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:59.541437 30958 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.603864 30958 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:59.604621 30970 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:59.521644 31010 consensus_queue.cc:1048] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:11:59.581954 29421 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:59.609220 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:59.592204 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:59.611692 29456 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:59.586470 30982 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:59.596736 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 45685.6us
I20260709 13:11:59.597731 29454 raft_consensus.cc:1240] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:59.599354 30977 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:59.616566 29495 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:11:59.617965 30980 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:59.618036 30981 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.619041 30981 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:59.620018 30980 consensus_queue.cc:1048] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:59.584038 30971 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:59.584985 30890 raft_consensus.cc:697] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
W20260709 13:11:59.595245 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 150459us
I20260709 13:11:59.611824 29344 leader_election.cc:304] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:11:59.638780 30981 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:59.640823 29455 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
I20260709 13:11:59.615206 29379 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:11:59.631265 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:11:59.645815 29448 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:59.648053 29379 raft_consensus.cc:1240] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:59.651412 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:59.653784 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:59.655558 29448 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:11:59.655771 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:59.656571 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:59.660324 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:59.661265 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:59.662567 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:59.661465 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:59.605857 30894 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:59.668955 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:59.670989 29456 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:11:59.615124 30979 raft_consensus.cc:2749] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:59.672758 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:59.674104 30429 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:59.714309 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:59.715638 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:11:59.716478 29454 raft_consensus.cc:2393] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 3: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
W20260709 13:11:59.717907 31086 log.cc:927] Time spent T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.173s	user 0.003s	sys 0.000s
I20260709 13:11:59.656661 30846 raft_consensus.cc:2749] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:59.721439 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:59.723574 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:59.728878 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:59.729271 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:59.731350 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:59.732156 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:59.732863 29381 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:11:59.733189 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:59.733847 29380 raft_consensus.cc:1240] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:59.734902 31007 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:59.715638 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:59.734701 30946 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:59.635926 30988 consensus_queue.cc:1048] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.085s
I20260709 13:11:59.726586 30944 raft_consensus.cc:993] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5: : Instructing follower 183db85c071f489fbc8de63a9edd8a3a to start an election
I20260709 13:11:59.759894 29376 raft_consensus.cc:1240] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:59.657498 30970 consensus_queue.cc:1048] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.082s
I20260709 13:11:59.771953 29421 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:59.733057 30979 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:11:59.772714 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:59.772714 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:59.773612 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:59.777874 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:59.804962 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:59.806043 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:59.809353 29346 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:59.817407 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:59.818488 29381 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
I20260709 13:11:59.766170 30981 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:59.804244 30867 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:59.844429 30867 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.844492 30913 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.845167 30867 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:59.845335 30913 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:59.815990 30958 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:59.848151 30913 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:11:59.843597 30981 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:59.790568 30979 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:59.854879 30977 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:11:59.856508 31016 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:11:59.866106 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 56911.6us
I20260709 13:11:59.786051 30944 raft_consensus.cc:1081] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Signalling peer 183db85c071f489fbc8de63a9edd8a3a to start an election
I20260709 13:11:59.878983 29346 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:59.883756 30429 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:59.890398 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:59.808629 30917 consensus_queue.cc:1048] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.086s
I20260709 13:11:59.846381 30903 consensus_queue.cc:1048] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:11:59.908797 29346 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:11:59.910691 29346 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:11:59.910997 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:59.862603 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:11:59.934288 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:11:59.946477 29526 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 4.
I20260709 13:11:59.948282 29346 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:59.954027 29528 raft_consensus.cc:1275] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:11:59.909327 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:11:59.964639 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 44263.6us
I20260709 13:11:59.917502 30429 raft_consensus.cc:2749] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:59.787302 30890 consensus_queue.cc:237] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:11:59.979373 29346 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:11:59.917368 31021 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:59.988281 29524 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 4.
I20260709 13:11:59.989969 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:11:59.990878 29524 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:59.945583 30894 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:11:59.955942 31077 raft_consensus.cc:2749] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:59.986982 30983 consensus_queue.cc:1059] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:12:00.010040 29346 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:00.011231 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 224736us
W20260709 13:11:59.971009 31072 log.cc:927] Time spent T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:12:00.017688 29421 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:00.021911 29421 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:11:59.970300 30686 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:00.027298 29421 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:11:59.985570 31021 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:00.032486 29346 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:00.032564 29495 leader_election.cc:400] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 3. Current term is 4.
I20260709 13:11:59.995290 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:00.012511 30894 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:00.039204 29495 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:00.042452 29524 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:12:00.020758 30944 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:00.110142 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:00.111346 29346 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:00.111825 29524 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 4.
I20260709 13:12:00.031239 30866 raft_consensus.cc:2749] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:00.031016 30997 raft_consensus.cc:2804] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:00.076905 29495 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:00.115820 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:00.124752 29524 raft_consensus.cc:1275] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:12:00.125299 29524 pending_rounds.cc:85] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 1
I20260709 13:12:00.125762 29524 pending_rounds.cc:107] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:12:00.126091 29524 raft_consensus.cc:2889] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:00.131785 29524 raft_consensus.cc:1275] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:12:00.132401 29524 pending_rounds.cc:85] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 2
I20260709 13:12:00.132699 29524 pending_rounds.cc:107] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:12:00.133014 29524 raft_consensus.cc:2889] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:00.036479 31075 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:00.038209 31021 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:00.116371 31019 consensus_meta.cc:287] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.535s	user 0.013s	sys 0.001s
W20260709 13:12:00.138531 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:00.138048 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 61246us
I20260709 13:12:00.046455 31009 raft_consensus.cc:2804] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:00.030881 31010 consensus_queue.cc:1059] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.112s
W20260709 13:12:00.155193 31095 log.cc:927] Time spent T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:12:00.075006 30595 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:00.042738 30979 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:00.110334 30977 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:00.110175 31016 raft_consensus.cc:2749] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:00.119817 30987 raft_consensus.cc:2804] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:00.043658 31098 consensus_queue.cc:1059] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.096s
I20260709 13:12:00.156174 31019 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 3. Current term is 4.
I20260709 13:12:00.157246 30958 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:00.137162 31107 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.189788 30595 raft_consensus.cc:697] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:00.072154 31102 consensus_queue.cc:1048] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.135s
I20260709 13:12:00.207885 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:00.229203 29378 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 4.
I20260709 13:12:00.172468 31075 raft_consensus.cc:697] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:00.220592 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:00.171643 30980 consensus_queue.cc:1059] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.043s
W20260709 13:12:00.291043 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 92915us
I20260709 13:12:00.198334 30970 consensus_queue.cc:1059] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:12:00.208954 30987 raft_consensus.cc:697] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:00.299103 29495 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:00.187302 30977 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:00.264143 30997 raft_consensus.cc:697] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 4 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:00.220445 30979 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:00.266211 29380 raft_consensus.cc:1275] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:12:00.235332 31016 consensus_queue.cc:1059] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 13:12:00.313655 31101 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:00.264921 31107 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:00.308471 30980 consensus_queue.cc:1048] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.115s
W20260709 13:12:00.412549 31071 log.cc:927] Time spent T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.103s	user 0.007s	sys 0.001s
W20260709 13:12:00.436995 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 133895us
W20260709 13:12:00.438210 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 170652us
W20260709 13:12:00.440204 31099 log.cc:927] Time spent T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.319s	user 0.000s	sys 0.002s
I20260709 13:12:00.428159 31101 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:00.446657 29495 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:00.310698 30595 consensus_queue.cc:237] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:00.327616 30970 consensus_queue.cc:1059] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.110s
I20260709 13:12:00.336061 30988 consensus_queue.cc:1059] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.102s
I20260709 13:12:00.320577 30979 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:00.454406 31101 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:00.464661 30979 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:00.434016 31009 raft_consensus.cc:697] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:00.443344 31119 raft_consensus.cc:3055] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:00.437397 31075 consensus_queue.cc:237] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:00.456845 31098 raft_consensus.cc:2804] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:00.484130 31098 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:12:00.484783 31112 log.cc:927] Time spent T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 13:12:00.484189 31125 raft_consensus.cc:3055] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:00.473837 31119 raft_consensus.cc:740] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:00.488436 31125 raft_consensus.cc:740] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:00.489403 31098 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:00.487414 31115 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.498404 31107 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:00.548686 29495 leader_election.cc:400] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 3. Current term is 4.
W20260709 13:12:00.549533 29530 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.002s	sys 0.001s
I20260709 13:12:00.550077 29495 leader_election.cc:403] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:12:00.550359 29530 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.002s	sys 0.001s
I20260709 13:12:00.566491 30979 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.570014 30979 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:00.573073 30977 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:00.573777 30980 raft_consensus.cc:2749] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 3. Current term is 4.
W20260709 13:12:00.551275 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 101439us
I20260709 13:12:00.437587 30987 consensus_queue.cc:237] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:00.457804 30997 consensus_queue.cc:237] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:00.490981 31009 consensus_queue.cc:237] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:00.502143 31115 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:00.636427 31127 log.cc:927] Time spent T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
W20260709 13:12:00.637424 30982 consensus_meta.cc:287] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.993s	user 0.017s	sys 0.008s
I20260709 13:12:00.638217 30982 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:00.643976 29522 raft_consensus.cc:1240] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:00.646311 30982 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:00.646629 31128 log.cc:927] Time spent T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.088s	user 0.002s	sys 0.000s
I20260709 13:12:00.647696 30981 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:00.659135 29495 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:00.686390 31107 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:00.687873 31107 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:00.691567 29529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 823) took 1037 ms. Trace:
I20260709 13:12:00.692260 29529 rpcz_store.cc:276] 0709 13:11:59.653465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:59.654961 (+  1496us) service_pool.cc:224] Handling call
0709 13:11:59.655291 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:59.664281 (+  8990us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:59.664315 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:59.670018 (+  5703us) log.cc:844] Serialized 26 byte log entry
0709 13:11:59.933362 (+263344us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:59.933423 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:00.672568 (+739145us) spinlock_profiling.cc:243] Waited 8.57 ms on lock 0x7b54000b7cd4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:00.672680 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:00.680051 (+  7371us) raft_consensus.cc:1685] finished
0709 13:12:00.680078 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:00.691259 (+ 11181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1243,"raft.queue_time_us":440,"raft.run_cpu_time_us":4927,"raft.run_wall_time_us":57923,"spinlock_wait_cycles":19710720,"thread_start_us":262605,"threads_started":1,"wal-append.queue_time_us":365424}
I20260709 13:12:00.695861 30917 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.696868 30917 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:12:00.699934 30903 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:12:00.707571 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 48680.4us
I20260709 13:12:00.743914 31133 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.745307 31133 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
W20260709 13:12:00.748795 30894 consensus_meta.cc:287] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.632s	user 0.019s	sys 0.010s
I20260709 13:12:00.749517 30894 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:00.751324 30867 consensus_meta.cc:287] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.888s	user 0.023s	sys 0.010s
I20260709 13:12:00.752038 30867 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:00.755738 30980 raft_consensus.cc:2804] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:00.756320 30980 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:00.756232 31115 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:00.757040 30980 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:00.760040 31132 consensus_queue.cc:1048] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:00.701118 30903 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:00.746959 31101 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:00.779956 30599 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:00.782802 30971 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:00.787820 30986 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:00.788739 31077 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:00.792184 30979 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:00.795228 29495 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:00.805794 31115 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
W20260709 13:12:00.822597 31111 log.cc:927] Time spent T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.646s	user 0.002s	sys 0.002s
I20260709 13:12:00.823074 31115 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:00.824210 30981 raft_consensus.cc:2804] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:12:00.825497 31113 log.cc:927] Time spent T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.555s	user 0.003s	sys 0.000s
I20260709 13:12:00.776402 30867 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:00.827010 31077 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:00.827842 30599 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:00.797797 29455 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532"
dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:45798
I20260709 13:12:00.828545 30986 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:00.788769 31078 raft_consensus.cc:3055] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:00.798260 30977 consensus_queue.cc:1048] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:12:00.800156 31133 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:00.830230 30903 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:00.830286 31101 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:00.833438 30946 raft_consensus.cc:3055] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:00.833817 31098 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:00.835477 31135 log.cc:927] Time spent T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:12:00.840092 30981 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:00.872614 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:00.856580 30946 raft_consensus.cc:740] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:00.800362 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:00.848766 31078 raft_consensus.cc:740] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:00.866815 30981 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:00.889199 29453 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
W20260709 13:12:00.916322 31087 log.cc:927] Time spent T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 1.364s	user 0.002s	sys 0.008s
I20260709 13:12:00.918669 29525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 813) took 2876 ms. Trace:
W20260709 13:12:00.920017 31091 log.cc:927] Time spent T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 1.024s	user 0.004s	sys 0.000s
I20260709 13:12:00.919216 29525 rpcz_store.cc:276] 0709 13:11:58.042358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.043637 (+  1279us) service_pool.cc:224] Handling call
0709 13:11:58.043989 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:58.194377 (+150388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:58.194418 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:58.212067 (+ 17649us) log.cc:844] Serialized 26 byte log entry
0709 13:11:59.359928 (+1147861us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b1800341aa0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c7be07 00007f6a81ad6ab9 00007f6a78c9869b 00007f6a78c9693f 00007f6a78c98c02 00007f6a7b92020b 00007f6a7b925d23 00007f6a7b9260d1 00007f6a7bd41a0f
0709 13:11:59.522358 (+162430us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:59.522398 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:59.522481 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:00.914954 (+1392473us) spinlock_profiling.cc:243] Waited 5.2 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:12:00.918115 (+  3161us) raft_consensus.cc:1685] finished
0709 13:12:00.918146 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:00.918397 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":149935,"raft.queue_time_us":168008,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":6217,"spinlock_wait_cycles":17707648,"thread_start_us":162203,"threads_started":1,"wal-append.queue_time_us":1327040}
I20260709 13:12:00.920352 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:00.923982 31102 raft_consensus.cc:3055] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:00.924517 31102 raft_consensus.cc:740] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:00.924794 29456 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:12:00.925837 31102 consensus_queue.cc:260] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:00.940563 30980 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:00.962217 29455 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:00.951663 31102 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:00.972788 31136 log.cc:927] Time spent T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:12:00.973030 29344 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:00.975294 31098 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:00.976033 30985 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:00.976794 31075 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:00.891453 30946 consensus_queue.cc:260] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:00.978850 29521 raft_consensus.cc:1275] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:00.979655 30811 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:00.979861 29526 raft_consensus.cc:1275] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:00.980572 29523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 1592) took 1466 ms. Trace:
I20260709 13:12:00.965899 29455 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:00.954310 30599 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:00.989169 29523 rpcz_store.cc:276] 0709 13:11:59.513795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:59.519402 (+  5607us) service_pool.cc:224] Handling call
0709 13:11:59.519857 (+   455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:59.536764 (+ 16907us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:59.536830 (+    66us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:59.537513 (+   683us) log.cc:844] Serialized 26 byte log entry
0709 13:11:59.640650 (+103137us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:59.640693 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:59.640775 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:00.918912 (+1278137us) spinlock_profiling.cc:243] Waited 7.43 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:12:00.947951 (+ 29039us) raft_consensus.cc:1685] finished
0709 13:12:00.947983 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:00.980301 (+ 32318us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16459,"raft.queue_time_us":21178,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":10951,"spinlock_wait_cycles":17084672,"thread_start_us":102732,"threads_started":1,"wal-append.queue_time_us":250610}
W20260709 13:12:00.976804 31021 consensus_meta.cc:287] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.813s	user 0.016s	sys 0.009s
I20260709 13:12:01.007395 30946 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:01.008898 29522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 837) took 1328 ms. Trace:
I20260709 13:12:01.003017 30811 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:01.009333 29522 rpcz_store.cc:276] 0709 13:11:59.680873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:59.892599 (+211726us) service_pool.cc:224] Handling call
0709 13:11:59.892903 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:00.644649 (+751746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:01.008512 (+363863us) spinlock_profiling.cc:243] Waited 750 ms on lock 0x7b54001018d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:01.008820 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1726022016}
I20260709 13:12:01.010258 31078 consensus_queue.cc:260] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:01.014784 30986 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:00.992782 30980 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:00.996541 31075 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:01.021416 31021 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:00.999724 30599 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:01.011308 30811 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:01.022537 31115 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:12:01.033489 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 60938.3us
W20260709 13:12:01.034341 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 97203.1us
I20260709 13:12:01.043648 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:01.044404 31075 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:01.044808 29449 raft_consensus.cc:2393] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 5: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:01.045410 30866 raft_consensus.cc:3055] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:01.045874 30866 raft_consensus.cc:740] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
W20260709 13:12:01.045969 31137 log.cc:927] Time spent T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:12:01.049007 31021 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:01.055294 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:01.057143 30917 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:01.056842 30866 consensus_queue.cc:260] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:01.058751 30866 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:01.059295 29277 catalog_manager.cc:5697] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 5 to 6, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132). New cstate: current_term: 6 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:01.062098 31019 raft_consensus.cc:3055] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:01.062640 31019 raft_consensus.cc:740] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:01.050529 31077 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:01.031654 30985 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:01.063916 31019 consensus_queue.cc:260] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:01.065088 31019 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:12:01.041020 31140 log.cc:927] Time spent T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:12:01.074326 29344 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:01.076380 29455 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:01.089856 31077 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:01.090368 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:01.089869 31119 consensus_queue.cc:260] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:01.105719 31119 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:01.108752 29277 catalog_manager.cc:5697] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: config changed from index -1 to 2, term changed from 1 to 3, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New cstate: current_term: 3 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:12:01.110474 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:01.020115 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:01.090690 31077 raft_consensus.cc:697] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:01.115873 30985 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:01.132052 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:01.139901 31114 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:01.133493 30985 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:01.137055 31125 consensus_queue.cc:260] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:01.151324 31125 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:01.146746 29449 raft_consensus.cc:2468] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:12:01.142618 31114 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:01.164845 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:01.168965 31114 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:01.172617 31107 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:12:01.183665 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:01.184486 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:01.187952 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:01.198812 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:01.148978 30985 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:01.147344 30981 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:01.211944 30987 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:01.212294 29527 raft_consensus.cc:1240] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:01.212801 30987 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:01.214567 29455 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:01.205387 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:01.216861 30887 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:01.217044 30981 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:01.217679 30987 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:01.217875 31114 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:01.218602 31114 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:01.219362 30958 raft_consensus.cc:3055] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:01.219892 30958 raft_consensus.cc:740] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:01.221297 30958 consensus_queue.cc:260] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:01.222728 30958 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:01.222882 31107 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:01.223673 31107 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:01.226994 31107 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:01.217531 30887 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:01.235716 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:01.236605 31078 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:01.238036 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:01.238832 29379 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:12:01.239035 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:01.241245 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:01.243592 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:01.244309 31107 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:01.244978 31107 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:01.245303 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:01.247160 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:01.247390 29379 raft_consensus.cc:1240] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:12:01.247282 31107 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:01.248884 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:01.249099 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:01.252568 29375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52172 (request call id 900) took 1457 ms. Trace:
I20260709 13:12:01.253157 29375 rpcz_store.cc:276] 0709 13:11:59.794581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:59.795612 (+  1031us) service_pool.cc:224] Handling call
0709 13:11:59.874214 (+ 78602us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:00.693871 (+819657us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:00.693939 (+    68us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:00.694872 (+   933us) log.cc:844] Serialized 52 byte log entry
0709 13:12:00.733810 (+ 38938us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:00.733876 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:01.230402 (+496526us) spinlock_profiling.cc:243] Waited 556 ms on lock 0x7b54003c41d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:01.230457 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:01.230513 (+    56us) raft_consensus.cc:1685] finished
0709 13:12:01.230526 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:01.252318 (+ 21792us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":263020,"raft.queue_time_us":267690,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":162,"spinlock_wait_cycles":1278143744,"thread_start_us":29734,"threads_started":1,"wal-append.queue_time_us":168280}
I20260709 13:12:01.198385 31077 consensus_queue.cc:237] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:01.257155 30887 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:01.227356 30894 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:01.259744 29278 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37594 (request call id 132) took 4352 ms. Trace:
I20260709 13:12:01.264017 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:01.265268 29451 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:12:01.265882 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:01.266537 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:01.268224 29346 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:01.270478 30686 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:01.272397 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:01.273190 29524 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
I20260709 13:12:01.275619 29455 raft_consensus.cc:2410] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:12:01.260296 29278 rpcz_store.cc:276] 0709 13:11:56.906688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.906845 (+   157us) service_pool.cc:224] Handling call
0709 13:12:01.259408 (+4352563us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:59.723345 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:59.728956 (+  5611us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:59.729002 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:11:59.729018 (+    16us) tablet.cc:662] Decoding operations
0709 13:11:59.730088 (+  1070us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:59.730151 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:59.730177 (+    26us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:11:59.731084 (+   907us) tablet.cc:701] Row locks acquired
0709 13:11:59.731126 (+    42us) write_op.cc:260] PREPARE: finished
0709 13:11:59.731294 (+   168us) write_op.cc:270] Start()
0709 13:11:59.731441 (+   147us) write_op.cc:276] Timestamp: P: 1783602719731238 usec, L: 0
0709 13:11:59.731465 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:11:59.843444 (+111979us) log.cc:844] Serialized 3667 byte log entry
0709 13:12:00.467798 (+624354us) op_driver.cc:464] REPLICATION: finished
0709 13:12:00.749608 (+281810us) write_op.cc:301] APPLY: starting
0709 13:12:00.749845 (+   237us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:00.750295 (+   450us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:00.750506 (+   211us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:00.779906 (+ 29400us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:00.780353 (+   447us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:12:00.780440 (+    87us) write_op.cc:312] APPLY: finished
0709 13:12:00.781069 (+   629us) log.cc:844] Serialized 70 byte log entry
0709 13:12:00.781439 (+   370us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:00.781724 (+   285us) write_op.cc:454] Released schema lock
0709 13:12:00.781807 (+    83us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:00.782452 (+   645us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:00.782481 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2145,"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":278764,"apply.run_cpu_time_us":5591,"apply.run_wall_time_us":32941,"num_ops":9,"prepare.queue_time_us":162414,"prepare.run_cpu_time_us":10581,"prepare.run_wall_time_us":249621,"raft.queue_time_us":320176,"raft.run_cpu_time_us":8462,"raft.run_wall_time_us":331962,"replication_time_us":722613,"thread_start_us":483802,"threads_started":4,"wal-append.queue_time_us":163659}]]}
I20260709 13:12:01.221340 31114 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:01.280123 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:01.281183 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:12:01.286403 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 52532.2us
I20260709 13:12:01.290423 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:01.293938 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:01.294653 29529 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
I20260709 13:12:01.291833 29524 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
I20260709 13:12:01.299551 30429 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:01.299700 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:01.278825 30946 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:01.302350 29521 raft_consensus.cc:1240] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:01.285442 29373 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:12:01.309734 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:01.313489 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:01.300433 30429 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:01.319854 30985 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:01.313400 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
W20260709 13:12:01.324779 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:01.327608 29419 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:01.330621 31107 consensus_queue.cc:1048] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:01.332093 29419 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:01.332566 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:01.320520 30429 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:01.320286 31080 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:01.305712 31078 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:01.350847 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:01.353430 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:01.334998 31118 raft_consensus.cc:2749] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:01.343689 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:01.349929 29453 raft_consensus.cc:1240] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:01.353749 31080 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:01.340250 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:01.347641 29454 raft_consensus.cc:1240] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:01.342152 29449 raft_consensus.cc:1240] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:12:01.355592 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:01.346644 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:01.346594 30894 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:01.353060 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:01.364670 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:01.386853 29523 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
I20260709 13:12:01.386130 29377 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 4.
I20260709 13:12:01.381031 29372 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:12:01.390949 29376 raft_consensus.cc:2468] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 4.
I20260709 13:12:01.395473 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:01.389935 29421 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:01.334209 30946 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:01.399386 29379 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 4.
I20260709 13:12:01.396507 29378 raft_consensus.cc:2468] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 1.
I20260709 13:12:01.387210 31107 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:12:01.398417 31119 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:01.404974 30981 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:12:01.413367 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 83636.2us
I20260709 13:12:01.411379 31119 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:01.417196 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:01.385459 31078 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:01.415613 29449 raft_consensus.cc:1240] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:01.426000 29377 raft_consensus.cc:1275] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:01.426729 30917 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:01.427160 31119 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:01.427150 30917 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:01.412317 30981 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:01.438309 29452 raft_consensus.cc:1240] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:12:01.442831 29419 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:01.443392 29451 raft_consensus.cc:1240] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:12:01.433312 31076 consensus_queue.cc:1048] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:12:01.445029 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:01.447643 30866 consensus_queue.cc:1048] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:01.448058 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:01.441260 30917 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:01.451102 31074 consensus_queue.cc:1059] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:01.454128 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:01.454778 29379 raft_consensus.cc:3055] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:01.455117 29379 raft_consensus.cc:740] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:01.459885 30979 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:01.417065 30894 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:01.433866 31080 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:01.463976 29379 consensus_queue.cc:260] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:01.422216 31077 consensus_queue.cc:1048] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:12:01.471335 29344 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:01.473824 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:01.476132 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:01.478312 31080 raft_consensus.cc:2804] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:01.460150 31119 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:01.486052 31080 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:01.480497 29379 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:01.478111 29344 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:01.487056 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 52990.7us
I20260709 13:12:01.459982 30946 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:01.487752 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:01.489708 29344 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:01.494481 29419 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:01.499315 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:01.500135 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:01.501353 30987 raft_consensus.cc:3055] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:01.500187 29373 raft_consensus.cc:2468] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:12:01.501828 30987 raft_consensus.cc:740] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:01.508500 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:01.507812 29374 raft_consensus.cc:1275] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:12:01.516995 29376 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:12:01.492903 31080 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:01.520295 29377 raft_consensus.cc:1240] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:12:01.523663 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:01.526162 29419 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:01.486402 31119 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:01.535784 29495 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:01.516407 30985 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:01.503104 30987 consensus_queue.cc:260] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:01.546908 29344 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:01.553148 30429 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:01.553591 30429 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:01.553961 30429 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:01.542918 30985 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:12:01.565280 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 45284.9us
I20260709 13:12:01.566773 29452 raft_consensus.cc:1240] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: []
W20260709 13:12:01.560249 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:01.564716 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:01.573648 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:01.574589 29523 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
I20260709 13:12:01.575647 31119 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:01.575850 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:01.576231 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:01.576602 29522 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
I20260709 13:12:01.576738 30983 raft_consensus.cc:2804] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:01.577288 30983 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:01.577665 30983 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:01.577885 29525 raft_consensus.cc:3055] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:01.578265 29525 raft_consensus.cc:740] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:01.580781 29344 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:01.538909 31076 consensus_queue.cc:1059] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:12:01.588092 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:01.570987 30946 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:01.569548 30985 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:01.599062 29527 raft_consensus.cc:3055] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:01.599834 29527 raft_consensus.cc:740] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:01.601091 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:12:01.597910 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 74971.6us
I20260709 13:12:01.601934 29452 raft_consensus.cc:2468] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:12:01.611793 29421 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:01.589074 30987 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:01.613843 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 109259us
I20260709 13:12:01.598081 31078 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:01.594650 30979 raft_consensus.cc:2804] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:01.630511 29421 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:01.617009 29525 consensus_queue.cc:260] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:01.639696 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:01.634534 30979 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:01.642633 30846 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:01.603438 30981 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:01.644356 31114 raft_consensus.cc:2804] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:01.634485 30686 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:01.669866 29525 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:01.669785 29379 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
I20260709 13:12:01.661163 31114 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:01.659475 30979 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:01.659041 30894 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:01.677170 29527 consensus_queue.cc:260] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:01.687692 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 50355.5us
W20260709 13:12:01.688051 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 116686us
I20260709 13:12:01.693899 29524 raft_consensus.cc:1240] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:01.699733 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:01.686128 31114 raft_consensus.cc:3060] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:01.705580 29527 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:01.709002 29523 raft_consensus.cc:1240] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:01.711484 29522 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
W20260709 13:12:01.715204 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:01.724472 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:01.716924 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 75019.4us
I20260709 13:12:01.724015 29344 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:01.698829 30894 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:01.728609 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:01.737723 30853 raft_consensus.cc:2749] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:12:01.748821 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:01.746044 29344 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:01.753187 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 122774us
I20260709 13:12:01.754168 29421 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:12:01.755847 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 59615us
I20260709 13:12:01.759034 29495 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:01.752017 31166 raft_consensus.cc:2804] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:01.764389 31119 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:01.752714 31168 raft_consensus.cc:2804] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:01.770012 31168 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:01.770419 31168 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:01.776723 31166 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:01.777556 31166 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:01.758698 30894 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:01.782529 30894 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:01.760255 31076 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:01.734300 30917 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:01.792250 30686 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:01.792424 31074 consensus_queue.cc:1059] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:01.796386 29372 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
W20260709 13:12:01.798970 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 44905.4us
I20260709 13:12:01.802090 31162 consensus_queue.cc:1048] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:01.803284 31163 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:01.812075 31171 consensus_queue.cc:1048] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:01.766474 30887 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:01.814612 30686 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:01.803826 31076 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:01.851737 31076 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:01.852165 30983 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:01.853348 30686 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:01.833827 29449 raft_consensus.cc:2393] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 5: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:01.827296 31163 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:01.856971 31163 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:01.833739 30887 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:01.861557 30887 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:01.814644 30986 raft_consensus.cc:3055] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:01.862421 30986 raft_consensus.cc:740] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:01.863546 30986 consensus_queue.cc:260] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:01.864925 30986 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:01.868417 30429 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:01.874805 30429 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:01.872048 29495 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:12:01.879122 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:01.824286 31114 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:12:01.886822 29344 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:01.874892 31171 consensus_queue.cc:1048] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:01.891252 31167 raft_consensus.cc:3055] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:01.855111 30983 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:01.896376 29527 raft_consensus.cc:1275] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
W20260709 13:12:01.885726 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:01.921311 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:01.922595 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 121317us
W20260709 13:12:01.910209 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:01.910840 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:01.918897 30429 raft_consensus.cc:2804] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:01.923940 30429 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:01.867051 30985 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:01.924397 30429 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:01.925055 29525 raft_consensus.cc:1275] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:12:01.929045 30917 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:01.929347 29495 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:01.920679 29527 pending_rounds.cc:85] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 2
I20260709 13:12:01.931689 30986 consensus_queue.cc:1059] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:01.932015 30894 raft_consensus.cc:2749] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:01.931734 29527 pending_rounds.cc:107] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:12:01.933120 29527 raft_consensus.cc:2889] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:01.934084 30429 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:01.927661 29525 pending_rounds.cc:85] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 3
I20260709 13:12:01.941538 29525 pending_rounds.cc:107] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:12:01.903179 30981 raft_consensus.cc:2749] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:01.941936 29525 raft_consensus.cc:2889] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:01.950803 30429 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:01.920360 31167 raft_consensus.cc:740] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:12:01.957908 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 139613us
I20260709 13:12:01.976189 30887 raft_consensus.cc:3055] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:01.976707 30887 raft_consensus.cc:740] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:01.977620 30887 consensus_queue.cc:260] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:01.978902 30887 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:01.979030 31114 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:01.972404 30429 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:01.989356 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:01.993420 29522 raft_consensus.cc:2393] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 5: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:01.992121 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:01.995697 31168 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:01.996821 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:01.998096 31168 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:01.974310 31167 consensus_queue.cc:260] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:01.999837 31167 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:01.998854 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:02.001590 31080 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:02.004066 29376 raft_consensus.cc:1240] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:02.004712 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:02.005475 29521 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
I20260709 13:12:02.008513 31166 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:02.008936 29523 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
I20260709 13:12:02.008848 29528 raft_consensus.cc:1275] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:12:02.001993 29526 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:02.016004 30686 consensus_queue.cc:1048] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:02.018934 30985 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:02.019797 29495 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:02.020711 30981 raft_consensus.cc:2749] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:02.022092 29495 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:02.023540 30429 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:02.022905 30981 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:02.027546 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:02.028414 29527 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:02.032590 31166 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:02.034675 31076 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:02.024528 30983 consensus_queue.cc:1048] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:12:02.038815 29277 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35182 (request call id 49) took 2441 ms. Trace:
I20260709 13:12:02.039827 31080 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:02.041059 31163 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:02.042271 31180 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:02.047950 29526 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
I20260709 13:12:02.042917 31180 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:02.052883 29344 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:02.062741 29527 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:02.039261 29277 rpcz_store.cc:276] 0709 13:11:59.597664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:59.597843 (+   179us) service_pool.cc:224] Handling call
0709 13:12:02.038687 (+2440844us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:01.323958 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:01.341442 (+ 17484us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:01.341514 (+    72us) write_op.cc:435] Acquired schema lock
0709 13:12:01.341533 (+    19us) tablet.cc:662] Decoding operations
0709 13:12:01.342033 (+   500us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:01.342176 (+   143us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:01.342214 (+    38us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:12:01.342581 (+   367us) tablet.cc:701] Row locks acquired
0709 13:12:01.342626 (+    45us) write_op.cc:260] PREPARE: finished
0709 13:12:01.342956 (+   330us) write_op.cc:270] Start()
0709 13:12:01.343198 (+   242us) write_op.cc:276] Timestamp: P: 1783602721342718 usec, L: 0
0709 13:12:01.343223 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:12:01.364551 (+ 21328us) log.cc:844] Serialized 988 byte log entry
0709 13:12:01.519904 (+155353us) op_driver.cc:464] REPLICATION: finished
0709 13:12:01.845846 (+325942us) spinlock_profiling.cc:243] Waited 5.1 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a78c7c0ac 00007f6a81ad6ab9 00007f6a78c9869b 00007f6a78c9693f 00007f6a78c98c02 00007f6a7f7bcef0
0709 13:12:02.007763 (+161917us) write_op.cc:301] APPLY: starting
0709 13:12:02.007853 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:02.008066 (+   213us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:02.008099 (+    33us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:02.008498 (+   399us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:02.008693 (+   195us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:12:02.008755 (+    62us) write_op.cc:312] APPLY: finished
0709 13:12:02.015120 (+  6365us) log.cc:844] Serialized 28 byte log entry
0709 13:12:02.019790 (+  4670us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:02.019894 (+   104us) write_op.cc:454] Released schema lock
0709 13:12:02.019943 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:02.030752 (+ 10809us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:02.030788 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":167662,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":462024,"apply.run_cpu_time_us":2205,"apply.run_wall_time_us":22974,"num_ops":2,"prepare.queue_time_us":143832,"prepare.run_cpu_time_us":4317,"prepare.run_wall_time_us":62813,"replication_time_us":145274,"spinlock_wait_cycles":11724032,"thread_start_us":450342,"threads_started":2}]]}
W20260709 13:12:02.074347 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 52329.3us
I20260709 13:12:02.010233 30979 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:02.090638 29495 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
W20260709 13:12:02.101485 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 48909.8us
I20260709 13:12:02.045809 31163 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:02.103071 29421 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:02.094722 29344 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:02.104630 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.105557 29344 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:02.105772 30983 raft_consensus.cc:2804] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:02.107728 29421 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:02.110376 30429 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:02.100716 31080 raft_consensus.cc:2804] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:02.102670 31177 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:02.113579 31080 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:02.112885 31076 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:02.111152 31162 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:02.111240 31077 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:02.111111 31125 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:02.106380 31166 consensus_queue.cc:1048] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:12:02.106410 30983 raft_consensus.cc:697] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:02.125065 29449 raft_consensus.cc:1275] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:02.126122 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:02.128183 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:02.128996 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:02.166580 29377 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:02.166368 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.110766 29344 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:02.114780 29495 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:02.147969 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:02.140795 31080 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:02.166323 29372 raft_consensus.cc:3060] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:02.156405 31125 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:02.109735 31171 consensus_queue.cc:1048] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:12:02.161440 31162 raft_consensus.cc:697] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 6 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:02.166024 31180 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:02.193040 29377 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:12:02.194610 29421 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:02.132407 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:02.166283 29373 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:02.171191 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 56540.7us
W20260709 13:12:02.177254 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.116035 31163 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:02.192735 29449 raft_consensus.cc:1240] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 3. Current term is 4. Ops: []
W20260709 13:12:02.196838 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 86155.9us
I20260709 13:12:02.155829 31177 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:02.198940 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:02.200938 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.203809 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:12:02.212481 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.203992 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:02.208158 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:02.213450 29526 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:02.213613 29524 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:02.213004 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.218829 29377 raft_consensus.cc:1240] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:02.221895 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:02.177389 31077 raft_consensus.cc:697] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:02.230203 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:02.184499 31125 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:02.183141 30981 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:02.226679 29495 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:02.166980 31166 consensus_queue.cc:1243] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer 71aa3578fd924765ab9ac0729c8d1483 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:12:02.232967 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:02.236878 29525 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
I20260709 13:12:02.210654 31165 raft_consensus.cc:2804] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:02.217866 30985 raft_consensus.cc:2804] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:12:02.266680 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 47610.5us
I20260709 13:12:02.279722 29527 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
I20260709 13:12:02.284365 29526 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:02.284291 29523 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
I20260709 13:12:02.239032 31163 raft_consensus.cc:697] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:02.290891 29276 catalog_manager.cc:5697] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 2 to 3, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 3 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
W20260709 13:12:02.284859 31155 log.cc:927] Time spent T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:12:02.285210 31119 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:02.290126 31178 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:02.302481 31107 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:02.293385 31165 raft_consensus.cc:697] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:02.319061 29276 catalog_manager.cc:5697] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 2 to 3, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 3 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:02.323652 29449 raft_consensus.cc:1240] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 4. Current term is 5. Ops: []
W20260709 13:12:02.342948 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 126381us
I20260709 13:12:02.317018 30979 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:02.321666 31119 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:02.355422 29276 catalog_manager.cc:5697] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 2 to 3, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 3 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:02.361922 29524 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:02.325490 31175 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:02.289083 30983 consensus_queue.cc:237] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:02.368146 31182 log.cc:927] Time spent T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:12:02.360922 31119 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:02.374644 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:02.374029 29276 catalog_manager.cc:5697] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 1 to 2, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 2 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:02.380373 29452 raft_consensus.cc:2393] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 3: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:02.386796 31163 consensus_queue.cc:237] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:02.396143 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:02.396796 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.345450 31107 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:12:02.400372 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 104777us
I20260709 13:12:02.325673 31178 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:02.405263 30946 consensus_queue.cc:1059] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:02.406222 30946 raft_consensus.cc:3055] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:02.406667 31178 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:02.325503 31162 consensus_queue.cc:237] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:02.357975 31118 consensus_queue.cc:1059] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:12:02.406576 30946 raft_consensus.cc:740] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:02.422145 29376 raft_consensus.cc:2410] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:12:02.421047 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:02.426908 29452 raft_consensus.cc:2393] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 3: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:02.427882 29495 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:02.402591 31080 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:02.438119 31080 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:02.439766 29375 raft_consensus.cc:1240] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:12:02.440624 31185 log.cc:927] Time spent T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:12:02.441260 31165 consensus_queue.cc:237] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:02.442097 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:02.371479 31175 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:12:02.443539 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.443611 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:02.343199 31077 consensus_queue.cc:237] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:02.438936 29276 catalog_manager.cc:5697] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 2 to 3, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 3 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
W20260709 13:12:02.454061 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 52115.8us
W20260709 13:12:02.458333 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:02.462947 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 56606.5us
I20260709 13:12:02.467722 29495 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:02.442543 31188 log.cc:927] Time spent T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.066s	user 0.000s	sys 0.002s
I20260709 13:12:02.482607 29495 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:02.511741 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:02.491559 29456 raft_consensus.cc:1275] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:02.515588 29448 raft_consensus.cc:1275] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:02.515854 30946 consensus_queue.cc:260] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:02.516928 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:02.517609 29374 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 2.
I20260709 13:12:02.479741 30985 raft_consensus.cc:697] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:02.512987 29276 catalog_manager.cc:5697] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 1 to 3, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 3 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:02.467362 30981 raft_consensus.cc:2764] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:12:02.532145 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:02.537231 29421 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:12:02.542317 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.535964 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:02.527590 30946 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:02.540421 29276 catalog_manager.cc:5697] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 3 to 4, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 4 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:02.546608 31178 raft_consensus.cc:2804] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:02.526290 29373 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:12:02.538820 30894 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:02.487208 31177 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:02.553995 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:02.556391 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:02.604575 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:02.614054 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:02.615464 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:02.628193 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.615587 31197 raft_consensus.cc:2804] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:02.629595 31197 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:02.629954 31197 raft_consensus.cc:3060] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:02.639526 31115 consensus_queue.cc:1059] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:12:02.646946 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.647814 29455 raft_consensus.cc:1275] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:12:02.652275 29421 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:12:02.651674 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:02.661355 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.596644 30894 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:02.662665 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:02.617322 31194 log.cc:927] Time spent T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:12:02.672953 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:02.676082 29529 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:02.641175 31115 raft_consensus.cc:3055] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:02.679369 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:02.679404 29276 catalog_manager.cc:5697] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 3 to 4, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 4 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:02.679330 29521 pending_rounds.cc:85] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 1
I20260709 13:12:02.682039 29521 pending_rounds.cc:107] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:12:02.682381 29521 raft_consensus.cc:2889] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:02.684361 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:02.674153 31162 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:02.559725 31178 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:02.678949 31115 raft_consensus.cc:740] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:02.708160 31178 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:02.708496 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:02.709199 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.709124 31115 consensus_queue.cc:260] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:02.710610 31115 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:02.649185 30985 consensus_queue.cc:237] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:02.715109 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:02.716873 29456 raft_consensus.cc:1275] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:12:02.717284 29456 pending_rounds.cc:85] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 2
I20260709 13:12:02.717501 29456 pending_rounds.cc:107] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:12:02.717772 29456 raft_consensus.cc:2889] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:02.719151 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:02.687590 31162 raft_consensus.cc:697] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:02.688120 29450 raft_consensus.cc:2393] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 4: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:02.755120 31162 consensus_queue.cc:237] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:02.755565 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:02.756951 29450 raft_consensus.cc:2393] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 3: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:02.758086 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:02.689947 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:02.759032 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:02.759797 29456 raft_consensus.cc:2393] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 3: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:02.760262 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:02.762161 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:02.690863 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:02.764216 29452 raft_consensus.cc:2393] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 4: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:02.696017 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:02.702286 29372 consensus_meta.cc:287] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.526s	user 0.010s	sys 0.001s
I20260709 13:12:02.703806 31175 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:02.704116 31192 raft_consensus.cc:3055] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:02.765872 29372 raft_consensus.cc:2468] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:12:02.706521 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:12:02.703320 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.725065 29453 raft_consensus.cc:1275] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:02.725986 29276 catalog_manager.cc:5697] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 1 to 2, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 2 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:02.729173 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:02.710855 31125 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:02.673823 30894 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:02.748152 31119 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:02.782559 31119 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:02.717496 29344 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:02.689142 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:02.766033 31192 raft_consensus.cc:740] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
W20260709 13:12:02.783871 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 66457.8us
I20260709 13:12:02.783975 30887 raft_consensus.cc:2804] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:02.784464 30887 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:02.785421 30887 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:02.784444 31192 consensus_queue.cc:260] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:02.798847 31192 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:02.704350 31107 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:02.760492 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:02.784765 29344 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:02.810165 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:02.824520 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 294234us
I20260709 13:12:02.831468 31165 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.832544 31165 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:02.834859 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.845393 31204 raft_consensus.cc:2804] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:02.846040 31204 raft_consensus.cc:697] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:12:02.847821 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 63168.4us
I20260709 13:12:02.773600 29276 catalog_manager.cc:5697] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 1 to 3, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 3 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:02.850028 29380 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:12:02.859987 29344 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:02.861351 29344 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:02.863296 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 333905us
I20260709 13:12:02.862413 29344 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:02.849552 29346 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 1.539s (SENT) [suppressed 12 similar messages]
I20260709 13:12:02.870256 31166 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:02.870952 31166 raft_consensus.cc:697] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:02.871932 29419 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:02.873167 29276 catalog_manager.cc:5697] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:02.875771 29374 raft_consensus.cc:1240] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:02.846985 31204 consensus_queue.cc:237] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:02.877844 30853 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:02.866541 30846 raft_consensus.cc:2804] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:02.862318 30983 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:02.879382 30846 raft_consensus.cc:697] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:02.879791 30983 raft_consensus.cc:697] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:02.880445 30846 consensus_queue.cc:237] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:02.880884 30983 consensus_queue.cc:237] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:02.894834 29276 catalog_manager.cc:5697] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 1 to 3, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 3 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:02.902352 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:02.903017 29276 catalog_manager.cc:5697] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:02.904309 29525 raft_consensus.cc:1240] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:02.894587 31125 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:02.904858 29276 catalog_manager.cc:5697] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 1 to 2, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 2 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:02.910765 29276 catalog_manager.cc:5697] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 1 to 4, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 4 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:02.908507 29528 raft_consensus.cc:1275] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:12:02.912758 29528 pending_rounds.cc:85] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 2
I20260709 13:12:02.871867 31166 consensus_queue.cc:237] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:02.919725 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:02.920699 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:02.921629 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:02.922956 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:02.913096 29528 pending_rounds.cc:107] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:12:02.915067 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:02.924584 29528 raft_consensus.cc:2889] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:02.925774 31107 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:02.926388 31107 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:02.929298 31107 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:02.932488 31167 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:02.933596 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.934894 29529 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:02.918728 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:02.937525 29276 catalog_manager.cc:5697] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 1 to 2, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 2 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:02.951674 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.954403 29419 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:02.949575 29344 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:02.995945 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:02.997186 29526 raft_consensus.cc:2393] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 5: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:02.999051 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:03.000372 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:03.000571 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:03.000967 29525 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:03.001735 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:03.002421 29529 raft_consensus.cc:2393] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 3: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:03.003237 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:03.004137 29529 raft_consensus.cc:2393] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 2: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:03.003921 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:03.004410 30917 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:03.005046 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:03.005056 30917 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:03.005210 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:03.006613 29530 raft_consensus.cc:2393] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 4: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:02.991799 31076 raft_consensus.cc:2804] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:03.007946 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:03.008931 29527 raft_consensus.cc:2410] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:12:02.992149 30894 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:03.009774 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:03.009953 29522 raft_consensus.cc:2393] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 5: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:03.011010 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:03.008023 31076 raft_consensus.cc:697] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:03.008949 30917 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:02.991532 31180 raft_consensus.cc:2749] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:03.012789 31076 consensus_queue.cc:237] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:03.013427 31165 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:03.014832 29529 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:12:03.021440 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:03.024587 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:03.025287 29522 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:03.025455 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:03.027091 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:03.036327 29525 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 4.
I20260709 13:12:03.041944 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:03.041877 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:03.042855 29530 raft_consensus.cc:1275] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
W20260709 13:12:03.041632 29419 leader_election.cc:336] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.518s (SENT)
I20260709 13:12:03.048024 29419 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:03.043360 29530 pending_rounds.cc:85] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 2
I20260709 13:12:03.051781 29530 pending_rounds.cc:107] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:12:03.052157 29530 raft_consensus.cc:2889] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:03.019071 30887 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:03.064559 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.066149 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:02.939319 31167 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:03.091610 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 242072us
I20260709 13:12:03.092363 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:03.095000 29380 raft_consensus.cc:1240] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:03.076099 30894 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:03.077924 31162 raft_consensus.cc:2749] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:03.096805 29527 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
W20260709 13:12:03.107839 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:03.109722 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.121613 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:03.123013 29526 raft_consensus.cc:2393] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 5: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:12:03.158396 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:03.160187 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.168218 31077 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:03.169014 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:03.168949 31077 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:03.192986 29522 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
W20260709 13:12:03.204303 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.221798 29527 raft_consensus.cc:1240] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 4. Current term is 5. Ops: []
W20260709 13:12:03.223650 31195 log.cc:927] Time spent T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260709 13:12:03.222013 31115 consensus_meta.cc:287] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.511s	user 0.017s	sys 0.007s
W20260709 13:12:03.237370 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:03.238569 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 169716us
I20260709 13:12:03.245518 30887 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:03.247444 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:03.251473 29379 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 2.
I20260709 13:12:03.250727 29455 raft_consensus.cc:2410] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:12:03.224902 30986 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.258000 29377 raft_consensus.cc:1275] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:12:03.258245 29379 raft_consensus.cc:1240] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:03.237955 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:03.270205 29375 raft_consensus.cc:1275] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:12:03.274634 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.276600 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:03.277437 29523 raft_consensus.cc:2368] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 4. Current term is 5.
I20260709 13:12:03.275221 29421 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:03.281375 29421 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:03.282522 29421 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:03.283296 29523 raft_consensus.cc:1240] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:12:03.262921 29373 raft_consensus.cc:1275] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:03.286329 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:03.286993 29454 raft_consensus.cc:1275] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:03.287014 29451 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
I20260709 13:12:03.305122 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:12:03.305467 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.306046 29453 raft_consensus.cc:2393] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 5: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:03.305824 30853 consensus_queue.cc:1059] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:03.306851 30853 consensus_queue.cc:1243] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer 429e58eb058349e3bf72b5a870c8f6e5 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:12:03.284516 31175 raft_consensus.cc:2749] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:03.266408 30986 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:03.302492 31199 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:03.310976 30986 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:03.311094 31199 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:03.282166 31192 raft_consensus.cc:2804] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:03.316148 29456 raft_consensus.cc:3055] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:03.323081 29456 raft_consensus.cc:740] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
W20260709 13:12:03.303552 31197 consensus_meta.cc:287] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.673s	user 0.020s	sys 0.003s
I20260709 13:12:03.302078 30866 raft_consensus.cc:2804] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:03.328418 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:12:03.345922 31178 consensus_meta.cc:287] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.637s	user 0.009s	sys 0.004s
I20260709 13:12:03.346496 31178 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:03.347954 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:03.348783 29449 raft_consensus.cc:1240] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:03.348217 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:03.350541 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:03.351284 29525 raft_consensus.cc:1240] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:03.355405 29523 raft_consensus.cc:1240] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:12:03.357146 29530 raft_consensus.cc:1240] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:03.359440 29529 raft_consensus.cc:1240] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:03.362246 31199 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:03.363870 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:03.364720 29529 raft_consensus.cc:2393] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 2: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:03.348917 31197 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:12:03.365654 29521 raft_consensus.cc:2393] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 5: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:03.366673 31197 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:03.367230 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:03.367995 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:03.338292 31180 consensus_queue.cc:1059] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
W20260709 13:12:03.334151 31222 log.cc:927] Time spent T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:12:03.369056 29528 raft_consensus.cc:2393] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 5: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:03.369642 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:03.370347 30866 raft_consensus.cc:697] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:03.370746 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:03.371336 30866 consensus_queue.cc:237] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:03.373127 29529 raft_consensus.cc:1275] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:12:03.373919 29528 raft_consensus.cc:1275] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:12:03.374145 29456 consensus_queue.cc:260] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:03.375406 29456 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:03.369118 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:03.377200 29529 raft_consensus.cc:3055] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:03.377575 29529 raft_consensus.cc:740] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:03.378381 29529 consensus_queue.cc:260] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:03.379305 29529 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:03.379993 29523 raft_consensus.cc:1275] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:03.382730 29421 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:03.383689 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:03.385532 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:03.387907 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 107752us
I20260709 13:12:03.396528 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:03.397295 29455 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:03.402225 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:03.479985 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 88700.8us
W20260709 13:12:03.525379 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:03.529933 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:03.530459 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:03.490401 29419 leader_election.cc:336] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.543s (SENT)
W20260709 13:12:03.508369 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:03.552947 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.561239 31167 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:03.480149 31078 consensus_queue.cc:1048] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.085s
I20260709 13:12:03.565724 29419 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:03.570997 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 64178.8us
W20260709 13:12:03.572377 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 47146.2us
I20260709 13:12:03.543141 29529 raft_consensus.cc:1275] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:12:03.615118 29529 pending_rounds.cc:85] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 2
I20260709 13:12:03.615547 29529 pending_rounds.cc:107] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:12:03.615913 29529 raft_consensus.cc:2889] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:03.483595 31180 consensus_queue.cc:1243] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer 429e58eb058349e3bf72b5a870c8f6e5 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:12:03.600390 31162 consensus_queue.cc:1048] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
W20260709 13:12:03.644601 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 154284us
W20260709 13:12:03.649760 29419 leader_election.cc:336] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.681s (SENT)
I20260709 13:12:03.643291 31212 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.685083 31212 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:03.686367 29452 raft_consensus.cc:1240] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:03.687681 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:03.688002 31212 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:03.624433 31178 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:03.689000 31178 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.689702 31196 raft_consensus.cc:3055] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:03.399986 31177 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:03.690253 31196 raft_consensus.cc:740] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:03.690558 31177 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:12:03.682006 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 284606us
W20260709 13:12:03.713248 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:03.646111 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.753499 29419 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:03.689024 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:12:03.756080 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.765093 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:03.765815 29525 raft_consensus.cc:1275] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:03.769038 29530 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:03.770689 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 120971us
I20260709 13:12:03.710881 31078 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.771986 31078 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:03.772256 29419 leader_election.cc:336] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.690s (SENT)
W20260709 13:12:03.773489 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.774187 31165 raft_consensus.cc:2749] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:12:03.772848 29419 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:03.775400 31165 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:03.777697 31165 consensus_queue.cc:1059] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:03.722815 31192 raft_consensus.cc:697] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:03.779654 31192 consensus_queue.cc:237] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:12:03.780400 31162 raft_consensus.cc:3055] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:03.780975 31162 raft_consensus.cc:740] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:03.782214 31162 consensus_queue.cc:260] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:03.784529 31162 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:03.691288 31177 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:03.664912 31180 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:03.791791 29530 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:03.795166 29419 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:03.795344 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:03.767367 29456 raft_consensus.cc:1275] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:03.693001 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:03.802244 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:03.748111 29455 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
I20260709 13:12:03.704864 30917 consensus_queue.cc:1059] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.091s
I20260709 13:12:03.802265 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:03.817479 29523 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
I20260709 13:12:03.823730 29529 raft_consensus.cc:1275] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:12:03.815179 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:03.828049 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 252589us
I20260709 13:12:03.835615 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:03.836691 29523 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
W20260709 13:12:03.802079 30853 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:12:03.850795 29452 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
W20260709 13:12:03.856276 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.857414 29529 raft_consensus.cc:1275] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:03.691370 31196 consensus_queue.cc:260] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:03.690263 31178 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:03.860464 29419 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:03.861656 31235 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.861969 30917 raft_consensus.cc:3055] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:12:03.827450 29495 connection.cc:256] RPC call timeout handler was delayed by -1.1876714540001103s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15080000000000002s for a response
W20260709 13:12:03.873301 29495 connection.cc:256] RPC call timeout handler was delayed by -1.1525714540000536s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1547s for a response
W20260709 13:12:03.873767 29495 connection.cc:256] RPC call timeout handler was delayed by -1.0139714540000568s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17010000000000003s for a response
W20260709 13:12:03.874168 29495 connection.cc:256] RPC call timeout handler was delayed by -1.000471454000035s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1716s for a response
W20260709 13:12:03.874312 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.842294 31197 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.873004 30917 raft_consensus.cc:740] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:03.879619 31196 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:03.880577 30917 consensus_queue.cc:260] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:03.881084 31175 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:03.881891 30917 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:03.881642 31175 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:03.851482 31180 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:03.884198 29495 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:12:03.884899 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:03.885655 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:03.886363 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:03.887169 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:03.887727 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.878535 31235 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:03.890286 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 135516us
I20260709 13:12:03.800254 31240 consensus_queue.cc:1048] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.083s
I20260709 13:12:03.881697 31178 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:03.933071 29522 raft_consensus.cc:1275] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:03.933071 29530 raft_consensus.cc:1275] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:03.949563 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:03.950537 29529 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:03.889060 29527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93"
dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
mode: GRACEFUL
new_leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
 from {username='slave'} at 127.0.0.1:52288
I20260709 13:12:03.961050 29527 raft_consensus.cc:606] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Received request to transfer leadership to TS 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:03.961606 29527 raft_consensus.cc:614] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:12:03.962970 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 78691.3us
W20260709 13:12:03.965829 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.953951 31212 raft_consensus.cc:2804] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:03.886328 31197 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:03.972734 29419 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:03.994640 31235 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:03.997114 31175 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:03.997788 31175 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:03.960745 31178 raft_consensus.cc:2749] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:03.998328 29419 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:04.000289 29419 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:04.001578 29419 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:03.974778 31212 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:04.002594 31239 raft_consensus.cc:2749] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:04.002911 31212 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:04.003360 31239 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:04.004040 31239 raft_consensus.cc:2749] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:04.005755 31235 consensus_queue.cc:1048] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:04.007368 29419 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:04.009914 30853 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:04.010407 30853 raft_consensus.cc:697] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 3 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:04.011309 30853 consensus_queue.cc:237] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:04.018231 29419 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:04.020150 29419 leader_election.cc:400] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 4. Current term is 5.
I20260709 13:12:04.020603 30917 raft_consensus.cc:2749] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:04.022176 31235 consensus_queue.cc:1059] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:04.023056 31240 raft_consensus.cc:3055] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:04.023422 31240 raft_consensus.cc:740] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:04.023562 29419 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:04.024358 31235 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:04.024329 31240 consensus_queue.cc:260] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:04.025282 29451 raft_consensus.cc:1240] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:12:04.025724 31240 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:04.027858 31078 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:04.029440 31197 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:04.032718 31235 consensus_queue.cc:1059] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:04.033592 31235 consensus_queue.cc:1059] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:04.034385 31178 raft_consensus.cc:3055] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:04.034756 31178 raft_consensus.cc:740] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:04.018433 31077 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:04.042088 31204 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
W20260709 13:12:04.061100 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 185790us
I20260709 13:12:04.068974 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:04.073918 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:04.081704 29453 raft_consensus.cc:2393] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 4: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:04.081950 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:04.092976 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:04.082711 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:04.044274 31178 consensus_queue.cc:260] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:04.098567 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:04.098932 29526 raft_consensus.cc:1240] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:04.099097 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:04.101125 29456 raft_consensus.cc:2410] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 7 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:12:04.061285 31235 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:04.102677 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:04.102754 29344 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:04.108021 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 223936us
I20260709 13:12:04.108878 29455 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
I20260709 13:12:04.108951 29495 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:04.081043 31115 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:04.119197 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:04.121680 29344 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:12:04.124248 29493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 110665us
W20260709 13:12:04.126116 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:04.134209 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:04.135562 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.112010 31175 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.138396 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:04.117475 30686 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:04.144277 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 176431us
I20260709 13:12:04.093477 31204 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:04.123265 29344 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:04.148593 29344 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:04.151878 31115 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:04.109860 31167 consensus_queue.cc:1048] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.031s
W20260709 13:12:04.158774 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 49921.1us
I20260709 13:12:04.129112 30983 raft_consensus.cc:2804] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:04.163568 31115 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:04.164857 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.131266 31078 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:04.167232 29495 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:04.170970 31254 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:04.171486 31254 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:04.171909 31254 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:04.159176 30686 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:04.174135 30686 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:04.176062 29449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1455) took 1531 ms. Trace:
I20260709 13:12:04.176486 29449 rpcz_store.cc:276] 0709 13:12:02.644901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.659925 (+ 15024us) service_pool.cc:224] Handling call
0709 13:12:02.673142 (+ 13217us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:03.349271 (+676129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:04.175764 (+826493us) spinlock_profiling.cc:243] Waited 675 ms on lock 0x7b54000d6454. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:04.175969 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1553348992}
I20260709 13:12:04.112437 31235 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:04.161671 31076 raft_consensus.cc:2804] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:04.192289 29346 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:04.193097 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 44622.5us
I20260709 13:12:04.175227 31197 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.198421 30686 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:04.198904 30686 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.199268 30686 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:04.203989 30983 raft_consensus.cc:697] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:04.205062 30983 consensus_queue.cc:237] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:04.207839 31252 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:12:04.212698 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.215764 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:04.216774 29447 raft_consensus.cc:2393] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 2: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:04.146261 31175 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:04.185810 31076 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.168598 31244 consensus_queue.cc:1048] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:12:04.180691 30986 consensus_queue.cc:1048] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.040s
W20260709 13:12:04.219692 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 52591.1us
I20260709 13:12:04.306645 29495 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:12:04.309335 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:04.238085 31243 log.cc:927] Time spent T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:12:04.304095 30686 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:04.219512 31077 consensus_queue.cc:1048] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.104s
I20260709 13:12:04.323017 31257 raft_consensus.cc:2804] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:12:04.238745 31241 log.cc:927] Time spent T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:12:04.223130 31076 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:04.241290 31248 raft_consensus.cc:2749] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:12:04.330492 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 138293us
I20260709 13:12:04.260512 31238 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:04.335273 29346 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:04.236853 30853 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.214547 31197 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:04.345394 29495 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:12:04.348534 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.229468 31177 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:04.358022 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:04.360169 29524 raft_consensus.cc:2393] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 5: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:04.219246 31254 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:04.327831 31257 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:12:04.384995 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:04.412401 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 67087.4us
I20260709 13:12:04.412815 31204 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:04.413419 29495 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:04.414084 31175 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:04.414319 31250 raft_consensus.cc:2749] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:04.414729 29495 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:04.415534 31235 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:04.362703 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 152887us
I20260709 13:12:04.418286 29524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37958 (request call id 887) took 1017 ms. Trace:
I20260709 13:12:04.342549 31078 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:04.418731 31252 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:04.426076 29524 rpcz_store.cc:276] 0709 13:12:03.345714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:03.348047 (+  2333us) service_pool.cc:224] Handling call
0709 13:12:04.357895 (+1009848us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b5800060c98. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61b71 00007f6a78c61eee 0000000000375939 00007f6a80cd51e0 00007f6a80d9e0c4 00007f6a80d9e131 00007f6a80d4c0a0 00007f6a80d4b984 00007f6a7a2c66d4 00007f6a7a2c6662
0709 13:12:04.362618 (+  4723us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4831872}
W20260709 13:12:04.423440 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 79915.5us
I20260709 13:12:04.412504 31197 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:04.416993 31257 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:04.424901 31077 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.424712 31250 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:04.361361 31248 consensus_queue.cc:1048] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.089s
I20260709 13:12:04.359071 30853 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:04.344362 31238 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:04.460619 29344 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:04.416726 31251 consensus_queue.cc:1048] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:12:04.445055 31252 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:04.468320 31259 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:04.474676 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:04.471529 31252 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:04.472569 29495 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:12:04.459728 31247 log.cc:927] Time spent T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.290s	user 0.000s	sys 0.001s
I20260709 13:12:04.464565 30155 raft_consensus.cc:3060] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 LEARNER]: Advancing to term 5
I20260709 13:12:04.473584 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:04.481994 29522 raft_consensus.cc:1240] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:04.474936 29523 raft_consensus.cc:1275] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:12:04.441742 29346 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:04.480552 29529 raft_consensus.cc:1275] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:04.481067 29530 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
I20260709 13:12:04.487002 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:04.487883 29528 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:04.493773 31256 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:04.494333 31250 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:04.494722 30686 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:04.494911 31250 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:04.497855 31250 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:04.477097 31258 consensus_queue.cc:1048] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:12:04.503485 30853 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:04.474936 31259 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.481588 31254 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:04.464730 31078 consensus_queue.cc:1048] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
W20260709 13:12:04.520092 31212 consensus_meta.cc:287] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.517s	user 0.006s	sys 0.006s
I20260709 13:12:04.520727 31212 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:04.522043 29527 raft_consensus.cc:1240] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:04.477591 31077 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
W20260709 13:12:04.526050 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.525980 31077 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:04.529721 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:04.530704 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:04.531064 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 89434.9us
W20260709 13:12:04.537206 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.511439 31259 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:04.535452 31250 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.542197 31244 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:04.542699 30986 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:04.553449 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.545089 30155 raft_consensus.cc:1275] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 LEARNER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:12:04.527647 31240 consensus_meta.cc:287] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.501s	user 0.015s	sys 0.000s
I20260709 13:12:04.523314 31212 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:04.552256 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 289176us
I20260709 13:12:04.553372 31250 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:04.601969 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.559844 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:04.559770 31262 consensus_queue.cc:1059] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:12:04.563575 30686 consensus_queue.cc:1048] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:04.564631 30986 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:04.569232 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:04.611300 29529 raft_consensus.cc:2410] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:12:04.582106 31076 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:04.583446 29495 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:04.587910 31078 consensus_queue.cc:1048] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:12:04.589120 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 54090.4us
I20260709 13:12:04.589943 31248 consensus_queue.cc:1048] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:04.591403 29344 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:04.592038 31257 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:04.594121 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.527235 31252 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:04.597289 31251 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:04.602931 29524 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:04.641681 31251 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:04.644074 31251 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:04.646459 31252 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:04.646695 31077 raft_consensus.cc:3055] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:04.648612 31259 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:04.650765 31259 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:04.616703 31212 raft_consensus.cc:2749] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:04.629508 31204 consensus_queue.cc:1048] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:04.631002 31235 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.623415 31244 raft_consensus.cc:2749] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:04.632375 31175 consensus_queue.cc:1048] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:04.626748 31258 raft_consensus.cc:2804] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:04.626117 29346 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:04.638244 31178 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:04.640630 31265 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.624557 29344 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:04.676921 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 52432.5us
I20260709 13:12:04.654961 31257 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:04.656742 30986 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:04.657368 31177 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:04.658156 31250 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:04.689554 31076 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:04.680647 31199 raft_consensus.cc:2804] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:04.692469 31199 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.691679 31265 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:04.692893 31199 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:04.664778 29524 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:04.647408 31077 raft_consensus.cc:740] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:04.695116 31265 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:04.676002 31251 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:04.695762 31077 consensus_queue.cc:260] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:04.673213 31258 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:04.620890 29495 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:04.673034 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:04.674641 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 48600.5us
I20260709 13:12:04.670442 31235 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:04.701566 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:04.697132 31258 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:04.702239 29529 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:04.712719 31076 consensus_queue.cc:1048] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:04.723860 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:04.725104 29455 raft_consensus.cc:2393] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 3: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:04.725811 29529 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:12:04.727862 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:04.728801 29447 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
W20260709 13:12:04.732618 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 111757us
I20260709 13:12:04.733589 29495 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:04.705271 31077 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:12:04.794745 29493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 93113.9us
I20260709 13:12:04.773782 29495 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:04.804260 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:04.805210 29524 raft_consensus.cc:2393] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 4: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:04.805040 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:04.806319 29447 raft_consensus.cc:2393] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 4: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:04.804284 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:04.810518 29448 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:04.816819 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:04.716991 31244 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:04.819886 31244 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:04.820392 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:04.821362 29450 raft_consensus.cc:2468] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:12:04.822482 31244 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:04.822798 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:04.824023 29449 raft_consensus.cc:2393] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 3: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:04.828684 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:04.828902 31264 raft_consensus.cc:2764] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:12:04.831691 29451 raft_consensus.cc:2410] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:12:04.731941 31235 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:04.835258 31175 consensus_queue.cc:1048] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:04.836503 31251 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:04.794862 30853 consensus_queue.cc:1048] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:12:04.839901 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:04.741032 31197 raft_consensus.cc:2764] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
W20260709 13:12:04.843708 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 111641us
I20260709 13:12:04.871460 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:04.858132 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:04.875998 29521 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:04.903141 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:04.904480 29524 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:12:04.879040 29453 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:12:04.966641 29344 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:04.969820 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 90856.2us
I20260709 13:12:04.972733 29377 raft_consensus.cc:1275] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:12:04.974159 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:04.974344 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:04.974856 29453 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:12:04.975026 29375 raft_consensus.cc:1240] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:04.975827 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:04.975047 29450 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
I20260709 13:12:04.985154 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:04.985945 29452 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:04.987349 29453 raft_consensus.cc:2393] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 3: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:04.988497 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:04.989634 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:04.985816 31259 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:04.990332 29447 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
I20260709 13:12:04.996243 29524 raft_consensus.cc:1240] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:04.991218 29454 raft_consensus.cc:1240] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:05.013172 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:04.991788 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:05.013964 29450 raft_consensus.cc:2468] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
I20260709 13:12:04.994822 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:04.984383 29344 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:05.002682 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:05.004755 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:04.976670 31175 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.014070 29449 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:05.000852 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:05.018208 29453 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:04.976403 31244 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:04.977025 30985 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:05.021327 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:05.025738 29376 raft_consensus.cc:2393] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 5: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:05.027845 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:05.028743 29450 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:05.030867 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:05.036473 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:05.038561 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:05.017472 31259 raft_consensus.cc:697] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:05.046505 31259 consensus_queue.cc:237] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:05.047667 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:05.048203 31265 raft_consensus.cc:2764] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:12:05.048265 29450 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
I20260709 13:12:05.041836 31199 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:05.044413 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:05.049537 29454 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:05.032907 31264 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:05.050824 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:05.052160 29381 raft_consensus.cc:2368] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 2. Current term is 3.
I20260709 13:12:05.029991 31251 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:05.052596 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:05.058194 29376 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:05.053380 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:05.054052 31197 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.055097 31252 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.063253 29450 raft_consensus.cc:1275] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:05.063074 31252 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:05.065654 31252 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:05.031006 30985 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:05.062204 31197 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:05.066954 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:05.079921 29525 raft_consensus.cc:2376] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6. Re-sending same reply.
I20260709 13:12:05.081588 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:05.070825 29454 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:05.076336 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:05.085001 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:05.020758 31244 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:05.082593 29525 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:12:05.091043 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:12:05.105497 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.110261 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:05.020738 31175 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:05.129099 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 146625us
I20260709 13:12:05.126528 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:05.133803 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:05.133630 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:05.134523 29454 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:05.134681 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:05.138753 29448 raft_consensus.cc:2410] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:12:05.139249 29525 raft_consensus.cc:2393] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 2: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:05.140244 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:05.140929 29525 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:12:05.143978 29344 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:05.080040 31251 raft_consensus.cc:697] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:05.152300 29448 raft_consensus.cc:1275] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:05.152598 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:05.154345 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:05.157722 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:05.165553 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:05.161996 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:05.172935 31078 consensus_queue.cc:1059] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:05.173378 29447 raft_consensus.cc:1275] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:05.163335 31199 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:05.174162 31078 raft_consensus.cc:3055] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:05.174921 31078 raft_consensus.cc:740] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:05.174983 29447 raft_consensus.cc:1275] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:12:05.175447 29447 pending_rounds.cc:85] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 2
I20260709 13:12:05.175693 29447 pending_rounds.cc:107] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:12:05.175930 29447 raft_consensus.cc:2889] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:05.175971 31078 consensus_queue.cc:260] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:05.176769 29419 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:05.177040 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:05.177182 31078 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:05.177561 29447 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:12:05.086671 31264 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:05.158093 31204 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:05.179677 31177 raft_consensus.cc:2749] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:05.179862 31204 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.180358 31204 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:05.157711 31257 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.181459 31177 consensus_queue.cc:1048] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:05.182089 31257 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:05.183907 31197 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:05.189757 29448 raft_consensus.cc:1275] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:05.138130 30917 raft_consensus.cc:3055] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:05.197007 29447 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
W20260709 13:12:05.162133 31267 log.cc:927] Time spent T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:12:05.200003 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:05.207540 29524 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:12:05.207568 29448 raft_consensus.cc:1275] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:05.210511 29525 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
I20260709 13:12:05.205927 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:05.215258 29454 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:12:05.220275 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:05.206856 30887 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
W20260709 13:12:05.220960 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.206696 31259 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:05.224936 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:05.192905 30917 raft_consensus.cc:740] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:05.226881 29376 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
I20260709 13:12:05.230352 29449 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:12:05.233011 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:05.236178 29376 raft_consensus.cc:2393] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 5: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
W20260709 13:12:05.226276 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 147698us
I20260709 13:12:05.244490 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:05.245215 29456 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:05.238637 29495 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:05.251874 29495 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:05.254098 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.262570 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:05.253815 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:05.265755 31257 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:05.266266 29525 raft_consensus.cc:1240] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:05.231354 30887 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:05.259302 31197 raft_consensus.cc:2804] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:05.271858 31197 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.272294 31197 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:05.273553 31258 consensus_meta.cc:287] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.566s	user 0.002s	sys 0.010s
I20260709 13:12:05.274065 31258 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:05.275306 29380 raft_consensus.cc:1240] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:05.275768 31175 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:05.230996 31259 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:05.277041 29529 raft_consensus.cc:1275] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:05.277761 31264 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:05.271883 30917 consensus_queue.cc:260] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:05.279438 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:05.280401 29523 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:05.280877 29525 raft_consensus.cc:1275] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:05.281062 29529 raft_consensus.cc:1240] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:05.282212 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:05.282966 29375 raft_consensus.cc:2368] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3.
I20260709 13:12:05.293179 29525 raft_consensus.cc:1275] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:05.294100 29452 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:12:05.295013 29447 raft_consensus.cc:1240] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:05.291080 29453 raft_consensus.cc:2468] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
I20260709 13:12:05.299412 29455 raft_consensus.cc:1240] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 1. Current term is 2. Ops: []
W20260709 13:12:05.300487 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 48763us
I20260709 13:12:05.301786 29495 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:05.300356 29452 raft_consensus.cc:1275] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:05.309549 29495 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:05.279973 30917 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:05.319146 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 140467us
I20260709 13:12:05.320701 29419 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:05.213335 31251 consensus_queue.cc:237] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:05.324052 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:05.326578 29419 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:05.326649 29525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f"
dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:52288
I20260709 13:12:05.327301 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:05.327778 29525 raft_consensus.cc:606] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:12:05.314488 31256 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:05.329857 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:05.321738 31212 raft_consensus.cc:2804] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:05.315790 31257 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:05.324934 31175 raft_consensus.cc:2749] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:05.327840 29375 raft_consensus.cc:2368] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3.
I20260709 13:12:05.359622 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:05.360216 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:05.360813 29521 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
I20260709 13:12:05.323609 31235 consensus_queue.cc:1048] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:12:05.369578 31235 consensus_queue.cc:1048] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:05.370402 29375 raft_consensus.cc:1275] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:05.370543 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:05.369863 31282 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:05.371462 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:05.372952 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:05.377619 31266 consensus_queue.cc:1059] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:05.377794 29495 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:05.341356 31256 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:05.380653 29495 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:05.345498 31212 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.351652 31257 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:05.385241 29375 raft_consensus.cc:1275] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:12:05.418771 29456 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
I20260709 13:12:05.417968 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:05.420871 29375 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:05.416867 29523 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
I20260709 13:12:05.389281 31256 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:05.421923 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 95565.8us
I20260709 13:12:05.390699 31212 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:05.387529 31264 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:05.413673 31257 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:05.415804 31266 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:05.428531 29419 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:05.444190 29419 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:05.445451 29419 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:05.449584 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.453928 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:05.454391 29450 raft_consensus.cc:1240] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:05.455147 31201 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:05.455346 31280 log.cc:927] Time spent T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:12:05.455579 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:05.455760 31201 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:05.457273 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:05.458199 31201 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:05.458482 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:05.459184 29378 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
I20260709 13:12:05.460134 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:05.461333 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:05.461997 29378 raft_consensus.cc:2393] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 5: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:05.462688 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:05.463792 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:05.466262 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:05.470651 29419 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:05.471212 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:05.473493 29378 raft_consensus.cc:2393] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 5: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:05.483548 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:05.498397 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:05.440183 31282 consensus_queue.cc:1048] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:12:05.471254 31294 raft_consensus.cc:2764] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 6 LEADER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:12:05.517153 31295 raft_consensus.cc:2764] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:12:05.519393 31235 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:12:05.534003 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 153422us
I20260709 13:12:05.509526 31291 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:05.516364 31264 raft_consensus.cc:697] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
W20260709 13:12:05.553130 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 82603us
I20260709 13:12:05.535542 29495 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:05.566296 29419 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:05.570693 31266 raft_consensus.cc:697] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:05.629284 31303 raft_consensus.cc:2804] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:05.631253 31303 raft_consensus.cc:697] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:05.632419 31303 consensus_queue.cc:237] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:05.630120 31264 consensus_queue.cc:237] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:05.639153 31299 log.cc:927] Time spent T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:12:05.641269 31077 consensus_meta.cc:287] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.840s	user 0.010s	sys 0.002s
I20260709 13:12:05.641099 31266 consensus_queue.cc:237] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:05.644433 29377 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
I20260709 13:12:05.648093 29381 raft_consensus.cc:1275] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:12:05.649369 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 114107us
I20260709 13:12:05.650683 29495 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:05.649469 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:05.662580 29375 raft_consensus.cc:2410] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:12:05.664016 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:05.664788 29375 raft_consensus.cc:2368] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3.
I20260709 13:12:05.665550 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:05.666164 29375 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:12:05.668147 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:05.669476 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:05.668001 31308 raft_consensus.cc:2804] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:05.628175 31204 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:05.700152 31302 log.cc:927] Time spent T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:12:05.700660 31197 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:05.703544 31296 log.cc:927] Time spent T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:12:05.710321 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:05.711990 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:05.716213 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.738544 29376 raft_consensus.cc:1240] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:12:05.741010 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:05.741882 29372 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
W20260709 13:12:05.746630 31269 log.cc:927] Time spent T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 1.061s	user 0.014s	sys 0.010s
I20260709 13:12:05.748960 29522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 1715) took 1265 ms. Trace:
I20260709 13:12:05.749356 29522 rpcz_store.cc:276] 0709 13:12:04.483191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:04.484266 (+  1075us) service_pool.cc:224] Handling call
0709 13:12:04.484581 (+   315us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:04.602299 (+117718us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:04.602350 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:04.611414 (+  9064us) log.cc:844] Serialized 52 byte log entry
0709 13:12:04.685317 (+ 73903us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:04.685659 (+   342us) log.cc:844] Serialized 14 byte log entry
0709 13:12:04.705496 (+ 19837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:04.705579 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:05.743122 (+1037543us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b24002bddc8. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78b1f9c4 00007f6a78b1dacb 00007f6a78cd8dc9 00007f6a78cd8a55 00007f6a78cd809d 00007f6a7b90a10e 00007f6a7b92188c 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221
0709 13:12:05.748611 (+  5489us) raft_consensus.cc:1685] finished
0709 13:12:05.748731 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:05.748892 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25578,"prepare.queue_time_us":882,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":41019,"raft.run_cpu_time_us":55,"raft.run_wall_time_us":55,"spinlock_wait_cycles":55543552,"thread_start_us":167830,"threads_started":2,"wal-append.queue_time_us":57198}
I20260709 13:12:05.752880 31204 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:05.743175 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:05.708567 31197 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:05.756428 29381 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:12:05.711246 31212 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:05.713577 31308 raft_consensus.cc:697] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 5 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
W20260709 13:12:05.766562 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.768846 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:05.772305 29381 raft_consensus.cc:2410] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:12:05.781016 30887 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:05.691311 31307 consensus_queue.cc:1059] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.085s
I20260709 13:12:05.783725 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:05.783505 31307 raft_consensus.cc:3055] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:05.786355 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:05.786191 31307 raft_consensus.cc:740] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:05.801319 31258 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:05.806583 29374 raft_consensus.cc:1240] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: []
W20260709 13:12:05.808859 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 242618us
I20260709 13:12:05.832293 29419 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:05.833678 29419 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:05.815765 29453 raft_consensus.cc:1240] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:05.807997 31244 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:05.820802 31212 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:05.812667 29379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 175) took 1189 ms. Trace:
I20260709 13:12:05.809624 31291 raft_consensus.cc:2804] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:05.816354 31307 consensus_queue.cc:260] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:05.815047 31308 consensus_queue.cc:237] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:05.818645 31257 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:05.846467 31240 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:05.836935 31178 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:05.848479 31257 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:05.842998 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:05.851092 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:05.851600 29449 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:05.812614 31304 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.814875 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:05.858739 29375 raft_consensus.cc:2410] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:12:05.861553 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:05.817472 31256 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:05.828464 29381 raft_consensus.cc:1240] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5. Ops: []
W20260709 13:12:05.829588 31278 log.cc:927] Time spent T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.559s	user 0.002s	sys 0.000s
I20260709 13:12:05.831064 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:05.835350 29379 rpcz_store.cc:276] 0709 13:12:04.623151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:04.623349 (+   198us) service_pool.cc:224] Handling call
0709 13:12:05.380861 (+757512us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b5800010298. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61b71 00007f6a78c61a22 00007f6a81b7ac09 00007f6a80cd4ee0 00007f6a80d9e0ab 00007f6a80d9e131 00007f6a80d5ffc0 00007f6a80d4a929 00007f6a80d4a3d2 00007f6a7a2c1bd4
0709 13:12:05.811671 (+430810us) spinlock_profiling.cc:243] Waited 5.87 ms on lock 0x7b5800010298. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61e9c 00007f6a78c61a5b 00007f6a81b7ac09 00007f6a80cd4ee0 00007f6a80d9e0ab 00007f6a80d9e131 00007f6a80d5ffc0 00007f6a80d4a929 00007f6a80d4a3d2 00007f6a7a2c1bd4
0709 13:12:05.811913 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:05.812135 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:05.812173 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:05.812346 (+   173us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:05.812393 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:05.812460 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:05.812592 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18205824}
I20260709 13:12:05.836894 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:05.836652 31291 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.840920 31250 consensus_queue.cc:1059] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:05.841037 30853 consensus_queue.cc:1048] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:05.841418 31307 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:05.865474 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:05.859084 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:05.863022 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:05.884414 29378 raft_consensus.cc:2393] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 5: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:05.884796 29526 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
I20260709 13:12:05.866699 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:05.887272 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:05.882421 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:05.888734 29530 raft_consensus.cc:2393] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 6: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:05.870471 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:05.889267 29529 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:05.877287 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:05.889149 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:05.890349 29521 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:05.890784 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:05.891534 29375 raft_consensus.cc:2393] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 5: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:05.884305 29525 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
I20260709 13:12:05.868024 29524 raft_consensus.cc:1240] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:05.892544 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:05.893392 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:05.894197 29526 raft_consensus.cc:1275] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:05.887635 29523 raft_consensus.cc:1275] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:12:05.897882 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:05.899804 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:05.900013 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:05.900760 29526 raft_consensus.cc:2410] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:12:05.902635 29344 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:05.903102 29449 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
I20260709 13:12:05.904666 29495 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:05.886840 31238 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:05.906344 31199 consensus_queue.cc:1059] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:05.906831 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:05.907277 31244 raft_consensus.cc:2804] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:05.907755 31244 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:05.908136 31244 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:05.895784 31107 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.909024 31107 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:05.913043 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:05.908262 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:05.914731 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:05.914754 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:05.919064 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:05.882647 31304 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:05.922134 29374 raft_consensus.cc:2368] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3.
I20260709 13:12:05.923223 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:05.924398 29528 raft_consensus.cc:2393] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 5: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:05.856031 31178 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.924943 31235 consensus_queue.cc:1048] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:05.924896 31178 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:05.878389 31240 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.929342 31256 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:05.929482 31240 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:05.885661 31291 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:05.932904 31252 raft_consensus.cc:3055] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:05.933393 31252 raft_consensus.cc:740] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:05.934394 31252 consensus_queue.cc:260] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:05.936031 31250 raft_consensus.cc:2804] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:05.936779 31250 raft_consensus.cc:697] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:05.938051 31250 consensus_queue.cc:237] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:05.940347 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:05.940600 31199 raft_consensus.cc:3055] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:05.941275 29522 raft_consensus.cc:2393] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 5: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:05.941231 31199 raft_consensus.cc:740] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:05.938707 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:05.942437 31199 consensus_queue.cc:260] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:05.943516 29524 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:12:05.944444 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:05.949522 29495 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:05.945389 31252 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:05.954958 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:05.961737 29450 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:05.962005 29529 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:05.964565 29522 raft_consensus.cc:1240] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:12:05.960788 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:05.965936 29378 raft_consensus.cc:2393] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 5: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:05.956192 29495 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:05.959553 31244 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:05.969468 29528 raft_consensus.cc:1275] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:12:05.969691 29495 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:12:05.964035 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:12:05.950708 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.960559 31257 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:05.964241 31107 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:05.980895 29495 leader_election.cc:400] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3.
I20260709 13:12:05.964497 31178 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:05.988197 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 92231.7us
I20260709 13:12:05.989046 29346 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:05.985939 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:05.991050 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:05.992172 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:05.971145 31308 raft_consensus.cc:2749] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:05.984982 29495 leader_election.cc:403] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:12:05.981755 31212 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:05.981426 31305 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:05.999038 31201 raft_consensus.cc:2749] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:05.985306 31076 consensus_queue.cc:1048] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:12:05.979292 31291 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:05.997754 31257 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3.
I20260709 13:12:06.004837 29377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52172 (request call id 984) took 1011 ms. Trace:
I20260709 13:12:06.012706 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:06.014268 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:06.021809 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:06.023347 29448 raft_consensus.cc:1240] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:12:05.998412 29495 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:12:05.984297 31199 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:05.991917 31251 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.018110 29450 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
I20260709 13:12:06.019604 29377 rpcz_store.cc:276] 0709 13:12:04.993443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:04.996465 (+  3022us) service_pool.cc:224] Handling call
0709 13:12:06.004572 (+1008107us) spinlock_profiling.cc:243] Waited 629 ms on lock 0x7b540002f654. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:06.004732 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1446169984}
I20260709 13:12:06.025895 29495 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:05.997267 31212 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.033141 29495 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:06.033686 29448 raft_consensus.cc:1275] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:12:06.034575 29455 raft_consensus.cc:2393] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 6: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:06.036998 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:06.037949 31303 raft_consensus.cc:2749] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:06.041997 29495 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:12:06.030112 31308 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:06.045457 29495 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:06.037457 31212 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:06.036757 31256 raft_consensus.cc:2749] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:12:06.052525 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 63564.3us
I20260709 13:12:06.052107 29495 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:06.054234 29346 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:06.057116 29495 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:06.058894 31327 consensus_queue.cc:1048] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:06.059146 31076 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:06.060555 31310 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:06.065325 29448 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe"
dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
mode: GRACEFUL
new_leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
 from {username='slave'} at 127.0.0.1:36686
I20260709 13:12:06.066028 29346 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:06.034444 30986 consensus_queue.cc:1059] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:12:06.051550 31308 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.046970 31178 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.076860 29495 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:06.052753 31266 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:06.089912 30986 consensus_queue.cc:1048] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:12:06.092101 31266 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:06.092585 31266 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:06.053591 31257 raft_consensus.cc:2749] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:06.030661 31251 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:06.017568 31305 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:06.097524 31305 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:06.102835 31320 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:06.103543 31320 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:06.105923 31320 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:06.106050 31291 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:06.078819 31256 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:06.107625 31178 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:06.108824 29448 raft_consensus.cc:606] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Received request to transfer leadership to TS 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:06.109186 29448 raft_consensus.cc:614] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:06.109930 31178 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:06.089365 31325 log.cc:927] Time spent T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:12:06.090018 29346 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:06.112762 29380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52172 (request call id 977) took 1142 ms. Trace:
I20260709 13:12:06.090983 31326 raft_consensus.cc:3055] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:06.088241 31308 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:06.057974 31244 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:06.113307 29380 rpcz_store.cc:276] 0709 13:12:04.970458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:04.970623 (+   165us) service_pool.cc:224] Handling call
0709 13:12:04.971124 (+   501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:05.275756 (+304632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:06.112431 (+836675us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b54001d2c54. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:06.112679 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":699110784}
I20260709 13:12:06.120005 30985 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:06.115060 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 76290.9us
I20260709 13:12:06.125346 29344 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:06.086295 31076 raft_consensus.cc:2749] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:06.117314 31201 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:06.128610 29344 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:06.131453 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 54735.9us
I20260709 13:12:06.115535 31326 raft_consensus.cc:740] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:06.136076 29495 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:06.138831 29495 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:06.142218 29419 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:06.127244 31257 raft_consensus.cc:2749] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:06.146035 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:06.140066 31258 raft_consensus.cc:2804] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:06.147799 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:06.150277 29449 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:06.152035 31326 consensus_queue.cc:260] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:06.153492 31326 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:06.130132 31244 raft_consensus.cc:2804] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:06.154409 31244 raft_consensus.cc:697] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:06.154958 29344 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:06.142714 31264 raft_consensus.cc:2749] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:06.155393 31244 consensus_queue.cc:237] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:06.160207 29449 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:12:06.142671 31310 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:06.161762 29344 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:06.162374 31262 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:06.162663 29344 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:06.162804 31262 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:06.163267 30986 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:06.163700 30986 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.164059 30986 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:06.164912 29344 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:06.165750 31242 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:06.166181 31242 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:06.166549 31242 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:06.168215 31251 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:06.169214 31251 consensus_queue.cc:1048] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:06.169739 31329 consensus_queue.cc:1059] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:06.170876 31329 raft_consensus.cc:3055] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:06.171201 31329 raft_consensus.cc:740] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:06.172186 31329 consensus_queue.cc:260] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:06.174522 29530 raft_consensus.cc:1240] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:06.175458 31178 raft_consensus.cc:2749] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:12:06.177026 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.177544 31076 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:06.178067 31076 raft_consensus.cc:697] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:06.179787 31259 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:06.181660 31304 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:06.182228 31304 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.182359 31320 consensus_queue.cc:1048] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:06.182714 31304 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:06.185123 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 95182.9us
I20260709 13:12:06.185665 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:06.185989 29346 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:06.188068 31327 raft_consensus.cc:2749] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:06.188252 30985 consensus_queue.cc:1048] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:06.191046 29372 raft_consensus.cc:1240] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:06.191779 31304 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:06.179162 29421 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:06.163287 31262 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:06.197309 31178 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:06.198032 29421 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:06.200361 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:06.200518 29495 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:06.200848 29448 raft_consensus.cc:1275] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:06.206871 29524 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:06.212060 29419 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:06.211139 29421 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:06.228078 31178 consensus_queue.cc:1048] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:06.213946 31310 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:06.208676 31329 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:06.234930 29529 raft_consensus.cc:1240] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 LEADER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:12:06.213821 31238 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:06.223248 31282 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:12:06.247735 29451 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45796 (request call id 787) took 2158 ms (client timeout 1612 ms). Trace:
I20260709 13:12:06.179067 31076 consensus_queue.cc:237] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:06.259333 29451 rpcz_store.cc:269] 0709 13:12:04.076807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:04.081526 (+  4719us) service_pool.cc:224] Handling call
0709 13:12:06.234526 (+2153000us) spinlock_profiling.cc:243] Waited 748 ms on lock 0x7b54000190d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:06.234715 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1721107328}
I20260709 13:12:06.274887 29376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52172 (request call id 1001) took 1124 ms. Trace:
I20260709 13:12:06.213173 31251 consensus_queue.cc:1059] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:12:06.278823 29521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98"
dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
mode: GRACEFUL
new_leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
 from {username='slave'} at 127.0.0.1:52288
I20260709 13:12:06.276428 29376 rpcz_store.cc:276] 0709 13:12:05.150441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.390736 (+240295us) service_pool.cc:224] Handling call
0709 13:12:05.422408 (+ 31672us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:05.739338 (+316930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:06.274485 (+535147us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b54001ee954. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:06.274795 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":726167296}
I20260709 13:12:06.221379 31259 consensus_queue.cc:1048] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:12:06.315318 29521 raft_consensus.cc:606] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Received request to transfer leadership to TS 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:06.316059 29521 raft_consensus.cc:614] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:06.218125 31264 consensus_queue.cc:1048] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:12:06.312021 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:06.312863 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:06.262173 31282 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.261492 31310 raft_consensus.cc:697] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:06.223167 31327 consensus_queue.cc:1048] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:12:06.262650 31178 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:06.321190 29526 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
W20260709 13:12:06.338554 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.339432 29522 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:12:06.343963 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:06.344815 29521 raft_consensus.cc:2393] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 6: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:12:06.345305 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 128677us
I20260709 13:12:06.328539 31282 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:06.348065 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:06.343137 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 132100us
I20260709 13:12:06.350505 29525 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
W20260709 13:12:06.361505 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.364099 29421 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:06.366854 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:06.313194 31238 consensus_queue.cc:1059] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:12:06.377197 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:06.381119 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:06.384358 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:06.379513 29421 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:06.371086 30853 raft_consensus.cc:2749] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:06.397982 29521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6"
dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:52288
I20260709 13:12:06.401648 29521 raft_consensus.cc:606] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
W20260709 13:12:06.403434 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 77750.4us
I20260709 13:12:06.408898 29421 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:06.417079 29421 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:06.421964 29421 leader_election.cc:400] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 2. Current term is 3.
I20260709 13:12:06.422385 29421 leader_election.cc:403] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:12:06.421196 28234 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:12:06.428283 31333 log.cc:927] Time spent T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
W20260709 13:12:06.430332 31334 log.cc:927] Time spent T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
W20260709 13:12:06.431936 31332 log.cc:927] Time spent T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
W20260709 13:12:06.435103 31330 log.cc:927] Time spent T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.284s	user 0.000s	sys 0.002s
I20260709 13:12:06.418911 31178 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:06.426260 30917 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:06.434549 31266 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:06.415627 31238 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:06.411728 31327 consensus_queue.cc:1048] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
W20260709 13:12:06.457409 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:06.467360 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 45572.4us
I20260709 13:12:06.468377 29421 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:06.399380 31310 consensus_queue.cc:237] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:06.495116 31337 log.cc:927] Time spent T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:12:06.507128 29381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 730) took 1275 ms. Trace:
I20260709 13:12:06.464843 30917 raft_consensus.cc:697] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 3 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:06.427062 31242 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:06.471370 31177 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 2. Current term is 3.
I20260709 13:12:06.507637 29381 rpcz_store.cc:276] 0709 13:12:05.231758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.791927 (+560169us) service_pool.cc:224] Handling call
0709 13:12:05.828273 (+ 36346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:05.863766 (+ 35493us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:06.506903 (+643137us) spinlock_profiling.cc:243] Waited 35.9 ms on lock 0x7b54001ef0d0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd858ad 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:06.507059 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82681216}
I20260709 13:12:06.500562 31320 raft_consensus.cc:2749] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:06.506250 31201 raft_consensus.cc:2749] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:06.476444 30986 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:06.549297 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.530881 31250 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:06.551762 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.532035 31177 consensus_queue.cc:1048] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:12:06.524945 31346 consensus_queue.cc:1048] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
W20260709 13:12:06.564586 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 51972.8us
W20260709 13:12:06.567651 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 220213us
W20260709 13:12:06.562618 31199 consensus_meta.cc:287] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.533s	user 0.008s	sys 0.007s
I20260709 13:12:06.579023 31251 consensus_queue.cc:1048] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:06.557158 31250 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:06.646154 31212 consensus_meta.cc:287] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.581s	user 0.008s	sys 0.005s
I20260709 13:12:06.643039 31356 consensus_queue.cc:1048] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
W20260709 13:12:06.647830 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 73548.6us
I20260709 13:12:06.646634 31212 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:06.645533 31308 consensus_meta.cc:287] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.523s	user 0.007s	sys 0.005s
W20260709 13:12:06.646955 31350 log.cc:927] Time spent T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:12:06.563691 30917 consensus_queue.cc:237] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:06.659617 29346 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:06.662508 31201 raft_consensus.cc:2749] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:06.662624 29346 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:06.594784 31340 consensus_queue.cc:1048] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.151s
I20260709 13:12:06.658603 31242 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:06.667483 31242 raft_consensus.cc:2749] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:12:06.668092 31348 log.cc:927] Time spent T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:12:06.673082 31338 consensus_queue.cc:1059] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:06.675043 29346 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:06.676041 29527 raft_consensus.cc:1240] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:12:06.678545 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:06.679278 29381 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:12:06.680716 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:06.681267 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:06.681576 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:06.682575 29495 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:06.682734 29381 raft_consensus.cc:1240] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:12:06.683652 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:06.684480 29495 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:06.687263 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:06.687965 31076 consensus_queue.cc:1048] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:06.688813 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:06.689448 29378 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:12:06.689625 31252 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:06.692063 30986 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:06.693305 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:06.694566 29373 raft_consensus.cc:1275] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:12:06.688227 31242 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:06.654139 31266 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:06.664019 31345 log.cc:927] Time spent T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 13:12:06.679430 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:06.768013 29421 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:06.770884 31212 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:06.772732 31346 consensus_queue.cc:1059] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:12:06.777669 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:06.778914 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:06.780818 31250 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:06.781983 31240 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:06.785876 31329 consensus_meta.cc:287] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.540s	user 0.012s	sys 0.000s
I20260709 13:12:06.790091 31351 raft_consensus.cc:3055] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:06.790652 31351 raft_consensus.cc:740] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:06.655154 31308 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:06.796224 29377 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
I20260709 13:12:06.774396 31252 raft_consensus.cc:2749] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:06.837415 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:06.838217 29376 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
I20260709 13:12:06.839507 29421 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:06.840837 29523 raft_consensus.cc:1240] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:12:06.843564 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 159140us
I20260709 13:12:06.822978 31240 raft_consensus.cc:3055] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:06.846158 31212 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:06.850030 31212 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:06.852259 31212 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:06.773644 31294 consensus_queue.cc:1059] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 13:12:06.791944 31175 consensus_queue.cc:1059] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:12:06.861557 29419 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:06.803978 31351 consensus_queue.cc:260] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:06.844808 31346 raft_consensus.cc:2764] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:12:06.846393 31252 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:06.847224 29495 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:06.848793 31240 raft_consensus.cc:740] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:06.868821 31250 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:06.868333 29495 leader_election.cc:400] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3.
I20260709 13:12:06.870328 29495 leader_election.cc:403] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:12:06.873615 29495 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:06.887672 31353 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:06.888286 31353 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.888665 31353 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:06.892321 31349 log.cc:927] Time spent T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:12:06.903702 31351 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:06.904419 31340 raft_consensus.cc:1027] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: attempt to promote peer ca041dab9b2f44409ed7bf4c6cf66ab2: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260709 13:12:06.905704 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.911789 29495 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:12:06.874238 31262 consensus_meta.cc:287] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.677s	user 0.012s	sys 0.002s
W20260709 13:12:06.908269 31282 consensus_meta.cc:287] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.537s	user 0.006s	sys 0.007s
I20260709 13:12:06.927735 31282 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:06.926582 31340 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:06.920953 31262 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:06.906819 31359 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3.
W20260709 13:12:06.921908 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 60453.1us
I20260709 13:12:06.936177 29419 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:06.918582 31358 log.cc:927] Time spent T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:12:06.871666 31252 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:06.914661 31250 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:06.918224 31266 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:06.942148 29419 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:06.934167 31212 raft_consensus.cc:2749] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:12:06.938285 31326 consensus_meta.cc:287] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.784s	user 0.016s	sys 0.002s
I20260709 13:12:06.935462 31340 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.942413 31346 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:06.944321 29419 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:06.944804 31294 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:06.943187 31266 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:06.949461 31244 raft_consensus.cc:3055] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:06.961169 31244 raft_consensus.cc:740] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:06.959820 31340 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:06.940299 31240 consensus_queue.cc:260] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:06.966555 29419 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:06.970149 31262 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:06.971979 31352 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:06.975776 31362 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:06.976646 29529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 1758) took 1072 ms. Trace:
I20260709 13:12:06.977079 29529 rpcz_store.cc:276] 0709 13:12:05.904329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.965788 (+ 61459us) service_pool.cc:224] Handling call
0709 13:12:05.966077 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:06.235585 (+269508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:06.976334 (+740749us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b54003048d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:06.976573 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":617599360}
I20260709 13:12:06.977927 31107 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.941493 31250 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:06.980319 31250 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:06.980508 31252 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:06.981238 31107 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:06.982400 31282 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:06.962458 31244 consensus_queue.cc:260] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:06.984467 31244 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:06.985950 29372 raft_consensus.cc:1240] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 4. Current term is 5. Ops: []
W20260709 13:12:06.986253 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.988067 28234 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:06.987972 31339 raft_consensus.cc:3055] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:06.988559 31339 raft_consensus.cc:740] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:06.989557 31339 consensus_queue.cc:260] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:06.990913 31339 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:06.962543 31266 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:06.996315 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:07.000310 29419 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:07.000667 29372 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:07.001173 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 89478.7us
I20260709 13:12:07.001674 29419 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:06.963443 31308 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:07.009495 29379 raft_consensus.cc:2955] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:12:07.012367 30853 raft_consensus.cc:2749] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:07.018288 31353 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:07.024050 29372 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
I20260709 13:12:07.024948 29495 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:06.996189 31362 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:07.030200 31362 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:07.012070 31266 consensus_queue.cc:1048] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:12:07.032816 31362 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:06.993414 31291 raft_consensus.cc:2955] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:12:07.038445 31295 raft_consensus.cc:3055] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:07.038937 31295 raft_consensus.cc:740] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:07.039932 31295 consensus_queue.cc:260] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:07.005446 31250 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:12:07.050923 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.021070 30917 raft_consensus.cc:2749] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:07.059659 29344 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:07.061829 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 55496.2us
I20260709 13:12:07.063822 31240 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:07.063558 31282 consensus_queue.cc:1059] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:07.064813 31282 raft_consensus.cc:3055] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:07.065176 31282 raft_consensus.cc:740] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
W20260709 13:12:07.066001 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:07.068850 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.071902 31282 consensus_queue.cc:260] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:07.074810 31282 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:07.076680 31327 raft_consensus.cc:2804] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:07.077188 31327 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:07.077589 31327 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:07.088584 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 85081.5us
I20260709 13:12:07.010236 31352 raft_consensus.cc:2749] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:07.004066 31252 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:07.139358 29277 catalog_manager.cc:5697] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 3 to 5, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 5 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:12:07.041415 31250 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:07.107173 31295 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:07.116220 31252 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:07.138015 31244 consensus_queue.cc:1059] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:12:07.153098 31282 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:07.158658 29449 raft_consensus.cc:1240] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:12:07.162146 29448 raft_consensus.cc:1275] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:07.164948 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:07.167948 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:12:07.167855 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 143032us
W20260709 13:12:07.153678 31258 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.985s	user 0.059s	sys 0.050s
I20260709 13:12:07.175805 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:07.156121 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:07.174389 29524 raft_consensus.cc:1240] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:07.176510 30853 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:12:07.280150 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.285562 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:07.305202 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:07.306912 29526 raft_consensus.cc:1240] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:07.308713 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:07.309428 29526 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:07.275195 31310 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:07.310774 29521 raft_consensus.cc:1240] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:12:07.298725 31258 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.126s	user 0.059s	sys 0.050s
I20260709 13:12:07.326252 31242 raft_consensus.cc:3055] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:07.353806 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:07.330252 31327 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:07.331341 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:07.390823 29375 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:07.331806 29377 raft_consensus.cc:1240] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:07.332046 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:07.332454 29421 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:07.333253 31240 consensus_queue.cc:1059] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:07.334136 31351 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:07.335791 31178 consensus_queue.cc:1059] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:07.314425 31353 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:07.340404 31252 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:07.345495 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:07.412391 29372 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:07.344147 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:07.416860 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:07.329384 29376 raft_consensus.cc:1240] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:07.351161 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:07.377426 29526 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
I20260709 13:12:07.420465 29527 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:07.421237 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:07.378942 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:07.423944 29454 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:07.349328 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:07.350891 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:07.433625 29522 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 4.
I20260709 13:12:07.362648 29455 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:07.389716 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:07.435343 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:07.436252 29455 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
I20260709 13:12:07.437443 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:07.438742 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:07.392884 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:07.441030 29377 raft_consensus.cc:1275] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:07.393677 29374 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 4.
I20260709 13:12:07.395083 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:07.402173 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 69803.5us
I20260709 13:12:07.323625 31238 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.435539 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:07.307901 31107 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:07.442685 29377 raft_consensus.cc:1275] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:12:07.448094 29377 pending_rounds.cc:85] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5: Aborting all ops after (but not including) 2
I20260709 13:12:07.448643 29378 raft_consensus.cc:1275] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:07.448730 29377 pending_rounds.cc:107] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:12:07.449229 29377 raft_consensus.cc:2889] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:07.450066 29378 raft_consensus.cc:1275] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:07.444372 29527 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
I20260709 13:12:07.442518 29372 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
I20260709 13:12:07.452414 31238 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:07.454879 31238 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:07.458051 29454 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
I20260709 13:12:07.298317 31282 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:07.343405 31258 raft_consensus.cc:697] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:12:07.464563 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 84172.9us
I20260709 13:12:07.465859 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:07.376528 31242 raft_consensus.cc:740] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:07.498677 31242 consensus_queue.cc:260] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:07.500483 31242 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:07.370138 31212 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:07.503862 31212 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:07.506837 31212 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:07.470273 29529 raft_consensus.cc:1275] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:07.509671 29455 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:12:07.515393 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:07.467243 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:07.411846 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:07.316963 30853 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:07.479821 29527 raft_consensus.cc:1275] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:12:07.482949 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:07.410964 31326 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.486318 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:07.414273 31304 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:12:07.535005 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.488823 29495 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:07.532821 29455 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:12:07.313560 31340 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:07.520453 29521 raft_consensus.cc:1275] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:07.475291 31352 raft_consensus.cc:3055] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:12:07.537547 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.488446 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:07.536388 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 47658.7us
I20260709 13:12:07.473852 29375 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
I20260709 13:12:07.413362 31351 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:07.487177 29419 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:07.540702 29495 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:07.545779 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 54269.5us
I20260709 13:12:07.548323 29495 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:07.549261 31308 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:07.549564 29495 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:07.549784 31308 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:07.550343 31308 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:07.551599 31252 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:07.544450 31352 raft_consensus.cc:740] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:07.562098 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:07.489969 31320 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:07.566067 29454 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:12:07.553855 31235 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:12:07.571679 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 84577.8us
I20260709 13:12:07.572027 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:07.572435 29419 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:07.572721 29449 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:12:07.569062 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:07.576026 29495 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:07.552789 31362 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:07.554443 31212 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.579314 29346 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:07.580888 29449 raft_consensus.cc:1240] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:12:07.567113 31305 raft_consensus.cc:2804] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:07.604125 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:07.543741 31326 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:07.576995 31252 raft_consensus.cc:697] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 6 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:07.584097 31238 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:07.579173 31362 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.570627 31320 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:07.592427 31304 raft_consensus.cc:697] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 6 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:07.570976 31235 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:07.576882 31244 consensus_queue.cc:1048] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:12:07.607077 31107 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:07.605984 31310 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:07.598304 31204 raft_consensus.cc:2804] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:07.598362 31305 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:07.668123 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:07.643993 31248 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.681432 31248 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:07.683954 31364 log.cc:927] Time spent T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 13:12:07.684921 31326 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:07.680615 31305 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:07.702543 29276 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37608 (request call id 150) took 13120 ms (client timeout 15000 ms). Trace:
I20260709 13:12:07.592005 31258 consensus_queue.cc:237] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:07.654458 31362 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:07.647337 31238 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.705490 31238 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:07.599588 31212 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:07.650255 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:07.709398 29447 raft_consensus.cc:1275] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:12:07.670743 31177 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:07.676180 31310 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:07.614321 31352 consensus_queue.cc:260] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:07.719586 31370 log.cc:927] Time spent T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.251s	user 0.002s	sys 0.000s
I20260709 13:12:07.721129 31107 raft_consensus.cc:697] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 6 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:07.721370 31204 raft_consensus.cc:697] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:07.733306 31310 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:07.760710 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 184735us
I20260709 13:12:07.724805 31369 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:07.767407 31369 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:07.756142 29279 catalog_manager.cc:5697] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:07.703029 29276 rpcz_store.cc:269] 0709 13:11:54.582669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.583707 (+  1038us) service_pool.cc:224] Handling call
0709 13:12:07.702444 (+13118737us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:03.564067 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:03.564676 (+   609us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:03.564716 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:12:03.564733 (+    17us) tablet.cc:662] Decoding operations
0709 13:12:03.566242 (+  1509us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:03.566356 (+   114us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:03.566397 (+    41us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:12:03.723782 (+157385us) tablet.cc:701] Row locks acquired
0709 13:12:03.723821 (+    39us) write_op.cc:260] PREPARE: finished
0709 13:12:03.724111 (+   290us) write_op.cc:270] Start()
0709 13:12:03.724414 (+   303us) write_op.cc:276] Timestamp: P: 1783602723724031 usec, L: 0
0709 13:12:03.724473 (+    59us) op_driver.cc:348] REPLICATION: starting
0709 13:12:03.778121 (+ 53648us) log.cc:844] Serialized 6409 byte log entry
0709 13:12:04.593568 (+815447us) op_driver.cc:464] REPLICATION: finished
0709 13:12:04.973364 (+379796us) write_op.cc:301] APPLY: starting
0709 13:12:04.973476 (+   112us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:04.973890 (+   414us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:04.974028 (+   138us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:05.054934 (+ 80906us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:05.055307 (+   373us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 13:12:05.055380 (+    73us) write_op.cc:312] APPLY: finished
0709 13:12:05.055809 (+   429us) log.cc:844] Serialized 112 byte log entry
0709 13:12:05.081264 (+ 25455us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:05.128865 (+ 47601us) write_op.cc:454] Released schema lock
0709 13:12:05.139481 (+ 10616us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:05.198829 (+ 59348us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:05.209014 (+ 10185us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3257,"reported_tablets":37,"child_traces":[["op",{"apply.queue_time_us":209718,"apply.run_cpu_time_us":6148,"apply.run_wall_time_us":196365,"num_ops":16,"prepare.queue_time_us":312411,"prepare.run_cpu_time_us":25394,"prepare.run_wall_time_us":425663,"raft.queue_time_us":182467,"raft.run_cpu_time_us":47482,"raft.run_wall_time_us":71261,"replication_time_us":868858,"thread_start_us":485284,"threads_started":4,"wal-append.queue_time_us":318589,"wal-append.run_cpu_time_us":18156,"wal-append.run_wall_time_us":1968052}]]}
I20260709 13:12:07.800665 31369 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:07.801657 31339 consensus_meta.cc:287] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.810s	user 0.018s	sys 0.000s
I20260709 13:12:07.802698 31204 consensus_queue.cc:237] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:07.770288 29279 catalog_manager.cc:5697] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 4 to 5, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 5 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:07.808549 29279 catalog_manager.cc:5697] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 4 to 5, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 5 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:07.817413 29279 catalog_manager.cc:5697] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:07.823637 31340 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:07.728681 31177 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:07.833225 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:07.721681 31252 consensus_queue.cc:237] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:07.826004 31326 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:07.845608 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 399213us
I20260709 13:12:07.822847 30985 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.847296 29279 catalog_manager.cc:5697] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 1 to 3, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 3 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:07.849684 29376 raft_consensus.cc:1275] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:07.829129 31235 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:07.737882 31304 consensus_queue.cc:237] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:07.855444 29279 catalog_manager.cc:5697] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 3 to 4, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 4 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:07.857414 31266 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:07.864892 29376 raft_consensus.cc:1275] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:07.844094 31320 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:07.865130 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:07.866118 29380 raft_consensus.cc:1240] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:07.878990 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:07.881006 29380 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:07.881829 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:07.868197 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:07.882905 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:07.880270 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:07.884425 29279 catalog_manager.cc:5697] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 3 to 4, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 4 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:07.866319 29495 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:07.889221 29279 catalog_manager.cc:5697] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 3 to 4, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 4 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:07.899606 29528 raft_consensus.cc:1275] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:07.929553 29380 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 7.
I20260709 13:12:07.933104 31340 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.933736 31340 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:07.937136 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.859776 31326 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:07.866757 30917 consensus_queue.cc:1059] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 13:12:07.859824 30985 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:07.871116 31240 consensus_queue.cc:1059] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:12:07.877099 31266 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:07.968150 31376 log.cc:927] Time spent T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:12:07.945160 31386 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:07.997130 31386 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:07.986496 31340 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:07.986969 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 245011us
W20260709 13:12:07.989995 29263 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leader transfer in progress [suppressed 33 similar messages]
I20260709 13:12:08.002581 29455 raft_consensus.cc:1275] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:08.004710 29455 raft_consensus.cc:1275] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:12:07.990517 31291 consensus_meta.cc:287] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.956s	user 0.013s	sys 0.002s
I20260709 13:12:07.992098 31398 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:07.992601 29447 raft_consensus.cc:1275] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:07.994612 30985 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:08.012158 29344 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:07.969936 31248 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:07.972393 31199 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.880520 31107 consensus_queue.cc:237] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:08.023420 29447 raft_consensus.cc:1275] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:12:08.027998 29450 raft_consensus.cc:1275] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:12:08.035450 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 50497.8us
I20260709 13:12:08.036293 29447 pending_rounds.cc:85] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 3
I20260709 13:12:08.036738 29447 pending_rounds.cc:107] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:12:08.037132 29447 raft_consensus.cc:2889] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:08.034118 29451 raft_consensus.cc:1275] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:07.977373 31212 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:08.044358 29344 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:08.042207 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:08.061156 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:08.063930 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:08.066329 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 200067us
I20260709 13:12:08.067530 29495 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:08.036042 31398 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:08.049459 31248 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:08.033960 29279 catalog_manager.cc:5697] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 2 to 4, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 4 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:08.111815 29279 catalog_manager.cc:5697] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:08.115204 29279 catalog_manager.cc:5697] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:08.127817 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:08.085022 31177 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:08.085495 30985 consensus_queue.cc:1048] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
W20260709 13:12:08.134459 31399 log.cc:927] Time spent T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:12:08.135179 31238 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:08.139719 31282 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:08.143462 31352 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:08.146292 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:08.084786 31212 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:08.073339 31386 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:08.097599 31204 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:08.034819 31199 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:08.104848 31398 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:08.158332 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:08.171274 29380 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:08.160997 29279 catalog_manager.cc:5697] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 2 to 4, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 4 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:08.068427 31338 consensus_queue.cc:1048] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.084s
W20260709 13:12:08.173688 29263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 189692us
W20260709 13:12:08.172851 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 102538us
I20260709 13:12:08.099903 31355 consensus_queue.cc:1048] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 13:12:08.139360 31362 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:08.186142 29279 catalog_manager.cc:5697] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 2 to 3, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 3 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:08.169432 31212 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:08.191367 29380 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
W20260709 13:12:08.270344 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 93620.1us
W20260709 13:12:08.177323 31405 log.cc:927] Time spent T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 13:12:08.192703 31295 consensus_meta.cc:287] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.908s	user 0.014s	sys 0.001s
I20260709 13:12:08.247817 31240 raft_consensus.cc:1064] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a: attempting to promote NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 to VOTER
I20260709 13:12:08.293581 29453 raft_consensus.cc:2410] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:12:08.276872 29279 catalog_manager.cc:5697] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:08.297834 31409 consensus_queue.cc:1048] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:08.300840 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:08.301697 29279 catalog_manager.cc:5697] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 1 to 2, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 2 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:08.303112 30119 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:08.166872 31238 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:08.299317 31362 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:08.303436 29279 catalog_manager.cc:5697] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 2 to 4, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 4 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
W20260709 13:12:08.322290 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 204319us
W20260709 13:12:08.244612 31404 log.cc:927] Time spent T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:12:08.177280 31411 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.245623 31266 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:08.329012 29495 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:08.245059 31420 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.257267 31413 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:08.245220 31398 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:08.228289 31326 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:08.333855 29495 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:08.320303 31425 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:08.345561 31409 raft_consensus.cc:2749] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:08.347404 31199 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:08.357484 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:08.358603 29372 raft_consensus.cc:2393] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 5: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:08.350699 29521 consensus_queue.cc:237] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:08.307652 31175 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.339922 29523 raft_consensus.cc:1240] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:12:08.338490 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:08.348027 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:08.334849 31362 consensus_queue.cc:1048] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:12:08.369004 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:08.349156 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:08.325865 31418 consensus_queue.cc:1048] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:12:08.349608 29373 raft_consensus.cc:1240] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:08.353895 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:08.354897 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:08.355759 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:08.357151 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:08.270407 31386 consensus_queue.cc:1048] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 13:12:08.340241 31266 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:08.368119 31305 consensus_meta.cc:287] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.667s	user 0.014s	sys 0.000s
I20260709 13:12:08.330585 31304 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.364122 29527 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
W20260709 13:12:08.392131 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 53978.5us
W20260709 13:12:08.381928 31242 consensus_meta.cc:287] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.879s	user 0.011s	sys 0.006s
I20260709 13:12:08.396792 29452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 83) took 1078 ms. Trace:
I20260709 13:12:08.340785 31240 consensus_queue.cc:237] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:08.368355 31212 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:08.397226 29452 rpcz_store.cc:276] 0709 13:12:07.318481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:07.712556 (+394075us) service_pool.cc:224] Handling call
0709 13:12:07.735796 (+ 23240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:07.861941 (+126145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:07.861975 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:07.862019 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:07.862046 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:08.396570 (+534524us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b540001a4d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:08.396622 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:08.396734 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":289562880}
I20260709 13:12:08.332832 31411 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:08.429601 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:08.431324 29522 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:08.378506 31175 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:08.467110 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:08.453485 31308 consensus_meta.cc:287] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.884s	user 0.014s	sys 0.001s
I20260709 13:12:08.396679 31304 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:08.394806 31305 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:08.351862 31420 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:08.457880 30985 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:08.482172 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.489684 29522 raft_consensus.cc:1275] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:08.493046 29527 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
I20260709 13:12:08.454946 31338 consensus_queue.cc:1059] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:12:08.493640 29530 raft_consensus.cc:1240] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:08.479297 31308 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:08.478945 31362 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.502715 31362 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:08.504242 31424 log.cc:927] Time spent T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 13:12:08.505430 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:08.522547 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.492017 31282 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.647718 31238 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.651615 31238 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:08.652372 31429 log.cc:927] Time spent T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 13:12:08.654836 31178 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.641075 31355 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.656344 31355 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:08.660324 31340 raft_consensus.cc:3055] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:08.660959 31340 raft_consensus.cc:740] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:08.662899 31250 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:08.664254 31415 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:08.667748 31415 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:08.676772 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:08.683219 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:08.686544 29421 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:08.693602 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.697010 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:08.697824 29372 raft_consensus.cc:1240] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:08.499336 30985 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:08.703507 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:08.710065 29344 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:08.714600 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:08.646572 31282 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:08.682085 31310 consensus_meta.cc:287] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.859s	user 0.015s	sys 0.000s
I20260709 13:12:08.666265 31410 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.663446 31238 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:08.666728 31355 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:08.733878 29454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45796 (request call id 829) took 1323 ms. Trace:
I20260709 13:12:08.723258 31262 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:08.741288 31262 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.741693 31262 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:08.734426 29454 rpcz_store.cc:276] 0709 13:12:07.404950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:07.486035 (+ 81085us) service_pool.cc:224] Handling call
0709 13:12:08.728063 (+1242028us) spinlock_profiling.cc:243] Waited 30.7 ms on lock 0x7b54002913d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:08.728293 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70616320}
I20260709 13:12:08.746905 29381 raft_consensus.cc:1275] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:12:08.665247 31178 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:08.710228 31250 consensus_queue.cc:1048] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:12:08.708858 31295 consensus_queue.cc:1048] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:12:08.722347 31107 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:08.725720 31415 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:08.733104 31351 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:08.763513 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 52302us
I20260709 13:12:08.767341 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:08.776248 29421 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:08.725952 31258 consensus_queue.cc:1048] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:12:08.727710 31310 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:08.756791 31238 consensus_queue.cc:1059] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:12:08.772408 31355 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:08.794821 31352 consensus_meta.cc:287] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.648s	user 0.009s	sys 0.005s
I20260709 13:12:08.783627 31291 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:08.779776 31413 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
W20260709 13:12:08.806943 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 85170.8us
I20260709 13:12:08.785194 31411 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:08.795821 31408 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.737525 31410 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:08.805369 31434 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:08.809392 31304 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:08.827521 31238 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:12:08.858100 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 77426us
I20260709 13:12:08.863672 29421 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:08.806344 31355 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:08.842692 31352 raft_consensus.cc:3055] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:08.841784 31411 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:08.868337 31282 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:08.872222 31238 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:08.872289 31240 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:08.870319 31352 raft_consensus.cc:740] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:08.880887 31250 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:08.883466 31355 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:08.855208 31420 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:08.891363 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.817453 31413 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:08.877214 31304 consensus_queue.cc:1059] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
W20260709 13:12:08.895001 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.873131 31204 raft_consensus.cc:493] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
W20260709 13:12:08.898571 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.826184 31408 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:08.881568 31295 consensus_queue.cc:1059] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:12:08.875913 31411 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:08.958421 31408 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:08.958590 31411 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:08.894090 31422 consensus_queue.cc:1048] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.199s
I20260709 13:12:08.897747 31250 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:08.939888 31436 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:08.960732 31436 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:08.961853 31250 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:08.856194 31434 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:08.936514 31432 log.cc:927] Time spent T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
W20260709 13:12:08.936581 31428 log.cc:927] Time spent T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
W20260709 13:12:08.937619 31433 log.cc:927] Time spent T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.087s	user 0.001s	sys 0.001s
I20260709 13:12:08.938313 30985 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:08.910216 31204 raft_consensus.cc:515] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:09.040355 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:09.041666 29375 raft_consensus.cc:2410] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:12:08.900882 31420 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
W20260709 13:12:08.956207 31430 log.cc:927] Time spent T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:12:08.955964 31352 consensus_queue.cc:260] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:08.902557 31240 raft_consensus.cc:697] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:08.905673 31291 raft_consensus.cc:697] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 7 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:08.985529 29377 raft_consensus.cc:1275] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:12:08.986388 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:09.034826 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:09.056951 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:09.035022 31178 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:09.045534 31372 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.017s	user 0.014s	sys 0.040s
I20260709 13:12:09.034902 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:08.980865 31415 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.060245 31436 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:09.092957 31434 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:09.094725 31238 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:09.078469 31372 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.208s	user 0.014s	sys 0.041s
I20260709 13:12:09.041728 31204 leader_election.cc:290] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:09.081470 31422 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.061122 31447 consensus_queue.cc:1048] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:09.063534 31291 consensus_queue.cc:237] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:09.064220 31413 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:09.076272 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.056584 31420 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:09.073742 31445 raft_consensus.cc:493] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:09.042909 31310 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:08.987042 31250 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:09.035398 31410 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:09.113339 31410 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.113938 31410 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:09.116772 31420 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:09.060598 31240 consensus_queue.cc:237] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:09.128841 31448 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:09.083768 31352 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:09.129832 31448 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:09.096621 31415 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:09.111372 31262 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:09.111415 31250 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:12:09.112785 31422 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:09.079873 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.110939 31445 raft_consensus.cc:515] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:09.185114 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:09.202829 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.182524 31413 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:09.185624 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:09.296538 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.118273 31204 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:09.182978 31310 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:09.358585 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:09.375770 29526 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:09.380744 31212 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:09.385362 29526 raft_consensus.cc:1240] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:09.386580 29453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45798 (request call id 1534) took 2216 ms. Trace:
I20260709 13:12:09.213307 31447 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:09.391429 31408 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.397835 29522 raft_consensus.cc:1240] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:12:09.351832 31413 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:09.392689 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.348737 31294 raft_consensus.cc:3055] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:09.375766 31411 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:09.295517 31338 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:09.399307 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:09.399648 29449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1541) took 2229 ms. Trace:
I20260709 13:12:09.382608 31295 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:09.357544 31436 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:09.377152 31351 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.407229 31294 raft_consensus.cc:740] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:09.387332 29453 rpcz_store.cc:276] 0709 13:12:07.167588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:07.167705 (+   117us) service_pool.cc:224] Handling call
0709 13:12:09.383928 (+2216223us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b5400371ed4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:09.384172 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2302430592}
I20260709 13:12:09.382907 31434 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:09.416263 29449 rpcz_store.cc:276] 0709 13:12:07.170169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:07.583589 (+413420us) service_pool.cc:224] Handling call
0709 13:12:07.583861 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:07.693676 (+109815us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:07.693718 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:07.693780 (+    62us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:07.693824 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:09.399317 (+1705493us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54000d7354. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:09.399387 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:09.399573 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":251941120}
I20260709 13:12:09.382295 31366 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:09.393652 31304 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.436640 31304 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:09.437131 31413 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:09.425634 31436 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:09.438912 31304 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:09.419238 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:09.440474 31436 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:09.418375 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:09.406191 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.359213 31204 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:09.445307 31204 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:09.381384 31212 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:09.445960 31445 leader_election.cc:290] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:09.382891 31310 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:09.447080 31450 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:09.447678 31450 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:09.448479 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:09.434275 29375 raft_consensus.cc:1240] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:09.402357 31447 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:09.435674 31366 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:09.394085 31178 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:09.435292 31434 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:09.420819 31411 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:09.423694 31295 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:09.460119 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:09.455317 31436 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:09.406359 31408 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:09.462121 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:09.464116 29456 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
I20260709 13:12:09.460572 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:09.462810 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:09.465941 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:09.472246 29454 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
I20260709 13:12:09.466197 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:12:09.461642 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.473583 29448 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
I20260709 13:12:09.476886 29448 raft_consensus.cc:1275] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:12:09.477952 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:09.479236 29452 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:09.455240 31410 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:09.458514 31304 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.461057 31291 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.461272 31178 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:09.430205 31351 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:09.421787 31338 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:09.462697 31235 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:12:09.498070 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 92417.7us
I20260709 13:12:09.452440 31450 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:09.514442 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.573827 29344 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:09.470091 31436 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:09.581960 29452 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
I20260709 13:12:09.488540 31310 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:09.505906 31235 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:09.592914 31351 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:09.594265 31235 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:09.585021 30887 raft_consensus.cc:493] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:09.596530 31422 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:09.597592 31453 log.cc:927] Time spent T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:12:09.599272 31447 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:09.600839 29529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 1810) took 1204 ms. Trace:
I20260709 13:12:09.601545 29529 rpcz_store.cc:276] 0709 13:12:08.396680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:08.396827 (+   147us) service_pool.cc:224] Handling call
0709 13:12:08.397180 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:08.457122 (+ 59942us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:08.457181 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:08.457842 (+   661us) log.cc:844] Serialized 26 byte log entry
0709 13:12:08.709935 (+252093us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:08.709976 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:09.600387 (+890411us) spinlock_profiling.cc:243] Waited 59.4 ms on lock 0x7b54002e3bd4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:09.600461 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:09.600519 (+    58us) raft_consensus.cc:1685] finished
0709 13:12:09.600536 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:09.600773 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":290,"raft.queue_time_us":2323,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":8015,"spinlock_wait_cycles":136591232,"thread_start_us":229607,"threads_started":1,"wal-append.queue_time_us":309515}
I20260709 13:12:09.585358 31338 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:09.587009 31178 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:09.588550 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:09.582875 31262 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:09.614022 29448 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:12:09.589953 31362 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:09.621767 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:09.490659 31448 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:09.495610 31291 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:09.502185 31445 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:09.618067 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.595723 30887 raft_consensus.cc:515] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:09.618427 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:09.619130 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:09.619201 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:09.618129 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:09.620301 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:09.629122 29448 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:09.606595 31434 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:09.622570 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:09.608640 31411 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:09.622553 29451 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:09.634770 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:09.575834 31415 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:09.611159 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 138417us
I20260709 13:12:09.610834 31408 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:09.631464 29495 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:09.630468 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:09.612913 31410 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:09.491132 31304 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:09.636977 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:09.637132 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:09.620760 31338 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:09.635402 29455 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
I20260709 13:12:09.640193 29456 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
I20260709 13:12:09.643715 29454 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
I20260709 13:12:09.625440 31366 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:09.652850 29453 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
I20260709 13:12:09.654115 31327 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:09.654909 30853 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:09.655192 31291 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:09.655903 31305 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:09.656397 31436 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:09.632113 31445 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:09.640566 31338 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:09.659229 31338 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:09.659723 31445 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:09.636080 31442 log.cc:927] Time spent T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b: Append to log took a long time: real 0.166s	user 0.001s	sys 0.001s
I20260709 13:12:09.661487 31295 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:09.662405 31352 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:09.662977 31352 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:09.665313 31352 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:09.648293 31393 raft_consensus.cc:3055] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:12:09.639240 31454 log.cc:927] Time spent T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:12:09.626559 31250 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:09.631783 31422 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:09.657804 29527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37968 (request call id 1807) took 1264 ms. Trace:
I20260709 13:12:09.647084 31434 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:09.651201 31304 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:09.677467 30155 raft_consensus.cc:1275] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 LEARNER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:12:09.683728 29527 rpcz_store.cc:276] 0709 13:12:08.393731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:08.394510 (+   779us) service_pool.cc:224] Handling call
0709 13:12:09.657583 (+1263073us) spinlock_profiling.cc:243] Waited 62.4 ms on lock 0x7b54000fa5d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:09.657689 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143422336}
I20260709 13:12:09.644901 31410 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:09.676573 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:09.685966 31434 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:09.686908 31410 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:09.671537 31393 raft_consensus.cc:740] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:09.676431 30154 raft_consensus.cc:1275] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:09.668577 29448 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
I20260709 13:12:09.678262 31248 raft_consensus.cc:3055] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:12:09.690222 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 116522us
I20260709 13:12:09.669183 29451 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:12:09.688879 31434 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:09.679059 30887 leader_election.cc:290] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:09.675607 30853 consensus_queue.cc:1059] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:12:09.690384 31248 raft_consensus.cc:740] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:09.693601 31248 consensus_queue.cc:260] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:09.694131 30986 consensus_queue.cc:1059] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:09.694772 31248 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:09.691748 31422 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:09.665118 31294 consensus_queue.cc:260] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:09.698256 31422 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:09.695545 30887 raft_consensus.cc:3055] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:09.699306 30887 raft_consensus.cc:740] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:09.700402 30887 consensus_queue.cc:260] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:09.701859 30887 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:09.688591 31393 consensus_queue.cc:260] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:09.705957 31427 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.682236 31175 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:09.712105 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 80887.1us
I20260709 13:12:09.707175 31308 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:09.712289 31250 raft_consensus.cc:2749] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:09.713966 29344 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:09.706554 31427 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:09.720772 31445 consensus_queue.cc:1048] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:12:09.723642 31295 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.725934 31295 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:09.726812 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:09.726963 31410 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:09.720212 31175 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:09.728224 31295 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:09.728125 31175 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:09.722620 31178 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:09.707890 31422 consensus_queue.cc:1048] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
W20260709 13:12:09.730983 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.727551 31410 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:09.733171 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:09.735283 31250 consensus_queue.cc:1048] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:09.734434 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:09.734897 31409 consensus_queue.cc:1048] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:09.745827 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:09.746519 29452 raft_consensus.cc:2468] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
I20260709 13:12:09.746776 31340 consensus_queue.cc:260] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:09.747464 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:09.747931 31340 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:09.748107 29452 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
I20260709 13:12:09.748261 31107 consensus_queue.cc:1048] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:09.749264 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:09.736972 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:09.738699 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:09.749876 29452 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:09.750442 29455 raft_consensus.cc:2410] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:12:09.750528 29456 raft_consensus.cc:1240] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:12:09.750818 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:09.751559 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:09.733759 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:09.741565 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:09.740846 29495 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:09.721935 31434 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:09.755056 29451 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:09.744742 29419 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:09.734958 31304 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.789855 31304 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:09.791680 29449 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
I20260709 13:12:09.792138 29374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 791) took 2436 ms. Trace:
I20260709 13:12:09.792208 31304 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:09.744032 31252 consensus_queue.cc:1048] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:12:09.792640 29374 rpcz_store.cc:276] 0709 13:12:07.379179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:07.446858 (+ 67679us) service_pool.cc:224] Handling call
0709 13:12:07.447441 (+   583us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:07.665134 (+217693us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:07.665181 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:07.665924 (+   743us) log.cc:844] Serialized 26 byte log entry
0709 13:12:07.855888 (+189964us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:07.855933 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:09.791745 (+1935812us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b5400191254. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:09.791796 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:09.791844 (+    48us) raft_consensus.cc:1685] finished
0709 13:12:09.791856 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:09.792079 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2031,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":16450,"spinlock_wait_cycles":499589760,"thread_start_us":158266,"threads_started":1,"wal-append.queue_time_us":246355,"wal-append.run_cpu_time_us":2242,"wal-append.run_wall_time_us":1048733}
I20260709 13:12:09.794006 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:09.735797 31305 consensus_queue.cc:1048] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 13:12:09.719960 31346 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:09.752512 29448 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:09.753638 29452 raft_consensus.cc:1240] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:09.757176 29455 raft_consensus.cc:1275] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:09.726496 31427 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:09.762598 31434 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:09.763212 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:09.764760 29521 raft_consensus.cc:1275] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:09.764984 31410 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:09.765535 31199 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:09.768734 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:09.775794 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:09.803463 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:09.803897 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:09.776655 31366 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.818780 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:09.776814 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:09.819927 29529 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
I20260709 13:12:09.822495 29344 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:09.822604 29529 raft_consensus.cc:1240] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:09.777146 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:09.823463 29528 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:09.778995 31353 raft_consensus.cc:2749] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:09.779693 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:09.782521 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:09.832672 29522 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:09.784394 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:09.784833 31464 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.785889 29530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 1802) took 1448 ms. Trace:
I20260709 13:12:09.787142 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:09.835361 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:09.835805 29527 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:12:09.787408 29379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52172 (request call id 1029) took 2459 ms. Trace:
I20260709 13:12:09.787650 31445 raft_consensus.cc:2804] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:09.831470 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:09.788054 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 47325.4us
I20260709 13:12:09.837468 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:09.838032 29495 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:09.788710 31435 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:09.798271 29455 raft_consensus.cc:1275] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:09.799937 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:12:09.815832 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.838693 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:09.818842 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:09.839618 29372 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 4.
I20260709 13:12:09.803678 31199 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:09.827389 29344 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:09.827759 29521 raft_consensus.cc:2393] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 4: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:09.830011 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:09.831399 31366 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:09.741470 31178 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:09.841750 31464 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:09.839795 29526 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
I20260709 13:12:09.832132 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:09.861821 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:09.888659 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:09.825055 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 83641.8us
I20260709 13:12:09.844183 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:09.845297 29495 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:09.845548 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:09.835041 29530 rpcz_store.cc:276] 0709 13:12:08.337619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:08.338879 (+  1260us) service_pool.cc:224] Handling call
0709 13:12:08.339122 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:08.498250 (+159128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:09.785618 (+1287368us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b5400303ed4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:09.785822 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":354904448}
I20260709 13:12:09.931756 29372 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
I20260709 13:12:09.836730 29379 rpcz_store.cc:276] 0709 13:12:07.328050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:07.331098 (+  3048us) service_pool.cc:224] Handling call
0709 13:12:07.334476 (+  3378us) spinlock_profiling.cc:243] Waited 1.18 ms on lock 0x7b5800010298. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61b71 00007f6a78c61a22 00007f6a81b7ac09 00007f6a80cd4ee0 00007f6a80d9e0ab 00007f6a80d9e131 00007f6a80d5ffc0 00007f6a80d4a929 00007f6a80d4a3d2 00007f6a7a2c1bd4
0709 13:12:07.334667 (+   191us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:07.570268 (+235601us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:12:07.748801 (+178533us) log.cc:844] Serialized 14 byte log entry
0709 13:12:08.043268 (+294467us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:08.043334 (+    66us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:08.043409 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:09.648006 (+1604597us) spinlock_profiling.cc:243] Waited 4.55 ms on lock 0x7b1800391600. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c672a6 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419
0709 13:12:09.787050 (+139044us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b54000fd554. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:09.787113 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:09.787287 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57800,"prepare.queue_time_us":197545,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":57263,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":7587,"spinlock_wait_cycles":554489472,"thread_start_us":396582,"threads_started":2,"wal-append.queue_time_us":335132,"wal-append.run_cpu_time_us":1345,"wal-append.run_wall_time_us":1027566}
I20260709 13:12:09.932664 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:09.932894 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:09.849007 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:09.937602 29376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 808) took 1299 ms. Trace:
I20260709 13:12:09.939079 29380 raft_consensus.cc:2410] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:12:09.938071 29376 rpcz_store.cc:276] 0709 13:12:08.639989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:08.640146 (+   157us) service_pool.cc:224] Handling call
0709 13:12:08.640545 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:08.777644 (+137099us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:08.777695 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:08.778363 (+   668us) log.cc:844] Serialized 26 byte log entry
0709 13:12:08.841972 (+ 63609us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:08.842031 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:09.849732 (+1007701us) spinlock_profiling.cc:243] Waited 85.2 ms on lock 0x7b54003dcf54. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:09.849790 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:09.849842 (+    52us) raft_consensus.cc:1685] finished
0709 13:12:09.849854 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:09.937527 (+ 87673us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17417,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":7244,"spinlock_wait_cycles":196006784,"thread_start_us":114567,"threads_started":2,"wal-append.queue_time_us":104953}
I20260709 13:12:09.939654 29379 raft_consensus.cc:1275] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:09.942986 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:09.946126 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 102743us
I20260709 13:12:09.933477 29377 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
I20260709 13:12:09.947525 29344 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:09.833537 30985 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:09.960876 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 115676us
I20260709 13:12:09.980408 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:09.980712 29495 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:09.960852 29344 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:09.795830 31346 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:09.990420 29449 raft_consensus.cc:2468] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 1.
I20260709 13:12:09.990541 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:09.991954 31346 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:09.960131 31252 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.992990 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:09.993691 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:09.851292 31435 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:09.994603 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:09.995893 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:09.996304 31435 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:09.997288 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:09.998092 29381 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
I20260709 13:12:09.981397 29378 raft_consensus.cc:2410] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:12:09.843096 31199 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:09.842563 31445 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:09.986439 31250 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:09.987709 31398 raft_consensus.cc:2804] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:09.987926 31366 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:09.988473 29375 raft_consensus.cc:1240] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:09.946619 31076 consensus_queue.cc:1059] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:12:09.989383 31434 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:09.994297 29377 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
I20260709 13:12:09.852252 31463 raft_consensus.cc:2804] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:09.999722 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:10.009441 29448 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:12:10.001502 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:09.833305 31258 consensus_queue.cc:1048] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.165s
I20260709 13:12:10.000353 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:09.982137 29495 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:09.841063 31338 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:10.006489 29381 raft_consensus.cc:1275] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:12:10.003464 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:09.999601 29344 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:10.010399 29452 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
I20260709 13:12:09.995260 29456 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:10.011734 31305 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:10.027105 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:10.028079 29378 raft_consensus.cc:2468] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 1.
I20260709 13:12:10.012418 31464 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:09.997184 31251 raft_consensus.cc:2804] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:10.002218 31398 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:10.001777 31445 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:10.007243 31435 raft_consensus.cc:2804] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:10.010854 31463 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:09.993041 31252 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:10.045184 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:10.004262 31425 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:10.002153 31410 consensus_queue.cc:1048] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:12:10.084720 29528 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:10.098501 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:10.095738 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 113692us
I20260709 13:12:10.103195 29495 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:10.106756 29524 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
I20260709 13:12:10.111919 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:10.114728 29495 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:10.116995 29524 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:12:10.042110 31366 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:10.117213 29344 leader_election.cc:304] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:10.048066 31251 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:10.048363 31413 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:10.102272 31398 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:10.109172 31435 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.096975 31425 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:10.116272 31250 raft_consensus.cc:2804] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:10.126226 29344 leader_election.cc:304] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:10.109493 31463 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:10.129424 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:10.102084 31459 consensus_queue.cc:1048] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:12:10.108659 31355 consensus_queue.cc:1048] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:12:10.137122 29495 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:10.141577 29495 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:10.125213 31251 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:10.121346 31366 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.127200 31408 raft_consensus.cc:2804] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:10.117609 31411 consensus_queue.cc:1048] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:12:10.128407 31435 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:10.131742 31258 raft_consensus.cc:2749] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:10.130505 31175 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:10.161518 31252 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:10.131582 31250 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:10.133564 31178 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:10.144368 30985 raft_consensus.cc:2749] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:10.153177 31199 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:10.166011 29346 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:10.185068 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:10.158859 31366 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:10.181363 31250 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:10.202971 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:10.206032 31305 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:10.224184 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:10.209396 31326 raft_consensus.cc:2804] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:12:10.209614 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 43744.5us
I20260709 13:12:10.215891 31479 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:10.236339 31479 raft_consensus.cc:697] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:10.237103 29450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1551) took 2564 ms. Trace:
I20260709 13:12:10.237385 31479 consensus_queue.cc:237] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:10.237701 29450 rpcz_store.cc:276] 0709 13:12:07.672636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:08.049944 (+377308us) service_pool.cc:224] Handling call
0709 13:12:08.728461 (+678517us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:08.728711 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:08.728748 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:08.728813 (+    65us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:08.728859 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:08.728935 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:10.236812 (+1507877us) spinlock_profiling.cc:243] Waited 663 ms on lock 0x7b54002913d0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd858ad 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:10.236985 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1525029248}
I20260709 13:12:10.216202 31262 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.239650 31338 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:10.239789 31262 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:10.219779 31327 raft_consensus.cc:3055] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:10.215934 31252 raft_consensus.cc:2804] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:10.241978 31212 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:10.242244 31327 raft_consensus.cc:740] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:10.242393 31252 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:10.242915 31252 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:10.243280 31327 consensus_queue.cc:260] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:10.244696 31327 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:10.248633 31464 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:10.249270 31464 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:10.229673 31326 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:10.230211 29346 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:10.229357 31305 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:10.225446 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:10.255040 29346 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:10.255792 30158 raft_consensus.cc:2468] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 1.
I20260709 13:12:10.256346 29346 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:10.256707 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 115196us
I20260709 13:12:10.257310 29495 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:10.253512 31452 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.020s	sys 0.016s
I20260709 13:12:10.266534 29346 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:10.254859 31326 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:10.258502 31421 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:10.272720 29346 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:10.273489 29495 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:10.259469 31458 raft_consensus.cc:2804] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:10.262102 31242 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:10.279258 29495 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:10.257920 31452 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.020s	sys 0.017s
I20260709 13:12:10.280418 31475 raft_consensus.cc:2749] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:10.281942 31464 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:10.274983 31427 consensus_queue.cc:1048] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:12:10.282541 31445 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:10.283977 31478 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:10.290331 31478 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:10.290792 31478 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:10.284875 31484 raft_consensus.cc:2804] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:10.288985 31308 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:10.291867 31484 raft_consensus.cc:697] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 5 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:10.291955 31308 raft_consensus.cc:697] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:10.292804 29495 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:10.286218 30986 consensus_queue.cc:1048] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:12:10.273121 31421 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.295660 31421 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:10.298319 29495 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:10.275822 31338 raft_consensus.cc:2804] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:10.299732 29495 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:10.301461 29346 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:10.305099 31464 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:10.309387 29529 raft_consensus.cc:1240] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:10.309847 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:10.307256 31464 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:10.312005 31464 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:10.277670 31458 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:10.311232 31409 raft_consensus.cc:2804] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:10.330534 31409 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:10.330982 31409 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:10.334851 31366 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:10.337193 31366 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:10.351100 31409 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:10.331266 29277 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35182 (request call id 53) took 4144 ms. Trace:
W20260709 13:12:10.370723 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 62626.3us
I20260709 13:12:10.303620 31480 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:10.306680 31338 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:10.307965 31411 raft_consensus.cc:2804] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:10.304840 31484 consensus_queue.cc:237] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:10.312971 31425 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:10.360759 31458 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:10.387513 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:10.386581 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:10.369532 29277 rpcz_store.cc:276] 0709 13:12:06.186867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.187044 (+   177us) service_pool.cc:224] Handling call
0709 13:12:10.331151 (+4144107us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:07.553200 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:07.692274 (+139074us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:07.697404 (+  5130us) write_op.cc:435] Acquired schema lock
0709 13:12:07.697438 (+    34us) tablet.cc:662] Decoding operations
0709 13:12:07.698001 (+   563us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:07.698104 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:07.698166 (+    62us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:12:07.698425 (+   259us) tablet.cc:701] Row locks acquired
0709 13:12:07.698456 (+    31us) write_op.cc:260] PREPARE: finished
0709 13:12:07.698683 (+   227us) write_op.cc:270] Start()
0709 13:12:07.715358 (+ 16675us) write_op.cc:276] Timestamp: P: 1783602727698613 usec, L: 0
0709 13:12:07.720476 (+  5118us) op_driver.cc:348] REPLICATION: starting
0709 13:12:07.839737 (+119261us) log.cc:844] Serialized 602 byte log entry
0709 13:12:08.778965 (+939228us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a78c7c0ac 00007f6a81ad6ab9 00007f6a78c9869b 00007f6a78c9693f 00007f6a78c98c02 00007f6a7b92020b
0709 13:12:09.492097 (+713132us) op_driver.cc:464] REPLICATION: finished
0709 13:12:10.160749 (+668652us) spinlock_profiling.cc:243] Waited 3.48 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a78c7c0ac 00007f6a81ad6ab9 00007f6a78c9869b 00007f6a78c9693f 00007f6a78c98c02 00007f6a7f7bcef0
0709 13:12:10.285137 (+124388us) write_op.cc:301] APPLY: starting
0709 13:12:10.285239 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:10.285365 (+   126us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:10.285395 (+    30us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:10.288575 (+  3180us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:10.288772 (+   197us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:12:10.288842 (+    70us) write_op.cc:312] APPLY: finished
0709 13:12:10.289068 (+   226us) log.cc:844] Serialized 22 byte log entry
0709 13:12:10.289275 (+   207us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:10.289391 (+   116us) write_op.cc:454] Released schema lock
0709 13:12:10.289445 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:10.291400 (+  1955us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:10.291436 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":916927,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":785692,"apply.run_cpu_time_us":2338,"apply.run_wall_time_us":4754,"num_ops":1,"prepare.queue_time_us":228714,"prepare.run_cpu_time_us":61308,"prepare.run_wall_time_us":1573402,"raft.queue_time_us":350460,"replication_time_us":1750905,"spinlock_wait_cycles":96213504,"thread_start_us":2280246,"threads_started":4,"wal-append.queue_time_us":1093650}]]}
I20260709 13:12:10.389453 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:10.391873 29449 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:12:10.393254 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:10.393915 29449 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
I20260709 13:12:10.396792 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:10.378284 31480 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:10.401727 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:10.402153 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:10.383564 31338 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:10.386731 31411 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.400058 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:10.402812 29455 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
I20260709 13:12:10.403654 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:10.405282 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:10.405844 29447 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:10.405938 29450 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
I20260709 13:12:10.411206 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:10.410272 30853 raft_consensus.cc:2955] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index 2 to 5, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:12:10.413540 31305 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:10.383370 31251 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:10.415979 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:10.416770 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:10.420224 29375 raft_consensus.cc:2393] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 6: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
W20260709 13:12:10.430068 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:10.411155 31411 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:10.404317 31480 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:10.434247 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:10.435460 29452 raft_consensus.cc:2410] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:12:10.385093 31308 consensus_queue.cc:237] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:10.444497 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:10.445360 29530 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:10.446305 29447 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
I20260709 13:12:10.450735 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:10.451193 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:10.442516 30157 raft_consensus.cc:2955] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 2 to 5, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:12:10.452759 29377 raft_consensus.cc:2393] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 6: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:10.454244 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:10.455319 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:10.458115 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:10.459976 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:10.460172 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:10.460861 29524 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:10.460822 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:10.463205 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:10.464382 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:10.470819 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:10.472397 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:10.473735 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:10.474293 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:10.474747 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:10.463234 31250 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:10.476943 29379 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:12:10.513792 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:10.516522 31252 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:10.518888 31252 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:10.519825 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:10.519935 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:10.521015 29452 raft_consensus.cc:1275] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:12:10.521301 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:10.515432 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:10.521050 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:10.526489 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:10.528204 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:10.529680 29379 raft_consensus.cc:2393] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 6: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:10.536854 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:10.470768 31445 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:10.547930 29530 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 7.
I20260709 13:12:10.540423 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:10.538256 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:10.538506 29421 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:10.522675 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:10.552485 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:10.549434 29376 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
I20260709 13:12:10.553622 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:10.554530 29376 raft_consensus.cc:2393] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 7: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:10.555835 31304 raft_consensus.cc:2749] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:10.537618 31492 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.553515 29421 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:10.549623 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:10.550676 31305 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:10.551852 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:10.482159 31409 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:10.482605 31250 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:10.482385 31294 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:10.562824 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:10.513923 31398 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:10.559075 29421 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:10.481602 31435 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:10.567442 29421 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:12:10.587411 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:10.557137 31492 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:10.560010 31304 raft_consensus.cc:2764] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:12:10.611102 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:10.608443 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:10.617012 29376 raft_consensus.cc:2368] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 6. Current term is 7.
I20260709 13:12:10.618053 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:10.589560 31107 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:10.629657 29372 raft_consensus.cc:1275] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:10.616055 29373 raft_consensus.cc:2393] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 6: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:10.627847 29376 raft_consensus.cc:1240] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:10.562893 31421 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:10.614735 29452 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:12:10.624817 29381 raft_consensus.cc:2393] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 7: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:10.636852 29346 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:10.637831 31398 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:10.636509 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:10.632555 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:10.589459 30986 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.640491 30986 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:10.641314 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:10.642040 30985 raft_consensus.cc:2804] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:10.642560 30985 raft_consensus.cc:697] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:10.643200 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:10.642480 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:10.646649 31408 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:10.647303 31408 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:10.647595 31492 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:10.649123 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:10.650339 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:10.650925 29530 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:12:10.649936 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:10.654145 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:10.651777 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:10.662794 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:10.663208 29530 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
I20260709 13:12:10.664920 29528 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
I20260709 13:12:10.669435 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:10.670581 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:10.679139 29524 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:12:10.623344 31177 raft_consensus.cc:2804] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:10.685247 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:10.686910 29378 raft_consensus.cc:1240] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:12:10.687474 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:10.687919 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:10.688491 29528 raft_consensus.cc:2393] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 5: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:10.688867 31177 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.689370 31177 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:10.689510 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:10.681975 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:10.691345 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:10.692557 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:10.623117 31251 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:10.693837 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:10.695147 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:10.687455 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:10.699075 29530 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 4.
I20260709 13:12:10.702113 29527 raft_consensus.cc:1275] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:10.703801 29527 raft_consensus.cc:1275] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:10.704403 29528 raft_consensus.cc:1275] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:12:10.705693 29527 raft_consensus.cc:1275] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:12:10.707026 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:10.655095 31464 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:10.720410 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:10.721704 29527 raft_consensus.cc:2368] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 6. Current term is 7.
I20260709 13:12:10.723682 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:10.765115 29379 raft_consensus.cc:2410] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:12:10.769052 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 201738us
I20260709 13:12:10.770702 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:10.772822 29419 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:10.767906 29527 raft_consensus.cc:1275] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:10.778764 29419 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:10.780686 31353 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:10.786368 31435 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:10.786489 29421 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:10.787969 31443 consensus_queue.cc:1048] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:10.789566 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:10.790328 31443 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:10.790824 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:10.791062 29421 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:10.792043 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:10.792694 29448 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:10.793071 29419 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:10.797551 29419 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:10.798870 29524 raft_consensus.cc:1240] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:10.799393 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:10.794302 29421 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:10.814328 29419 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:10.777364 31458 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:10.830322 31458 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:10.832844 31478 consensus_meta.cc:287] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.542s	user 0.013s	sys 0.000s
I20260709 13:12:10.790797 31443 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.792816 31434 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:12:10.798388 31463 consensus_meta.cc:287] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.655s	user 0.014s	sys 0.000s
I20260709 13:12:10.798393 31353 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:10.711411 30985 consensus_queue.cc:237] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:10.798123 31107 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:10.796164 31199 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:10.833496 31478 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:10.863394 31326 consensus_meta.cc:287] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.586s	user 0.013s	sys 0.000s
I20260709 13:12:10.819157 31308 raft_consensus.cc:493] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:10.837628 31304 raft_consensus.cc:2749] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:10.827304 31464 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:10.867679 31443 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:10.880787 31463 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:10.898468 31308 raft_consensus.cc:515] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:10.893663 31501 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:10.907460 31177 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:10.893366 31486 log.cc:927] Time spent T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:12:10.917186 31421 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:10.903028 31502 raft_consensus.cc:2749] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:10.883802 31107 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.865322 29495 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:11.138834 31351 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.915957 31338 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:11.140223 31351 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:11.141908 31412 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:12:11.141070 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 275570us
I20260709 13:12:11.142982 31351 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:11.142794 31412 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:11.146926 31412 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:11.141805 31212 raft_consensus.cc:2749] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:11.147382 29495 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:11.162396 31477 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:10.967777 31478 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:11.071708 29451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45798 (request call id 1558) took 1334 ms. Trace:
W20260709 13:12:11.151067 31408 consensus_meta.cc:287] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.503s	user 0.006s	sys 0.007s
W20260709 13:12:10.975329 31497 log.cc:927] Time spent T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.107s	user 0.004s	sys 0.001s
I20260709 13:12:11.143008 31338 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:11.156648 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:11.191805 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:10.895326 31434 consensus_queue.cc:1048] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.299s
W20260709 13:12:10.981619 31480 consensus_meta.cc:287] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.530s	user 0.014s	sys 0.000s
W20260709 13:12:11.064428 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 249996us
I20260709 13:12:11.115223 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:11.119966 31262 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:11.090920 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:10.912374 31308 leader_election.cc:290] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:11.206916 31408 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:11.209060 30986 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:11.209489 29421 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:12:11.150493 31077 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.104633 31177 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:10.911049 31500 log.cc:927] Time spent T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:12:11.195720 31107 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:10.912102 31501 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:11.236542 29495 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:11.187950 29451 rpcz_store.cc:276] 0709 13:12:09.741173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:09.741289 (+   116us) service_pool.cc:224] Handling call
0709 13:12:11.071036 (+1329747us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b54000195d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:11.071313 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5683968}
I20260709 13:12:10.910349 31463 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:11.248876 29448 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:12:11.250546 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:11.252282 29421 leader_election.cc:400] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 6. Current term is 7.
I20260709 13:12:11.252821 29421 leader_election.cc:403] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:11.253640 31077 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:11.256013 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:11.257001 31077 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:11.257542 31411 consensus_meta.cc:287] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.729s	user 0.012s	sys 0.004s
I20260709 13:12:11.258123 31411 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:11.264392 31308 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:11.265545 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:11.268603 31175 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:12:11.261418 29381 raft_consensus.cc:2468] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 1.
I20260709 13:12:11.275520 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:11.276587 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:11.277537 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:11.278652 29449 raft_consensus.cc:2368] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 6. Current term is 7.
I20260709 13:12:11.207232 31480 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:11.281592 29528 raft_consensus.cc:1240] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:11.293015 29526 raft_consensus.cc:2393] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 7: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:11.279750 31501 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:10.896612 31326 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:11.297533 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:11.299357 29521 raft_consensus.cc:1240] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:11.294831 31506 raft_consensus.cc:2804] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:11.300897 31480 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:11.300920 31506 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:11.302448 31506 raft_consensus.cc:3060] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:11.323287 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 119962us
I20260709 13:12:11.326053 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:11.333380 31408 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:11.344045 31458 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:11.345203 31458 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:11.329672 31393 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:11.348124 29522 raft_consensus.cc:1240] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:11.352515 29495 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:11.354058 31415 consensus_queue.cc:1048] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:11.354872 31480 raft_consensus.cc:2749] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:11.355306 29277 catalog_manager.cc:5697] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: config changed from index 2 to 5, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:12:11.368906 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:11.360122 31411 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:11.362576 29448 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:11.364038 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:11.356163 31415 consensus_queue.cc:1059] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:11.359091 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:11.370199 31410 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:11.372000 31251 consensus_queue.cc:1059] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:11.382072 29522 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:11.357086 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:11.399231 29521 raft_consensus.cc:2393] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 7: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:11.337199 31443 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:11.406167 31251 raft_consensus.cc:3055] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:11.406752 31251 raft_consensus.cc:740] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:12:11.407753 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 49694.7us
I20260709 13:12:11.408066 31443 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:11.402853 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 64779.1us
I20260709 13:12:11.409379 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:11.408102 29450 raft_consensus.cc:2368] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 6. Current term is 7.
I20260709 13:12:11.405202 31415 raft_consensus.cc:3055] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:11.422093 29529 raft_consensus.cc:2393] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 4: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:11.420195 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:11.412914 31415 raft_consensus.cc:740] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
W20260709 13:12:11.444911 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:11.451068 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:11.434428 29344 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:12:11.415153 31251 consensus_queue.cc:260] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:11.470083 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:12:11.472363 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:11.472738 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:11.475149 29380 raft_consensus.cc:2393] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 6: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:11.475699 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:11.476365 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:11.476563 31338 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:11.469543 31077 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:11.477862 29379 raft_consensus.cc:1240] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:11.478098 31077 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:11.481283 31077 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:11.482126 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:11.474880 31326 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:11.492220 31415 consensus_queue.cc:260] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:11.493136 31338 raft_consensus.cc:697] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:11.494015 31415 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:11.496515 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:11.498286 31326 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.499099 31326 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:11.500424 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 90440.3us
I20260709 13:12:11.458074 31458 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:11.443423 31410 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:12:11.476464 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 606792us
I20260709 13:12:11.504822 29419 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:11.508127 31509 raft_consensus.cc:2749] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:11.508747 31294 consensus_meta.cc:287] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.943s	user 0.023s	sys 0.009s
W20260709 13:12:11.509774 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 90984.3us
I20260709 13:12:11.511216 29344 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:12:11.511693 31477 raft_consensus.cc:2749] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:11.516021 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:12:11.517680 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:11.517915 29452 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
I20260709 13:12:11.518687 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:11.520473 31339 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.520987 31339 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:11.519429 29381 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:12:11.509938 30853 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.507000 29419 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:11.523355 31410 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:11.528825 30853 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:11.532287 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:11.532992 31506 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:11.534359 31501 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:11.536463 29455 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:12:11.545547 29448 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:12:11.538519 31410 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:11.547940 29344 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:11.550261 31351 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:11.550734 31351 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:11.551079 31351 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:11.535740 30986 raft_consensus.cc:2804] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:12:11.563114 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 56299.1us
I20260709 13:12:11.540721 31477 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:11.494868 31338 consensus_queue.cc:237] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:11.562471 29495 leader_election.cc:304] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:11.523391 31107 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:11.559741 30986 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:11.585234 30986 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:11.589593 29344 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:11.591979 29447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1593) took 1015 ms. Trace:
I20260709 13:12:11.592478 29447 rpcz_store.cc:276] 0709 13:12:10.575962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:11.286716 (+710754us) service_pool.cc:224] Handling call
0709 13:12:11.329521 (+ 42805us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:11.368802 (+ 39281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:11.368837 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:11.369415 (+   578us) log.cc:844] Serialized 26 byte log entry
0709 13:12:11.460577 (+ 91162us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:12:11.460800 (+   223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:11.461080 (+   280us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:11.591419 (+130339us) raft_consensus.cc:1685] finished
0709 13:12:11.591450 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:11.591756 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5856,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":188,"thread_start_us":90629,"threads_started":1,"wal-append.queue_time_us":207534}
I20260709 13:12:11.593997 31459 consensus_queue.cc:1059] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:11.599711 31411 raft_consensus.cc:2749] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:11.592041 31463 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:11.616568 31463 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:11.599290 31326 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:11.617901 31463 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:11.595316 31459 raft_consensus.cc:3055] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:11.622219 31459 raft_consensus.cc:740] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:11.623410 31459 consensus_queue.cc:260] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:11.624601 29449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1587) took 1050 ms. Trace:
I20260709 13:12:11.627349 31480 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:11.628242 31480 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:11.628611 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 92779.6us
I20260709 13:12:11.625020 31459 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:11.631170 29495 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:11.640797 29419 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:11.649341 29522 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
I20260709 13:12:11.633631 29495 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:11.625056 29449 rpcz_store.cc:276] 0709 13:12:10.573843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:11.281126 (+707283us) service_pool.cc:224] Handling call
0709 13:12:11.305421 (+ 24295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:11.341335 (+ 35914us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:11.341393 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:11.356561 (+ 15168us) log.cc:844] Serialized 26 byte log entry
0709 13:12:11.457780 (+101219us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:11.502079 (+ 44299us) log.cc:844] Serialized 14 byte log entry
0709 13:12:11.502336 (+   257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:11.502419 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:11.624333 (+121914us) raft_consensus.cc:1685] finished
0709 13:12:11.624358 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:11.624528 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16140,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":64,"raft.queue_time_us":7830,"raft.run_cpu_time_us":756,"raft.run_wall_time_us":36898,"thread_start_us":100333,"threads_started":1,"wal-append.queue_time_us":201647}
I20260709 13:12:11.631461 31480 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:11.639340 31175 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 6. Current term is 7.
I20260709 13:12:11.634313 31212 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:11.635143 31408 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.653286 31410 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:11.645840 31506 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:11.704056 31408 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:11.680797 31212 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:11.783798 29456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1582) took 1026 ms. Trace:
I20260709 13:12:11.784512 29456 rpcz_store.cc:276] 0709 13:12:10.549115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:10.880652 (+331537us) service_pool.cc:224] Handling call
0709 13:12:10.882761 (+  2109us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:10.883125 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:12:11.283644 (+400519us) log.cc:844] Serialized 14 byte log entry
0709 13:12:11.500623 (+216979us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:11.524440 (+ 23817us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:11.546696 (+ 22256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:11.546798 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:11.575092 (+ 28294us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1098,"prepare.queue_time_us":10943,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":71,"raft.queue_time_us":4665,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":13761,"thread_start_us":497291,"threads_started":2,"wal-append.queue_time_us":283172}
I20260709 13:12:11.655908 31477 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:11.707444 31408 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:11.726740 31212 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:11.781834 31501 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:11.792392 31479 raft_consensus.cc:2749] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:12:11.842048 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 208773us
W20260709 13:12:11.926434 29493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 81231.5us
I20260709 13:12:11.913453 31107 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:11.958642 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:11.989327 31412 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
W20260709 13:12:12.002266 31525 log.cc:927] Time spent T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:12:12.002156 31412 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:12:12.040747 31524 log.cc:927] Time spent T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b: Append to log took a long time: real 0.233s	user 0.000s	sys 0.002s
I20260709 13:12:12.038044 31477 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:12.096269 31412 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:12.023609 31479 raft_consensus.cc:2955] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
W20260709 13:12:12.101955 31351 consensus_meta.cc:287] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.550s	user 0.008s	sys 0.006s
I20260709 13:12:12.102622 31339 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:12.102016 30986 consensus_meta.cc:287] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.514s	user 0.011s	sys 0.003s
I20260709 13:12:12.102771 31351 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:12.112247 30986 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:12.111516 31212 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:12.120254 31212 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:12.127108 31523 log.cc:927] Time spent T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.322s	user 0.000s	sys 0.002s
I20260709 13:12:12.128885 31479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:37954 (request call id 66) took 3781 ms. Trace:
I20260709 13:12:12.129882 31351 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:12.129860 31463 consensus_meta.cc:287] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.511s	user 0.015s	sys 0.000s
I20260709 13:12:12.131893 30986 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:12.134428 31463 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:12.137132 31463 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:12.132436 31479 rpcz_store.cc:276] 0709 13:12:08.347561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:08.348639 (+  1078us) service_pool.cc:224] Handling call
0709 13:12:08.386048 (+ 37409us) log.cc:844] Serialized 508 byte log entry
0709 13:12:09.584066 (+1198018us) spinlock_profiling.cc:243] Waited 4.6 ms on lock 0x7b2c001231f8. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7a67fa11 00007f6a7a68ea0a 00007f6a7a68e693 00007f6a7a68e631 00007f6a7bdc2b52 00007f6a7bdc2cf5 00007f6a7bcff691 00007f6a7bcdfeaa 00007f6a7bce6d53 00007f6a7bce6cd9 00007f6a7bce6c69
0709 13:12:09.748624 (+164558us) spinlock_profiling.cc:243] Waited 4.12 ms on lock 0x7b1800365bc0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c672a6 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bcff142 00007f6a7bcdfeaa 00007f6a7bce6d53
0709 13:12:09.753131 (+  4507us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b54001f8c20. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bcff142 00007f6a7bcdfeaa 00007f6a7bce6d53 00007f6a7bce6cd9 00007f6a7bce6c69 00007f6a7bce6c31 00007f6a7bce5dfd 000000000038f354 000000000038f199 00007f6a78c99475
0709 13:12:10.338070 (+584939us) spinlock_profiling.cc:243] Waited 3.54 ms on lock 0x7b54001f8c20. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd06b26 00007f6a7bd0049a 00007f6a7bcff714 00007f6a7bcdfeaa 00007f6a7bce6d53 00007f6a7bce6cd9 00007f6a7bce6c69 00007f6a7bce6c31 00007f6a7bce5dfd 000000000038f354
0709 13:12:12.128726 (+1790656us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":8933,"mutex_wait_us":124144,"raft.queue_time_us":124466,"raft.run_cpu_time_us":45420,"raft.run_wall_time_us":2660602,"spinlock_wait_cycles":32219264,"thread_start_us":51964,"threads_started":1,"wal-append.queue_time_us":225546,"wal-append.run_cpu_time_us":4973,"wal-append.run_wall_time_us":1425742}
I20260709 13:12:12.180188 30853 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:12.210440 31338 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.003s	sys 0.007s
W20260709 13:12:12.211079 31338 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.003s	sys 0.007s
W20260709 13:12:12.243172 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 643334us
I20260709 13:12:12.245002 29419 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:12.246243 30853 raft_consensus.cc:2749] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:12.248405 29419 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:12.249473 30853 raft_consensus.cc:2749] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:12.250346 29419 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:12.251333 30853 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:12.253243 29419 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:12.254099 30853 raft_consensus.cc:2749] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:12.256793 29419 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:12.257778 30853 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:12.258513 29419 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:12.259954 30853 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:12.260663 29419 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:12.261775 30853 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:12.263336 29419 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:12.264207 30853 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:12.267539 29419 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:12.268419 30853 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:12.270277 29419 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:12.271278 30853 raft_consensus.cc:2749] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:12.273195 29419 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:12.274149 30853 raft_consensus.cc:2749] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:12.276156 29419 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:12.277266 30853 raft_consensus.cc:2749] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:12.278308 29419 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:12.279322 30853 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:12.280316 29419 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:12.281301 30853 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:12.282073 29419 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:12.283826 29419 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:12.284549 31339 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:12.284999 29419 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:12.285322 31339 raft_consensus.cc:2749] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:12.285974 31107 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:12.286754 29419 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:12.287858 30853 raft_consensus.cc:2749] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:12.290222 30853 consensus_queue.cc:1048] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:12.291540 31339 consensus_queue.cc:1048] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:12.292119 30853 consensus_queue.cc:1048] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:12.294667 31107 consensus_queue.cc:1048] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:12.297114 29419 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:12.298182 30853 raft_consensus.cc:2749] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:12.300534 29419 leader_election.cc:400] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 6. Current term is 7.
I20260709 13:12:12.313215 30853 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:12:12.315146 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:12.314095 31107 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.319401 31107 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:12.322850 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:12.321316 30853 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:12.323908 29450 raft_consensus.cc:2468] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 1.
I20260709 13:12:12.324204 31107 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:12.325750 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:12.325521 30853 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:12.330437 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:12.331564 29447 raft_consensus.cc:2368] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 4. Current term is 5.
I20260709 13:12:12.332509 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:12.333673 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:12.334683 29447 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:12.335094 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:12.336516 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:12.337204 29447 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
I20260709 13:12:12.337292 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:12.338866 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:12.339208 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:12.339655 29450 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:12.339972 29447 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:12.346407 29447 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:12:12.348367 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:12.349334 29447 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:12.351979 29450 raft_consensus.cc:2410] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:12:12.354171 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:12.357470 29450 raft_consensus.cc:1240] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:12.365218 29447 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:12:12.365650 29277 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35182 (request call id 55) took 1099 ms. Trace:
I20260709 13:12:12.366061 29277 rpcz_store.cc:276] 0709 13:12:11.266277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:11.273867 (+  7590us) service_pool.cc:224] Handling call
0709 13:12:12.365519 (+1091652us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:11.669904 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:11.965591 (+295687us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:12.004144 (+ 38553us) write_op.cc:435] Acquired schema lock
0709 13:12:12.010610 (+  6466us) tablet.cc:662] Decoding operations
0709 13:12:12.045437 (+ 34827us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:12.089712 (+ 44275us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:12.100286 (+ 10574us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:12:12.108790 (+  8504us) tablet.cc:701] Row locks acquired
0709 13:12:12.108850 (+    60us) write_op.cc:260] PREPARE: finished
0709 13:12:12.109201 (+   351us) write_op.cc:270] Start()
0709 13:12:12.109428 (+   227us) write_op.cc:276] Timestamp: P: 1783602732109005 usec, L: 0
0709 13:12:12.109454 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:12:12.110378 (+   924us) log.cc:844] Serialized 602 byte log entry
0709 13:12:12.125562 (+ 15184us) op_driver.cc:464] REPLICATION: finished
0709 13:12:12.127081 (+  1519us) write_op.cc:301] APPLY: starting
0709 13:12:12.127209 (+   128us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:12.127847 (+   638us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:12.127923 (+    76us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:12.128405 (+   482us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:12.128752 (+   347us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:12:12.128821 (+    69us) write_op.cc:312] APPLY: finished
0709 13:12:12.129037 (+   216us) log.cc:844] Serialized 22 byte log entry
0709 13:12:12.129226 (+   189us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:12.129333 (+   107us) write_op.cc:454] Released schema lock
0709 13:12:12.129381 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:12.129822 (+   441us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:12.129849 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":926,"apply.run_cpu_time_us":1950,"apply.run_wall_time_us":2656,"num_ops":1,"prepare.queue_time_us":116196,"prepare.run_cpu_time_us":12963,"prepare.run_wall_time_us":514948,"replication_time_us":15862,"thread_start_us":95877,"threads_started":1}]]}
W20260709 13:12:12.385919 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:12.387295 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:12.389420 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:12.402700 31479 consensus_queue.cc:1059] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:12.404472 31408 raft_consensus.cc:3055] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:12.404984 31408 raft_consensus.cc:740] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:12.406126 31212 consensus_queue.cc:1059] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:12.406682 29495 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:12.407305 31212 raft_consensus.cc:3055] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:12.407933 31212 raft_consensus.cc:740] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:12.408356 31477 raft_consensus.cc:2804] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:12.408485 29495 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:12.408984 31212 consensus_queue.cc:260] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:12.409863 31480 raft_consensus.cc:2804] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:12.410267 31480 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:12.410431 31212 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:12.410703 31480 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:12.411322 29495 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:12.408906 31477 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:12.416044 31477 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:12.405930 31408 consensus_queue.cc:260] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:12.419593 31212 raft_consensus.cc:2804] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:12.419968 31408 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:12.420173 31212 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:12.420425 29495 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:12.421329 31212 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:12.424226 31479 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:12.425002 29495 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:12:12.425356 29452 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45798 (request call id 1577) took 1884 ms (client timeout 1838 ms). Trace:
I20260709 13:12:12.425894 31479 raft_consensus.cc:2749] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:12:12.425815 29452 rpcz_store.cc:269] 0709 13:12:10.541201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:10.653901 (+112700us) service_pool.cc:224] Handling call
0709 13:12:12.425102 (+1771201us) spinlock_profiling.cc:243] Waited 863 ms on lock 0x7b54000ceed4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:12.425269 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1984740608}
I20260709 13:12:12.427418 29495 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:12.434425 29495 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:12:12.435118 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:12.436295 31501 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:12.436417 31212 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:12.437090 31501 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:12.438452 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:12:12.438838 31212 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:12.439580 31479 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:12.440034 31479 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:12.440443 31479 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:12.441203 31535 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:12.429895 31480 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:12.444191 31480 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:12.449512 29263 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b5c4a6169e564566927a70e27f4af6f6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:12.451014 29495 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:12.452631 29495 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:12.458841 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:12.459980 29451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1591) took 1884 ms. Trace:
I20260709 13:12:12.460413 29451 rpcz_store.cc:276] 0709 13:12:10.575236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:11.292352 (+717116us) service_pool.cc:224] Handling call
0709 13:12:11.394143 (+101791us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:11.413241 (+ 19098us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:11.413266 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:11.438218 (+ 24952us) log.cc:844] Serialized 26 byte log entry
0709 13:12:11.558079 (+119861us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:11.576105 (+ 18026us) log.cc:844] Serialized 14 byte log entry
0709 13:12:11.576596 (+   491us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:11.576718 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:12.331149 (+754431us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b1800368da0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c993f3 00007f6a78c9b7c1 00007f6a78c9b779 00007f6a78c9b709 00007f6a78c9b6d1 00007f6a78c9a9cd 000000000038f354 000000000038f199 00007f6a78c7c83a
0709 13:12:12.451382 (+120233us) raft_consensus.cc:1685] finished
0709 13:12:12.459606 (+  8224us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:12.459871 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6401,"prepare.queue_time_us":17735,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":8485,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":2905,"spinlock_wait_cycles":5769984,"thread_start_us":83374,"threads_started":1,"wal-append.queue_time_us":196643}
I20260709 13:12:12.466598 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:12.476336 30157 raft_consensus.cc:2955] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:12:12.478924 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:12.479879 29378 raft_consensus.cc:2468] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 5.
I20260709 13:12:12.482251 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:12.485399 30121 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:12.488312 31528 raft_consensus.cc:2804] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:12.488837 31528 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:12.489341 31528 raft_consensus.cc:3060] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:12.493012 31251 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:12.516283 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:12.523473 29522 raft_consensus.cc:2468] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 5.
I20260709 13:12:12.525661 30119 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:12:12.526623 31412 raft_consensus.cc:2804] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:12.527315 31412 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:12.527911 31412 raft_consensus.cc:3060] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:12.709578 29529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53428 (request call id 179) took 1068 ms. Trace:
I20260709 13:12:12.710085 29529 rpcz_store.cc:276] 0709 13:12:11.641056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:11.641266 (+   210us) service_pool.cc:224] Handling call
0709 13:12:11.669381 (+ 28115us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:11.677344 (+  7963us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:11.677373 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:11.677422 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:11.677449 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:12.709230 (+1031781us) spinlock_profiling.cc:243] Waited 7.72 ms on lock 0x7b540019e954. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:12.709285 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:12.709475 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17747712}
I20260709 13:12:12.715602 30853 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.716357 30853 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:12.719966 30853 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:12.721541 31251 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.722311 31251 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:12.725350 31251 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:12.731003 31528 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:12:12.736758 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:12.740671 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:12.741652 29455 raft_consensus.cc:2393] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in current term 2: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:12.742877 31528 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 2 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:12.742995 30853 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:12.743798 30853 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:12.745999 31412 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:12.748396 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:12.749112 29456 raft_consensus.cc:3060] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:12.752314 31107 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:12.753005 31107 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:12.756330 31107 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:12.450389 31501 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:12.761828 31412 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:12.765450 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:12.766256 29378 raft_consensus.cc:3060] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:12.769207 29344 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.176s	user 0.010s	sys 0.017s
W20260709 13:12:12.769634 29344 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.176s	user 0.010s	sys 0.017s
W20260709 13:12:12.769914 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 1.17674e+06us
I20260709 13:12:12.770705 29344 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:12.772037 31251 raft_consensus.cc:2749] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:12.775590 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:12:12.775918 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:12.779013 29378 raft_consensus.cc:2468] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 6.
I20260709 13:12:12.779975 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:12.780776 29455 raft_consensus.cc:2393] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in current term 2: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:12.784394 30121 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:12.788177 31412 raft_consensus.cc:3060] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:12.788583 30853 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:12.791836 29344 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:12.792450 31212 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:12.793049 31212 raft_consensus.cc:697] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:12.794134 31212 consensus_queue.cc:237] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:12.794914 30985 raft_consensus.cc:2749] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:12.797567 31412 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:12.799806 31536 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:12:12.802693 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:12.803682 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 337033us
I20260709 13:12:12.805307 30157 raft_consensus.cc:1240] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:12.805490 31535 consensus_queue.cc:1048] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:12.806663 29456 raft_consensus.cc:2468] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 2.
I20260709 13:12:12.807314 30853 consensus_queue.cc:1059] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:12.807963 30121 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:12:12.808538 31501 raft_consensus.cc:3055] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:12.808912 31501 raft_consensus.cc:740] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:12.809382 29344 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:12.809998 31501 consensus_queue.cc:260] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:12.811331 31458 raft_consensus.cc:2749] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:12.812070 31412 raft_consensus.cc:2804] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:12.808930 30985 consensus_queue.cc:1059] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:12:12.813966 31412 raft_consensus.cc:697] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:12:12.814460 31458 raft_consensus.cc:3055] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:12.814867 31458 raft_consensus.cc:740] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:12.815265 31412 consensus_queue.cc:237] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:12.815866 31458 consensus_queue.cc:260] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:12.816934 31458 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:12.817967 31477 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:12.811352 31501 raft_consensus.cc:3060] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:12.824049 31536 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:12.824776 31536 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:12.825816 31408 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:12.826380 31408 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:12.828907 31408 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:12.830536 31542 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
W20260709 13:12:12.831641 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:12.831559 31408 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:12.832481 31408 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:12.832577 31542 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:12.835366 31542 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:12.835084 31408 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:12.837426 31479 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:12.840268 31479 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:12.842628 31477 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:12.827354 31536 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:12.846472 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:12.847466 29454 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:12.867130 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 62131.7us
W20260709 13:12:12.870574 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:12.864714 30986 consensus_queue.cc:1059] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:12:12.879166 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:12.882053 30853 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.883302 30853 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:12.886590 30853 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:12.888470 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:12.892321 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:12.893514 29344 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:12:12.894311 29454 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:12.897395 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:12.898231 29522 raft_consensus.cc:3060] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:12.914582 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:12.915645 29528 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:12.915889 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:12.916437 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:12.916651 29523 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:12.918881 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:12.920567 29525 raft_consensus.cc:1240] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:12.921727 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:12.922550 31458 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:12.923076 31458 raft_consensus.cc:697] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:12.926453 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:12.927269 29525 raft_consensus.cc:2393] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 4: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:12.928388 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:12.925798 29495 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:12.930513 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:12.935217 29522 raft_consensus.cc:2468] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 6.
I20260709 13:12:12.936959 30119 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:12:12.937664 29530 raft_consensus.cc:1240] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:12.938551 29495 leader_election.cc:400] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 6. Current term is 7.
I20260709 13:12:12.940390 29495 leader_election.cc:403] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:12:12.942138 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:12.942988 29529 raft_consensus.cc:2393] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 7: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:12.924083 31458 consensus_queue.cc:237] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:12.949334 31538 raft_consensus.cc:2804] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:12.952521 31538 raft_consensus.cc:697] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:12:12.953928 31538 consensus_queue.cc:237] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:12.955543 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:12.956244 29529 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:12.961387 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:12.962363 29525 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:12.950191 31475 raft_consensus.cc:3055] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:12.967760 31475 raft_consensus.cc:740] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:12.968865 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:12.969563 29522 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:12:12.969153 31475 consensus_queue.cc:260] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:12.970875 29526 raft_consensus.cc:1240] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:12.939069 31543 raft_consensus.cc:2749] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:12.951359 29530 raft_consensus.cc:1240] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:12.976255 29521 raft_consensus.cc:1240] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:12.977949 29522 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:12.992035 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:12.994192 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 1.31519e+06us
I20260709 13:12:12.996068 29373 raft_consensus.cc:1240] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:12.999735 29524 raft_consensus.cc:2468] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
I20260709 13:12:12.971087 31475 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:13.005800 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:13.020129 29381 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:13.021571 29529 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
W20260709 13:12:13.028509 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 90134.8us
I20260709 13:12:13.008014 30986 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:13.034417 30986 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:13.037485 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.037884 29344 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:13.038199 30986 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:13.038877 31458 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:12:13.039989 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 124075us
I20260709 13:12:13.044369 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:13.045284 29522 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
W20260709 13:12:13.046232 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.033814 29525 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:13.039033 29344 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:13.043541 30157 raft_consensus.cc:1240] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:13.044028 29381 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 7.
I20260709 13:12:13.046466 29495 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:13.024003 29276 catalog_manager.cc:5697] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: config changed from index 3 to 4, VOTER 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) evicted. New cstate: current_term: 1 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:12:13.033596 29278 catalog_manager.cc:5697] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 3 to 4, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 4 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:13.053072 29379 raft_consensus.cc:1240] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 3. Current term is 5. Ops: []
I20260709 13:12:13.051249 29278 catalog_manager.cc:5697] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 3 to 6, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 6 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
W20260709 13:12:13.054937 29421 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.539s (SENT) [suppressed 6 similar messages]
I20260709 13:12:13.025426 31543 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:13.061002 31251 consensus_queue.cc:1059] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:13.062047 31251 consensus_queue.cc:1059] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:13.063710 31480 consensus_queue.cc:1059] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:13.064586 31480 consensus_queue.cc:1243] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer ca041dab9b2f44409ed7bf4c6cf66ab2 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:12:13.065936 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.065102 31541 raft_consensus.cc:3055] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:13.067453 31541 raft_consensus.cc:740] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:13.055681 29278 catalog_manager.cc:5697] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 2 to 5, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 5 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:13.068986 31541 consensus_queue.cc:260] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:13.069281 29278 catalog_manager.cc:5697] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 3 to 5, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 5 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:13.078898 29380 raft_consensus.cc:1240] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:13.084729 31552 raft_consensus.cc:3055] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:13.070334 31541 raft_consensus.cc:3060] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:13.086990 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 46136.2us
I20260709 13:12:13.089735 29495 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:13.044605 31458 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:13.087338 29381 raft_consensus.cc:1240] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:13.090708 29379 raft_consensus.cc:1240] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:13.094875 29278 catalog_manager.cc:5697] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 3 to 5, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 5 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:13.093065 31458 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:13.093744 30986 raft_consensus.cc:3055] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:13.115361 29379 raft_consensus.cc:1240] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:13.091353 31552 raft_consensus.cc:740] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:13.101689 31480 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:12:13.120442 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 61677.9us
I20260709 13:12:13.116372 31212 raft_consensus.cc:2804] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:13.128029 31552 consensus_queue.cc:260] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:13.129375 31552 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:13.135820 29495 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:13.136962 31480 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:13.137501 31480 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:13.137905 31480 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:13.139206 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:13.140071 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:13.140817 29380 raft_consensus.cc:3060] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:13.127306 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:13.142670 29375 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:13.117653 30986 raft_consensus.cc:740] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:13.144439 30986 consensus_queue.cc:260] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:13.140197 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:13.145794 30986 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:13.147375 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:13.147795 31501 consensus_queue.cc:1048] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:13.148281 29374 raft_consensus.cc:2393] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 5: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:13.140097 29372 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:13.140722 29381 raft_consensus.cc:1240] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:13.152494 29379 raft_consensus.cc:1240] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:13.162411 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:13.122495 30985 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:13.169545 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:13.172616 29379 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:12:13.173563 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:13.171867 29278 catalog_manager.cc:5697] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 4 to 5, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 5 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:13.174535 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:13.174271 29374 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
I20260709 13:12:13.171008 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:13.175242 29379 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
W20260709 13:12:13.178090 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 55507.2us
I20260709 13:12:13.183754 29375 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 7.
I20260709 13:12:13.184784 29376 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:13.187315 29278 catalog_manager.cc:5697] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 2 to 3, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 3 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:13.191787 29279 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37586 (request call id 133) took 11879 ms (client timeout 15000 ms). Trace:
W20260709 13:12:13.192203 29279 rpcz_store.cc:269] 0709 13:12:01.316640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:01.317038 (+   398us) service_pool.cc:224] Handling call
0709 13:12:13.183685 (+11866647us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:09.120852 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:09.121738 (+   886us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:09.121786 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:12:09.121812 (+    26us) tablet.cc:662] Decoding operations
0709 13:12:09.124439 (+  2627us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:09.124512 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:09.124556 (+    44us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:12:09.192664 (+ 68108us) tablet.cc:701] Row locks acquired
0709 13:12:09.192718 (+    54us) write_op.cc:260] PREPARE: finished
0709 13:12:09.350666 (+157948us) write_op.cc:270] Start()
0709 13:12:09.378107 (+ 27441us) write_op.cc:276] Timestamp: P: 1783602729344430 usec, L: 0
0709 13:12:09.378135 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:12:09.453168 (+ 75033us) log.cc:844] Serialized 6405 byte log entry
0709 13:12:11.165134 (+1711966us) op_driver.cc:464] REPLICATION: finished
0709 13:12:11.432394 (+267260us) write_op.cc:301] APPLY: starting
0709 13:12:11.437815 (+  5421us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:11.469353 (+ 31538us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:11.486706 (+ 17353us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:11.548983 (+ 62277us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:11.549730 (+   747us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 13:12:11.549853 (+   123us) write_op.cc:312] APPLY: finished
0709 13:12:11.550714 (+   861us) log.cc:844] Serialized 112 byte log entry
0709 13:12:11.600695 (+ 49981us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:11.680822 (+ 80127us) write_op.cc:454] Released schema lock
0709 13:12:11.680915 (+    93us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:11.685729 (+  4814us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:11.685797 (+    68us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":306115,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":237739,"apply.run_cpu_time_us":14161,"apply.run_wall_time_us":268549,"num_ops":16,"prepare.queue_time_us":754396,"prepare.run_cpu_time_us":7591,"prepare.run_wall_time_us":340217,"raft.queue_time_us":12448,"raft.run_cpu_time_us":844,"raft.run_wall_time_us":845,"replication_time_us":1782780,"thread_start_us":129379,"threads_started":3,"wal-append.queue_time_us":140370,"wal-append.run_cpu_time_us":24016,"wal-append.run_wall_time_us":1417177}]]}
I20260709 13:12:13.197711 29372 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:12:13.169413 31212 raft_consensus.cc:697] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:13.191238 29278 catalog_manager.cc:5697] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 3 to 4, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 4 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:13.203013 29278 catalog_manager.cc:5697] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 5 to 6, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 6 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:13.205015 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:13.205173 29380 raft_consensus.cc:2468] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 2.
I20260709 13:12:13.207661 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:13.208600 29278 catalog_manager.cc:5697] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 2 to 5, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 5 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:13.232571 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.244947 30985 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:13.212257 31212 consensus_queue.cc:237] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:13.245493 31251 consensus_queue.cc:1059] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:12:13.250895 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.263768 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:13.263854 31555 consensus_queue.cc:1059] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:13.260869 30985 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:13.264813 29454 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:13.268404 31458 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:13.269999 29373 raft_consensus.cc:1240] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:12:13.271088 31543 raft_consensus.cc:2749] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 6. Current term is 7.
I20260709 13:12:13.200681 31550 consensus_queue.cc:1059] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:12:13.273706 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:13.274214 29455 raft_consensus.cc:1275] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:13.276728 29455 raft_consensus.cc:1275] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:13.280817 29456 raft_consensus.cc:1275] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:13.281581 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:13.282267 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:13.282413 29455 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
W20260709 13:12:13.283115 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.285197 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:13.286083 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:13.259622 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:13.260289 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:13.261480 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:13.295466 29375 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
I20260709 13:12:13.289825 30853 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.257601 29380 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 4.
I20260709 13:12:13.297066 29456 raft_consensus.cc:1275] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:12:13.297142 29455 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:13.291855 31501 consensus_queue.cc:1059] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:13.302064 30853 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:13.294620 29379 raft_consensus.cc:2376] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 7. Re-sending same reply.
I20260709 13:12:13.300390 29278 catalog_manager.cc:5697] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 2 to 5, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 5 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:13.309653 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:13.316411 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.326606 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:13.325810 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:13.328716 29448 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:13.330765 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:13.331765 29451 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
I20260709 13:12:13.327473 29453 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:13.325939 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:13.333277 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:13.334159 29456 raft_consensus.cc:2368] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 5. Current term is 6.
I20260709 13:12:13.333282 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:13.336381 29447 raft_consensus.cc:2393] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 7: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
W20260709 13:12:13.321472 29346 connection.cc:256] RPC call timeout handler was delayed by -1.0859267549999458s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18380000000000002s for a response
I20260709 13:12:13.341025 29454 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
I20260709 13:12:13.358474 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:13.327665 31543 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:13.380703 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:13.375458 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:13.377336 29375 raft_consensus.cc:1240] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:13.381786 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:13.375267 29379 raft_consensus.cc:1275] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 13:12:13.382704 29448 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:12:13.380620 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:13.382725 29379 pending_rounds.cc:85] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5: Aborting all ops after (but not including) 2
I20260709 13:12:13.340101 31535 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.392472 29372 raft_consensus.cc:1240] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:13.391954 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:13.412590 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:13.384043 29374 raft_consensus.cc:1275] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:13.415696 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:13.383605 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 126633us
I20260709 13:12:13.418890 29381 raft_consensus.cc:2368] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 5. Current term is 6.
I20260709 13:12:13.420794 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:13.419627 29344 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:13.420483 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:13.420794 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:13.423369 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:13.423904 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:13.425308 29372 raft_consensus.cc:2368] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5.
I20260709 13:12:13.425691 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:13.427462 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:13.411125 29379 pending_rounds.cc:107] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:12:13.429461 29379 raft_consensus.cc:2889] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:13.429921 29379 pending_rounds.cc:107] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:12:13.430214 29379 raft_consensus.cc:2889] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:13.430272 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.390980 31555 raft_consensus.cc:3055] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:13.430342 29346 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:13.434600 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:13.424679 31251 raft_consensus.cc:3055] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:13.435853 31251 raft_consensus.cc:740] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:13.436935 31251 consensus_queue.cc:260] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:13.440353 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:13.443079 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:13.443269 29376 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 7.
I20260709 13:12:13.443928 29375 raft_consensus.cc:2368] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 6. Current term is 7.
I20260709 13:12:13.444255 29381 raft_consensus.cc:1240] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:13.445273 31251 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:13.416203 31550 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:13.414180 31535 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:13.420509 31458 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:13.449131 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:13.465418 29373 raft_consensus.cc:2393] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 7: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:13.450665 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:13.420433 31212 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.454025 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:13.446534 29448 raft_consensus.cc:2393] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 6: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:13.391939 31543 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:13.460875 29529 raft_consensus.cc:1275] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:13.463829 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:13.454725 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:13.472064 29447 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:13.442292 31552 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:13.433919 31555 raft_consensus.cc:740] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:13.470331 29344 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:13.480360 29378 raft_consensus.cc:2393] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 7: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
W20260709 13:12:13.467515 31553 log.cc:927] Time spent T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.193s	user 0.002s	sys 0.007s
I20260709 13:12:13.487720 29380 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:12:13.466807 30853 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:13.507386 29448 raft_consensus.cc:1240] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 1. Current term is 2. Ops: [1.4-1.4]
I20260709 13:12:13.507026 29447 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
I20260709 13:12:13.537703 29454 raft_consensus.cc:1240] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 5. Current term is 6. Ops: []
W20260709 13:12:13.475287 30179 debug-util.cc:398] Leaking SignalData structure 0x7b08002dad60 after lost signal to thread 28237
I20260709 13:12:13.466629 31550 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:13.510277 31556 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:13.509833 31552 raft_consensus.cc:697] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:13.478183 31212 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:13.564061 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 270809us
I20260709 13:12:13.568166 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:13.568885 29522 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:13.552781 31541 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:12:13.570406 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 100177us
I20260709 13:12:13.570582 29454 raft_consensus.cc:1275] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:12:13.573585 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:13.574635 29524 raft_consensus.cc:1240] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:12:13.577802 29346 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:13.576083 29344 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:13.560134 31561 raft_consensus.cc:2804] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:13.587940 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:13.588974 29448 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:12:13.599884 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:13.552003 30985 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:13.602898 29447 raft_consensus.cc:1275] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:12:13.607049 29522 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 7.
I20260709 13:12:13.610669 29525 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 7.
I20260709 13:12:13.616439 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:12:13.590107 30179 debug-util.cc:398] Leaking SignalData structure 0x7b08002db460 after lost signal to thread 29313
I20260709 13:12:13.570161 31535 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:13.617673 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:13.617167 29525 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:13.633124 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 65837us
I20260709 13:12:13.620343 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:13.637877 31535 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.645560 29448 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
I20260709 13:12:13.648488 29525 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:12:13.649451 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:13.612375 31458 raft_consensus.cc:2804] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:13.650216 29448 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
I20260709 13:12:13.650264 29455 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:13.590823 31541 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:13.620795 31561 raft_consensus.cc:697] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:13.654454 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:13.637049 31501 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.656462 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:13.657064 29524 raft_consensus.cc:2393] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 5: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:13.620154 31565 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:13.619931 31562 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:13.651628 30986 raft_consensus.cc:3055] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:13.647276 31568 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:13.575407 31555 consensus_queue.cc:260] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:13.662868 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:12:13.664876 31558 log.cc:927] Time spent T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:12:13.665843 31550 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:13.665630 31482 consensus_queue.cc:1048] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:13.663311 30986 raft_consensus.cc:740] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:13.667071 30985 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:13.666970 31562 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:13.662782 31565 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:13.695897 31561 consensus_queue.cc:237] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:13.699930 31555 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:13.667102 29524 raft_consensus.cc:1240] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:12:13.673555 29455 raft_consensus.cc:2368] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5.
I20260709 13:12:13.708191 29521 raft_consensus.cc:1275] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:12:13.689962 31571 consensus_queue.cc:1059] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:13.662530 31552 consensus_queue.cc:237] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:13.709930 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 53314.4us
I20260709 13:12:13.691591 31541 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:13.658299 31535 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:13.663409 31501 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:13.692152 30986 consensus_queue.cc:260] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:13.695052 31562 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:13.661370 31567 consensus_queue.cc:1059] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:12:13.669198 31212 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:13.688807 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 89044.9us
I20260709 13:12:13.689463 31543 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:13.670955 30179 debug-util.cc:398] Leaking SignalData structure 0x7b080037d180 after lost signal to thread 29405
I20260709 13:12:13.712180 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:13.713539 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:13.754202 29448 raft_consensus.cc:2368] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 6. Current term is 7.
I20260709 13:12:13.715433 31574 consensus_queue.cc:1048] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:12:13.717804 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 146578us
I20260709 13:12:13.723205 29454 raft_consensus.cc:1240] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:13.724846 29450 raft_consensus.cc:1240] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:13.706836 31568 raft_consensus.cc:697] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:13.729876 29452 raft_consensus.cc:1240] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:13.730902 31535 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:13.731868 31571 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:13.667706 31569 consensus_queue.cc:1048] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:12:13.746608 29524 raft_consensus.cc:1240] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:12:13.752610 29344 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:13.710420 31565 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:13.763006 29346 leader_election.cc:400] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 6. Current term is 7.
I20260709 13:12:13.765095 29346 leader_election.cc:403] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 13:12:13.756992 30179 debug-util.cc:398] Leaking SignalData structure 0x7b0800127ce0 after lost signal to thread 29406
I20260709 13:12:13.766497 29421 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:13.744071 31458 raft_consensus.cc:697] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:13.770664 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:13.773124 29344 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:13.774209 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.767328 30986 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:13.782363 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:13.781476 31567 raft_consensus.cc:2749] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:13.784123 31576 consensus_queue.cc:1059] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:13.784941 31572 raft_consensus.cc:3055] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:13.768190 31571 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:13.771039 31482 consensus_queue.cc:1048] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:12:13.831848 31556 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:13.832257 31501 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:13.832963 31501 raft_consensus.cc:3055] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:13.833392 31501 raft_consensus.cc:740] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:13.837517 29447 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:13.842208 29346 leader_election.cc:400] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 4. Current term is 5.
I20260709 13:12:13.842625 29346 leader_election.cc:403] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:12:13.791039 29523 raft_consensus.cc:1240] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:13.791028 29527 raft_consensus.cc:1240] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:13.792038 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:13.792181 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:13.812649 31541 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.850219 29530 raft_consensus.cc:2393] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 6: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:13.793684 29524 raft_consensus.cc:2393] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 6: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:12:13.804764 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:13.825003 30179 debug-util.cc:398] Leaking SignalData structure 0x7b08002fe140 after lost signal to thread 29480
I20260709 13:12:13.825372 31579 raft_consensus.cc:2804] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:13.825196 31458 consensus_queue.cc:237] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:13.826172 31565 raft_consensus.cc:3055] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:12:13.826320 31480 consensus_meta.cc:287] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.688s	user 0.014s	sys 0.000s
I20260709 13:12:13.792517 30853 raft_consensus.cc:3055] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:13.812855 31572 raft_consensus.cc:740] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:13.798446 31577 raft_consensus.cc:2749] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 6. Current term is 7.
I20260709 13:12:13.828266 31568 consensus_queue.cc:237] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:13.830629 31571 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:13.831213 31555 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:13.850559 31541 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:13.856595 31579 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:13.855198 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:13.857692 31564 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:13.863415 29447 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
W20260709 13:12:13.854314 30179 debug-util.cc:398] Leaking SignalData structure 0x7b08003716c0 after lost signal to thread 29481
I20260709 13:12:13.853782 31251 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 4. Current term is 5.
I20260709 13:12:13.834647 31501 consensus_queue.cc:260] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:13.854864 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:13.856082 31567 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:12:13.882344 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 112381us
I20260709 13:12:13.885898 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:13.864282 30853 raft_consensus.cc:740] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:13.859632 31565 raft_consensus.cc:740] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:13.858245 29346 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:13.885269 29529 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 4.
I20260709 13:12:13.890874 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:13.891497 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:13.889683 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:13.897666 29530 raft_consensus.cc:2393] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 7: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:13.898972 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:13.900679 29527 raft_consensus.cc:2393] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 8: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:13.902012 31590 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:13.902639 31590 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:13.903913 29421 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:13.870122 31480 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:13.908172 29521 raft_consensus.cc:1275] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:13.887014 31579 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:13.885118 31555 raft_consensus.cc:697] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:12:13.910650 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 52504.3us
I20260709 13:12:13.918700 29529 raft_consensus.cc:1240] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:12:13.909024 29421 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:13.925971 31541 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:13.896077 31564 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:13.933362 31480 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:13.934892 31565 consensus_queue.cc:260] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:13.936822 31565 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:13.899012 31567 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:13.939349 31590 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:13.945351 31590 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:13.945834 31590 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:13.946184 31590 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:13.909175 31556 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:13.916750 31571 raft_consensus.cc:2804] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:13.939404 31555 consensus_queue.cc:237] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:13.947944 31571 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:13.944000 29525 raft_consensus.cc:2393] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 5: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:13.908022 31501 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:13.899276 31572 consensus_queue.cc:260] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:13.964951 29346 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:13.954136 29526 raft_consensus.cc:2955] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 2 to 5, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:12:13.978557 29377 raft_consensus.cc:1275] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:12:13.952652 31571 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:13.963748 30179 debug-util.cc:398] Leaking SignalData structure 0x7b08003941c0 after lost signal to thread 29554
W20260709 13:12:13.993783 30179 debug-util.cc:398] Leaking SignalData structure 0x7b08001161a0 after lost signal to thread 30182
I20260709 13:12:13.996696 30986 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:13.997207 30986 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:13.997262 29346 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:13.997771 30986 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:13.998812 29346 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:13.999877 31577 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:14.000249 31577 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:14.000603 31577 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:14.000991 31588 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:13.990463 31574 consensus_queue.cc:1048] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:12:13.991683 31589 log.cc:927] Time spent T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:12:13.991457 31572 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:14.007829 30986 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:14.010486 30986 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:14.011727 29276 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35182 (request call id 56) took 1224 ms. Trace:
I20260709 13:12:14.014335 31564 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:14.018616 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:14.019443 29527 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
I20260709 13:12:14.019894 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:14.020131 29450 raft_consensus.cc:1275] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:12:14.020496 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:14.020619 29522 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
I20260709 13:12:14.021310 29523 raft_consensus.cc:2393] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 4: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:13.995325 31567 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:14.012454 29276 rpcz_store.cc:276] 0709 13:12:12.787667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:12.787901 (+   234us) service_pool.cc:224] Handling call
0709 13:12:12.898911 (+111010us) spinlock_profiling.cc:243] Waited 69.2 ms on lock 0x7b5400002490. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61b71 00007f6a78c620b2 00007f6a81bdba89 00007f6a81b73da6 00007f6a81b45088 00007f6a81c4337e 00007f6a801042a4 00007f6a80104232 00007f6a80104161 00007f6a801040dc
0709 13:12:14.011654 (+1112743us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:13.286274 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:13.287001 (+   727us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:13.287066 (+    65us) write_op.cc:435] Acquired schema lock
0709 13:12:13.287084 (+    18us) tablet.cc:662] Decoding operations
0709 13:12:13.287433 (+   349us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:13.287520 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:13.287552 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:12:13.287770 (+   218us) tablet.cc:701] Row locks acquired
0709 13:12:13.287787 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:12:13.287944 (+   157us) write_op.cc:270] Start()
0709 13:12:13.288085 (+   141us) write_op.cc:276] Timestamp: P: 1783602733287897 usec, L: 0
0709 13:12:13.288109 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:12:13.288828 (+   719us) log.cc:844] Serialized 538 byte log entry
0709 13:12:13.669293 (+380465us) op_driver.cc:464] REPLICATION: finished
0709 13:12:13.966491 (+297198us) spinlock_profiling.cc:243] Waited 46.1 ms on lock 0x7b18000ca8a0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c993f3 00007f6a78c9b7c1 00007f6a78c9b779 00007f6a78c9b709 00007f6a78c9b6d1 00007f6a78c9a9cd 000000000038f354 000000000038f199 00007f6a78c7c83a
0709 13:12:13.966624 (+   133us) write_op.cc:301] APPLY: starting
0709 13:12:13.966718 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:13.966858 (+   140us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:13.966890 (+    32us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:13.967230 (+   340us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:13.967463 (+   233us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:12:13.969831 (+  2368us) write_op.cc:312] APPLY: finished
0709 13:12:13.980014 (+ 10183us) log.cc:844] Serialized 22 byte log entry
0709 13:12:13.980988 (+   974us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:13.981101 (+   113us) write_op.cc:454] Released schema lock
0709 13:12:13.981155 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:13.989434 (+  8279us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:13.989470 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":100182,"reported_tablets":1,"spinlock_wait_cycles":159194240,"child_traces":[["op",{"apply.queue_time_us":142742,"apply.run_cpu_time_us":2238,"apply.run_wall_time_us":20466,"num_ops":1,"prepare.queue_time_us":110571,"prepare.run_cpu_time_us":74156,"prepare.run_wall_time_us":206810,"raft.queue_time_us":228033,"raft.run_cpu_time_us":14211,"raft.run_wall_time_us":159645,"replication_time_us":369409,"spinlock_wait_cycles":106060672,"thread_start_us":407831,"threads_started":4,"wal-append.queue_time_us":143411}]]}
I20260709 13:12:14.036499 29346 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:13.966344 30853 consensus_queue.cc:260] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:13.920519 31584 consensus_queue.cc:1059] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.127s
I20260709 13:12:14.038552 30853 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:14.023072 31577 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:14.048610 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:14.049868 29447 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
I20260709 13:12:14.053018 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:14.055912 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:14.056999 29452 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
I20260709 13:12:14.055943 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:14.059464 29450 raft_consensus.cc:2410] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:12:14.055874 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:14.062057 29346 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:14.111816 29521 raft_consensus.cc:1275] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:12:14.116096 29521 raft_consensus.cc:1275] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:14.121318 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:14.125821 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:14.127180 29523 raft_consensus.cc:1240] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:14.126652 29450 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
W20260709 13:12:14.134053 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 290928us
I20260709 13:12:14.121807 31568 raft_consensus.cc:2804] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:14.136821 29448 raft_consensus.cc:1275] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:14.122879 31584 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:14.126652 29377 raft_consensus.cc:2955] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 2 to 5, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:12:14.141886 31575 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.142151 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:14.142478 31575 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:14.144795 31575 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:14.136382 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:14.151643 31566 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:12:14.151903 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:14.158470 31576 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:14.159569 31576 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:14.160200 31579 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:14.162358 31579 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:14.128715 31564 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:14.162899 31576 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:14.163041 31584 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:14.163642 31577 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:14.175208 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:14.165529 31567 raft_consensus.cc:3055] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:14.176466 31567 raft_consensus.cc:740] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:14.177361 31567 consensus_queue.cc:260] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:14.178612 31567 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:14.180470 31588 consensus_queue.cc:1048] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:14.181221 31584 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:14.182385 29419 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:14.182796 31568 raft_consensus.cc:697] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:14.183744 29419 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:14.184635 31576 raft_consensus.cc:2804] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:14.185235 31576 raft_consensus.cc:697] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 7 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:14.185400 31572 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:14.185945 31572 raft_consensus.cc:697] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:14.186339 31576 consensus_queue.cc:237] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:14.184029 31568 consensus_queue.cc:237] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:14.186810 31572 consensus_queue.cc:237] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:14.188884 31501 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.189422 31501 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:14.165407 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:14.190701 29419 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:14.193435 31584 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:14.194131 30853 consensus_queue.cc:1059] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:14.195165 31584 raft_consensus.cc:3055] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:14.195276 31561 consensus_queue.cc:1048] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:14.196677 31584 raft_consensus.cc:740] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
W20260709 13:12:14.208621 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 146677us
I20260709 13:12:14.211642 29448 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
I20260709 13:12:14.215948 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:14.224050 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:14.238262 29530 raft_consensus.cc:1275] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:14.242290 29346 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:14.248900 31552 consensus_queue.cc:1048] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:14.213353 31584 consensus_queue.cc:260] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:14.195724 31577 consensus_queue.cc:1048] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:12:14.259829 29277 catalog_manager.cc:5697] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:14.263266 29277 catalog_manager.cc:5697] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:14.264902 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 355941us
W20260709 13:12:14.266410 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:14.262308 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:12:14.267050 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:14.267396 29523 raft_consensus.cc:2368] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 4. Current term is 5.
I20260709 13:12:14.265988 29277 catalog_manager.cc:5697] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 4 to 5, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 5 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:14.172088 31564 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:14.273193 31584 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:14.270836 31552 raft_consensus.cc:2804] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:14.276154 31552 raft_consensus.cc:697] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:14.277273 31552 consensus_queue.cc:237] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:14.278931 31564 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:14.257145 31555 consensus_queue.cc:1059] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:12:14.280417 31555 raft_consensus.cc:3055] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:14.280820 31555 raft_consensus.cc:740] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:14.281237 31501 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:14.284188 29419 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:14.285504 29419 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:14.266309 29421 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:14.295126 29277 catalog_manager.cc:5697] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 4 to 5, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 5 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:14.274951 31590 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:14.307164 29277 catalog_manager.cc:5697] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:14.304593 30853 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:14.311906 30853 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.312333 30853 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:14.311626 29277 catalog_manager.cc:5697] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 3 to 4, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 4 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:14.318908 29277 catalog_manager.cc:5697] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 4 to 5, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 5 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:14.324467 29421 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:14.327118 29346 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:14.329188 29277 catalog_manager.cc:5697] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 2 to 3, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 3 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:14.332892 29454 raft_consensus.cc:2393] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 5: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:14.334062 29278 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37594 (request call id 133) took 7197 ms. Trace:
I20260709 13:12:14.305187 31564 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:14.316113 30986 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.315366 31599 raft_consensus.cc:2804] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:14.343849 29277 catalog_manager.cc:5697] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:14.350242 31564 raft_consensus.cc:2749] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:14.351940 31590 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:14.346415 31556 raft_consensus.cc:2804] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:14.281704 31555 consensus_queue.cc:260] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:14.307648 31571 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:14.357650 29447 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
I20260709 13:12:14.359349 31556 raft_consensus.cc:697] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:14.339138 29278 rpcz_store.cc:276] 0709 13:12:07.109318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:07.134264 (+ 24946us) service_pool.cc:224] Handling call
0709 13:12:14.306975 (+7172711us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:13.437633 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:13.473464 (+ 35831us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:13.475241 (+  1777us) write_op.cc:435] Acquired schema lock
0709 13:12:13.475266 (+    25us) tablet.cc:662] Decoding operations
0709 13:12:13.664903 (+189637us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:13.664961 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:13.664996 (+    35us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:12:13.666293 (+  1297us) tablet.cc:701] Row locks acquired
0709 13:12:13.666315 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:12:13.666512 (+   197us) write_op.cc:270] Start()
0709 13:12:13.666657 (+   145us) write_op.cc:276] Timestamp: P: 1783602733666459 usec, L: 0
0709 13:12:13.666679 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:12:13.844211 (+177532us) log.cc:844] Serialized 4454 byte log entry
0709 13:12:13.846430 (+  2219us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b5400422054. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd81e28 00007f6a7f7bc581 00007f6a7f7bbd58 00007f6a7f7c09f1 00007f6a7f7c09a9 00007f6a7f7c0939 00007f6a7f7c0901 00007f6a7f7bfb2d 000000000038f354 000000000038f199
0709 13:12:13.885247 (+ 38817us) op_driver.cc:464] REPLICATION: finished
0709 13:12:13.989912 (+104665us) write_op.cc:301] APPLY: starting
0709 13:12:13.990003 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:13.990319 (+   316us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:13.990346 (+    27us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:13.991718 (+  1372us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:13.991973 (+   255us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:12:13.992029 (+    56us) write_op.cc:312] APPLY: finished
0709 13:12:13.992386 (+   357us) log.cc:844] Serialized 82 byte log entry
0709 13:12:13.995817 (+  3431us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:13.995973 (+   156us) write_op.cc:454] Released schema lock
0709 13:12:13.996033 (+    60us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":74394,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":99988,"apply.run_cpu_time_us":3331,"apply.run_wall_time_us":6482,"num_ops":11,"prepare.queue_time_us":208,"prepare.run_cpu_time_us":10370,"prepare.run_wall_time_us":408981,"replication_time_us":210045,"spinlock_wait_cycles":335006464,"thread_start_us":228135,"threads_started":1}]]}
I20260709 13:12:14.347054 31599 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:14.360945 31556 consensus_queue.cc:237] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:14.361789 31599 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:14.363046 30986 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:14.365676 30986 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:14.359292 31571 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:14.370572 29346 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:14.371696 31555 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:14.373193 31251 consensus_queue.cc:1048] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:14.374807 31251 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:14.375159 31251 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.375957 29346 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:14.376655 31458 consensus_queue.cc:1048] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:14.377453 31251 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:14.379886 29523 raft_consensus.cc:1275] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:14.380527 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:14.401567 29526 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
W20260709 13:12:14.390622 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:14.403466 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:14.392047 29344 leader_election.cc:400] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 4. Current term is 5.
I20260709 13:12:14.393205 29277 catalog_manager.cc:5697] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 4 to 5, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 5 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:14.404462 30853 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:14.405530 29344 leader_election.cc:403] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:12:14.400892 31575 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:14.411720 31584 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:12:14.414929 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 113305us
I20260709 13:12:14.408613 29277 catalog_manager.cc:5697] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 1 to 2, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 2 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:14.427551 29277 catalog_manager.cc:5697] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:14.420634 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 204792us
I20260709 13:12:14.443112 29277 catalog_manager.cc:5697] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 4 to 5, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 5 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:14.446768 29277 catalog_manager.cc:5697] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 2 to 3, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 3 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:14.449054 30853 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:14.456501 30157 raft_consensus.cc:1240] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:14.419893 31575 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.446121 31579 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:14.456398 31480 consensus_queue.cc:1048] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
W20260709 13:12:14.468604 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 183192us
I20260709 13:12:14.489089 29344 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:14.496570 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:14.499835 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:14.473210 31575 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:14.502111 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:14.445693 31584 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:14.503391 29378 raft_consensus.cc:2393] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 5: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:14.503767 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:14.504629 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:14.504482 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:14.504490 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:14.509768 29525 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:14.512396 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:12:14.514928 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 190568us
I20260709 13:12:14.516387 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:14.516431 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:14.518361 29448 raft_consensus.cc:1240] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:14.520726 29375 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
I20260709 13:12:14.522809 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:14.524899 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:14.518188 29374 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
I20260709 13:12:14.527053 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:14.527066 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:14.527880 29378 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 4.
I20260709 13:12:14.527976 29448 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:14.532066 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:14.525584 29373 raft_consensus.cc:2376] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 7. Re-sending same reply.
I20260709 13:12:14.537400 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:14.538311 29380 raft_consensus.cc:2376] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 2. Re-sending same reply.
I20260709 13:12:14.541023 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:14.510581 31568 raft_consensus.cc:2804] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:14.521622 31576 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.551537 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:14.553769 29455 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
I20260709 13:12:14.554855 29448 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:12:14.586746 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:14.516983 31541 consensus_queue.cc:1048] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:12:14.592772 29525 raft_consensus.cc:1275] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:12:14.593634 31584 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:14.517421 31588 consensus_queue.cc:1048] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:12:14.502816 29381 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:12:14.546945 31568 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.598572 29381 raft_consensus.cc:606] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:12:14.599038 29381 raft_consensus.cc:614] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:14.491217 29368 tablet_service.cc:1558] Processing DeleteTablet for tablet b5c4a6169e564566927a70e27f4af6f6 with delete_type TABLET_DATA_TOMBSTONED (TS 429e58eb058349e3bf72b5a870c8f6e5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52164
W20260709 13:12:14.611407 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 155587us
I20260709 13:12:14.615954 29495 leader_election.cc:400] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 5. Current term is 6.
I20260709 13:12:14.616353 29495 leader_election.cc:403] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:12:14.596323 30853 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.616266 29421 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:14.617237 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 118179us
I20260709 13:12:14.617134 30853 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:14.621927 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:14.595373 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:14.647831 29495 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:14.671152 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:14.610268 31568 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:14.621390 29421 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:14.651562 30853 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:14.615656 31528 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.587805 31576 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:14.601548 31480 consensus_queue.cc:1059] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:12:14.713171 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:14.713342 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:14.714406 29455 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:14.715078 30853 raft_consensus.cc:2804] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:12:14.715341 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 94075.1us
I20260709 13:12:14.715478 30853 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:14.716104 30853 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:14.718824 31576 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:14.718683 31599 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:14.622035 31572 consensus_queue.cc:1059] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.093s
I20260709 13:12:14.725682 29450 raft_consensus.cc:1275] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:12:14.728310 29346 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:14.729430 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:14.730166 29381 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:14.708807 29495 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:14.678018 31561 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.716305 29421 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:14.673350 31612 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:14.780354 29448 raft_consensus.cc:1275] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:12:14.787520 29448 pending_rounds.cc:85] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 3
I20260709 13:12:14.787900 29448 pending_rounds.cc:107] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:12:14.788223 29448 raft_consensus.cc:2889] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:14.791203 29381 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
I20260709 13:12:14.797145 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:14.797389 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 81186.7us
I20260709 13:12:14.799211 29421 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:14.783887 30853 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:14.804566 29421 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:14.776360 31576 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.780834 31618 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 5. Current term is 6.
W20260709 13:12:14.797333 31587 log.cc:927] Time spent T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:12:14.817420 29421 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:14.803046 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:14.714226 31528 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:14.831785 30853 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:14.835685 31615 log.cc:927] Time spent T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
W20260709 13:12:14.836300 31619 log.cc:927] Time spent T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:12:14.802099 31561 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:14.804091 31607 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:14.822294 31576 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:14.859081 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 130894us
I20260709 13:12:14.824092 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:14.827775 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:14.823760 31618 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:14.892532 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:14.846560 31561 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:14.862295 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 153592us
W20260709 13:12:14.850231 31617 log.cc:927] Time spent T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:12:14.872510 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:14.872834 31599 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:14.829118 31565 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:14.873184 31251 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:14.849687 31624 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:14.850265 31571 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:14.856783 31576 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:14.860507 31584 raft_consensus.cc:2804] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:14.876420 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:14.876725 31577 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:14.877192 31528 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:14.850770 31610 log.cc:927] Time spent T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 13:12:14.849411 31607 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:14.878991 31616 log.cc:927] Time spent T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.174s	user 0.002s	sys 0.000s
W20260709 13:12:14.842886 31598 log.cc:927] Time spent T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.538s	user 0.004s	sys 0.000s
I20260709 13:12:14.886924 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:14.903863 29375 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:12:14.905818 29495 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:14.911080 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 45998.4us
I20260709 13:12:14.923540 29374 raft_consensus.cc:2393] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 4: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:14.901549 31618 raft_consensus.cc:697] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
W20260709 13:12:14.928676 29493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 458606us
I20260709 13:12:14.919550 31565 raft_consensus.cc:697] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 7 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:14.919376 31584 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.927623 31607 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:14.922569 31571 raft_consensus.cc:697] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 7 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:14.916033 31561 consensus_queue.cc:1059] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:12:14.970162 29346 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:14.970964 31618 consensus_queue.cc:237] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:14.974268 29372 raft_consensus.cc:1240] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:14.930476 29448 raft_consensus.cc:2468] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 2.
W20260709 13:12:14.986824 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:14.993716 29375 raft_consensus.cc:1240] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:14.995122 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:14.997666 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 91940.5us
I20260709 13:12:14.996426 30121 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:12:14.989009 31584 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:14.926033 31577 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:15.012208 31636 raft_consensus.cc:2804] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:15.011248 31637 raft_consensus.cc:2804] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:15.028465 31637 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:15.028966 31637 raft_consensus.cc:3060] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:15.000792 31480 raft_consensus.cc:2804] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:15.032040 31480 raft_consensus.cc:697] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:15.033499 31480 consensus_queue.cc:237] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:15.035915 31571 consensus_queue.cc:237] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:14.993309 31631 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:15.022013 31579 consensus_meta.cc:287] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.546s	user 0.006s	sys 0.006s
I20260709 13:12:15.022490 31640 consensus_queue.cc:1059] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:15.023275 31251 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:15.024509 31560 log.cc:927] Time spent T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b: Append to log took a long time: real 0.113s	user 0.002s	sys 0.000s
I20260709 13:12:14.997391 31630 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:12:15.081831 29344 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.044s	sys 0.048s
W20260709 13:12:15.082237 29344 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.044s	sys 0.048s
W20260709 13:12:15.075146 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:15.082540 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 581321us
W20260709 13:12:15.075619 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 75346us
I20260709 13:12:15.078086 29381 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
I20260709 13:12:15.010768 31561 raft_consensus.cc:3055] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:15.083460 29495 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:15.086678 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:15.101722 31637 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:15.078641 31579 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 4. Current term is 5.
I20260709 13:12:15.088294 31561 raft_consensus.cc:740] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:15.076784 31636 raft_consensus.cc:697] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
W20260709 13:12:15.096047 31575 consensus_meta.cc:287] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.553s	user 0.013s	sys 0.000s
W20260709 13:12:15.120932 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 125301us
W20260709 13:12:15.130079 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 44213.6us
I20260709 13:12:15.130523 29346 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:15.161091 29530 raft_consensus.cc:1275] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:12:15.128417 31599 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.126569 31575 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:15.150997 29522 raft_consensus.cc:1275] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:12:15.129207 31501 raft_consensus.cc:3055] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:15.139279 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:15.165685 29377 raft_consensus.cc:1240] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:15.082055 31565 consensus_queue.cc:237] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:15.191023 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 60628.7us
I20260709 13:12:15.192662 29346 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:15.110987 31624 consensus_queue.cc:1048] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 13:12:15.082011 31631 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:15.198199 31631 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:15.199015 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:15.201172 31636 consensus_queue.cc:237] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:15.162032 31634 tablet_replica.cc:333] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:12:15.206259 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:15.170878 31501 raft_consensus.cc:740] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:15.208817 29454 raft_consensus.cc:3060] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:15.210755 29346 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:15.211810 31637 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 3 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:15.168457 31575 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:15.194201 31552 raft_consensus.cc:2749] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:15.217700 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:15.165122 31599 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:15.220443 31630 raft_consensus.cc:2804] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:12:15.221182 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 137827us
I20260709 13:12:15.222962 29346 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:15.209908 31597 log.cc:927] Time spent T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:12:15.231436 29495 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:15.209308 31631 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.239806 31640 raft_consensus.cc:2804] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:15.240432 31640 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:15.240842 31640 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:15.239874 31631 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:15.246908 29454 raft_consensus.cc:2468] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 3.
I20260709 13:12:15.234620 29495 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:15.254307 30121 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:12:15.259207 29495 leader_election.cc:400] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5.
I20260709 13:12:15.259627 29495 leader_election.cc:403] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:15.266018 29376 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
I20260709 13:12:15.213203 31641 raft_consensus.cc:2804] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:15.262614 31574 raft_consensus.cc:2804] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:15.253844 31575 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.264956 31480 raft_consensus.cc:2804] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:15.262511 31572 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.254627 31571 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:15.280601 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 57769.1us
I20260709 13:12:15.253613 31618 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.233647 31630 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:15.204547 31561 consensus_queue.cc:260] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:15.264201 31552 raft_consensus.cc:2749] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:15.260172 31577 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:15.283383 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 66815.3us
I20260709 13:12:15.279830 31641 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:15.212868 31639 consensus_queue.cc:1059] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.213s
I20260709 13:12:15.382311 31627 consensus_queue.cc:1048] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:15.383054 31639 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5.
W20260709 13:12:15.383224 31648 log.cc:927] Time spent T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
W20260709 13:12:15.389375 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 92595.1us
W20260709 13:12:15.390782 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 131728us
I20260709 13:12:15.396422 29495 leader_election.cc:400] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 6. Current term is 7.
I20260709 13:12:15.396939 29495 leader_election.cc:403] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 13:12:15.392057 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 105708us
I20260709 13:12:15.296393 31630 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:15.283406 31480 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:15.391268 31646 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:15.310328 31643 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.298435 31574 raft_consensus.cc:697] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:12:15.262888 31501 consensus_queue.cc:260] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:15.285609 31572 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:15.416591 31639 raft_consensus.cc:2749] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 6. Current term is 7.
I20260709 13:12:15.416683 31599 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:15.420367 31607 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:15.421357 31654 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:15.426987 31638 consensus_queue.cc:1048] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.135s
I20260709 13:12:15.291378 31618 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:15.314767 31641 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.290000 31571 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:15.429196 31584 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:15.285527 31575 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:15.452651 31480 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:15.482434 31599 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.496510 29421 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:12:15.499382 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 59222.3us
W20260709 13:12:15.473009 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.431104 31541 consensus_queue.cc:1059] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 13:12:15.503400 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:15.504343 29448 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:12:15.508303 31555 consensus_queue.cc:1048] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:15.508744 31579 consensus_queue.cc:1048] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:15.511432 31655 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.513391 31565 raft_consensus.cc:2804] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:15.514130 31565 raft_consensus.cc:697] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 6 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:15.515322 31565 consensus_queue.cc:237] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:15.492765 31501 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:15.521728 29454 raft_consensus.cc:1275] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:15.521867 29448 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:15.526924 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:15.486264 31646 raft_consensus.cc:697] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:15.512502 31655 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:15.548267 30853 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:15.549441 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:15.550050 30853 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:15.550976 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:15.551936 29456 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
I20260709 13:12:15.552301 29450 raft_consensus.cc:1275] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:12:15.556784 29449 raft_consensus.cc:2393] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 5: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:15.547569 29421 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:12:15.532917 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 109811us
I20260709 13:12:15.495728 31639 consensus_queue.cc:1059] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.059s
W20260709 13:12:15.566829 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 59826.3us
I20260709 13:12:15.478963 31643 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:15.593719 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:15.557113 31568 consensus_meta.cc:287] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.851s	user 0.014s	sys 0.000s
I20260709 13:12:15.603556 29495 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:15.604799 29448 raft_consensus.cc:1275] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:15.605436 30853 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:15.617842 30853 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:15.618446 30853 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:15.618785 30853 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:15.621439 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:15.622957 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:15.626279 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:15.632591 29495 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:15.632920 30853 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:15.494433 31654 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:15.637223 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:15.531726 31599 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:15.643733 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 96274us
I20260709 13:12:15.648226 30853 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:15.632161 31636 raft_consensus.cc:3055] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:15.636775 31639 raft_consensus.cc:2804] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:15.630998 31568 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:15.669158 30853 consensus_queue.cc:1059] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:12:15.691430 29381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52172 (request call id 1138) took 1151 ms. Trace:
I20260709 13:12:15.680662 29453 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:15.663954 31631 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:15.728973 31646 consensus_queue.cc:237] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:15.729883 31642 raft_consensus.cc:3055] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:15.730531 31642 raft_consensus.cc:740] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:15.681420 31572 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:15.732218 31572 raft_consensus.cc:3055] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:15.731855 31642 consensus_queue.cc:260] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:15.732597 31572 raft_consensus.cc:740] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:15.693686 29381 rpcz_store.cc:276] 0709 13:12:14.539635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.892017 (+352382us) service_pool.cc:224] Handling call
0709 13:12:15.691144 (+799127us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b540002f654. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:15.691326 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":423278976}
W20260709 13:12:15.672931 31629 log.cc:927] Time spent T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.680s	user 0.006s	sys 0.004s
I20260709 13:12:15.665477 31636 raft_consensus.cc:740] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:15.689330 31650 raft_consensus.cc:3055] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:12:15.735737 31612 consensus_meta.cc:287] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.928s	user 0.009s	sys 0.006s
I20260709 13:12:15.758468 29374 raft_consensus.cc:2368] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 6. Current term is 7.
I20260709 13:12:15.675132 31599 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:15.737166 31541 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:15.770609 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 138114us
I20260709 13:12:15.771377 29495 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:15.606343 31574 consensus_queue.cc:237] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:12:15.756799 31640 consensus_meta.cc:287] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.515s	user 0.007s	sys 0.006s
I20260709 13:12:15.739836 31639 raft_consensus.cc:697] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:15.676761 31643 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:15.685258 31655 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:15.776628 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 160931us
I20260709 13:12:15.777345 29495 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:15.755210 31642 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:15.760931 31650 raft_consensus.cc:740] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:15.685993 31661 consensus_queue.cc:1048] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.110s
I20260709 13:12:15.770318 31612 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:15.800702 29452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1644) took 1079 ms. Trace:
I20260709 13:12:15.801273 29452 rpcz_store.cc:276] 0709 13:12:14.721040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.723607 (+  2567us) service_pool.cc:224] Handling call
0709 13:12:14.724035 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:14.724619 (+   584us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:14.724656 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:14.725190 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 13:12:14.804050 (+ 78860us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:14.804103 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:14.804195 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:15.561995 (+757800us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:12:15.800334 (+238339us) raft_consensus.cc:1685] finished
0709 13:12:15.800359 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:15.800620 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2290,"raft.queue_time_us":7850,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":39126,"spinlock_wait_cycles":4029824,"thread_start_us":78305,"threads_started":1,"wal-append.queue_time_us":187353}
I20260709 13:12:15.803893 31571 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:15.806740 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.793637 29495 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:15.791241 31607 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:15.804279 31584 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:15.832712 29453 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:12:15.777736 31541 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:15.809535 31561 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:15.825131 29495 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:15.790963 31572 consensus_queue.cc:260] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:15.838940 31671 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:15.839596 31657 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:15.840062 31664 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.811175 31618 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:15.816226 31575 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:15.863638 31672 consensus_queue.cc:1048] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:12:15.864238 31633 raft_consensus.cc:3055] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:15.864704 31633 raft_consensus.cc:740] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:15.865077 29376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 876) took 1361 ms. Trace:
I20260709 13:12:15.865610 31541 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:15.865639 29376 rpcz_store.cc:276] 0709 13:12:14.503910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.504084 (+   174us) service_pool.cc:224] Handling call
0709 13:12:15.864858 (+1360774us) spinlock_profiling.cc:243] Waited 610 ms on lock 0x7b54003dc554. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:15.864972 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1402406912}
W20260709 13:12:15.867867 31601 log.cc:927] Time spent T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 1.194s	user 0.009s	sys 0.006s
I20260709 13:12:15.868297 29374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52172 (request call id 1139) took 1327 ms. Trace:
I20260709 13:12:15.867987 31639 consensus_queue.cc:237] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:15.868717 29374 rpcz_store.cc:276] 0709 13:12:14.544085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.980474 (+436389us) service_pool.cc:224] Handling call
0709 13:12:15.867975 (+887501us) spinlock_profiling.cc:243] Waited 754 ms on lock 0x7b540009d3d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:15.868140 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1733449088}
W20260709 13:12:15.869591 31662 log.cc:927] Time spent T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 13:12:15.870543 31664 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:15.871647 31654 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:15.852509 31655 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.872375 31650 consensus_queue.cc:260] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:15.832376 31571 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.819772 31251 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:15.865998 31633 consensus_queue.cc:260] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:12:15.860595 31659 log.cc:927] Time spent T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 13:12:15.861157 31675 raft_consensus.cc:2804] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:15.886415 31675 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:15.886915 31675 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:15.887629 31571 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:15.888381 31650 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:15.890306 31571 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:15.814987 31636 consensus_queue.cc:260] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:15.862377 31635 log.cc:927] Time spent T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.775s	user 0.004s	sys 0.009s
I20260709 13:12:15.786300 31640 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:15.859683 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.873049 31655 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:15.879307 31568 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:15.882709 31657 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:15.884101 31251 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:15.892061 31458 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:15.904475 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 45324.3us
I20260709 13:12:15.855261 31671 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:12:15.912885 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.892061 31636 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:15.918550 31584 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.919262 31584 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:15.904752 31631 raft_consensus.cc:493] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:15.920855 31631 raft_consensus.cc:515] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:15.921727 31584 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:15.927608 29447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 110) took 1451 ms. Trace:
I20260709 13:12:15.928071 29447 rpcz_store.cc:276] 0709 13:12:14.476558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.476702 (+   144us) service_pool.cc:224] Handling call
0709 13:12:14.477114 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:14.488207 (+ 11093us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:14.488238 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:14.509425 (+ 21187us) log.cc:844] Serialized 26 byte log entry
0709 13:12:14.982535 (+473110us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:14.982606 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:14.982724 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:15.861593 (+878869us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:12:15.922604 (+ 61011us) raft_consensus.cc:1685] finished
0709 13:12:15.922626 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:15.927475 (+  4849us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10654,"raft.queue_time_us":11245,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":118,"spinlock_wait_cycles":31735680,"thread_start_us":431233,"threads_started":1,"wal-append.queue_time_us":523095}
I20260709 13:12:15.932509 31670 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:15.933089 31670 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:15.933437 31670 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:15.937281 31640 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:15.911219 31657 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:15.913452 31672 raft_consensus.cc:2804] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:15.925520 31458 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:15.969420 31633 raft_consensus.cc:3060] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:15.977432 31645 log.cc:927] Time spent T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.892s	user 0.008s	sys 0.009s
I20260709 13:12:15.980979 31251 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:15.986109 31634 raft_consensus.cc:2243] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:15.923815 31671 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:16.061190 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:16.016882 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 48320.7us
I20260709 13:12:15.990825 31566 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.029739 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:16.030733 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:16.031558 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:15.973122 31672 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:16.032524 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:16.042652 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:16.043300 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:16.066088 29529 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:16.044759 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:16.045656 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:16.052295 29346 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:16.061196 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:16.062424 29419 leader_election.cc:336] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.539s (SENT)
W20260709 13:12:16.070777 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:16.060307 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 413928us
I20260709 13:12:16.095268 29376 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "71aa3578fd924765ab9ac0729c8d1483"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:12:16.114632 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:16.118326 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:16.065426 29522 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:12:16.033273 31624 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.067683 29526 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:12:16.069378 29495 leader_election.cc:304] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:16.064635 29523 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
W20260709 13:12:16.115988 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 53944.4us
I20260709 13:12:16.119405 29376 raft_consensus.cc:606] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Received request to transfer leadership to TS 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:16.117344 29346 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:16.068491 29419 leader_election.cc:336] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.560s (SENT)
I20260709 13:12:16.069413 29377 raft_consensus.cc:1240] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 5. Current term is 6. Ops: []
W20260709 13:12:16.128347 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 59885.9us
I20260709 13:12:16.121372 29522 raft_consensus.cc:1240] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:16.055833 31571 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:16.133034 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:16.129259 29421 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:16.134981 29421 leader_election.cc:400] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 6. Current term is 7.
I20260709 13:12:16.118325 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:16.135879 29421 leader_election.cc:403] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:16.112798 31566 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:16.138163 29455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1641) took 1418 ms. Trace:
I20260709 13:12:16.138896 29455 rpcz_store.cc:276] 0709 13:12:14.719880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.729924 (+ 10044us) service_pool.cc:224] Handling call
0709 13:12:14.778748 (+ 48824us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:14.794860 (+ 16112us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:14.794896 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:15.041282 (+246386us) spinlock_profiling.cc:243] Waited 4.51 ms on lock 0x7b2c0005b3b8. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7a67fa11 00007f6a7a68f372 00007f6a7bdc1a01 00007f6a7bd8643a 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2
0709 13:12:15.045584 (+  4302us) log.cc:844] Serialized 26 byte log entry
0709 13:12:15.084932 (+ 39348us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:15.084977 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:15.085058 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:15.976731 (+891673us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:12:16.137918 (+161187us) raft_consensus.cc:1685] finished
0709 13:12:16.137943 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:16.138099 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12945,"raft.queue_time_us":15724,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":7607,"spinlock_wait_cycles":44112896,"thread_start_us":38748,"threads_started":1,"wal-append.queue_time_us":39268}
I20260709 13:12:16.141170 29451 raft_consensus.cc:1275] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:16.142120 31579 raft_consensus.cc:2804] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:16.142534 31579 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:16.142899 31579 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:16.140136 31566 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:16.146934 31674 log.cc:927] Time spent T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 13:12:16.162933 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:16.183677 29456 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:12:16.163240 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:16.189091 29448 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
I20260709 13:12:16.167304 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:16.173866 31572 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:16.193892 31655 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:16.197465 29456 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:16.159968 29373 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
W20260709 13:12:16.175275 31641 consensus_meta.cc:287] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.676s	user 0.009s	sys 0.000s
I20260709 13:12:16.202174 31641 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:16.180881 31664 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:16.203704 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:16.191190 31584 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:16.204419 31584 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:16.205087 31584 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:16.191120 29276 catalog_manager.cc:5697] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 1 to 2, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132). New cstate: current_term: 2 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:16.208892 31641 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:16.216733 31679 log.cc:927] Time spent T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.241s	user 0.002s	sys 0.000s
I20260709 13:12:16.221918 31584 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:16.174610 29378 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
I20260709 13:12:16.208039 29276 catalog_manager.cc:5697] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 5 to 6, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132). New cstate: current_term: 6 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:16.069211 31672 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:16.211615 30853 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:16.161710 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:16.118963 31646 raft_consensus.cc:2804] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:16.182605 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:16.277091 29447 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:12:16.223805 31571 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:16.118119 31631 leader_election.cc:290] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:12:16.225804 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 156529us
I20260709 13:12:16.227203 29372 raft_consensus.cc:1240] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:12:16.133607 31624 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:16.232489 31630 consensus_meta.cc:287] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.802s	user 0.015s	sys 0.000s
I20260709 13:12:16.286814 31630 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:16.271044 31480 consensus_meta.cc:287] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.759s	user 0.011s	sys 0.002s
W20260709 13:12:16.235093 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 100290us
I20260709 13:12:16.204391 29452 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:12:16.238487 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:12:16.248139 29419 leader_election.cc:336] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.699s (SENT)
I20260709 13:12:16.409694 29454 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:12:16.263682 29529 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:16.409974 29419 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:16.235955 31564 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:16.223182 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.238059 31501 raft_consensus.cc:2749] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 6. Current term is 7.
I20260709 13:12:16.236060 31641 raft_consensus.cc:2749] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:16.281792 30853 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:16.164858 31458 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:16.234730 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 165959us
I20260709 13:12:16.280196 31646 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:16.382058 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.354388 31634 raft_consensus.cc:2272] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:16.398057 29495 leader_election.cc:400] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 5. Current term is 6.
I20260709 13:12:16.263419 31607 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.405544 29380 raft_consensus.cc:1275] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:12:16.391433 31642 consensus_meta.cc:287] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.588s	user 0.012s	sys 0.001s
I20260709 13:12:16.422472 29495 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:16.424278 29346 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:16.417191 31675 consensus_meta.cc:287] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.530s	user 0.004s	sys 0.017s
I20260709 13:12:16.442490 31675 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:16.438735 30853 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:16.439078 29495 leader_election.cc:400] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5.
I20260709 13:12:16.445693 29346 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:16.446136 29495 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:16.447906 29495 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:16.412351 31636 consensus_queue.cc:1048] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:12:16.454860 29495 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:16.456313 30853 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:16.456473 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 208383us
I20260709 13:12:16.456861 30853 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:16.449138 31579 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:16.448770 31561 consensus_meta.cc:287] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.594s	user 0.011s	sys 0.000s
I20260709 13:12:16.468425 30853 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:16.469096 30853 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.469770 30853 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:16.460525 31501 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.476121 31501 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:16.460616 31661 raft_consensus.cc:2749] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:16.484982 30853 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:16.484787 31577 consensus_queue.cc:1048] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:12:16.499797 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 363916us
I20260709 13:12:16.424645 31646 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:16.505234 29344 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:16.483001 31681 log.cc:927] Time spent T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.314s	user 0.005s	sys 0.004s
I20260709 13:12:16.479194 31501 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:16.444330 31678 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:16.464473 31664 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:16.463755 31640 raft_consensus.cc:2749] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:16.500865 31641 raft_consensus.cc:2749] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:16.464385 31572 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:16.502521 31251 raft_consensus.cc:2749] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:16.543018 29344 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:16.425490 31564 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:16.550765 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 102814us
I20260709 13:12:16.429697 31480 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:16.436950 31607 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:16.483163 31670 consensus_meta.cc:287] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.549s	user 0.007s	sys 0.002s
I20260709 13:12:16.585088 29346 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:16.454656 31690 consensus_queue.cc:1048] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.108s
I20260709 13:12:16.489338 31655 consensus_queue.cc:1048] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.059s
W20260709 13:12:16.571564 31657 consensus_meta.cc:287] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.555s	user 0.004s	sys 0.007s
I20260709 13:12:16.550134 31627 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:12:16.596282 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 53414.7us
I20260709 13:12:16.550442 31458 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:16.594393 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 158303us
W20260709 13:12:16.601192 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 146444us
W20260709 13:12:16.601446 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.601727 29455 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:12:16.603407 29495 leader_election.cc:400] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 6. Current term is 7.
I20260709 13:12:16.611112 29346 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:16.592958 31630 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:16.615152 29495 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:16.602378 31627 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:16.618852 29346 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:16.602082 31575 raft_consensus.cc:2804] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:16.621227 29495 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:12:16.626497 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.610095 31588 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.588930 31670 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:16.632426 30853 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:16.625118 31627 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:16.634187 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.615654 31584 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:16.607836 31577 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:16.631572 31682 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.660835 31682 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:16.661994 31607 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:16.623391 31631 raft_consensus.cc:2804] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:16.663638 31631 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:16.638497 30853 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:16.664124 31631 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:16.665621 30853 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:16.663321 31682 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:16.626109 31641 raft_consensus.cc:2749] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:16.654105 31568 raft_consensus.cc:493] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:16.668159 31568 raft_consensus.cc:515] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:16.670586 31568 leader_election.cc:290] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:16.632027 31640 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:12:16.672189 31686 log.cc:927] Time spent T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.280s	user 0.004s	sys 0.002s
W20260709 13:12:16.672611 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 53776.4us
I20260709 13:12:16.673959 29346 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:16.675719 31552 raft_consensus.cc:2804] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:16.676285 31552 raft_consensus.cc:697] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:16.677253 31552 consensus_queue.cc:237] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:16.679939 29528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 1956) took 1059 ms. Trace:
I20260709 13:12:16.680768 31577 raft_consensus.cc:697] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:16.680356 29528 rpcz_store.cc:276] 0709 13:12:15.620405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:15.620551 (+   146us) service_pool.cc:224] Handling call
0709 13:12:15.620922 (+   371us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:15.760627 (+139705us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:15.760650 (+    23us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:15.787371 (+ 26721us) log.cc:844] Serialized 52 byte log entry
0709 13:12:16.117818 (+330447us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:16.132013 (+ 14195us) log.cc:844] Serialized 14 byte log entry
0709 13:12:16.134857 (+  2844us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:16.134965 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:16.671451 (+536486us) spinlock_profiling.cc:243] Waited 46.7 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:12:16.679585 (+  8134us) raft_consensus.cc:1685] finished
0709 13:12:16.679680 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:16.679862 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10757,"prepare.queue_time_us":13917,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":52935,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":10125,"spinlock_wait_cycles":107491200,"thread_start_us":397936,"threads_started":2,"wal-append.queue_time_us":473495}
I20260709 13:12:16.681890 31577 consensus_queue.cc:237] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:16.617781 31571 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:16.670711 31689 log.cc:927] Time spent T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:12:16.623994 31575 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:16.606598 31691 consensus_queue.cc:1048] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:12:16.608583 31458 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:16.690577 29495 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:16.603778 31657 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:16.697539 29495 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:12:16.704679 29495 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:12:16.679382 31630 raft_consensus.cc:2804] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:16.710278 29524 raft_consensus.cc:1275] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:16.712044 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:16.712713 29530 raft_consensus.cc:1275] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:16.712076 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:16.713522 29526 raft_consensus.cc:1240] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:16.713194 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:16.718938 29528 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:16.712108 31630 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:16.719648 31630 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:16.720692 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:16.716810 29521 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:16.690236 31640 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:16.698638 31575 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:16.701401 31641 raft_consensus.cc:2749] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:16.734650 29523 raft_consensus.cc:1275] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:16.732712 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:16.733500 29448 raft_consensus.cc:1240] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:12:16.734042 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:16.730906 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:16.738075 29455 raft_consensus.cc:1240] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:16.740471 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:16.741420 29526 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:16.713310 31660 consensus_queue.cc:1059] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:12:16.711004 31642 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:16.748565 29528 raft_consensus.cc:1240] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:16.638263 31588 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:16.707615 31678 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:16.760474 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:16.763082 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:16.795220 29452 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
I20260709 13:12:16.767427 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:16.631352 31695 consensus_queue.cc:1048] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.100s
I20260709 13:12:16.767271 29448 raft_consensus.cc:1240] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 6 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:12:16.771759 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:16.773267 29455 raft_consensus.cc:1240] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
W20260709 13:12:16.776435 31693 log.cc:927] Time spent T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:12:16.827479 31624 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:16.832472 31657 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:16.778784 31692 log.cc:927] Time spent T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:12:16.710610 31618 consensus_queue.cc:1059] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:12:16.779466 31579 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:16.837672 31618 raft_consensus.cc:3055] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:16.838239 31618 raft_consensus.cc:740] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
W20260709 13:12:16.784029 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 284688us
I20260709 13:12:16.788682 31670 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:16.726634 31675 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:16.792352 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:16.804167 29454 raft_consensus.cc:1275] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:12:16.809299 31633 consensus_meta.cc:287] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.753s	user 0.004s	sys 0.008s
I20260709 13:12:16.812431 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:16.857779 29456 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:12:16.813745 29449 raft_consensus.cc:1240] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:16.814658 31564 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:16.816115 29447 raft_consensus.cc:1240] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:12:16.816762 31480 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:16.767709 31636 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.768002 31677 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:16.873222 29529 raft_consensus.cc:3060] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:16.793506 31678 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:16.767854 31661 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:16.739413 31640 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:16.923244 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:16.924314 29373 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:16.933439 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:16.931375 29529 raft_consensus.cc:1275] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:12:16.885630 29454 raft_consensus.cc:1240] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:16.862068 31572 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.788785 31458 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:16.800658 31641 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
W20260709 13:12:16.902016 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.902940 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:12:16.895684 31672 consensus_meta.cc:287] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.612s	user 0.013s	sys 0.000s
I20260709 13:12:16.915112 29380 raft_consensus.cc:1275] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:12:16.916985 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:16.981746 29378 raft_consensus.cc:2393] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 5: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:16.956715 31579 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:12:16.925685 31671 consensus_meta.cc:287] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.809s	user 0.012s	sys 0.000s
I20260709 13:12:16.918978 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:16.939388 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:16.988093 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:16.988628 29379 raft_consensus.cc:2393] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 5: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:16.879717 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:16.961885 29453 raft_consensus.cc:1275] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:16.983659 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:16.917516 29447 raft_consensus.cc:1275] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:12:16.986472 29373 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
I20260709 13:12:16.987751 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:16.924168 31678 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:16.998382 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:17.000980 29375 raft_consensus.cc:2393] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 5: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:16.839349 31618 consensus_queue.cc:260] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:17.021600 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:17.009927 29376 raft_consensus.cc:1275] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:12:17.009197 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:17.063804 29379 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:17.056996 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:17.058620 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:17.064640 29377 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 7.
I20260709 13:12:17.058854 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:16.909346 31636 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:17.065891 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:17.066370 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:17.060962 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:16.956058 31698 consensus_queue.cc:1048] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.144s
I20260709 13:12:17.073904 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:17.076399 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:17.067930 29523 raft_consensus.cc:2376] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 7. Re-sending same reply.
I20260709 13:12:17.078035 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:17.079239 29377 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 8.
I20260709 13:12:17.081239 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:17.081635 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:16.947559 31677 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:17.082264 29375 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
I20260709 13:12:17.082978 29528 raft_consensus.cc:2368] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 6. Current term is 7.
I20260709 13:12:17.060221 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:16.909936 31564 consensus_queue.cc:1059] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.086s
I20260709 13:12:17.064930 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:17.060288 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:17.069466 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:17.070979 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:17.071871 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:17.072350 29524 raft_consensus.cc:2393] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 6: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:17.089296 29523 raft_consensus.cc:2393] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 6: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:17.090036 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:17.091346 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:16.971125 31572 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:16.984452 31641 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:17.103849 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:17.105465 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:17.094406 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:16.998526 31579 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:17.102896 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:17.109443 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:17.109905 29524 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:17.109789 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:17.098308 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:16.970907 31661 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:17.061196 31571 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:17.101954 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:17.134801 29521 raft_consensus.cc:2393] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 6: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:17.135150 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:17.135560 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:17.124810 29377 raft_consensus.cc:1275] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:12:17.111258 29528 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
I20260709 13:12:16.984719 31672 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:17.078023 31642 raft_consensus.cc:697] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:17.001626 31671 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:17.110803 29375 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
I20260709 13:12:17.089349 31699 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:17.137883 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:17.158056 29529 raft_consensus.cc:2393] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 6: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:17.099195 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:17.138442 29421 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:17.139176 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:17.161449 30853 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:17.162137 30853 raft_consensus.cc:697] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 6 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:17.124097 29527 raft_consensus.cc:1275] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:12:17.167199 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:17.163535 29421 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:17.101040 31618 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:17.171841 29527 raft_consensus.cc:1275] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:17.168408 29526 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:12:17.153793 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:17.173023 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:17.173741 29529 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
I20260709 13:12:17.174376 29526 raft_consensus.cc:1275] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:12:17.175168 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:17.176729 29528 raft_consensus.cc:2393] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 6: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:17.177187 29372 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 4.
I20260709 13:12:17.179088 29421 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:17.137730 31633 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.192611 29421 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:17.204828 31682 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:17.205461 31682 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.205852 31682 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:17.206179 31634 ts_tablet_manager.cc:1916] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:17.206990 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:17.176468 31699 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:17.208438 29377 raft_consensus.cc:1275] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:17.208348 31642 consensus_queue.cc:237] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:17.194841 30853 consensus_queue.cc:237] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:17.213769 29524 raft_consensus.cc:2410] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:12:17.123230 31251 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.221561 29378 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:12:17.225646 29378 raft_consensus.cc:606] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:12:17.226042 29378 raft_consensus.cc:614] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:17.222957 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:17.247443 29344 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:17.251595 29344 leader_election.cc:304] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:17.184042 31697 consensus_queue.cc:1048] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:12:17.261351 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:17.265646 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:17.267589 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 170682us
I20260709 13:12:17.188865 31577 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.273939 29524 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 4.
I20260709 13:12:17.281365 31695 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:17.282228 31695 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:17.285279 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:17.286088 29527 raft_consensus.cc:2393] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 4: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:17.194093 31564 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:17.201485 31658 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.295950 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:17.171387 31607 consensus_queue.cc:1048] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.088s
I20260709 13:12:17.167935 31630 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:17.301702 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:17.305646 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 113213us
I20260709 13:12:17.166839 31571 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:17.171778 31696 consensus_queue.cc:1048] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 13:12:17.309442 29530 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 7.
I20260709 13:12:17.261235 31698 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:17.314484 29524 raft_consensus.cc:1275] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:12:17.295245 31679 log.cc:927] Time spent T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:12:17.286670 31636 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:17.316584 31458 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.338781 31670 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:17.355122 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:17.370990 29380 raft_consensus.cc:2368] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 6. Current term is 7.
I20260709 13:12:17.355585 31698 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.307134 31658 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:17.355751 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 104267us
I20260709 13:12:17.291709 31577 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:17.291829 31564 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.366427 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:17.383004 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:17.220234 31633 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:17.370159 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:17.378250 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:17.371956 29528 raft_consensus.cc:2410] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:12:17.384989 29450 raft_consensus.cc:2393] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 3: Already voted for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in this term.
I20260709 13:12:17.385154 29530 raft_consensus.cc:2410] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:12:17.264793 31251 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:17.378309 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:17.298856 31699 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:17.396479 29521 raft_consensus.cc:1240] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 3. Current term is 4. Ops: []
W20260709 13:12:17.386361 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 94834.1us
W20260709 13:12:17.396915 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 175344us
I20260709 13:12:17.391136 31588 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:17.391317 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:17.391547 31671 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:17.392586 31572 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:17.392778 31677 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:17.393028 31627 consensus_meta.cc:287] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.758s	user 0.013s	sys 0.000s
I20260709 13:12:17.394729 31630 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:17.458532 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 77051.1us
I20260709 13:12:17.375248 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:17.397711 29346 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:17.357465 31690 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.405520 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:17.459463 29529 raft_consensus.cc:2393] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 6: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:17.447537 29376 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
I20260709 13:12:17.373852 31698 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:17.388875 31564 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:17.456768 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:17.456909 30986 raft_consensus.cc:2749] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:17.397431 31702 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:17.396029 31712 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:17.466917 31627 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:17.468070 31577 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:17.468380 31703 log.cc:927] Time spent T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 13:12:17.382778 31670 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:17.465919 31690 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:17.377650 31458 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:17.485584 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 87946.5us
I20260709 13:12:17.502748 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:17.527314 29344 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:17.577178 29379 consensus_meta.cc:287] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.504s	user 0.016s	sys 0.000s
I20260709 13:12:17.580365 29379 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 4.
I20260709 13:12:17.582508 29447 raft_consensus.cc:2393] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 5: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:17.513978 31641 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:17.592185 31251 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:17.592561 31458 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:17.503851 31630 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:17.593386 31630 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.593806 31630 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:17.596714 31720 log.cc:927] Time spent T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:12:17.597939 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:17.598783 29447 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:17.576769 31722 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.599705 31722 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:17.602237 31722 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:17.603040 31630 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:17.605247 31630 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:17.568101 31572 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
W20260709 13:12:17.630398 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 103230us
I20260709 13:12:17.631527 29344 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:17.524937 31646 consensus_meta.cc:287] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 1.009s	user 0.012s	sys 0.002s
I20260709 13:12:17.629989 29447 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:17.628679 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:17.640255 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:17.638022 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:17.645556 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:17.471529 31658 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:17.474252 31579 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:17.646623 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:17.606570 31572 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:17.610303 31571 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:17.478178 31574 consensus_queue.cc:1048] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.167s
I20260709 13:12:17.495172 31561 consensus_queue.cc:1048] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.148s
I20260709 13:12:17.652338 29447 raft_consensus.cc:1275] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:17.638029 30986 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:17.622349 31577 consensus_queue.cc:1059] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:12:17.662930 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:17.648625 31672 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:17.665643 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 82056.7us
I20260709 13:12:17.665902 29521 raft_consensus.cc:2393] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 2: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:17.673390 31670 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:17.673777 31661 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:17.503571 31713 consensus_queue.cc:1048] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.146s
I20260709 13:12:17.677304 29379 raft_consensus.cc:1240] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:17.677641 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:17.590759 31712 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:17.688982 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:17.708361 29378 raft_consensus.cc:2368] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9.
W20260709 13:12:17.708958 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:17.709280 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:17.709559 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:17.710125 29378 raft_consensus.cc:2393] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 8: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:17.692899 31571 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:17.716037 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:17.716198 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:17.694052 31627 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:17.694433 31572 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:17.694281 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:17.695437 31631 consensus_meta.cc:287] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 1.031s	user 0.015s	sys 0.000s
I20260709 13:12:17.696233 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:17.697762 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:17.734499 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:17.734745 29373 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
I20260709 13:12:17.646306 31646 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:17.706779 29453 raft_consensus.cc:1275] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 3. (index mismatch)
I20260709 13:12:17.660799 30986 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.682857 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:17.710654 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:17.711663 30853 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:17.739400 30853 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:17.717429 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:17.719214 31695 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:17.719676 31633 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:12:17.721467 31575 consensus_meta.cc:287] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.976s	user 0.014s	sys 0.000s
I20260709 13:12:17.722293 31697 consensus_queue.cc:1048] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:17.722579 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:17.758292 31690 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:17.729341 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:17.730322 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:17.760533 29521 raft_consensus.cc:2393] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 7: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:12:17.763751 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 59845.4us
I20260709 13:12:17.764854 29344 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:17.765985 29344 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:12:17.766566 29344 raft_consensus.cc:2686] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:12:17.735925 29373 raft_consensus.cc:1240] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:17.680346 31711 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:17.768560 31711 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.768985 31711 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:17.769164 31568 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:17.769763 31568 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.770176 31568 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:17.771771 31712 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:17.774542 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:17.733146 31571 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:17.776909 31638 raft_consensus.cc:3055] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:17.743506 29378 raft_consensus.cc:2376] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5. Re-sending same reply.
I20260709 13:12:17.777482 31638 raft_consensus.cc:740] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:17.757408 31564 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:17.767714 31555 consensus_queue.cc:1048] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:17.717893 29421 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:12:17.790786 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 79062.8us
I20260709 13:12:17.748687 30986 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:17.812089 30853 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:17.813042 29452 raft_consensus.cc:1275] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:12:17.814524 31678 consensus_meta.cc:287] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.789s	user 0.014s	sys 0.000s
I20260709 13:12:17.815604 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:17.817478 31711 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:17.819872 29381 raft_consensus.cc:2393] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 7: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:17.778623 31638 consensus_queue.cc:260] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:17.825250 29372 raft_consensus.cc:1240] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:18.359308 29276 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35182 (request call id 57) took 4305 ms. Trace:
I20260709 13:12:18.284994 31639 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.365799 31639 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:18.315138 31702 raft_consensus.cc:3055] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:18.365029 29276 rpcz_store.cc:276] 0709 13:12:14.054057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.054312 (+   255us) service_pool.cc:224] Handling call
0709 13:12:14.184308 (+129996us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b5400422054. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcf0090 00007f6a7bd8ef3a 00007f6a81b451cc 00007f6a81c4337e 00007f6a801042a4 00007f6a80104232 00007f6a80104161 00007f6a801040dc 00007f6a80103392 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:18.359193 (+4174885us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:16.711373 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:16.751003 (+ 39630us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:16.751053 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:12:16.751077 (+    24us) tablet.cc:662] Decoding operations
0709 13:12:16.835643 (+ 84566us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:16.835708 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:16.835737 (+    29us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:12:16.836045 (+   308us) tablet.cc:701] Row locks acquired
0709 13:12:16.836064 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:12:16.836270 (+   206us) write_op.cc:270] Start()
0709 13:12:16.836446 (+   176us) write_op.cc:276] Timestamp: P: 1783602736836209 usec, L: 0
0709 13:12:16.836473 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:12:16.837630 (+  1157us) log.cc:844] Serialized 988 byte log entry
0709 13:12:17.364416 (+526786us) op_driver.cc:464] REPLICATION: finished
0709 13:12:17.759761 (+395345us) write_op.cc:301] APPLY: starting
0709 13:12:17.760007 (+   246us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:17.760243 (+   236us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:17.760622 (+   379us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:17.761207 (+   585us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:17.761512 (+   305us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:12:17.761659 (+   147us) write_op.cc:312] APPLY: finished
0709 13:12:17.761974 (+   315us) log.cc:844] Serialized 28 byte log entry
0709 13:12:17.762176 (+   202us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:17.762271 (+    95us) write_op.cc:454] Released schema lock
0709 13:12:17.762313 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:17.762708 (+   395us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:17.762750 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":678269,"reported_tablets":2,"spinlock_wait_cycles":60436736,"child_traces":[["op",{"apply.queue_time_us":389331,"apply.run_cpu_time_us":2984,"apply.run_wall_time_us":2983,"num_ops":2,"prepare.queue_time_us":175352,"prepare.run_cpu_time_us":4430,"prepare.run_wall_time_us":142091,"replication_time_us":471280,"spinlock_wait_cycles":3328,"thread_start_us":287472,"threads_started":2}]]}
I20260709 13:12:18.368582 31702 raft_consensus.cc:740] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:18.369544 31571 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:17.986917 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:17.744349 31631 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:18.372187 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:18.373376 31572 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:18.373960 31572 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:18.374696 31631 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:17.865061 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 55148.8us
I20260709 13:12:17.987617 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:18.376143 31572 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:18.376487 29421 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:18.377297 29530 raft_consensus.cc:2410] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:12:18.376628 31697 consensus_queue.cc:1048] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:18.377924 29421 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:18.377753 31572 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:12:18.066009 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:18.380908 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:17.889281 29448 raft_consensus.cc:2393] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 8: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:18.126899 29524 raft_consensus.cc:1240] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:18.384614 29524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 1988) took 1004 ms. Trace:
I20260709 13:12:18.379230 31697 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:18.430531 29454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45798 (request call id 1669) took 1258 ms. Trace:
I20260709 13:12:18.431077 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:18.403919 29452 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.018s	sys 0.027s
W20260709 13:12:18.435650 29452 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.019s	sys 0.027s
I20260709 13:12:18.438639 29381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52172 (request call id 1160) took 1505 ms. Trace:
I20260709 13:12:18.439347 29381 rpcz_store.cc:276] 0709 13:12:16.932849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:16.933030 (+   181us) service_pool.cc:224] Handling call
0709 13:12:18.438310 (+1505280us) spinlock_profiling.cc:243] Waited 885 ms on lock 0x7b54003dd454. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:18.438544 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2035802880}
W20260709 13:12:17.818588 31682 consensus_meta.cc:287] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.612s	user 0.010s	sys 0.005s
I20260709 13:12:18.434096 29454 rpcz_store.cc:276] 0709 13:12:17.172442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:17.175567 (+  3125us) service_pool.cc:224] Handling call
0709 13:12:17.815458 (+639891us) spinlock_profiling.cc:243] Waited 6.04 ms on lock 0x7b5800193598. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61b71 00007f6a78c61eee 0000000000375939 00007f6a80cd51e0 00007f6a80d9e0c4 00007f6a80d9e131 00007f6a80d4c0a0 00007f6a80d4b984 00007f6a7a2c66d4 00007f6a7a2c6662
0709 13:12:18.430430 (+614972us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13900032}
I20260709 13:12:18.443602 29529 raft_consensus.cc:3055] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:18.444585 29448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45798 (request call id 1671) took 1266 ms. Trace:
I20260709 13:12:18.444746 29530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 1991) took 1063 ms. Trace:
I20260709 13:12:17.804925 31575 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:18.174829 31618 consensus_meta.cc:287] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.988s	user 0.015s	sys 0.000s
I20260709 13:12:18.447290 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:18.448235 29419 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 2.112s (SENT) [suppressed 29 similar messages]
I20260709 13:12:18.452378 29523 raft_consensus.cc:3055] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:18.453451 29529 raft_consensus.cc:740] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:17.900368 31640 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:18.458845 29377 raft_consensus.cc:1240] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:12:18.384995 29524 rpcz_store.cc:276] 0709 13:12:17.380609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.126124 (+745515us) service_pool.cc:224] Handling call
0709 13:12:18.126618 (+   494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:18.384305 (+257687us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:18.384546 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:18.450054 29448 rpcz_store.cc:276] 0709 13:12:17.178438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:17.178589 (+   151us) service_pool.cc:224] Handling call
0709 13:12:17.774374 (+595785us) spinlock_profiling.cc:243] Waited 5.71 ms on lock 0x7b5800193598. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61b71 00007f6a78c61eee 0000000000375939 00007f6a80cd51e0 00007f6a80d9e0c4 00007f6a80d9e131 00007f6a80d4c0a0 00007f6a80d4b984 00007f6a7a2c66d4 00007f6a7a2c6662
0709 13:12:18.444374 (+670000us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54002909d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:18.444520 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":274345600}
I20260709 13:12:17.818758 31722 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:18.451475 29530 rpcz_store.cc:276] 0709 13:12:17.381421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.443826 (+1062405us) service_pool.cc:224] Handling call
0709 13:12:18.444113 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:18.444338 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:18.444381 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:18.444442 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:18.444488 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:18.444577 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:18.444688 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:12:18.487946 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 720375us
I20260709 13:12:18.504812 29529 consensus_queue.cc:260] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:18.507978 29522 raft_consensus.cc:2410] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:12:18.508340 31251 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.511243 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:18.524791 29376 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
W20260709 13:12:18.513554 31568 consensus_meta.cc:287] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.743s	user 0.014s	sys 0.000s
I20260709 13:12:18.515677 29374 raft_consensus.cc:2368] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 6. Current term is 7.
W20260709 13:12:18.512863 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 64593.7us
I20260709 13:12:18.518880 31660 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.502712 29523 raft_consensus.cc:740] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:18.536695 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:18.537566 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:18.538677 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:18.157873 31695 raft_consensus.cc:493] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:18.541039 29521 raft_consensus.cc:1240] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:18.521131 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:18.158061 31584 raft_consensus.cc:3055] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:18.529409 29277 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37608 (request call id 151) took 6080 ms. Trace:
I20260709 13:12:18.530906 29529 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:18.544978 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:18.551172 29448 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:12:18.552477 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:18.448796 31572 raft_consensus.cc:697] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 4 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
W20260709 13:12:18.520983 29447 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.031s	sys 0.056s
W20260709 13:12:18.554221 29447 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.031s	sys 0.057s
W20260709 13:12:18.554854 29374 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52172 (request call id 1172) took 1550 ms (client timeout 1611 ms). Trace:
I20260709 13:12:18.539681 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:18.539938 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:18.246243 31707 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
W20260709 13:12:18.540601 29421 leader_election.cc:336] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.611s (SENT)
I20260709 13:12:18.522217 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:17.926808 31698 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:18.559993 29421 leader_election.cc:336] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.659s (SENT)
I20260709 13:12:18.562532 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:18.566052 29522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37958 (request call id 1086) took 1334 ms. Trace:
I20260709 13:12:18.520485 31638 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:18.156042 31633 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:18.603636 29451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1686) took 1325 ms. Trace:
I20260709 13:12:18.606019 29376 raft_consensus.cc:1275] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:12:18.525327 31640 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:18.443248 31697 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:18.519375 31575 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:18.546768 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:18.523250 29344 leader_election.cc:304] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:12:18.555361 29374 rpcz_store.cc:269] 0709 13:12:17.004898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:17.005909 (+  1011us) service_pool.cc:224] Handling call
0709 13:12:18.554637 (+1548728us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54001d3654. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:18.554793 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3272429824}
I20260709 13:12:18.556929 29454 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:12:18.557565 29528 raft_consensus.cc:2393] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 6: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:18.558856 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:18.618345 29449 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:18.618599 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:18.547668 29277 rpcz_store.cc:276] 0709 13:12:12.448773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:12.454398 (+  5625us) service_pool.cc:224] Handling call
0709 13:12:18.529310 (+6074912us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:14.726031 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:14.726679 (+   648us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:14.726709 (+    30us) write_op.cc:435] Acquired schema lock
0709 13:12:14.726733 (+    24us) tablet.cc:662] Decoding operations
0709 13:12:14.868863 (+142130us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:14.868947 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:14.868983 (+    36us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:12:14.870275 (+  1292us) tablet.cc:701] Row locks acquired
0709 13:12:14.870298 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:12:14.870472 (+   174us) write_op.cc:270] Start()
0709 13:12:14.870626 (+   154us) write_op.cc:276] Timestamp: P: 1783602734870416 usec, L: 0
0709 13:12:14.870661 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:12:14.881754 (+ 11093us) log.cc:844] Serialized 5623 byte log entry
0709 13:12:15.503348 (+621594us) op_driver.cc:464] REPLICATION: finished
0709 13:12:15.746107 (+242759us) write_op.cc:301] APPLY: starting
0709 13:12:15.751112 (+  5005us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:15.812910 (+ 61798us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:15.826607 (+ 13697us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:15.940933 (+114326us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:15.941247 (+   314us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:12:15.941304 (+    57us) write_op.cc:312] APPLY: finished
0709 13:12:15.941689 (+   385us) log.cc:844] Serialized 100 byte log entry
0709 13:12:15.942618 (+   929us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:15.942799 (+   181us) write_op.cc:454] Released schema lock
0709 13:12:15.942857 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:15.943317 (+   460us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:15.943346 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":407849,"reported_tablets":43,"spinlock_wait_cycles":262400,"child_traces":[["op",{"apply.queue_time_us":136362,"apply.run_cpu_time_us":5725,"apply.run_wall_time_us":236081,"num_ops":14,"prepare.queue_time_us":203003,"prepare.run_cpu_time_us":6500,"prepare.run_wall_time_us":175088,"replication_time_us":607740,"thread_start_us":136477,"threads_started":2}]]}
I20260709 13:12:18.541785 29521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 1990) took 1160 ms. Trace:
I20260709 13:12:18.433290 31678 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:18.543571 29523 consensus_queue.cc:260] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:18.620441 29523 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:18.521433 31722 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:18.524282 31706 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.454885 31682 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:18.609109 29451 rpcz_store.cc:276] 0709 13:12:17.278728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:17.956425 (+677697us) service_pool.cc:224] Handling call
0709 13:12:17.957037 (+   612us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:17.957630 (+   593us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:17.957657 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:17.958434 (+   777us) log.cc:844] Serialized 52 byte log entry
0709 13:12:18.437123 (+478689us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:18.437167 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:18.437242 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:18.603342 (+166100us) raft_consensus.cc:1685] finished
0709 13:12:18.603361 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:18.603562 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":138,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":110,"thread_start_us":312281,"threads_started":1,"wal-append.queue_time_us":585063}
I20260709 13:12:18.627311 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:18.619320 29521 rpcz_store.cc:276] 0709 13:12:17.381167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.446713 (+1065546us) service_pool.cc:224] Handling call
0709 13:12:18.520328 (+ 73615us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:18.541525 (+ 21197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:18.541725 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":896768}
I20260709 13:12:18.559633 31646 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:18.610512 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:18.656499 29381 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
W20260709 13:12:18.657696 29419 leader_election.cc:336] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.545s (SENT)
I20260709 13:12:18.658179 29419 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:18.566426 29522 rpcz_store.cc:276] 0709 13:12:17.222014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:17.222615 (+   601us) service_pool.cc:224] Handling call
0709 13:12:18.548338 (+1325723us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54000a3054. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:18.556104 (+  7766us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2945376128}
I20260709 13:12:18.569962 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:18.542677 31744 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.663142 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:18.541875 29524 raft_consensus.cc:2393] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 6: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:18.542446 31251 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:18.621048 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:18.670401 29528 raft_consensus.cc:2410] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:12:18.670387 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:18.621431 29454 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:18.547396 31584 raft_consensus.cc:740] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:18.616104 29421 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:18.559326 31742 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:18.575024 29529 raft_consensus.cc:1275] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:12:18.519832 31656 consensus_queue.cc:1059] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.094s
I20260709 13:12:18.650511 31691 raft_consensus.cc:2749] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:18.659437 29530 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
I20260709 13:12:18.661950 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:18.601440 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
W20260709 13:12:18.620792 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 97639.8us
W20260709 13:12:18.667057 29419 leader_election.cc:336] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.881s (SENT)
I20260709 13:12:18.667395 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:18.693285 29454 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:12:18.693871 30853 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.668475 29522 raft_consensus.cc:2393] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 8: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:18.694309 30853 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:18.695084 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:18.694312 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:18.614976 31697 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:18.547811 31660 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:18.673544 29527 raft_consensus.cc:2393] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 7: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:18.676105 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:18.700743 29528 raft_consensus.cc:2393] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 6: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:18.701413 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:18.612902 31564 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:18.677076 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:18.695895 29524 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:12:18.702430 29374 raft_consensus.cc:2393] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 8: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:18.652261 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:18.703797 29527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37958 (request call id 1090) took 1409 ms. Trace:
W20260709 13:12:18.679841 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 64015.2us
I20260709 13:12:18.706044 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:18.680748 29529 pending_rounds.cc:85] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 3
I20260709 13:12:18.554396 31695 raft_consensus.cc:515] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:18.674549 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:18.707350 29529 pending_rounds.cc:107] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:12:18.707790 29521 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:12:18.707912 29529 raft_consensus.cc:2889] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:18.709360 29521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53428 (request call id 232) took 1049 ms. Trace:
I20260709 13:12:18.652983 31722 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:18.568182 31707 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:18.717988 31564 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.718616 31564 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:18.687952 31742 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:18.721547 31564 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:18.704838 31584 consensus_queue.cc:260] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:18.727716 31646 consensus_queue.cc:1059] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:18.729007 31698 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:18.729758 29447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1680) took 1508 ms. Trace:
I20260709 13:12:18.729614 31646 consensus_queue.cc:1059] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:18.730216 29447 rpcz_store.cc:276] 0709 13:12:17.221721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:17.718127 (+496406us) service_pool.cc:224] Handling call
0709 13:12:17.733444 (+ 15317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:17.735357 (+  1913us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:17.735393 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:17.791807 (+ 56414us) log.cc:844] Serialized 26 byte log entry
0709 13:12:18.554677 (+762870us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:18.554729 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:18.554802 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:18.729499 (+174697us) raft_consensus.cc:1685] finished
0709 13:12:18.729529 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:18.729685 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":119,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":6952,"thread_start_us":664366,"threads_started":1,"wal-append.queue_time_us":861778}
I20260709 13:12:18.731695 31710 raft_consensus.cc:3055] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:18.732111 31710 raft_consensus.cc:740] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:18.732437 29456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1688) took 1453 ms. Trace:
I20260709 13:12:18.703133 29451 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
W20260709 13:12:18.677412 30986 consensus_meta.cc:287] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.864s	user 0.012s	sys 0.001s
I20260709 13:12:18.743780 29523 raft_consensus.cc:1275] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 3. (term mismatch)
I20260709 13:12:18.755900 29523 pending_rounds.cc:85] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 2
I20260709 13:12:18.698210 29373 raft_consensus.cc:1240] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:18.668785 31571 raft_consensus.cc:2749] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:18.546373 31568 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:18.764807 31575 raft_consensus.cc:3055] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:18.560806 31618 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:18.706221 29421 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:18.704217 29527 rpcz_store.cc:276] 0709 13:12:17.294801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:17.295676 (+   875us) service_pool.cc:224] Handling call
0709 13:12:18.703573 (+1407897us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54000a3a54. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:18.703716 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3166100352}
I20260709 13:12:18.710701 29521 rpcz_store.cc:276] 0709 13:12:17.660504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.708462 (+1047958us) service_pool.cc:224] Handling call
0709 13:12:18.708825 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:18.709015 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:18.709049 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:18.709097 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:18.709125 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:18.709180 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:18.709298 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:18.675544 31746 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:18.622641 31640 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:18.687177 31501 raft_consensus.cc:2804] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:18.615875 31633 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:18.672708 31572 consensus_queue.cc:237] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:18.695813 29522 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:12:18.732859 29456 rpcz_store.cc:276] 0709 13:12:17.279442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.079780 (+800338us) service_pool.cc:224] Handling call
0709 13:12:18.080311 (+   531us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:18.374335 (+294024us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:12:18.374382 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:18.375028 (+   646us) log.cc:844] Serialized 26 byte log entry
0709 13:12:18.612670 (+237642us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:18.612716 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:18.612788 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:18.732208 (+119420us) raft_consensus.cc:1685] finished
0709 13:12:18.732232 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:18.732372 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":293448,"raft.queue_time_us":294808,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":112,"thread_start_us":237180,"threads_started":1,"wal-append.queue_time_us":354561}
I20260709 13:12:18.751153 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:18.697485 29419 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:18.757977 29523 pending_rounds.cc:107] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 7.3
I20260709 13:12:18.660820 31706 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:18.560003 31702 consensus_queue.cc:260] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:18.727219 31634 ts_tablet_manager.cc:1929] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:12:18.716128 29529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 1101) took 1305 ms. Trace:
I20260709 13:12:18.673111 31744 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:18.765388 31568 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:18.977669 29523 raft_consensus.cc:2889] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:18.971251 31691 raft_consensus.cc:3055] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:18.809764 30853 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:18.978386 31691 raft_consensus.cc:740] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:18.949584 31695 leader_election.cc:290] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:18.979903 31691 consensus_queue.cc:260] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:18.981312 31691 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:18.959012 31251 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:18.957863 31707 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:18.978780 29523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 1992) took 1546 ms. Trace:
W20260709 13:12:18.981746 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:18.984820 29523 rpcz_store.cc:276] 0709 13:12:17.432521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.445359 (+1012838us) service_pool.cc:224] Handling call
0709 13:12:18.445739 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:18.978466 (+532727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:18.978713 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:18.986534 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:18.988718 29523 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:18.990446 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:18.992652 29523 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 7.
I20260709 13:12:18.994320 31706 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:18.994750 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:18.995623 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:18.995893 31744 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:18.996958 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:18.997668 31660 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:18.765309 31575 raft_consensus.cc:740] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:19.000844 31575 consensus_queue.cc:260] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:19.002274 31575 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:19.004179 29529 rpcz_store.cc:276] 0709 13:12:17.410400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.442879 (+1032479us) service_pool.cc:224] Handling call
0709 13:12:18.443378 (+   499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:18.715845 (+272467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:18.716066 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:19.005589 31697 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:19.007233 29346 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:18.721616 31742 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:18.995950 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:19.039145 29523 raft_consensus.cc:2393] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 6: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:18.723726 31584 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:19.030460 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:18.911990 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:19.012246 30853 raft_consensus.cc:2749] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:12:19.012872 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 345856us
I20260709 13:12:19.007397 31634 log.cc:1199] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5: Deleting WAL directory at /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/ts-0-root/wals/b5c4a6169e564566927a70e27f4af6f6
W20260709 13:12:19.044452 29419 leader_election.cc:336] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.917s (SENT)
I20260709 13:12:19.044915 29419 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:19.028877 31571 raft_consensus.cc:2804] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:19.046319 31571 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.046659 31571 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:18.843322 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:19.013818 29530 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 7.
I20260709 13:12:19.051005 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:19.051913 29530 raft_consensus.cc:2410] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:12:19.052767 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:19.053285 29530 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:18.905048 31698 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:19.053988 31698 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:18.991668 31501 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.055768 31501 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:19.055938 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:19.057243 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:19.057783 29523 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:19.058960 31698 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:12:19.061136 29493 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.005s	sys 0.050s
W20260709 13:12:19.020874 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 314732us
I20260709 13:12:18.850847 29526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53428 (request call id 229) took 1198 ms. Trace:
I20260709 13:12:19.020578 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:19.022892 29522 raft_consensus.cc:2468] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
I20260709 13:12:19.016287 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:19.028069 29449 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:18.765879 29372 raft_consensus.cc:1240] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:12:18.963408 29278 catalog_manager.cc:5697] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 1 to 3, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132). New cstate: current_term: 3 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:19.030524 29346 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:19.010973 31633 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:12:18.891284 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:18.810359 31639 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:19.042878 29527 raft_consensus.cc:2468] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
I20260709 13:12:19.208539 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:19.209167 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:18.765393 31682 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:18.762038 30986 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:19.231285 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.165386 29450 raft_consensus.cc:2393] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 5: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:18.734882 31579 consensus_queue.cc:1059] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.329s
I20260709 13:12:19.031392 31618 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:19.300068 29452 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.856s	user 0.014s	sys 0.017s
W20260709 13:12:19.300588 29452 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.015s	sys 0.017s
I20260709 13:12:19.301637 29452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1684) took 2024 ms. Trace:
I20260709 13:12:19.164961 31698 raft_consensus.cc:2749] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:12:19.201472 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 171037us
I20260709 13:12:19.323304 29346 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:19.203934 29529 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:19.243105 31634 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52164 (request call id 64) took 4769 ms. Trace:
I20260709 13:12:19.329468 29528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53428 (request call id 231) took 1675 ms. Trace:
I20260709 13:12:19.330231 29528 rpcz_store.cc:276] 0709 13:12:17.653771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.705175 (+1051404us) service_pool.cc:224] Handling call
0709 13:12:18.705458 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:19.165953 (+460495us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:19.166001 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:19.166063 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:19.166116 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.329129 (+163013us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b54001013d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:19.329194 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:19.329387 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":841599232}
I20260709 13:12:19.332229 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:19.209271 29456 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:18.761510 31711 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:19.217840 29523 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:19.335068 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:19.219614 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:19.335721 29456 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:19.220373 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:12:19.163934 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.330370 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:19.072362 31702 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:19.337718 29450 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:19.136507 29453 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.015s	sys 0.004s
I20260709 13:12:19.246898 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:19.201618 31660 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:19.259512 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:18.732980 31710 consensus_queue.cc:260] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:19.278926 31722 consensus_meta.cc:287] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.517s	user 0.005s	sys 0.003s
I20260709 13:12:19.284088 31579 raft_consensus.cc:3055] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:19.220358 31251 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:12:19.309180 29525 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.802s	user 0.011s	sys 0.042s
W20260709 13:12:19.352380 29525 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.011s	sys 0.042s
I20260709 13:12:19.203605 29526 rpcz_store.cc:276] 0709 13:12:17.652178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.450735 (+798557us) service_pool.cc:224] Handling call
0709 13:12:18.451078 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:18.768014 (+316936us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:18.768050 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:18.768100 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:18.768310 (+   210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:18.850449 (+ 82139us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b54001027d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:18.850535 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:18.850752 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":728366976}
I20260709 13:12:19.200475 29521 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:19.236758 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:19.318881 29455 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.830s	user 0.010s	sys 0.016s
W20260709 13:12:19.354805 29455 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.900s	user 0.010s	sys 0.016s
I20260709 13:12:19.029981 31746 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:19.319774 29380 raft_consensus.cc:1240] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:12:19.355084 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:19.236678 31713 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.369001 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:19.370268 29526 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:19.372469 31711 raft_consensus.cc:2804] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:19.350960 31660 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:19.383841 31713 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:19.384631 31660 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:19.351971 31579 raft_consensus.cc:740] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:19.386261 31713 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:19.386157 31579 consensus_queue.cc:260] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:19.352550 31722 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:19.346549 31639 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:19.387475 31579 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:19.376150 31697 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:19.377216 29456 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:19.387742 31711 raft_consensus.cc:697] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:19.414304 31711 consensus_queue.cc:237] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:19.392699 30986 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:19.396538 31640 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:19.398389 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:19.398773 31746 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:19.400794 31618 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:19.334725 31634 rpcz_store.cc:276] 0709 13:12:14.479683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.479883 (+   200us) service_pool.cc:224] Handling call
0709 13:12:15.090425 (+610542us) ts_tablet_manager.cc:1151] Deleting tablet b5c4a6169e564566927a70e27f4af6f6
0709 13:12:15.112954 (+ 22529us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:12:17.924953 (+2811999us) tablet_metadata.cc:665] Metadata flushed
0709 13:12:18.726894 (+801941us) tablet_metadata.cc:665] Metadata flushed
0709 13:12:19.242946 (+516052us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":787928,"tablet-delete.queue_time_us":452905,"thread_start_us":296516,"threads_started":1}
I20260709 13:12:19.401170 31639 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:19.401511 29448 raft_consensus.cc:2393] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 7: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
W20260709 13:12:19.422709 31638 consensus_meta.cc:287] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.805s	user 0.009s	sys 0.005s
I20260709 13:12:19.422851 31639 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:19.427024 31552 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.427639 31552 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:19.430589 31552 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:19.402918 31722 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:19.205152 29493 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.006s	sys 0.051s
I20260709 13:12:19.373785 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:19.434657 29526 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:19.223316 31678 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:19.435938 31678 raft_consensus.cc:493] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:19.436568 31678 raft_consensus.cc:515] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:19.437433 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:19.439389 31678 leader_election.cc:290] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:12:19.339644 29453 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.358s	user 0.016s	sys 0.005s
I20260709 13:12:19.344316 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:19.443207 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:19.349629 29529 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:12:19.440045 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:19.444613 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:19.445650 29529 raft_consensus.cc:2410] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:12:19.446265 31501 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:19.344663 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:19.446691 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:19.447271 29523 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:12:19.447450 29526 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:19.449494 29530 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 8.
I20260709 13:12:19.450867 29530 raft_consensus.cc:1275] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:12:19.350580 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:19.366854 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.395457 31710 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:19.451893 29527 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:19.461818 29453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1683) took 2184 ms. Trace:
I20260709 13:12:19.355820 29449 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:19.462888 29454 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.033s	sys 0.039s
I20260709 13:12:19.302139 29452 rpcz_store.cc:276] 0709 13:12:17.277540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:17.813879 (+536339us) service_pool.cc:224] Handling call
0709 13:12:17.814189 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:17.814421 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:12:18.436320 (+621899us) log.cc:844] Serialized 14 byte log entry
0709 13:12:19.301181 (+864861us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:19.301253 (+    72us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:19.301318 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.301407 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:19.301568 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":553808,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"thread_start_us":1485765,"threads_started":2}
I20260709 13:12:19.443430 29522 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:19.459273 29521 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
W20260709 13:12:19.457298 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.446609 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:19.439998 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
W20260709 13:12:19.441556 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:19.464035 29454 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.033s	sys 0.039s
I20260709 13:12:19.470047 29523 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
W20260709 13:12:19.478904 29375 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.012s	sys 0.062s
W20260709 13:12:19.481329 29375 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.012s	sys 0.063s
I20260709 13:12:19.486593 29495 leader_election.cc:400] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9.
I20260709 13:12:19.487250 29495 leader_election.cc:403] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 13:12:19.488902 29379 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.976s	user 0.033s	sys 0.013s
I20260709 13:12:19.500200 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:19.484930 31691 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:19.371279 31555 consensus_queue.cc:1048] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.127s
I20260709 13:12:19.485544 31618 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:19.522212 29419 leader_election.cc:336] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.713s (SENT)
I20260709 13:12:19.479069 31571 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:19.523205 29419 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:19.525427 29495 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:19.527853 29495 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:19.490687 31640 consensus_queue.cc:1059] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:12:19.532083 29450 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:19.511397 31742 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9.
I20260709 13:12:19.467485 29453 rpcz_store.cc:276] 0709 13:12:17.277125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:17.742179 (+465054us) service_pool.cc:224] Handling call
0709 13:12:17.742517 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:17.742796 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:12:17.980979 (+238183us) log.cc:844] Serialized 14 byte log entry
0709 13:12:19.461283 (+1480304us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:19.461366 (+    83us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:19.461443 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.461559 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:19.461740 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":625159,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":48,"raft.queue_time_us":128,"thread_start_us":1701163,"threads_started":2}
I20260709 13:12:19.501406 29449 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
W20260709 13:12:19.532614 29379 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.020s	user 0.033s	sys 0.013s
I20260709 13:12:19.520059 31584 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.553681 31678 raft_consensus.cc:2749] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:12:19.560923 29524 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.854s	user 0.028s	sys 0.062s
W20260709 13:12:19.561496 29524 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.855s	user 0.028s	sys 0.062s
I20260709 13:12:19.529345 31697 raft_consensus.cc:2749] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:19.558983 31640 consensus_queue.cc:1243] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer 429e58eb058349e3bf72b5a870c8f6e5 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:12:19.534770 31746 raft_consensus.cc:2804] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:12:19.559008 29447 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.042s	sys 0.047s
W20260709 13:12:19.570019 29447 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.043s	sys 0.047s
I20260709 13:12:19.573653 29447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1702) took 1031 ms. Trace:
I20260709 13:12:19.523463 31618 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:19.577574 29447 rpcz_store.cc:276] 0709 13:12:18.542605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.732131 (+189526us) service_pool.cc:224] Handling call
0709 13:12:18.732549 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:18.732766 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:12:18.850317 (+117551us) log.cc:844] Serialized 14 byte log entry
0709 13:12:19.573102 (+722785us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:19.573199 (+    97us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:19.573267 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.573371 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:19.573569 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58823,"prepare.queue_time_us":171605,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"raft.queue_time_us":5746,"thread_start_us":721967,"threads_started":1}
W20260709 13:12:19.585788 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 57711.4us
W20260709 13:12:19.585911 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 60509.7us
W20260709 13:12:19.591600 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:19.592159 29451 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.010s	sys 0.007s
W20260709 13:12:19.592705 29451 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.010s	sys 0.007s
I20260709 13:12:19.593474 29451 raft_consensus.cc:2955] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:12:19.598845 31640 consensus_queue.cc:1059] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:12:19.599856 29455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1685) took 2321 ms. Trace:
W20260709 13:12:19.600970 29419 leader_election.cc:336] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 2.086s (SENT)
I20260709 13:12:19.604696 29523 raft_consensus.cc:1275] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:12:19.647655 29419 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:19.646958 29455 rpcz_store.cc:276] 0709 13:12:17.277987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:17.926555 (+648568us) service_pool.cc:224] Handling call
0709 13:12:17.926974 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:17.927403 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:12:18.380940 (+453537us) log.cc:844] Serialized 14 byte log entry
0709 13:12:19.355324 (+974384us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:19.371854 (+ 16530us) log.cc:844] Serialized 26 byte log entry
0709 13:12:19.372021 (+   167us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:19.372283 (+   262us) log.cc:844] Serialized 14 byte log entry
0709 13:12:19.377108 (+  4825us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.377226 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:19.599571 (+222345us) raft_consensus.cc:1685] finished
0709 13:12:19.599594 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:19.599782 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":411841,"prepare.queue_time_us":439411,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":94,"raft.queue_time_us":30433,"raft.run_cpu_time_us":499,"raft.run_wall_time_us":102092,"thread_start_us":1301956,"threads_started":2,"wal-append.queue_time_us":1139899}
W20260709 13:12:19.649278 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 48365.6us
I20260709 13:12:19.535842 31501 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:19.651646 29522 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
W20260709 13:12:19.644837 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 55704.5us
I20260709 13:12:19.570026 31746 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.655432 29495 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:19.562044 31584 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:19.665732 31707 raft_consensus.cc:2764] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:12:19.669116 31501 consensus_queue.cc:1048] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:19.669853 31707 consensus_queue.cc:1059] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:19.658325 31746 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:19.657526 31697 raft_consensus.cc:2749] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:12:19.681545 29420 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.967s	user 0.031s	sys 0.044s
W20260709 13:12:19.682085 29420 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.968s	user 0.031s	sys 0.044s
W20260709 13:12:19.683902 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.676671 31722 consensus_queue.cc:1048] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:19.644591 31742 consensus_queue.cc:1059] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
W20260709 13:12:19.686151 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:19.696333 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 373149us
I20260709 13:12:19.710920 29419 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:19.716878 29522 raft_consensus.cc:3055] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:19.719264 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:19.723796 29522 raft_consensus.cc:740] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:19.719565 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:19.724947 29450 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:19.728917 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.728789 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:19.703780 31702 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.724844 29522 consensus_queue.cc:260] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:19.738292 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:19.745020 29455 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:19.706274 31698 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:19.741472 29447 raft_consensus.cc:1240] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:19.734527 29346 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:19.749985 29346 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:12:19.750640 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 260517us
I20260709 13:12:19.752049 29346 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:19.754473 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:19.709627 31697 consensus_queue.cc:1048] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:12:19.755192 29454 raft_consensus.cc:2468] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:12:19.754132 29450 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:12:19.739717 31618 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:19.709941 31713 consensus_queue.cc:1048] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:12:19.767278 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:19.768035 29454 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:19.769284 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:19.770396 29449 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
I20260709 13:12:19.773067 29455 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
W20260709 13:12:19.759534 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 256952us
I20260709 13:12:19.755158 31251 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:19.730515 31568 consensus_queue.cc:1048] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:12:19.774652 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:19.795301 29450 raft_consensus.cc:2410] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:12:19.751291 31724 raft_consensus.cc:2804] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:19.735176 31638 consensus_queue.cc:1048] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:12:19.796267 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:19.796591 31724 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:19.796756 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 567240us
I20260709 13:12:19.797048 31724 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:19.779186 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:19.779122 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:19.798470 29449 raft_consensus.cc:2368] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 5. Current term is 6.
I20260709 13:12:19.780510 29525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 1993) took 2144 ms. Trace:
I20260709 13:12:19.781708 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:19.798774 29344 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:19.785645 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.778471 29346 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:19.788070 29454 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
I20260709 13:12:19.790725 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:12:19.794270 29278 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.008s	sys 0.036s
W20260709 13:12:19.800599 29278 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.008s	sys 0.036s
I20260709 13:12:19.800511 29452 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
I20260709 13:12:19.796988 29448 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
I20260709 13:12:19.804690 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:19.800319 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:19.806866 29447 raft_consensus.cc:2368] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 6. Current term is 7.
I20260709 13:12:19.799170 29525 rpcz_store.cc:276] 0709 13:12:17.636034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.442340 (+806306us) service_pool.cc:224] Handling call
0709 13:12:18.503669 (+ 61329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:18.503922 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:12:19.352826 (+848904us) log.cc:844] Serialized 14 byte log entry
0709 13:12:19.780079 (+427253us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:19.780147 (+    68us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:19.780218 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.780307 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:19.780432 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1161986,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":1977,"raft.queue_time_us":10329,"thread_start_us":1271545,"threads_started":2}
W20260709 13:12:19.826709 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 48341.7us
I20260709 13:12:19.815124 29344 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:19.761910 31722 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:19.747732 31702 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:19.841800 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:19.774509 31660 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:19.840142 29450 raft_consensus.cc:1275] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:12:19.849557 29346 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:19.857290 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:19.850790 29344 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:19.854177 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:19.858347 29448 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
I20260709 13:12:19.760459 31572 consensus_queue.cc:1048] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
W20260709 13:12:19.869886 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 159058us
I20260709 13:12:19.789566 31251 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.877390 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:19.882202 29447 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
I20260709 13:12:19.876626 29419 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:19.758224 31698 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:19.833415 31638 raft_consensus.cc:2749] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:12:19.889254 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 223160us
I20260709 13:12:19.830576 31691 raft_consensus.cc:2804] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:19.897109 29372 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:12:19.908447 29372 raft_consensus.cc:606] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 LEADER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:12:19.893239 29526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 1996) took 1140 ms. Trace:
I20260709 13:12:19.909399 29526 rpcz_store.cc:276] 0709 13:12:18.752839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:19.448219 (+695380us) service_pool.cc:224] Handling call
0709 13:12:19.448492 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:19.448742 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:12:19.802195 (+353453us) log.cc:844] Serialized 14 byte log entry
0709 13:12:19.892287 (+ 90092us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:19.892417 (+   130us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:19.892688 (+   271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.892948 (+   260us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:19.893151 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":241711,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":203,"thread_start_us":442371,"threads_started":2}
W20260709 13:12:19.889284 31749 log.cc:927] Time spent T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.217s	user 0.000s	sys 0.002s
I20260709 13:12:19.886835 31251 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:19.924335 29495 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:12:19.951424 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.912403 31584 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:19.912075 31691 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.900293 31763 raft_consensus.cc:2804] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:19.935319 31713 raft_consensus.cc:2804] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:12:19.992471 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 116095us
I20260709 13:12:19.993368 29419 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:19.983289 31756 log.cc:927] Time spent T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.298s	user 0.002s	sys 0.000s
I20260709 13:12:19.957587 31742 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:19.935113 31638 raft_consensus.cc:2804] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:12:19.983760 31754 log.cc:927] Time spent T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.284s	user 0.002s	sys 0.000s
I20260709 13:12:19.987852 31713 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.009900 31713 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:20.011415 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:20.012316 29377 raft_consensus.cc:2393] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 7: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:20.013361 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:20.014748 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:19.936134 31618 consensus_queue.cc:1048] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:12:19.980669 31660 raft_consensus.cc:697] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:20.003738 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:20.019593 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:20.020556 29381 raft_consensus.cc:2393] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 8: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:20.021600 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:20.022568 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:20.023240 29372 raft_consensus.cc:1803] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: voting while tombstoned based on last-logged opid 1.3
I20260709 13:12:20.023687 29372 raft_consensus.cc:2468] T b5c4a6169e564566927a70e27f4af6f6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 2.
I20260709 13:12:19.981657 31691 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:19.999166 31572 raft_consensus.cc:2749] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:20.006100 31763 raft_consensus.cc:697] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:20.027709 29375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52172 (request call id 1193) took 1419 ms. Trace:
I20260709 13:12:20.027724 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:20.008582 31748 log.cc:927] Time spent T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.451s	user 0.010s	sys 0.000s
I20260709 13:12:20.008476 29265 catalog_manager.cc:5028] TS 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): tablet b5c4a6169e564566927a70e27f4af6f6 (table test-workload [id=364c32d53f7748a2857a4a9acd17c671]) successfully deleted
I20260709 13:12:20.028229 29375 rpcz_store.cc:276] 0709 13:12:18.606434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.662605 (+ 56171us) service_pool.cc:224] Handling call
0709 13:12:18.677777 (+ 15172us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:18.678166 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:18.678189 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:18.683092 (+  4903us) log.cc:844] Serialized 26 byte log entry
0709 13:12:19.483930 (+800838us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:19.483979 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.484062 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:20.025270 (+541208us) raft_consensus.cc:1685] finished
0709 13:12:20.025294 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:20.025472 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6645,"raft.queue_time_us":3284,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":7512,"thread_start_us":768343,"threads_started":1,"wal-append.queue_time_us":976564}
I20260709 13:12:20.009246 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:19.968245 31640 consensus_queue.cc:1059] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:12:19.997080 29419 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:20.024952 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:12:20.007992 31759 log.cc:927] Time spent T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.258s	user 0.001s	sys 0.001s
I20260709 13:12:20.042192 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:20.042728 31575 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.043098 29375 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
I20260709 13:12:20.043340 31575 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:20.043833 29451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 136) took 1432 ms. Trace:
W20260709 13:12:20.035445 29265 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 123375us
I20260709 13:12:20.035956 29374 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:20.034870 31638 raft_consensus.cc:697] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:20.045625 31575 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:20.046186 31575 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.046239 31638 consensus_queue.cc:237] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:20.046733 31575 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:20.002744 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:20.044227 29451 rpcz_store.cc:276] 0709 13:12:18.611722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.760174 (+148452us) service_pool.cc:224] Handling call
0709 13:12:18.760968 (+   794us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:18.804101 (+ 43133us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:18.804145 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:18.911128 (+106983us) log.cc:844] Serialized 534 byte log entry
0709 13:12:19.593284 (+682156us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:19.991472 (+398188us) log.cc:844] Serialized 14 byte log entry
0709 13:12:19.991782 (+   310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.991869 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:20.043594 (+ 51725us) raft_consensus.cc:1685] finished
0709 13:12:20.043615 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:20.043768 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7466,"raft.queue_time_us":534,"raft.run_cpu_time_us":391,"raft.run_wall_time_us":49552,"thread_start_us":578940,"threads_started":1,"wal-append.queue_time_us":690481}
I20260709 13:12:20.049218 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:20.050468 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:20.038093 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:12:20.040607 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 43634us
I20260709 13:12:19.999606 31742 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:20.028986 29372 raft_consensus.cc:2368] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 6. Current term is 7.
I20260709 13:12:20.051635 29376 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:20.052426 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:20.054435 29419 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:20.028672 31757 log.cc:927] Time spent T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.286s	user 0.001s	sys 0.000s
I20260709 13:12:20.044552 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:19.985419 31633 consensus_queue.cc:1059] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:12:20.055449 31742 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:20.064337 29375 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
W20260709 13:12:20.066735 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 117114us
I20260709 13:12:20.073133 29495 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:20.067728 29372 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
I20260709 13:12:20.004384 31777 raft_consensus.cc:2749] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:20.081117 29376 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:12:20.085246 29419 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:20.092171 31572 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:20.055409 31584 raft_consensus.cc:2749] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:20.095826 29419 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:20.102406 29419 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:20.106261 29524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53428 (request call id 230) took 2453 ms. Trace:
I20260709 13:12:20.108306 29524 rpcz_store.cc:276] 0709 13:12:17.653074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.702435 (+1049361us) service_pool.cc:224] Handling call
0709 13:12:18.702748 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:18.705107 (+  2359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:18.705135 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:18.706668 (+  1533us) log.cc:844] Serialized 26 byte log entry
0709 13:12:19.561945 (+855277us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:19.561996 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.562091 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:20.106003 (+543912us) raft_consensus.cc:1685] finished
0709 13:12:20.106040 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:20.106189 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":275290,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":118,"thread_start_us":854929,"threads_started":1,"wal-append.queue_time_us":974310}
I20260709 13:12:20.069322 31697 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:20.069046 31776 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:20.123834 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:20.126119 29419 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:20.127385 31572 raft_consensus.cc:2749] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:20.127854 31702 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:20.127966 31788 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.129266 31724 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:20.132695 31763 consensus_queue.cc:237] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:20.135926 29521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2008) took 1124 ms. Trace:
I20260709 13:12:20.175763 29521 rpcz_store.cc:276] 0709 13:12:19.006691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:19.487680 (+480989us) service_pool.cc:224] Handling call
0709 13:12:19.488173 (+   493us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:19.492902 (+  4729us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:19.492949 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:19.493664 (+   715us) log.cc:844] Serialized 26 byte log entry
0709 13:12:19.759794 (+266130us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:19.759857 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.759956 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:19.948900 (+188944us) spinlock_profiling.cc:243] Waited 3.55 ms on lock 0x7b4800150258. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a80cafaa1 00007f6a80ca6b37 00007f6a80ca69ca 00007f6a80d9e26f 00007f6a80d9df37 00007f6a80db255c 00007f6a80db2508 00007f6a80db2488 00007f6a80db2443 00007f6a80db16ec 00007f6a7fcdba96
0709 13:12:20.131024 (+182124us) raft_consensus.cc:1685] finished
0709 13:12:20.131059 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:20.131402 (+   343us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4272,"raft.queue_time_us":4379,"raft.run_cpu_time_us":6620,"raft.run_wall_time_us":459930,"spinlock_wait_cycles":8160128,"thread_start_us":246285,"threads_started":1,"wal-append.queue_time_us":625461}
I20260709 13:12:20.158046 29419 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:20.103364 31640 raft_consensus.cc:3055] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:20.164287 29375 raft_consensus.cc:2393] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 6: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:20.104771 31584 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:20.165974 31633 raft_consensus.cc:3055] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:20.184778 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:20.165215 31697 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:20.187800 29381 raft_consensus.cc:2393] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 7: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:20.189862 29419 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:20.192250 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 93579.7us
W20260709 13:12:20.173427 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 322601us
I20260709 13:12:20.197065 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:20.197739 29375 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:20.199687 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 242304us
I20260709 13:12:20.179765 31640 raft_consensus.cc:740] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:20.187053 31572 raft_consensus.cc:2804] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:20.219336 29529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2007) took 1212 ms. Trace:
W20260709 13:12:20.199775 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 126779us
I20260709 13:12:20.203991 29419 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:20.200737 31777 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:12:20.208786 31778 log.cc:927] Time spent T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 13:12:20.140168 31660 consensus_queue.cc:237] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:20.176875 31788 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:20.212308 31579 consensus_meta.cc:287] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.804s	user 0.009s	sys 0.005s
I20260709 13:12:20.185159 31792 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:20.188491 31633 raft_consensus.cc:740] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:20.163939 31776 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:20.194500 31698 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:20.238039 29529 rpcz_store.cc:276] 0709 13:12:19.006408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:19.486571 (+480163us) service_pool.cc:224] Handling call
0709 13:12:19.487119 (+   548us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:19.491434 (+  4315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:19.491470 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:19.492084 (+   614us) log.cc:844] Serialized 26 byte log entry
0709 13:12:19.759181 (+267097us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:19.759226 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.759325 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:20.219081 (+459756us) raft_consensus.cc:1685] finished
0709 13:12:20.219103 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:20.219265 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13936,"raft.queue_time_us":5160,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":6365,"thread_start_us":266725,"threads_started":1,"wal-append.queue_time_us":682021}
I20260709 13:12:20.238052 29527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2005) took 1232 ms. Trace:
I20260709 13:12:20.234812 29374 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 7.
I20260709 13:12:20.242074 29375 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:12:20.242707 29344 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:12:20.240653 29495 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:20.237514 31572 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.218294 31640 consensus_queue.cc:260] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:20.217721 31710 consensus_meta.cc:287] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.733s	user 0.013s	sys 0.000s
I20260709 13:12:20.226075 31691 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:20.234369 31746 consensus_meta.cc:287] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.543s	user 0.012s	sys 0.000s
I20260709 13:12:20.255003 29527 rpcz_store.cc:276] 0709 13:12:19.005788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:19.485095 (+479307us) service_pool.cc:224] Handling call
0709 13:12:19.485835 (+   740us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:19.491630 (+  5795us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:19.491657 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:19.500193 (+  8536us) log.cc:844] Serialized 26 byte log entry
0709 13:12:19.737667 (+237474us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:19.737716 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.737793 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:20.237768 (+499975us) raft_consensus.cc:1685] finished
0709 13:12:20.237791 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:20.237979 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7354,"raft.queue_time_us":2599,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":7350,"thread_start_us":205639,"threads_started":1,"wal-append.queue_time_us":671489}
I20260709 13:12:20.262954 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:20.264967 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:20.265790 31698 consensus_queue.cc:1048] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:20.243650 31697 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:20.269495 29344 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:20.269659 31777 consensus_queue.cc:1059] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:20.271481 31633 consensus_queue.cc:260] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:20.215435 31251 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:20.233279 31742 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:20.291455 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 49358.2us
I20260709 13:12:20.230090 31713 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:20.263087 31788 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:20.268236 31572 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:20.243887 31795 consensus_queue.cc:1048] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:12:20.311784 31678 raft_consensus.cc:3055] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:20.312222 31678 raft_consensus.cc:740] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:20.313081 31678 consensus_queue.cc:260] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:20.314141 31678 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:20.315421 29375 raft_consensus.cc:2368] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 6. Current term is 7.
I20260709 13:12:20.317070 31251 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:20.290150 31584 consensus_queue.cc:1059] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:12:20.317884 29377 raft_consensus.cc:2368] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 6. Current term is 7.
I20260709 13:12:20.318580 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:20.289325 29373 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:12:20.300639 29419 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:20.321179 31584 raft_consensus.cc:3055] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:20.321386 29419 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:20.322041 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:20.322701 29419 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:20.324126 31747 raft_consensus.cc:3055] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:20.324549 31747 raft_consensus.cc:740] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:20.325497 31747 consensus_queue.cc:260] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:20.326615 31747 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:20.327760 31777 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:20.328580 31777 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.329056 31777 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:20.330955 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:20.321780 31584 raft_consensus.cc:740] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:20.293017 29421 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:20.303997 29380 raft_consensus.cc:2368] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 5. Current term is 6.
I20260709 13:12:20.332361 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:20.332892 29380 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "71aa3578fd924765ab9ac0729c8d1483"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:12:20.307186 31776 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:20.332463 31584 consensus_queue.cc:260] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:20.308434 31633 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:20.294629 31792 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:20.344419 31698 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:20.344754 31755 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:20.345248 31755 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:20.345621 31755 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:20.346307 31584 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:20.310714 31742 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:20.323275 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:20.350757 29377 raft_consensus.cc:2393] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 7: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:20.352102 29377 raft_consensus.cc:1240] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:20.354910 31691 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:20.358093 31697 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:20.359896 31571 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:20.361583 31753 log.cc:927] Time spent T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.805s	user 0.000s	sys 0.005s
W20260709 13:12:20.362385 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.363866 29378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52172 (request call id 1190) took 1758 ms. Trace:
I20260709 13:12:20.364675 31640 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:20.364318 29378 rpcz_store.cc:276] 0709 13:12:18.605242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.606297 (+  1055us) service_pool.cc:224] Handling call
0709 13:12:18.606755 (+   458us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:18.607286 (+   531us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:18.607316 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:18.608165 (+   849us) log.cc:844] Serialized 52 byte log entry
0709 13:12:19.171305 (+563140us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:19.706147 (+534842us) log.cc:844] Serialized 14 byte log entry
0709 13:12:19.708311 (+  2164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.708405 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:20.021674 (+313269us) spinlock_profiling.cc:243] Waited 2.16 ms on lock 0x7b54001edda8. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7f6f0161 00007f6a7f78830b 00007f6a7f788259 00007f6a7f7881e9 00007f6a7f7881b1 00007f6a7f7874ad 000000000038f354 000000000038f199 00007f6a78c99475 00007f6a78c9b7c1 00007f6a78c9b779
0709 13:12:20.360789 (+339115us) spinlock_profiling.cc:243] Waited 4.56 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:12:20.363591 (+  2802us) raft_consensus.cc:1685] finished
0709 13:12:20.363614 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:20.363791 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29914,"prepare.queue_time_us":530611,"prepare.run_cpu_time_us":7883,"prepare.run_wall_time_us":295796,"raft.queue_time_us":3580,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":19684,"spinlock_wait_cycles":15464576,"thread_start_us":950083,"threads_started":2,"wal-append.queue_time_us":926719}
I20260709 13:12:20.370798 31575 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:20.290813 31746 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:20.374002 31746 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:20.337957 29373 raft_consensus.cc:1240] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 13:12:20.380870 29419 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:20.339272 29375 raft_consensus.cc:1240] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:20.385414 31798 raft_consensus.cc:2804] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:20.386469 29379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52172 (request call id 1184) took 1875 ms. Trace:
I20260709 13:12:20.299726 29344 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:20.310215 31713 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:20.341209 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 48288us
W20260709 13:12:20.388998 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 89379.6us
I20260709 13:12:20.389283 29522 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:20.389642 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.343401 29380 raft_consensus.cc:606] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 LEADER]: Received request to transfer leadership to TS 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:20.303442 31579 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:12:20.392449 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.391266 29376 raft_consensus.cc:1240] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:20.390192 29421 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:12:20.408356 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:20.401170 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.404400 29344 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:20.417443 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:20.417688 29447 raft_consensus.cc:1275] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:12:20.386914 29379 rpcz_store.cc:276] 0709 13:12:18.511211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.511337 (+   126us) service_pool.cc:224] Handling call
0709 13:12:18.511730 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:18.512256 (+   526us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:12:19.545072 (+1032816us) log.cc:844] Serialized 14 byte log entry
0709 13:12:20.170679 (+625607us) log.cc:844] Serialized 14 byte log entry
0709 13:12:20.170966 (+   287us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:20.384254 (+213288us) spinlock_profiling.cc:243] Waited 4.74 ms on lock 0x7b2c00062108. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7a67fa11 00007f6a7a68f372 00007f6a7bdc1a01 00007f6a7bd8643a 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2
0709 13:12:20.384737 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 13:12:20.384927 (+   190us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:20.384963 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:20.385059 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:20.386219 (+  1160us) raft_consensus.cc:1685] finished
0709 13:12:20.386243 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:20.386395 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37724,"prepare.queue_time_us":1220470,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":80,"raft.queue_time_us":93806,"raft.run_cpu_time_us":398,"raft.run_wall_time_us":8131,"spinlock_wait_cycles":10894080,"thread_start_us":1502420,"threads_started":4,"wal-append.queue_time_us":410202}
I20260709 13:12:20.416240 29421 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:20.420437 29451 raft_consensus.cc:1275] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:12:20.420962 29452 raft_consensus.cc:2393] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 8: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:20.421660 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:20.423081 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:20.436894 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:20.445663 29346 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:20.427086 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:20.435984 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:20.447943 29447 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:20.448344 29522 raft_consensus.cc:1275] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:12:20.383358 29374 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
I20260709 13:12:20.448901 29522 pending_rounds.cc:85] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 4
I20260709 13:12:20.436535 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:20.426564 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:20.452718 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:20.450665 29522 pending_rounds.cc:107] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:12:20.424852 29448 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:12:20.453606 29522 raft_consensus.cc:2889] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:20.453588 29450 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
W20260709 13:12:20.422602 31753 log.cc:927] Time spent T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:12:20.458432 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:20.467617 29379 raft_consensus.cc:2393] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 7: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:20.456202 29522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2017) took 1398 ms. Trace:
I20260709 13:12:20.403564 31571 raft_consensus.cc:2749] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:20.470515 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:20.469532 29522 rpcz_store.cc:276] 0709 13:12:19.057512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:19.654189 (+596677us) service_pool.cc:224] Handling call
0709 13:12:19.716687 (+ 62498us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:20.388556 (+671869us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b58001a81d0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bce20aa 00007f6a7bd64447 00007f6a7bd7cfe7 00007f6a7bd7e7de 00007f6a7bd88b49 00007f6a7bd89416 00007f6a7bd85d8f 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4
0709 13:12:20.455820 (+ 67264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:20.456122 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":327152000}
I20260709 13:12:20.421708 31501 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:20.469550 29346 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:20.467401 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:20.387559 31798 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:20.417595 31575 raft_consensus.cc:2804] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:20.415228 31579 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.481930 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:20.454296 30986 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.471617 31698 raft_consensus.cc:697] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:20.446885 31251 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:20.493848 29448 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 1.
W20260709 13:12:20.471088 31639 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
W20260709 13:12:20.501988 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 81946.9us
I20260709 13:12:20.492969 31798 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:20.484344 31785 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:20.509873 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:20.514181 29448 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:20.496224 31579 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:20.504998 31571 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:12:20.521423 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 280854us
I20260709 13:12:20.470377 31784 consensus_queue.cc:1048] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:12:20.539969 29448 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:20.541611 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:20.522864 31251 raft_consensus.cc:697] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:20.550022 31251 consensus_queue.cc:237] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:20.520080 31713 raft_consensus.cc:2804] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:12:20.552286 31803 log.cc:927] Time spent T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:12:20.553290 31682 raft_consensus.cc:3055] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:20.553725 31682 raft_consensus.cc:740] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
W20260709 13:12:20.555330 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.548107 31698 consensus_queue.cc:237] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:20.510119 31575 raft_consensus.cc:697] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:12:20.571197 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 45018.2us
I20260709 13:12:20.504805 30986 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:20.575543 31713 raft_consensus.cc:697] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:20.554657 31682 consensus_queue.cc:260] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:20.578188 31713 consensus_queue.cc:237] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:20.579118 31682 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:20.523994 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:20.574899 31501 raft_consensus.cc:697] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:20.593181 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:20.594369 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:20.597127 29529 raft_consensus.cc:2410] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 7 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:12:20.597036 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:12:20.592428 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 122969us
I20260709 13:12:20.597720 29528 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:12:20.596102 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:20.600935 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:20.601672 29521 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:12:20.598991 29526 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:12:20.604775 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:20.582353 29495 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:20.605274 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:20.605450 29529 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
I20260709 13:12:20.605860 29526 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:20.608704 29377 raft_consensus.cc:1275] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:20.612326 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:20.612192 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:20.613237 29523 raft_consensus.cc:2393] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 7: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:20.613350 29525 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:20.606330 29495 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:20.614276 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:20.615094 29530 raft_consensus.cc:2410] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:12:20.598723 31571 raft_consensus.cc:697] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 7 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:20.627421 29495 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:20.580504 31707 consensus_queue.cc:1059] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:12:20.630669 29495 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:20.635891 29521 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:20.598785 31691 consensus_queue.cc:1048] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:12:20.618907 31806 raft_consensus.cc:2804] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:20.668748 29525 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:12:20.653389 29526 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:12:20.671185 29495 leader_election.cc:400] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 5. Current term is 6.
I20260709 13:12:20.655213 31746 raft_consensus.cc:2764] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:12:20.673836 29495 leader_election.cc:403] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:12:20.644392 31802 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:20.666445 31552 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.678285 29495 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:20.679360 31707 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 5. Current term is 6.
I20260709 13:12:20.679843 31571 consensus_queue.cc:237] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:20.686084 31572 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:20.664049 31806 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:12:20.708832 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 52660.9us
I20260709 13:12:20.673007 31792 raft_consensus.cc:2804] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:20.709539 29495 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:20.712904 29449 raft_consensus.cc:1240] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:12:20.717311 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:20.713475 29495 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:20.721700 29450 raft_consensus.cc:2393] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 7: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:20.723402 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:20.726024 29450 raft_consensus.cc:2393] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 7: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:20.687412 30986 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:20.728924 29346 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:20.731411 29456 raft_consensus.cc:2410] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:12:20.733031 29495 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:20.647698 31575 consensus_queue.cc:237] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:20.737020 29346 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:20.738042 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:20.738945 29495 leader_election.cc:400] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 6. Current term is 7.
I20260709 13:12:20.739424 29495 leader_election.cc:403] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:20.708711 31802 raft_consensus.cc:697] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:20.713259 31640 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:20.741077 29495 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:20.744585 29346 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:20.714293 31806 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:20.726861 31707 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:12:20.758733 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.679728 31755 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:20.770578 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.761948 29528 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
W20260709 13:12:20.769316 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.759011 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:20.708215 31552 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:20.772157 29450 raft_consensus.cc:2393] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 6: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:20.777405 31707 raft_consensus.cc:697] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:20.778502 31707 consensus_queue.cc:237] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:20.779094 29450 raft_consensus.cc:1275] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:12:20.690574 31501 consensus_queue.cc:237] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:20.784420 31755 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:20.756793 31785 raft_consensus.cc:2804] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:20.785188 31785 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.785529 31785 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:20.743795 31776 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:20.787945 31776 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:20.788331 31776 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:20.770398 31618 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:20.800745 31660 raft_consensus.cc:993] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5: : Instructing follower 183db85c071f489fbc8de63a9edd8a3a to start an election
I20260709 13:12:20.801024 31618 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.801555 31618 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:20.774394 29346 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:12:20.800467 29419 leader_election.cc:336] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 2.112s (SENT)
I20260709 13:12:20.804610 29419 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:20.736375 31792 raft_consensus.cc:697] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:20.757524 30986 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:12:20.771566 31809 log.cc:927] Time spent T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.124s	user 0.001s	sys 0.001s
I20260709 13:12:20.799206 31785 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:20.731006 31702 consensus_queue.cc:1048] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:12:20.736202 31764 consensus_queue.cc:1048] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:12:20.775308 31784 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:20.743213 31795 raft_consensus.cc:2749] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 6. Current term is 7.
I20260709 13:12:20.774086 31742 raft_consensus.cc:2764] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:12:20.883747 31572 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:20.884003 31792 consensus_queue.cc:237] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:20.885993 31785 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:20.886309 31724 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:20.876957 31826 log.cc:927] Time spent T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:12:20.756633 31788 consensus_queue.cc:1048] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
W20260709 13:12:20.899202 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:20.911552 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 137213us
W20260709 13:12:20.912218 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 171219us
I20260709 13:12:20.912421 29346 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:20.913036 29495 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:20.914552 29495 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:20.873966 31784 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:20.917892 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.920853 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:20.928478 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:20.927723 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:20.931823 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:20.933794 29450 raft_consensus.cc:2468] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 1.
I20260709 13:12:20.936205 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:20.939169 29456 raft_consensus.cc:1240] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5. Ops: []
W20260709 13:12:20.940954 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.943456 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:12:20.947813 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.950088 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:20.950515 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:20.953678 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:20.955511 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:20.956313 29530 raft_consensus.cc:2393] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 7: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:20.922416 31834 raft_consensus.cc:2749] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:20.936916 29450 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
I20260709 13:12:20.964781 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:20.965126 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:20.919152 31785 raft_consensus.cc:1081] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 LEADER]: Signalling peer 183db85c071f489fbc8de63a9edd8a3a to start an election
I20260709 13:12:20.959307 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:20.963315 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:20.968663 29521 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:12:20.960964 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:20.961691 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:20.921522 31784 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:20.950845 29451 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:20.922302 30986 raft_consensus.cc:2804] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:20.960367 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:20.970161 29456 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:12:20.970956 29527 raft_consensus.cc:2393] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 7: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:20.921896 31802 consensus_queue.cc:237] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:20.929327 31795 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:20.960000 31787 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.110998 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:20.984510 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:12:21.065521 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 108293us
I20260709 13:12:21.111733 29523 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:21.100590 31776 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:21.101328 31822 log.cc:927] Time spent T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.281s	user 0.001s	sys 0.003s
I20260709 13:12:21.081918 31633 raft_consensus.cc:3055] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:12:21.103423 31820 log.cc:927] Time spent T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
I20260709 13:12:20.973315 29451 raft_consensus.cc:1240] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:12:20.980997 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:21.021934 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 109596us
I20260709 13:12:21.122676 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:21.127097 29530 raft_consensus.cc:2410] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:12:20.980327 29525 raft_consensus.cc:1240] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 5. Current term is 7. Ops: []
I20260709 13:12:21.127557 29346 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:21.127815 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:21.132774 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:21.112957 29456 raft_consensus.cc:1240] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
W20260709 13:12:20.997908 31829 log.cc:927] Time spent T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
W20260709 13:12:21.054289 31747 consensus_meta.cc:287] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.678s	user 0.012s	sys 0.000s
W20260709 13:12:21.123706 31798 consensus_meta.cc:287] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.598s	user 0.009s	sys 0.003s
I20260709 13:12:21.144341 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:21.144605 29528 raft_consensus.cc:1240] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:21.112617 29344 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:20.981777 30986 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.973690 29450 raft_consensus.cc:1240] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:12:21.140179 29421 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:12:21.045703 31579 consensus_meta.cc:287] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.508s	user 0.010s	sys 0.002s
I20260709 13:12:21.029404 31251 raft_consensus.cc:2804] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:21.106810 31795 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:21.142740 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:21.145092 29525 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:21.159653 29529 raft_consensus.cc:1275] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:12:21.044746 31552 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:21.164321 29529 pending_rounds.cc:85] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 2
I20260709 13:12:21.164674 29529 pending_rounds.cc:107] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:12:21.164935 29529 raft_consensus.cc:2889] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:21.163285 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 50768.5us
I20260709 13:12:21.123970 31633 raft_consensus.cc:740] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:21.167405 29344 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:21.164309 29526 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
I20260709 13:12:21.179929 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:21.179759 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:21.181090 29526 raft_consensus.cc:2410] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:12:21.182298 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:21.140992 31568 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:21.125252 31787 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:21.047319 31806 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:21.187429 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:21.160688 31579 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:21.198802 31764 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:21.199074 31827 log.cc:927] Time spent T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.382s	user 0.002s	sys 0.000s
I20260709 13:12:21.199335 31764 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:21.201738 31764 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:21.202445 31777 consensus_meta.cc:287] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.873s	user 0.015s	sys 0.001s
I20260709 13:12:21.202771 29523 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:12:21.202906 31777 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:21.205194 31777 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:21.207134 29448 raft_consensus.cc:2393] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 7: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:21.157891 30986 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:21.178347 31795 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:21.259160 29344 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:21.260865 29344 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:21.184530 31702 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:21.272033 29344 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:12:21.196457 31251 raft_consensus.cc:697] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:21.290475 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:21.294322 29527 raft_consensus.cc:2393] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 7: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
W20260709 13:12:21.295571 31820 log.cc:927] Time spent T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:12:21.288025 31814 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:21.284724 31568 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:21.296635 31814 raft_consensus.cc:697] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:21.297108 31568 raft_consensus.cc:697] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:21.297771 31814 consensus_queue.cc:237] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:21.298054 31568 consensus_queue.cc:237] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:21.215010 31711 raft_consensus.cc:2749] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:21.184602 31618 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:21.312105 31806 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:21.319947 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:21.287869 31552 raft_consensus.cc:2804] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:21.286527 31776 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:21.161808 31798 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:21.339166 29530 raft_consensus.cc:2368] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 5. Current term is 6.
I20260709 13:12:21.306666 31633 consensus_queue.cc:260] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:21.342979 31633 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:21.355348 31579 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:21.356405 31798 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:21.364684 29525 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
W20260709 13:12:21.378778 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 104966us
I20260709 13:12:21.379027 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:21.381861 28234 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:12:21.384429 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:21.385918 29344 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:21.387133 31786 raft_consensus.cc:2749] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:21.389721 29495 leader_election.cc:304] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:21.390859 31742 raft_consensus.cc:2749] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:21.391144 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:21.391585 29495 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:21.392400 31742 raft_consensus.cc:2749] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:21.394376 29344 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:21.406682 29527 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 4.
I20260709 13:12:21.410471 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:21.331874 31552 raft_consensus.cc:697] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:12:21.414708 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 88108.2us
I20260709 13:12:21.417918 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:21.421506 29527 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 7.
I20260709 13:12:21.424844 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:21.426573 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:21.428678 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:21.439119 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:21.431452 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:21.440210 29525 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:21.440706 29376 raft_consensus.cc:2393] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 7: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:21.444342 29380 raft_consensus.cc:1240] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:12:21.446060 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:21.416872 31762 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:21.449311 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:21.449476 29379 raft_consensus.cc:1240] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:12:21.453962 29527 raft_consensus.cc:2393] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 6: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:21.449501 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:21.450766 29344 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:21.459520 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:21.420369 31618 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:21.458315 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:21.463450 29495 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:21.466176 29495 leader_election.cc:400] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 6. Current term is 7.
I20260709 13:12:21.452416 31762 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:21.769112 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:21.806227 29376 raft_consensus.cc:2368] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9.
W20260709 13:12:21.781246 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 315308us
I20260709 13:12:21.781596 29378 raft_consensus.cc:1240] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:21.784364 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:21.473126 29525 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
I20260709 13:12:21.483070 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:21.412451 31251 consensus_queue.cc:237] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:21.913641 29527 raft_consensus.cc:2468] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 3.
I20260709 13:12:21.498476 31552 consensus_queue.cc:237] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:21.918907 29374 raft_consensus.cc:2393] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 8: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:21.465979 31742 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:21.465055 31786 raft_consensus.cc:2804] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:21.921280 31786 raft_consensus.cc:697] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:21.441490 31784 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:21.893993 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:21.924530 29525 raft_consensus.cc:2393] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 8: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:21.896478 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:21.897866 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:21.926241 31784 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:21.898725 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:21.905189 31828 log.cc:927] Time spent T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 1.087s	user 0.014s	sys 0.016s
I20260709 13:12:21.920219 29376 raft_consensus.cc:1240] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:21.940584 31787 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:21.940652 29377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52172 (request call id 1208) took 1514 ms. Trace:
I20260709 13:12:21.935664 31762 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:21.941744 29377 rpcz_store.cc:276] 0709 13:12:20.426454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:20.426717 (+   263us) service_pool.cc:224] Handling call
0709 13:12:20.467365 (+ 40648us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:20.609125 (+141760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:21.939972 (+1330847us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b540002f654. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:21.940375 (+   403us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":324205824}
I20260709 13:12:21.944458 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:21.945940 29524 raft_consensus.cc:2368] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 6. Current term is 7.
W20260709 13:12:21.941756 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 126977us
I20260709 13:12:21.947304 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:12:21.961490 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:21.932574 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 481699us
W20260709 13:12:21.968650 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:21.966079 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:12:21.979214 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:21.981426 29449 raft_consensus.cc:1240] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:21.982472 29449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 969) took 1035 ms. Trace:
I20260709 13:12:21.982867 29449 rpcz_store.cc:276] 0709 13:12:20.946750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:21.112371 (+165621us) service_pool.cc:224] Handling call
0709 13:12:21.946678 (+834307us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b5800193598. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61b71 00007f6a78c61eee 0000000000375939 00007f6a80cd51e0 00007f6a80d9e0c4 00007f6a80d9e131 00007f6a80d5ffc0 00007f6a80d4a929 00007f6a80d4a3d2 00007f6a7a2c1bd4
0709 13:12:21.947095 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:21.982063 (+ 34968us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:21.982304 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7109504}
I20260709 13:12:21.985128 29529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2036) took 1378 ms. Trace:
I20260709 13:12:21.985790 29529 rpcz_store.cc:276] 0709 13:12:20.607383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:20.607523 (+   140us) service_pool.cc:224] Handling call
0709 13:12:20.607831 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:21.165388 (+557557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:21.984380 (+818992us) spinlock_profiling.cc:243] Waited 551 ms on lock 0x7b54002e3bd4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:21.984844 (+   464us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1267917696}
I20260709 13:12:21.996361 29528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2040) took 1055 ms. Trace:
I20260709 13:12:21.996270 29495 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:12:21.997021 29528 rpcz_store.cc:276] 0709 13:12:20.940499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:20.948550 (+  8051us) service_pool.cc:224] Handling call
0709 13:12:20.948841 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:21.145029 (+196188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:21.995666 (+850637us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b5400358ed4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:21.996139 (+   473us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":449732864}
I20260709 13:12:21.998916 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:21.999650 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:22.000038 31742 raft_consensus.cc:2804] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:12:22.014238 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:22.016940 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 44578.8us
I20260709 13:12:21.923283 31786 consensus_queue.cc:237] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:22.004647 29524 raft_consensus.cc:2376] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 8. Re-sending same reply.
I20260709 13:12:21.998956 29495 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:22.034891 31722 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:22.054502 31722 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:22.058014 31722 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:12:22.059242 31821 log.cc:927] Time spent T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 1.241s	user 0.000s	sys 0.003s
I20260709 13:12:22.061461 31787 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:12:22.062084 30986 consensus_meta.cc:287] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.811s	user 0.019s	sys 0.015s
I20260709 13:12:22.062758 31742 raft_consensus.cc:697] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 6 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:22.062821 30986 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:22.066114 30986 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:22.072808 31742 consensus_queue.cc:237] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:22.073565 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:12:22.061995 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 63358.8us
W20260709 13:12:22.074833 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:22.106156 30986 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:22.117717 29495 leader_election.cc:400] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 6. Current term is 7.
W20260709 13:12:22.118532 31633 consensus_meta.cc:287] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.775s	user 0.009s	sys 0.022s
I20260709 13:12:22.136804 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:22.140034 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:22.176904 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 46417.1us
I20260709 13:12:22.177114 31572 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:12:22.178828 29448 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45798 (request call id 1734) took 1665 ms (client timeout 1822 ms). Trace:
W20260709 13:12:22.179625 29448 rpcz_store.cc:269] 0709 13:12:20.512796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:20.541154 (+ 28358us) service_pool.cc:224] Handling call
0709 13:12:22.178012 (+1636858us) spinlock_profiling.cc:243] Waited 664 ms on lock 0x7b54002922d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:22.178448 (+   436us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1527693184}
I20260709 13:12:22.185667 30986 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:22.168345 28234 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:22.190689 31633 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.187135 31584 raft_consensus.cc:2749] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:22.128548 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:22.192287 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:22.192737 29521 raft_consensus.cc:2393] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 2: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:22.193241 29521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37958 (request call id 1149) took 1078 ms. Trace:
I20260709 13:12:22.193794 31722 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.194368 31819 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.194622 31722 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:22.195158 31819 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:22.197470 31722 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:22.198206 31722 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:22.193576 29521 rpcz_store.cc:276] 0709 13:12:21.114704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:22.127779 (+1013075us) service_pool.cc:224] Handling call
0709 13:12:22.193170 (+ 65391us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:22.201457 29521 raft_consensus.cc:1240] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:12:22.203090 29521 raft_consensus.cc:1240] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 13:12:22.204833 30986 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:22.206166 29524 raft_consensus.cc:1240] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:12:22.198956 31722 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:22.209304 31722 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:22.214051 29530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37958 (request call id 1143) took 1100 ms. Trace:
I20260709 13:12:22.191461 31633 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:22.169483 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 63878.8us
I20260709 13:12:22.224136 29522 raft_consensus.cc:2410] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:12:22.216077 31795 consensus_meta.cc:287] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.927s	user 0.020s	sys 0.016s
I20260709 13:12:22.217154 29528 raft_consensus.cc:1275] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:22.214636 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:22.225467 29529 raft_consensus.cc:2410] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:12:22.226552 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 63675.3us
I20260709 13:12:22.227303 29452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45798 (request call id 1716) took 1791 ms. Trace:
I20260709 13:12:22.229269 31633 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:22.228029 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:22.232514 29452 rpcz_store.cc:276] 0709 13:12:20.435462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:20.435653 (+   191us) service_pool.cc:224] Handling call
0709 13:12:22.125618 (+1689965us) spinlock_profiling.cc:243] Waited 843 ms on lock 0x7b54000190d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:22.227095 (+101477us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1938397952}
I20260709 13:12:22.219750 29530 rpcz_store.cc:276] 0709 13:12:21.113665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:21.142681 (+ 29016us) service_pool.cc:224] Handling call
0709 13:12:22.129794 (+987113us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b54000a3054. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:22.213786 (+ 83992us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":362925440}
I20260709 13:12:22.235442 31787 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.251864 31819 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:22.266191 29526 raft_consensus.cc:2393] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 6: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:22.249096 31795 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:22.255954 31722 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.280001 29495 leader_election.cc:400] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 6. Current term is 7.
I20260709 13:12:22.292100 29522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37958 (request call id 1148) took 1177 ms. Trace:
I20260709 13:12:22.298385 31802 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:22.299224 31802 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:22.300660 29530 raft_consensus.cc:1240] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:22.303030 29530 raft_consensus.cc:1275] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:22.308573 29524 raft_consensus.cc:1240] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:22.310067 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:22.309441 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:22.310925 29524 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:12:22.311097 29530 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:22.312265 29527 raft_consensus.cc:2393] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 6: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:22.303834 31711 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.298024 31722 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:22.294090 29522 rpcz_store.cc:276] 0709 13:12:21.114487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:21.965189 (+850702us) service_pool.cc:224] Handling call
0709 13:12:22.290587 (+325398us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b540006efd4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:22.292008 (+  1421us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":315207552}
I20260709 13:12:22.264878 31787 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:22.324503 29528 raft_consensus.cc:1275] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:12:22.277596 31762 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:22.334368 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 1.19356e+06us
I20260709 13:12:22.366716 29525 raft_consensus.cc:1275] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:12:22.378701 31713 consensus_queue.cc:1048] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.101s
I20260709 13:12:22.385102 31251 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.399523 31798 consensus_queue.cc:1059] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:12:22.399904 31251 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:22.401335 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 145020us
I20260709 13:12:22.402318 29495 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:12:22.418419 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:22.365403 31711 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:22.422792 29344 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:22.428761 31568 consensus_queue.cc:1048] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:12:22.430027 31555 raft_consensus.cc:3055] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:22.430225 31251 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:22.430536 31555 raft_consensus.cc:740] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:22.432160 29381 raft_consensus.cc:1240] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 3. Current term is 5. Ops: []
I20260709 13:12:22.433542 29529 raft_consensus.cc:1275] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:12:22.435470 29527 raft_consensus.cc:1275] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:12:22.414732 31633 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:22.363705 31854 consensus_queue.cc:1059] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.152s
I20260709 13:12:22.442087 31802 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:22.456333 31853 consensus_queue.cc:1059] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:12:22.457505 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 112559us
I20260709 13:12:22.457904 31863 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:22.458724 29421 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:22.458814 31863 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:22.460731 31785 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.461299 31571 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.461957 31863 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:22.462293 31808 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.462500 31251 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.462935 31808 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:22.463670 30986 raft_consensus.cc:2804] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:22.464088 30986 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:22.464442 30986 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:22.464637 31798 consensus_queue.cc:1048] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:22.465655 31808 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:22.466275 31808 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.467901 31764 consensus_queue.cc:1048] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:22.469094 31702 consensus_queue.cc:1048] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:22.467263 31861 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:22.470409 31764 consensus_queue.cc:1048] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:22.471123 31861 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:22.461558 31785 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:22.472589 31762 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:22.473652 31861 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:22.473902 31785 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:22.461997 31571 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:22.474406 30986 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:22.476310 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 1.67566e+06us
W20260709 13:12:22.476857 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:22.491261 30986 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:22.433349 31835 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:22.463243 31251 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:22.500743 29524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2059) took 1011 ms. Trace:
I20260709 13:12:22.476899 31571 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:22.502254 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:22.508982 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:22.514516 29530 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
I20260709 13:12:22.466818 31808 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:22.519392 31776 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:22.521271 31251 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:22.521136 31776 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:22.522437 31722 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:22.522401 31808 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:22.524906 29374 raft_consensus.cc:1275] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:22.517596 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:22.520063 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 61590.1us
I20260709 13:12:22.503870 31863 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:22.502530 29524 rpcz_store.cc:276] 0709 13:12:21.489696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:22.324741 (+835045us) service_pool.cc:224] Handling call
0709 13:12:22.354530 (+ 29789us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:22.404173 (+ 49643us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:12:22.404613 (+   440us) log.cc:844] Serialized 14 byte log entry
0709 13:12:22.500175 (+ 95562us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:22.500377 (+   202us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:22.500437 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:22.500506 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:22.500670 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3282,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":1853,"thread_start_us":95049,"threads_started":1}
I20260709 13:12:22.545071 31787 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:22.551189 29380 raft_consensus.cc:1275] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:12:22.555773 31786 raft_consensus.cc:3055] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:22.556010 29525 raft_consensus.cc:3055] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:22.556358 31786 raft_consensus.cc:740] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:22.557672 31786 consensus_queue.cc:260] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:22.563809 31552 consensus_queue.cc:1048] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:12:22.565709 31552 consensus_queue.cc:1059] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:22.568212 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:22.568464 29381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 918) took 1143 ms. Trace:
I20260709 13:12:22.572914 31787 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.573841 31787 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:22.575628 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 173467us
I20260709 13:12:22.576462 31787 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:22.576828 29495 leader_election.cc:400] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 5. Current term is 6.
I20260709 13:12:22.578320 29495 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:22.579201 31787 raft_consensus.cc:2749] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:12:22.582250 31858 log.cc:927] Time spent T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.274s	user 0.002s	sys 0.001s
I20260709 13:12:22.556445 29525 raft_consensus.cc:740] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:22.583848 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:22.584147 29525 consensus_queue.cc:260] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:22.585340 29525 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:22.551990 31776 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:22.518585 31835 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:22.568953 29381 rpcz_store.cc:276] 0709 13:12:21.424912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:21.425906 (+   994us) service_pool.cc:224] Handling call
0709 13:12:21.940885 (+514979us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:22.433859 (+492974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:22.567372 (+133513us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b540002f654. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:22.568240 (+   868us) spinlock_profiling.cc:243] Waited 514 ms on lock 0x7b540002f650. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd858ad 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:22.568397 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2148466176}
W20260709 13:12:22.585471 29419 connection.cc:256] RPC call timeout handler was delayed by -1.678803476999974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1743s for a response
I20260709 13:12:22.567314 31552 raft_consensus.cc:3055] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:12:22.614158 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:22.617271 29419 connection.cc:256] RPC call timeout handler was delayed by -1.525803476999954s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19130000000000003s for a response
W20260709 13:12:22.617705 29419 connection.cc:256] RPC call timeout handler was delayed by -1.4826034770001115s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19610000000000002s for a response
W20260709 13:12:22.618646 31867 log.cc:927] Time spent T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:12:22.618517 29278 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35182 (request call id 58) took 4007 ms. Trace:
I20260709 13:12:22.609552 31552 raft_consensus.cc:740] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:22.621502 31711 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:22.623803 31808 consensus_queue.cc:1048] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:22.624789 31571 consensus_queue.cc:1059] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:12:22.625561 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:22.652448 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:22.652882 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:22.653347 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:22.634744 29419 connection.cc:256] RPC call timeout handler was delayed by -1.4673034770000868s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1978s for a response
I20260709 13:12:22.620043 31764 raft_consensus.cc:3055] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:22.647173 31501 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:22.658288 29419 connection.cc:256] RPC call timeout handler was delayed by -1.3737034769999354s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2082s for a response
W20260709 13:12:22.659072 29419 connection.cc:256] RPC call timeout handler was delayed by -1.3467034770001192s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21120000000000003s for a response
W20260709 13:12:22.659617 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:22.645867 29346 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:22.626109 31863 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.623835 31555 consensus_queue.cc:260] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:22.648347 31819 consensus_queue.cc:1048] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
W20260709 13:12:22.686575 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:22.703421 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:22.682235 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:22.710045 29521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 1158) took 1319 ms. Trace:
I20260709 13:12:22.655110 31786 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:22.710987 29521 rpcz_store.cc:276] 0709 13:12:21.381979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:22.210123 (+828144us) service_pool.cc:224] Handling call
0709 13:12:22.210637 (+   514us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:22.211427 (+   790us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:22.211462 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:22.212129 (+   667us) log.cc:844] Serialized 26 byte log entry
0709 13:12:22.362339 (+150210us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:22.362397 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:22.362485 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:22.666736 (+304251us) raft_consensus.cc:1685] finished
0709 13:12:22.666763 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:22.700968 (+ 34205us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":142,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":244,"thread_start_us":149738,"threads_started":1,"wal-append.queue_time_us":267415}
I20260709 13:12:22.716323 29524 raft_consensus.cc:1240] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:22.716925 31835 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:22.717338 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:12:22.720062 29419 connection.cc:256] RPC call timeout handler was delayed by -1.2738034770000013s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21930000000000002s for a response
I20260709 13:12:22.665894 31555 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:22.731416 29526 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:22.731873 29419 connection.cc:256] RPC call timeout handler was delayed by -1.2486034769999605s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22210000000000002s for a response
I20260709 13:12:22.733717 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:22.736629 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:22.716329 31871 log.cc:927] Time spent T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:12:22.733575 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:22.655965 31764 raft_consensus.cc:740] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:22.717373 31795 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:22.743244 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:12:22.761201 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 167221us
I20260709 13:12:22.745265 31835 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:12:22.764772 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:22.764591 29521 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:22.686053 31501 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:22.733731 31711 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:22.768006 29529 raft_consensus.cc:1275] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:12:22.740253 31863 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:22.788609 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:22.792120 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:22.791091 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:22.743467 31584 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:22.665755 31862 consensus_queue.cc:1048] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.123s
I20260709 13:12:22.747833 31571 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:22.801637 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:22.764359 31835 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:22.810386 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:22.796196 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 187575us
I20260709 13:12:22.803809 29522 raft_consensus.cc:1275] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:12:22.809252 31501 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:22.816180 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:22.794404 31802 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.809753 29447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1724) took 2223 ms. Trace:
I20260709 13:12:22.818667 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:22.802003 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:22.802860 29344 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:22.814603 29523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2045) took 1847 ms. Trace:
I20260709 13:12:22.837311 29379 raft_consensus.cc:2393] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 6: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:22.641861 29278 rpcz_store.cc:276] 0709 13:12:18.611271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.611442 (+   171us) service_pool.cc:224] Handling call
0709 13:12:22.618143 (+4006701us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:20.104271 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:20.234596 (+130325us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:20.234642 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:12:20.234659 (+    17us) tablet.cc:662] Decoding operations
0709 13:12:20.235104 (+   445us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:20.235165 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:20.235198 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:12:20.235420 (+   222us) tablet.cc:701] Row locks acquired
0709 13:12:20.235445 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:12:20.235659 (+   214us) write_op.cc:270] Start()
0709 13:12:20.235791 (+   132us) write_op.cc:276] Timestamp: P: 1783602740235599 usec, L: 0
0709 13:12:20.235814 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:12:20.236681 (+   867us) log.cc:844] Serialized 538 byte log entry
0709 13:12:20.646694 (+410013us) op_driver.cc:464] REPLICATION: finished
0709 13:12:20.820400 (+173706us) write_op.cc:301] APPLY: starting
0709 13:12:20.820522 (+   122us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:20.820670 (+   148us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:20.820849 (+   179us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:20.821182 (+   333us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:20.843792 (+ 22610us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:12:20.867557 (+ 23765us) write_op.cc:312] APPLY: finished
0709 13:12:20.874762 (+  7205us) log.cc:844] Serialized 22 byte log entry
0709 13:12:20.874982 (+   220us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:20.875081 (+    99us) write_op.cc:454] Released schema lock
0709 13:12:20.875148 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:20.875626 (+   478us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:20.875654 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":55690,"mutex_wait_us":5234,"reported_tablets":3,"spinlock_wait_cycles":740864,"child_traces":[["op",{"apply.queue_time_us":168462,"apply.run_cpu_time_us":2651,"apply.run_wall_time_us":55242,"num_ops":1,"prepare.queue_time_us":840030,"prepare.run_cpu_time_us":20781,"prepare.run_wall_time_us":356480,"raft.queue_time_us":134080,"raft.run_cpu_time_us":10966,"raft.run_wall_time_us":100438,"replication_time_us":385609,"thread_start_us":839688,"threads_started":4,"wal-append.queue_time_us":225813,"wal-append.run_cpu_time_us":19836,"wal-append.run_wall_time_us":1441675}]]}
I20260709 13:12:22.844419 29381 raft_consensus.cc:1240] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:12:22.846144 29373 raft_consensus.cc:1275] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:12:22.833941 31802 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:22.849028 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:22.850037 31802 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:22.827268 31571 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:22.819139 29447 rpcz_store.cc:276] 0709 13:12:20.438074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:20.449258 (+ 11184us) service_pool.cc:224] Handling call
0709 13:12:20.449708 (+   450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:20.449992 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:12:20.922603 (+472611us) log.cc:844] Serialized 14 byte log entry
0709 13:12:22.590994 (+1668391us) log.cc:844] Serialized 14 byte log entry
0709 13:12:22.597641 (+  6647us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:22.609538 (+ 11897us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:22.614999 (+  5461us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:22.651163 (+ 36164us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:22.661722 (+ 10559us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":674687,"prepare.queue_time_us":388505,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":81,"raft.queue_time_us":775071,"raft.run_cpu_time_us":549,"raft.run_wall_time_us":13498,"thread_start_us":1284971,"threads_started":4,"wal-append.queue_time_us":549497}
I20260709 13:12:22.843348 31764 consensus_queue.cc:260] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:22.855930 31879 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:22.856902 31571 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:22.856667 31879 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:22.859048 31879 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:22.819151 31584 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:22.860004 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:22.860670 29377 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 8.
I20260709 13:12:22.861346 31584 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:22.866649 31853 consensus_queue.cc:1048] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:22.867513 31785 consensus_queue.cc:1048] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:22.828007 31819 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:22.839143 31568 raft_consensus.cc:2804] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:22.872869 29521 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:22.876225 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:22.820953 29523 rpcz_store.cc:276] 0709 13:12:20.967411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:21.204642 (+237231us) service_pool.cc:224] Handling call
0709 13:12:21.204951 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:21.205344 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:12:22.131198 (+925854us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b18002846e0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c13c0a 00007f6a82353219 00007f6a78c9ba40 00007f6a78c964e4 00007f6a78c96455 00007f6a7f77e3c7 00007f6a7bd909a7 00007f6a7bda00bf 00007f6a7bda0038
0709 13:12:22.355444 (+224246us) log.cc:844] Serialized 14 byte log entry
0709 13:12:22.553298 (+197854us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:22.648157 (+ 94859us) log.cc:844] Serialized 26 byte log entry
0709 13:12:22.652551 (+  4394us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:22.652596 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:22.652669 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:22.812252 (+159583us) raft_consensus.cc:1685] finished
0709 13:12:22.814199 (+  1947us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:22.814395 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47332,"prepare.queue_time_us":1007505,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":52,"raft.queue_time_us":4455,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":45765,"spinlock_wait_cycles":43127552,"thread_start_us":267583,"threads_started":2,"wal-append.queue_time_us":221249}
W20260709 13:12:22.883952 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 89388.3us
I20260709 13:12:22.887724 29525 raft_consensus.cc:1275] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:12:22.888629 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:22.892467 29525 pending_rounds.cc:85] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 2
I20260709 13:12:22.821130 31552 consensus_queue.cc:260] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:22.854283 31501 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.872161 31787 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:22.906196 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:22.892970 29525 pending_rounds.cc:107] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:12:22.908336 29525 raft_consensus.cc:2889] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:22.905789 29421 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:22.909235 29344 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:22.883121 31863 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:22.917639 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:22.922331 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 108907us
I20260709 13:12:22.894374 31568 raft_consensus.cc:697] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:22.880030 31584 consensus_queue.cc:1048] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:12:22.888995 31571 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:22.882818 31819 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:22.934429 29523 raft_consensus.cc:1275] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:12:22.923424 31879 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:22.916841 31835 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:22.944693 31877 log.cc:927] Time spent T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:12:22.946400 31501 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:22.906553 31862 consensus_queue.cc:1059] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:12:22.931219 31251 raft_consensus.cc:2804] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:12:22.951813 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:22.983011 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:12:22.948529 29346 leader_election.cc:336] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 1.630s (SENT)
I20260709 13:12:22.995164 29447 raft_consensus.cc:1275] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:12:22.941845 31552 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:22.942799 31879 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:22.930351 31787 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:22.983865 31764 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:22.984977 31853 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:23.021983 31880 log.cc:927] Time spent T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:12:23.030216 29454 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0"
dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:45798
I20260709 13:12:23.031240 29454 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:23.031745 29454 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:23.031567 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:23.035923 29451 raft_consensus.cc:2376] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7. Re-sending same reply.
I20260709 13:12:23.038839 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:23.044943 31819 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:23.045264 29450 raft_consensus.cc:1240] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:23.013994 31879 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:22.982853 31571 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:12:23.056010 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 150296us
I20260709 13:12:23.059374 29447 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:12:23.060439 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 119547us
I20260709 13:12:23.066465 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:23.067734 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:12:23.069631 31873 log.cc:927] Time spent T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.363s	user 0.009s	sys 0.000s
I20260709 13:12:23.033527 31861 raft_consensus.cc:3055] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:23.032217 31835 raft_consensus.cc:3055] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:12:23.077513 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 85491.1us
I20260709 13:12:23.096244 29526 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:23.087785 29452 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
W20260709 13:12:23.103420 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:23.106218 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:23.107019 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:23.098347 29455 raft_consensus.cc:2468] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
W20260709 13:12:23.126544 29346 leader_election.cc:336] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 1.781s (SENT)
I20260709 13:12:23.057098 31853 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:23.098866 31861 raft_consensus.cc:740] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:23.127130 29346 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:23.108476 31251 raft_consensus.cc:697] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:23.105243 31835 raft_consensus.cc:740] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:23.142653 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:12:23.143352 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:23.071838 31568 consensus_queue.cc:237] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:23.163756 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 246496us
W20260709 13:12:23.173471 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:23.196105 29455 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:23.158000 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:23.200371 29450 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:23.210002 29528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2063) took 1219 ms. Trace:
I20260709 13:12:23.201531 31575 raft_consensus.cc:2749] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:23.210752 29528 rpcz_store.cc:276] 0709 13:12:21.990591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:22.401888 (+411297us) service_pool.cc:224] Handling call
0709 13:12:22.402378 (+   490us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:22.403033 (+   655us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:22.403063 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:22.442094 (+ 39031us) log.cc:844] Serialized 26 byte log entry
0709 13:12:22.609966 (+167872us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:22.610021 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:22.610115 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:22.896966 (+286851us) spinlock_profiling.cc:243] Waited 5.56 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:12:23.204553 (+307587us) raft_consensus.cc:1685] finished
0709 13:12:23.204594 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:23.209880 (+  5286us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3054,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":6624,"spinlock_wait_cycles":12786944,"thread_start_us":141320,"threads_started":1,"wal-append.queue_time_us":189039}
I20260709 13:12:23.233175 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:12:23.255679 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 129191us
I20260709 13:12:23.240630 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:12:23.234907 31887 log.cc:927] Time spent T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.230s	user 0.000s	sys 0.002s
W20260709 13:12:23.276239 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 229886us
I20260709 13:12:23.273365 29455 raft_consensus.cc:1275] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:12:23.277957 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:23.255211 31501 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:23.254884 31763 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.294828 29452 raft_consensus.cc:1275] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:12:23.295943 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:23.302177 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 166388us
I20260709 13:12:23.296825 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:23.233148 31251 consensus_queue.cc:237] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:23.233433 31835 consensus_queue.cc:260] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:23.319067 29455 raft_consensus.cc:1275] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:12:23.310153 29378 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 4.
I20260709 13:12:23.230016 31861 consensus_queue.cc:260] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:23.287257 31571 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:12:23.316365 31891 log.cc:927] Time spent T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:12:23.322710 29372 raft_consensus.cc:1240] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:23.319608 29455 pending_rounds.cc:85] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 3
I20260709 13:12:23.326793 29455 pending_rounds.cc:107] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:12:23.327278 29455 raft_consensus.cc:2889] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:23.351280 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 55255.6us
I20260709 13:12:23.348748 29454 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:23.340186 31890 log.cc:927] Time spent T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:12:23.357194 29450 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:12:23.357627 31889 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.358886 29495 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:23.359345 29454 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:23.359804 31861 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:23.360682 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:23.365820 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 87345us
I20260709 13:12:23.293224 31763 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:23.367548 29421 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:12:23.372562 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:23.352380 31853 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:23.378155 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:23.379680 29456 raft_consensus.cc:1240] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:23.375168 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:23.375722 31571 raft_consensus.cc:2804] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:12:23.383127 31555 consensus_meta.cc:287] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.641s	user 0.007s	sys 0.006s
W20260709 13:12:23.385293 31881 log.cc:927] Time spent T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.358s	user 0.002s	sys 0.000s
I20260709 13:12:23.387988 31785 consensus_queue.cc:1048] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:23.389498 31798 consensus_queue.cc:1048] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:12:23.397748 31886 log.cc:927] Time spent T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.384s	user 0.002s	sys 0.005s
I20260709 13:12:23.387298 29495 leader_election.cc:304] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:23.413645 29447 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:23.426146 29449 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:23.373334 31802 raft_consensus.cc:2749] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:23.429462 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:23.410476 31711 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:23.415897 31571 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:23.376164 31889 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:23.457245 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:12:23.676594 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:23.452600 29454 raft_consensus.cc:1275] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:12:23.576786 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:23.573743 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:23.702986 29526 raft_consensus.cc:2410] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:12:23.636739 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:23.608793 29528 raft_consensus.cc:1275] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:23.721326 29449 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:12:23.724818 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:23.726004 29449 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
W20260709 13:12:23.525198 29346 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 2.321s (SENT) [suppressed 30 similar messages]
W20260709 13:12:23.797001 30119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:23.799993 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:12:23.547582 30122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:23.547817 31552 consensus_meta.cc:287] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.536s	user 0.009s	sys 0.005s
I20260709 13:12:23.798868 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:23.804651 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:12:23.643420 31786 consensus_meta.cc:287] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.879s	user 0.003s	sys 0.013s
W20260709 13:12:23.575621 31764 consensus_meta.cc:287] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.541s	user 0.010s	sys 0.004s
I20260709 13:12:23.809046 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:23.451457 31571 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:23.671440 31905 log.cc:927] Time spent T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.122s	user 0.001s	sys 0.001s
I20260709 13:12:23.736186 29447 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:12:23.469226 31802 raft_consensus.cc:2749] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:23.673282 31763 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:23.799604 31722 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:23.821813 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 434659us
I20260709 13:12:23.827601 29448 raft_consensus.cc:1275] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:12:23.820564 29381 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
I20260709 13:12:23.819285 29522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2087) took 1109 ms. Trace:
W20260709 13:12:23.820868 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 295700us
I20260709 13:12:23.458055 31711 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:23.573452 31879 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:23.826151 29452 raft_consensus.cc:1275] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:12:23.831988 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:23.833542 29449 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:23.828385 29522 rpcz_store.cc:276] 0709 13:12:22.710401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:22.850278 (+139877us) service_pool.cc:224] Handling call
0709 13:12:22.850690 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:22.851162 (+   472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:22.851194 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:22.862991 (+ 11797us) log.cc:844] Serialized 26 byte log entry
0709 13:12:23.391314 (+528323us) spinlock_profiling.cc:243] Waited 8.44 ms on lock 0x7b18003cbfe0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c7be07 00007f6a81ad6ab9 00007f6a78c9869b 00007f6a78c9693f 00007f6a78c98c02 00007f6a7b92020b 00007f6a7b925d23 00007f6a7b9260d1 00007f6a7bd41a0f
0709 13:12:23.432796 (+ 41482us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:23.432838 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:23.432911 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:23.810436 (+377525us) raft_consensus.cc:1685] finished
0709 13:12:23.810460 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:23.819195 (+  8735us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2636,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":12185,"spinlock_wait_cycles":19413248,"thread_start_us":41263,"threads_started":1,"wal-append.queue_time_us":664371}
I20260709 13:12:23.837874 29448 raft_consensus.cc:1275] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:12:23.838618 29448 pending_rounds.cc:85] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 5
I20260709 13:12:23.838917 29448 pending_rounds.cc:107] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:12:23.839071 29448 raft_consensus.cc:2889] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:23.841585 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:23.829945 30154 consensus_queue.cc:237] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:23.857295 29450 raft_consensus.cc:2393] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 9: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:23.873636 29447 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
I20260709 13:12:23.876039 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:23.883566 31787 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:23.884202 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:23.884992 29454 raft_consensus.cc:2393] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 7: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:23.885078 31889 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:23.886085 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:23.886822 29454 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:23.877308 29495 leader_election.cc:400] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9.
I20260709 13:12:23.887926 29495 leader_election.cc:403] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:12:23.891152 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:23.891948 31787 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9.
I20260709 13:12:23.892005 29372 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:12:23.898591 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:23.836949 31722 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:23.926055 29454 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:23.903853 31889 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:23.929957 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:23.939916 31889 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:23.941294 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:23.942503 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:23.926296 29421 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:23.942953 31889 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:12:23.930665 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:23.935988 31915 consensus_queue.cc:1048] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:23.936798 29381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52172 (request call id 1235) took 1077 ms. Trace:
I20260709 13:12:23.944183 29381 rpcz_store.cc:276] 0709 13:12:22.874386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:22.875771 (+  1385us) service_pool.cc:224] Handling call
0709 13:12:23.936527 (+1060756us) spinlock_profiling.cc:243] Waited 937 ms on lock 0x7b54003f3754. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:23.936667 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2154447104}
I20260709 13:12:23.945207 31711 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:23.945243 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:23.946861 31879 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:23.951830 31861 consensus_meta.cc:287] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.578s	user 0.011s	sys 0.003s
I20260709 13:12:23.961486 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:23.962239 29523 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:23.964087 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:23.965319 29525 raft_consensus.cc:2410] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:12:23.905097 31787 consensus_queue.cc:1059] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:12:23.977079 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:23.970464 29449 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:12:23.978245 29450 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:23.978983 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:23.927647 29447 raft_consensus.cc:1275] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:12:23.985838 29421 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:23.996150 31722 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:23.998569 31711 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:23.977896 31862 consensus_queue.cc:1048] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:12:23.999996 31798 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:24.000576 31798 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:24.003918 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:24.004390 29377 raft_consensus.cc:1275] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:12:24.004586 29381 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:24.005606 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:24.009253 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:23.977239 31889 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:24.011102 31889 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.011463 31889 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:24.015612 31501 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:23.995258 31787 raft_consensus.cc:3055] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:24.016705 31787 raft_consensus.cc:740] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:24.017707 31787 consensus_queue.cc:260] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:24.019097 31787 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:24.023980 31798 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:24.032831 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:24.016155 31501 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:24.096099 31501 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:24.042271 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:23.999212 31711 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:24.044691 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:24.047480 29529 raft_consensus.cc:1275] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:12:24.052577 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:24.121125 29450 raft_consensus.cc:2393] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 6: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:24.122120 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:24.122901 29450 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
I20260709 13:12:24.123329 29344 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:24.054113 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:24.123920 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:24.122112 31711 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:24.125653 31853 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:24.124760 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:24.062340 29381 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
W20260709 13:12:24.064790 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:24.066731 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:12:24.088821 31900 log.cc:927] Time spent T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.802s	user 0.004s	sys 0.000s
I20260709 13:12:24.131315 29450 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
I20260709 13:12:24.131779 29456 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
I20260709 13:12:24.094133 29379 raft_consensus.cc:3055] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:24.053378 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:24.126194 31853 raft_consensus.cc:697] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:24.114475 29276 catalog_manager.cc:5697] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:24.061887 29525 raft_consensus.cc:1275] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:24.131762 29451 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:12:24.132992 29379 raft_consensus.cc:740] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:24.099486 31835 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:24.157053 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:24.140655 29419 connection.cc:256] RPC call timeout handler was delayed by -1.5204409160000978s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19910000000000003s for a response
I20260709 13:12:24.164397 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:24.161775 30986 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.167837 30986 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:24.145717 29447 raft_consensus.cc:1275] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:24.162261 29372 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
W20260709 13:12:24.166770 29419 connection.cc:256] RPC call timeout handler was delayed by -1.4440403220000917s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1988s for a response
W20260709 13:12:24.158660 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 53588.1us
I20260709 13:12:24.174918 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:24.177497 30986 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:24.141460 29379 consensus_queue.cc:260] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:24.137027 31571 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:24.181216 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:24.181964 29453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1744) took 1113 ms. Trace:
I20260709 13:12:24.189164 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:24.189845 29448 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
I20260709 13:12:24.191566 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:24.192353 29450 raft_consensus.cc:2393] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 6: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
W20260709 13:12:24.194729 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:24.195741 29375 raft_consensus.cc:1240] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:24.195917 31787 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:24.196753 31787 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:24.199618 31787 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:24.164970 29276 catalog_manager.cc:5697] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 4 to 7, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 7 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:24.207688 29379 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:24.211577 29276 catalog_manager.cc:5697] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.212816 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:24.213558 29448 raft_consensus.cc:2468] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
W20260709 13:12:24.228996 29495 connection.cc:256] RPC call timeout handler was delayed by -1.5125766210001075s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16210000000000002s for a response
W20260709 13:12:24.229593 29495 connection.cc:256] RPC call timeout handler was delayed by -1.4360766210002112s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1706s for a response
W20260709 13:12:24.229893 29495 connection.cc:256] RPC call timeout handler was delayed by -1.3127766210002392s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18430000000000002s for a response
W20260709 13:12:24.230176 29495 connection.cc:256] RPC call timeout handler was delayed by -1.2983766210002159s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1859s for a response
W20260709 13:12:24.230626 29495 connection.cc:256] RPC call timeout handler was delayed by -1.2461766210001315s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1917s for a response
W20260709 13:12:24.231077 29495 connection.cc:256] RPC call timeout handler was delayed by -1.0850766210000984s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2096s for a response
W20260709 13:12:24.231441 29495 connection.cc:256] RPC call timeout handler was delayed by -1.0256766210002297s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2162s for a response
I20260709 13:12:24.232544 29454 raft_consensus.cc:2393] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 5: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
W20260709 13:12:24.232563 29495 connection.cc:256] RPC call timeout handler was delayed by -1.0193766210002195s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2169s for a response
I20260709 13:12:24.143941 31780 consensus_queue.cc:1048] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:12:24.180361 31762 raft_consensus.cc:493] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:24.186132 29453 rpcz_store.cc:276] 0709 13:12:23.028805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:23.068663 (+ 39858us) service_pool.cc:224] Handling call
0709 13:12:23.069074 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:23.104051 (+ 34977us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:23.104089 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:23.140115 (+ 36026us) log.cc:844] Serialized 26 byte log entry
0709 13:12:23.283567 (+143452us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:23.283622 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:23.283698 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:24.087756 (+804058us) spinlock_profiling.cc:243] Waited 6.43 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:12:24.141532 (+ 53776us) raft_consensus.cc:1685] finished
0709 13:12:24.141564 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:24.141847 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19249,"raft.queue_time_us":34827,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":14331,"spinlock_wait_cycles":14777728,"thread_start_us":126366,"threads_started":1,"wal-append.queue_time_us":146094}
I20260709 13:12:24.236342 31787 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.255893 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:24.175176 31853 consensus_queue.cc:237] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:24.259687 29448 raft_consensus.cc:1275] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:12:24.242518 31501 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:24.262146 29447 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
I20260709 13:12:24.263114 31724 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.263008 29276 catalog_manager.cc:5697] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 4 to 6, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 6 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.263724 31724 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:24.264447 29495 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:24.264989 29276 catalog_manager.cc:5697] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 4 to 6, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 6 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:24.266007 31724 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:24.265861 29495 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:24.267524 29448 raft_consensus.cc:1240] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:24.266610 29276 catalog_manager.cc:5697] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.268697 31912 raft_consensus.cc:2749] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:24.269523 31912 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:24.270170 29276 catalog_manager.cc:5697] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 6 to 7, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 7 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.271812 29449 raft_consensus.cc:2393] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 6: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:24.272375 29276 catalog_manager.cc:5697] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 5 to 6, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 6 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:24.274240 29276 catalog_manager.cc:5697] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.276439 31501 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:24.277082 31924 log.cc:927] Time spent T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:12:24.279134 29495 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:24.280164 31802 raft_consensus.cc:2804] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:24.280597 31802 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:24.281006 31802 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:24.284924 31571 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:24.309852 31921 log.cc:927] Time spent T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:12:24.309664 31802 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:24.314664 31912 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:24.315412 31912 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:24.317966 31912 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:24.315794 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:24.320457 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 149075us
W20260709 13:12:24.336333 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 152789us
W20260709 13:12:24.338864 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 160512us
W20260709 13:12:24.341549 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 62521.8us
I20260709 13:12:24.363029 29495 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:24.252923 31762 raft_consensus.cc:515] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:12:24.373407 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:24.385954 29495 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:24.319126 31787 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:24.372098 31912 raft_consensus.cc:2749] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:24.359876 31889 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:24.401372 30119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:24.363850 31928 consensus_queue.cc:1048] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
W20260709 13:12:24.390070 29419 leader_election.cc:336] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.524s (SENT)
I20260709 13:12:24.404808 29419 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:24.407977 29495 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:24.412547 29450 raft_consensus.cc:1240] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:12:24.409571 31879 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:24.432430 29375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52172 (request call id 1244) took 1152 ms. Trace:
I20260709 13:12:24.398149 31919 raft_consensus.cc:2804] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:24.448448 31919 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:12:24.448822 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:24.448947 31919 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:24.436249 29451 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45798 (request call id 1754) took 1210 ms (client timeout 1578 ms). Trace:
W20260709 13:12:24.452857 29451 rpcz_store.cc:269] 0709 13:12:23.220941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:23.221177 (+   236us) service_pool.cc:224] Handling call
0709 13:12:24.431246 (+1210069us) spinlock_profiling.cc:243] Waited 717 ms on lock 0x7b54002526d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:24.431413 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1649707904}
I20260709 13:12:24.437839 31762 leader_election.cc:290] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:24.444061 31912 raft_consensus.cc:2749] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:24.444878 29453 raft_consensus.cc:1240] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:24.457396 31889 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:24.432986 29375 rpcz_store.cc:276] 0709 13:12:23.280463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:23.280602 (+   139us) service_pool.cc:224] Handling call
0709 13:12:23.289798 (+  9196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:24.196263 (+906465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:24.432145 (+235882us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b54003bb854. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:24.432349 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1997133184}
W20260709 13:12:24.464615 31925 log.cc:927] Time spent T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.166s	user 0.003s	sys 0.001s
I20260709 13:12:24.466485 29379 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 7.
W20260709 13:12:24.468106 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 53915.3us
I20260709 13:12:24.469259 29346 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:24.471025 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 47183us
I20260709 13:12:24.475594 31763 raft_consensus.cc:2804] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:24.476257 31763 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.476718 31763 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:24.479708 31895 consensus_queue.cc:1048] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:24.481488 31251 consensus_queue.cc:1048] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:12:24.494916 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 59432.8us
I20260709 13:12:24.502846 29455 raft_consensus.cc:2410] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:12:24.446118 31787 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:24.412940 31802 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:24.514904 31898 raft_consensus.cc:2955] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 LEADER]: Committing config change with OpId 6.7: config changed from index 5 to 7, VOTER 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:12:24.518034 29529 raft_consensus.cc:2955] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 5 to 7, VOTER 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
W20260709 13:12:24.532805 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 147245us
W20260709 13:12:24.533795 29419 leader_election.cc:336] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.575s (SENT)
I20260709 13:12:24.534308 29419 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:24.538815 31835 raft_consensus.cc:2749] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:24.539305 31713 consensus_queue.cc:1048] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:24.539618 31711 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.540665 31711 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:24.542975 31711 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:24.549939 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 140616us
I20260709 13:12:24.467243 29379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52172 (request call id 1247) took 1056 ms. Trace:
W20260709 13:12:24.559245 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 44453.2us
I20260709 13:12:24.558734 29379 rpcz_store.cc:276] 0709 13:12:23.410835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:23.411188 (+   353us) service_pool.cc:224] Handling call
0709 13:12:24.093971 (+682783us) spinlock_profiling.cc:243] Waited 3.79 ms on lock 0x7b540005bca0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bcfddc0 00007f6a7bd89e18 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:24.467168 (+373197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8722688}
I20260709 13:12:24.563161 29344 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:24.555760 31575 consensus_queue.cc:1048] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
W20260709 13:12:24.568928 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:24.564934 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:24.571204 31251 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:24.571926 31251 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:24.572477 31251 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:24.554764 31919 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:24.573621 31575 consensus_queue.cc:1048] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:12:24.573681 29419 leader_election.cc:336] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.639s (SENT)
W20260709 13:12:24.577876 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 173885us
I20260709 13:12:24.578028 31919 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:24.578742 29419 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:24.589694 31898 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:40114 (request call id 0) took 1186 ms. Trace:
I20260709 13:12:24.589923 31835 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:24.589304 29419 leader_election.cc:336] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.653s (SENT)
I20260709 13:12:24.591130 29419 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:24.588783 29495 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:12:24.592479 29419 leader_election.cc:336] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.715s (SENT)
I20260709 13:12:24.592823 31919 raft_consensus.cc:2749] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:24.593760 31835 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:24.595148 29495 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:12:24.595822 29419 leader_election.cc:336] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.795s (SENT)
I20260709 13:12:24.595889 31713 consensus_queue.cc:1048] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:24.596565 29419 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:24.597388 31835 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:12:24.598752 29419 leader_election.cc:336] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.797s (SENT)
I20260709 13:12:24.599308 29419 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:24.601450 31835 raft_consensus.cc:2749] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:12:24.602802 29419 leader_election.cc:336] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.913s (SENT)
W20260709 13:12:24.604744 29419 leader_election.cc:336] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.918s (SENT)
I20260709 13:12:24.606150 29419 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:24.635143 29346 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:24.639093 29495 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:12:24.648707 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 43990.1us
I20260709 13:12:24.648926 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:24.649537 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:24.650174 29526 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:12:24.645460 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:24.636118 31251 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:24.656148 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:24.656581 29521 raft_consensus.cc:1275] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:12:24.657567 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:24.661454 29346 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:24.663694 29346 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:24.658151 29528 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:12:24.619975 31835 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:24.664917 29522 raft_consensus.cc:2468] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
I20260709 13:12:24.636929 31919 raft_consensus.cc:2804] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:12:24.672366 29419 leader_election.cc:336] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.961s (SENT)
I20260709 13:12:24.672889 29419 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:24.689296 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:24.692306 31251 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:24.693410 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 54449.4us
I20260709 13:12:24.702778 29346 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:24.675619 31552 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:24.698033 31889 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:24.676393 31919 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:24.699981 31710 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:24.696435 31940 raft_consensus.cc:2749] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:24.590142 31898 rpcz_store.cc:276] 0709 13:12:23.403355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:23.419416 (+ 16061us) service_pool.cc:224] Handling call
0709 13:12:23.845172 (+425756us) log.cc:844] Serialized 508 byte log entry
0709 13:12:24.589594 (+744422us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23950,"raft.run_cpu_time_us":1335,"raft.run_wall_time_us":26636,"thread_start_us":79961,"threads_started":1,"wal-append.queue_time_us":141933}
I20260709 13:12:24.700248 31798 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:24.711095 31919 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:24.725064 29344 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:24.717273 31710 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.718727 31711 raft_consensus.cc:2804] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:24.710417 31713 consensus_queue.cc:1048] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:12:24.710310 31724 consensus_queue.cc:1048] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:12:24.728329 31552 raft_consensus.cc:697] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:24.737884 31710 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:24.748327 31552 consensus_queue.cc:237] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:24.751713 31929 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:24.752242 31929 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:24.755362 29419 leader_election.cc:336] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 2.112s (SENT)
I20260709 13:12:24.771247 29419 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:24.768337 31889 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.769290 29495 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:24.769701 29344 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:24.734508 29263 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet eb6a9a102eba49209ddf2bdf286077e8 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:24.777254 29495 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:24.739398 31711 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.780445 29495 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:24.779109 29263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 46699.4us
W20260709 13:12:24.790751 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:24.792343 29495 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:24.814179 29495 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:12:24.819242 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 116541us
I20260709 13:12:24.775151 31929 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:24.814179 29344 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:24.792129 31711 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:24.791038 31802 raft_consensus.cc:2804] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:24.835620 29344 leader_election.cc:304] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:24.795619 31501 raft_consensus.cc:2749] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:24.795105 31787 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:24.819049 31764 raft_consensus.cc:2804] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:24.779390 31798 consensus_queue.cc:1048] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:12:24.788407 31889 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:24.848867 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 106464us
I20260709 13:12:24.788466 31763 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:24.854530 29346 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:24.838655 31802 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:24.861219 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 66810.5us
I20260709 13:12:24.843654 31764 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.843400 31787 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.856335 31713 raft_consensus.cc:2749] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:24.840636 31928 consensus_queue.cc:1048] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:12:24.852118 31951 raft_consensus.cc:2804] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:12:24.875631 29419 leader_election.cc:336] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 2.193s (SENT)
I20260709 13:12:24.864552 31802 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:24.870355 31764 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:24.890482 29419 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:24.871222 31787 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:24.905521 29495 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:24.908591 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 54148.4us
I20260709 13:12:24.909479 29346 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:24.907624 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:24.913573 29526 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:24.874769 31949 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:24.883505 31951 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.910597 29346 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:24.903626 31945 log.cc:927] Time spent T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
W20260709 13:12:24.922129 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 54960.7us
I20260709 13:12:24.914603 31954 raft_consensus.cc:2804] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:12:24.920604 31944 log.cc:927] Time spent T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.187s	user 0.001s	sys 0.001s
I20260709 13:12:24.915124 31501 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:24.937220 31552 raft_consensus.cc:2749] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:24.914919 31762 raft_consensus.cc:2804] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:24.922901 31949 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.945349 31954 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:24.991072 31954 raft_consensus.cc:3060] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:24.996915 30119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:24.925287 31951 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:24.998850 29526 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
W20260709 13:12:25.003952 29419 connection.cc:256] RPC call timeout handler was delayed by -1.2425232890000188s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2647s for a response
W20260709 13:12:25.005000 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 62288.7us
I20260709 13:12:25.006160 29346 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:25.010622 29344 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:25.012089 29346 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:24.951349 31762 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.993527 31949 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:25.033577 29419 leader_election.cc:336] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 3.220s (SENT)
I20260709 13:12:25.035877 29419 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:24.997314 31575 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:25.036867 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:25.012656 31928 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:25.018086 31713 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:25.017071 31908 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:25.048468 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:25.023185 31762 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:24.991971 31957 consensus_queue.cc:1048] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.092s
I20260709 13:12:25.035524 31962 raft_consensus.cc:2804] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:25.043399 31835 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:12:25.075950 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 57573.3us
I20260709 13:12:25.031810 31786 consensus_queue.cc:1048] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:12:25.085724 29419 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:25.061007 31713 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:25.078913 29380 raft_consensus.cc:1240] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:25.045773 31912 raft_consensus.cc:2804] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:25.045754 31964 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:25.076654 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 124625us
I20260709 13:12:25.089610 31501 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:25.089828 29372 raft_consensus.cc:1275] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:25.079514 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:25.077363 31962 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:25.079669 31763 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:25.080022 31908 raft_consensus.cc:697] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:25.092154 31889 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:25.095875 31713 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:25.045987 31575 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:25.155432 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:12:25.147993 31922 log.cc:927] Time spent T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:12:25.161649 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:25.143891 31955 log.cc:927] Time spent T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:12:25.143153 31835 raft_consensus.cc:2749] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:25.173115 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:25.155961 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 210915us
I20260709 13:12:25.170579 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:25.173972 29381 raft_consensus.cc:2393] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 6: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:25.109584 31970 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:25.122283 31501 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:25.111413 31964 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:25.318840 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:25.147033 31962 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:25.186004 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:25.175040 29377 raft_consensus.cc:2393] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 6: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
W20260709 13:12:25.224303 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:25.243093 31919 consensus_meta.cc:287] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.503s	user 0.013s	sys 0.000s
W20260709 13:12:25.245126 31937 log.cc:927] Time spent T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b: Append to log took a long time: real 0.478s	user 0.000s	sys 0.005s
I20260709 13:12:25.252964 31974 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:25.357404 31251 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:25.357712 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:25.358438 29528 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:25.336153 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 250521us
W20260709 13:12:25.239931 31956 log.cc:927] Time spent T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:12:25.360306 31967 consensus_queue.cc:1059] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:25.361081 31501 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:25.361379 31967 raft_consensus.cc:3055] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:25.361809 31967 raft_consensus.cc:740] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:25.361984 31575 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:25.362807 31967 consensus_queue.cc:260] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:25.364336 31967 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:25.301419 31835 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:25.365020 31764 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:25.366417 31835 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:25.368433 31951 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:25.369874 29379 raft_consensus.cc:2368] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5.
I20260709 13:12:25.308106 31975 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:25.357649 31974 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:25.370563 31975 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:25.361781 29419 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:25.372924 31501 raft_consensus.cc:2749] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:25.238737 31908 consensus_queue.cc:237] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:25.373806 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:25.357327 29346 connection.cc:256] RPC call timeout handler was delayed by -1.0392658680000295s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1876s for a response
I20260709 13:12:25.374217 29419 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:25.376159 31889 raft_consensus.cc:2749] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:25.376688 29521 raft_consensus.cc:1240] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:25.377089 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:25.377884 31251 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:25.356215 31802 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:25.379904 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:25.154361 31961 consensus_queue.cc:1059] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.196s
I20260709 13:12:25.384222 31961 raft_consensus.cc:3055] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:25.384683 31961 raft_consensus.cc:740] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
W20260709 13:12:25.385653 31711 consensus_meta.cc:287] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.537s	user 0.012s	sys 0.000s
I20260709 13:12:25.385596 31961 consensus_queue.cc:260] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:25.386953 31961 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:25.386597 31711 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:25.388178 29421 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:25.389062 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:25.389698 29452 raft_consensus.cc:2376] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3. Re-sending same reply.
I20260709 13:12:25.391323 31711 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:25.392274 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:25.392575 31912 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:25.392951 29452 raft_consensus.cc:2376] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6. Re-sending same reply.
I20260709 13:12:25.393100 31912 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:25.357132 31785 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.394955 31785 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:25.336882 31940 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:25.399597 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:25.334632 31957 consensus_queue.cc:1059] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:12:25.400993 31957 raft_consensus.cc:3055] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:25.401396 31957 raft_consensus.cc:740] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:25.402069 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:25.402312 31957 consensus_queue.cc:260] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:25.404085 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:25.404085 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:25.406071 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:25.406414 31889 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:25.406996 31889 raft_consensus.cc:697] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:25.407883 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:25.408018 31889 consensus_queue.cc:237] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:25.410508 29523 raft_consensus.cc:1275] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:12:25.413084 29521 raft_consensus.cc:1275] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:12:25.413751 31710 consensus_meta.cc:287] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.664s	user 0.008s	sys 0.003s
I20260709 13:12:25.414186 31710 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:25.415261 29380 raft_consensus.cc:1240] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:25.417555 31251 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:25.417793 31940 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:25.388168 29455 raft_consensus.cc:3055] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:25.418290 31940 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:25.439746 31785 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:25.337890 31919 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:25.441823 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:25.442571 31919 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:25.372934 31975 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:25.444056 29521 raft_consensus.cc:1275] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:12:25.445187 31949 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:25.419914 31764 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:25.447739 31957 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:25.448997 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:25.450017 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:25.318576 31970 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:25.452836 31951 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:25.450331 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:25.453930 31970 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:25.454135 29525 raft_consensus.cc:1275] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:25.454253 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:25.455098 29527 raft_consensus.cc:2393] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 6: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:25.372802 31974 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:25.455346 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:25.455843 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:25.307459 31929 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:25.458195 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:25.459019 29452 raft_consensus.cc:2468] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
I20260709 13:12:25.454594 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:25.461308 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:25.462064 29452 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:12:25.462827 31964 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:25.402612 31912 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:25.468451 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:25.422091 29455 raft_consensus.cc:740] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:25.498108 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:12:25.533958 30119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:26.148907 29375 raft_consensus.cc:2393] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 6: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
W20260709 13:12:25.564663 31954 consensus_meta.cc:287] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.555s	user 0.008s	sys 0.003s
I20260709 13:12:25.561210 29528 raft_consensus.cc:2410] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:12:26.149737 31954 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:26.151005 29523 raft_consensus.cc:1240] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:26.151062 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:26.144160 31962 consensus_meta.cc:287] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.787s	user 0.012s	sys 0.000s
I20260709 13:12:26.151968 31962 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:26.152281 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:26.152679 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:26.153103 29526 raft_consensus.cc:1240] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:12:26.153378 29523 raft_consensus.cc:2393] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 6: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:26.154234 31962 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:26.154412 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:25.737167 31980 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.145496 31802 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:25.476922 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:25.794363 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:25.393105 31762 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:26.156193 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:26.154448 29526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2133) took 1484 ms. Trace:
I20260709 13:12:26.156986 29526 rpcz_store.cc:276] 0709 13:12:24.669758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:25.005477 (+335719us) service_pool.cc:224] Handling call
0709 13:12:25.022250 (+ 16773us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:26.153579 (+1131329us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:26.154215 (+   636us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54003593d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:26.154388 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2600157952}
I20260709 13:12:26.157956 31762 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:26.158401 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:12:25.819603 29522 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.004s	sys 0.024s
I20260709 13:12:25.458655 31929 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:26.159567 29522 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.995s	user 0.015s	sys 0.032s
I20260709 13:12:26.159698 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:25.490540 31951 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:25.682122 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:26.160810 29526 raft_consensus.cc:2393] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 7: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:26.160624 31951 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:25.927436 31785 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.161757 31785 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:26.162892 31951 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:25.491035 31974 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:25.605652 31713 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:26.164105 31785 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:25.892179 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:26.164988 29372 raft_consensus.cc:2393] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 8: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:26.147773 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:26.166008 29372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 935) took 1042 ms. Trace:
I20260709 13:12:25.608394 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:26.141609 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:25.501092 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:25.613273 31711 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:25.652132 31949 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:26.164038 31974 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:26.015897 31889 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.002s	sys 0.007s
I20260709 13:12:26.134750 29379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 929) took 1098 ms. Trace:
I20260709 13:12:26.203245 29379 rpcz_store.cc:276] 0709 13:12:25.036363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:25.036580 (+   217us) service_pool.cc:224] Handling call
0709 13:12:25.420620 (+384040us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b54001905d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:26.134664 (+714044us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":764040448}
I20260709 13:12:26.140123 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:26.143978 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:26.205024 29378 raft_consensus.cc:2393] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 6: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:25.501629 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:26.166354 29372 rpcz_store.cc:276] 0709 13:12:25.123882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:25.124169 (+   287us) service_pool.cc:224] Handling call
0709 13:12:26.165824 (+1041655us) spinlock_profiling.cc:243] Waited 994 ms on lock 0x7b5400080f54. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:26.165946 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2286809344}
I20260709 13:12:26.205899 29374 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:26.207940 29522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2129) took 1571 ms. Trace:
I20260709 13:12:26.210337 29524 raft_consensus.cc:2410] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:12:26.197865 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:12:25.718650 29529 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.009s	sys 0.012s
W20260709 13:12:26.211776 29529 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.042s	user 0.012s	sys 0.028s
W20260709 13:12:26.028203 29421 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.008s	sys 0.004s
I20260709 13:12:25.488876 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:26.159101 29455 consensus_queue.cc:260] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:25.564227 31787 consensus_meta.cc:287] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.634s	user 0.012s	sys 0.000s
I20260709 13:12:26.174695 29528 raft_consensus.cc:2410] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:12:25.660688 31710 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:26.167181 29521 raft_consensus.cc:1240] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:12:26.138085 31835 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:26.211825 31957 consensus_meta.cc:287] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.759s	user 0.010s	sys 0.005s
I20260709 13:12:26.166456 31895 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:26.208786 29522 rpcz_store.cc:276] 0709 13:12:24.640779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:24.671424 (+ 30645us) service_pool.cc:224] Handling call
0709 13:12:24.694059 (+ 22635us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:24.694270 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:12:25.164846 (+470576us) log.cc:844] Serialized 14 byte log entry
0709 13:12:26.207592 (+1042746us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:26.207652 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:26.207703 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:26.207770 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:26.207882 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50666,"prepare.queue_time_us":228290,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":2619,"raft.queue_time_us":6829,"thread_start_us":1422852,"threads_started":2}
W20260709 13:12:26.223111 29496 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.041s	user 0.007s	sys 0.045s
W20260709 13:12:26.282868 29496 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.101s	user 0.009s	sys 0.046s
I20260709 13:12:26.202742 31898 consensus_queue.cc:1059] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
W20260709 13:12:26.203035 31889 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.004s	sys 0.009s
W20260709 13:12:26.252857 29421 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.017s	sys 0.010s
W20260709 13:12:26.166128 31940 consensus_meta.cc:287] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.726s	user 0.007s	sys 0.004s
I20260709 13:12:26.255343 29455 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:26.241691 29529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2116) took 1620 ms. Trace:
I20260709 13:12:26.259529 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:26.154984 31912 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:26.243970 31961 consensus_meta.cc:287] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.857s	user 0.012s	sys 0.008s
I20260709 13:12:26.266261 29450 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:26.282407 31802 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.172240 31711 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:26.211777 31762 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.286042 29523 raft_consensus.cc:2410] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:12:26.245903 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 48066.4us
W20260709 13:12:26.289645 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 901493us
I20260709 13:12:26.246019 29452 raft_consensus.cc:1275] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:26.196687 31980 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:26.304466 29419 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:26.299400 29529 rpcz_store.cc:276] 0709 13:12:24.621758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:24.621899 (+   141us) service_pool.cc:224] Handling call
0709 13:12:24.645369 (+ 23470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:24.645647 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:12:24.998410 (+352763us) log.cc:844] Serialized 14 byte log entry
0709 13:12:26.241127 (+1242717us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:26.241209 (+    82us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:26.241263 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:26.241348 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:26.241618 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19309,"prepare.queue_time_us":189031,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":83543,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":73,"thread_start_us":1514019,"threads_started":3,"wal-append.queue_time_us":694803}
I20260709 13:12:26.283629 31835 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.314536 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:26.314766 29527 raft_consensus.cc:2410] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:12:26.315209 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:26.328702 29530 raft_consensus.cc:2393] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 6: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:26.329072 29447 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
W20260709 13:12:26.317494 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:26.256001 31787 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:26.320663 29421 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:26.307016 31940 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:26.308568 31957 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:26.322963 31713 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:26.324949 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:26.311673 31962 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.339181 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:26.346619 29529 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:26.346904 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:26.343948 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:26.348145 29452 raft_consensus.cc:2410] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:12:26.344374 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:26.322430 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:26.349424 29525 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:26.350250 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:26.351547 31908 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.028s	sys 0.068s
I20260709 13:12:26.353044 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:26.353498 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:26.357517 29447 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
I20260709 13:12:26.358027 29523 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:26.301945 31895 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:26.359985 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:26.364465 29450 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:26.356797 31962 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:26.361495 31980 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:26.361677 31711 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:26.332496 31954 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:26.317874 31987 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:26.372731 29527 raft_consensus.cc:1240] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:26.381911 29529 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:12:26.384467 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:12:26.358693 31908 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.028s	sys 0.069s
I20260709 13:12:26.343353 31889 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:26.323114 31802 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:26.391032 29524 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:26.413890 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 123300us
I20260709 13:12:26.420444 29419 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:26.357388 31979 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.333531 31762 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:26.361510 31961 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:26.340186 31835 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:26.423753 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:26.424584 29452 raft_consensus.cc:2393] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 7: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:26.425135 29450 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:12:26.356663 31957 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:26.427915 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:26.429481 29527 raft_consensus.cc:2410] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:12:26.414605 31906 raft_consensus.cc:3055] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:26.431820 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:26.433630 29522 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:12:26.434579 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:26.435132 29450 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:26.435920 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:26.423169 31990 log.cc:927] Time spent T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:12:26.440111 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:26.445714 29447 raft_consensus.cc:2393] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 7: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:26.445714 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:26.456784 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:26.457679 29525 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:12:26.466377 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:26.467456 29529 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:26.433991 31906 raft_consensus.cc:740] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:12:26.470814 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:26.480214 29452 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:12:26.477432 29455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1791) took 1096 ms. Trace:
W20260709 13:12:26.478533 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 272054us
I20260709 13:12:26.482437 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:26.404863 31987 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:26.480922 29455 rpcz_store.cc:276] 0709 13:12:25.381176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:25.387618 (+  6442us) service_pool.cc:224] Handling call
0709 13:12:25.388016 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:26.476841 (+1088825us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:26.476930 (+    89us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:26.477003 (+    73us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:26.477051 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:26.477153 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:26.477339 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:26.487367 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:26.488240 29455 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:26.492403 29527 raft_consensus.cc:2393] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 8: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:26.428437 31961 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:26.444886 31974 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:26.453987 31889 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:26.500905 29346 leader_election.cc:336] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 2.170s (SENT)
I20260709 13:12:26.501413 29346 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:26.502317 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:12:26.503077 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:26.503407 29452 raft_consensus.cc:2410] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:12:26.426522 31979 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:26.479471 31986 raft_consensus.cc:2804] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:26.513486 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:26.518625 29530 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:12:26.488197 31985 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.520867 31713 consensus_queue.cc:1059] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:12:26.541435 31989 log.cc:927] Time spent T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 13:12:26.492614 31940 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:26.530270 29450 raft_consensus.cc:2468] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
I20260709 13:12:26.569167 29529 raft_consensus.cc:2410] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:12:26.599696 29450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1810) took 1088 ms. Trace:
I20260709 13:12:26.600410 29450 rpcz_store.cc:276] 0709 13:12:25.510961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:26.563161 (+1052200us) service_pool.cc:224] Handling call
0709 13:12:26.598916 (+ 35755us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:26.599191 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:26.599234 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:26.599295 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:26.599344 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:26.599421 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:26.599605 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:26.541425 31951 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:26.578025 31929 raft_consensus.cc:3055] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:12:26.636742 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:26.506508 31889 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:26.662333 31889 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:26.666361 31993 log.cc:927] Time spent T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 13:12:26.691365 29451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1799) took 1227 ms. Trace:
W20260709 13:12:26.696164 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:26.701514 29374 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:12:26.700131 29451 rpcz_store.cc:276] 0709 13:12:25.463880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:25.464380 (+   500us) service_pool.cc:224] Handling call
0709 13:12:25.464746 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:25.492190 (+ 27444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:25.492222 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:25.492728 (+   506us) log.cc:844] Serialized 26 byte log entry
0709 13:12:25.787235 (+294507us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:26.688620 (+901385us) log.cc:844] Serialized 14 byte log entry
0709 13:12:26.690865 (+  2245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:26.690990 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:26.691053 (+    63us) raft_consensus.cc:1685] finished
0709 13:12:26.691073 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:26.691281 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":406883,"prepare.queue_time_us":661297,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":63,"raft.queue_time_us":28642,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":101,"thread_start_us":780379,"threads_started":2,"wal-append.queue_time_us":822058}
I20260709 13:12:26.702325 29374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52172 (request call id 1259) took 1205 ms. Trace:
W20260709 13:12:26.697578 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 445019us
I20260709 13:12:26.620445 31787 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:26.712414 29374 rpcz_store.cc:276] 0709 13:12:25.496939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:25.501336 (+  4397us) service_pool.cc:224] Handling call
0709 13:12:26.702242 (+1200906us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:12:26.715706 30119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:26.716205 29455 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:12:26.724444 29455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45798 (request call id 1812) took 1212 ms. Trace:
W20260709 13:12:26.710209 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 189545us
I20260709 13:12:26.724975 29455 rpcz_store.cc:276] 0709 13:12:25.567820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:26.487000 (+919180us) service_pool.cc:224] Handling call
0709 13:12:26.724344 (+237344us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:26.656695 31929 raft_consensus.cc:740] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:26.549119 31985 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:26.738899 29376 raft_consensus.cc:1240] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:26.703824 31711 raft_consensus.cc:2749] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:26.743830 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:26.744369 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:26.753300 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:26.754606 29375 raft_consensus.cc:2393] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 7: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:26.758796 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:26.743963 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:26.760102 31986 raft_consensus.cc:697] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 7 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:26.760602 32020 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:26.762269 31974 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:26.743320 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:26.688663 31895 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:26.764895 31974 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:26.765233 31986 consensus_queue.cc:237] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:26.765873 31895 consensus_queue.cc:1059] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:26.767642 31974 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:26.742561 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:26.768458 32020 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:26.769678 29377 raft_consensus.cc:2393] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 9: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:26.771324 32020 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:26.712783 31962 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:26.780967 29453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1798) took 1317 ms. Trace:
I20260709 13:12:26.781584 29453 rpcz_store.cc:276] 0709 13:12:25.463597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:25.463720 (+   123us) service_pool.cc:224] Handling call
0709 13:12:25.464053 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:25.490522 (+ 26469us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:25.490574 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:25.491280 (+   706us) log.cc:844] Serialized 26 byte log entry
0709 13:12:26.139953 (+648673us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:26.623548 (+483595us) log.cc:844] Serialized 14 byte log entry
0709 13:12:26.780524 (+156976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:26.780636 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:26.780709 (+    73us) raft_consensus.cc:1685] finished
0709 13:12:26.780728 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:26.780888 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87323,"prepare.queue_time_us":316872,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":170632,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":203,"thread_start_us":1038382,"threads_started":3,"wal-append.queue_time_us":787061}
I20260709 13:12:26.785355 29453 raft_consensus.cc:1240] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:26.719578 31835 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:26.795436 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:26.797750 29372 raft_consensus.cc:2368] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 7. Current term is 8.
I20260709 13:12:26.690240 31951 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:26.801034 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:26.728277 31987 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:26.813508 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:26.810326 29523 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:12:26.814420 29374 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 7.
W20260709 13:12:26.789158 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 368791us
W20260709 13:12:26.817266 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 472252us
I20260709 13:12:26.741770 31940 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:26.816512 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:26.742316 31802 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:26.829406 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:12:26.822203 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 86089.1us
I20260709 13:12:26.742972 31979 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:26.733115 31949 consensus_queue.cc:1048] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.080s
I20260709 13:12:26.799821 31762 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:26.885334 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:26.803761 31957 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:26.913183 29495 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
W20260709 13:12:26.914551 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 75976.3us
I20260709 13:12:26.919080 29419 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:26.921653 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:26.922464 29379 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 8.
I20260709 13:12:26.928766 29344 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:26.829224 31835 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:26.652139 31906 consensus_queue.cc:260] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:27.215409 29526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 1194) took 1734 ms. Trace:
W20260709 13:12:27.196223 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:26.935309 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:26.822762 32020 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:26.822726 32024 raft_consensus.cc:3055] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:12:27.250459 29454 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.000s	sys 0.005s
I20260709 13:12:27.251471 29526 rpcz_store.cc:276] 0709 13:12:25.480637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:26.161728 (+681091us) service_pool.cc:224] Handling call
0709 13:12:26.162139 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:26.162707 (+   568us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:12:26.423126 (+260419us) log.cc:844] Serialized 14 byte log entry
0709 13:12:26.515213 (+ 92087us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b18001c8b80. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c7be07 00007f6a81ad6ab9 00007f6a78c9869b 00007f6a78c9693f 00007f6a78c98c02 00007f6a7b92020b 00007f6a7b925d23 00007f6a7b92623a 00007f6a7bd90a2a
0709 13:12:26.808203 (+292990us) log.cc:844] Serialized 14 byte log entry
0709 13:12:26.808366 (+   163us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:26.809064 (+   698us) log.cc:844] Serialized 26 byte log entry
0709 13:12:26.809262 (+   198us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:26.816351 (+  7089us) log.cc:844] Serialized 14 byte log entry
0709 13:12:26.817200 (+   849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:26.822459 (+  5259us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:27.215027 (+392568us) raft_consensus.cc:1685] finished
0709 13:12:27.215061 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:27.215295 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":131765,"prepare.queue_time_us":288839,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":97,"raft.queue_time_us":6739,"raft.run_cpu_time_us":419,"raft.run_wall_time_us":20243,"spinlock_wait_cycles":227043840,"thread_start_us":548840,"threads_started":2,"wal-append.queue_time_us":778137}
W20260709 13:12:27.068131 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 139471us
I20260709 13:12:26.827745 31987 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:12:27.279745 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:27.111737 32003 log.cc:927] Time spent T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.283s	user 0.001s	sys 0.000s
W20260709 13:12:27.278960 29454 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.000s	sys 0.013s
I20260709 13:12:27.283088 29449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1801) took 1818 ms. Trace:
W20260709 13:12:27.074820 32002 log.cc:927] Time spent T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:12:26.832999 31940 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:27.283442 29449 rpcz_store.cc:276] 0709 13:12:25.464453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:25.467153 (+  2700us) service_pool.cc:224] Handling call
0709 13:12:25.467616 (+   463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:25.492247 (+ 24631us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:12:26.389563 (+897316us) log.cc:844] Serialized 14 byte log entry
0709 13:12:26.815258 (+425695us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:26.830925 (+ 15667us) log.cc:844] Serialized 26 byte log entry
0709 13:12:26.831115 (+   190us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:26.835747 (+  4632us) log.cc:844] Serialized 14 byte log entry
0709 13:12:26.931524 (+ 95777us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:26.931742 (+   218us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:27.282902 (+351160us) raft_consensus.cc:1685] finished
0709 13:12:27.282924 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:27.283039 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":122821,"prepare.queue_time_us":965452,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":98,"raft.queue_time_us":168806,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":95925,"thread_start_us":634361,"threads_started":2,"wal-append.queue_time_us":797285}
I20260709 13:12:27.285326 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:12:26.936743 32009 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.281119 29344 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:27.276655 31979 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:27.072726 31787 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:27.084218 31785 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:27.297264 29448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1804) took 1808 ms. Trace:
I20260709 13:12:27.198619 31957 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.967041 31929 consensus_queue.cc:260] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:27.300727 31987 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:27.304793 29451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1814) took 1463 ms. Trace:
W20260709 13:12:27.309566 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 390545us
I20260709 13:12:27.310599 32022 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
W20260709 13:12:27.277958 29524 consensus_meta.cc:287] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.849s	user 0.007s	sys 0.006s
I20260709 13:12:26.916833 31802 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:27.326277 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 45270.3us
I20260709 13:12:26.999835 31961 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:27.137147 31951 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:27.331209 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 418141us
I20260709 13:12:27.326941 31835 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:12:27.333003 30119 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.003s	sys 0.015s
W20260709 13:12:27.365217 30119 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.003s	sys 0.015s
W20260709 13:12:27.334172 29456 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.000s	sys 0.013s
W20260709 13:12:27.335578 29421 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.013s	sys 0.003s
I20260709 13:12:27.333178 31957 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:27.337906 29451 rpcz_store.cc:276] 0709 13:12:25.841214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:26.737069 (+895855us) service_pool.cc:224] Handling call
0709 13:12:26.795876 (+ 58807us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:26.796441 (+   565us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:26.796489 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:26.802859 (+  6370us) log.cc:844] Serialized 26 byte log entry
0709 13:12:26.933143 (+130284us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:26.933603 (+   460us) log.cc:844] Serialized 14 byte log entry
0709 13:12:27.261083 (+327480us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:27.261223 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:27.304560 (+ 43337us) raft_consensus.cc:1685] finished
0709 13:12:27.304581 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:27.304723 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":413831,"prepare.queue_time_us":234,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":351734,"raft.run_cpu_time_us":358,"raft.run_wall_time_us":23222,"thread_start_us":17934,"threads_started":1,"wal-append.queue_time_us":474409}
I20260709 13:12:27.279060 32024 raft_consensus.cc:740] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:26.998934 31974 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.368249 29495 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:27.328140 31785 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:27.342346 29524 raft_consensus.cc:2468] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:27.379673 29524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37968 (request call id 2156) took 1036 ms. Trace:
I20260709 13:12:27.343343 31985 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:27.336819 32009 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:27.392623 31987 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:27.360165 31787 raft_consensus.cc:697] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:27.394304 32009 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:27.394433 31787 consensus_queue.cc:237] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:27.397812 29346 leader_election.cc:336] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 1.740s (SENT)
I20260709 13:12:27.382875 31785 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:27.344789 32022 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:27.346489 29447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1809) took 1835 ms. Trace:
I20260709 13:12:27.365468 31802 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:27.405771 29447 rpcz_store.cc:276] 0709 13:12:25.510677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:26.516849 (+1006172us) service_pool.cc:224] Handling call
0709 13:12:26.517305 (+   456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:26.720134 (+202829us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:26.720174 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:26.727153 (+  6979us) log.cc:844] Serialized 26 byte log entry
0709 13:12:27.072595 (+345442us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:27.345900 (+273305us) log.cc:844] Serialized 14 byte log entry
0709 13:12:27.346145 (+   245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:27.346228 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:27.346267 (+    39us) raft_consensus.cc:1685] finished
0709 13:12:27.346281 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:27.346413 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":248892,"prepare.queue_time_us":274057,"prepare.run_wall_time_us":51,"raft.queue_time_us":250022,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":202,"spinlock_wait_cycles":4023680,"thread_start_us":490180,"threads_started":2,"wal-append.queue_time_us":565687}
I20260709 13:12:27.347942 29455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1813) took 1745 ms. Trace:
I20260709 13:12:27.407805 29455 rpcz_store.cc:276] 0709 13:12:25.602739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:26.818977 (+1216238us) service_pool.cc:224] Handling call
0709 13:12:26.819351 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:26.819662 (+   311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:26.819695 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:26.922049 (+102354us) log.cc:844] Serialized 26 byte log entry
0709 13:12:27.280001 (+357952us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:27.347348 (+ 67347us) log.cc:844] Serialized 14 byte log entry
0709 13:12:27.347612 (+   264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:27.347696 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:27.347742 (+    46us) raft_consensus.cc:1685] finished
0709 13:12:27.347755 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:27.347879 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66992,"prepare.queue_time_us":68184,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":1505,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"thread_start_us":345099,"threads_started":1,"wal-append.queue_time_us":317171}
I20260709 13:12:27.409659 31802 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:27.407838 32022 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:27.353819 29419 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:27.411526 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 57812.2us
I20260709 13:12:27.413559 29419 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:27.413878 32009 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:27.414947 29419 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:27.415611 31986 raft_consensus.cc:2749] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:27.355655 31906 raft_consensus.cc:3060] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:27.355896 31940 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:27.328469 29448 rpcz_store.cc:276] 0709 13:12:25.489229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:25.489731 (+   502us) service_pool.cc:224] Handling call
0709 13:12:26.166593 (+676862us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:26.206800 (+ 40207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:26.206872 (+    72us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:26.214859 (+  7987us) log.cc:844] Serialized 26 byte log entry
0709 13:12:26.493632 (+278773us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:26.514787 (+ 21155us) log.cc:844] Serialized 14 byte log entry
0709 13:12:26.703433 (+188646us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:26.703566 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:27.297006 (+593440us) raft_consensus.cc:1685] finished
0709 13:12:27.297032 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:27.297189 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":20327,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":3881,"raft.queue_time_us":259625,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":2858,"spinlock_wait_cycles":1747328,"thread_start_us":379972,"threads_started":2,"wal-append.queue_time_us":444569}
I20260709 13:12:27.430024 31929 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.358351 29344 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:27.430994 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 72723.5us
I20260709 13:12:27.431555 29419 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:27.431948 31895 raft_consensus.cc:2804] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:27.432830 29344 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:27.366365 29421 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.013s	sys 0.003s
W20260709 13:12:27.433534 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 609978us
I20260709 13:12:27.434172 29344 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:27.434078 32008 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:27.435129 32008 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:27.435484 32008 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:27.435720 31711 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:27.436157 31711 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:27.436508 31711 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:27.437549 29421 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:27.438547 29421 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:12:27.365828 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 644559us
I20260709 13:12:27.439325 31986 raft_consensus.cc:2804] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:27.440661 31986 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:27.441002 31986 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:27.253557 32020 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:27.444567 32006 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:12:27.366291 29456 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.000s	sys 0.013s
I20260709 13:12:27.447827 29456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1803) took 1959 ms. Trace:
I20260709 13:12:27.368273 31762 consensus_queue.cc:1059] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:12:27.385731 32024 consensus_queue.cc:260] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:27.448814 32024 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:27.448248 29456 rpcz_store.cc:276] 0709 13:12:25.488628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:25.489114 (+   486us) service_pool.cc:224] Handling call
0709 13:12:26.198298 (+709184us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x7b5800193598. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61b71 00007f6a78c61a22 00007f6a81b7ac09 00007f6a80cd4ee0 00007f6a80d9e0ab 00007f6a80d9e131 00007f6a80d5ffc0 00007f6a80d4a929 00007f6a80d4a3d2 00007f6a7a2c1bd4
0709 13:12:26.198495 (+   197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:26.198730 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:12:26.500641 (+301911us) log.cc:844] Serialized 14 byte log entry
0709 13:12:27.447422 (+946781us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:27.447478 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:27.447552 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:27.447639 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:27.447760 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10933,"prepare.queue_time_us":258446,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":53589,"raft.run_cpu_time_us":60,"raft.run_wall_time_us":60,"spinlock_wait_cycles":5241088,"thread_start_us":1195245,"threads_started":3,"wal-append.queue_time_us":687702}
I20260709 13:12:27.377380 31974 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:27.448185 32020 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:27.386680 31835 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:27.389261 29495 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:27.452323 31974 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:27.452430 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 63260.9us
I20260709 13:12:27.452963 31974 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:27.387741 32007 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:27.360637 31979 raft_consensus.cc:697] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 8 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:27.454416 29495 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:27.454814 31979 consensus_queue.cc:237] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:27.455683 32007 raft_consensus.cc:2749] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:27.390748 31957 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:27.330071 31713 raft_consensus.cc:2749] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:27.437461 32019 consensus_queue.cc:1059] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:27.457237 32019 consensus_queue.cc:1243] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer 429e58eb058349e3bf72b5a870c8f6e5 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:12:27.457422 29495 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:27.457794 32019 raft_consensus.cc:3055] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:27.458216 32019 raft_consensus.cc:740] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:27.458981 31940 raft_consensus.cc:2749] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:27.450199 29454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1800) took 1986 ms. Trace:
I20260709 13:12:27.459824 31940 consensus_queue.cc:1059] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:27.459642 29454 rpcz_store.cc:276] 0709 13:12:25.464169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:25.465271 (+  1102us) service_pool.cc:224] Handling call
0709 13:12:26.199801 (+734530us) spinlock_profiling.cc:243] Waited 33 ms on lock 0x7b5800193598. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61b71 00007f6a78c61a22 00007f6a81b7ac09 00007f6a80cd4ee0 00007f6a80d9e0ab 00007f6a80d9e131 00007f6a80d5ffc0 00007f6a80d4a929 00007f6a80d4a3d2 00007f6a7a2c1bd4
0709 13:12:26.200003 (+   202us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:26.206913 (+  6910us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:26.206941 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:26.207400 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 13:12:26.688866 (+481466us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:26.720284 (+ 31418us) log.cc:844] Serialized 14 byte log entry
0709 13:12:27.283043 (+562759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:27.283154 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:27.424655 (+141501us) raft_consensus.cc:1685] finished
0709 13:12:27.449964 (+ 25309us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:27.450124 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1615,"prepare.queue_time_us":34065,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":48,"raft.queue_time_us":56506,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"spinlock_wait_cycles":76042752,"thread_start_us":986331,"threads_started":2,"wal-append.queue_time_us":578617}
I20260709 13:12:27.462836 32007 raft_consensus.cc:3055] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:27.463276 32007 raft_consensus.cc:740] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:27.392083 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:27.459136 32019 consensus_queue.cc:260] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:27.432984 31895 raft_consensus.cc:697] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:27.464326 32007 consensus_queue.cc:260] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:27.465106 32019 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:27.465463 31895 consensus_queue.cc:237] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:27.380172 29524 rpcz_store.cc:276] 0709 13:12:26.343196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:26.357049 (+ 13853us) service_pool.cc:224] Handling call
0709 13:12:27.379572 (+1022523us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:27.466943 29453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 992) took 1308 ms. Trace:
I20260709 13:12:27.467451 29344 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:27.468120 29419 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:27.470233 29495 leader_election.cc:400] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5.
I20260709 13:12:27.470548 29495 leader_election.cc:403] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:12:27.471753 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:27.471994 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:27.429329 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:27.448568 31889 raft_consensus.cc:2749] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:27.467362 29453 rpcz_store.cc:276] 0709 13:12:26.158424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:26.786510 (+628086us) service_pool.cc:224] Handling call
0709 13:12:26.786899 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:26.787392 (+   493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:26.787433 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:26.797584 (+ 10151us) log.cc:844] Serialized 26 byte log entry
0709 13:12:27.369193 (+571609us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:27.369256 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:27.369337 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:27.466659 (+ 97322us) raft_consensus.cc:1685] finished
0709 13:12:27.466686 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:27.466874 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":135,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":11157,"thread_start_us":486390,"threads_started":1,"wal-append.queue_time_us":647860}
I20260709 13:12:27.482869 30157 raft_consensus.cc:2468] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:12:27.487720 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:27.488471 29372 raft_consensus.cc:2468] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
I20260709 13:12:27.492976 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:27.493451 32007 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:27.494040 31957 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5.
I20260709 13:12:27.492887 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:27.497670 29493 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:12:27.498746 31957 raft_consensus.cc:2804] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:27.499264 31957 raft_consensus.cc:697] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:27.500216 31957 consensus_queue.cc:237] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:27.501576 31713 raft_consensus.cc:3055] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:27.502022 31713 raft_consensus.cc:740] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:27.502910 31713 consensus_queue.cc:260] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:27.503820 29375 raft_consensus.cc:1275] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:12:27.508200 31835 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:27.493757 29378 raft_consensus.cc:2376] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5. Re-sending same reply.
I20260709 13:12:27.513942 29495 leader_election.cc:400] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 7. Current term is 8.
I20260709 13:12:27.514487 29495 leader_election.cc:403] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:12:27.516741 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:27.517663 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 50302.1us
I20260709 13:12:27.520517 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:27.522891 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:27.523758 29454 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:27.525204 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:27.525977 29373 raft_consensus.cc:2393] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 6: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:27.527823 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:27.529121 29453 raft_consensus.cc:2393] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 6: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:27.527774 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:27.533658 29419 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:27.535364 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:27.538319 29344 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:27.539876 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:27.543514 29456 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:27.540472 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:27.544481 29448 raft_consensus.cc:3060] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:27.546011 29344 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:27.511902 31713 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:27.532356 31949 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:27.528563 31974 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 7. Current term is 8.
I20260709 13:12:27.549541 29421 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:27.539449 32022 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:27.556042 29521 raft_consensus.cc:1240] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:27.556138 29524 raft_consensus.cc:1275] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:27.571947 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:27.572862 29375 raft_consensus.cc:2393] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 8: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:27.560736 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:27.574134 29523 raft_consensus.cc:1275] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:12:27.574328 29373 raft_consensus.cc:1240] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:27.574561 29523 pending_rounds.cc:85] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 3
I20260709 13:12:27.574895 29523 pending_rounds.cc:107] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:12:27.575205 29523 raft_consensus.cc:2889] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:27.553913 32030 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:27.539510 32035 raft_consensus.cc:2749] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:27.564064 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:27.564800 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:27.565704 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:27.567005 29447 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:27.584408 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:27.567149 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:27.584883 29528 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:27.585027 29453 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:27.568224 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:27.563413 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:27.587399 29529 raft_consensus.cc:1240] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:27.585322 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:27.580540 29372 raft_consensus.cc:2410] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:12:27.581436 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:27.571398 29527 raft_consensus.cc:1240] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:12:27.590070 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:27.502911 31785 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:27.585346 29525 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
W20260709 13:12:27.594532 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 54398us
W20260709 13:12:27.594637 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 45204us
I20260709 13:12:27.595145 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:27.595755 29419 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:27.595840 29449 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
I20260709 13:12:27.596431 29455 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
I20260709 13:12:27.546607 31889 consensus_queue.cc:1048] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:12:27.599198 29454 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
I20260709 13:12:27.601213 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:27.557025 31949 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:27.562976 31929 raft_consensus.cc:2804] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:27.603427 29419 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:27.603883 29451 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
I20260709 13:12:27.605268 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:27.600375 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:27.604514 29495 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:27.607925 29450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1811) took 2096 ms. Trace:
I20260709 13:12:27.608383 29450 rpcz_store.cc:276] 0709 13:12:25.511247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:26.617380 (+1106133us) service_pool.cc:224] Handling call
0709 13:12:26.700749 (+ 83369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:27.063999 (+363250us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:12:27.321692 (+257693us) log.cc:844] Serialized 14 byte log entry
0709 13:12:27.509350 (+187658us) log.cc:844] Serialized 14 byte log entry
0709 13:12:27.509947 (+   597us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:27.510397 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:12:27.510521 (+   124us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:27.510711 (+   190us) log.cc:844] Serialized 14 byte log entry
0709 13:12:27.512857 (+  2146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:27.513319 (+   462us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:27.571355 (+ 58036us) spinlock_profiling.cc:243] Waited 6.21 ms on lock 0x7b18002ebe20. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c99522 00007f6a78c9b7c1 00007f6a78c9b779 00007f6a78c9b709 00007f6a78c9b6d1 00007f6a78c9a9cd 000000000038f354 000000000038f199 00007f6a78c7c83a
0709 13:12:27.577231 (+  5876us) spinlock_profiling.cc:243] Waited 5.13 ms on lock 0x7b18002ebe20. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c13c0a 00007f6a82353219 00007f6a7fc5a58f 00007f6a78c99571 00007f6a78c9b7c1 00007f6a78c9b779 00007f6a78c9b709 00007f6a78c9b6d1 00007f6a78c9a9cd
0709 13:12:27.607705 (+ 30474us) raft_consensus.cc:1685] finished
0709 13:12:27.607729 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:27.607864 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8514,"prepare.queue_time_us":258951,"prepare.run_cpu_time_us":136,"prepare.run_wall_time_us":5588,"raft.queue_time_us":84278,"raft.run_cpu_time_us":455,"raft.run_wall_time_us":13723,"spinlock_wait_cycles":26077184,"thread_start_us":303451,"threads_started":2,"wal-append.queue_time_us":208180}
I20260709 13:12:27.609280 29495 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:27.612087 31974 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.612620 31974 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:27.614786 31974 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:27.615602 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:27.616170 31985 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:27.616300 29450 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:12:27.616671 31985 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:27.617010 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:27.617129 31985 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:27.619340 29448 raft_consensus.cc:2468] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:12:27.592480 31787 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.621014 31787 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:27.623734 31787 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:27.623582 32036 consensus_queue.cc:1048] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:12:27.624648 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:27.625181 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:27.625579 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:27.626390 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:27.627168 29449 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
I20260709 13:12:27.627996 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:27.628026 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:27.628661 29449 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
I20260709 13:12:27.626482 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:27.642478 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:27.616698 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:12:27.680550 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 77211.7us
I20260709 13:12:27.681746 29419 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:27.684446 29451 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
I20260709 13:12:27.686738 29419 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:27.690613 29419 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:27.691998 29419 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:27.694211 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:27.593202 31940 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:12:27.696031 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:27.602242 31895 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.601012 31987 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:27.695545 29419 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:27.705463 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:27.594251 32030 raft_consensus.cc:697] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:27.698072 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:27.630296 31949 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:27.736084 29447 raft_consensus.cc:1275] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:12:27.698314 32014 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:27.756840 29372 raft_consensus.cc:2410] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:12:27.602826 31979 raft_consensus.cc:2804] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:27.698763 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:27.685649 32019 raft_consensus.cc:2749] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:27.765559 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:27.765945 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 156756us
I20260709 13:12:27.771623 29495 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:27.695744 32006 raft_consensus.cc:2749] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:27.607872 32022 consensus_queue.cc:1048] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.146s
I20260709 13:12:27.776688 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:27.776885 29495 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:27.780722 29378 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
I20260709 13:12:27.781443 29495 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:27.783110 29495 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:12:27.783818 30121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:27.778481 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 83050.6us
I20260709 13:12:27.629833 31835 consensus_queue.cc:1048] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.144s
W20260709 13:12:27.816983 30119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:27.785796 29419 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:27.820333 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:27.821035 29375 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:12:27.821607 29419 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:27.790261 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:27.824286 29372 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
I20260709 13:12:27.695291 32020 raft_consensus.cc:2749] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:27.687445 31974 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:27.685945 32036 raft_consensus.cc:2749] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:27.801987 29346 leader_election.cc:336] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 1.953s (SENT)
I20260709 13:12:27.836927 29346 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:27.757438 32012 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:27.699149 31929 raft_consensus.cc:697] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:27.771130 32011 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:27.815737 31787 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:27.826310 31961 raft_consensus.cc:2804] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:27.757200 31985 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:27.759093 31987 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:27.784938 31979 raft_consensus.cc:697] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:27.832211 31889 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:27.758870 31895 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:27.766034 31940 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:27.833825 32006 raft_consensus.cc:2749] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:27.848129 32030 consensus_queue.cc:237] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:27.865693 32042 log.cc:927] Time spent T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:12:27.848294 31957 raft_consensus.cc:2749] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:27.847746 31787 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:27.854326 31974 raft_consensus.cc:2804] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:27.875622 29453 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:12:27.879102 31940 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:27.883915 31979 consensus_queue.cc:237] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:27.888871 31987 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:27.891089 31895 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:27.892446 32040 log.cc:927] Time spent T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
W20260709 13:12:27.894169 32033 log.cc:927] Time spent T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 13:12:27.896232 31785 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:27.897086 29452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1808) took 2386 ms. Trace:
I20260709 13:12:27.897492 29452 rpcz_store.cc:276] 0709 13:12:25.510369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:26.509667 (+999298us) service_pool.cc:224] Handling call
0709 13:12:26.510003 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:26.804971 (+294968us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:12:26.831333 (+ 26362us) log.cc:844] Serialized 14 byte log entry
0709 13:12:27.506977 (+675644us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:27.507720 (+   743us) log.cc:844] Serialized 26 byte log entry
0709 13:12:27.507883 (+   163us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:27.508092 (+   209us) log.cc:844] Serialized 14 byte log entry
0709 13:12:27.508298 (+   206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:27.508382 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:27.896870 (+388488us) raft_consensus.cc:1685] finished
0709 13:12:27.896895 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:27.897028 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30962,"prepare.queue_time_us":27699,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":84,"raft.queue_time_us":286217,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":221,"spinlock_wait_cycles":1364736,"thread_start_us":747578,"threads_started":2,"wal-append.queue_time_us":622573}
I20260709 13:12:27.901041 31985 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:27.902338 32041 log.cc:927] Time spent T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.272s	user 0.000s	sys 0.001s
W20260709 13:12:27.903589 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 101657us
I20260709 13:12:27.903978 31929 consensus_queue.cc:237] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:27.845647 32012 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:27.864358 31961 raft_consensus.cc:697] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
W20260709 13:12:27.933938 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 112430us
I20260709 13:12:27.867437 32018 raft_consensus.cc:2749] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:27.936735 29419 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:27.934053 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:27.877094 31974 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:12:27.948848 31711 consensus_meta.cc:287] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.512s	user 0.010s	sys 0.003s
I20260709 13:12:27.949373 32012 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:27.950403 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:27.875854 31787 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:27.956086 31986 consensus_meta.cc:287] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.515s	user 0.006s	sys 0.006s
W20260709 13:12:27.985368 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 202314us
I20260709 13:12:27.959117 29419 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:27.971817 32035 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:27.971971 32050 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:12:27.973892 32008 consensus_meta.cc:287] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.538s	user 0.008s	sys 0.001s
I20260709 13:12:27.978529 32022 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:27.932878 29372 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "71aa3578fd924765ab9ac0729c8d1483"
 from {username='slave'} at 127.0.0.1:41856
W20260709 13:12:27.981743 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 211245us
I20260709 13:12:27.986304 29495 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:27.987771 29419 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:27.990901 29372 raft_consensus.cc:606] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Received request to transfer leadership to TS 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:27.991330 29372 raft_consensus.cc:614] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:27.992028 29495 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:27.993366 29495 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:27.993997 32012 raft_consensus.cc:2749] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:27.981452 31974 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:28.002393 29419 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:27.982585 31802 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:27.994889 32014 raft_consensus.cc:2749] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:27.998083 31987 raft_consensus.cc:2749] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:28.025633 29456 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:12:27.998271 31940 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:27.983222 31711 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:28.005270 32006 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:27.999934 32022 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:28.006592 31889 raft_consensus.cc:2749] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:28.083480 31985 raft_consensus.cc:2804] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:27.997411 32008 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:28.036602 32009 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:28.061509 29377 raft_consensus.cc:2393] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 7: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:28.062623 31711 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:28.028205 31785 consensus_queue.cc:1048] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:12:28.005472 31895 consensus_queue.cc:1059] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:12:28.064582 32022 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:28.067396 32006 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:27.997027 32035 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:28.076766 31961 consensus_queue.cc:237] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:28.004818 31802 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:28.081045 32007 consensus_meta.cc:287] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.587s	user 0.013s	sys 0.001s
I20260709 13:12:28.113238 29279 catalog_manager.cc:5697] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: config changed from index 5 to 7, VOTER 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) evicted. New cstate: current_term: 6 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:28.116278 32008 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:28.080370 31949 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:27.995396 31986 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:28.119141 31986 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:28.097734 31985 raft_consensus.cc:697] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:28.119442 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:28.119992 29455 raft_consensus.cc:2393] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 9: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
W20260709 13:12:28.092347 32052 log.cc:927] Time spent T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:12:28.101217 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:28.102452 29379 raft_consensus.cc:2368] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 6. Current term is 7.
W20260709 13:12:28.099301 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 93342.5us
W20260709 13:12:28.107741 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:28.123975 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:28.126717 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:28.127146 30157 raft_consensus.cc:1275] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:12:28.133651 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:28.136027 32035 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:28.120352 31985 consensus_queue.cc:237] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:28.109043 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:28.099952 32024 raft_consensus.cc:3055] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:28.144161 32024 raft_consensus.cc:740] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:28.145149 32024 consensus_queue.cc:260] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:28.111570 31711 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.146523 32024 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:28.094990 32011 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:28.140110 29456 raft_consensus.cc:1275] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:12:28.147234 32011 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:28.146277 31711 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:28.148643 29456 raft_consensus.cc:1240] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:28.149544 32011 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:28.149784 31711 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:28.056875 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 63573.8us
W20260709 13:12:28.141340 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:28.151074 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:28.151664 29456 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:28.151871 29495 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:28.152784 29495 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:28.153559 31957 raft_consensus.cc:2804] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:28.153973 31957 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:28.154349 31957 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:28.156919 32006 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:28.159734 32007 raft_consensus.cc:2804] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:28.160207 32007 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:28.160566 32007 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:28.162679 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:28.163314 29452 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:28.164328 29495 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:28.165375 31987 raft_consensus.cc:2804] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:28.165890 31987 raft_consensus.cc:697] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:28.168200 29495 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:28.168715 32019 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:28.166846 31987 consensus_queue.cc:237] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:28.169297 32019 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:28.171231 31940 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:28.171707 31940 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:28.172042 31940 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:28.174906 31974 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:28.176043 29495 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:28.215991 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:28.216830 32044 raft_consensus.cc:2804] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:28.217262 32044 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:28.217741 32044 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:28.218197 29455 raft_consensus.cc:1275] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:28.219235 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:28.179239 29344 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:28.182366 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:28.220273 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:28.185876 32008 consensus_queue.cc:1048] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:28.189059 32019 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:28.191141 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:28.221403 29453 raft_consensus.cc:2468] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:12:28.222292 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:28.222647 32008 raft_consensus.cc:2804] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:28.223098 32008 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:28.182157 29373 raft_consensus.cc:2393] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 10: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:28.223464 32008 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:28.188668 29452 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:28.225875 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:28.226950 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:28.194782 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:28.223469 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:28.227927 29451 raft_consensus.cc:2393] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 6: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:28.228787 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:12:28.229005 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 49851.4us
I20260709 13:12:28.229411 29451 raft_consensus.cc:2468] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:12:28.230195 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:28.230511 29344 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:28.230719 29451 raft_consensus.cc:2468] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:12:28.197084 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:28.232372 32018 consensus_queue.cc:1059] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:28.232897 29447 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:12:28.233268 32018 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:28.233647 32018 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:28.233987 32018 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:28.197588 30121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:28.235926 32056 raft_consensus.cc:3055] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:28.236370 32056 raft_consensus.cc:740] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:28.198016 29456 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:12:28.237274 32056 consensus_queue.cc:260] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:28.238588 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:28.239534 29456 raft_consensus.cc:2410] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:12:28.240386 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:28.191686 29346 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:28.201370 29454 raft_consensus.cc:1240] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:28.199841 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:12:28.244181 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 52579us
I20260709 13:12:28.244503 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:28.245401 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:28.245919 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:28.246466 31895 raft_consensus.cc:2804] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:28.246570 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:28.246977 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:28.247088 31895 raft_consensus.cc:697] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:28.247591 29454 raft_consensus.cc:2468] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
I20260709 13:12:28.214178 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:28.248535 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:28.248947 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:28.249835 29452 raft_consensus.cc:2393] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 6: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:28.228793 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:28.255554 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:28.214639 29419 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:28.177758 32047 consensus_queue.cc:1048] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:28.217622 29495 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:28.180864 31785 consensus_queue.cc:1048] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:28.220307 29450 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:12:28.336687 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:28.337332 29450 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:28.237330 32004 consensus_queue.cc:1048] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:28.201949 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:28.183679 31949 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:28.163084 31787 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:28.323009 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:28.264602 31895 consensus_queue.cc:237] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:28.329531 29456 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:12:28.238610 32056 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:28.359990 29450 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:12:28.286885 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:28.331950 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:28.332016 29447 raft_consensus.cc:2468] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:28.286757 32007 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:28.293826 31957 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:28.323426 29451 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
W20260709 13:12:28.324313 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 75497.8us
I20260709 13:12:28.346609 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:28.366986 29453 raft_consensus.cc:2393] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 8: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:12:28.366791 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 149225us
I20260709 13:12:28.347682 29449 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:28.323576 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 74378.4us
I20260709 13:12:28.352632 31987 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:12:28.354928 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 140342us
I20260709 13:12:28.361265 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:28.371462 29454 raft_consensus.cc:1275] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:12:28.372197 29454 pending_rounds.cc:85] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 3
I20260709 13:12:28.372459 29454 pending_rounds.cc:107] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:12:28.372689 29454 raft_consensus.cc:2889] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:28.353566 32019 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:28.388942 32019 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:28.362524 32035 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:28.399422 32044 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:28.400931 32018 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:28.403208 32018 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:28.404793 31957 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:28.405593 32008 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:28.406752 32007 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:28.391253 32019 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:28.369765 29495 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:28.417642 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 48144.7us
I20260709 13:12:28.419046 29495 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:28.361716 31940 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:28.409204 31987 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:28.434964 29495 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:28.436058 29495 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:28.444751 31961 raft_consensus.cc:2804] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:28.444968 32047 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:28.445432 31961 raft_consensus.cc:697] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:28.425117 31957 raft_consensus.cc:2804] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:28.446466 31961 consensus_queue.cc:237] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:28.449815 32061 consensus_queue.cc:1048] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:12:28.437443 32007 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:12:28.455094 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 81149.6us
I20260709 13:12:28.457568 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:28.436671 31987 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:28.454067 31802 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:28.454609 31957 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:28.454192 31787 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:28.448212 32044 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:28.468497 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:28.473860 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:28.474602 29456 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
W20260709 13:12:28.474112 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 102772us
I20260709 13:12:28.465386 32007 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:28.467988 31957 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:28.483737 32007 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:28.479466 31940 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:28.480048 32008 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:28.503895 31974 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:28.510097 29276 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37594 (request call id 134) took 10002 ms. Trace:
I20260709 13:12:28.510598 29276 rpcz_store.cc:276] 0709 13:12:18.507401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.511677 (+  4276us) service_pool.cc:224] Handling call
0709 13:12:28.509988 (+9998311us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:24.353049 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:24.353785 (+   736us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:24.353840 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:12:24.353859 (+    19us) tablet.cc:662] Decoding operations
0709 13:12:24.354948 (+  1089us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:24.355070 (+   122us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:24.355105 (+    35us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:12:24.373854 (+ 18749us) tablet.cc:701] Row locks acquired
0709 13:12:24.373948 (+    94us) write_op.cc:260] PREPARE: finished
0709 13:12:24.374290 (+   342us) write_op.cc:270] Start()
0709 13:12:24.374502 (+   212us) write_op.cc:276] Timestamp: P: 1783602744374210 usec, L: 0
0709 13:12:24.374522 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:12:24.381361 (+  6839us) log.cc:844] Serialized 3672 byte log entry
0709 13:12:24.766805 (+385444us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b1800191c80. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c993f3 00007f6a78c9b7c1 00007f6a78c9b779 00007f6a78c9b709 00007f6a78c9b6d1 00007f6a78c9a9cd 000000000038f354 000000000038f199 00007f6a78c7c83a
0709 13:12:25.069075 (+302270us) spinlock_profiling.cc:243] Waited 4 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:12:26.337276 (+1268201us) op_driver.cc:464] REPLICATION: finished
0709 13:12:27.247003 (+909727us) write_op.cc:301] APPLY: starting
0709 13:12:27.247121 (+   118us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:27.247366 (+   245us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:27.247404 (+    38us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:27.248961 (+  1557us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:27.249286 (+   325us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:12:27.249332 (+    46us) write_op.cc:312] APPLY: finished
0709 13:12:27.249716 (+   384us) log.cc:844] Serialized 70 byte log entry
0709 13:12:27.472639 (+222923us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:27.504819 (+ 32180us) write_op.cc:454] Released schema lock
0709 13:12:27.532181 (+ 27362us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:27.568497 (+ 36316us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:27.580021 (+ 11524us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":46979,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":909220,"apply.run_cpu_time_us":7710,"apply.run_wall_time_us":303576,"num_ops":9,"prepare.queue_time_us":51988,"prepare.run_cpu_time_us":131046,"prepare.run_wall_time_us":292175,"raft.queue_time_us":914181,"raft.run_cpu_time_us":20664,"raft.run_wall_time_us":511151,"replication_time_us":1948508,"spinlock_wait_cycles":37417472,"thread_start_us":1221385,"threads_started":6,"wal-append.queue_time_us":420312,"wal-append.run_cpu_time_us":42183,"wal-append.run_wall_time_us":2145087}]]}
I20260709 13:12:28.520021 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:28.520709 29456 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:12:28.521289 29449 raft_consensus.cc:2410] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:12:28.522408 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:28.523800 29456 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:28.527477 29346 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:28.533354 29346 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:28.534291 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:28.536473 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:28.538463 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:28.539068 29451 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:28.539878 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:28.541532 32007 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:28.542403 29454 raft_consensus.cc:1275] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:12:28.539188 29453 raft_consensus.cc:1275] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:12:28.553871 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:28.554768 29530 raft_consensus.cc:2410] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:12:28.548434 29455 raft_consensus.cc:2955] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 5 to 7, VOTER 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:12:28.555460 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:28.555967 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:28.556567 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:28.556712 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:28.556859 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:28.557372 29521 raft_consensus.cc:2410] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:12:28.558231 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:28.558969 29522 raft_consensus.cc:2368] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 6. Current term is 7.
I20260709 13:12:28.559792 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:28.560375 29522 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 7.
I20260709 13:12:28.560478 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:28.561218 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:28.561643 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:28.561926 31957 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:28.562247 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:28.562813 29522 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:28.532085 32020 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.563560 29495 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:28.563781 32020 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:28.564524 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:28.565713 29495 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:28.555320 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:28.564520 31961 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:28.567690 29525 raft_consensus.cc:2368] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 7. Current term is 9.
I20260709 13:12:28.562736 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:28.558244 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:28.572372 29529 raft_consensus.cc:2376] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9. Re-sending same reply.
I20260709 13:12:28.573525 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:28.574941 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:28.568480 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:28.576495 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:28.565672 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:28.576574 29495 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:28.579160 29495 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:28.579787 29529 raft_consensus.cc:2393] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 7: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:28.570539 29346 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:28.577966 29521 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 7.
I20260709 13:12:28.581794 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:28.582469 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:28.582953 29495 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:28.584952 29495 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:28.588104 29495 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:12:28.589006 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:28.589562 29495 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:28.591457 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:28.591638 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:28.592458 29521 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:28.595467 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:28.595402 29528 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:12:28.597069 29419 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:28.598436 29525 raft_consensus.cc:1240] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:28.599956 29525 raft_consensus.cc:1275] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:12:28.593477 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:28.590233 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:28.553062 32062 raft_consensus.cc:2749] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:28.603807 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:28.582798 32018 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:28.604456 29523 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
I20260709 13:12:28.604674 31961 raft_consensus.cc:2749] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:28.607147 29419 leader_election.cc:400] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 6. Current term is 7.
I20260709 13:12:28.607559 29419 leader_election.cc:403] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:12:28.612661 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:28.613375 29447 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:28.614114 29346 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:28.615234 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:28.616106 29450 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:28.619076 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:28.624063 29529 raft_consensus.cc:2368] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 4. Current term is 5.
I20260709 13:12:28.624959 29451 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:12:28.615339 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:28.625391 29456 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
I20260709 13:12:28.628324 29521 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:12:28.629105 29530 raft_consensus.cc:1240] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:12:28.625486 29529 raft_consensus.cc:1240] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:28.630663 29450 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
I20260709 13:12:28.581918 31940 raft_consensus.cc:2749] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:28.590487 31787 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:28.633488 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:28.586834 32044 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:28.633747 29521 raft_consensus.cc:1240] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:28.587065 32061 consensus_queue.cc:1059] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:12:28.643767 29495 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:28.638638 29447 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
I20260709 13:12:28.651887 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:28.654742 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:28.667722 29453 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:28.590590 31711 raft_consensus.cc:2804] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:28.594208 32007 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:28.656208 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 49344.5us
I20260709 13:12:28.673477 29419 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:28.674777 29419 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:28.552472 31895 consensus_queue.cc:1048] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 13:12:28.607585 31985 raft_consensus.cc:2804] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:12:28.658680 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 46946.8us
I20260709 13:12:28.660355 29530 raft_consensus.cc:1240] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:28.593838 32047 raft_consensus.cc:697] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:28.663143 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:28.635917 32009 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:28.667775 29454 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:12:28.663375 32030 raft_consensus.cc:2804] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:28.661548 32019 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:28.676626 29419 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:28.676668 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:28.697769 29526 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:28.674461 31957 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:28.686779 32030 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:28.703533 31787 raft_consensus.cc:2804] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:28.678571 32017 raft_consensus.cc:2749] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:28.703982 32030 raft_consensus.cc:3060] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:28.704005 32047 consensus_queue.cc:237] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:28.709918 32020 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:28.639976 29449 raft_consensus.cc:1240] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
W20260709 13:12:28.688863 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 45186us
I20260709 13:12:28.678574 29528 raft_consensus.cc:1240] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:28.711928 29495 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:28.691586 29453 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:12:28.697679 29344 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:28.677106 31711 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:28.704063 31787 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:28.715673 31787 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:28.716711 32071 consensus_queue.cc:1048] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:28.720073 29495 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:28.720960 32071 consensus_queue.cc:1048] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:28.724684 29495 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:28.680529 31985 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:28.727259 31985 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:28.727389 32044 raft_consensus.cc:3055] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:28.728065 32044 raft_consensus.cc:740] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:28.728814 31940 raft_consensus.cc:2804] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:28.729449 31940 raft_consensus.cc:697] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:28.729025 32044 consensus_queue.cc:260] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:28.730687 32044 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:28.731268 32061 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:28.713766 29419 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:28.731614 31957 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:28.731909 32061 raft_consensus.cc:697] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:28.732066 31957 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:28.732344 32017 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:28.732525 31957 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:28.732990 29419 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:28.679059 32035 raft_consensus.cc:2749] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:28.732923 32061 consensus_queue.cc:237] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:28.681790 29346 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:28.715721 32063 raft_consensus.cc:2749] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:28.735541 29495 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:28.735669 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 53969.9us
I20260709 13:12:28.730424 31940 consensus_queue.cc:237] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:28.690196 29521 raft_consensus.cc:1240] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:28.757315 29521 raft_consensus.cc:1240] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:28.737782 29279 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35182 (request call id 60) took 3883 ms. Trace:
I20260709 13:12:28.737655 32020 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:28.733942 32017 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:28.714239 29344 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:28.761664 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 47491.3us
I20260709 13:12:28.800594 29521 raft_consensus.cc:1275] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:28.744679 29522 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:12:28.808960 29521 raft_consensus.cc:1240] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:28.754361 29278 catalog_manager.cc:5697] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 7 to 8, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 8 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:28.812168 29278 catalog_manager.cc:5697] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 6 to 9, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 9 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
W20260709 13:12:28.813535 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 78626.4us
I20260709 13:12:28.815151 29419 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:28.815445 29278 catalog_manager.cc:5697] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 2 to 7, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 7 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:28.739972 31711 raft_consensus.cc:3060] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:28.825098 29278 catalog_manager.cc:5697] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 5 to 6, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 6 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:28.751992 29495 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:28.827003 29278 catalog_manager.cc:5697] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 7 to 8, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 8 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:28.750854 29526 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:12:28.828909 29278 catalog_manager.cc:5697] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 5 to 6, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 6 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:28.831215 29278 catalog_manager.cc:5697] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 3 to 4, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 4 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:28.834427 29521 raft_consensus.cc:1275] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:28.833249 29278 catalog_manager.cc:5697] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 5 to 6, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 6 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:28.836887 29521 raft_consensus.cc:1275] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:12:28.837553 29419 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:28.838599 29419 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:12:28.845543 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 93636.1us
I20260709 13:12:28.763576 32071 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:28.740844 31895 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:28.846676 29419 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:28.846663 29495 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:28.765178 32018 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:28.758188 29279 rpcz_store.cc:276] 0709 13:12:24.854252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:24.865653 (+ 11401us) service_pool.cc:224] Handling call
0709 13:12:28.737699 (+3872046us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:28.449469 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:28.450070 (+   601us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:28.450114 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:12:28.450135 (+    21us) tablet.cc:662] Decoding operations
0709 13:12:28.450490 (+   355us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:28.450585 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:28.450625 (+    40us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:12:28.450824 (+   199us) tablet.cc:701] Row locks acquired
0709 13:12:28.450844 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:12:28.451015 (+   171us) write_op.cc:270] Start()
0709 13:12:28.451138 (+   123us) write_op.cc:276] Timestamp: P: 1783602748450959 usec, L: 0
0709 13:12:28.451159 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:12:28.451882 (+   723us) log.cc:844] Serialized 538 byte log entry
0709 13:12:28.559999 (+108117us) op_driver.cc:464] REPLICATION: finished
0709 13:12:28.699070 (+139071us) write_op.cc:301] APPLY: starting
0709 13:12:28.699161 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:28.699268 (+   107us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:28.699383 (+   115us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:28.699659 (+   276us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:28.699840 (+   181us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:12:28.699899 (+    59us) write_op.cc:312] APPLY: finished
0709 13:12:28.700105 (+   206us) log.cc:844] Serialized 22 byte log entry
0709 13:12:28.700298 (+   193us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:28.700393 (+    95us) write_op.cc:454] Released schema lock
0709 13:12:28.700433 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:28.700915 (+   482us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:28.700946 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":506055,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":138767,"apply.run_cpu_time_us":1783,"apply.run_wall_time_us":1784,"num_ops":1,"prepare.queue_time_us":276769,"prepare.run_cpu_time_us":2757,"prepare.run_wall_time_us":2758,"replication_time_us":108668,"thread_start_us":301092,"threads_started":2}]]}
I20260709 13:12:28.741765 31987 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:28.884369 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 147860us
I20260709 13:12:28.811408 31802 raft_consensus.cc:2749] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:28.885506 29346 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:28.836211 29278 catalog_manager.cc:5697] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 5 to 6, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 6 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:28.820057 32056 consensus_queue.cc:1059] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 13:12:28.820384 32008 consensus_queue.cc:1059] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 13:12:28.893088 29495 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:28.799326 31713 consensus_queue.cc:1059] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:12:28.898746 29344 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:28.903728 29278 catalog_manager.cc:5697] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:28.915028 29278 catalog_manager.cc:5697] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:28.882218 32019 raft_consensus.cc:2804] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:28.852257 32035 raft_consensus.cc:2749] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:28.924978 29278 catalog_manager.cc:5697] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:28.806735 32062 consensus_queue.cc:1059] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.093s
I20260709 13:12:28.927093 29527 raft_consensus.cc:2368] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 6. Current term is 7.
I20260709 13:12:28.881305 32020 raft_consensus.cc:2749] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:28.844640 32024 consensus_queue.cc:1048] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 13:12:28.889638 32069 raft_consensus.cc:2804] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:28.893139 32011 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:28.904915 32047 raft_consensus.cc:2804] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:28.844703 31762 consensus_queue.cc:1059] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:12:28.898114 32071 raft_consensus.cc:697] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:28.936978 29278 catalog_manager.cc:5697] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 6 to 7, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 7 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:28.915680 32018 raft_consensus.cc:697] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:28.978282 32030 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:28.979082 32018 consensus_queue.cc:237] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:28.979749 29375 raft_consensus.cc:1240] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:28.959102 31961 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:28.984148 31961 raft_consensus.cc:697] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:28.984587 32062 raft_consensus.cc:3055] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:28.970397 32007 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:28.985586 31929 raft_consensus.cc:2804] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:28.986176 31929 raft_consensus.cc:697] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:28.985920 32007 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:28.987051 31929 consensus_queue.cc:237] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:28.988327 32007 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:28.975040 31787 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:28.990271 31929 raft_consensus.cc:3055] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:28.991117 29530 raft_consensus.cc:1240] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:28.958668 31895 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:28.930946 32019 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:28.990686 31929 raft_consensus.cc:740] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:28.962926 32047 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:28.900224 32046 consensus_queue.cc:1059] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:12:28.965528 29278 catalog_manager.cc:5697] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 3 to 4, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 4 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:29.004065 31787 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:29.032287 29278 catalog_manager.cc:5697] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:29.033908 29278 catalog_manager.cc:5697] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 5 to 7, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 7 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:29.004738 31895 raft_consensus.cc:3055] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:28.985234 31961 consensus_queue.cc:237] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:28.985221 32062 raft_consensus.cc:740] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:29.025281 32009 raft_consensus.cc:2749] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 6. Current term is 7.
I20260709 13:12:29.007300 32019 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:29.026212 31957 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:29.027334 32071 consensus_queue.cc:237] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:29.065214 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 179819us
I20260709 13:12:29.030212 32047 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:28.999428 32069 raft_consensus.cc:697] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:29.036152 29278 catalog_manager.cc:5697] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:29.026767 31929 consensus_queue.cc:260] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:29.067656 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.076066 29278 catalog_manager.cc:5697] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:29.038723 31895 raft_consensus.cc:740] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:29.083310 29346 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:29.077796 29278 catalog_manager.cc:5697] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 4 to 7, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 7 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:29.093947 29278 catalog_manager.cc:5697] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 3 to 5, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 5 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:29.108039 29346 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:29.111130 32062 consensus_queue.cc:260] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:29.112936 32062 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:29.114032 32069 consensus_queue.cc:237] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:29.136932 31957 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:29.058127 32000 consensus_queue.cc:1059] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:12:29.138494 32032 raft_consensus.cc:3055] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:29.138646 32046 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.138974 32032 raft_consensus.cc:740] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:12:29.139308 32046 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:29.139943 32032 consensus_queue.cc:260] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:29.141480 32032 raft_consensus.cc:3060] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:29.141558 32046 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:29.142357 32046 raft_consensus.cc:2804] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:29.142833 32046 raft_consensus.cc:697] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:29.143978 31713 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:29.144259 32030 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:29.144817 29346 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:29.145263 31895 consensus_queue.cc:260] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:29.145891 31713 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:29.146865 31895 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:29.147581 32030 consensus_queue.cc:1048] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:29.148203 29346 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:29.148998 32030 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.149719 32063 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:29.150334 32030 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:29.152544 29453 raft_consensus.cc:1275] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:29.148422 31987 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:29.155020 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:29.155983 29449 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:29.122843 31985 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:29.158453 29525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.006s	sys 0.010s
I20260709 13:12:29.141474 29448 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
I20260709 13:12:29.158898 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:12:29.164425 29525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.007s	sys 0.010s
I20260709 13:12:29.164851 29447 raft_consensus.cc:2468] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
I20260709 13:12:29.160006 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:29.165794 29453 raft_consensus.cc:1240] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:29.162196 29421 leader_election.cc:400] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 6. Current term is 7.
I20260709 13:12:29.166450 29421 leader_election.cc:403] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:12:29.176483 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:29.180998 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:12:29.183596 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 284955us
I20260709 13:12:29.184698 29529 raft_consensus.cc:1240] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:29.155224 32030 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:29.192727 29447 raft_consensus.cc:1240] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:29.195446 29453 raft_consensus.cc:1240] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:29.195626 29450 raft_consensus.cc:1275] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:29.195811 29447 raft_consensus.cc:1240] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:29.193589 29452 raft_consensus.cc:1240] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:29.198033 29452 raft_consensus.cc:1275] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:12:29.199159 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:29.200634 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:29.201606 29452 raft_consensus.cc:2393] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 9: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:29.213768 32046 consensus_queue.cc:237] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:29.226850 31762 raft_consensus.cc:3055] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:29.234200 29449 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:29.216409 31957 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.236726 32020 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 6. Current term is 7.
I20260709 13:12:29.230288 31762 raft_consensus.cc:740] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:29.292574 31985 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:29.282511 32018 consensus_queue.cc:1048] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:12:29.256628 32063 consensus_queue.cc:1048] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:12:29.271613 32035 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:29.301540 32035 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:29.304877 31762 consensus_queue.cc:260] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:29.306581 31762 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:29.313913 32087 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:29.314822 32087 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:29.321955 32035 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:29.306660 31711 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:29.327858 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:12:29.331969 29522 raft_consensus.cc:1275] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:12:29.335657 29527 raft_consensus.cc:1240] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:29.340169 29373 raft_consensus.cc:1240] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:29.340154 29522 pending_rounds.cc:85] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 2
I20260709 13:12:29.341539 29522 pending_rounds.cc:107] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:12:29.341771 29522 raft_consensus.cc:2889] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:29.335958 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:29.344517 31711 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:29.352836 30157 raft_consensus.cc:2468] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
I20260709 13:12:29.358767 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:29.360080 29526 raft_consensus.cc:2393] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 9: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:29.283245 31957 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:29.285354 32047 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:29.354665 32024 consensus_queue.cc:1059] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:12:29.379686 29526 raft_consensus.cc:1240] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 LEADER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:29.396347 29526 raft_consensus.cc:1240] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 LEADER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:29.364471 32008 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.364112 32035 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:29.383838 31974 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:29.398242 32011 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.420444 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:29.421398 29375 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
I20260709 13:12:29.422209 29374 raft_consensus.cc:1240] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:29.424036 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:29.423112 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:29.427085 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:29.431842 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:29.436519 29344 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:12:29.437009 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:29.436616 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:29.440593 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:29.480528 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:29.482227 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:12:29.492689 29376 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:12:29.499797 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:29.518033 29378 raft_consensus.cc:1240] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:29.521056 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:29.522024 29378 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:29.471740 32056 raft_consensus.cc:2804] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:29.428114 32035 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:29.472188 32087 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:29.432817 32008 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:29.537590 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.431062 32011 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:29.554548 32011 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:29.524873 31929 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:29.574005 32035 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:29.574712 32035 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:29.575428 32047 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:29.578214 31957 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:29.579144 29379 raft_consensus.cc:1240] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 7. Current term is 8. Ops: []
W20260709 13:12:29.584287 32097 log.cc:927] Time spent T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:12:29.544384 32030 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.585433 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:29.585507 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:29.536085 31785 raft_consensus.cc:3055] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:29.586269 31785 raft_consensus.cc:740] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:29.586136 29379 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 8.
I20260709 13:12:29.585496 32030 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:29.586190 29455 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
I20260709 13:12:29.575207 32035 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:29.587565 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:29.692528 32030 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:29.693408 29421 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:29.693931 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:29.695072 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:29.695462 32116 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:29.696353 32116 consensus_queue.cc:1059] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:29.697602 32116 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:29.698115 32116 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:29.700701 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:12:29.701189 29419 leader_election.cc:336] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.626s (SENT)
W20260709 13:12:29.615351 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.701696 29419 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:29.702242 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:29.702651 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.705998 29378 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:12:29.587291 31785 consensus_queue.cc:260] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:29.712137 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:29.577566 32092 log.cc:927] Time spent T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:12:29.719758 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:29.710269 29380 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
I20260709 13:12:29.725986 29346 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:29.707151 32104 log.cc:927] Time spent T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 13:12:29.730307 32063 consensus_queue.cc:1048] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:29.731444 32086 raft_consensus.cc:2804] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:29.731925 32086 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:29.732009 29346 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:29.732331 32086 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:29.732908 32024 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:29.734019 29346 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:29.679795 32110 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.736469 32083 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:29.737474 32110 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:29.739655 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:29.743433 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:29.741739 29379 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "71aa3578fd924765ab9ac0729c8d1483"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:12:29.746356 29379 raft_consensus.cc:606] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Received request to transfer leadership to TS 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:29.559206 32056 raft_consensus.cc:697] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:29.751076 29378 raft_consensus.cc:1240] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:29.710625 32011 raft_consensus.cc:3055] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:29.721882 31713 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.766817 29378 raft_consensus.cc:1275] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:12:29.760877 29455 raft_consensus.cc:3055] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:29.724751 32115 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.768781 29455 raft_consensus.cc:740] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:29.773115 29378 raft_consensus.cc:1275] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:29.773291 29448 raft_consensus.cc:3055] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:29.773696 29448 raft_consensus.cc:740] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:29.774587 29448 consensus_queue.cc:260] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:29.775995 29448 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:29.756743 32112 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:29.769436 32011 raft_consensus.cc:740] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:29.781751 29455 consensus_queue.cc:260] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:29.579679 29368 tablet_service.cc:1558] Processing DeleteTablet for tablet eb6a9a102eba49209ddf2bdf286077e8 with delete_type TABLET_DATA_TOMBSTONED (TS 429e58eb058349e3bf72b5a870c8f6e5 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:52164
I20260709 13:12:29.773506 32116 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:29.769411 32030 consensus_queue.cc:1059] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:12:29.803742 32116 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.804392 32116 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:29.798677 32096 log.cc:927] Time spent T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.279s	user 0.006s	sys 0.000s
I20260709 13:12:29.807128 32116 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:29.768514 31895 consensus_queue.cc:1048] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:12:29.797391 29448 raft_consensus.cc:1275] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:29.820863 32008 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:29.825529 32086 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:29.831637 32086 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:29.831961 32105 log.cc:927] Time spent T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.417s	user 0.001s	sys 0.001s
I20260709 13:12:29.836808 32116 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:12:29.794530 32019 consensus_meta.cc:287] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.721s	user 0.010s	sys 0.006s
I20260709 13:12:29.837862 32116 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:29.838195 32019 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:29.840782 32019 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:29.841293 32116 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:29.841718 29447 raft_consensus.cc:1240] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:29.802016 29525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 1221) took 1241 ms. Trace:
I20260709 13:12:29.842861 29525 rpcz_store.cc:276] 0709 13:12:28.560250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:28.600642 (+ 40392us) service_pool.cc:224] Handling call
0709 13:12:28.600911 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:29.164958 (+564047us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:29.164991 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:29.172020 (+  7029us) log.cc:844] Serialized 26 byte log entry
0709 13:12:29.363203 (+191183us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:29.379401 (+ 16198us) log.cc:844] Serialized 14 byte log entry
0709 13:12:29.380537 (+  1136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:29.380632 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:29.801749 (+421117us) raft_consensus.cc:1685] finished
0709 13:12:29.801774 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:29.801939 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":387,"prepare.queue_time_us":16499,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":2420,"raft.queue_time_us":5374,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":4109,"thread_start_us":696541,"threads_started":2,"wal-append.queue_time_us":211872}
I20260709 13:12:29.802654 32110 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:29.780782 31711 consensus_queue.cc:1059] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:12:29.812553 32035 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:29.771761 31713 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:29.848451 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:29.849099 31713 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:29.782912 32117 consensus_queue.cc:1059] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:12:29.851364 32117 raft_consensus.cc:3055] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:29.852581 31710 raft_consensus.cc:3055] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:29.853243 31710 raft_consensus.cc:740] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:12:29.857112 32103 log.cc:927] Time spent T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.442s	user 0.002s	sys 0.000s
W20260709 13:12:29.813465 31762 consensus_meta.cc:287] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.506s	user 0.015s	sys 0.000s
I20260709 13:12:29.771718 32115 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:29.854198 31710 consensus_queue.cc:260] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:29.860316 32056 consensus_queue.cc:237] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:29.814220 32011 consensus_queue.cc:260] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:29.863485 32011 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:29.801739 32119 raft_consensus.cc:2749] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:29.790105 32112 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:29.837630 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:29.852041 32117 raft_consensus.cc:740] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:29.813274 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:12:29.815290 29495 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.913s	user 0.007s	sys 0.023s
I20260709 13:12:29.915359 29521 raft_consensus.cc:1275] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:29.799885 29455 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:29.781595 32063 consensus_queue.cc:1048] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.093s
I20260709 13:12:29.874596 31710 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:29.874874 32115 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:29.880211 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:29.882200 32088 raft_consensus.cc:3055] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:29.960238 32088 raft_consensus.cc:740] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:12:29.960500 32091 log.cc:927] Time spent T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.529s	user 0.000s	sys 0.005s
I20260709 13:12:29.961292 32088 consensus_queue.cc:260] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:29.962725 32088 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:29.888885 29373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 338) took 1231 ms. Trace:
I20260709 13:12:29.963408 32112 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:29.963855 29373 rpcz_store.cc:276] 0709 13:12:28.657522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:28.657705 (+   183us) service_pool.cc:224] Handling call
0709 13:12:28.658032 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:29.340774 (+682742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:29.888559 (+547785us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b5400190d54. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:29.888784 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1568405376}
I20260709 13:12:29.964655 29528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2204) took 1389 ms. Trace:
I20260709 13:12:29.915253 32035 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:29.965842 32117 consensus_queue.cc:260] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:29.966202 32035 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:29.891142 29375 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:12:29.967295 32117 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:29.887169 29344 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:29.968504 32035 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:29.968842 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 81786.9us
I20260709 13:12:29.969907 32063 raft_consensus.cc:2749] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:29.970609 29529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 1232) took 1407 ms. Trace:
I20260709 13:12:29.902884 29524 raft_consensus.cc:1240] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 8. Current term is 9. Ops: []
W20260709 13:12:29.971257 32099 log.cc:927] Time spent T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.555s	user 0.002s	sys 0.001s
I20260709 13:12:29.972127 29379 raft_consensus.cc:1240] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:29.904201 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:29.973944 29530 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:12:29.912762 29527 raft_consensus.cc:1275] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:12:29.916615 29421 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.680s (SENT) [suppressed 26 similar messages]
I20260709 13:12:29.979128 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:29.980018 29381 raft_consensus.cc:2393] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 7: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:29.965019 29528 rpcz_store.cc:276] 0709 13:12:28.575204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:28.715528 (+140324us) service_pool.cc:224] Handling call
0709 13:12:28.715875 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:28.736057 (+ 20182us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:12:28.911387 (+175330us) log.cc:844] Serialized 14 byte log entry
0709 13:12:29.160095 (+248708us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:29.161169 (+  1074us) log.cc:844] Serialized 26 byte log entry
0709 13:12:29.171349 (+ 10180us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:29.171437 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:29.171574 (+   137us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:29.879273 (+707699us) spinlock_profiling.cc:243] Waited 4.48 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:12:29.964316 (+ 85043us) raft_consensus.cc:1685] finished
0709 13:12:29.964444 (+   128us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:29.964588 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19357,"prepare.queue_time_us":200406,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":66,"raft.queue_time_us":27827,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":192,"spinlock_wait_cycles":10293120,"thread_start_us":391305,"threads_started":2,"wal-append.queue_time_us":471800}
W20260709 13:12:29.981679 29495 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.079s	user 0.009s	sys 0.023s
W20260709 13:12:29.982211 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 1.08918e+06us
I20260709 13:12:29.901602 29525 raft_consensus.cc:1240] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:29.971010 29529 rpcz_store.cc:276] 0709 13:12:28.563193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:28.630347 (+ 67154us) service_pool.cc:224] Handling call
0709 13:12:28.630548 (+   201us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:29.194278 (+563730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:29.970366 (+776088us) spinlock_profiling.cc:243] Waited 554 ms on lock 0x7b54003043d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:29.970544 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1274001280}
I20260709 13:12:29.987533 29447 raft_consensus.cc:1275] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:29.990327 29456 raft_consensus.cc:1240] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:12:29.990664 29447 raft_consensus.cc:1275] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:29.995446 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:29.997658 29447 raft_consensus.cc:2393] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 8: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:29.997850 29455 raft_consensus.cc:1275] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:12:29.998271 29455 pending_rounds.cc:85] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 4
I20260709 13:12:29.998517 29455 pending_rounds.cc:107] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:12:29.998767 29455 raft_consensus.cc:2889] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:30.003639 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 223967us
I20260709 13:12:30.004721 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:30.007539 29455 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:30.004853 29346 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:29.999575 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:30.026235 29447 raft_consensus.cc:1275] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:30.028359 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:29.871978 29372 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
W20260709 13:12:30.030429 29495 connection.cc:256] RPC call timeout handler was delayed by -1.0696652050000921s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1552s for a response
I20260709 13:12:30.030763 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:30.029198 29448 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:12:30.034724 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:12:30.037429 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.038669 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:30.039340 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:30.039484 29344 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:30.039309 29453 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:30.041392 29495 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:12:30.046406 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.046581 29455 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
I20260709 13:12:30.053527 29453 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
I20260709 13:12:30.086486 29453 raft_consensus.cc:1275] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:12:30.089641 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 48342.1us
I20260709 13:12:30.090371 29453 raft_consensus.cc:1275] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:12:30.090803 29495 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:12:30.101392 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:30.102927 29449 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
I20260709 13:12:29.977597 32018 consensus_queue.cc:1048] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.105s
I20260709 13:12:30.182318 29449 raft_consensus.cc:1275] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:12:30.189311 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 63394.9us
I20260709 13:12:30.197502 29456 raft_consensus.cc:1275] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:30.082345 32030 consensus_queue.cc:1048] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.127s
I20260709 13:12:30.197999 31762 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:30.212307 32090 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:30.212713 31762 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:30.212888 32090 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:30.213220 31762 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:30.213383 32090 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:30.087108 31929 consensus_queue.cc:1059] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 8.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.140s
I20260709 13:12:30.106127 31951 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:30.228248 31951 raft_consensus.cc:697] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:30.228596 31929 raft_consensus.cc:3055] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:30.229091 31929 raft_consensus.cc:740] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:30.229529 31951 consensus_queue.cc:237] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:30.229959 31929 consensus_queue.cc:260] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:30.182952 31940 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:30.234426 29495 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:30.241523 32071 raft_consensus.cc:2749] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:30.255292 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 126938us
W20260709 13:12:30.257486 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 252779us
W20260709 13:12:30.259056 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 342466us
I20260709 13:12:30.199915 32047 consensus_queue.cc:1059] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:12:30.262921 29419 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:30.265345 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:30.263278 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.264264 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:30.266252 29528 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
I20260709 13:12:30.263056 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:30.269490 32121 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:30.269690 29529 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 8.
I20260709 13:12:30.270009 32121 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:30.281414 29419 leader_election.cc:400] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 4. Current term is 5.
I20260709 13:12:30.282146 29419 leader_election.cc:403] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:30.270529 32121 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:30.289129 29346 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:12:30.290306 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.290079 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:30.292068 29527 raft_consensus.cc:2393] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 8: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:30.294210 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:30.296226 29346 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:30.306245 29450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1875) took 1113 ms. Trace:
I20260709 13:12:30.306945 29450 rpcz_store.cc:276] 0709 13:12:29.193201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:29.196368 (+  3167us) service_pool.cc:224] Handling call
0709 13:12:29.196669 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:29.215088 (+ 18419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:29.215129 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:29.845884 (+630755us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b2c0005b3b8. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7a67fa11 00007f6a7a68f372 00007f6a7bdc1a01 00007f6a7bd8643a 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2
0709 13:12:29.846544 (+   660us) log.cc:844] Serialized 26 byte log entry
0709 13:12:30.091545 (+245001us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:30.091599 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:30.091696 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:30.305837 (+214141us) raft_consensus.cc:1685] finished
0709 13:12:30.305867 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:30.306154 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17972,"raft.queue_time_us":18466,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":8057,"spinlock_wait_cycles":47157376,"thread_start_us":244474,"threads_started":1,"wal-append.queue_time_us":424140}
I20260709 13:12:30.309544 32063 raft_consensus.cc:2804] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:30.309995 32063 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:30.310366 32063 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:30.313313 29452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1881) took 1115 ms. Trace:
I20260709 13:12:30.313541 31901 consensus_queue.cc:1059] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:30.314850 31901 raft_consensus.cc:3055] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:12:30.315613 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.313794 29452 rpcz_store.cc:276] 0709 13:12:29.198044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:29.203477 (+  5433us) service_pool.cc:224] Handling call
0709 13:12:29.208731 (+  5254us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:29.209060 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:29.209114 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:29.822731 (+613617us) spinlock_profiling.cc:243] Waited 25.9 ms on lock 0x7b2c0005b3b8. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7a67fa11 00007f6a7a68f372 00007f6a7bdc1a01 00007f6a7bd8643a 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2
0709 13:12:29.823271 (+   540us) log.cc:844] Serialized 26 byte log entry
0709 13:12:30.084273 (+261002us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:30.084344 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:30.084456 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:30.312998 (+228542us) raft_consensus.cc:1685] finished
0709 13:12:30.313030 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:30.313245 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59610880,"thread_start_us":260425,"threads_started":1,"wal-append.queue_time_us":442858}
I20260709 13:12:30.315240 31901 raft_consensus.cc:740] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:12:30.317385 31901 consensus_queue.cc:260] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:30.323354 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:30.324244 29419 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:30.324771 29527 raft_consensus.cc:2410] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:12:30.325623 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.294204 32008 raft_consensus.cc:2749] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:30.326792 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:30.331337 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:30.332863 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:30.333779 29528 raft_consensus.cc:2393] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 8: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:12:30.332727 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 293335us
I20260709 13:12:30.335039 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:30.336519 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:30.337553 29523 raft_consensus.cc:2393] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 7: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:30.267594 32120 consensus_queue.cc:1048] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:12:30.344146 29419 leader_election.cc:400] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 6. Current term is 7.
I20260709 13:12:30.347558 29419 leader_election.cc:403] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:12:30.336721 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:30.319430 32020 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 4. Current term is 5.
I20260709 13:12:30.359653 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:30.365739 29525 raft_consensus.cc:2393] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 4: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:30.337271 29495 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:30.372172 32123 log.cc:927] Time spent T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b: Append to log took a long time: real 0.110s	user 0.000s	sys 0.002s
I20260709 13:12:30.358143 32009 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:30.355855 31901 raft_consensus.cc:3060] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:30.366242 32119 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:30.374894 32047 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.358551 31895 consensus_queue.cc:1048] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
W20260709 13:12:30.422366 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 70030.7us
I20260709 13:12:30.374614 32011 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 6. Current term is 7.
I20260709 13:12:30.379662 31974 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:30.408124 32020 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.379882 31987 consensus_queue.cc:1048] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
W20260709 13:12:30.455529 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:30.468622 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.488821 32120 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.409798 32094 consensus_queue.cc:1059] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:12:30.424464 32047 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:30.543084 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 243210us
W20260709 13:12:30.548183 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 55586.9us
I20260709 13:12:30.501824 32115 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:30.424676 32119 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:30.555253 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:30.551654 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:30.514129 32142 log.cc:927] Time spent T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:12:30.553036 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:12:30.532980 32117 consensus_meta.cc:287] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.565s	user 0.012s	sys 0.001s
I20260709 13:12:30.456990 32020 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:30.563081 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 185248us
I20260709 13:12:30.564319 29525 raft_consensus.cc:1240] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:30.489735 32120 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:30.565897 30157 raft_consensus.cc:1275] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:12:30.566980 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:30.559732 32138 log.cc:927] Time spent T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.113s	user 0.001s	sys 0.001s
I20260709 13:12:30.560961 32131 tablet_replica.cc:333] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:12:30.546456 32035 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.561282 32136 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.560047 32115 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:30.598018 31987 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:30.650465 32115 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:30.651829 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:30.634251 31987 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:30.655054 31987 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:30.615360 32035 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:30.658821 32035 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:30.662328 32117 consensus_queue.cc:1048] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:30.664662 32020 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:30.673079 32120 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:30.614295 32136 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:30.675608 32062 raft_consensus.cc:993] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5: : Instructing follower 71aa3578fd924765ab9ac0729c8d1483 to start an election
I20260709 13:12:30.676512 32136 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:30.677243 32136 raft_consensus.cc:1081] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Signalling peer 71aa3578fd924765ab9ac0729c8d1483 to start an election
I20260709 13:12:30.683552 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:30.684549 30157 raft_consensus.cc:2393] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 4: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
W20260709 13:12:30.685290 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 121117us
I20260709 13:12:30.687067 29495 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:30.679258 32119 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:30.707608 29495 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:30.685644 32120 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:30.727542 32120 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:30.730237 32120 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:30.685982 32136 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:30.731942 32136 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:30.734333 32144 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:30.734963 32144 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:30.735997 32146 consensus_queue.cc:1048] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:30.703423 32115 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:30.737389 32144 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:30.701341 32035 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:30.699435 32020 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:30.720643 32152 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:12:30.721698 32125 log.cc:927] Time spent T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.261s	user 0.000s	sys 0.002s
W20260709 13:12:30.722100 32132 log.cc:927] Time spent T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
W20260709 13:12:30.722843 31762 consensus_meta.cc:287] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.509s	user 0.010s	sys 0.004s
I20260709 13:12:30.723599 32151 consensus_queue.cc:1059] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.131s
I20260709 13:12:30.724720 32141 raft_consensus.cc:3055] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:30.725148 32143 consensus_queue.cc:1048] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.104s
W20260709 13:12:30.726363 32139 log.cc:927] Time spent T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:12:30.737703 32115 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:30.754424 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.751976 31940 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:12:30.787925 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.731272 32047 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:30.821049 32120 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:30.821516 32158 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:30.821991 32158 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:30.821893 32120 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:30.822389 32158 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:30.776371 32020 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:30.825647 32154 log.cc:927] Time spent T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:12:30.825965 32020 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:30.785318 32152 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:30.829468 32152 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:30.830101 32136 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:30.738389 32035 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:30.839866 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 231780us
I20260709 13:12:30.787667 32141 raft_consensus.cc:740] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:30.760455 31987 consensus_queue.cc:1048] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
W20260709 13:12:30.843338 32088 consensus_meta.cc:287] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.880s	user 0.013s	sys 0.007s
W20260709 13:12:30.841437 32090 consensus_meta.cc:287] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.628s	user 0.006s	sys 0.008s
I20260709 13:12:30.776541 32121 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:30.788902 31762 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:30.851590 32136 consensus_queue.cc:1059] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:12:30.841382 31974 raft_consensus.cc:697] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:30.880609 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:30.855402 31710 consensus_meta.cc:287] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.896s	user 0.011s	sys 0.007s
I20260709 13:12:30.878760 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:30.884348 29521 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6"
dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
 from {username='slave'} at 127.0.0.1:37968
I20260709 13:12:30.885135 29521 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:30.885596 29521 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:30.891258 32159 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:30.891299 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:30.883212 32152 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.893026 32152 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:30.896903 29344 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:30.897729 31762 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:30.898379 32018 raft_consensus.cc:2749] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:30.899765 29379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52172 (request call id 1292) took 1320 ms. Trace:
I20260709 13:12:30.899852 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:30.900560 29530 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:30.902179 29521 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:30.900259 29379 rpcz_store.cc:276] 0709 13:12:29.578857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:29.774305 (+195448us) service_pool.cc:224] Handling call
0709 13:12:29.774656 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:29.972528 (+197872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:30.899517 (+926989us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b54000d9dd4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:30.899701 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":453645184}
I20260709 13:12:30.889251 32136 consensus_queue.cc:1243] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer 71aa3578fd924765ab9ac0729c8d1483 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:12:30.905296 29521 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:30.865216 32090 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:30.948374 32090 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:30.892066 32159 raft_consensus.cc:697] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:30.952423 32159 consensus_queue.cc:237] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:30.907397 32035 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:30.961282 32120 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:30.916975 32115 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:30.926967 32020 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:30.962857 32020 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:30.963573 32152 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:30.917212 32141 consensus_queue.cc:260] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:30.965633 32158 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:30.928960 29530 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:12:30.920096 29377 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
I20260709 13:12:30.910997 29375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 982) took 1481 ms. Trace:
I20260709 13:12:30.970198 29375 rpcz_store.cc:276] 0709 13:12:29.429598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:29.429727 (+   129us) service_pool.cc:224] Handling call
0709 13:12:29.848096 (+418369us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b5800010298. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61b71 00007f6a78c61a22 00007f6a81b7ac09 00007f6a80cd4ee0 00007f6a80d9e0ab 00007f6a80d9e131 00007f6a80d4c0a0 00007f6a80d4b984 00007f6a7a2c66d4 00007f6a7a2c6662
0709 13:12:30.910790 (+1062694us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b54003f2d54. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:30.910926 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66507520}
W20260709 13:12:30.970783 29372 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 976) took 1549 ms (client timeout 1618 ms). Trace:
I20260709 13:12:30.971948 29344 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:30.945088 32063 consensus_meta.cc:287] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.634s	user 0.016s	sys 0.000s
I20260709 13:12:30.973237 32063 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:30.974375 29521 raft_consensus.cc:1240] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 7. Current term is 8. Ops: []
W20260709 13:12:30.976378 29372 rpcz_store.cc:269] 0709 13:12:29.421305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:29.422432 (+  1127us) service_pool.cc:224] Handling call
0709 13:12:30.970535 (+1548103us) spinlock_profiling.cc:243] Waited 404 ms on lock 0x7b54003bbd54. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:30.970700 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":928205056}
I20260709 13:12:30.966614 32020 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:30.925114 32143 raft_consensus.cc:3055] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:12:30.981489 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.909750 32071 raft_consensus.cc:3055] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:30.981526 32143 raft_consensus.cc:740] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:30.983530 32071 raft_consensus.cc:740] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:30.985200 32158 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:30.984769 32071 consensus_queue.cc:260] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:30.986624 32071 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:30.909034 31785 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:30.989029 29377 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 985) took 1558 ms (client timeout 1719 ms). Trace:
W20260709 13:12:30.989506 29377 rpcz_store.cc:269] 0709 13:12:29.430438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:29.431326 (+   888us) service_pool.cc:224] Handling call
0709 13:12:29.813067 (+381741us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b5800010298. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61b71 00007f6a78c61a22 00007f6a81b7ac09 00007f6a80cd4ee0 00007f6a80d9e0ab 00007f6a80d9e131 00007f6a80d4c0a0 00007f6a80d4b984 00007f6a7a2c66d4 00007f6a7a2c6662
0709 13:12:30.988808 (+1175741us) spinlock_profiling.cc:243] Waited 975 ms on lock 0x7b54003c46d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:30.988957 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2245133440}
I20260709 13:12:31.012844 29279 catalog_manager.cc:5697] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 3 to 4, leader changed from ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 4 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:12:30.902209 32121 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:30.992974 31895 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:31.017221 32117 consensus_queue.cc:1059] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:12:30.893038 31974 consensus_queue.cc:237] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:31.051585 29493 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.008s	sys 0.023s
W20260709 13:12:31.056058 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:31.082424 29493 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.009s	sys 0.023s
I20260709 13:12:31.087016 32020 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:31.088075 32020 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:31.024502 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 430746us
I20260709 13:12:31.018342 32136 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:31.050585 32008 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.000s	sys 0.017s
I20260709 13:12:31.059755 32121 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.095425 32158 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.110845 32152 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:31.121405 32008 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.000s	sys 0.019s
I20260709 13:12:31.112618 31895 raft_consensus.cc:697] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:31.110926 32090 raft_consensus.cc:493] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
W20260709 13:12:31.148672 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 441145us
I20260709 13:12:31.124056 32115 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:31.156857 29421 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:31.158950 29449 raft_consensus.cc:1240] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:31.158308 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:31.151983 29495 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:31.162689 29495 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:31.165024 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:31.165692 29449 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:31.165721 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:31.168309 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:31.168329 29455 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:12:31.168982 29447 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:31.169695 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:31.170238 29447 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:12:31.112293 32136 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:31.173898 29451 raft_consensus.cc:3055] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:31.175652 29451 raft_consensus.cc:740] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:31.177400 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:31.178053 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:31.178072 29455 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:31.176692 29451 consensus_queue.cc:260] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:31.180558 29451 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:31.128093 31713 consensus_queue.cc:1048] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:12:31.185046 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:31.188174 29449 raft_consensus.cc:2468] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
I20260709 13:12:31.129307 32121 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:31.171141 32017 raft_consensus.cc:2749] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:31.160095 32020 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:31.170657 31961 raft_consensus.cc:2804] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:31.138185 32158 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:31.146102 32152 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:31.186252 31940 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:31.282780 29447 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
W20260709 13:12:31.284484 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 101872us
I20260709 13:12:31.282994 29451 raft_consensus.cc:1275] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:12:31.161195 32090 raft_consensus.cc:515] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:31.171015 32047 consensus_queue.cc:1048] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:12:31.174320 32009 consensus_queue.cc:1048] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:12:31.173008 32115 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:31.291932 29450 raft_consensus.cc:3060] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:31.173388 32119 consensus_queue.cc:1048] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:12:31.173888 31957 consensus_queue.cc:1048] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:12:31.310597 32121 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:31.193938 32120 consensus_queue.cc:1059] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.098s
W20260709 13:12:31.224502 32164 log.cc:927] Time spent T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.170s	user 0.001s	sys 0.001s
I20260709 13:12:31.301540 29419 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:31.324079 29419 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:31.291198 32146 consensus_queue.cc:1048] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:12:31.198276 31987 consensus_queue.cc:1048] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.098s
I20260709 13:12:31.309906 32119 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:31.292598 29455 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:31.291981 31961 raft_consensus.cc:697] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:31.320806 29452 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:31.296105 31940 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:31.317924 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 147415us
W20260709 13:12:31.345757 32169 log.cc:927] Time spent T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:12:31.318013 32121 consensus_queue.cc:1059] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:12:31.348171 32121 consensus_queue.cc:1243] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer 71aa3578fd924765ab9ac0729c8d1483 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:12:31.352543 32167 log.cc:927] Time spent T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:12:31.369676 29450 raft_consensus.cc:1275] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:12:31.289219 31895 consensus_queue.cc:237] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:31.412137 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:31.337360 32120 raft_consensus.cc:2749] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:31.415542 29495 connection.cc:256] RPC call timeout handler was delayed by -1.1525449499999922s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17190000000000003s for a response
W20260709 13:12:31.428377 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:31.350490 31940 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:31.350881 32020 raft_consensus.cc:3055] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:12:31.486608 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:31.359378 32162 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
W20260709 13:12:31.445089 32179 log.cc:927] Time spent T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2: Append to log took a long time: real 0.151s	user 0.001s	sys 0.001s
I20260709 13:12:31.490932 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:31.486112 32020 raft_consensus.cc:740] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:31.485778 31929 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:31.411454 32090 leader_election.cc:290] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:31.340377 32119 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:31.507886 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:31.505770 29455 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:31.453342 32146 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:31.515105 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:31.535386 29448 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:31.540877 29521 raft_consensus.cc:1240] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:31.559026 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:31.559463 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:31.560408 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:31.560482 29453 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
I20260709 13:12:31.561206 29449 raft_consensus.cc:2410] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:12:31.562232 29449 raft_consensus.cc:1240] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:12:31.562292 29453 raft_consensus.cc:1240] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:12:31.564838 29453 raft_consensus.cc:1240] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:12:31.568339 29453 raft_consensus.cc:1275] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:31.521997 31961 consensus_queue.cc:237] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:31.572750 29448 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
W20260709 13:12:31.572860 31785 consensus_meta.cc:287] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.585s	user 0.008s	sys 0.005s
W20260709 13:12:31.588274 32176 log.cc:927] Time spent T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:12:31.591289 29451 raft_consensus.cc:1275] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:12:31.592741 32119 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:31.530330 32162 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:31.602435 32162 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:31.610070 32071 consensus_meta.cc:287] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.623s	user 0.012s	sys 0.003s
I20260709 13:12:31.505231 32184 raft_consensus.cc:3055] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:31.611210 32184 raft_consensus.cc:740] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:31.612434 32184 consensus_queue.cc:260] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:31.614210 32184 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:31.620216 32158 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:31.521620 32063 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:31.622670 32115 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:31.516443 32152 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:31.515120 32181 log.cc:927] Time spent T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:12:31.514240 31711 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.629748 31711 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:31.632833 31711 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:31.657691 29455 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
W20260709 13:12:31.666821 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 217558us
I20260709 13:12:31.673588 29523 raft_consensus.cc:1217] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 6.4->[7.5-7.5]   Dedup: 7.5->[]
I20260709 13:12:31.674165 29523 raft_consensus.cc:1240] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:12:31.675525 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:31.675670 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:31.675905 29521 raft_consensus.cc:1240] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:12:31.676604 29528 raft_consensus.cc:2393] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 9: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:31.675518 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:31.677438 29530 raft_consensus.cc:2376] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9. Re-sending same reply.
I20260709 13:12:31.677860 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:31.679715 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:31.680145 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:31.663504 32115 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:31.685815 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:31.544353 32146 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:31.687732 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:31.699318 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:31.702400 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:31.705087 29377 raft_consensus.cc:1240] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:31.705848 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:31.706107 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:31.706467 29380 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:31.706944 29379 raft_consensus.cc:1240] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:31.707759 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:31.709830 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:31.709944 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:31.710933 29376 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
I20260709 13:12:31.711337 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:31.713071 29376 raft_consensus.cc:1275] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:31.716516 29376 raft_consensus.cc:1275] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:12:31.709053 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:31.704146 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:31.684353 32163 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.718717 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:31.882722 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:31.884018 29381 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:12:31.809441 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:31.757174 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:31.719182 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:31.884297 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:31.886442 29522 raft_consensus.cc:2393] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 4: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:31.886336 29377 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:31.888583 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:31.682462 32119 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.682478 31951 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.687047 31785 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.886698 29523 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:31.900694 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:31.901099 29375 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:12:31.840013 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:31.882454 32146 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:31.908020 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 211239us
I20260709 13:12:31.816007 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:31.923982 29528 raft_consensus.cc:2393] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 9: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:31.850380 29380 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
I20260709 13:12:31.758831 32094 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.685236 32071 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.839708 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:31.891076 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:31.935938 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:31.889707 32158 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:31.770085 32153 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.909361 29372 raft_consensus.cc:1275] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:12:31.944027 29372 pending_rounds.cc:85] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5: Aborting all ops after (but not including) 3
I20260709 13:12:31.944406 29372 pending_rounds.cc:107] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:12:31.944805 29372 raft_consensus.cc:2889] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:31.758826 32120 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:31.919539 29377 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
I20260709 13:12:31.935927 29522 raft_consensus.cc:2410] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:12:31.724665 32170 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:31.912907 32090 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:31.960281 32090 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:31.961568 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:31.962778 32090 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:31.698313 32115 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:31.972924 29523 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 7.
I20260709 13:12:31.903064 32119 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:31.958169 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:31.913755 31785 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:31.959137 32170 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:31.975461 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:31.982321 29377 raft_consensus.cc:2393] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 8: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:31.985037 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:31.903095 32163 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:32.007418 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:32.008772 29377 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:12:32.012946 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:32.014031 29372 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 8.
I20260709 13:12:32.023108 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:31.913805 31951 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:32.029428 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:32.032747 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:32.033567 29377 raft_consensus.cc:2376] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9. Re-sending same reply.
I20260709 13:12:32.034575 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:32.036022 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:32.133061 29380 raft_consensus.cc:2393] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 7: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:12:32.136806 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:32.138909 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:32.144613 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:32.146263 29452 raft_consensus.cc:2393] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 7: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:32.150496 29453 raft_consensus.cc:1275] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:12:32.129848 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 188027us
I20260709 13:12:32.161510 31785 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:32.162626 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:32.164311 29452 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
W20260709 13:12:32.057565 31929 consensus_meta.cc:287] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.537s	user 0.012s	sys 0.002s
I20260709 13:12:31.940258 32071 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:32.172259 32071 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:32.173249 32071 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:32.173982 31951 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:32.134614 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:32.180325 29377 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 8.
I20260709 13:12:32.181969 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:32.184896 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:32.185957 29376 raft_consensus.cc:3055] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:32.186321 29376 raft_consensus.cc:740] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:32.183274 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:32.189674 29375 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:32.192070 29376 consensus_queue.cc:260] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:32.206777 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:32.208150 29522 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:12:32.174132 32071 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:31.937513 32094 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:32.224339 29529 raft_consensus.cc:1240] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 LEADER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:12:32.070533 32119 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:31.974049 32120 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:31.955358 32153 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:31.946337 32158 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:32.022804 32186 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.296614 32186 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:32.297205 29421 leader_election.cc:336] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.581s (SENT)
W20260709 13:12:32.097323 32192 log.cc:927] Time spent T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
W20260709 13:12:32.081838 32193 log.cc:927] Time spent T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:12:32.050913 32196 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.086601 32115 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:32.222882 29373 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
I20260709 13:12:32.227205 29372 raft_consensus.cc:2393] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 4: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:32.245807 32120 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:32.246712 32163 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:32.252555 32184 consensus_meta.cc:287] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.638s	user 0.014s	sys 0.000s
I20260709 13:12:32.254005 29419 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:32.257237 32170 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:32.266530 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:32.273020 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
W20260709 13:12:32.274838 32190 log.cc:927] Time spent T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 13:12:32.282481 32071 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:32.263150 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:32.288769 32207 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:32.292423 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:32.292353 29375 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
I20260709 13:12:32.293802 32158 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:32.320451 29495 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:32.321745 31940 consensus_meta.cc:287] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.812s	user 0.014s	sys 0.011s
I20260709 13:12:32.330907 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:32.332360 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:32.335309 32143 consensus_queue.cc:260] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:32.337334 32143 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:32.336011 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:32.337693 32153 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:32.338104 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:32.338604 32196 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:32.341585 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:32.339509 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:32.339236 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:32.353700 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:32.354758 32207 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:32.356742 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:32.330978 32094 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:32.376346 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:32.373845 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 53693.1us
I20260709 13:12:32.377622 29380 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 8.
I20260709 13:12:32.339097 31940 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:32.365849 29421 leader_election.cc:336] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.680s (SENT)
I20260709 13:12:32.388134 32158 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:32.388836 32158 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:32.389142 32071 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:32.390118 32071 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:32.396989 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:32.376390 32207 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:32.378592 32120 raft_consensus.cc:2749] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:32.402019 32196 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:32.405484 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:32.406481 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:32.406085 32162 consensus_queue.cc:1059] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:32.407716 29375 raft_consensus.cc:2393] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 5: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:32.408349 32162 raft_consensus.cc:3055] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:12:32.409183 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 155663us
I20260709 13:12:32.411149 32017 consensus_queue.cc:1059] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:32.411907 29495 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:32.412312 32017 consensus_queue.cc:1243] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer 71aa3578fd924765ab9ac0729c8d1483 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:12:32.409204 32162 raft_consensus.cc:740] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:32.414798 31940 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:32.414386 32162 consensus_queue.cc:260] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:32.415911 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:32.416908 29372 raft_consensus.cc:2393] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 7: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:32.417238 32071 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:32.418125 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:32.417254 32162 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:32.413015 32017 raft_consensus.cc:3055] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:32.389317 32158 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:32.424381 32017 raft_consensus.cc:740] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:32.425390 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:32.407022 29373 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 8.
I20260709 13:12:32.426075 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:32.409112 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:32.400190 29421 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:32.411334 29419 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:32.419152 29372 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 10.
I20260709 13:12:32.392027 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:32.435477 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:32.444980 31974 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:32.446009 31974 raft_consensus.cc:697] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:32.449502 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:32.453254 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:32.456380 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:32.458357 29378 raft_consensus.cc:2393] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 4: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:32.458729 32090 consensus_queue.cc:1059] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:12:32.459668 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:32.460354 32152 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:32.461226 29373 raft_consensus.cc:2393] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 8: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:32.454322 32153 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.461714 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:32.464243 29375 raft_consensus.cc:2468] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 7.
I20260709 13:12:32.462903 31974 consensus_queue.cc:237] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:32.455091 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:32.468518 32017 consensus_queue.cc:260] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:32.470122 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:32.470628 32017 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:32.470990 30121 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:12:32.471546 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:32.471984 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:32.472198 32004 raft_consensus.cc:2804] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:32.472719 32004 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.473150 32004 raft_consensus.cc:3060] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:32.473438 29374 raft_consensus.cc:1275] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:32.472875 32020 consensus_queue.cc:260] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:32.473691 32186 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:32.474354 32020 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:32.474545 29456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1895) took 1230 ms. Trace:
I20260709 13:12:32.475055 29374 raft_consensus.cc:1275] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:12:32.475003 29456 rpcz_store.cc:276] 0709 13:12:31.156783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.157265 (+   482us) service_pool.cc:224] Handling call
0709 13:12:31.157616 (+   351us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:31.158037 (+   421us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:12:31.550006 (+391969us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b18003fd720. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c7be07 00007f6a81ad6ab9 00007f6a78c9869b 00007f6a78c9693f 00007f6a78c96455 00007f6a7f77e3c7 00007f6a7bd909a7 00007f6a7bda00bf 00007f6a7bda0038
0709 13:12:31.759434 (+209428us) log.cc:844] Serialized 14 byte log entry
0709 13:12:32.281479 (+522045us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b18003fd720. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a7b92e4bc 00007f6a78c7c48b 00007f6a81ad6ab9 00007f6a78c9869b 00007f6a78c9693f 00007f6a78c98c02 00007f6a7b92020b 00007f6a7b925d23 00007f6a7b92623a
0709 13:12:32.335159 (+ 53680us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:32.336184 (+  1025us) log.cc:844] Serialized 52 byte log entry
0709 13:12:32.343101 (+  6917us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:32.362452 (+ 19351us) log.cc:844] Serialized 14 byte log entry
0709 13:12:32.365554 (+  3102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.378897 (+ 13343us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:32.378948 (+    51us) raft_consensus.cc:1685] finished
0709 13:12:32.378964 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:32.387276 (+  8312us) inbound_call.cc:177] Queueing success response
0709 13:12:32.469954 (+ 82678us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b18003fd720. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c99557 00007f6a78c9b7c1 00007f6a78c9b779 00007f6a78c9b709 00007f6a78c9b6d1 00007f6a78c9a9cd 000000000038f354 000000000038f199 00007f6a78c7c83a
Metrics: {"mutex_wait_us":8670,"prepare.queue_time_us":914594,"prepare.run_cpu_time_us":142,"prepare.run_wall_time_us":6447,"raft.queue_time_us":56606,"raft.run_cpu_time_us":519,"raft.run_wall_time_us":18468,"spinlock_wait_cycles":61627264,"thread_start_us":311130,"threads_started":2,"wal-append.queue_time_us":229617}
I20260709 13:12:32.452306 32120 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:32.480265 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 69087.7us
I20260709 13:12:32.481680 29419 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:32.462206 32153 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:32.483731 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:32.486217 29372 raft_consensus.cc:1275] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:32.488502 29375 raft_consensus.cc:1275] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:32.492735 32136 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:32.462589 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:32.498751 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:32.499724 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:32.495641 29378 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 7.
I20260709 13:12:32.496924 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:32.472947 29377 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 7.
I20260709 13:12:32.500569 32120 raft_consensus.cc:2804] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:32.514751 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:32.512383 29381 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:32.517570 32120 raft_consensus.cc:697] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
W20260709 13:12:32.521710 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 73761.4us
I20260709 13:12:32.551012 32090 consensus_queue.cc:1048] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:32.553717 32090 raft_consensus.cc:3055] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:32.554270 32090 raft_consensus.cc:740] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:32.580855 29381 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
W20260709 13:12:32.623775 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 140451us
I20260709 13:12:32.626034 32004 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:12:32.649806 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:32.654753 32121 raft_consensus.cc:2804] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:32.518958 32120 consensus_queue.cc:237] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:32.668753 29380 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 7.
W20260709 13:12:32.671914 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 314402us
W20260709 13:12:32.673216 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:32.663695 32212 log.cc:927] Time spent T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.139s	user 0.002s	sys 0.000s
I20260709 13:12:32.650130 32153 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:32.679890 32018 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.680258 31929 raft_consensus.cc:493] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:32.681248 32018 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:32.681953 29495 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:32.684690 32061 raft_consensus.cc:2804] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:32.685386 32061 raft_consensus.cc:697] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:32.692348 29377 raft_consensus.cc:1240] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:12:32.686242 29495 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:32.693668 31940 consensus_queue.cc:1048] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:32.666776 32186 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:32.701333 32004 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 8 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:32.710083 32158 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:32.728567 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:32.729733 29381 raft_consensus.cc:3060] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:32.730881 29374 raft_consensus.cc:1240] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 5. Current term is 6. Ops: []
W20260709 13:12:32.735949 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:32.738943 29372 raft_consensus.cc:1240] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:32.744849 32156 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:32.746521 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:32.747746 29527 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:32.749316 31974 raft_consensus.cc:2804] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:32.749848 31974 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:32.750101 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:32.750334 31974 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:32.753124 32186 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:32.756506 29277 catalog_manager.cc:5697] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
W20260709 13:12:32.758798 32215 log.cc:927] Time spent T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:12:32.746428 32156 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:32.681301 31929 raft_consensus.cc:515] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:32.770867 31929 leader_election.cc:290] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:12:32.791630 29421 leader_election.cc:336] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.683s (SENT)
I20260709 13:12:32.686677 32061 consensus_queue.cc:237] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:32.790591 29373 raft_consensus.cc:1240] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:12:32.816095 31987 consensus_queue.cc:1048] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:32.817498 32183 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:32.818259 32183 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:32.820075 32018 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:32.820895 32183 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:32.821979 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:32.828455 29381 raft_consensus.cc:2468] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 8.
I20260709 13:12:32.833101 29344 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:32.844444 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:32.880048 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:32.882757 32186 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:32.865345 32141 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:32.886822 32183 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:32.887873 32183 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:32.879046 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:32.890511 32183 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:32.890828 29529 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
I20260709 13:12:32.894766 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:32.895707 29456 raft_consensus.cc:3060] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:12:32.896250 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:32.897476 32121 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:32.897951 32121 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:32.869479 32158 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:32.901876 32090 consensus_queue.cc:260] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:32.867822 32153 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:12:32.922297 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 192173us
I20260709 13:12:32.939952 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
W20260709 13:12:32.940776 32220 log.cc:927] Time spent T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:12:32.944087 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:32.946494 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:32.955605 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:12:32.964619 32219 log.cc:927] Time spent T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:12:32.969164 32156 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:32.970876 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
W20260709 13:12:33.007766 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 65455.4us
W20260709 13:12:33.015635 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.018201 29527 raft_consensus.cc:1240] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:32.927946 32153 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:33.027539 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 85937.8us
W20260709 13:12:33.013773 32143 consensus_meta.cc:287] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.669s	user 0.011s	sys 0.006s
I20260709 13:12:33.016592 32156 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:33.020430 29456 raft_consensus.cc:2468] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 8.
W20260709 13:12:33.028420 29421 leader_election.cc:336] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 2.061s (SENT)
I20260709 13:12:33.039208 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:33.029641 32020 consensus_meta.cc:287] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.555s	user 0.014s	sys 0.002s
I20260709 13:12:33.017127 32152 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.053373 29421 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:33.045066 32090 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:33.057864 29529 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:12:33.029482 32153 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:33.069522 29456 raft_consensus.cc:1240] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:33.073817 29376 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:33.091311 29455 raft_consensus.cc:1275] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:12:33.093648 29448 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
I20260709 13:12:33.069497 29277 catalog_manager.cc:5697] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 4 to 6, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 6 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:33.095634 32156 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:33.098774 32156 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:33.099481 32175 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:33.100244 32175 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:33.102607 32175 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:33.071336 32183 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.103770 31713 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.103471 32183 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:33.104283 31713 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:33.115557 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.117688 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:33.118745 29450 raft_consensus.cc:2410] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:12:33.121634 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 102927us
W20260709 13:12:33.125169 32222 log.cc:927] Time spent T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
W20260709 13:12:33.136407 32162 consensus_meta.cc:287] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.716s	user 0.017s	sys 0.000s
W20260709 13:12:33.153154 29421 leader_election.cc:336] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.509s (SENT)
I20260709 13:12:33.090056 32152 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:33.107303 32186 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:33.160910 29421 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:33.166479 29376 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
W20260709 13:12:33.167348 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:33.170217 32122 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:12:33.159543 32183 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:33.180286 32227 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:33.181229 32227 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:33.185484 29448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45796 (request call id 1068) took 1287 ms. Trace:
I20260709 13:12:33.186230 29448 rpcz_store.cc:276] 0709 13:12:31.897726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.900375 (+  2649us) service_pool.cc:224] Handling call
0709 13:12:33.185234 (+1284859us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5400262354. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:33.185397 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2688784128}
W20260709 13:12:33.190276 32017 consensus_meta.cc:287] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.719s	user 0.007s	sys 0.007s
W20260709 13:12:33.194482 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.197413 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:33.197991 32227 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:33.198414 29525 raft_consensus.cc:2393] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 6: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:33.200076 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:33.200935 29528 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:12:33.185503 29455 raft_consensus.cc:1275] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:12:33.171986 29376 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 1006) took 1451 ms (client timeout 1847 ms). Trace:
I20260709 13:12:33.204715 30121 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
W20260709 13:12:33.206067 29376 rpcz_store.cc:269] 0709 13:12:31.716658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.828011 (+111353us) service_pool.cc:224] Handling call
0709 13:12:32.184443 (+356432us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b5800010298. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61b71 00007f6a78c61a22 00007f6a81b7ac09 00007f6a80cd4ee0 00007f6a80d9e0ab 00007f6a80d9e131 00007f6a80d4c0a0 00007f6a80d4b984 00007f6a7a2c66d4 00007f6a7a2c6662
0709 13:12:32.504371 (+319928us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b18000dcce0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bdc1646 00007f6a7bcfb58e 00007f6a7bd7cf9e 00007f6a7bd7e7de 00007f6a7bd8a27c 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c
0709 13:12:33.049391 (+545020us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b580050c6d0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bce20aa 00007f6a7bd64447 00007f6a7bd7cfe7 00007f6a7bd7e7de 00007f6a7bd8a27c 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c
0709 13:12:33.168409 (+119018us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1193909248}
I20260709 13:12:33.209935 29524 raft_consensus.cc:1275] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:33.210807 29379 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
W20260709 13:12:33.211309 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 58243.5us
I20260709 13:12:33.211484 32170 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.212085 32170 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:33.243783 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:33.244863 29456 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:33.249894 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:33.253808 29521 raft_consensus.cc:1240] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:33.227313 32017 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:33.259552 29450 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
W20260709 13:12:33.262080 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.185503 31974 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:33.246840 31713 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:33.281090 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:33.287870 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:33.289602 29522 raft_consensus.cc:2393] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 8: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:33.297994 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:33.305122 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:33.312772 29455 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:12:33.279594 32183 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:33.346292 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:33.346545 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:33.350039 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 44341us
I20260709 13:12:33.354727 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:33.355659 29456 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:33.357760 29452 raft_consensus.cc:1275] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:12:33.361358 29528 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
W20260709 13:12:33.369463 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.331791 31940 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.376658 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:12:33.376880 29421 leader_election.cc:336] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 2.461s (SENT)
I20260709 13:12:33.377449 29450 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:33.377554 29421 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:33.378542 32120 raft_consensus.cc:2749] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:33.379138 31901 raft_consensus.cc:2804] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:33.379866 31901 raft_consensus.cc:697] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:12:33.381206 31901 consensus_queue.cc:237] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:12:33.383896 32225 log.cc:927] Time spent T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.157s	user 0.002s	sys 0.000s
I20260709 13:12:33.386139 32131 raft_consensus.cc:2243] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Raft consensus shutting down.
W20260709 13:12:33.386485 32228 log.cc:927] Time spent T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:12:33.366813 32020 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.388756 32020 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:33.391947 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:12:33.392856 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.393100 29453 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
I20260709 13:12:33.394692 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:33.395704 32183 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:33.397342 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:33.398890 32183 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:33.400066 32131 raft_consensus.cc:2272] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.406991 32131 ts_tablet_manager.cc:1916] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:33.409219 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:33.411015 32170 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:33.399044 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:33.424355 31974 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:33.424952 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:33.426988 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:33.428051 32152 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:33.428188 29379 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 996) took 1719 ms (client timeout 1890 ms). Trace:
I20260709 13:12:33.429949 29376 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "71aa3578fd924765ab9ac0729c8d1483"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:12:33.431155 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:33.352612 29495 connection.cc:256] RPC call timeout handler was delayed by -1.2047636889999467s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22080000000000002s for a response
W20260709 13:12:33.449976 29495 connection.cc:256] RPC call timeout handler was delayed by -1.1705636889998914s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22460000000000002s for a response
I20260709 13:12:33.433540 29344 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:33.436013 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:33.436502 29525 raft_consensus.cc:1240] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 6. Current term is 7. Ops: []
W20260709 13:12:33.438621 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:33.451442 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.447297 29448 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
W20260709 13:12:33.448416 29379 rpcz_store.cc:269] 0709 13:12:31.709028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.709462 (+   434us) service_pool.cc:224] Handling call
0709 13:12:33.427971 (+1718509us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54000d93d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:33.428117 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3394291584}
W20260709 13:12:33.447057 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 211800us
I20260709 13:12:33.457140 29452 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:33.458354 29455 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:12:33.457170 29527 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
I20260709 13:12:33.449527 29376 raft_consensus.cc:606] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 LEADER]: Received request to transfer leadership to TS 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:33.473182 29526 raft_consensus.cc:1275] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:12:33.473819 29526 pending_rounds.cc:85] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 4
I20260709 13:12:33.474172 29526 pending_rounds.cc:107] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:12:33.472898 29277 catalog_manager.cc:5697] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 4 to 5, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 5 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:33.474557 29526 raft_consensus.cc:2889] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:33.477070 32121 consensus_meta.cc:287] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.579s	user 0.017s	sys 0.000s
I20260709 13:12:33.477774 32121 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:33.480094 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:33.481096 29447 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
I20260709 13:12:33.482527 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:33.490365 29447 raft_consensus.cc:2410] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:12:33.497145 29456 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
I20260709 13:12:33.436767 31940 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:33.526655 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:33.529315 29344 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:33.470145 32170 raft_consensus.cc:2804] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:33.525916 32152 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:33.540512 32170 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:33.516680 32153 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:33.588605 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.552585 32141 raft_consensus.cc:2804] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:33.592936 29344 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:33.580674 32170 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:33.628846 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 135896us
W20260709 13:12:33.625593 32232 log.cc:927] Time spent T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.078s	user 0.000s	sys 0.002s
I20260709 13:12:33.597098 32141 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:33.615527 31929 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:12:33.655584 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 252264us
I20260709 13:12:33.594859 32152 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:33.644021 32121 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:33.646886 32141 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:33.600662 32122 consensus_queue.cc:1059] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:12:33.652506 31929 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:33.660715 32227 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:33.688900 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.687357 31929 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:33.713024 29344 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:33.710563 32135 raft_consensus.cc:993] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5: : Instructing follower 71aa3578fd924765ab9ac0729c8d1483 to start an election
W20260709 13:12:33.721064 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 48937.1us
I20260709 13:12:33.710141 32004 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:33.735546 32135 raft_consensus.cc:2804] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:33.736136 32135 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:33.736477 32135 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:33.742102 29452 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
W20260709 13:12:33.743949 32235 log.cc:927] Time spent T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b: Append to log took a long time: real 0.076s	user 0.000s	sys 0.002s
W20260709 13:12:33.744830 32237 log.cc:927] Time spent T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:12:33.745790 32153 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:33.747452 32153 raft_consensus.cc:1081] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 LEADER]: Signalling peer 71aa3578fd924765ab9ac0729c8d1483 to start an election
I20260709 13:12:33.752314 32004 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:12:33.755749 32218 log.cc:927] Time spent T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.825s	user 0.000s	sys 0.010s
I20260709 13:12:33.755950 31987 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:33.756544 31987 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:33.705044 32227 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:33.760635 31940 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:33.785468 29454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 1901) took 2602 ms. Trace:
I20260709 13:12:33.786104 29454 rpcz_store.cc:276] 0709 13:12:31.165307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.166111 (+   804us) service_pool.cc:224] Handling call
0709 13:12:31.191708 (+ 25597us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:31.192179 (+   471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:31.192220 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:31.204373 (+ 12153us) log.cc:844] Serialized 26 byte log entry
0709 13:12:32.271217 (+1066844us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b18003ef740. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c7be07 00007f6a81ad6ab9 00007f6a78c9869b 00007f6a78c9693f 00007f6a78c98c02 00007f6a7b92020b 00007f6a7b925d23 00007f6a7b9260d1 00007f6a7bd41a0f
0709 13:12:32.622137 (+350920us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:32.622320 (+   183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:32.649626 (+ 27306us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:33.577958 (+928332us) spinlock_profiling.cc:243] Waited 21.7 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:12:33.758315 (+180357us) raft_consensus.cc:1685] finished
0709 13:12:33.758354 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:33.768034 (+  9680us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":27593,"raft.run_cpu_time_us":9184,"raft.run_wall_time_us":75684,"spinlock_wait_cycles":54372096,"thread_start_us":261709,"threads_started":1,"wal-append.queue_time_us":1544037}
I20260709 13:12:33.810118 29455 raft_consensus.cc:1275] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:12:33.807744 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 65161.9us
W20260709 13:12:33.818102 32233 log.cc:927] Time spent T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.187s	user 0.000s	sys 0.002s
I20260709 13:12:33.818434 32152 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:33.820223 32246 log.cc:927] Time spent T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:12:33.833616 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.842821 31987 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:33.844579 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 105776us
W20260709 13:12:33.851078 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 76423.7us
I20260709 13:12:33.850368 29344 leader_election.cc:304] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:33.860335 29344 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:33.796142 32254 consensus_queue.cc:1048] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:12:33.864274 32163 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:33.862097 29346 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:33.868579 32163 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:33.870879 31987 consensus_queue.cc:1048] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:12:33.871016 32170 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:33.871577 32163 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:33.873463 32170 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:33.860155 31940 consensus_queue.cc:1048] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:12:33.858857 32152 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:33.861210 31713 raft_consensus.cc:2749] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:33.885669 32260 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:33.886021 29495 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:12:33.886315 32260 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:33.886823 32260 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:33.895362 32152 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:33.886011 29346 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:33.886838 32020 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:33.901386 32226 raft_consensus.cc:2804] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:33.902185 32226 raft_consensus.cc:697] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:33.903355 32152 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:33.903851 32226 consensus_queue.cc:237] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:33.911418 31940 consensus_queue.cc:1048] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:33.911893 29495 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:33.913282 31940 raft_consensus.cc:2749] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:33.913614 29495 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:12:33.915208 31940 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:33.927001 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:33.930358 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:33.931936 31929 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:33.932221 31713 consensus_queue.cc:1059] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:33.933490 31940 raft_consensus.cc:697] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:33.935272 31940 consensus_queue.cc:237] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:33.940522 31713 raft_consensus.cc:2804] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:33.941111 31713 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:33.940567 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 54716us
I20260709 13:12:33.929455 29344 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:33.949524 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:33.902915 32135 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:33.941264 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:33.955811 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:33.957983 29526 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 10.
I20260709 13:12:33.956768 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:33.960052 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:33.953867 32170 raft_consensus.cc:2804] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:33.960755 32170 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:33.961187 32170 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:33.961499 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:33.962792 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:33.962991 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:33.963681 29523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7"
dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
 from {username='slave'} at 127.0.0.1:37968
I20260709 13:12:33.964510 29523 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:33.964890 29523 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:33.967535 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:33.968083 32141 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:33.968343 31929 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:33.968946 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:33.970378 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:33.970960 29530 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
I20260709 13:12:33.971410 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:33.941665 32261 raft_consensus.cc:3055] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:33.963727 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:33.976559 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:33.941481 31713 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:33.975229 29528 raft_consensus.cc:2393] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 6: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:33.975083 29522 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:33.987339 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:33.988631 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:33.997753 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:33.954073 32254 consensus_queue.cc:1048] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:12:33.998580 29521 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:12:33.976512 32017 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.002938 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:34.000087 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:33.976739 32261 raft_consensus.cc:740] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:34.017665 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:34.010366 29529 raft_consensus.cc:2376] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 7. Re-sending same reply.
I20260709 13:12:33.992664 32271 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.010393 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:34.013674 29453 raft_consensus.cc:1275] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:34.014582 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:34.016994 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:34.015373 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:34.015652 32141 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:34.031960 29451 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:34.034626 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:34.101663 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:34.102847 29530 raft_consensus.cc:1275] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:12:34.017074 32163 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:34.057009 29527 raft_consensus.cc:2393] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 9: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:12:34.066900 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 109502us
I20260709 13:12:34.038961 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:34.107087 29526 raft_consensus.cc:2393] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 7: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:34.111183 29453 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
I20260709 13:12:34.111833 29376 raft_consensus.cc:1275] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:34.100159 32020 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.116725 32020 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:34.118996 32020 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:34.124307 29421 leader_election.cc:336] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.872s (SENT)
I20260709 13:12:34.124941 29421 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:34.123914 32261 consensus_queue.cc:260] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:34.127861 32270 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.128948 32270 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:34.037806 32017 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:34.128010 32261 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:34.133452 32017 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:34.128191 32135 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:34.134446 29523 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:34.113396 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:34.151017 29450 raft_consensus.cc:1275] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:34.153647 29522 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:12:34.160832 29451 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:12:34.167851 29523 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:34.174005 32162 consensus_queue.cc:1048] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:34.175226 32032 consensus_queue.cc:1048] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:12:34.174378 29495 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:34.180508 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:34.071887 32260 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:34.189375 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:34.189631 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 74345.3us
I20260709 13:12:34.190197 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:34.191668 29495 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:34.196157 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:34.205466 29523 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:34.206831 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:34.177155 32020 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.165472 32120 raft_consensus.cc:2749] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:34.195945 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:34.219374 29525 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:34.220309 32227 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:34.220793 32163 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:34.208534 32256 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.222316 32256 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:34.223114 32020 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:34.209129 31940 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:34.224512 31940 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:34.224985 31940 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:34.191478 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:34.209566 31974 consensus_queue.cc:1048] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:34.174098 32170 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:34.175426 32004 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:34.217515 32260 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:34.218075 29455 raft_consensus.cc:2468] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 4.
I20260709 13:12:34.188378 32270 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:34.208437 32226 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:34.109304 32271 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:34.225566 32020 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:34.468760 32226 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:12:34.246411 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:34.259197 29421 leader_election.cc:336] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.781s (SENT)
W20260709 13:12:34.264271 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:34.477613 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:34.236073 29447 raft_consensus.cc:1275] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:34.468783 29495 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:34.413477 29525 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:34.229535 29527 raft_consensus.cc:1240] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:34.471005 29524 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:34.308789 29346 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:34.456406 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 298045us
I20260709 13:12:34.478650 30121 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:34.452418 29279 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35182 (request call id 61) took 5292 ms. Trace:
I20260709 13:12:34.475404 32162 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.492766 32240 raft_consensus.cc:2804] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:34.493324 32240 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:34.493775 32240 raft_consensus.cc:3060] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:34.289265 31713 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:34.495844 32227 raft_consensus.cc:2749] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:34.431100 31940 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:34.499528 31940 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:34.493395 32162 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:34.500447 29421 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:34.429795 29277 catalog_manager.cc:5697] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 6 to 7, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 7 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:34.417585 32251 raft_consensus.cc:3055] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:34.504038 32238 consensus_queue.cc:1048] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:12:34.514748 32162 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:34.485183 32226 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:34.507794 29344 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:34.422663 32131 ts_tablet_manager.cc:1929] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.6
I20260709 13:12:34.505355 32251 raft_consensus.cc:740] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:34.521209 32270 raft_consensus.cc:2804] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:12:34.538424 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:34.521041 32020 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:34.544059 32270 raft_consensus.cc:697] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:34.545909 29523 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:12:34.553818 32270 consensus_queue.cc:237] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:34.487993 29279 rpcz_store.cc:276] 0709 13:12:29.159654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:29.159807 (+   153us) service_pool.cc:224] Handling call
0709 13:12:34.452097 (+5292290us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:32.884230 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:32.885326 (+  1096us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:32.885393 (+    67us) write_op.cc:435] Acquired schema lock
0709 13:12:32.885425 (+    32us) tablet.cc:662] Decoding operations
0709 13:12:32.885981 (+   556us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:32.886059 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:32.886094 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:12:32.886484 (+   390us) tablet.cc:701] Row locks acquired
0709 13:12:32.886553 (+    69us) write_op.cc:260] PREPARE: finished
0709 13:12:32.886755 (+   202us) write_op.cc:270] Start()
0709 13:12:32.886929 (+   174us) write_op.cc:276] Timestamp: P: 1783602752886676 usec, L: 0
0709 13:12:32.886954 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:12:33.083820 (+196866us) log.cc:844] Serialized 538 byte log entry
0709 13:12:33.930705 (+846885us) op_driver.cc:464] REPLICATION: finished
0709 13:12:34.065772 (+135067us) write_op.cc:301] APPLY: starting
0709 13:12:34.075648 (+  9876us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:34.075868 (+   220us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:34.076058 (+   190us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:34.076513 (+   455us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:34.076854 (+   341us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:12:34.076925 (+    71us) write_op.cc:312] APPLY: finished
0709 13:12:34.077333 (+   408us) log.cc:844] Serialized 22 byte log entry
0709 13:12:34.077602 (+   269us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:34.077730 (+   128us) write_op.cc:454] Released schema lock
0709 13:12:34.077814 (+    84us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:34.078390 (+   576us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:34.078431 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1702525,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":125432,"apply.run_cpu_time_us":3019,"apply.run_wall_time_us":21785,"num_ops":1,"prepare.queue_time_us":345350,"prepare.run_cpu_time_us":49011,"prepare.run_wall_time_us":562599,"raft.queue_time_us":113451,"raft.run_cpu_time_us":10930,"raft.run_wall_time_us":54414,"replication_time_us":1043536,"thread_start_us":427441,"threads_started":4,"wal-append.queue_time_us":436872}]]}
W20260709 13:12:34.555783 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 296639us
W20260709 13:12:34.557334 29421 leader_election.cc:336] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.590s (SENT)
I20260709 13:12:34.557878 29421 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:34.558097 32017 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.552904 32131 log.cc:1199] T eb6a9a102eba49209ddf2bdf286077e8 P 429e58eb058349e3bf72b5a870c8f6e5: Deleting WAL directory at /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/ts-0-root/wals/eb6a9a102eba49209ddf2bdf286077e8
I20260709 13:12:34.559870 32120 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:34.526930 31929 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:12:34.562299 29421 leader_election.cc:336] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.519s (SENT)
I20260709 13:12:34.562969 29421 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:34.531607 31713 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:34.537384 32256 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:34.568981 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:34.559029 32017 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:34.570227 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 362851us
I20260709 13:12:34.575263 29344 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:34.571796 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:34.584939 29344 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:34.585264 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:34.586761 29528 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:34.587901 29521 raft_consensus.cc:1240] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 5. Current term is 6. Ops: []
W20260709 13:12:34.588768 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 120097us
I20260709 13:12:34.589670 29495 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:34.591126 29495 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:34.568958 31929 raft_consensus.cc:697] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:34.571527 32152 raft_consensus.cc:2749] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:34.593683 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:34.592100 29495 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:34.592811 31713 raft_consensus.cc:2804] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:34.606007 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:34.603839 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 97000.9us
I20260709 13:12:34.590878 32276 raft_consensus.cc:2804] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:34.574769 32240 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:34.584856 32256 consensus_queue.cc:1059] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:12:34.605620 32227 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:34.614218 32162 raft_consensus.cc:2804] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:34.617854 31713 raft_consensus.cc:697] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:34.620218 32131 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52164 (request call id 65) took 5227 ms. Trace:
I20260709 13:12:34.635860 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:34.636729 29525 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:34.642585 29346 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:34.630498 32162 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:34.643833 32162 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:34.648249 32271 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:34.649688 31713 consensus_queue.cc:237] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:34.601981 32251 consensus_queue.cc:260] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:34.652545 32251 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:34.653496 31929 consensus_queue.cc:237] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:34.653319 29277 catalog_manager.cc:5697] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:34.653366 32227 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:34.627763 32170 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:34.626722 32276 raft_consensus.cc:697] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:12:34.636801 29421 leader_election.cc:336] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 2.878s (SENT)
W20260709 13:12:34.664299 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:34.634079 30154 raft_consensus.cc:1240] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:34.659475 32280 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:34.675976 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:34.670816 32273 consensus_queue.cc:1048] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:12:34.672137 32274 raft_consensus.cc:2804] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:34.675771 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:34.637953 32131 rpcz_store.cc:276] 0709 13:12:29.399790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:29.475712 (+ 75922us) service_pool.cc:224] Handling call
0709 13:12:30.500464 (+1024752us) ts_tablet_manager.cc:1151] Deleting tablet eb6a9a102eba49209ddf2bdf286077e8
0709 13:12:30.524971 (+ 24507us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:12:33.963931 (+3438960us) tablet_metadata.cc:665] Metadata flushed
0709 13:12:34.422468 (+458537us) tablet_metadata.cc:665] Metadata flushed
0709 13:12:34.608609 (+186141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2595233,"tablet-delete.queue_time_us":573749,"thread_start_us":491179,"threads_started":1}
I20260709 13:12:34.684221 29529 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
W20260709 13:12:34.686754 29327 auto_rebalancer.cc:629] Failed to schedule move for tablet 3cece22da76441f5a3d309c5cb454c42: Illegal state: Replica 429e58eb058349e3bf72b5a870c8f6e5 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:34.688115 32226 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:34.690476 32226 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:34.675184 32280 raft_consensus.cc:697] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:34.692633 32240 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 5 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:34.692585 32280 consensus_queue.cc:237] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:34.700524 29278 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37608 (request call id 152) took 10460 ms. Trace:
I20260709 13:12:34.700250 32276 consensus_queue.cc:237] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:34.712451 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:34.713361 29455 raft_consensus.cc:3060] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:34.716497 29528 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:34.658257 32227 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:34.719872 29525 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:34.701100 29278 rpcz_store.cc:276] 0709 13:12:24.239997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:24.245145 (+  5148us) service_pool.cc:224] Handling call
0709 13:12:34.699985 (+10454840us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:29.620299 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:29.620915 (+   616us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:29.620955 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:12:29.620968 (+    13us) tablet.cc:662] Decoding operations
0709 13:12:29.696249 (+ 75281us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:29.696311 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:29.696361 (+    50us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:12:29.697889 (+  1528us) tablet.cc:701] Row locks acquired
0709 13:12:29.697912 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:12:29.698082 (+   170us) write_op.cc:270] Start()
0709 13:12:29.698220 (+   138us) write_op.cc:276] Timestamp: P: 1783602749698033 usec, L: 0
0709 13:12:29.698244 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:12:29.776833 (+ 78589us) log.cc:844] Serialized 7973 byte log entry
0709 13:12:30.738106 (+961273us) op_driver.cc:464] REPLICATION: finished
0709 13:12:30.917696 (+179590us) write_op.cc:301] APPLY: starting
0709 13:12:30.917823 (+   127us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:30.918413 (+   590us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:30.918550 (+   137us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:30.920924 (+  2374us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:30.921310 (+   386us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=20
0709 13:12:30.921368 (+    58us) write_op.cc:312] APPLY: finished
0709 13:12:30.921847 (+   479us) log.cc:844] Serialized 138 byte log entry
0709 13:12:30.922064 (+   217us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:30.922286 (+   222us) write_op.cc:454] Released schema lock
0709 13:12:30.922343 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:30.922766 (+   423us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:30.922797 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":194523,"reported_tablets":39,"spinlock_wait_cycles":46336,"child_traces":[["op",{"apply.queue_time_us":179232,"apply.run_cpu_time_us":5106,"apply.run_wall_time_us":5108,"num_ops":20,"prepare.queue_time_us":332966,"prepare.run_cpu_time_us":80120,"prepare.run_wall_time_us":408440,"raft.queue_time_us":331052,"raft.run_cpu_time_us":9786,"raft.run_wall_time_us":132099,"replication_time_us":1039666,"thread_start_us":482659,"threads_started":4,"wal-append.queue_time_us":453993,"wal-append.run_cpu_time_us":14092,"wal-append.run_wall_time_us":1699448}]]}
W20260709 13:12:34.728727 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 136699us
I20260709 13:12:34.732251 29344 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:34.732235 29495 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:34.738724 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 118764us
W20260709 13:12:34.740860 29421 leader_election.cc:336] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 2.220s (SENT)
I20260709 13:12:34.756031 29421 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:34.758102 31974 consensus_queue.cc:1048] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:34.729362 32274 raft_consensus.cc:697] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:34.760514 32274 consensus_queue.cc:237] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:34.755722 32282 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:12:34.806548 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 74416.5us
I20260709 13:12:34.807406 29344 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:34.809253 29344 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:34.813968 29346 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:34.732805 32141 consensus_queue.cc:1048] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:12:34.816756 29455 raft_consensus.cc:2468] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 5.
W20260709 13:12:34.826622 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 72075.6us
W20260709 13:12:34.830624 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 89841.2us
I20260709 13:12:34.830956 30121 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:34.814126 32273 raft_consensus.cc:2804] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:34.813642 32153 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:34.812790 32152 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:34.834803 29277 catalog_manager.cc:5697] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 2 to 3, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 3 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:34.813977 32261 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:34.812508 32282 raft_consensus.cc:697] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:34.817914 29376 consensus_queue.cc:237] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:12:34.830279 32122 raft_consensus.cc:2804] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:12:34.877553 29421 leader_election.cc:336] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.561s (SENT)
W20260709 13:12:34.878600 29421 leader_election.cc:336] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.685s (SENT)
I20260709 13:12:34.879371 29421 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:34.858191 29524 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
W20260709 13:12:34.871598 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 61534us
I20260709 13:12:34.856287 32273 raft_consensus.cc:697] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:34.844018 32153 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:34.848143 32017 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:34.835193 32020 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:34.841367 32252 raft_consensus.cc:2804] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:34.883728 29344 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:34.907407 32153 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:34.921082 29421 leader_election.cc:336] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.717s (SENT)
W20260709 13:12:34.921902 29421 leader_election.cc:336] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.800s (SENT)
I20260709 13:12:34.922276 29421 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:34.925282 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:34.927772 32252 raft_consensus.cc:697] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:12:34.928944 32252 consensus_queue.cc:237] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:34.929968 32120 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:34.931115 32120 raft_consensus.cc:2749] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:34.932397 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:34.931926 32273 consensus_queue.cc:237] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:34.935987 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 52361.9us
I20260709 13:12:34.937122 32141 raft_consensus.cc:2804] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:34.937700 32141 raft_consensus.cc:697] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:34.830165 32162 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:34.946424 29419 leader_election.cc:336] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.561s (SENT)
I20260709 13:12:34.949716 29419 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:34.950290 29421 leader_election.cc:336] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 2.349s (SENT)
I20260709 13:12:34.950910 29421 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:34.882992 32122 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:34.954907 32162 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:34.939034 32141 consensus_queue.cc:237] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:34.882248 32261 raft_consensus.cc:697] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:12:34.959457 29419 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 2.054s (SENT) [suppressed 58 similar messages]
W20260709 13:12:34.983139 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 144004us
I20260709 13:12:34.997839 29495 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:34.980727 32122 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:34.980301 32020 raft_consensus.cc:2749] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:34.939574 32282 consensus_queue.cc:237] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:35.011852 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 69013.3us
W20260709 13:12:35.021082 29421 leader_election.cc:336] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 2.562s (SENT)
I20260709 13:12:35.024369 29421 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:34.982630 31940 consensus_queue.cc:1048] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
W20260709 13:12:35.027381 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.011997 32120 raft_consensus.cc:2749] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:12:35.034919 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 78471.2us
I20260709 13:12:35.018213 32291 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:12:35.045951 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.030781 32017 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:12:35.046983 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 49300.2us
I20260709 13:12:35.055474 29495 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:35.043478 32020 raft_consensus.cc:2749] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:12:35.066025 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.063787 32017 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:35.029476 32290 consensus_queue.cc:1059] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:12:35.044687 32291 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:35.080025 29419 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:35.081413 32287 raft_consensus.cc:2804] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:35.053828 32261 consensus_queue.cc:237] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:35.093726 32017 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:35.086613 32120 raft_consensus.cc:2804] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:35.107472 32120 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:35.108117 32120 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:35.109975 32152 raft_consensus.cc:2749] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:12:35.112427 29419 leader_election.cc:336] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.717s (SENT)
I20260709 13:12:35.064275 32162 consensus_queue.cc:1048] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:12:35.113163 29419 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:35.078298 32291 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:35.141613 32020 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:35.151950 32299 consensus_queue.cc:1048] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:12:35.160907 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 107468us
I20260709 13:12:35.163520 29346 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:35.130632 32294 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.273269 32287 raft_consensus.cc:697] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:35.281180 32287 consensus_queue.cc:237] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:34.656855 32163 consensus_queue.cc:1175] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "71aa3578fd924765ab9ac0729c8d1483" responder_term: 6 status { last_received { term: 5 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:12:35.315264 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 294231us
I20260709 13:12:35.317047 32020 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:35.317852 32152 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.317644 32020 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:35.318379 32152 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:35.320163 32020 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:35.320726 32152 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:35.230847 32294 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:35.321705 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:12:35.306028 32293 log.cc:927] Time spent T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 13:12:35.324833 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:35.326467 29456 raft_consensus.cc:1275] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:12:35.329813 29495 leader_election.cc:336] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.618s (SENT)
I20260709 13:12:35.330288 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:35.329936 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:35.332098 29448 raft_consensus.cc:1275] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:12:35.331998 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:35.390343 29453 raft_consensus.cc:2468] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:12:35.338591 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:35.393602 29449 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:35.314261 29419 leader_election.cc:336] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.853s (SENT)
I20260709 13:12:35.394222 29454 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:35.345781 32170 raft_consensus.cc:2749] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:35.379643 29447 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:35.395195 29421 leader_election.cc:336] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.853s (SENT)
W20260709 13:12:35.394871 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 80783.9us
W20260709 13:12:35.396446 29419 leader_election.cc:336] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.869s (SENT)
W20260709 13:12:35.400949 32280 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.005s	sys 0.016s
I20260709 13:12:35.391826 29450 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
W20260709 13:12:35.403331 32280 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.005s	sys 0.017s
I20260709 13:12:35.398582 29419 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:35.398379 32227 consensus_meta.cc:287] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.656s	user 0.012s	sys 0.004s
W20260709 13:12:35.421885 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 258500us
I20260709 13:12:35.425063 29454 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
W20260709 13:12:35.430696 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 100976us
I20260709 13:12:35.432850 29451 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
I20260709 13:12:35.393159 32291 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:35.459676 32152 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:35.470261 32152 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:35.477097 32317 log.cc:927] Time spent T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.075s	user 0.002s	sys 0.000s
I20260709 13:12:35.477800 32152 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:35.432687 32227 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:35.440269 32017 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:35.464174 29346 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:35.467983 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:35.504781 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.507869 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:35.508582 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:35.482463 32120 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:35.509608 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.509654 29524 raft_consensus.cc:2393] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 11: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:35.513942 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:35.516757 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:35.518568 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:35.443805 32020 consensus_queue.cc:1048] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:12:35.541132 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:35.529824 29447 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
I20260709 13:12:35.543300 29522 raft_consensus.cc:2410] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:12:35.492656 32291 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:35.552758 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 88906.2us
I20260709 13:12:35.493973 32017 raft_consensus.cc:697] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 7 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:35.553459 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:35.554111 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:35.554764 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:35.555225 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:35.555519 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:35.555775 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:35.555851 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:35.562690 29527 raft_consensus.cc:2393] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 9: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:35.563095 29526 raft_consensus.cc:2393] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 7: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:35.552994 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:35.558393 29346 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:35.570389 29495 leader_election.cc:336] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.620s (SENT)
I20260709 13:12:35.570588 29419 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:35.570932 29495 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:35.572569 32291 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:12:35.573918 29495 leader_election.cc:336] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.639s (SENT)
I20260709 13:12:35.574405 29495 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:35.575292 32291 raft_consensus.cc:2749] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:12:35.576290 32153 consensus_meta.cc:287] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.660s	user 0.012s	sys 0.002s
I20260709 13:12:35.576872 32153 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:35.577225 32294 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:35.577442 32227 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:35.579080 32120 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:35.578971 32017 consensus_queue.cc:237] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:35.593256 29346 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:35.558935 32315 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:35.588366 32299 raft_consensus.cc:2804] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:12:35.609251 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:35.615386 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.609364 32315 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:35.609715 32287 consensus_queue.cc:1048] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:12:35.617094 32315 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:35.617333 32287 consensus_queue.cc:1243] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer 183db85c071f489fbc8de63a9edd8a3a log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:12:35.619297 32318 log.cc:927] Time spent T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:12:35.608507 32311 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:35.611932 32299 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:35.645782 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:35.646468 29521 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:35.608031 32291 consensus_queue.cc:1048] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:12:35.649340 32313 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:35.631114 32141 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:35.629738 32287 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:12:35.659178 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 66355us
I20260709 13:12:35.643443 32299 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:35.670259 29346 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:35.673120 29495 leader_election.cc:336] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.532s (SENT)
W20260709 13:12:35.674218 32122 consensus_meta.cc:287] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.652s	user 0.013s	sys 0.004s
I20260709 13:12:35.678828 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:35.689014 29452 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:35.682246 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:35.696163 29455 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:35.709669 29495 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:12:35.717573 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 47445.5us
I20260709 13:12:35.730183 32300 raft_consensus.cc:2749] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:35.711985 32122 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:35.737010 32122 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:35.746856 32273 raft_consensus.cc:3055] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:35.748955 32273 raft_consensus.cc:740] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:35.759013 29523 raft_consensus.cc:1240] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:35.763521 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:35.776386 29455 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
W20260709 13:12:35.777892 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 105168us
I20260709 13:12:35.831249 29521 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 7.
I20260709 13:12:35.851883 29452 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:12:35.886945 29452 pending_rounds.cc:85] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 4
I20260709 13:12:35.660221 32313 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:35.667838 32141 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:35.668125 32287 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:35.887344 29452 pending_rounds.cc:107] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:12:35.928608 29452 raft_consensus.cc:2889] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:35.834614 29526 raft_consensus.cc:1240] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 9. Current term is 10. Ops: []
W20260709 13:12:35.939543 29449 consensus_meta.cc:287] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.540s	user 0.007s	sys 0.008s
I20260709 13:12:35.940162 29449 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
W20260709 13:12:35.950569 32333 log.cc:927] Time spent T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:12:35.831544 32332 raft_consensus.cc:2749] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:35.968549 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 142941us
I20260709 13:12:35.970006 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:35.958361 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 179336us
I20260709 13:12:35.973060 29522 raft_consensus.cc:1275] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:12:35.977860 29495 leader_election.cc:336] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.706s (SENT)
I20260709 13:12:35.983322 29495 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:35.983399 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:35.972965 29524 raft_consensus.cc:1240] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:35.989802 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:35.995298 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:35.973409 32256 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.999387 29449 raft_consensus.cc:1275] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:12:36.005457 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:36.010953 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:36.011752 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:36.015605 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.015776 32271 consensus_queue.cc:1059] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:36.008796 32256 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:36.016991 32271 raft_consensus.cc:3055] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:35.997855 32291 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:36.017408 29381 raft_consensus.cc:1275] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:36.013140 32122 consensus_queue.cc:1059] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:12:36.018451 32256 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:36.018590 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:36.019006 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:36.019866 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.019964 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:36.020855 32305 consensus_queue.cc:1048] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:36.021602 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.022364 29378 raft_consensus.cc:2393] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 7: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:36.022365 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.015596 29379 raft_consensus.cc:1275] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:12:36.021214 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:36.021186 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.024924 29377 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
I20260709 13:12:36.031463 29380 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:36.033033 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:36.033239 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 55467.6us
I20260709 13:12:36.035624 29374 raft_consensus.cc:1240] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:35.958633 32273 consensus_queue.cc:260] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:36.036794 29525 raft_consensus.cc:1275] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:12:36.034062 29529 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:36.038419 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:36.018594 32122 raft_consensus.cc:3055] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:36.004812 32323 consensus_queue.cc:1059] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:12:36.044338 29524 raft_consensus.cc:1275] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:36.057518 29344 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:36.017427 32271 raft_consensus.cc:740] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:36.070570 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:36.070966 29495 leader_election.cc:336] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.890s (SENT)
I20260709 13:12:36.071542 29495 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:36.072816 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.049145 32122 raft_consensus.cc:740] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:36.049535 32300 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:36.091905 32289 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:36.092164 32271 consensus_queue.cc:260] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:36.093261 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.076366 32280 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:36.095122 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:36.095782 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.059033 32260 consensus_queue.cc:1048] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:12:36.096506 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:36.097184 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.098914 32332 raft_consensus.cc:3055] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:36.100109 32305 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:12:36.100426 32342 log.cc:927] Time spent T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:12:36.100828 32323 consensus_queue.cc:1048] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:36.101956 32287 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:36.105715 32315 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:36.080827 32273 raft_consensus.cc:3060] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:36.093427 32254 raft_consensus.cc:3055] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:36.096283 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:36.145084 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:36.145387 29527 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:36.127851 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.128901 29374 raft_consensus.cc:2368] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 9. Current term is 10.
W20260709 13:12:36.134265 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 63354.3us
I20260709 13:12:36.135756 29380 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
W20260709 13:12:36.147027 29495 leader_election.cc:336] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.892s (SENT)
I20260709 13:12:36.151047 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:36.122014 32313 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:36.107297 32299 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:36.159292 29376 raft_consensus.cc:2393] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 8: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:36.159616 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:36.160413 29374 raft_consensus.cc:2376] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7. Re-sending same reply.
I20260709 13:12:36.134333 32122 consensus_queue.cc:260] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:36.161669 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.155591 29372 raft_consensus.cc:2410] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:12:36.162792 32122 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:36.164839 30154 raft_consensus.cc:1240] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 LEADER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:36.165787 32141 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:36.166580 32152 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:12:36.167177 32334 log.cc:927] Time spent T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:12:36.169317 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:36.130162 32332 raft_consensus.cc:740] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:36.170383 29373 raft_consensus.cc:2368] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 7. Current term is 8.
I20260709 13:12:36.134123 32305 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.148113 32254 raft_consensus.cc:740] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:12:36.177338 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 93005.9us
I20260709 13:12:36.114375 32300 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:36.201574 29378 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
I20260709 13:12:36.202931 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:36.204352 29421 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:36.207685 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:36.215021 29378 raft_consensus.cc:2376] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6. Re-sending same reply.
I20260709 13:12:36.216557 29375 raft_consensus.cc:2410] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:12:36.222525 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 900839us
W20260709 13:12:36.223562 29421 leader_election.cc:336] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.869s (SENT)
I20260709 13:12:36.224040 29421 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:36.128682 32280 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:36.226418 32331 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:36.226696 32336 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:36.245193 29419 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:36.177119 32305 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:36.259297 29419 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:36.179316 32313 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.266768 29419 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:12:36.271178 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 92684.1us
I20260709 13:12:36.262180 32120 raft_consensus.cc:2749] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:36.248512 32153 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:36.261793 32336 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:12:36.277981 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 52550us
W20260709 13:12:36.282449 29421 leader_election.cc:336] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 2.056s (SENT)
W20260709 13:12:36.283244 29421 leader_election.cc:336] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 2.082s (SENT)
I20260709 13:12:36.283601 29421 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:36.269521 29419 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:36.269309 32017 raft_consensus.cc:2749] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:12:36.293143 29421 leader_election.cc:336] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 2.443s (SENT)
I20260709 13:12:36.293955 29421 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:36.291262 32020 raft_consensus.cc:2804] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:36.297492 32020 raft_consensus.cc:697] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 7 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:36.298194 32330 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:36.298617 32020 consensus_queue.cc:237] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:36.289036 32152 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:36.300956 32152 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:36.268472 32313 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:36.303881 32017 raft_consensus.cc:2749] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:36.306051 29528 raft_consensus.cc:1240] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:36.296859 32331 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:36.307329 32331 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:36.313493 29530 raft_consensus.cc:1275] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:36.317638 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:36.317870 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:36.318502 29453 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
I20260709 13:12:36.318634 29452 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
W20260709 13:12:36.321007 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 49033.3us
I20260709 13:12:36.324515 32254 consensus_queue.cc:260] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:36.326305 32254 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:36.329941 29521 raft_consensus.cc:1275] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:12:36.277539 32332 consensus_queue.cc:260] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:36.324761 29449 raft_consensus.cc:1275] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:12:36.329249 32335 consensus_queue.cc:1048] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:12:36.344074 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:36.345583 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:36.347091 32315 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:36.348095 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.348661 32332 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:36.349514 29374 raft_consensus.cc:2393] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 7: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:36.351001 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:36.351480 32305 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:36.352455 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:36.353051 29374 raft_consensus.cc:2376] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8. Re-sending same reply.
I20260709 13:12:36.353277 32271 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:36.353986 32305 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:36.369318 32331 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:36.373566 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.375946 32350 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:36.388899 29527 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:12:36.388899 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.391522 29374 raft_consensus.cc:2368] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 7. Current term is 8.
I20260709 13:12:36.410897 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:36.412338 29375 raft_consensus.cc:2376] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9. Re-sending same reply.
I20260709 13:12:36.418179 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:36.418717 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 125623us
I20260709 13:12:36.423252 32330 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:36.424798 32330 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:36.425372 32330 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:36.429656 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:36.399835 32350 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:36.429919 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:36.432515 32331 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.433151 32331 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:36.433377 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.435649 32331 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:36.437258 32330 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:36.436841 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.446151 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.450603 29374 raft_consensus.cc:2393] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 8: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:36.453043 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:36.452198 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:36.456503 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.455709 29372 raft_consensus.cc:2376] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6. Re-sending same reply.
I20260709 13:12:36.461156 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:36.465075 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:36.467517 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.474723 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.490825 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.492738 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.495291 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.498809 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.455051 32350 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:36.506906 29372 raft_consensus.cc:1240] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 13:12:36.509148 29421 leader_election.cc:336] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 2.092s (SENT)
I20260709 13:12:36.510210 29421 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:36.516352 29447 raft_consensus.cc:1275] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:12:36.521898 29372 raft_consensus.cc:1275] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:12:36.524029 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 100803us
I20260709 13:12:36.531059 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:36.531893 29449 raft_consensus.cc:2468] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 4.
I20260709 13:12:36.535282 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:36.526539 32363 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.527110 32330 raft_consensus.cc:2749] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:36.536003 29456 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:12:36.536366 29450 raft_consensus.cc:1240] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:36.536087 32363 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:36.537436 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:36.536563 29372 raft_consensus.cc:1275] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:36.540457 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:36.540597 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:36.541105 29456 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
W20260709 13:12:36.542285 29421 leader_election.cc:336] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 2.103s (SENT)
I20260709 13:12:36.542778 29421 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:36.545776 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:36.546499 29456 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:36.548159 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:36.548844 29455 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:36.550693 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:36.552333 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:12:36.552526 29421 leader_election.cc:336] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 2.193s (SENT)
I20260709 13:12:36.552907 29454 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:36.552996 29421 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:36.566337 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:36.573143 32330 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:36.590005 29449 raft_consensus.cc:1240] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:36.613020 29456 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
W20260709 13:12:36.618914 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 66402.9us
I20260709 13:12:36.628671 29454 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:36.643074 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:12:36.622571 29421 leader_election.cc:336] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 2.246s (SENT)
I20260709 13:12:36.644438 29421 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:36.646978 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:36.658787 32362 raft_consensus.cc:2749] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:36.577442 32331 raft_consensus.cc:2749] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:36.663574 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:36.663805 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:36.664418 29454 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:36.646220 32195 consensus_queue.cc:1048] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:12:36.680473 29454 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:36.672003 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:12:36.687166 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 64624.2us
W20260709 13:12:36.689533 29421 leader_election.cc:336] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 2.338s (SENT)
I20260709 13:12:36.690536 29421 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:36.691131 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:36.690078 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 159162us
W20260709 13:12:36.691785 29421 leader_election.cc:336] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 2.400s (SENT)
I20260709 13:12:36.694192 29421 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:36.695374 30121 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:36.697230 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:36.710314 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:12:36.712990 29421 leader_election.cc:336] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 2.777s (SENT)
I20260709 13:12:36.715013 29455 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:12:36.716204 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:36.717152 29454 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:36.694845 32331 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:36.741209 29455 raft_consensus.cc:1240] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:36.699820 32362 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:36.753463 29452 raft_consensus.cc:1240] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:12:36.757728 29421 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:36.759918 29454 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:36.760782 29452 raft_consensus.cc:1240] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:12:36.713929 31929 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.722867 32195 raft_consensus.cc:2804] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:36.778784 29452 raft_consensus.cc:1275] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:36.723467 32296 raft_consensus.cc:493] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:36.773379 32195 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:12:36.782414 32365 log.cc:927] Time spent T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
W20260709 13:12:36.785210 32359 log.cc:927] Time spent T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
W20260709 13:12:36.784945 29344 consensus_peers.cc:597] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 -> Peer ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671): Couldn't send request to peer ca041dab9b2f44409ed7bf4c6cf66ab2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 95122b0f733946aba19edf1d98467467. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:36.806633 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 484075us
I20260709 13:12:36.786633 32313 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:36.788582 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.789757 29375 raft_consensus.cc:1240] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:12:36.791290 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.816468 29381 raft_consensus.cc:2393] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 6: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:36.767150 32120 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:36.798405 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 85467.2us
I20260709 13:12:36.812299 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:36.817463 29525 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:36.812728 29529 raft_consensus.cc:1275] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:12:36.825012 29344 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:36.801677 32195 raft_consensus.cc:3060] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:36.832962 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:36.827073 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.774508 31929 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:36.834079 29381 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 8.
I20260709 13:12:36.836848 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:36.819563 29421 leader_election.cc:336] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 2.930s (SENT)
I20260709 13:12:36.838168 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:36.839639 29381 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
I20260709 13:12:36.840265 29421 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:36.840518 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.842137 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.843783 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.837510 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.847988 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.853615 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.854326 29373 raft_consensus.cc:2368] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 4. Current term is 5.
I20260709 13:12:36.858114 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.859054 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.859776 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.860647 29381 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 8.
I20260709 13:12:36.863456 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.868315 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:36.836090 32274 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:36.874622 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:36.874826 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.875905 29373 raft_consensus.cc:2368] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 7. Current term is 8.
I20260709 13:12:36.882490 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.855238 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:36.835888 32251 consensus_queue.cc:1048] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:12:36.885262 29525 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:12:36.886308 29381 raft_consensus.cc:2393] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 7: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:36.893846 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.925521 29450 raft_consensus.cc:1240] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:36.927600 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.895681 31929 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:36.934253 29450 raft_consensus.cc:1275] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:12:36.885740 32274 raft_consensus.cc:697] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:36.919257 32280 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:36.856796 32294 consensus_queue.cc:1048] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:12:36.824070 32296 raft_consensus.cc:515] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:36.917819 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:36.920336 29447 raft_consensus.cc:1275] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:12:36.923008 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 103530us
I20260709 13:12:36.930428 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:36.931439 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.880519 32120 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:36.900761 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:36.938007 29450 raft_consensus.cc:3055] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:12:36.944887 29421 leader_election.cc:336] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.833s (SENT)
I20260709 13:12:36.940814 29381 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
I20260709 13:12:36.953799 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.955178 29381 raft_consensus.cc:2468] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:12:36.941869 29450 raft_consensus.cc:740] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:36.956431 29421 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:36.957871 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.965049 29524 raft_consensus.cc:1275] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:12:36.967209 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:36.970012 29525 raft_consensus.cc:1275] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:12:36.970640 29525 pending_rounds.cc:85] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 3
I20260709 13:12:36.971009 29525 pending_rounds.cc:107] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:12:36.971374 29525 raft_consensus.cc:2889] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:36.972594 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:36.974712 29378 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:36.965961 29524 pending_rounds.cc:85] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 1
I20260709 13:12:36.956854 29450 consensus_queue.cc:260] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:36.984513 29524 pending_rounds.cc:107] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:12:36.985888 29524 raft_consensus.cc:2889] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:36.985176 29450 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:36.988837 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.989804 29373 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:12:36.991024 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:36.991945 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:37.000742 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:37.007184 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:37.008637 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:37.009723 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:37.010733 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:37.015074 32296 leader_election.cc:290] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:12:37.022034 32332 consensus_meta.cc:287] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.673s	user 0.015s	sys 0.000s
W20260709 13:12:37.024240 32271 consensus_meta.cc:287] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.670s	user 0.016s	sys 0.000s
I20260709 13:12:37.025038 29379 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:12:36.936374 32274 consensus_queue.cc:237] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:37.028059 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:37.030071 32331 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.030646 32331 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:36.992586 32362 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:37.032954 32331 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:37.035243 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:37.011324 29373 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
W20260709 13:12:37.051034 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.050406 29378 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 7.
I20260709 13:12:37.053151 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:37.057684 29376 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:12:37.058693 29447 raft_consensus.cc:1275] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:12:37.060914 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:37.036676 32330 raft_consensus.cc:2749] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:37.064687 29450 raft_consensus.cc:1275] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:12:37.075950 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:37.076455 29450 pending_rounds.cc:85] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 4
I20260709 13:12:37.076750 29450 pending_rounds.cc:107] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:12:37.076988 29450 raft_consensus.cc:2889] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:37.065176 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:37.055716 32331 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:37.000063 32170 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:37.056102 32254 consensus_meta.cc:287] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.729s	user 0.013s	sys 0.004s
I20260709 13:12:37.070499 29456 raft_consensus.cc:1275] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:37.071250 29528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2362) took 1092 ms. Trace:
I20260709 13:12:37.065740 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:37.080036 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:37.082732 29421 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:37.089988 29450 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:37.088356 29528 rpcz_store.cc:276] 0709 13:12:35.979122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:36.246669 (+267547us) service_pool.cc:224] Handling call
0709 13:12:36.267049 (+ 20380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:36.306596 (+ 39547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:37.071005 (+764409us) spinlock_profiling.cc:243] Waited 38.7 ms on lock 0x7b54000cadd4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:37.071189 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89107712}
I20260709 13:12:37.107343 29379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 1028) took 1033 ms. Trace:
I20260709 13:12:37.110402 29379 rpcz_store.cc:276] 0709 13:12:36.073932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:36.079655 (+  5723us) service_pool.cc:224] Handling call
0709 13:12:37.107032 (+1027377us) spinlock_profiling.cc:243] Waited 911 ms on lock 0x7b540039f3d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:37.107230 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2094516992}
I20260709 13:12:37.108032 29449 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:12:37.113119 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:37.114835 29450 raft_consensus.cc:2410] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:12:37.120919 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:12:37.134459 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 51507.6us
I20260709 13:12:37.136592 29421 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:37.136977 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:37.139243 29379 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:12:37.140753 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:37.141520 29378 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
I20260709 13:12:37.142407 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:37.121452 32330 raft_consensus.cc:2804] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:37.176183 32330 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:37.176918 32330 raft_consensus.cc:3060] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:37.143575 32300 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:37.180699 29375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1042) took 1057 ms. Trace:
I20260709 13:12:37.181174 29375 rpcz_store.cc:276] 0709 13:12:36.123245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:36.503680 (+380435us) service_pool.cc:224] Handling call
0709 13:12:36.789459 (+285779us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:36.816101 (+ 26642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:37.180425 (+364324us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b54003bbd50. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd858ad 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:37.180625 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":607548160}
I20260709 13:12:37.182782 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:37.184314 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:37.184305 29344 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:37.185776 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:37.186209 32276 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:37.188444 32276 raft_consensus.cc:697] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:37.189466 32276 consensus_queue.cc:237] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:37.193331 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:37.193861 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.197168 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:37.198863 29375 raft_consensus.cc:2393] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 9: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:37.199599 32152 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:37.200111 32294 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.151924 32120 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:37.154407 29451 raft_consensus.cc:1275] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:12:37.155315 29346 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:37.201323 32294 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:37.201905 32271 raft_consensus.cc:2749] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:12:37.202103 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 46950us
I20260709 13:12:37.086817 32331 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:37.151072 29450 raft_consensus.cc:1275] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:37.203758 32294 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:37.205902 32331 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:37.207226 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:37.208093 29373 raft_consensus.cc:2393] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 8: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:37.208917 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:37.210042 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:37.211077 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:37.163077 29523 raft_consensus.cc:1240] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:37.203084 29346 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:37.163957 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:37.132295 32362 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:37.212596 29379 raft_consensus.cc:2393] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 8: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:37.212474 32362 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:37.213464 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:37.214650 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:37.214854 32362 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:37.144389 32195 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:37.168574 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:37.217044 29454 raft_consensus.cc:2393] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 8: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:37.169564 32280 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:37.217679 32280 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:37.187211 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:37.219030 29380 raft_consensus.cc:2393] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 7: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:37.220027 32280 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:37.220139 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:37.108807 32170 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:37.141079 29421 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:37.221073 29380 raft_consensus.cc:2393] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 8: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:37.197315 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:37.215374 29379 raft_consensus.cc:2393] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 8: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
W20260709 13:12:37.222015 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 81012.1us
I20260709 13:12:37.199998 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:37.223582 29375 raft_consensus.cc:2393] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 8: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:37.223889 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:37.223685 32254 consensus_queue.cc:1048] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:37.222108 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:37.225397 29376 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "71aa3578fd924765ab9ac0729c8d1483"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:12:37.225694 29421 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:37.226094 29376 raft_consensus.cc:606] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 LEADER]: Received request to transfer leadership to TS 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:37.224498 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:37.230022 29375 raft_consensus.cc:2410] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:12:37.231048 29346 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:37.231328 29421 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:37.233469 29377 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
W20260709 13:12:37.238446 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:37.239951 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.233634 29421 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:37.236133 29373 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 7.
I20260709 13:12:37.241786 29419 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:37.225346 29344 leader_election.cc:304] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:37.237429 29346 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:37.240549 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:37.243162 29373 raft_consensus.cc:1275] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:37.247085 32299 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:37.252609 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:37.253408 29449 raft_consensus.cc:3060] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:37.244482 29381 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 10.
I20260709 13:12:37.278167 29346 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:37.224498 32362 raft_consensus.cc:2749] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:37.229460 32163 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:37.317827 29374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1040) took 1196 ms. Trace:
W20260709 13:12:37.325237 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 99969.4us
I20260709 13:12:37.239410 32331 raft_consensus.cc:2749] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:37.326325 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 48309.2us
I20260709 13:12:37.241725 32120 raft_consensus.cc:2804] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:37.334765 29376 raft_consensus.cc:1240] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:37.244028 31713 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:37.253412 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:37.324265 32299 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.317276 32294 raft_consensus.cc:2749] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:37.339205 32120 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:37.343726 32271 raft_consensus.cc:2749] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:37.373374 32195 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 5 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:37.449643 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 284135us
W20260709 13:12:37.472029 29495 leader_election.cc:336] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.967s (SENT)
I20260709 13:12:37.472728 29449 raft_consensus.cc:2468] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 5.
I20260709 13:12:37.257820 32388 raft_consensus.cc:2749] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:37.453804 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 69097us
I20260709 13:12:37.240121 32274 consensus_queue.cc:1048] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.101s
W20260709 13:12:37.454185 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 97279.4us
I20260709 13:12:37.457329 29346 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:37.468571 29373 raft_consensus.cc:1240] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:37.490149 29379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1055) took 1179 ms. Trace:
I20260709 13:12:37.332805 32260 raft_consensus.cc:2749] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:12:37.449266 32020 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.010s	user 0.036s	sys 0.016s
I20260709 13:12:37.471698 32120 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:37.479089 29372 raft_consensus.cc:1275] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:12:37.508143 29372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1069) took 1151 ms. Trace:
W20260709 13:12:37.509119 29495 leader_election.cc:336] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 2.000s (SENT)
I20260709 13:12:37.509872 29495 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:37.510536 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:37.510862 32300 raft_consensus.cc:2749] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:37.491909 30121 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:12:37.491377 32363 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:37.469738 32362 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:12:37.501972 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 268399us
W20260709 13:12:37.504638 32020 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.066s	user 0.036s	sys 0.017s
I20260709 13:12:37.516553 29421 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:37.521996 29421 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:37.508219 32163 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:37.453452 32152 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:37.508761 29372 rpcz_store.cc:276] 0709 13:12:36.357164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.474576 (+1117412us) service_pool.cc:224] Handling call
0709 13:12:37.475006 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:37.507754 (+ 32748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:37.508073 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:37.539516 31713 consensus_queue.cc:1059] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:12:37.542845 31713 raft_consensus.cc:3055] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:37.543262 31713 raft_consensus.cc:740] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:37.544299 31713 consensus_queue.cc:260] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:37.546063 32170 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:37.473387 32299 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:37.547735 29346 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:37.548918 29421 leader_election.cc:336] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 2.939s (SENT)
I20260709 13:12:37.572669 29421 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:37.574324 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:37.558101 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:37.524935 32368 raft_consensus.cc:2804] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:37.532335 32388 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:37.578356 29376 raft_consensus.cc:1240] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:37.537456 32363 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:37.586508 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:37.591003 29449 raft_consensus.cc:1275] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:37.595283 29449 raft_consensus.cc:1240] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:37.598968 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:12:37.599509 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 50617.5us
I20260709 13:12:37.600073 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:37.601130 29375 raft_consensus.cc:1275] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:12:37.602888 32394 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:37.603425 32395 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.603801 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:37.603955 32395 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:37.604466 29453 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
I20260709 13:12:37.573987 32254 consensus_queue.cc:1048] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:12:37.612450 32120 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:37.613054 32330 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:37.615010 32299 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:37.541332 32152 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:37.616585 32120 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:37.617349 32152 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:37.619792 29450 raft_consensus.cc:1240] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:37.596702 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:12:37.625948 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 78334.1us
W20260709 13:12:37.639823 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.599670 32368 raft_consensus.cc:697] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:12:37.588204 32163 consensus_queue.cc:1059] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:12:37.632815 32260 raft_consensus.cc:2749] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:37.650935 32393 log.cc:927] Time spent T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 13:12:37.668040 32385 log.cc:927] Time spent T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 13:12:37.676810 32330 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:37.705003 29346 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:37.710611 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:12:37.720747 29346 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:37.722885 29380 raft_consensus.cc:1275] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:12:37.703385 32397 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:37.702996 32274 consensus_queue.cc:1059] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.045s
W20260709 13:12:37.742935 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 109320us
I20260709 13:12:37.735603 32395 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:37.737119 32163 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:37.720142 32335 consensus_queue.cc:1048] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:12:37.765774 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:37.743691 32397 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:37.737494 32343 consensus_queue.cc:1048] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:12:37.773012 29346 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:37.779168 32412 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.779846 32412 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:37.330991 29374 rpcz_store.cc:276] 0709 13:12:36.121450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:36.494144 (+372694us) service_pool.cc:224] Handling call
0709 13:12:36.494592 (+   448us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:36.519054 (+ 24462us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:36.519088 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:36.541713 (+ 22625us) log.cc:844] Serialized 52 byte log entry
0709 13:12:36.684259 (+142546us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:36.914103 (+229844us) spinlock_profiling.cc:243] Waited 3 ms on lock 0x7b18003a8a60. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a7b92e4bc 00007f6a78c7c48b 00007f6a81ad6ab9 00007f6a78c9869b 00007f6a78c9693f 00007f6a78c96455 00007f6a7f77e3c7 00007f6a7bd909a7 00007f6a7bda00bf
0709 13:12:36.921205 (+  7102us) log.cc:844] Serialized 14 byte log entry
0709 13:12:36.922521 (+  1316us) log.cc:844] Serialized 14 byte log entry
0709 13:12:37.251101 (+328580us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b18003a8a60. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c13c0a 00007f6a82353219 00007f6a7b93cd70 00007f6a7b930293 00007f6a7b925cea 00007f6a7b92623a 00007f6a7bd90a2a 00007f6a7bda00bf 00007f6a7bda0038
0709 13:12:37.317214 (+ 66113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:37.317365 (+   151us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:37.317440 (+    75us) raft_consensus.cc:1685] finished
0709 13:12:37.317462 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:37.317727 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":384249,"prepare.queue_time_us":92097,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":91,"raft.queue_time_us":84904,"raft.run_cpu_time_us":361,"raft.run_wall_time_us":13736,"spinlock_wait_cycles":50408064,"thread_start_us":160774,"threads_started":2,"wal-append.queue_time_us":170587}
I20260709 13:12:37.782088 32412 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:37.784965 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:37.753113 32261 consensus_queue.cc:1048] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:12:37.752982 32408 raft_consensus.cc:2749] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:37.795218 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:37.759227 32276 consensus_queue.cc:1048] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:12:37.789496 32406 consensus_queue.cc:1048] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:12:37.741444 32368 consensus_queue.cc:237] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:12:37.810235 29421 leader_election.cc:336] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 2.749s (SENT)
I20260709 13:12:37.810855 29421 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:37.796795 32370 log.cc:927] Time spent T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.536s	user 0.002s	sys 0.002s
W20260709 13:12:37.819154 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 46233.7us
I20260709 13:12:37.821169 29346 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:37.819525 32330 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:37.831694 32332 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:37.833734 32407 ts_tablet_manager.cc:933] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2: Initiating tablet copy from peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127)
W20260709 13:12:37.845327 29495 connection.cc:256] RPC call timeout handler was delayed by -1.0874503380000533s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3613s for a response
W20260709 13:12:37.845940 29495 connection.cc:256] RPC call timeout handler was delayed by -1.0113297499999589s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1582s for a response
W20260709 13:12:37.846273 29495 connection.cc:256] RPC call timeout handler was delayed by -1.0113297499999589s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1582s for a response
W20260709 13:12:37.860634 29421 leader_election.cc:336] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 3.249s (SENT)
I20260709 13:12:37.861512 29421 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:37.863400 32276 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:37.872773 32330 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:37.877385 32397 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:37.907670 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 82919.9us
I20260709 13:12:37.875743 32401 consensus_queue.cc:1048] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:12:37.771975 32141 raft_consensus.cc:2955] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:12:37.883874 32280 consensus_queue.cc:1048] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:12:37.883342 32403 consensus_queue.cc:1048] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:12:37.931717 30154 raft_consensus.cc:1240] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5. Ops: []
W20260709 13:12:37.933735 32413 log.cc:927] Time spent T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:12:37.934069 32294 consensus_queue.cc:1048] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:37.941876 32403 consensus_queue.cc:1048] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:37.942560 32403 consensus_queue.cc:1243] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer 429e58eb058349e3bf72b5a870c8f6e5 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:12:37.943872 32397 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.944458 32397 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:37.944994 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:37.945935 29455 raft_consensus.cc:2410] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:12:37.947193 32397 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:37.953289 29344 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:37.969944 29377 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 1043) took 1845 ms (client timeout 1949 ms). Trace:
W20260709 13:12:37.970557 29377 rpcz_store.cc:269] 0709 13:12:36.124962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:36.148860 (+ 23898us) service_pool.cc:224] Handling call
0709 13:12:37.969753 (+1820893us) spinlock_profiling.cc:243] Waited 949 ms on lock 0x7b54003f3254. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:37.969879 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2182501248}
I20260709 13:12:37.971458 32170 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:37.969985 29526 raft_consensus.cc:1275] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
I20260709 13:12:37.939510 32271 consensus_queue.cc:1048] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:37.493600 29379 rpcz_store.cc:276] 0709 13:12:36.310522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.327835 (+1017313us) service_pool.cc:224] Handling call
0709 13:12:37.345894 (+ 18059us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:37.477392 (+131498us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:12:37.477432 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:37.489805 (+ 12373us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:37.489865 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:37.489954 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:37.490085 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3348,"raft.queue_time_us":21121,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":9139}
I20260709 13:12:37.976711 32424 consensus_queue.cc:1048] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:37.958537 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:37.981458 29450 raft_consensus.cc:2410] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:12:37.987095 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:37.988205 29450 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:12:37.938664 31713 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:37.959692 29455 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532"
dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
mode: GRACEFUL
new_leader_uuid: "71aa3578fd924765ab9ac0729c8d1483"
 from {username='slave'} at 127.0.0.1:36686
I20260709 13:12:38.004063 29455 raft_consensus.cc:606] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Received request to transfer leadership to TS 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:38.004776 29455 raft_consensus.cc:614] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:36.592020 29265 catalog_manager.cc:5028] TS 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): tablet eb6a9a102eba49209ddf2bdf286077e8 (table test-workload [id=364c32d53f7748a2857a4a9acd17c671]) successfully deleted
I20260709 13:12:37.960137 29523 raft_consensus.cc:2955] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:12:37.962966 29278 catalog_manager.cc:5697] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:37.965003 29375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 374) took 1701 ms. Trace:
I20260709 13:12:37.966285 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:37.969525 29456 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:37.969568 32381 raft_consensus.cc:993] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5: : Instructing follower 71aa3578fd924765ab9ac0729c8d1483 to start an election
W20260709 13:12:37.990585 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 112867us
I20260709 13:12:38.013000 29421 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:38.014392 29421 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:12:38.015035 29265 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 1.42314e+06us
I20260709 13:12:37.919734 32407 tablet_copy_client.cc:323] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Beginning tablet copy session from remote peer at address 127.27.146.129:42127
I20260709 13:12:38.016265 32394 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:38.016721 32394 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:38.017096 32394 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:38.017247 28234 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:12:38.019737 32330 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:38.020192 32330 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.020557 32330 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:37.994313 29526 raft_consensus.cc:1275] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:37.995954 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:38.023212 29522 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:12:38.008723 29375 rpcz_store.cc:276] 0709 13:12:36.263204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.239684 (+976480us) service_pool.cc:224] Handling call
0709 13:12:37.326492 (+ 86808us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:37.601629 (+275137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:37.964559 (+362930us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b54003c4bd4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:37.964823 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":630745344}
I20260709 13:12:38.026897 32271 raft_consensus.cc:1081] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 LEADER]: Signalling peer 71aa3578fd924765ab9ac0729c8d1483 to start an election
I20260709 13:12:38.028761 29380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1051) took 1719 ms. Trace:
I20260709 13:12:38.029444 29380 rpcz_store.cc:276] 0709 13:12:36.308863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.236402 (+927539us) service_pool.cc:224] Handling call
0709 13:12:37.718546 (+482144us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:37.723540 (+  4994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:38.028512 (+304972us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b5400080550. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd858ad 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:38.028694 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1108121344}
I20260709 13:12:38.044042 29421 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:38.048830 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.053761 29456 raft_consensus.cc:1275] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
I20260709 13:12:38.064879 29421 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:38.066473 29421 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:38.067294 32388 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:38.067706 32397 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:38.068105 32388 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:38.048847 28234 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:38.072687 32330 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:38.073969 29421 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:38.077877 29421 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:38.080149 29421 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:38.075567 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 169272us
I20260709 13:12:38.081750 29495 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:38.082859 32401 raft_consensus.cc:2749] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:38.078822 32395 raft_consensus.cc:2749] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:38.046851 32381 raft_consensus.cc:3055] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:38.089787 29421 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:38.083977 32388 raft_consensus.cc:2749] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:38.092855 32363 raft_consensus.cc:2749] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:38.091701 32397 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:38.086206 32381 raft_consensus.cc:740] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:38.113304 29526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5"
dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
 from {username='slave'} at 127.0.0.1:37968
I20260709 13:12:38.121316 29526 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:38.116161 32426 consensus_queue.cc:1059] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:38.123286 29495 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:38.121905 29526 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:38.095718 32260 consensus_queue.cc:1048] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:12:38.107472 32397 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:38.139454 29344 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:38.103977 32395 consensus_queue.cc:1059] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:12:38.153504 29495 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:38.133502 32299 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:38.122033 32401 consensus_queue.cc:1048] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:12:38.152261 29448 raft_consensus.cc:2955] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:12:38.149876 32397 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:38.156927 32426 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:38.151717 32280 raft_consensus.cc:3055] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:12:38.186399 29277 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37586 (request call id 134) took 13335 ms (client timeout 15000 ms). Trace:
I20260709 13:12:38.190222 29495 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:38.167683 32406 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:38.180814 32424 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:38.156559 32270 consensus_queue.cc:1048] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:12:38.170090 32300 consensus_queue.cc:1059] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:12:38.177460 32368 consensus_queue.cc:1048] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:12:38.195335 32280 raft_consensus.cc:740] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:38.204101 29391 tablet_copy_service.cc:140] P 429e58eb058349e3bf72b5a870c8f6e5: Received BeginTabletCopySession request for tablet 95122b0f733946aba19edf1d98467467 from peer ca041dab9b2f44409ed7bf4c6cf66ab2 ({username='slave'} at 127.0.0.1:58422)
I20260709 13:12:38.202690 32406 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.237845 29391 tablet_copy_service.cc:161] P 429e58eb058349e3bf72b5a870c8f6e5: Beginning new tablet copy session on tablet 95122b0f733946aba19edf1d98467467 from peer ca041dab9b2f44409ed7bf4c6cf66ab2 at {username='slave'} at 127.0.0.1:58422: session id = ca041dab9b2f44409ed7bf4c6cf66ab2-95122b0f733946aba19edf1d98467467
I20260709 13:12:38.238183 32406 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:38.219475 32195 consensus_queue.cc:1059] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:12:38.181442 32299 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:38.177531 32381 consensus_queue.cc:260] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:38.248500 32368 raft_consensus.cc:3055] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:12:38.196584 29277 rpcz_store.cc:269] 0709 13:12:24.851032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:24.878253 (+ 27221us) service_pool.cc:224] Handling call
0709 13:12:38.178649 (+13300396us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:35.149875 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:35.399401 (+249526us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:35.404398 (+  4997us) write_op.cc:435] Acquired schema lock
0709 13:12:35.406500 (+  2102us) tablet.cc:662] Decoding operations
0709 13:12:35.580069 (+173569us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:35.580418 (+   349us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:35.580456 (+    38us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:12:35.581072 (+   616us) tablet.cc:701] Row locks acquired
0709 13:12:35.581086 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:12:35.581271 (+   185us) write_op.cc:270] Start()
0709 13:12:35.581390 (+   119us) write_op.cc:276] Timestamp: P: 1783602755581210 usec, L: 0
0709 13:12:35.581405 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 13:12:35.623362 (+ 41957us) log.cc:844] Serialized 2499 byte log entry
0709 13:12:36.221655 (+598293us) op_driver.cc:464] REPLICATION: finished
0709 13:12:36.270272 (+ 48617us) write_op.cc:301] APPLY: starting
0709 13:12:36.270398 (+   126us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:36.270637 (+   239us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:36.270779 (+   142us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:36.353228 (+ 82449us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:36.353492 (+   264us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:12:36.353557 (+    65us) write_op.cc:312] APPLY: finished
0709 13:12:36.442174 (+ 88617us) log.cc:844] Serialized 52 byte log entry
0709 13:12:36.474009 (+ 31835us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:36.487455 (+ 13446us) write_op.cc:454] Released schema lock
0709 13:12:36.497884 (+ 10429us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:36.543932 (+ 46048us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:36.550845 (+  6913us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1872837,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":47351,"apply.run_cpu_time_us":5363,"apply.run_wall_time_us":254230,"num_ops":6,"prepare.queue_time_us":93230,"prepare.run_cpu_time_us":14584,"prepare.run_wall_time_us":521274,"raft.queue_time_us":202083,"raft.run_cpu_time_us":26941,"raft.run_wall_time_us":105861,"replication_time_us":597357,"thread_start_us":225486,"threads_started":4,"wal-append.queue_time_us":268128,"wal-append.run_cpu_time_us":46010,"wal-append.run_wall_time_us":1644397}]]}
I20260709 13:12:38.256623 32394 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:38.289660 29526 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:38.314276 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:38.318073 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 127919us
I20260709 13:12:38.323904 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:38.324539 29495 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:38.323683 29526 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:38.286952 32368 raft_consensus.cc:740] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:12:38.325728 29378 raft_consensus.cc:1275] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:38.313786 32424 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:38.335819 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:38.336901 29377 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:38.338698 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:38.340112 32395 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.340513 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:38.340706 32395 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:38.341163 29380 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 8.
I20260709 13:12:38.325474 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:38.346046 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:38.347067 29376 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 8.
I20260709 13:12:38.347474 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:38.348179 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:38.348654 29372 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:38.351338 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:38.352245 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:38.351439 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:38.352720 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:38.353085 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:38.353257 29375 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 8.
I20260709 13:12:38.352293 29378 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 8.
I20260709 13:12:38.353300 29376 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
I20260709 13:12:38.353587 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:38.310668 32300 consensus_queue.cc:1243] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer ca041dab9b2f44409ed7bf4c6cf66ab2 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:12:38.356127 29380 raft_consensus.cc:2393] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 8: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:38.357180 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:38.371799 29377 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
I20260709 13:12:38.376082 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:38.379060 29526 raft_consensus.cc:3055] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:38.379637 29526 raft_consensus.cc:740] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
W20260709 13:12:38.380831 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.380565 29526 consensus_queue.cc:260] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:38.381935 29526 raft_consensus.cc:3060] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:12:38.384618 32432 log.cc:927] Time spent T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:12:38.384881 32388 raft_consensus.cc:3055] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:38.385358 32388 raft_consensus.cc:740] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:38.386312 32388 consensus_queue.cc:260] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:38.387681 32299 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:38.388123 32441 log.cc:927] Time spent T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:12:38.389225 32368 consensus_queue.cc:260] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:38.390472 29456 raft_consensus.cc:1240] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:38.354642 32141 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:58412 (request call id 4) took 3620 ms. Trace:
W20260709 13:12:38.401301 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.408721 32448 consensus_queue.cc:1059] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:38.411146 29421 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:38.422012 32450 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:38.421918 32448 consensus_queue.cc:1243] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer 429e58eb058349e3bf72b5a870c8f6e5 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:12:38.428489 32436 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:38.428897 32394 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:38.429250 32436 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:38.432138 32434 log.cc:927] Time spent T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:12:38.351635 32280 consensus_queue.cc:260] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:38.434633 29526 raft_consensus.cc:1275] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:12:38.403553 32437 raft_consensus.cc:2749] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:38.412024 32388 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:38.445999 29346 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:38.448297 29346 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:38.454423 29449 raft_consensus.cc:1275] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:12:38.458323 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 133878us
I20260709 13:12:38.458472 29346 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:38.436996 32368 raft_consensus.cc:3060] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:38.468369 29372 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 7.
I20260709 13:12:38.472312 29373 raft_consensus.cc:1240] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:38.464520 32436 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:38.462803 32274 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:38.470453 32280 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:38.476173 29495 leader_election.cc:400] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 7. Current term is 8.
I20260709 13:12:38.476613 29495 leader_election.cc:403] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:12:38.480929 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 69865.5us
I20260709 13:12:38.481695 29421 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:38.483033 29421 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:38.454819 32296 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:38.460048 32261 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:38.489184 29421 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:38.491886 32363 raft_consensus.cc:2804] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:38.492007 29421 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:38.492378 32363 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:38.492835 32363 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:38.492995 32450 raft_consensus.cc:2749] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:38.493356 29421 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:38.494424 29421 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:38.495196 32454 raft_consensus.cc:2804] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:38.495700 32454 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:38.495962 32450 raft_consensus.cc:2804] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:38.496104 32454 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:38.496435 32450 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.496798 32450 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:38.464037 32332 consensus_queue.cc:1048] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:12:38.503283 29495 leader_election.cc:304] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:38.507633 32447 consensus_queue.cc:1048] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:38.456661 32352 consensus_queue.cc:1048] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:12:38.485081 32395 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:38.486176 32394 raft_consensus.cc:2804] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:38.514904 32453 raft_consensus.cc:2749] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:38.486060 29368 tablet_service.cc:1558] Processing DeleteTablet for tablet eb6a9a102eba49209ddf2bdf286077e8 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 7)) from {username='slave'} at 127.0.0.1:52164
I20260709 13:12:38.482311 32437 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 7. Current term is 8.
I20260709 13:12:38.516029 32369 consensus_queue.cc:1048] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:12:38.517167 32440 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
W20260709 13:12:38.518157 32443 log.cc:927] Time spent T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:12:38.486529 32254 consensus_queue.cc:1059] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:12:38.524658 32455 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:38.408593 32141 rpcz_store.cc:276] 0709 13:12:34.724641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:34.725552 (+   911us) service_pool.cc:224] Handling call
0709 13:12:34.909587 (+184035us) log.cc:844] Serialized 513 byte log entry
0709 13:12:35.733823 (+824236us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b180005ae80. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c672a6 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd06b26 00007f6a7bd0049a 00007f6a7bcff714
0709 13:12:35.734600 (+   777us) spinlock_profiling.cc:243] Waited 8.98 ms on lock 0x7b54001d9fa0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd06b26 00007f6a7bd0049a 00007f6a7bcff714 00007f6a7bcdfeaa 00007f6a7bce6d53 00007f6a7bce6cd9 00007f6a7bce6c69 00007f6a7bce6c31 00007f6a7bce5dfd 000000000038f354
0709 13:12:35.736952 (+  2352us) spinlock_profiling.cc:243] Waited 47 ms on lock 0x7b54001d9fa0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bcff142 00007f6a7bcdfeaa 00007f6a7bce6d53 00007f6a7bce6cd9 00007f6a7bce6c69 00007f6a7bce6c31 00007f6a7bce5dfd 000000000038f354 000000000038f199 00007f6a78c99475
0709 13:12:35.752442 (+ 15490us) spinlock_profiling.cc:243] Waited 31.3 ms on lock 0x7b54001d9fa0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bcff142 00007f6a7bcdfeaa 00007f6a7bce6d53 00007f6a7bce6cd9 00007f6a7bce6c69 00007f6a7bce6c31 00007f6a7bce5dfd 000000000038f354 000000000038f199 00007f6a78c99475
0709 13:12:36.210182 (+457740us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b180005ae80. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c672a6 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bcfbdbe 00007f6a7bd06930 00007f6a7bd068d8
0709 13:12:36.323967 (+113785us) spinlock_profiling.cc:243] Waited 29 ms on lock 0x7b54001d9fa0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bcfbdbe 00007f6a7bd06930 00007f6a7bd068d8 00007f6a7bd06858 00007f6a7bd06813 00007f6a7bd05a9c 00007f6a81bf1626 00007f6a81bebdd8 00007f6a7bd427cb 00007f6a7bd452c0
0709 13:12:36.355576 (+ 31609us) spinlock_profiling.cc:243] Waited 29.8 ms on lock 0x7b54001d9fa0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bcfcaaa 00007f6a7bcfbdd9 00007f6a7bd06930 00007f6a7bd068d8 00007f6a7bd06858 00007f6a7bd06813 00007f6a7bd05a9c 00007f6a81bf1626 00007f6a81bebdd8 00007f6a7bd427cb
0709 13:12:38.345366 (+1989790us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":117514,"raft.queue_time_us":261000,"raft.run_cpu_time_us":21687,"raft.run_wall_time_us":1462131,"spinlock_wait_cycles":342049536,"thread_start_us":251531,"threads_started":2,"wal-append.queue_time_us":421062,"wal-append.run_cpu_time_us":21514,"wal-append.run_wall_time_us":2080323}
I20260709 13:12:38.509459 32448 raft_consensus.cc:2749] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:38.548540 32406 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:38.572227 32445 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:38.573081 32445 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:38.575012 32406 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:38.575664 32440 consensus_queue.cc:1059] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:38.578648 32453 raft_consensus.cc:3055] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:38.579144 32453 raft_consensus.cc:740] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:38.580307 32453 consensus_queue.cc:260] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:38.581571 32426 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:38.507817 32450 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:38.541606 32394 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:38.588553 29374 raft_consensus.cc:2393] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 11: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:38.547771 32401 consensus_queue.cc:1059] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:12:38.592058 32444 consensus_queue.cc:1048] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:12:38.587994 32394 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:38.594151 32401 raft_consensus.cc:3055] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:38.594568 32401 raft_consensus.cc:740] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:38.595476 32401 consensus_queue.cc:260] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:38.596838 32401 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:38.551385 32300 consensus_queue.cc:1048] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:12:38.601044 32397 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:38.621018 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 133645us
I20260709 13:12:38.627379 29421 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:38.628633 32447 raft_consensus.cc:2804] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:38.629200 32447 raft_consensus.cc:697] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 6 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:38.630148 32447 consensus_queue.cc:237] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:38.623261 32445 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:38.586867 32455 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:38.637336 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.633466 29391 tablet_copy_source_session.cc:215] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:38.633873 32450 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:38.633601 32455 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:38.604620 32363 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:38.656502 32330 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:38.635910 29421 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:38.657444 32454 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:38.659861 29421 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:38.662684 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:38.662952 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:38.663363 29373 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:38.664227 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:38.664625 32330 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:38.664930 29372 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 8.
I20260709 13:12:38.669174 29421 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:38.669483 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:38.670248 29379 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:38.675633 32450 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:38.684163 32381 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:38.656555 32363 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:38.692662 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:38.693358 29374 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:38.693424 29379 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 8.
I20260709 13:12:38.705531 29373 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 10.
I20260709 13:12:38.700935 29421 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:38.708627 29421 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:38.678717 32388 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:38.715387 32448 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:38.683401 32450 raft_consensus.cc:697] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 7 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:38.721949 29379 raft_consensus.cc:1240] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:12:38.721304 32448 raft_consensus.cc:697] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 10 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:38.724234 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:38.706923 32455 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:12:38.728029 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.717818 32363 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:38.731153 32455 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:38.731401 32445 consensus_queue.cc:1059] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:38.732402 32445 consensus_queue.cc:1243] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer 429e58eb058349e3bf72b5a870c8f6e5 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:12:38.733726 32448 consensus_queue.cc:237] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:38.735940 32455 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:38.737962 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:38.738737 29380 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:38.738564 32450 consensus_queue.cc:237] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:38.717367 32388 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:38.742465 29265 catalog_manager.cc:5028] TS 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): tablet eb6a9a102eba49209ddf2bdf286077e8 (table test-workload [id=364c32d53f7748a2857a4a9acd17c671]) successfully deleted
I20260709 13:12:38.743460 32388 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:38.753500 32452 raft_consensus.cc:3055] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:38.754091 32452 raft_consensus.cc:740] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:38.732052 32363 raft_consensus.cc:697] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 8 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:38.769091 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:38.770423 29379 raft_consensus.cc:2393] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 9: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:38.773293 29380 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
W20260709 13:12:38.774173 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 221118us
I20260709 13:12:38.778417 29421 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:12:38.781457 32463 log.cc:927] Time spent T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:12:38.755209 32452 consensus_queue.cc:260] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:38.783017 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:38.783627 32452 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:38.784183 32395 raft_consensus.cc:2804] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:38.784842 32395 raft_consensus.cc:697] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:38.785918 32395 consensus_queue.cc:237] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:38.745121 32454 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:38.789317 32394 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:38.795334 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.797344 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:38.775070 29495 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:38.798058 29453 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:38.804740 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:38.806594 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:38.807703 29377 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:38.809013 29495 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:38.813731 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:38.814409 29380 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:38.804592 32330 raft_consensus.cc:2749] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:38.855522 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:38.860796 32397 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:39.001979 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:39.152871 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:39.115072 32407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95122b0f733946aba19edf1d98467467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:39.115350 32448 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:39.214242 29278 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35182 (request call id 62) took 4349 ms. Trace:
I20260709 13:12:38.829708 32462 raft_consensus.cc:2804] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:39.118732 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:38.854576 32300 consensus_queue.cc:1048] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:38.879776 32363 consensus_queue.cc:237] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:39.121620 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.803437 32440 consensus_queue.cc:1048] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 13:12:38.820744 29495 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:39.227526 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 408024us
I20260709 13:12:39.228963 29495 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:12:39.115121 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:39.214709 29278 rpcz_store.cc:276] 0709 13:12:34.864799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:34.865199 (+   400us) service_pool.cc:224] Handling call
0709 13:12:39.214125 (+4348926us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:38.248110 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:38.248819 (+   709us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:38.248871 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:12:38.248898 (+    27us) tablet.cc:662] Decoding operations
0709 13:12:38.249397 (+   499us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:38.249498 (+   101us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:38.249544 (+    46us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:12:38.249827 (+   283us) tablet.cc:701] Row locks acquired
0709 13:12:38.249854 (+    27us) write_op.cc:260] PREPARE: finished
0709 13:12:38.250068 (+   214us) write_op.cc:270] Start()
0709 13:12:38.250229 (+   161us) write_op.cc:276] Timestamp: P: 1783602758249996 usec, L: 0
0709 13:12:38.250259 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:12:38.251197 (+   938us) log.cc:844] Serialized 538 byte log entry
0709 13:12:38.650777 (+399580us) op_driver.cc:464] REPLICATION: finished
0709 13:12:38.775167 (+124390us) write_op.cc:301] APPLY: starting
0709 13:12:38.776823 (+  1656us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:38.776960 (+   137us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:38.777102 (+   142us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:38.777398 (+   296us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:38.777572 (+   174us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:12:38.777621 (+    49us) write_op.cc:312] APPLY: finished
0709 13:12:38.780979 (+  3358us) log.cc:844] Serialized 22 byte log entry
0709 13:12:38.781243 (+   264us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:38.781406 (+   163us) write_op.cc:454] Released schema lock
0709 13:12:38.781470 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:38.782005 (+   535us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:38.782047 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":800785,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":116071,"apply.run_cpu_time_us":2609,"apply.run_wall_time_us":13075,"num_ops":1,"prepare.queue_time_us":142463,"prepare.run_cpu_time_us":30734,"prepare.run_wall_time_us":123954,"raft.queue_time_us":67272,"raft.run_cpu_time_us":20485,"raft.run_wall_time_us":62267,"replication_time_us":400302,"thread_start_us":297753,"threads_started":4,"wal-append.queue_time_us":172966}]]}
W20260709 13:12:39.231120 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:38.811645 32280 consensus_queue.cc:1048] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:12:39.130668 29377 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:12:38.803208 32424 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:39.133106 32454 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.134616 29374 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:12:39.133464 32455 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.122044 32447 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:12:39.141052 32470 log.cc:927] Time spent T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.359s	user 0.000s	sys 0.013s
I20260709 13:12:39.127413 29380 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:12:39.142868 29449 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:39.154662 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 322221us
I20260709 13:12:39.158818 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:39.240473 29453 raft_consensus.cc:1275] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:12:39.590319 29453 pending_rounds.cc:85] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 4
I20260709 13:12:39.590587 29453 pending_rounds.cc:107] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:12:39.590860 29453 raft_consensus.cc:2889] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:39.322160 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 96098.4us
I20260709 13:12:39.134495 32388 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:39.224069 32448 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:39.335014 32445 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.244400 32444 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:39.334506 32454 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:39.346454 32430 log.cc:927] Time spent T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:12:39.548537 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:12:39.559523 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 328991us
I20260709 13:12:39.652984 29522 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:39.217602 32381 consensus_meta.cc:287] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.533s	user 0.012s	sys 0.011s
W20260709 13:12:39.476980 32472 log.cc:927] Time spent T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
I20260709 13:12:39.629428 29449 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:12:39.541072 32408 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:39.604266 32260 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.654994 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:39.687243 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:39.688273 29529 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 8.
I20260709 13:12:39.689497 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:39.690953 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:39.655055 29521 raft_consensus.cc:1217] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 5.3->[7.4-9.5]   Dedup: 9.5->[]
W20260709 13:12:39.610829 32475 log.cc:927] Time spent T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.269s	user 0.001s	sys 0.000s
I20260709 13:12:39.565207 32280 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:39.603854 32415 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.585417 32450 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:39.518983 32440 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:39.612406 32459 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.691876 29521 raft_consensus.cc:1240] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10. Ops: [7.4-9.5]
I20260709 13:12:39.620937 32170 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.619916 32394 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:39.635623 32411 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.698076 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:39.700908 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:39.649250 32453 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:39.706287 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:39.697266 32260 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:39.587703 32455 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:39.746557 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:39.748610 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:39.750473 29525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2438) took 1055 ms. Trace:
W20260709 13:12:39.712677 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:39.669902 32436 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.588873 32447 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:39.764297 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:39.767807 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:39.767807 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:39.771652 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:39.751050 29525 rpcz_store.cc:276] 0709 13:12:38.699810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.700472 (+   662us) service_pool.cc:224] Handling call
0709 13:12:38.721142 (+ 20670us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:38.722245 (+  1103us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:38.722350 (+   105us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:38.728496 (+  6146us) log.cc:844] Serialized 26 byte log entry
0709 13:12:38.744360 (+ 15864us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:38.744403 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:38.744479 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:39.750163 (+1005684us) raft_consensus.cc:1685] finished
0709 13:12:39.750197 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:39.750385 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":666,"raft.queue_time_us":1563,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":1654,"thread_start_us":8419,"threads_started":1,"wal-append.queue_time_us":45398}
I20260709 13:12:39.656248 32445 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:39.698366 32276 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:39.780414 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:39.686271 32444 consensus_queue.cc:1059] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:12:39.760838 32462 raft_consensus.cc:697] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:39.760927 32476 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:39.789615 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:39.790400 29528 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:39.789846 32476 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:39.793412 32476 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:39.790073 32462 consensus_queue.cc:237] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:39.794485 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:39.799907 30121 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.022s	sys 0.022s
W20260709 13:12:39.800508 30121 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.022s	sys 0.022s
I20260709 13:12:39.695482 32408 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:12:39.800827 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 646984us
I20260709 13:12:39.804955 29528 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:12:39.811050 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:39.811090 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:39.784744 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:39.705122 32280 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:39.815734 29495 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:39.823532 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:39.823886 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:39.713508 32415 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:39.735625 32170 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:39.827107 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:39.835526 29528 raft_consensus.cc:2393] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 8: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:39.836717 29528 raft_consensus.cc:1240] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:39.838042 29528 raft_consensus.cc:1275] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:12:39.838346 29528 pending_rounds.cc:85] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 3
I20260709 13:12:39.838557 29528 pending_rounds.cc:107] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:12:39.838760 29528 raft_consensus.cc:2889] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:39.807433 32469 log.cc:927] Time spent T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.367s	user 0.002s	sys 0.000s
I20260709 13:12:39.736924 32459 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:39.776274 32436 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:39.720345 32450 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:39.828145 32444 raft_consensus.cc:3055] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:39.853034 29530 raft_consensus.cc:1240] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 6. Current term is 7. Ops: []
W20260709 13:12:39.854374 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:39.725057 32440 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:39.850296 32424 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.016s	sys 0.057s
I20260709 13:12:39.831351 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:39.874660 29525 raft_consensus.cc:2393] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 8: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:39.829964 29495 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:39.767814 32411 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:39.882679 29522 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
W20260709 13:12:39.918090 29327 auto_rebalancer.cc:629] Failed to schedule move for tablet 1e3b77a777d14f819c6bc72128621f93: Illegal state: Replica 183db85c071f489fbc8de63a9edd8a3a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
W20260709 13:12:39.861183 32360 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.011s	sys 0.033s
W20260709 13:12:39.861627 32477 log.cc:927] Time spent T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:12:39.857051 32296 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.803882 32276 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:39.912389 32395 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.036s	sys 0.097s
W20260709 13:12:39.934842 32395 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.036s	sys 0.098s
I20260709 13:12:39.857923 32444 raft_consensus.cc:740] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:39.937448 32444 consensus_queue.cc:260] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:39.913407 32394 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:39.939885 32394 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:39.940308 32395 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.940816 32170 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:39.942615 29524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2437) took 1249 ms. Trace:
I20260709 13:12:39.939168 32444 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:39.945652 29276 catalog_manager.cc:5697] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 8 to 9, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 9 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:39.873976 32424 raft_consensus.cc:697] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:39.948590 29276 catalog_manager.cc:5697] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 7 to 8, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 8 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:39.949043 32424 consensus_queue.cc:237] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:39.951450 32450 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:39.941052 32395 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:39.952397 32447 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:39.953636 32445 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:39.954349 32454 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:39.954864 32280 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:39.955823 32280 raft_consensus.cc:2804] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:39.956226 32280 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:39.956771 32280 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:39.956269 32459 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:39.954386 32395 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:39.960644 32440 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:39.961262 32440 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.961721 32440 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:39.917325 32476 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:39.967892 32476 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:39.968888 32444 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.970130 32427 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.969718 32444 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:39.970335 32476 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:39.952075 32450 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:39.970703 32427 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:39.971079 32450 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:12:39.930482 32360 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.012s	sys 0.033s
I20260709 13:12:39.953909 29276 catalog_manager.cc:5697] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 3 to 5, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 5 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:39.943035 29524 rpcz_store.cc:276] 0709 13:12:38.693242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.693364 (+   122us) service_pool.cc:224] Handling call
0709 13:12:38.693770 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:38.694190 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:38.694219 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:38.708809 (+ 14590us) log.cc:844] Serialized 26 byte log entry
0709 13:12:38.794971 (+ 86162us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:38.795019 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:38.795101 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:39.942372 (+1147271us) raft_consensus.cc:1685] finished
0709 13:12:39.942396 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:39.942547 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5288,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":10047,"thread_start_us":66871,"threads_started":1,"wal-append.queue_time_us":609958}
I20260709 13:12:39.944105 32388 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:39.976270 32455 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:40.050770 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.027736 32448 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:40.049085 29380 consensus_queue.cc:237] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:12:39.944514 32296 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:40.067947 32401 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.026s	sys 0.051s
W20260709 13:12:40.080629 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 380692us
I20260709 13:12:40.084164 29377 raft_consensus.cc:1275] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:12:40.083642 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:40.108295 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:40.109218 29378 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:40.110909 29346 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:40.133294 29374 raft_consensus.cc:1275] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:12:40.077631 32401 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.027s	sys 0.051s
I20260709 13:12:40.149710 32276 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:40.148885 29276 catalog_manager.cc:5697] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 6 to 7, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 7 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:40.153084 32427 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:40.156679 32296 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:40.080294 32440 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:40.158031 32440 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.158664 32440 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:40.160877 32450 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:12:40.163272 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:40.267383 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 448397us
W20260709 13:12:40.258816 29420 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.785s	user 0.010s	sys 0.015s
W20260709 13:12:40.170936 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 53076.7us
W20260709 13:12:40.172746 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 61965us
I20260709 13:12:40.273666 29378 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:12:40.173700 32170 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:12:40.174137 32479 log.cc:927] Time spent T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:12:40.114627 32488 raft_consensus.cc:2804] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:40.175801 32411 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:40.177331 32459 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:40.182889 32343 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.188418 29276 catalog_manager.cc:5697] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 4 to 5, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 5 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:40.081318 32260 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:40.192989 32444 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:40.289929 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 460101us
I20260709 13:12:40.196250 32394 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:40.198283 32408 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:40.080284 32381 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:40.208341 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.208724 32484 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
W20260709 13:12:40.268400 29420 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.011s	sys 0.015s
W20260709 13:12:40.300230 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:40.300797 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.294570 29276 catalog_manager.cc:5697] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:40.194974 32415 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:40.281251 32488 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:40.282490 29344 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:40.291293 29495 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:40.277523 32170 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:40.328814 32170 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:40.329363 32394 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.329866 32394 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:40.330474 32486 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.276897 32401 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:40.331660 32388 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:40.331230 32486 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:40.331835 32401 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:40.332201 32388 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:40.334106 32401 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:40.334303 32388 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:40.334717 32401 raft_consensus.cc:2764] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:12:40.335932 32482 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:40.336117 32260 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:40.339679 32141 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.318565 32450 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:40.278056 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:40.353014 29378 raft_consensus.cc:2468] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 5.
I20260709 13:12:40.353183 29454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2008) took 1534 ms. Trace:
I20260709 13:12:40.353760 29454 rpcz_store.cc:276] 0709 13:12:38.819180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.819293 (+   113us) service_pool.cc:224] Handling call
0709 13:12:38.819700 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:38.820125 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:38.820152 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:38.858982 (+ 38830us) log.cc:844] Serialized 26 byte log entry
0709 13:12:39.692874 (+833892us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:39.692936 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:39.693032 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:40.352851 (+659819us) raft_consensus.cc:1685] finished
0709 13:12:40.352873 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:40.353113 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":24857,"thread_start_us":466453,"threads_started":1,"wal-append.queue_time_us":775213}
I20260709 13:12:40.328692 32363 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:40.342689 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 51495.1us
W20260709 13:12:40.341849 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 59482.6us
I20260709 13:12:40.357837 29495 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:12:40.343533 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.354889 30121 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:12:40.319743 32462 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:40.325359 32448 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:40.362818 29276 catalog_manager.cc:5697] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 5 to 7, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 7 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:40.334824 32388 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:40.342883 32488 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:40.369902 29276 catalog_manager.cc:5697] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:40.287904 32459 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:40.351652 32458 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.298379 32280 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:40.319306 32381 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:40.367739 32486 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:40.392127 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 82012.8us
I20260709 13:12:40.397435 29344 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:40.402647 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:40.404585 29495 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:40.290182 32343 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:40.360963 32141 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:40.395844 32494 raft_consensus.cc:2804] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:40.361645 32450 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:40.326064 32484 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:40.355626 32482 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:40.373993 32462 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:40.362531 32363 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:40.393855 32448 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:40.392465 32388 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:40.399134 32458 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:40.446257 29346 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 1.727s (SENT) [suppressed 32 similar messages]
I20260709 13:12:40.421164 32401 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.469640 32280 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:40.471987 32141 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:40.472249 32363 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:40.436129 32394 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:40.436913 32494 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:40.500372 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 54171.4us
I20260709 13:12:40.443768 32440 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:40.479877 32453 consensus_meta.cc:287] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.718s	user 0.006s	sys 0.009s
I20260709 13:12:40.479415 32498 raft_consensus.cc:2764] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:12:40.475070 32343 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:40.514384 32482 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:40.517197 29453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2005) took 1714 ms. Trace:
I20260709 13:12:40.469619 32458 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:40.517751 29453 rpcz_store.cc:276] 0709 13:12:38.802495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:38.802651 (+   156us) service_pool.cc:224] Handling call
0709 13:12:38.803087 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:39.591334 (+788247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:40.516883 (+925549us) spinlock_profiling.cc:243] Waited 437 ms on lock 0x7b54001c1e54. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:40.517122 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1004712320}
I20260709 13:12:40.517304 32499 raft_consensus.cc:2764] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:12:40.495922 32494 raft_consensus.cc:3060] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:40.519686 32388 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:40.520629 32473 log.cc:927] Time spent T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.978s	user 0.008s	sys 0.002s
I20260709 13:12:40.510566 32444 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.475509 32401 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:40.525041 29421 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:12:40.646102 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:40.533116 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 93443.4us
W20260709 13:12:40.667528 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 142547us
I20260709 13:12:40.568239 32381 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:40.668265 32448 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:40.668447 29421 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:40.531840 32397 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:40.682054 29421 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:40.682072 29495 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:40.666144 32482 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:40.686757 32482 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:40.689276 32482 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:40.685428 32448 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.689481 32488 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:40.690346 32448 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:40.691768 32363 raft_consensus.cc:2804] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:40.692358 32363 raft_consensus.cc:697] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:40.692708 32448 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:40.693099 32401 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:40.693364 32363 consensus_queue.cc:237] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:40.694856 32388 raft_consensus.cc:2804] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:40.695441 32388 raft_consensus.cc:697] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:40.696396 32388 consensus_queue.cc:237] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:40.696772 32508 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:40.697376 32407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:54212 (request call id 106) took 3122 ms. Trace:
I20260709 13:12:40.697479 32508 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:40.697942 32407 rpcz_store.cc:276] 0709 13:12:37.583778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.601441 (+ 17663us) service_pool.cc:224] Handling call
0709 13:12:37.840454 (+239013us) ts_tablet_manager.cc:934] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2: Initiating tablet copy from peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127)
0709 13:12:38.855975 (+1015521us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:12:40.206162 (+1350187us) tablet_metadata.cc:665] Metadata flushed
0709 13:12:40.206348 (+   186us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:12:40.696446 (+490098us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:12:40.696817 (+   371us) tablet_replica.cc:206] Creating consensus instance
0709 13:12:40.697210 (+   393us) ts_tablet_manager.cc:989] Replica registered.
0709 13:12:40.697280 (+    70us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":38799,"tablet-copy.queue_time_us":170678,"thread_start_us":105189,"threads_started":2}
I20260709 13:12:40.681790 32394 raft_consensus.cc:2804] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:40.700371 32394 raft_consensus.cc:697] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
W20260709 13:12:40.700582 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.701318 32394 consensus_queue.cc:237] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:40.702241 32508 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:40.584503 32462 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:40.665169 32498 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.524850 32450 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:40.586537 32459 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:40.708540 29421 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:40.709478 32170 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:40.710216 32330 consensus_queue.cc:1048] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:12:40.709116 32483 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:40.681137 32444 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:40.708323 32407 tablet_copy_client.cc:806] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Starting download of 0 data blocks...
W20260709 13:12:40.760157 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 45665.5us
I20260709 13:12:40.715034 32498 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:40.710296 32448 consensus_queue.cc:1048] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:12:40.761777 29495 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:40.707643 32397 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:40.739709 32330 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:40.760141 32407 tablet_copy_client.cc:670] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:40.765604 32498 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:40.782485 29495 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:40.774935 32486 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:40.784153 32170 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:40.801326 32483 raft_consensus.cc:697] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:40.785719 32401 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:40.785115 32488 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:40.784870 32496 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:40.824613 29495 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:40.801398 32363 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:40.782780 32494 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:12:40.841555 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.826640 32401 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:40.829340 32453 raft_consensus.cc:2804] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:40.821177 32388 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.851949 29495 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:40.814200 32498 consensus_queue.cc:1048] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:12:40.851766 32401 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:40.821213 32486 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:40.867717 29495 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:40.830487 32300 consensus_queue.cc:1048] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:12:40.850651 32330 raft_consensus.cc:697] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:40.869086 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:40.855348 32453 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:40.832679 32363 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:40.877477 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:40.876644 30158 raft_consensus.cc:2393] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 7: Already voted for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in this term.
I20260709 13:12:40.946461 32526 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
W20260709 13:12:40.944360 32515 log.cc:927] Time spent T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:12:40.868708 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:40.944530 32330 consensus_queue.cc:237] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:40.894968 32453 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:41.000581 32510 raft_consensus.cc:2749] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:40.857878 32448 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:40.857810 32482 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:40.863799 32488 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:40.985590 32436 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:40.832065 32496 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:40.857797 32388 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:41.037631 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:40.986797 32522 raft_consensus.cc:2749] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:12:41.033907 32513 log.cc:927] Time spent T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.212s	user 0.002s	sys 0.000s
W20260709 13:12:41.064983 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 197412us
I20260709 13:12:41.068684 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: true dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:41.069615 29453 raft_consensus.cc:2393] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 7: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:41.014530 32448 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:41.046440 32397 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:41.080444 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:41.080981 32397 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.081593 32397 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:41.082347 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:41.082970 29447 raft_consensus.cc:2468] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:12:41.084285 29451 raft_consensus.cc:1240] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 8 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:41.084389 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:41.084841 32388 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:41.085047 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:41.023579 32482 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:41.077456 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:41.085669 29455 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
I20260709 13:12:41.086010 29452 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
I20260709 13:12:41.079769 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:41.086975 29450 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
I20260709 13:12:41.080246 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:41.087364 29455 raft_consensus.cc:1275] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:12:41.087790 29449 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
I20260709 13:12:41.076866 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:41.081073 29448 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:41.079963 32524 log.cc:927] Time spent T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:12:41.090751 29450 raft_consensus.cc:1275] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:41.091914 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:41.091957 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:41.092613 29455 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
I20260709 13:12:41.093569 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:41.094105 29451 raft_consensus.cc:1240] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:41.085179 29447 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:12:41.086993 32482 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:41.076573 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:41.092670 29450 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:41.063210 32394 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:41.070271 32330 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.115723 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:41.100755 32514 log.cc:927] Time spent T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
I20260709 13:12:41.109710 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:41.112226 29448 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
I20260709 13:12:41.141284 29447 raft_consensus.cc:1240] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 6 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:41.142102 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:41.140022 29526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2449) took 1714 ms. Trace:
I20260709 13:12:41.144742 29448 raft_consensus.cc:1240] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 10 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:41.114125 29523 raft_consensus.cc:3055] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:41.140609 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:41.145804 29523 raft_consensus.cc:740] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:41.146127 29521 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 7.
I20260709 13:12:41.114403 29529 raft_consensus.cc:1275] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:12:41.147917 29529 pending_rounds.cc:85] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 4
I20260709 13:12:41.148279 29529 pending_rounds.cc:107] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:12:41.148592 29529 raft_consensus.cc:2889] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:41.149122 29450 raft_consensus.cc:2468] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:12:41.088455 29454 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
I20260709 13:12:41.117250 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:41.010210 32526 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:40.998004 32483 consensus_queue.cc:237] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:41.108793 29453 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
I20260709 13:12:41.142697 29495 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:41.114965 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:41.112972 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:41.150574 29522 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 8.
I20260709 13:12:41.144506 29526 rpcz_store.cc:276] 0709 13:12:39.425433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:39.530999 (+105566us) service_pool.cc:224] Handling call
0709 13:12:39.531601 (+   602us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:39.930162 (+398561us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:39.930197 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:39.930252 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:39.930288 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:41.139530 (+1209242us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b54000cb2d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:41.139802 (+   272us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:41.139953 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":916006272}
I20260709 13:12:41.151988 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:41.146804 29523 consensus_queue.cc:260] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:41.154608 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:41.157512 29525 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 7.
I20260709 13:12:41.158340 29523 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:41.151643 32397 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:41.160770 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:41.176250 29530 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 8.
I20260709 13:12:41.177347 29495 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:41.178206 29495 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:41.138963 32534 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:41.181701 32300 raft_consensus.cc:2804] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:41.185103 32300 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:41.185482 32300 raft_consensus.cc:3060] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:41.179795 32488 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:41.152037 32484 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:41.204056 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:41.200955 29523 raft_consensus.cc:1275] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:12:41.189126 29495 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:41.137756 32330 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:41.176272 32494 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 7 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:41.209396 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:41.132501 32394 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:12:41.208146 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:41.215657 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 818277us
I20260709 13:12:41.215831 32491 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:41.205705 32523 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:41.285933 29526 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 7.
I20260709 13:12:41.223701 32415 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.225939 32363 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:41.230096 29452 raft_consensus.cc:1240] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:41.234233 32381 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.247116 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:41.310460 29380 raft_consensus.cc:3060] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:12:41.254241 32407 tablet_copy_client.cc:538] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:12:41.256844 32502 log.cc:927] Time spent T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.741s	user 0.005s	sys 0.008s
I20260709 13:12:41.181970 32498 consensus_queue.cc:1059] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:12:41.268297 29523 raft_consensus.cc:2393] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 6: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:41.206936 32534 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:41.209106 32517 raft_consensus.cc:2804] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:41.276175 32496 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:41.188051 32488 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:12:41.277369 29456 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:12:41.278515 32330 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:41.280359 32520 log.cc:927] Time spent T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
W20260709 13:12:41.281358 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 92351.5us
I20260709 13:12:41.297699 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:41.344985 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:41.223124 32492 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:41.321839 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:41.326246 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:41.346668 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:41.310789 32484 raft_consensus.cc:2804] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:41.292781 32523 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:41.341034 29380 raft_consensus.cc:2468] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 7.
I20260709 13:12:41.350960 30158 raft_consensus.cc:2368] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 6. Current term is 7.
I20260709 13:12:41.349466 29495 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:41.353847 32492 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:41.356003 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:41.356841 29378 raft_consensus.cc:2393] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 8: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:41.358623 29377 raft_consensus.cc:1240] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:12:41.359964 29372 raft_consensus.cc:1240] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 13:12:41.360689 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:41.361431 29379 raft_consensus.cc:1240] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:12:41.362726 30121 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:12:41.351274 32484 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:41.363896 32484 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:41.365131 32492 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:41.365708 32493 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:41.366256 32493 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:41.368949 32471 consensus_queue.cc:1048] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:41.372190 29374 raft_consensus.cc:1240] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:12:41.373708 32427 raft_consensus.cc:2804] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:41.374295 32427 raft_consensus.cc:697] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:12:41.375322 32427 consensus_queue.cc:237] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:41.359993 29523 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 8.
I20260709 13:12:41.356879 32507 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:41.380158 32507 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:41.357064 32523 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:41.388779 32529 log.cc:927] Time spent T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.317s	user 0.000s	sys 0.001s
I20260709 13:12:41.390394 29373 raft_consensus.cc:1240] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 7. Current term is 8. Ops: [5.3-7.4]
I20260709 13:12:41.391927 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: true dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:41.393981 32394 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:41.348804 32510 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:41.394899 32510 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:41.348548 32498 consensus_queue.cc:1243] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer 183db85c071f489fbc8de63a9edd8a3a log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:12:41.397965 32448 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:41.400210 29373 pending_rounds.cc:85] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5: Aborting all ops after (but not including) 4
I20260709 13:12:41.400574 29373 pending_rounds.cc:107] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:12:41.348428 32526 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:41.400918 29373 raft_consensus.cc:2889] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:41.403292 32401 consensus_meta.cc:287] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.531s	user 0.011s	sys 0.000s
I20260709 13:12:41.403750 32401 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:41.404973 29528 raft_consensus.cc:2393] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 10: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:41.403448 29376 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
I20260709 13:12:41.314469 32415 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:41.406333 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:41.407068 32415 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:41.322798 32381 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:41.407670 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:41.408447 29376 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:12:41.409426 32381 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:41.409474 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:41.410693 32453 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:41.407164 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:41.412017 29380 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
I20260709 13:12:41.412863 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:41.413825 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:41.414369 29380 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
I20260709 13:12:41.415107 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:41.415748 32508 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.416257 32508 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:41.417534 32484 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:41.418385 32508 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:41.325980 32491 raft_consensus.cc:697] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:41.336192 32517 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:41.419785 32517 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:41.419921 32484 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:41.425052 29530 raft_consensus.cc:2393] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 8: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:41.430030 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:41.430759 29521 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 10.
I20260709 13:12:41.430979 32276 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.410925 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:41.434620 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:41.446499 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:41.447165 29521 raft_consensus.cc:2410] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:12:41.447412 29376 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:12:41.442867 29381 raft_consensus.cc:1240] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:12:41.443202 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 93870.6us
I20260709 13:12:41.455157 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:12:41.457978 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 51215.1us
I20260709 13:12:41.457938 29495 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:41.425050 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:41.476231 32462 raft_consensus.cc:2804] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:41.476720 32462 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:41.477144 32462 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:41.438505 32401 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:41.487290 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:41.488703 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:41.489634 29376 raft_consensus.cc:2410] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:12:41.490797 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:41.491591 29376 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:12:41.496340 29380 raft_consensus.cc:1240] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:41.494235 29495 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:41.442358 32444 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:41.499133 29495 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:41.455160 32499 raft_consensus.cc:2804] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:12:41.506134 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:41.502717 29495 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:41.509105 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:41.454741 32492 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.431473 32276 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:41.493130 32408 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.476722 32493 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:41.513170 29376 raft_consensus.cc:2393] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 8: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:41.512259 29495 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:41.483891 32440 consensus_queue.cc:1059] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:12:41.520052 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:41.520254 29495 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:41.508847 32499 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:41.640516 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 120353us
I20260709 13:12:41.474884 32498 consensus_queue.cc:1048] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:12:41.505934 32484 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:41.508322 32508 raft_consensus.cc:2804] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:41.665486 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:41.517488 32444 raft_consensus.cc:2804] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:41.694483 32448 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:41.695422 32448 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:41.698810 32448 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:41.647639 32499 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:41.483624 32491 consensus_queue.cc:237] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:41.664009 32440 consensus_queue.cc:1243] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer 183db85c071f489fbc8de63a9edd8a3a log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:12:41.663261 32522 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:41.655725 32484 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:41.517108 32492 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:41.521939 32408 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:41.788493 32508 raft_consensus.cc:697] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
W20260709 13:12:41.836000 32505 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.966s	user 0.005s	sys 0.032s
W20260709 13:12:41.836730 32505 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.317s	user 0.005s	sys 0.032s
I20260709 13:12:41.836256 32516 consensus_queue.cc:1059] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.329s
I20260709 13:12:41.794129 32493 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:41.843885 32493 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:41.848343 32531 raft_consensus.cc:2804] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:41.849179 32531 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:41.849838 32531 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:41.823706 32466 consensus_queue.cc:1048] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.352s
I20260709 13:12:41.797475 32444 raft_consensus.cc:697] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:41.857172 32444 consensus_queue.cc:237] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:41.847132 32493 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:41.789856 32401 consensus_queue.cc:1059] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:12:41.876742 32542 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.877430 32542 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:41.881981 32280 raft_consensus.cc:3055] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:41.882628 32280 raft_consensus.cc:740] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:41.795784 32507 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:41.890799 32516 consensus_queue.cc:1243] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer 183db85c071f489fbc8de63a9edd8a3a log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:12:41.891604 32516 raft_consensus.cc:3055] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:41.892027 32516 raft_consensus.cc:740] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:41.893959 32401 consensus_queue.cc:1243] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer 183db85c071f489fbc8de63a9edd8a3a log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:12:41.893123 32516 consensus_queue.cc:260] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:41.897183 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:41.907217 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:41.826565 32522 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:12:41.898694 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:41.908252 32522 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:41.898963 32508 consensus_queue.cc:237] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:41.826349 32484 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:41.912335 32516 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:41.903988 29376 raft_consensus.cc:1275] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:12:41.960341 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:41.935422 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:41.962080 29380 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 8.
I20260709 13:12:41.963413 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:41.998466 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:42.001595 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:42.002596 29377 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:12:42.017712 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:42.006237 32541 consensus_queue.cc:1048] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:12:42.055181 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:42.013535 32542 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:42.073518 29380 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 7.
I20260709 13:12:42.072651 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:42.075779 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:42.077323 29419 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.003s	sys 0.008s
W20260709 13:12:42.077827 29419 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.003s	sys 0.009s
W20260709 13:12:42.078208 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 570962us
W20260709 13:12:42.072475 32300 consensus_meta.cc:287] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.887s	user 0.014s	sys 0.002s
I20260709 13:12:42.087241 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:42.085744 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:42.088819 29452 raft_consensus.cc:2468] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 6.
I20260709 13:12:42.090266 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:42.090756 29452 raft_consensus.cc:3060] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:42.097219 29375 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.002s	sys 0.014s
W20260709 13:12:42.097793 29375 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.002s	sys 0.014s
I20260709 13:12:42.039556 32280 consensus_queue.cc:260] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:42.107916 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:42.116072 29452 raft_consensus.cc:2468] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 7.
I20260709 13:12:42.131320 29449 raft_consensus.cc:1275] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:12:42.118593 29419 connection.cc:256] RPC call timeout handler was delayed by -2.5497656200002439s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2135s for a response
I20260709 13:12:42.132490 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:42.132424 29419 connection.cc:256] RPC call timeout handler was delayed by -2.4082167710000704s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2702s for a response
W20260709 13:12:42.134299 29419 connection.cc:256] RPC call timeout handler was delayed by -2.4006369470000664s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1938s for a response
W20260709 13:12:42.135082 29419 connection.cc:256] RPC call timeout handler was delayed by -2.2323925150001287s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2203s for a response
I20260709 13:12:42.107190 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:42.136989 29523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37958 (request call id 1358) took 1017 ms. Trace:
I20260709 13:12:42.137861 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:42.137405 29523 rpcz_store.cc:276] 0709 13:12:41.119313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:42.079103 (+959790us) service_pool.cc:224] Handling call
0709 13:12:42.136926 (+ 57823us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:42.132900 32547 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:42.132872 32408 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:42.103381 32276 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:42.092166 32300 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:42.188268 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:42.190637 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:42.191773 29523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37958 (request call id 1345) took 1076 ms. Trace:
I20260709 13:12:42.192190 29523 rpcz_store.cc:276] 0709 13:12:41.115098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:42.146838 (+1031740us) service_pool.cc:224] Handling call
0709 13:12:42.191690 (+ 44852us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:42.195343 29380 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 10.
I20260709 13:12:42.138437 32521 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:42.143617 32280 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:42.205684 29373 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.029s	sys 0.028s
W20260709 13:12:42.207692 29373 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.030s	sys 0.028s
I20260709 13:12:42.210837 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:42.212096 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:42.212925 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:42.213195 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:42.212096 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:42.214807 29377 raft_consensus.cc:2410] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:12:42.188948 32498 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:42.240149 29523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37958 (request call id 1351) took 1123 ms. Trace:
I20260709 13:12:42.247725 29523 rpcz_store.cc:276] 0709 13:12:41.116781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:42.193079 (+1076298us) service_pool.cc:224] Handling call
0709 13:12:42.240031 (+ 46952us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:12:42.208992 32462 consensus_meta.cc:287] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.731s	user 0.007s	sys 0.008s
W20260709 13:12:42.241498 29495 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.020s	sys 0.047s
I20260709 13:12:42.247097 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:42.249089 29495 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.020s	sys 0.047s
I20260709 13:12:42.249462 29524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37958 (request call id 1344) took 1134 ms. Trace:
W20260709 13:12:42.249424 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 607557us
I20260709 13:12:42.249925 29524 rpcz_store.cc:276] 0709 13:12:41.114865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:42.246773 (+1131908us) service_pool.cc:224] Handling call
0709 13:12:42.249398 (+  2625us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:42.141481 32547 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:42.253924 29528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37958 (request call id 1342) took 1132 ms. Trace:
I20260709 13:12:42.206977 32492 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:42.292909 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:42.299651 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:42.302008 32548 log.cc:927] Time spent T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:12:42.254011 32498 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:42.254806 32462 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:42.309015 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:42.309886 29524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37958 (request call id 1359) took 1190 ms. Trace:
I20260709 13:12:42.310369 32462 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:42.310225 29524 rpcz_store.cc:276] 0709 13:12:41.119680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:42.250552 (+1130872us) service_pool.cc:224] Handling call
0709 13:12:42.309813 (+ 59261us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:12:42.309145 32504 log.cc:927] Time spent T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 1.786s	user 0.000s	sys 0.013s
I20260709 13:12:42.313679 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:42.254700 29528 rpcz_store.cc:276] 0709 13:12:41.114304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.114716 (+   412us) service_pool.cc:224] Handling call
0709 13:12:42.246283 (+1131567us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b540019e454. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:42.246475 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":571608960}
I20260709 13:12:42.311350 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:42.315248 29523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37958 (request call id 1348) took 1199 ms. Trace:
I20260709 13:12:42.315742 29523 rpcz_store.cc:276] 0709 13:12:41.116012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:42.248600 (+1132588us) service_pool.cc:224] Handling call
0709 13:12:42.315161 (+ 66561us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:12:42.308058 32551 log.cc:927] Time spent T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 13:12:42.310451 32498 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:42.313210 29524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53428 (request call id 394) took 1039 ms. Trace:
I20260709 13:12:42.315258 29452 raft_consensus.cc:1240] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:42.320375 29524 rpcz_store.cc:276] 0709 13:12:41.272981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:42.311632 (+1038651us) service_pool.cc:224] Handling call
0709 13:12:42.311929 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:42.312124 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:42.312163 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:42.312207 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:42.312237 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:42.312305 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:42.312414 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:12:42.318737 32517 consensus_meta.cc:287] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.898s	user 0.014s	sys 0.000s
I20260709 13:12:42.254160 32448 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:42.331213 29452 raft_consensus.cc:1240] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:42.226112 32521 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:42.436290 29421 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:42.437844 29421 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:12:42.439338 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:42.351384 32274 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.019s	sys 0.026s
I20260709 13:12:42.453287 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:42.454070 29453 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:42.456787 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:42.457520 29454 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:12:42.450664 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:42.459307 32407 tablet_bootstrap.cc:492] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap starting.
I20260709 13:12:42.457566 32300 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:42.459944 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:12:42.460361 32554 log.cc:927] Time spent T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:12:42.460598 29450 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:42.435370 32448 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:42.445281 32274 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.930s	user 0.020s	sys 0.026s
I20260709 13:12:42.472280 32448 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:42.472916 32448 raft_consensus.cc:2804] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:42.473264 32448 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.473568 32448 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:42.474609 32535 log.cc:927] Time spent T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 1.286s	user 0.000s	sys 0.013s
I20260709 13:12:42.475585 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:42.476282 29454 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
W20260709 13:12:42.477996 32499 consensus_meta.cc:287] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.651s	user 0.005s	sys 0.006s
I20260709 13:12:42.478448 32499 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:42.474668 29450 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
I20260709 13:12:42.501137 32499 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:42.501744 29526 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37958 (request call id 1352) took 1384 ms (client timeout 1739 ms). Trace:
W20260709 13:12:42.531312 32531 consensus_meta.cc:287] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.681s	user 0.014s	sys 0.000s
I20260709 13:12:42.507596 32507 raft_consensus.cc:3055] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:12:42.508210 29530 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37958 (request call id 1356) took 1390 ms (client timeout 1703 ms). Trace:
I20260709 13:12:42.510006 32453 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:42.512377 32522 consensus_meta.cc:287] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.604s	user 0.013s	sys 0.000s
I20260709 13:12:42.512755 32534 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:42.515929 32424 raft_consensus.cc:3055] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:42.516351 32547 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:42.517514 32486 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:42.517884 32553 log.cc:927] Time spent T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:12:42.518923 32521 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:42.525959 32401 raft_consensus.cc:493] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:42.547803 32507 raft_consensus.cc:740] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:42.551932 32280 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:12:42.511382 32516 consensus_meta.cc:287] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.502s	user 0.004s	sys 0.004s
I20260709 13:12:42.433221 32517 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:42.554211 32522 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:42.547384 32300 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:42.708164 32280 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:42.676151 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:42.677201 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.StartTabletCopy -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 1.36215e+06us
W20260709 13:12:42.532277 29419 connection.cc:256] RPC call timeout handler was delayed by -1.9218109210000875s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19890000000000002s for a response
I20260709 13:12:42.523398 29449 raft_consensus.cc:1217] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 8 LEADER]: Deduplicated request from leader. Original: 3.2->[5.3-7.4]   Dedup: 7.4->[]
I20260709 13:12:42.755769 29449 raft_consensus.cc:1240] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 8 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 7. Current term is 8. Ops: [5.3-7.4]
I20260709 13:12:42.756701 32280 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:42.525281 29450 raft_consensus.cc:1275] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:42.673087 29375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1093) took 1270 ms. Trace:
I20260709 13:12:42.758029 29375 rpcz_store.cc:276] 0709 13:12:41.402304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.402427 (+   123us) service_pool.cc:224] Handling call
0709 13:12:41.402752 (+   325us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:41.455612 (+ 52860us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:41.455658 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:41.456436 (+   778us) log.cc:844] Serialized 52 byte log entry
0709 13:12:42.098314 (+641878us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:42.098384 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:42.098499 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:42.495314 (+396815us) spinlock_profiling.cc:243] Waited 3.91 ms on lock 0x7b4800080058. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a80cafaa1 00007f6a80ca6b37 00007f6a80ca69ca 00007f6a80d9e26f 00007f6a80d9df37 00007f6a80db255c 00007f6a80db2508 00007f6a80db2488 00007f6a80db2443 00007f6a80db16ec 00007f6a7fcdba96
0709 13:12:42.672034 (+176720us) raft_consensus.cc:1685] finished
0709 13:12:42.672134 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:42.672816 (+   682us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52423,"raft.queue_time_us":71576,"raft.run_cpu_time_us":39875,"raft.run_wall_time_us":1018622,"spinlock_wait_cycles":8985344,"thread_start_us":590230,"threads_started":1,"wal-append.queue_time_us":757518}
I20260709 13:12:42.761657 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:42.469873 29453 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:12:42.680488 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:42.766710 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:12:42.767067 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:42.502631 29456 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45796 (request call id 1139) took 1426 ms (client timeout 1786 ms). Trace:
W20260709 13:12:42.768013 29456 rpcz_store.cc:269] 0709 13:12:41.076488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.077332 (+   844us) service_pool.cc:224] Handling call
0709 13:12:42.493243 (+1415911us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b54003d1dd4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:42.502561 (+  9318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":313707776}
W20260709 13:12:42.527968 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:42.770129 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.771040 29376 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 8.
W20260709 13:12:42.544662 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.530580 29522 raft_consensus.cc:1240] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:42.503875 29527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53428 (request call id 392) took 1497 ms. Trace:
I20260709 13:12:42.793803 29527 rpcz_store.cc:276] 0709 13:12:41.004940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.005096 (+   156us) service_pool.cc:224] Handling call
0709 13:12:41.005467 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:41.073156 (+ 67689us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:41.073216 (+    60us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:41.073261 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:41.073292 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:42.486161 (+1412869us) spinlock_profiling.cc:243] Waited 67.5 ms on lock 0x7b54002328d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:42.501727 (+ 15566us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:42.501875 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":155170048}
W20260709 13:12:42.543555 29526 rpcz_store.cc:269] 0709 13:12:41.117166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.180756 (+ 63590us) service_pool.cc:224] Handling call
0709 13:12:42.493579 (+1312823us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b540006f9d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:42.501679 (+  8100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7668992}
I20260709 13:12:42.541976 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:12:42.708456 32300 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:42.800158 32300 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:42.672998 29373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1086) took 1282 ms. Trace:
I20260709 13:12:42.800961 29373 rpcz_store.cc:276] 0709 13:12:41.397423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.399561 (+  2138us) service_pool.cc:224] Handling call
0709 13:12:41.399977 (+   416us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:41.455266 (+ 55289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:41.455298 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:41.495438 (+ 40140us) log.cc:844] Serialized 52 byte log entry
0709 13:12:42.208590 (+713152us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:42.208641 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:42.208747 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:42.672175 (+463428us) raft_consensus.cc:1685] finished
0709 13:12:42.672217 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:42.672682 (+   465us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":210345,"raft.queue_time_us":56972,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":12801,"thread_start_us":690483,"threads_started":1,"wal-append.queue_time_us":804026}
I20260709 13:12:42.553582 32424 raft_consensus.cc:740] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:42.805428 32424 consensus_queue.cc:260] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:42.621451 32448 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:42.611860 32484 consensus_meta.cc:287] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.700s	user 0.014s	sys 0.009s
I20260709 13:12:42.823267 32484 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:42.600889 32488 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:42.587225 32507 consensus_queue.cc:260] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:42.828173 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.828569 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:42.829346 32507 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:42.599581 32510 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:42.831647 32280 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:42.832017 32510 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:42.832849 32280 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:42.833029 32510 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:42.593695 32517 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:42.595642 32522 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:42.531718 32523 consensus_meta.cc:287] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 1.149s	user 0.010s	sys 0.006s
I20260709 13:12:42.838662 32440 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:42.839807 32440 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:42.839917 32523 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:42.841382 32408 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:42.603650 32530 log.cc:927] Time spent T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 1.451s	user 0.017s	sys 0.023s
I20260709 13:12:42.548923 32531 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:42.561655 32547 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:42.564766 32401 raft_consensus.cc:515] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:42.699080 29372 raft_consensus.cc:1240] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:12:42.727840 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 289839us
W20260709 13:12:42.732543 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 55281.3us
I20260709 13:12:42.737018 32536 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:42.737092 32516 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:42.547952 29530 rpcz_store.cc:269] 0709 13:12:41.118263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.178016 (+ 59753us) service_pool.cc:224] Handling call
0709 13:12:42.485448 (+1307432us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b5400101dd4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:42.508141 (+ 22693us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":505654144}
I20260709 13:12:42.979194 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:42.981357 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:42.982409 29530 raft_consensus.cc:2393] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 8: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:42.981730 32516 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:42.784171 32498 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.984026 29379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1091) took 1556 ms. Trace:
I20260709 13:12:42.984931 32516 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:42.876721 32360 consensus_queue.cc:1059] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.109s
I20260709 13:12:42.785953 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:42.784334 32486 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:42.986531 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:42.987119 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:42.986992 32486 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:42.987978 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:42.988796 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:42.989244 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:42.989605 29525 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
W20260709 13:12:42.786911 29419 connection.cc:256] RPC call timeout handler was delayed by -1.8542570899999191s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1918s for a response
I20260709 13:12:42.990515 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:42.990692 32486 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:42.991008 29419 connection.cc:256] RPC call timeout handler was delayed by -1.8269746210000903s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2034s for a response
I20260709 13:12:42.789511 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:42.991447 29419 connection.cc:256] RPC call timeout handler was delayed by -1.6043895310001517s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1884s for a response
W20260709 13:12:42.991853 29419 connection.cc:256] RPC call timeout handler was delayed by -1.5908895310001299s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1899s for a response
I20260709 13:12:42.791376 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:42.992100 29376 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
I20260709 13:12:42.993443 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:42.993548 32280 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:42.993708 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:42.821645 29448 raft_consensus.cc:1240] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:12:42.830963 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:42.803228 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:42.841661 29378 raft_consensus.cc:1217] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 6.3->[7.4-9.5]   Dedup: 9.5->[]
I20260709 13:12:42.963289 29372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1088) took 1565 ms. Trace:
I20260709 13:12:42.965140 29421 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:42.995306 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:42.990562 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:43.005471 29376 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:12:43.006186 29525 raft_consensus.cc:2410] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:12:43.006336 32560 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:42.995409 29528 raft_consensus.cc:2393] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 9: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:43.006850 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:42.878551 29529 raft_consensus.cc:1240] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:43.007901 29372 rpcz_store.cc:276] 0709 13:12:41.398267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:42.697331 (+1299064us) service_pool.cc:224] Handling call
0709 13:12:42.698257 (+   926us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:42.962831 (+264574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:42.963210 (+   379us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:43.008864 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:42.852308 29524 raft_consensus.cc:1240] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:42.875963 29381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1092) took 1476 ms. Trace:
I20260709 13:12:42.984630 32498 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:42.992205 29419 connection.cc:256] RPC call timeout handler was delayed by -1.5710895310000978s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19210000000000002s for a response
I20260709 13:12:43.009624 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:43.015678 29419 connection.cc:256] RPC call timeout handler was delayed by -1.5377895310002714s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1958s for a response
I20260709 13:12:42.995661 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:42.966897 32536 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:43.007735 29378 raft_consensus.cc:1240] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 9. Current term is 10. Ops: [7.4-9.5]
I20260709 13:12:43.007373 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:42.881799 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.871914 29526 raft_consensus.cc:1240] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:42.873890 29522 raft_consensus.cc:1240] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:42.836494 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:42.874737 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:42.996908 32575 log.cc:927] Time spent T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 13:12:43.009030 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:43.022078 29419 connection.cc:256] RPC call timeout handler was delayed by -1.5195479920000707s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15880000000000002s for a response
I20260709 13:12:43.008869 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:42.995954 29278 catalog_manager.cc:5697] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:42.948231 32424 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:43.026633 29419 connection.cc:256] RPC call timeout handler was delayed by -1.3280895310001597s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2191s for a response
I20260709 13:12:42.854776 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:43.028402 29419 connection.cc:256] RPC call timeout handler was delayed by -1.1872544260002087s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1527s for a response
W20260709 13:12:43.028687 29419 connection.cc:256] RPC call timeout handler was delayed by -1.1831895310001528s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2352s for a response
I20260709 13:12:43.006881 32560 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.882658 32522 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:43.010138 29381 rpcz_store.cc:276] 0709 13:12:41.399378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.401610 (+  2232us) service_pool.cc:224] Handling call
0709 13:12:41.401918 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:41.449176 (+ 47258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:42.852484 (+1403308us) spinlock_profiling.cc:243] Waited 40.6 ms on lock 0x7b54003dd454. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:42.875685 (+ 23201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93403008}
I20260709 13:12:42.836290 32484 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:43.030699 29419 connection.cc:256] RPC call timeout handler was delayed by -1.162054426000168s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1555s for a response
I20260709 13:12:43.021590 29372 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:12:43.031014 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:42.953843 32440 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:42.984540 29379 rpcz_store.cc:276] 0709 13:12:41.399108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:42.708286 (+1309178us) service_pool.cc:224] Handling call
0709 13:12:42.709085 (+   799us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:42.710283 (+  1198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:42.710330 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:42.716985 (+  6655us) log.cc:844] Serialized 52 byte log entry
0709 13:12:42.810466 (+ 93481us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:42.810517 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:42.810609 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:42.955240 (+144631us) raft_consensus.cc:1685] finished
0709 13:12:42.955269 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:42.955485 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26529,"raft.run_cpu_time_us":409,"raft.run_wall_time_us":30355,"thread_start_us":72890,"threads_started":1,"wal-append.queue_time_us":212781}
I20260709 13:12:42.886843 32523 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:43.037406 29377 raft_consensus.cc:1275] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:43.034920 29378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1087) took 1637 ms. Trace:
W20260709 13:12:43.042603 29419 connection.cc:256] RPC call timeout handler was delayed by -1.1269544260001112s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15940000000000001s for a response
I20260709 13:12:43.042075 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:43.033478 29372 raft_consensus.cc:606] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
W20260709 13:12:43.044482 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:42.879719 32517 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:43.039227 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:43.038697 29378 rpcz_store.cc:276] 0709 13:12:41.397806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:42.706688 (+1308882us) service_pool.cc:224] Handling call
0709 13:12:42.841342 (+134654us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:43.022615 (+181273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:43.032897 (+ 10282us) spinlock_profiling.cc:243] Waited 93.8 ms on lock 0x7b54003f3c50. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd858ad 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:43.034823 (+  1926us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":215755648}
W20260709 13:12:43.048197 29419 connection.cc:256] RPC call timeout handler was delayed by -1.02885442600018s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1703s for a response
I20260709 13:12:43.044839 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:43.049371 29530 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 8.
I20260709 13:12:43.032019 32560 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:43.050325 29525 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:43.052193 29376 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 7.
I20260709 13:12:43.048722 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:43.059805 29524 raft_consensus.cc:2410] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:12:42.844193 32408 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:43.061329 29526 raft_consensus.cc:2393] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 12: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:43.060813 29375 raft_consensus.cc:1275] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:43.064800 29528 raft_consensus.cc:2393] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 8: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:43.061411 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:43.068192 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:43.071228 29522 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:12:43.072870 29525 raft_consensus.cc:2393] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 8: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:43.073735 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:43.071671 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:43.074987 29530 raft_consensus.cc:2393] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 8: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:43.074586 29381 raft_consensus.cc:1275] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:12:43.076354 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:43.071254 29346 leader_election.cc:336] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 1.727s (SENT)
I20260709 13:12:43.081287 29380 raft_consensus.cc:1275] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:43.080123 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:43.084872 29421 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:43.080796 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:43.067214 32510 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:43.088081 29377 raft_consensus.cc:1275] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:43.088296 29378 raft_consensus.cc:1275] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:12:43.056207 32522 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:43.099836 29379 raft_consensus.cc:1275] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:43.074574 32517 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:43.127058 32522 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:43.093472 32547 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.097640 32498 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:43.130801 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 46193.2us
I20260709 13:12:43.131778 32486 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:43.132100 29376 raft_consensus.cc:1275] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:12:43.132359 29529 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 10.
I20260709 13:12:43.140251 29526 raft_consensus.cc:3055] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:43.127087 32517 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:43.142262 29521 raft_consensus.cc:1240] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:43.154012 29527 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 8.
I20260709 13:12:43.156623 29530 raft_consensus.cc:1275] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:12:43.201500 29526 raft_consensus.cc:740] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:43.156296 32486 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:43.202417 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:43.198896 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 62802.5us
I20260709 13:12:43.202661 32486 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:43.183887 32448 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:43.186918 32575 log.cc:927] Time spent T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.133s	user 0.002s	sys 0.000s
I20260709 13:12:43.153999 32547 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:43.192695 32485 raft_consensus.cc:3055] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:43.231525 32335 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:43.231858 32531 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:43.232587 32335 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:43.234119 29419 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:43.235129 32335 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:43.165386 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:43.196420 32536 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:43.236056 29524 raft_consensus.cc:1275] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:43.202912 29526 consensus_queue.cc:260] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:43.235730 32448 raft_consensus.cc:2749] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:12:43.237962 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.238394 29421 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:43.239873 29419 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:43.248406 29373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52172 (request call id 1454) took 1036 ms. Trace:
I20260709 13:12:43.248910 29373 rpcz_store.cc:276] 0709 13:12:42.211561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:43.036812 (+825251us) service_pool.cc:224] Handling call
0709 13:12:43.073780 (+ 36968us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:43.184703 (+110923us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:43.184741 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:43.185552 (+   811us) log.cc:844] Serialized 52 byte log entry
0709 13:12:43.225283 (+ 39731us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:43.247843 (+ 22560us) log.cc:844] Serialized 14 byte log entry
0709 13:12:43.248103 (+   260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:43.248178 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:43.248205 (+    27us) raft_consensus.cc:1685] finished
0709 13:12:43.248212 (+     7us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:43.248328 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":162,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":145,"thread_start_us":39174,"threads_started":1,"wal-append.queue_time_us":46025}
I20260709 13:12:43.227658 32485 raft_consensus.cc:740] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:12:43.252337 32568 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:43.252998 32568 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:43.252651 32485 consensus_queue.cc:260] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:43.253567 32568 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:43.254689 32485 raft_consensus.cc:3060] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:43.256176 29529 raft_consensus.cc:1240] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 LEADER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:43.263351 29525 raft_consensus.cc:1275] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:12:43.269308 29278 catalog_manager.cc:5697] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 4 to 5, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132). New cstate: current_term: 5 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:12:43.271302 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:43.288424 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 232558us
I20260709 13:12:43.288189 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:43.288239 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:43.272017 29526 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:43.275760 32580 log.cc:927] Time spent T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.246s	user 0.002s	sys 0.000s
I20260709 13:12:43.276132 32448 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:43.276999 32401 leader_election.cc:290] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:43.279397 32408 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:43.281908 29419 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:43.300954 29374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1089) took 1902 ms. Trace:
I20260709 13:12:43.303817 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:43.304280 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:43.308313 29374 rpcz_store.cc:276] 0709 13:12:41.398565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:42.685657 (+1287092us) service_pool.cc:224] Handling call
0709 13:12:42.686655 (+   998us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:42.721769 (+ 35114us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:12:42.721833 (+    64us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:42.722845 (+  1012us) log.cc:844] Serialized 26 byte log entry
0709 13:12:43.017401 (+294556us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:43.017459 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:43.017574 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:43.300564 (+282990us) raft_consensus.cc:1685] finished
0709 13:12:43.300582 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:43.300746 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":293884,"threads_started":1,"wal-append.queue_time_us":294411}
I20260709 13:12:43.310737 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:43.311291 29528 raft_consensus.cc:2410] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:12:43.311585 29522 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:43.311947 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:43.312388 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:43.312601 29529 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:12:43.312546 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:43.315927 29522 raft_consensus.cc:2410] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:12:43.319264 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:43.322018 29528 raft_consensus.cc:2410] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:12:43.325920 29530 raft_consensus.cc:1240] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:43.330806 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:43.334643 29524 raft_consensus.cc:3055] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:43.334970 29524 raft_consensus.cc:740] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:43.338652 29454 raft_consensus.cc:1217] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Deduplicated request from leader. Original: 7.4->[8.5-8.5]   Dedup: 8.5->[]
I20260709 13:12:43.324004 32397 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:43.343684 29452 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:43.336007 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:43.339293 29454 raft_consensus.cc:1240] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:12:43.336972 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:43.359225 32408 consensus_queue.cc:1059] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:43.359611 32335 consensus_queue.cc:1059] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:43.364552 29523 raft_consensus.cc:1275] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:43.359157 32560 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:43.366632 29524 consensus_queue.cc:260] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:43.368305 29524 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:43.392777 29530 raft_consensus.cc:1240] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:43.367451 32560 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:43.401160 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:43.409765 29526 raft_consensus.cc:1275] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:12:43.413239 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:43.414182 29448 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:43.441622 29448 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:12:43.333341 32568 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:43.448654 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:43.451288 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:43.454095 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 81603.7us
I20260709 13:12:43.462312 29454 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:43.463557 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:43.463799 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:43.464468 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:43.464859 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:43.463037 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 181277us
I20260709 13:12:43.472265 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:43.473450 29451 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
W20260709 13:12:43.475626 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.478718 29419 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:43.479751 32397 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:43.481372 29419 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:43.482291 32397 raft_consensus.cc:2749] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:43.485257 29419 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:43.486572 32397 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:43.461035 32408 raft_consensus.cc:3055] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:43.497936 32408 raft_consensus.cc:740] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:43.502334 29451 raft_consensus.cc:1217] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Deduplicated request from leader. Original: 7.4->[8.5-8.5]   Dedup: 8.5->[]
I20260709 13:12:43.503306 29451 raft_consensus.cc:1240] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:12:43.506443 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:43.507460 29456 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:12:43.513285 29452 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
I20260709 13:12:43.515642 29524 raft_consensus.cc:1275] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:43.526715 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:43.532313 32586 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.496995 32486 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:43.522887 32589 consensus_queue.cc:1059] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:12:43.570739 29419 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:43.577090 29456 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
W20260709 13:12:43.582490 29276 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37594 (request call id 135) took 12280 ms (client timeout 15000 ms). Trace:
I20260709 13:12:43.582654 32486 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:43.587707 29452 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:43.499069 32408 consensus_queue.cc:260] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:43.589267 29454 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:12:43.583866 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:43.552110 32335 consensus_queue.cc:1059] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:12:43.591390 29344 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:43.586138 32448 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:43.605636 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:43.592654 32486 raft_consensus.cc:2749] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:43.599469 29453 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
W20260709 13:12:43.583199 29276 rpcz_store.cc:269] 0709 13:12:31.291558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:31.291791 (+   233us) service_pool.cc:224] Handling call
0709 13:12:43.526179 (+12234388us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:40.669960 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:40.670577 (+   617us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:40.670617 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:12:40.670641 (+    24us) tablet.cc:662] Decoding operations
0709 13:12:40.671617 (+   976us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:40.671738 (+   121us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:40.671767 (+    29us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:12:40.727588 (+ 55821us) tablet.cc:701] Row locks acquired
0709 13:12:40.727628 (+    40us) write_op.cc:260] PREPARE: finished
0709 13:12:40.727870 (+   242us) write_op.cc:270] Start()
0709 13:12:40.728063 (+   193us) write_op.cc:276] Timestamp: P: 1783602760727794 usec, L: 0
0709 13:12:40.728097 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:12:40.763057 (+ 34960us) log.cc:844] Serialized 3281 byte log entry
0709 13:12:41.309743 (+546686us) op_driver.cc:464] REPLICATION: finished
0709 13:12:41.815661 (+505918us) write_op.cc:301] APPLY: starting
0709 13:12:41.825841 (+ 10180us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:41.875092 (+ 49251us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:41.875269 (+   177us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:41.876575 (+  1306us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:41.876838 (+   263us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:12:41.876888 (+    50us) write_op.cc:312] APPLY: finished
0709 13:12:41.877215 (+   327us) log.cc:844] Serialized 64 byte log entry
0709 13:12:41.884567 (+  7352us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:41.884774 (+   207us) write_op.cc:454] Released schema lock
0709 13:12:41.884849 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:41.885336 (+   487us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:41.885367 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":807558,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":369506,"apply.run_cpu_time_us":3876,"apply.run_wall_time_us":89869,"num_ops":8,"prepare.queue_time_us":194964,"prepare.run_cpu_time_us":23183,"prepare.run_wall_time_us":149003,"raft.queue_time_us":196583,"raft.run_cpu_time_us":26850,"raft.run_wall_time_us":320401,"replication_time_us":481921,"thread_start_us":460447,"threads_started":4,"wal-append.queue_time_us":184419,"wal-append.run_cpu_time_us":13216,"wal-append.run_wall_time_us":1931326}]]}
I20260709 13:12:43.578007 32586 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:43.633064 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:43.627746 32408 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:43.635229 29453 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
W20260709 13:12:43.635633 30119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.622303 32424 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.637152 32424 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:43.630973 29454 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
I20260709 13:12:43.631840 32589 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:43.657438 29454 raft_consensus.cc:1240] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 10. Current term is 11. Ops: []
W20260709 13:12:43.660468 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 69194.1us
I20260709 13:12:43.641659 32424 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:43.639468 32590 raft_consensus.cc:3055] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:43.665504 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:43.656035 32568 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:43.659595 32589 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.651361 32335 consensus_queue.cc:1243] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer 71aa3578fd924765ab9ac0729c8d1483 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:12:43.696334 29452 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
W20260709 13:12:43.699872 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.665601 32590 raft_consensus.cc:740] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:43.679244 32589 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:43.702085 32590 consensus_queue.cc:260] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:43.703962 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:43.704897 32507 consensus_queue.cc:1059] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:43.705950 32592 raft_consensus.cc:3055] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:43.705708 32486 consensus_queue.cc:1048] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:43.706447 32407 tablet_bootstrap.cc:492] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:43.706583 29454 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
I20260709 13:12:43.704890 29453 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:43.707995 32586 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:43.721424 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:43.724540 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.706970 29495 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:12:43.678820 32587 raft_consensus.cc:3055] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:43.717656 32507 raft_consensus.cc:3055] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:43.714638 32592 raft_consensus.cc:740] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:43.738595 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:43.744433 29454 raft_consensus.cc:2393] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 8: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:43.726176 32407 tablet_bootstrap.cc:492] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap complete.
I20260709 13:12:43.746317 32407 ts_tablet_manager.cc:1403] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent bootstrapping tablet: real 1.287s	user 0.056s	sys 0.035s
I20260709 13:12:43.741804 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:43.714706 32547 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:43.734499 32587 raft_consensus.cc:740] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:43.742993 32507 raft_consensus.cc:740] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:43.768514 29421 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:43.751252 32424 raft_consensus.cc:2764] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:12:43.775278 29452 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:12:43.777870 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:12:43.777982 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 71168.3us
I20260709 13:12:43.786324 32590 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:43.787339 32589 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:43.789969 32589 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:43.780604 32486 raft_consensus.cc:2764] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:12:43.797580 29453 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
I20260709 13:12:43.799649 32587 consensus_queue.cc:260] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:43.800105 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:43.800974 32587 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:43.801048 32547 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:43.801188 29452 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:12:43.802145 32507 consensus_queue.cc:260] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:43.778154 32592 consensus_queue.cc:260] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:43.811043 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:43.811668 32592 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:43.812003 29453 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
W20260709 13:12:43.814793 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.816721 32586 consensus_queue.cc:1059] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:43.817203 32598 consensus_queue.cc:1059] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:43.808386 32507 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:43.818954 32598 consensus_queue.cc:1243] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer 71aa3578fd924765ab9ac0729c8d1483 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:12:43.819589 32598 raft_consensus.cc:3055] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:43.820027 32598 raft_consensus.cc:740] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:43.819702 32547 consensus_queue.cc:1048] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:43.821049 32598 consensus_queue.cc:260] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:43.818734 32586 raft_consensus.cc:3055] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:43.822338 32586 raft_consensus.cc:740] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:43.823114 32598 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:43.823622 29344 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:43.823758 32586 consensus_queue.cc:260] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:43.824239 32335 consensus_queue.cc:1048] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:12:43.827391 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.828888 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:43.829157 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:43.829470 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:43.829752 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:43.830128 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:43.830452 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:43.831061 32547 consensus_queue.cc:1048] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:43.831533 32486 consensus_queue.cc:1048] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:43.832409 32560 consensus_queue.cc:1048] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:43.832770 32448 consensus_queue.cc:1048] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:43.832808 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:43.864619 29376 raft_consensus.cc:2393] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 8: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:43.836711 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:43.865491 29379 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:43.865542 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:43.866945 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:43.836908 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:43.868171 29372 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:43.837941 29495 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:43.872959 32603 log.cc:927] Time spent T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:12:43.842077 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 324532us
I20260709 13:12:43.878141 29419 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:43.846807 29373 raft_consensus.cc:2393] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 8: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:43.879072 32448 consensus_queue.cc:1048] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:43.882007 32560 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:43.846987 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:43.882921 29380 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:43.883937 32424 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:43.884415 32424 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.884806 32424 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:43.850561 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:43.890525 29452 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
W20260709 13:12:43.852558 32604 log.cc:927] Time spent T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:12:43.852766 29344 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:43.854684 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:43.856439 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:43.856357 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:43.857713 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:43.895936 29378 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:43.857781 32586 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:43.894834 29377 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 12.
W20260709 13:12:43.859910 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.894687 29374 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 8.
I20260709 13:12:43.858600 32335 raft_consensus.cc:2804] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:12:43.899971 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 47345.9us
I20260709 13:12:43.901595 29380 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 8.
I20260709 13:12:43.899910 32335 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:43.906225 32408 raft_consensus.cc:2804] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:43.919994 32335 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:43.920033 32408 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:43.920732 32408 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:43.918502 29372 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 10.
I20260709 13:12:43.799670 32407 raft_consensus.cc:359] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:12:43.928092 32407 raft_consensus.cc:740] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Initialized, Role: LEARNER
I20260709 13:12:43.932214 32599 consensus_queue.cc:1059] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:43.933043 32597 consensus_queue.cc:1059] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:43.934360 32597 raft_consensus.cc:3055] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:43.934775 32597 raft_consensus.cc:740] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:43.934844 32589 raft_consensus.cc:3055] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:43.935357 32589 raft_consensus.cc:740] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:43.936501 32589 consensus_queue.cc:260] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:43.938166 32589 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:43.915616 29419 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:43.940958 32597 consensus_queue.cc:260] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:43.942577 32597 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:43.943055 29419 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:43.939157 29495 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:43.947715 29379 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
I20260709 13:12:43.949409 32547 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:43.949944 32547 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:12:43.950910 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.950346 32547 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:43.956005 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:43.949568 32486 consensus_queue.cc:1048] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:12:43.959316 32507 raft_consensus.cc:2749] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:43.929001 32407 consensus_queue.cc:260] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:12:43.969276 32407 ts_tablet_manager.cc:1434] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent starting tablet: real 0.222s	user 0.010s	sys 0.002s
W20260709 13:12:43.969858 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.974154 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:43.974794 29376 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:43.972514 32397 raft_consensus.cc:2804] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:43.973486 29391 tablet_copy_service.cc:342] P 429e58eb058349e3bf72b5a870c8f6e5: Request end of tablet copy session ca041dab9b2f44409ed7bf4c6cf66ab2-95122b0f733946aba19edf1d98467467 received from {username='slave'} at 127.0.0.1:58422
I20260709 13:12:43.977075 29344 leader_election.cc:400] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Vote denied by peer ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671) with higher term. Message: Invalid argument: T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 6. Current term is 7.
W20260709 13:12:43.979961 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 60483.9us
I20260709 13:12:43.983081 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:43.983698 29344 leader_election.cc:403] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:43.983826 29373 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:43.988389 32507 consensus_queue.cc:1059] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:43.990442 32587 raft_consensus.cc:2749] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671) with higher term. Message: Invalid argument: T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 6. Current term is 7.
I20260709 13:12:43.991580 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:43.992367 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:43.994172 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:43.995720 29419 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:43.995937 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:43.982610 29391 tablet_copy_service.cc:434] P 429e58eb058349e3bf72b5a870c8f6e5: ending tablet copy session ca041dab9b2f44409ed7bf4c6cf66ab2-95122b0f733946aba19edf1d98467467 on tablet 95122b0f733946aba19edf1d98467467 with peer ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:43.996649 32486 raft_consensus.cc:2764] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:12:43.997961 32486 consensus_queue.cc:1048] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:43.999413 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:44.001566 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:43.954965 32408 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:43.988749 29344 consensus_peers.cc:597] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 -> Peer ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671): Couldn't send request to peer ca041dab9b2f44409ed7bf4c6cf66ab2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 829dc08ee0ca4212a3b2c870b0ea1b35. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:44.008330 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:43.982748 32397 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:44.013470 29524 raft_consensus.cc:1275] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:12:44.016511 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:44.018164 30119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.018788 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:44.020965 29378 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:12:44.021271 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:44.022358 29524 raft_consensus.cc:2410] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:12:44.024717 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.022378 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:44.025743 29375 raft_consensus.cc:2393] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 8: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:44.022646 32424 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:44.028714 32424 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:44.029942 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:44.016937 29377 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
I20260709 13:12:44.033640 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:44.036432 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.037230 29524 raft_consensus.cc:1240] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 9. Current term is 10. Ops: []
W20260709 13:12:44.039465 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.039796 29419 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:44.041683 29419 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:44.042611 32595 raft_consensus.cc:2749] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:44.043335 32595 raft_consensus.cc:2764] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:12:44.050730 32547 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:44.055626 32397 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:44.034269 32335 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:44.072734 32547 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:44.088554 29374 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
I20260709 13:12:44.043191 29419 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:44.095726 32397 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:44.096326 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 53251.8us
W20260709 13:12:44.097339 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.097716 32547 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:44.066968 32335 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:44.097178 29419 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:44.080030 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:44.082168 32408 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:44.099166 29524 raft_consensus.cc:2410] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:12:44.104278 29529 raft_consensus.cc:1240] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 3. Current term is 4. Ops: []
W20260709 13:12:44.105010 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.105871 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:44.115525 29525 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:44.116712 32547 raft_consensus.cc:2804] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:44.117161 32547 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:44.117559 32547 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:44.106606 29527 raft_consensus.cc:1240] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:44.122177 29419 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:44.122862 32407 ts_tablet_manager.cc:933] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2: Initiating tablet copy from peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127)
I20260709 13:12:44.129616 29525 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:12:44.133170 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:44.141500 29527 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:44.134815 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:44.136587 32408 consensus_queue.cc:1048] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:44.140154 32397 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:44.148046 29524 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:44.161772 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 173822us
W20260709 13:12:44.173233 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.176151 29527 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
W20260709 13:12:44.177595 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.177503 29344 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:44.180389 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 58314.4us
I20260709 13:12:44.181445 29344 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:44.183065 29376 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:12:44.185734 29379 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
I20260709 13:12:44.187366 29373 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
I20260709 13:12:44.190233 32547 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:44.191891 32597 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:44.192590 32590 raft_consensus.cc:2804] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:44.193346 32590 raft_consensus.cc:697] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:44.191152 29495 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:44.194380 32590 consensus_queue.cc:237] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:44.194876 29495 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:44.192634 32547 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:44.205737 32614 raft_consensus.cc:2764] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:12:44.206981 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.172335 32486 raft_consensus.cc:2749] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:44.206895 32614 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:12:44.209770 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.202919 32597 raft_consensus.cc:697] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:12:44.222018 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.222905 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:44.223214 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:44.213095 29376 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:12:44.241456 29376 raft_consensus.cc:606] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:12:44.242419 29376 raft_consensus.cc:614] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:44.255369 29524 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
W20260709 13:12:44.258865 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 49104.3us
I20260709 13:12:44.217273 32614 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.264106 29419 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:44.264096 29278 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35182 (request call id 63) took 2776 ms. Trace:
I20260709 13:12:44.269074 29421 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:12:44.268451 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 63176.4us
I20260709 13:12:44.270093 32397 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:44.282186 29421 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:44.266016 32614 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:44.267733 29278 rpcz_store.cc:276] 0709 13:12:41.486370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:41.496944 (+ 10574us) service_pool.cc:224] Handling call
0709 13:12:44.262760 (+2765816us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:43.502481 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:43.503173 (+   692us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:43.503239 (+    66us) write_op.cc:435] Acquired schema lock
0709 13:12:43.503283 (+    44us) tablet.cc:662] Decoding operations
0709 13:12:43.503898 (+   615us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:43.503979 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:43.504011 (+    32us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:12:43.504511 (+   500us) tablet.cc:701] Row locks acquired
0709 13:12:43.504560 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:12:43.504745 (+   185us) write_op.cc:270] Start()
0709 13:12:43.504912 (+   167us) write_op.cc:276] Timestamp: P: 1783602763504675 usec, L: 0
0709 13:12:43.504934 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:12:43.505800 (+   866us) log.cc:844] Serialized 924 byte log entry
0709 13:12:43.718261 (+212461us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a78c7c0ac 00007f6a81ad6ab9 00007f6a78c9869b 00007f6a78c9693f 00007f6a78c98c02 00007f6a7b92020b
0709 13:12:43.987548 (+269287us) op_driver.cc:464] REPLICATION: finished
0709 13:12:44.213166 (+225618us) write_op.cc:301] APPLY: starting
0709 13:12:44.213286 (+   120us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:44.213445 (+   159us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:44.213481 (+    36us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:44.213960 (+   479us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:44.214256 (+   296us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:12:44.214308 (+    52us) write_op.cc:312] APPLY: finished
0709 13:12:44.214613 (+   305us) log.cc:844] Serialized 28 byte log entry
0709 13:12:44.214816 (+   203us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:44.214920 (+   104us) write_op.cc:454] Released schema lock
0709 13:12:44.214991 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:44.215443 (+   452us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:44.215470 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":217647,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":225273,"apply.run_cpu_time_us":2281,"apply.run_wall_time_us":2283,"num_ops":2,"prepare.queue_time_us":122355,"prepare.run_cpu_time_us":40672,"prepare.run_wall_time_us":276707,"raft.queue_time_us":36905,"raft.run_cpu_time_us":78637,"raft.run_wall_time_us":183929,"replication_time_us":482395,"spinlock_wait_cycles":40728448,"thread_start_us":498331,"threads_started":4,"wal-append.queue_time_us":285805}]]}
I20260709 13:12:44.285609 32397 raft_consensus.cc:2764] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:12:44.293041 32486 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:44.306257 32486 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.306629 32486 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:44.308034 29419 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:44.309710 29419 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:44.310561 32547 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:44.223306 32597 consensus_queue.cc:237] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:44.312062 29419 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:44.292733 29421 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:44.311375 32547 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:44.314703 29421 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:44.302632 32424 raft_consensus.cc:3055] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:44.315667 32424 raft_consensus.cc:740] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:44.316705 32424 consensus_queue.cc:260] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:44.317404 29379 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:12:44.318075 29379 raft_consensus.cc:606] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:12:44.318125 32424 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:44.319068 29344 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:44.320401 29419 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:44.321417 32586 raft_consensus.cc:2804] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:44.321574 29379 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "71aa3578fd924765ab9ac0729c8d1483"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:12:44.321797 29419 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:44.321995 32586 raft_consensus.cc:697] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:44.322935 32586 consensus_queue.cc:237] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:44.323892 32595 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:44.266196 32407 tablet_copy_client.cc:323] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Beginning tablet copy session from remote peer at address 127.27.146.129:42127
I20260709 13:12:44.315689 32401 consensus_queue.cc:1048] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:12:44.323926 32335 raft_consensus.cc:2955] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:12:44.337647 32614 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:44.340536 29391 tablet_copy_service.cc:140] P 429e58eb058349e3bf72b5a870c8f6e5: Received BeginTabletCopySession request for tablet 829dc08ee0ca4212a3b2c870b0ea1b35 from peer ca041dab9b2f44409ed7bf4c6cf66ab2 ({username='slave'} at 127.0.0.1:58422)
I20260709 13:12:44.341275 29391 tablet_copy_service.cc:161] P 429e58eb058349e3bf72b5a870c8f6e5: Beginning new tablet copy session on tablet 829dc08ee0ca4212a3b2c870b0ea1b35 from peer ca041dab9b2f44409ed7bf4c6cf66ab2 at {username='slave'} at 127.0.0.1:58422: session id = ca041dab9b2f44409ed7bf4c6cf66ab2-829dc08ee0ca4212a3b2c870b0ea1b35
I20260709 13:12:44.341446 29419 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:44.340806 29523 raft_consensus.cc:2955] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:12:44.311076 29279 catalog_manager.cc:5697] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 4 to 7, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 7 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:44.344558 32507 consensus_queue.cc:1048] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:44.345570 29279 catalog_manager.cc:5697] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 5 to 7, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 7 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:44.349596 29279 catalog_manager.cc:5697] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 9 to 10, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 10 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:44.358440 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 43710.2us
I20260709 13:12:44.359699 29495 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:44.360606 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.348891 32560 raft_consensus.cc:2749] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:44.364975 29495 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:44.362725 29279 catalog_manager.cc:5697] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:44.353505 32568 raft_consensus.cc:2804] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:44.350486 32595 raft_consensus.cc:697] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 8 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:44.358875 32448 raft_consensus.cc:2749] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:44.369174 29379 raft_consensus.cc:606] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Received request to transfer leadership to TS 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:44.361632 32397 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:44.369670 29495 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:44.370625 29379 raft_consensus.cc:614] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:44.358839 32547 raft_consensus.cc:2804] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:44.369786 29279 catalog_manager.cc:5697] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 6 to 7, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 7 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:44.366983 32401 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:44.375620 29381 raft_consensus.cc:1240] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:12:44.369174 32618 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:44.366863 32568 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:44.373149 32547 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:44.391547 29524 raft_consensus.cc:1240] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:44.391832 32547 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:44.379913 32401 raft_consensus.cc:697] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:44.392671 32486 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:44.393129 32401 consensus_queue.cc:237] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:44.395128 32590 consensus_queue.cc:1059] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:44.399133 32590 raft_consensus.cc:3055] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:44.398181 32568 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:44.382090 29279 catalog_manager.cc:5697] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 4 to 5, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 5 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:44.376791 29495 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:44.391270 32613 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.408327 29421 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:12:44.409679 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.410419 32448 raft_consensus.cc:2804] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:44.410919 32448 raft_consensus.cc:697] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 6 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:44.410949 29421 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:44.412036 32448 consensus_queue.cc:237] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:44.420513 30119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.377398 32397 raft_consensus.cc:697] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 10 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:44.425336 29279 catalog_manager.cc:5697] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:44.401162 32614 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:44.407989 32590 raft_consensus.cc:740] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:44.431393 32617 raft_consensus.cc:2804] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:44.431700 29279 catalog_manager.cc:5697] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 7 to 8, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 8 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:44.433612 29279 catalog_manager.cc:5697] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 5 to 8, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 8 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:44.431468 30121 leader_election.cc:336] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 1.543s (SENT)
W20260709 13:12:44.436556 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.436002 29279 catalog_manager.cc:5697] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 5 to 9, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 9 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:44.436789 32595 consensus_queue.cc:237] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:44.437222 32486 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:44.438066 29279 catalog_manager.cc:5697] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 5 to 6, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 6 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:44.442250 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.442128 32617 raft_consensus.cc:697] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:44.441957 29279 catalog_manager.cc:5697] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 5 to 7, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 7 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:44.445034 32617 consensus_queue.cc:237] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:44.446014 29279 catalog_manager.cc:5697] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 7 to 8, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 8 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:44.466274 29381 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:12:44.486795 29381 raft_consensus.cc:606] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:12:44.487357 29381 raft_consensus.cc:614] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:44.465827 32494 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:44.488336 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 77490.8us
I20260709 13:12:44.449821 32618 raft_consensus.cc:697] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:44.416544 32613 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:44.485036 29279 catalog_manager.cc:5697] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:44.492550 32486 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:44.489765 32614 raft_consensus.cc:2804] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:44.509701 29279 catalog_manager.cc:5697] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 7 to 8, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 8 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:44.511444 32618 consensus_queue.cc:237] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:44.511873 29279 catalog_manager.cc:5697] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:44.514142 29279 catalog_manager.cc:5697] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 7 to 8, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 8 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:44.516448 29279 catalog_manager.cc:5697] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 7 to 8, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 8 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:44.518005 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.518849 29279 catalog_manager.cc:5697] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:44.510530 32613 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:44.520300 29279 catalog_manager.cc:5697] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 4 to 11, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 11 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:44.521926 29279 catalog_manager.cc:5697] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 6 to 7, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 7 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:44.523787 29279 catalog_manager.cc:5697] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 7 to 8, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 8 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:44.525344 29279 catalog_manager.cc:5697] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:44.492655 32494 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:44.527064 29279 catalog_manager.cc:5697] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:44.528774 29279 catalog_manager.cc:5697] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 2 to 9, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 9 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:44.529848 32494 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:44.531651 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:44.532574 29523 raft_consensus.cc:2468] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 4.
W20260709 13:12:44.554605 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.534369 30119 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:12:44.592033 28234 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:12:44.601791 32568 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:12:44.535961 32486 raft_consensus.cc:697] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:44.607781 32486 consensus_queue.cc:237] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:44.612212 32547 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:44.618221 32621 log.cc:927] Time spent T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:12:44.559449 32614 raft_consensus.cc:697] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:44.621284 32568 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:44.621707 32614 consensus_queue.cc:237] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:44.507686 32397 consensus_queue.cc:237] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:44.629020 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:44.629916 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 288529us
I20260709 13:12:44.631119 29419 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:44.595368 28234 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:12:44.630357 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.615355 32547 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:44.643606 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 268238us
I20260709 13:12:44.568486 32494 raft_consensus.cc:2804] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:12:44.644696 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.646663 29495 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:44.664140 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 170300us
I20260709 13:12:44.664422 32644 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:44.506732 32590 consensus_queue.cc:260] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:44.658365 32494 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.676610 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:44.680792 29373 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:44.678766 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:44.682763 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:44.685966 29495 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:44.682760 32335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:58412 (request call id 5) took 4639 ms. Trace:
I20260709 13:12:44.687305 29495 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:44.695986 29373 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:12:44.698462 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:44.674738 32617 raft_consensus.cc:2804] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:44.696888 32424 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:44.687999 32335 rpcz_store.cc:276] 0709 13:12:40.043524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:40.045076 (+  1552us) service_pool.cc:224] Handling call
0709 13:12:40.139580 (+ 94504us) log.cc:844] Serialized 513 byte log entry
0709 13:12:41.214240 (+1074660us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b180004f540. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c13c0a 00007f6a82353219 00007f6a78c9ba40 00007f6a78c964e4 00007f6a78c96455 00007f6a7bcdfb0b 00007f6a7bd64b63 00007f6a7bd8c752 00007f6a80d4cd29
0709 13:12:41.506077 (+291837us) spinlock_profiling.cc:243] Waited 3.39 ms on lock 0x7b180004f540. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c993f3 00007f6a78c9b7c1 00007f6a78c9b779 00007f6a78c9b709 00007f6a78c9b6d1 00007f6a78c9a9cd 000000000038f354 000000000038f199 00007f6a78c7c83a
0709 13:12:42.224986 (+718909us) spinlock_profiling.cc:243] Waited 2.95 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:12:44.677963 (+2452977us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":883992,"raft.queue_time_us":825459,"raft.run_cpu_time_us":2218,"raft.run_wall_time_us":55320,"spinlock_wait_cycles":19655424,"thread_start_us":228211,"threads_started":1,"wal-append.queue_time_us":345477,"wal-append.run_cpu_time_us":16585,"wal-append.run_wall_time_us":2975934}
I20260709 13:12:44.681614 32494 raft_consensus.cc:3060] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:44.703956 29421 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:44.674654 32645 consensus_queue.cc:1059] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:12:44.707073 30158 raft_consensus.cc:1217] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 LEARNER]: Deduplicated request from leader. Original: 5.3->[5.4-5.4]   Dedup: 5.4->[]
W20260709 13:12:44.718532 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.711045 32590 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:44.710094 32424 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:44.724270 32401 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:44.756343 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 125373us
I20260709 13:12:44.725554 32617 raft_consensus.cc:697] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:44.723845 32627 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:44.759133 29495 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:44.743124 32424 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:44.769248 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:44.773617 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 55571.1us
I20260709 13:12:44.760320 32645 consensus_queue.cc:1243] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer 429e58eb058349e3bf72b5a870c8f6e5 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:12:44.762243 32397 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:44.742759 32633 consensus_queue.cc:1048] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
W20260709 13:12:44.801695 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 47779.4us
W20260709 13:12:44.817444 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.760485 32401 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:44.824005 32635 log.cc:927] Time spent T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:12:44.773356 32627 raft_consensus.cc:697] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 10 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
W20260709 13:12:44.922102 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 210702us
I20260709 13:12:44.863884 32617 consensus_queue.cc:237] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:44.945797 32560 raft_consensus.cc:3055] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:44.772626 32614 raft_consensus.cc:2804] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:12:44.952450 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 178262us
I20260709 13:12:44.954334 32494 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:12:44.960911 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:44.960736 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:44.994529 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.963318 29524 raft_consensus.cc:1275] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:12:44.987249 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.014382 29381 raft_consensus.cc:1240] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:45.015906 29419 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:45.030316 30119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:44.960423 32397 raft_consensus.cc:697] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:44.984200 32560 raft_consensus.cc:740] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
W20260709 13:12:45.045680 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.004766 32614 raft_consensus.cc:697] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:45.049876 29419 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:12:45.033537 32625 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.019s	sys 0.019s
W20260709 13:12:45.064867 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.033973 32649 raft_consensus.cc:2749] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:45.065085 32335 consensus_queue.cc:1048] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:12:45.084525 29419 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:45.085801 32632 raft_consensus.cc:2749] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:12:45.112457 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.086601 32661 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.107039 32595 raft_consensus.cc:2749] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:12:45.129837 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 45889.3us
I20260709 13:12:45.082170 32424 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:45.083290 32401 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:45.080484 32627 consensus_queue.cc:237] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:45.085158 32397 consensus_queue.cc:237] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:45.118474 29419 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:45.117842 32614 consensus_queue.cc:237] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:45.077399 32625 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.019s	sys 0.019s
I20260709 13:12:45.122786 32626 consensus_queue.cc:1059] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:12:45.081938 32560 consensus_queue.cc:260] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:45.141489 29495 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:12:45.132678 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:45.140748 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 143930us
I20260709 13:12:45.149210 29529 raft_consensus.cc:1275] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:12:45.155324 29346 leader_election.cc:336] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 1.547s (SENT)
I20260709 13:12:45.157445 29346 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:45.130903 32661 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:45.162945 29419 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:45.146857 32486 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:45.154304 32424 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:45.175222 32672 raft_consensus.cc:3055] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:45.175591 29495 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:45.175882 32672 raft_consensus.cc:740] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:45.177341 32494 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 5 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:45.177134 32672 consensus_queue.cc:260] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:45.177671 29495 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:45.178601 32672 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:45.179030 29495 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:45.180742 32424 raft_consensus.cc:2749] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:45.181658 32670 raft_consensus.cc:2804] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:45.165969 32560 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:45.156632 32632 consensus_queue.cc:1059] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:12:45.169127 32669 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:45.201429 32547 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:45.202553 32547 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:45.204914 32547 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:45.191435 32626 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.207583 32632 consensus_queue.cc:1243] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer 429e58eb058349e3bf72b5a870c8f6e5 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:12:45.206663 32661 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:45.242632 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 73191.7us
I20260709 13:12:45.208272 32670 raft_consensus.cc:697] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
W20260709 13:12:45.268931 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 108100us
W20260709 13:12:45.270226 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.290496 29452 raft_consensus.cc:1240] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:45.261652 32668 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.282066 32626 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:45.292227 29391 tablet_copy_source_session.cc:215] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:45.292120 32668 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:45.294164 32626 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:45.210538 32424 raft_consensus.cc:2804] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:12:45.258083 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 46420.9us
I20260709 13:12:45.193361 32649 raft_consensus.cc:2749] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:45.294552 32668 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:45.296538 32424 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:45.314556 29495 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:45.318389 29453 raft_consensus.cc:1240] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:45.320536 29495 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:45.316666 32424 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:45.323304 29495 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:12:45.323562 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 168280us
W20260709 13:12:45.324189 29346 leader_election.cc:336] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 1.552s (SENT)
I20260709 13:12:45.324447 29346 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:45.320176 32626 raft_consensus.cc:2804] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:45.328955 29453 raft_consensus.cc:1240] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:45.294615 32670 consensus_queue.cc:237] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:45.338518 29495 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:45.342613 29495 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:45.348475 32678 raft_consensus.cc:2804] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:45.349422 32678 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:45.350000 32678 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:45.332449 32669 raft_consensus.cc:2804] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:45.331841 32626 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:45.356590 29453 raft_consensus.cc:1240] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:45.365963 29453 raft_consensus.cc:1240] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:45.356467 32401 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:45.359004 32669 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:45.369994 32669 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:45.373657 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.362339 32626 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:45.378912 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 90531.3us
I20260709 13:12:45.355420 32666 raft_consensus.cc:2749] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:45.399060 32627 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:12:45.412030 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.416112 29453 raft_consensus.cc:1240] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 7. Current term is 8. Ops: []
W20260709 13:12:45.417891 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 93712.4us
W20260709 13:12:45.418285 32679 log.cc:927] Time spent T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:12:45.419973 29453 raft_consensus.cc:1240] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:45.421964 29381 raft_consensus.cc:1275] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:12:45.427336 29376 raft_consensus.cc:1275] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:12:45.376036 32401 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:45.378978 32649 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:45.355538 32617 consensus_queue.cc:1059] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:12:45.446419 29373 raft_consensus.cc:1275] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:12:45.446849 29453 raft_consensus.cc:1240] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:45.446017 32547 consensus_queue.cc:1048] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:12:45.456310 32424 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:45.459550 29452 raft_consensus.cc:1240] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:45.472075 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:45.473098 29456 raft_consensus.cc:2410] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:12:45.460318 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.414346 32668 consensus_queue.cc:1048] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:12:45.462764 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:45.475147 29454 raft_consensus.cc:2410] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:12:45.468037 32617 raft_consensus.cc:3055] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:45.476115 32617 raft_consensus.cc:740] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:45.443328 32401 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:45.477150 32617 consensus_queue.cc:260] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:45.478595 32617 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:45.478834 32424 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:45.451292 32680 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:45.480374 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:45.483342 29450 raft_consensus.cc:2410] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 13:12:45.464699 32681 log.cc:927] Time spent T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:12:45.486634 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:45.468017 32407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 829dc08ee0ca4212a3b2c870b0ea1b35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:45.468394 32678 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:45.468816 29346 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 1.828s (SENT) [suppressed 33 similar messages]
I20260709 13:12:45.472136 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:12:45.493947 29346 leader_election.cc:336] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 1.869s (SENT)
I20260709 13:12:45.494314 29448 raft_consensus.cc:2410] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:12:45.469906 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 62410.6us
I20260709 13:12:45.470788 32649 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:45.467581 29453 raft_consensus.cc:1240] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:45.465942 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:45.491554 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:45.494576 29346 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:45.506109 32678 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:45.516369 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.517745 29450 raft_consensus.cc:2393] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 9: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:12:45.521723 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.522224 29529 raft_consensus.cc:1275] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:45.526327 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:45.527813 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:45.528218 32649 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:45.531677 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:45.532568 29523 raft_consensus.cc:3060] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:45.534643 29527 raft_consensus.cc:1240] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:45.537101 32587 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:12:45.539067 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 196567us
W20260709 13:12:45.540717 30119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:45.541452 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 47563.1us
W20260709 13:12:45.542374 29346 leader_election.cc:336] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 1.889s (SENT)
I20260709 13:12:45.543206 29346 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:45.560526 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.568385 29523 raft_consensus.cc:2468] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 5.
W20260709 13:12:45.573117 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.557433 29495 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:45.539268 32680 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.582574 29530 raft_consensus.cc:1240] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:45.582913 29495 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:45.587816 30119 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:12:45.591928 29495 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:45.593571 32424 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:45.597687 32656 raft_consensus.cc:2804] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:45.598229 32629 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:45.598574 32335 raft_consensus.cc:2749] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:45.598928 32629 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:45.533565 32669 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:12:45.599577 32629 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:45.599452 32590 consensus_queue.cc:1059] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:12:45.603977 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:45.609375 29454 raft_consensus.cc:2368] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 6. Current term is 7.
I20260709 13:12:45.621019 32613 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:45.586756 32680 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:45.621759 32613 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:45.625463 32613 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:45.635929 32643 raft_consensus.cc:3055] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:45.636701 32643 raft_consensus.cc:740] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:45.637940 32643 consensus_queue.cc:260] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:45.605583 32676 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:45.605960 32669 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:45.649454 32676 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:45.653469 32676 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:45.654271 32671 consensus_queue.cc:1048] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
W20260709 13:12:45.682436 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 90586us
I20260709 13:12:45.683665 29495 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:45.685267 29495 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:12:45.694607 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 56873.3us
W20260709 13:12:45.702744 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:45.722730 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.731057 29453 raft_consensus.cc:1275] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:12:45.745383 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:45.678339 32656 raft_consensus.cc:697] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:12:45.809098 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:45.809826 29454 raft_consensus.cc:2468] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
I20260709 13:12:45.751518 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:45.800519 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:12:45.749467 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.812315 29450 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:45.756619 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.802985 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:45.800364 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:45.813234 29452 raft_consensus.cc:1275] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:12:45.814653 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 272314us
W20260709 13:12:45.818890 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.747614 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:12:45.745554 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 49264.8us
I20260709 13:12:45.704974 32613 raft_consensus.cc:2804] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:45.800705 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:45.680778 32643 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:45.730844 32586 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:45.845790 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.847412 29454 raft_consensus.cc:1240] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 10 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:12:45.848219 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.848798 32682 consensus_queue.cc:1059] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 10.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:45.852774 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:45.853528 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:45.702235 32670 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:45.865097 29451 raft_consensus.cc:2410] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:12:45.865712 29456 raft_consensus.cc:2410] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:12:45.825014 32632 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.866524 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:45.866021 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:45.829154 32424 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:12:45.869251 29346 leader_election.cc:336] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 1.944s (SENT)
I20260709 13:12:45.880997 29454 raft_consensus.cc:2393] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 8: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:45.881356 29346 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:45.882634 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:45.883329 29452 raft_consensus.cc:2376] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11. Re-sending same reply.
I20260709 13:12:45.840701 32613 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:45.855202 32625 consensus_queue.cc:1048] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:12:45.901222 29447 raft_consensus.cc:2468] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:45.884915 32632 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:45.885372 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:45.917979 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:45.919199 29454 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:45.910388 32632 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:45.901412 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:12:45.926795 32692 log.cc:927] Time spent T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:12:45.927045 29447 raft_consensus.cc:1275] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:12:45.927892 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 58694.6us
W20260709 13:12:45.928630 29346 leader_election.cc:336] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 2.007s (SENT)
W20260709 13:12:45.929651 29346 leader_election.cc:336] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 2.015s (SENT)
I20260709 13:12:45.930035 29346 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:45.931035 32667 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:45.931263 29346 leader_election.cc:336] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 2.018s (SENT)
I20260709 13:12:45.931787 29346 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:45.932587 32667 raft_consensus.cc:2749] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:45.874786 32670 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:45.934935 32670 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:45.878062 32586 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:45.938092 32586 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:45.919739 32613 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:45.864516 32691 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.925312 29450 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
W20260709 13:12:45.940769 30119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.941905 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:45.874091 32678 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.870837 32660 raft_consensus.cc:3055] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:45.945060 29377 raft_consensus.cc:1275] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:12:45.956848 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:45.956972 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:45.958668 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:45.962958 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:45.968971 29377 raft_consensus.cc:1240] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:45.918107 32560 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:45.973646 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:45.921085 32671 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:45.977636 29374 raft_consensus.cc:2393] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 9: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:45.877657 32397 consensus_queue.cc:1048] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 13:12:46.018036 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:12:46.004954 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.002053 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:46.052099 29378 raft_consensus.cc:2393] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 9: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:45.961679 32660 raft_consensus.cc:740] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:45.966140 32678 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:45.946990 32633 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.987979 32629 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:46.022792 29454 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:12:46.024022 29375 raft_consensus.cc:1240] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:12:46.008172 29450 raft_consensus.cc:1275] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:12:45.974071 32626 consensus_meta.cc:287] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.547s	user 0.007s	sys 0.006s
W20260709 13:12:45.963430 32672 consensus_meta.cc:287] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.784s	user 0.012s	sys 0.005s
W20260709 13:12:46.010210 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.997798 32424 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:46.067943 32424 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:45.939530 32691 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:45.903147 32401 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:46.033737 29449 raft_consensus.cc:1240] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:46.011011 32560 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:46.077477 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:46.034350 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:46.079146 29452 raft_consensus.cc:1275] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:46.035625 29455 raft_consensus.cc:1275] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:12:45.995076 32547 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.028367 32680 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:46.059048 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:45.942970 32656 consensus_queue.cc:237] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:46.069677 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:46.076122 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:46.086573 29379 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
I20260709 13:12:46.090461 32560 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:46.096684 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:46.100785 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:46.096952 32691 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:46.102324 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:46.109633 29454 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:46.109871 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:46.111537 29378 raft_consensus.cc:1275] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:12:46.094857 32613 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:46.115011 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:12:46.117170 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.118796 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:46.118809 29451 raft_consensus.cc:1240] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:46.122936 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:46.128068 29449 raft_consensus.cc:1240] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:46.128211 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:46.132288 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:46.133425 29378 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
I20260709 13:12:46.064342 32633 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:46.068919 32626 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:46.132889 29379 raft_consensus.cc:1275] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:12:46.141420 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:46.145048 29450 raft_consensus.cc:1275] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:12:46.118992 32568 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:46.151001 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:46.152107 29447 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
I20260709 13:12:46.100502 32547 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:46.160877 29454 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
I20260709 13:12:46.168169 29449 raft_consensus.cc:1240] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 10. Current term is 11. Ops: []
W20260709 13:12:46.170701 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.173676 29529 raft_consensus.cc:1240] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:46.174256 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:12:46.176833 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:46.187896 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.118098 32660 consensus_queue.cc:260] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.4, Last appended by leader: 4, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:46.160893 32568 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:46.219482 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:46.190919 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:46.241693 29454 raft_consensus.cc:2393] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 9: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:46.242055 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:46.243039 29379 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:12:46.162099 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:46.264842 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:46.213739 32629 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:46.269937 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:46.270212 32660 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:46.214536 32678 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:46.230103 32633 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:46.301429 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:46.302681 29454 raft_consensus.cc:2393] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 6: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:46.303766 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:46.218906 32670 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:46.304718 29452 raft_consensus.cc:2393] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 11: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:46.306080 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:46.310055 29456 raft_consensus.cc:1275] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:12:46.322292 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.323413 29451 raft_consensus.cc:1275] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:12:46.332897 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:46.310287 32613 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:46.328151 29447 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:12:46.307322 32589 raft_consensus.cc:3055] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:46.338106 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:46.339293 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:46.345264 29523 raft_consensus.cc:1240] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 9. Current term is 10. Ops: []
W20260709 13:12:46.362176 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.362243 29452 raft_consensus.cc:2468] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:45.862736 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:46.371325 29278 catalog_manager.cc:5697] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:46.374702 29495 leader_election.cc:304] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:46.376907 29523 raft_consensus.cc:1240] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:46.379361 29525 raft_consensus.cc:1240] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:46.380882 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:46.383464 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:46.384738 29456 raft_consensus.cc:2410] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:12:46.385809 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:46.373903 29278 catalog_manager.cc:5697] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: config changed from index -1 to 4, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New cstate: current_term: 5 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
W20260709 13:12:46.410688 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 46901.5us
I20260709 13:12:46.415714 29530 raft_consensus.cc:1240] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 8. Current term is 9. Ops: []
W20260709 13:12:46.417073 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.328820 32547 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:46.430085 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:46.431869 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:46.425758 29456 raft_consensus.cc:1275] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:12:46.437235 29452 raft_consensus.cc:1275] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:12:46.432627 29451 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:12:46.440250 32625 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.440835 32625 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:46.441260 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:46.464439 29522 raft_consensus.cc:1240] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:46.465812 32407 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:54212 (request call id 112) took 2343 ms. Trace:
I20260709 13:12:46.372025 32560 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.354097 32589 raft_consensus.cc:740] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:46.481158 29527 raft_consensus.cc:1240] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:46.481528 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:46.474498 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:46.497195 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:12:46.476796 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 102184us
I20260709 13:12:46.479022 32669 raft_consensus.cc:2749] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:46.443261 32625 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:46.381847 32613 consensus_queue.cc:1048] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.101s
I20260709 13:12:46.517267 29495 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:46.519691 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:46.467460 32401 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:46.515858 32710 log.cc:927] Time spent T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:12:46.542284 32698 consensus_queue.cc:1048] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:46.504204 32560 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:46.548600 32568 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:46.527544 32625 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:46.557212 30119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:46.564483 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.514725 32629 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.543537 29495 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:46.466426 32407 rpcz_store.cc:276] 0709 13:12:44.121868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:44.122060 (+   192us) service_pool.cc:224] Handling call
0709 13:12:44.123177 (+  1117us) ts_tablet_manager.cc:934] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2: Initiating tablet copy from peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127)
0709 13:12:45.321290 (+1198113us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:12:46.031838 (+710548us) tablet_metadata.cc:665] Metadata flushed
0709 13:12:46.037742 (+  5904us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:12:46.464606 (+426864us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:12:46.465069 (+   463us) tablet_replica.cc:206] Creating consensus instance
0709 13:12:46.465506 (+   437us) ts_tablet_manager.cc:989] Replica registered.
0709 13:12:46.465591 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":29953,"tablet-copy.queue_time_us":198,"thread_start_us":105724,"threads_started":1}
W20260709 13:12:46.528452 32703 log.cc:927] Time spent T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.237s	user 0.002s	sys 0.000s
I20260709 13:12:46.567899 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:46.578833 29449 raft_consensus.cc:2410] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:12:46.564977 32669 raft_consensus.cc:2804] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:12:46.569949 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 316810us
W20260709 13:12:46.572000 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.581041 29495 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:12:46.575568 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.576849 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:12:46.582754 29346 leader_election.cc:336] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 1.636s (SENT)
I20260709 13:12:46.583261 29346 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:46.589811 32408 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:12:46.598840 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.525461 32691 consensus_queue.cc:1059] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
W20260709 13:12:46.577665 32424 consensus_meta.cc:287] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.509s	user 0.012s	sys 0.002s
I20260709 13:12:46.608572 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:46.580353 32671 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.582216 32401 raft_consensus.cc:2804] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:12:46.616824 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.579893 32629 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:46.625065 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:46.630766 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:46.577870 32625 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:46.610206 32408 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.633132 29449 raft_consensus.cc:2393] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 8: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:46.566581 32589 consensus_queue.cc:260] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:46.633275 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:46.582340 32678 consensus_queue.cc:1048] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:12:46.614892 32407 tablet_copy_client.cc:806] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:46.585040 32633 consensus_queue.cc:1048] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:12:46.648432 29447 raft_consensus.cc:1275] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:12:46.655669 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:46.625023 32670 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:46.656508 29453 raft_consensus.cc:2368] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 6. Current term is 7.
I20260709 13:12:46.638892 29456 raft_consensus.cc:2376] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8. Re-sending same reply.
I20260709 13:12:46.621641 32401 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:46.611869 32424 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:46.658442 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:46.658170 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:46.661665 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:46.637167 32613 raft_consensus.cc:2804] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:46.662652 32401 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:46.643334 32632 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.623595 32671 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:46.649446 32547 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.696584 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:46.700831 32629 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:46.664783 32667 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:46.665463 32407 tablet_copy_client.cc:670] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:46.703967 32560 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:46.643071 32408 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:46.716646 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:46.717460 29452 raft_consensus.cc:2393] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 11: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:46.718010 32408 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:46.706501 32626 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:46.718307 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:46.709996 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:12:46.686745 32643 consensus_meta.cc:287] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.808s	user 0.011s	sys 0.005s
I20260709 13:12:46.710458 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:46.710513 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:46.712229 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:46.670231 32613 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:46.723762 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:12:46.724498 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.724699 29455 raft_consensus.cc:2393] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 9: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:46.719460 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:46.719743 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:46.719831 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:46.684387 32589 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:46.731545 29448 raft_consensus.cc:2410] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:12:46.731361 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 150405us
I20260709 13:12:46.732949 29495 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:46.686918 32632 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:46.728605 32613 raft_consensus.cc:3060] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:46.750309 32714 log.cc:927] Time spent T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.091s	user 0.003s	sys 0.000s
I20260709 13:12:46.740630 32626 consensus_queue.cc:1048] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:12:46.754051 29495 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:46.754750 32718 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:46.758883 29495 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:46.743711 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:46.701517 32547 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:46.760372 29495 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:46.762715 29527 raft_consensus.cc:1275] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:12:46.721176 32667 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:46.774832 29495 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:46.777647 29448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45796 (request call id 1202) took 1082 ms. Trace:
I20260709 13:12:46.789552 29448 rpcz_store.cc:276] 0709 13:12:45.694736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:45.695099 (+   363us) service_pool.cc:224] Handling call
0709 13:12:46.777277 (+1082178us) spinlock_profiling.cc:243] Waited 918 ms on lock 0x7b54003421d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:46.777519 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2111261952}
I20260709 13:12:46.794448 29495 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:46.769842 29452 raft_consensus.cc:3055] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:46.797874 29452 raft_consensus.cc:740] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:46.763584 32718 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:46.806643 29451 raft_consensus.cc:2410] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:12:46.811455 29377 raft_consensus.cc:1275] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:12:46.811771 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.812665 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:46.837821 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:46.812712 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:46.767107 32626 raft_consensus.cc:2749] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:46.843852 29377 raft_consensus.cc:1275] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:12:46.844424 29373 raft_consensus.cc:1275] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:12:46.839963 29375 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:12:46.778033 32678 raft_consensus.cc:2749] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:46.782991 32671 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:46.781738 32397 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:46.781167 32424 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:46.839370 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:46.867390 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:46.854153 29377 raft_consensus.cc:1275] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:46.868784 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:12:46.863143 29346 leader_election.cc:336] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 1.784s (SENT)
W20260709 13:12:46.869477 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:46.870426 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:46.870898 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.782070 32625 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:46.855202 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:46.858325 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:46.862356 29374 raft_consensus.cc:1275] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:12:46.852164 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:46.864089 29380 raft_consensus.cc:1275] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:12:46.807539 32633 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:12:46.864705 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 257658us
I20260709 13:12:46.841142 29452 consensus_queue.cc:260] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:46.832993 32670 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:46.881039 29452 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:46.886183 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:46.887269 29421 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:46.852855 32643 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:46.893908 29346 leader_election.cc:336] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 1.840s (SENT)
I20260709 13:12:46.881546 32633 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:46.906997 29346 leader_election.cc:336] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 2.023s (SENT)
I20260709 13:12:46.908089 29346 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:46.909759 29526 raft_consensus.cc:1240] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:46.909745 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:12:46.919231 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 128360us
I20260709 13:12:46.899128 32625 raft_consensus.cc:2804] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:46.874739 32626 consensus_queue.cc:1048] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:12:46.894011 32629 consensus_queue.cc:1059] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.020s
W20260709 13:12:46.926713 29346 leader_election.cc:336] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 2.040s (SENT)
I20260709 13:12:46.873826 32662 consensus_queue.cc:1048] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:12:46.937412 32671 consensus_queue.cc:1059] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:12:46.930483 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 94670.6us
I20260709 13:12:46.933211 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:46.938917 29455 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:12:46.939404 32408 consensus_queue.cc:1059] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:46.887769 32670 consensus_queue.cc:1048] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:12:46.875028 32718 consensus_queue.cc:1048] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:12:46.942042 29452 raft_consensus.cc:1275] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:12:46.934563 29346 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:46.876303 32397 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:46.947175 29495 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:46.948063 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:46.948969 29448 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:12:46.903371 32643 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:46.926004 32625 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:46.951030 32629 consensus_queue.cc:1243] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer 183db85c071f489fbc8de63a9edd8a3a log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:12:46.957190 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:46.920188 32685 consensus_queue.cc:1059] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:12:46.926777 32720 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:46.961685 29495 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:46.916792 32633 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:46.960616 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 60172.7us
I20260709 13:12:46.967016 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:46.975035 29495 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:46.977998 29448 raft_consensus.cc:1275] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:46.938997 32721 consensus_queue.cc:1059] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
W20260709 13:12:46.979802 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 53128.4us
W20260709 13:12:46.983645 29346 leader_election.cc:336] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 2.131s (SENT)
I20260709 13:12:46.980888 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:46.984709 29455 raft_consensus.cc:2468] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 4.
I20260709 13:12:46.962422 32625 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:46.936784 32661 consensus_queue.cc:1059] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:12:46.962715 32670 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:46.985636 29495 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:46.988297 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:46.999454 29455 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
W20260709 13:12:46.992113 29346 leader_election.cc:336] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 2.163s (SENT)
I20260709 13:12:47.000757 29346 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:46.958911 32718 consensus_queue.cc:1048] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
W20260709 13:12:46.980654 32660 consensus_meta.cc:287] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.709s	user 0.014s	sys 0.003s
I20260709 13:12:47.004873 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:46.980254 32618 raft_consensus.cc:2749] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:47.006246 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:47.004004 29495 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:47.005605 29455 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:12:46.976714 32547 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:46.981359 32397 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:47.012576 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:47.013446 29448 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
I20260709 13:12:46.979481 32724 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:47.010031 29495 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:47.018620 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 80348.3us
I20260709 13:12:47.021234 32721 raft_consensus.cc:3055] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:47.021636 32721 raft_consensus.cc:740] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:12:47.022027 29346 leader_election.cc:336] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 2.328s (SENT)
I20260709 13:12:47.022480 29346 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:47.021668 32734 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:47.022529 32721 consensus_queue.cc:260] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:47.023991 32734 raft_consensus.cc:2749] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:47.024107 32721 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:46.982219 32691 consensus_queue.cc:1048] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
W20260709 13:12:47.024466 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.008342 32626 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:12:47.027040 30119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.026865 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:47.029553 29448 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
W20260709 13:12:47.028553 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:47.030507 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:47.031206 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.011523 32667 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:47.016613 32424 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:47.044646 32424 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:47.045079 32424 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:47.016405 32660 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:47.035590 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:47.049047 29375 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11.
I20260709 13:12:47.036784 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:47.037695 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:47.038444 29372 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
I20260709 13:12:47.039342 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:47.040033 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:47.040562 32723 log.cc:927] Time spent T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:12:47.051218 29373 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:12:47.050601 29377 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 12.
I20260709 13:12:47.040725 32397 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:47.055619 32734 consensus_queue.cc:1059] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:47.057212 32720 raft_consensus.cc:3055] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:47.057593 32720 raft_consensus.cc:740] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:47.058496 32720 consensus_queue.cc:260] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:47.059720 32720 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:47.060871 32639 consensus_queue.cc:1048] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:47.032523 32618 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:47.063376 32618 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:47.063803 32618 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:47.067736 32633 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:47.041793 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:47.042032 32643 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:47.012257 32670 raft_consensus.cc:697] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:47.015002 32729 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:47.055585 32397 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:47.041105 29378 raft_consensus.cc:1275] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:12:47.073822 29346 leader_election.cc:336] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 1.963s (SENT)
I20260709 13:12:47.088351 29346 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:47.088487 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 62429.9us
I20260709 13:12:47.072194 29421 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:47.017974 32678 consensus_queue.cc:1048] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:12:47.076295 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:47.092864 29375 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 10.
I20260709 13:12:47.069191 32407 tablet_copy_client.cc:538] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:12:47.104001 29346 leader_election.cc:336] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 2.041s (SENT)
I20260709 13:12:47.104470 29346 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:47.107542 29495 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:47.110441 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:47.114370 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:12:47.114842 29419 connection.cc:256] RPC call timeout handler was delayed by -3.0114785040000243s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2169s for a response
I20260709 13:12:47.115208 29452 raft_consensus.cc:2393] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 6: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
W20260709 13:12:47.115440 29419 connection.cc:256] RPC call timeout handler was delayed by -2.955678503999934s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2231s for a response
I20260709 13:12:47.078339 32691 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:12:47.115870 29419 connection.cc:256] RPC call timeout handler was delayed by -2.3399807600001168s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 13:12:47.119055 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 46961.9us
I20260709 13:12:47.050694 32661 consensus_queue.cc:1059] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:12:47.120723 29526 raft_consensus.cc:1275] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:47.123387 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:47.123780 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:47.124447 29447 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:47.124804 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:47.125120 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:47.125546 29526 raft_consensus.cc:2393] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 7: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:47.126209 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:47.126353 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:47.127526 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:47.100550 32408 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:47.128257 29525 raft_consensus.cc:2393] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 8: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:47.129779 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:47.130756 29346 leader_election.cc:336] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 2.657s (SENT)
I20260709 13:12:47.131151 29346 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:47.126096 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:47.133698 29522 raft_consensus.cc:2410] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:12:47.135964 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:47.136157 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:47.137111 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:47.138461 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:47.138609 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:47.103614 32718 consensus_queue.cc:1048] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:12:47.111984 32727 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:47.141299 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:47.141600 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:47.142352 29528 raft_consensus.cc:2393] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 6: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:47.142599 29452 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
I20260709 13:12:47.142859 29521 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:12:47.143741 29524 raft_consensus.cc:2393] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 10: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:47.105672 32626 consensus_queue.cc:1048] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:12:47.124130 32586 raft_consensus.cc:2749] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:12:47.155306 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.123939 32724 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:47.123157 32633 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:47.125556 32691 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:47.166147 32691 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:47.127758 32740 raft_consensus.cc:2804] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:12:47.183128 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.103477 32729 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:12:47.212124 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.220271 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:12:47.226625 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 95882.1us
I20260709 13:12:47.231348 29524 raft_consensus.cc:1217] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 3.3->[5.4-7.5]   Dedup: 7.5->[]
I20260709 13:12:47.232270 29524 raft_consensus.cc:1240] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:12:47.236312 29521 raft_consensus.cc:2393] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 9: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:47.240302 29528 raft_consensus.cc:1217] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 7.5->[9.6-9.6]   Dedup: 9.6->[]
I20260709 13:12:47.241029 29528 raft_consensus.cc:1240] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:12:47.247619 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.203616 32740 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:47.205507 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:47.251746 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:47.256589 29379 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
I20260709 13:12:47.261122 29528 raft_consensus.cc:1240] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:12:47.202849 32670 consensus_queue.cc:237] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:47.255795 32740 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:47.252888 32547 consensus_queue.cc:1048] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:12:47.274199 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:47.275535 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:47.276348 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.277787 32625 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:47.278635 32424 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:47.237004 32613 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:47.283149 29527 raft_consensus.cc:1240] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:47.210665 32738 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:47.284547 32397 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:47.287140 32589 consensus_meta.cc:287] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.550s	user 0.006s	sys 0.005s
I20260709 13:12:47.298966 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:47.300341 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:47.301059 29521 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:47.245162 32633 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:47.288865 32671 raft_consensus.cc:3055] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:47.289165 32729 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:12:47.289677 32742 log.cc:927] Time spent T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:12:47.290421 32613 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:47.294486 32626 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:12:47.319736 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 152236us
I20260709 13:12:47.320303 29447 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
I20260709 13:12:47.321256 29530 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
I20260709 13:12:47.322247 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:47.323112 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:47.324577 29421 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:47.326042 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:47.330348 29524 raft_consensus.cc:2393] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 9: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:47.330338 29456 raft_consensus.cc:2376] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 7. Re-sending same reply.
I20260709 13:12:47.326416 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:47.331219 29421 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:47.331612 29525 raft_consensus.cc:2393] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 6: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:12:47.347890 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.370682 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:47.369392 29522 raft_consensus.cc:2393] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 9: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:47.329156 29419 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:47.382637 29456 raft_consensus.cc:2468] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 3.
I20260709 13:12:47.388803 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:47.389470 29447 raft_consensus.cc:3060] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:12:47.316198 32671 raft_consensus.cc:740] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:47.212659 32724 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:12:47.397454 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:47.304260 32586 consensus_queue.cc:1059] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 13:12:47.271342 32618 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:47.412926 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 81790.6us
I20260709 13:12:47.413328 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:47.414260 29522 raft_consensus.cc:2393] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 6: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:47.369139 32729 raft_consensus.cc:2804] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:47.424376 29526 raft_consensus.cc:1275] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:12:47.430239 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.427994 29523 raft_consensus.cc:2368] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 8. Current term is 9.
W20260709 13:12:47.430838 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:47.424873 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 95786.1us
I20260709 13:12:47.433877 29421 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:47.426221 29524 raft_consensus.cc:1275] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:12:47.424376 29525 raft_consensus.cc:1275] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:12:47.436543 29525 pending_rounds.cc:85] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 3
I20260709 13:12:47.437321 29449 raft_consensus.cc:1275] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:12:47.437762 29449 pending_rounds.cc:85] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 4
I20260709 13:12:47.437686 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:47.438941 29521 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 8.
I20260709 13:12:47.440445 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:47.441565 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:47.442365 29521 raft_consensus.cc:2410] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 13:12:47.442546 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:47.447163 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.451314 29419 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:47.457182 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:47.421799 32735 raft_consensus.cc:3055] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:47.458601 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:47.438100 29449 pending_rounds.cc:107] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:12:47.482347 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:47.436842 29525 pending_rounds.cc:107] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:12:47.459390 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:47.483949 29449 raft_consensus.cc:2889] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:47.484944 29525 raft_consensus.cc:2889] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:47.413867 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
W20260709 13:12:47.486609 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 55932.1us
I20260709 13:12:47.425099 32698 raft_consensus.cc:3055] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:47.489387 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:47.489476 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:47.388125 32626 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:47.425561 32632 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:47.430038 32729 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:47.494488 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:47.427407 32618 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:47.497517 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:47.498062 32749 log.cc:927] Time spent T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
W20260709 13:12:47.502887 32401 consensus_meta.cc:287] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.804s	user 0.015s	sys 0.000s
I20260709 13:12:47.517838 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:47.409722 32625 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:47.498659 32724 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:47.499264 32745 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:47.485456 32735 raft_consensus.cc:740] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:47.500782 32407 tablet_bootstrap.cc:492] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap starting.
I20260709 13:12:47.456866 32643 consensus_queue.cc:1048] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:12:47.425366 32748 raft_consensus.cc:2764] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 13:12:47.502861 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:47.508378 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 57250.3us
I20260709 13:12:47.510071 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:47.515257 29447 raft_consensus.cc:2468] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 5.
I20260709 13:12:47.502749 32660 raft_consensus.cc:3055] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:47.523300 29495 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:12:47.644325 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 121137us
W20260709 13:12:47.453038 32669 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.842s	user 0.007s	sys 0.000s
I20260709 13:12:47.527616 29522 raft_consensus.cc:2410] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:12:47.517954 32721 consensus_queue.cc:1059] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.116s
I20260709 13:12:47.502461 32633 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:47.503450 32698 raft_consensus.cc:740] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:47.513975 32729 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:47.526609 32745 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:47.410432 32408 consensus_queue.cc:1059] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.115s
I20260709 13:12:47.628497 29524 raft_consensus.cc:2368] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 4. Current term is 5.
I20260709 13:12:47.503912 32671 consensus_queue.cc:260] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:47.648727 29372 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 1152) took 1551 ms (client timeout 1687 ms). Trace:
W20260709 13:12:47.645784 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.529243 29526 raft_consensus.cc:2393] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 9: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:12:47.661583 29372 rpcz_store.cc:269] 0709 13:12:46.082223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:46.082361 (+   138us) service_pool.cc:224] Handling call
0709 13:12:47.633503 (+1551142us) spinlock_profiling.cc:243] Waited 910 ms on lock 0x7b5400383e54. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:47.633611 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2094005504}
I20260709 13:12:47.652088 29495 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:47.658984 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:47.629113 29450 raft_consensus.cc:1240] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 3. Current term is 5. Ops: []
I20260709 13:12:47.527720 32401 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:47.632884 32660 raft_consensus.cc:740] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:47.664343 29495 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:47.650503 32613 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:47.676124 29524 raft_consensus.cc:1275] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:47.662460 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:47.654389 32424 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:47.679278 29526 raft_consensus.cc:1240] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 7. Current term is 8. Ops: []
W20260709 13:12:47.656224 32669 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.049s	user 0.013s	sys 0.001s
I20260709 13:12:47.656527 32618 consensus_queue.cc:1048] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:12:47.659804 32745 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:47.709545 29521 raft_consensus.cc:2393] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 10: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:47.688308 29495 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:47.673388 32718 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:47.653872 32691 consensus_queue.cc:1048] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
W20260709 13:12:47.722236 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.656796 32724 consensus_queue.cc:1048] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:12:47.690477 32633 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:47.740818 29495 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:47.743258 29453 raft_consensus.cc:1275] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:12:47.734680 29529 consensus_meta.cc:287] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.593s	user 0.011s	sys 0.003s
I20260709 13:12:47.672111 32397 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:47.744284 29529 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11.
I20260709 13:12:47.660331 32748 consensus_queue.cc:1048] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:12:47.677889 32751 consensus_queue.cc:1048] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:12:47.753450 32401 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:47.751456 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:47.755916 32756 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:47.721496 32671 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:47.689160 32632 consensus_queue.cc:1048] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:12:47.770407 29529 raft_consensus.cc:1240] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:47.736748 32678 raft_consensus.cc:2749] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:47.775714 29529 raft_consensus.cc:1240] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 11. Current term is 12. Ops: []
W20260709 13:12:47.752051 32747 log.cc:927] Time spent T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:12:47.678504 32735 consensus_queue.cc:260] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:47.713737 32669 raft_consensus.cc:697] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 6 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:47.785732 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:47.789569 29455 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:12:47.739075 32424 consensus_queue.cc:1048] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:12:47.800501 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:47.786499 29419 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:47.749145 32629 consensus_queue.cc:1048] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
W20260709 13:12:47.797851 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 84664.7us
W20260709 13:12:47.784224 32754 log.cc:927] Time spent T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:12:47.804016 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:12:47.805094 32752 log.cc:927] Time spent T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.272s	user 0.000s	sys 0.001s
W20260709 13:12:47.800477 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.743398 32698 consensus_queue.cc:260] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:47.751519 32758 consensus_queue.cc:1048] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 13:12:47.801097 32643 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:47.757891 32660 consensus_queue.cc:260] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:47.816807 32765 consensus_queue.cc:1048] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:12:47.787345 32741 consensus_queue.cc:1048] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:12:47.807657 32626 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:47.824451 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:47.842422 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:47.843369 29452 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:47.826946 32750 log.cc:927] Time spent T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.282s	user 0.001s	sys 0.001s
I20260709 13:12:47.812927 32625 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:47.845660 32716 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:47.846313 32716 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:47.829216 32669 consensus_queue.cc:237] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:47.830607 32397 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:47.830199 32729 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:47.831903 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 45516.1us
I20260709 13:12:47.807574 32735 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:47.832551 32560 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:12:47.853085 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:47.853572 29419 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:47.839555 32643 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:47.867167 29528 raft_consensus.cc:1240] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:47.859244 29495 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:47.870927 32626 raft_consensus.cc:2749] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:12:47.855082 32740 consensus_meta.cc:287] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.584s	user 0.012s	sys 0.002s
I20260709 13:12:47.873661 29495 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:47.851858 32660 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:47.895731 32626 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:47.855569 32397 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:47.882294 29448 raft_consensus.cc:1240] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:12:47.900199 29419 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:47.901383 29452 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
I20260709 13:12:47.861105 32765 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:47.861370 32698 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:47.884972 29495 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:47.886637 29528 raft_consensus.cc:1240] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:47.887411 32716 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:47.887046 32740 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:47.907689 32667 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:47.908285 32667 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:47.908967 32408 raft_consensus.cc:3055] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:47.909415 32408 raft_consensus.cc:740] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:47.910508 32667 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:47.910282 32408 consensus_queue.cc:260] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:47.911764 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 95558.9us
I20260709 13:12:47.912631 32719 raft_consensus.cc:3055] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:47.913071 32719 raft_consensus.cc:740] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:47.913156 32740 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:47.914251 32408 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:47.915900 32685 raft_consensus.cc:1064] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5: attempting to promote NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 to VOTER
I20260709 13:12:47.917672 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:12:47.918444 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 104808us
I20260709 13:12:47.914067 32719 consensus_queue.cc:260] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:47.914851 32721 consensus_queue.cc:1175] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "71aa3578fd924765ab9ac0729c8d1483" responder_term: 8 status { last_received { term: 7 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:12:47.923868 29495 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:47.929836 29525 raft_consensus.cc:1240] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:47.934777 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:47.934636 29495 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:47.937628 29495 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:47.941190 29452 raft_consensus.cc:2393] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 10: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:47.942924 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:47.944691 29495 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:47.945078 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:47.945842 29452 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:12:47.947465   300 consensus_queue.cc:1048] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:47.949013 32733 consensus_queue.cc:1059] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:47.919062 32758 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:47.950529 32678 raft_consensus.cc:2749] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:47.934458 32629 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:47.943427 32740 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:47.936587 32718 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:47.968502 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:47.976397 29452 raft_consensus.cc:2376] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 5. Re-sending same reply.
I20260709 13:12:47.954605 32719 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:47.977895 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:47.978343 29419 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:47.934114 32720 consensus_queue.cc:1048] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:12:48.008489 32718 raft_consensus.cc:697] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:48.016029 32736 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:48.017550 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 71132.1us
I20260709 13:12:48.019268 29495 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:48.021054 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:48.022557 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:48.023734 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:48.023962 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:48.024695 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:48.023872   307 raft_consensus.cc:2804] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:48.025359 29448 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:12:48.025689   307 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:48.026069   307 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:48.036557 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 58359.9us
I20260709 13:12:47.972018 32629 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:47.978012 32669 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:47.977294 32729 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:48.040144 32547 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:48.040975 29419 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:48.054352 29455 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:12:48.058414 29419 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:48.042955 32629 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:48.067054 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:48.071635 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 118340us
I20260709 13:12:48.060177 32669 raft_consensus.cc:697] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:47.974938 32758 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:48.063340 32625 raft_consensus.cc:2749] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:48.087080 29455 raft_consensus.cc:1240] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
W20260709 13:12:48.064713 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 119906us
I20260709 13:12:48.009660 32718 consensus_queue.cc:237] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:48.104665 30119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:48.106068 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 45112.8us
I20260709 13:12:48.110950 32737 raft_consensus.cc:2749] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:48.111675 29419 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:48.016768 32736 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:48.114818 29419 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:48.115742 29346 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:48.121446 29419 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:48.124176 29419 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:48.126065 32748 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:48.131807 32748 consensus_queue.cc:1048] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:12:48.123888 32671 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:48.132059 32737 consensus_queue.cc:1048] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
W20260709 13:12:48.148356 32766 log.cc:927] Time spent T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:12:48.120050 32730 raft_consensus.cc:2749] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:48.151486 29419 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:48.122628 32716 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:48.168920 29419 leader_election.cc:400] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 4. Current term is 5.
I20260709 13:12:48.169296 29419 leader_election.cc:403] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:48.121974 32643 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:48.154062 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 65540.9us
W20260709 13:12:48.165234 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 46218.2us
I20260709 13:12:48.134671 32632 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:12:48.167306   306 log.cc:927] Time spent T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:12:48.132376 32729 consensus_queue.cc:1048] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:12:48.173170 29419 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:48.172981 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 143161us
I20260709 13:12:48.181650 32632 raft_consensus.cc:697] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 8 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:48.171298 32737 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:48.189167 29495 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:48.176222 32625 raft_consensus.cc:2749] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 4. Current term is 5.
I20260709 13:12:48.189922 29419 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:48.192046   308 consensus_queue.cc:1059] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:48.199604 29419 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:48.180584 32758 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:48.203266 29451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 1248) took 1081 ms. Trace:
I20260709 13:12:48.204785 29419 leader_election.cc:400] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 8. Current term is 9.
I20260709 13:12:48.205108 29419 leader_election.cc:403] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:48.189378 32643 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:48.206766 29346 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:48.214934 29346 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:48.203883 29451 rpcz_store.cc:276] 0709 13:12:47.122041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:47.426781 (+304740us) service_pool.cc:224] Handling call
0709 13:12:47.427115 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:47.427510 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:47.427539 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:47.427990 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:12:47.831841 (+403851us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:47.831892 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:47.832004 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:48.203014 (+371010us) raft_consensus.cc:1685] finished
0709 13:12:48.203038 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:48.203197 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10388,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":43956,"thread_start_us":329388,"threads_started":1,"wal-append.queue_time_us":470494}
I20260709 13:12:48.180886 32720 consensus_queue.cc:1048] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
W20260709 13:12:48.219458   315 log.cc:927] Time spent T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:12:48.219894 32586 raft_consensus.cc:2749] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:48.221853 32740 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:48.200901 32730 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:48.200959 32424 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:12:48.228937 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:48.227769 29346 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:48.204638 32751 raft_consensus.cc:2749] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:48.170423 32669 consensus_queue.cc:237] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:48.194559 32716 consensus_queue.cc:1048] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:12:48.217562 32758 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 8. Current term is 9.
I20260709 13:12:48.213616 32678 raft_consensus.cc:3055] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:48.224371 32671 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:48.230724 32424 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:48.257409 32424 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:48.216313 32736 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:48.247828 32678 raft_consensus.cc:740] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:48.250253 32730 raft_consensus.cc:697] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 11 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:48.281018 32765 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:48.281004 32740 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:48.298622 32740 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:48.301898 32740 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:48.257139 32721 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:48.305711 29530 raft_consensus.cc:1275] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:12:48.311060 29530 pending_rounds.cc:85] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 5
I20260709 13:12:48.311352 29530 pending_rounds.cc:107] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:12:48.311673 29530 raft_consensus.cc:2889] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:48.305002 29419 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:48.318773 29419 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:12:48.328889 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 101243us
I20260709 13:12:48.330470 29346 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:48.340641 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:48.339558 29346 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:48.303323 32745 consensus_meta.cc:287] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.556s	user 0.006s	sys 0.003s
I20260709 13:12:48.345836 29346 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:48.341238 32720 raft_consensus.cc:2804] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:48.332949 32719 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.353580 29346 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:48.334646 32547 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:48.326206 32765 raft_consensus.cc:2749] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:48.334843 32740 raft_consensus.cc:2749] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:48.350741 32671 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:48.352317 32721 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:48.352345 32720 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:48.305099 32730 consensus_queue.cc:237] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:48.357208 32719 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:48.372289 32667 raft_consensus.cc:3055] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:12:48.374666 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 424528us
I20260709 13:12:48.347954 32745 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:48.376214 32738 raft_consensus.cc:3055] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:48.397718 32738 raft_consensus.cc:740] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:48.398967 32738 consensus_queue.cc:260] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:48.376715 32586 raft_consensus.cc:2749] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:48.400758 29527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53428 (request call id 442) took 1507 ms. Trace:
I20260709 13:12:48.357244 32678 consensus_queue.cc:260] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:48.401464 29527 rpcz_store.cc:276] 0709 13:12:46.884267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:46.884421 (+   154us) service_pool.cc:224] Handling call
0709 13:12:46.897955 (+ 13534us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:47.283600 (+385645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:48.391623 (+1108023us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b54002328d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:48.391895 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":885411200}
I20260709 13:12:48.402446 32678 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:48.386713 32721 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:48.404454 32721 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:48.404562 32662 consensus_queue.cc:1059] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:48.405782 32662 raft_consensus.cc:3055] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:48.406214 32662 raft_consensus.cc:740] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
W20260709 13:12:48.378510 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:48.403093 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:48.383055 29346 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:48.270597 32632 consensus_queue.cc:237] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:48.393663 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:48.341849 32736 consensus_queue.cc:1048] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:12:48.396919 32719 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:48.397033 32560 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:48.415402 29346 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:48.380766 32397 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:48.390869 32720 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:48.424304 29346 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:48.431660 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:48.420909 32589 raft_consensus.cc:2804] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:48.394550 32667 raft_consensus.cc:740] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:48.437086 29346 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:48.438102 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:48.387863 32408 consensus_queue.cc:1048] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:12:48.400822 32738 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:48.394995   307 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:12:48.443426 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:48.425607 32560 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:48.432711 32586 raft_consensus.cc:2804] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:48.452041 29522 raft_consensus.cc:2393] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 9: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:48.452796 29451 raft_consensus.cc:1240] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:48.453936 29527 raft_consensus.cc:2468] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:12:48.450884 29346 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:48.460065 29346 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:48.439278 32589 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:48.440851 32719 raft_consensus.cc:2804] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:48.454319 32735 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:48.469120 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:48.407196 32662 consensus_queue.cc:260] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:48.473402 29346 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:48.477469 32667 consensus_queue.cc:260] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:48.478819 32667 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:48.479815 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:48.444298 32671 consensus_queue.cc:1059] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:12:48.481055 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:48.476811 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 45047.5us
I20260709 13:12:48.482089 32733 raft_consensus.cc:3055] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:48.511925 32733 raft_consensus.cc:740] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:48.493651 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:48.476332 32735 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:48.497045 32745 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:48.497761 29456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 1245) took 1379 ms. Trace:
I20260709 13:12:48.467211 32734 raft_consensus.cc:2804] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:48.474253 32739 raft_consensus.cc:2749] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:48.527225 29456 rpcz_store.cc:276] 0709 13:12:47.118063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:47.414675 (+296612us) service_pool.cc:224] Handling call
0709 13:12:47.415055 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:47.513613 (+ 98558us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:12:47.665265 (+151652us) log.cc:844] Serialized 14 byte log entry
0709 13:12:47.745043 (+ 79778us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:47.771303 (+ 26260us) log.cc:844] Serialized 26 byte log entry
0709 13:12:47.771477 (+   174us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:47.771550 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:47.771629 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:48.495388 (+723759us) spinlock_profiling.cc:243] Waited 6.15 ms on lock 0x7b18003d4200. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c993f3 00007f6a78c9b7c1 00007f6a78c9b779 00007f6a78c9b709 00007f6a78c9b6d1 00007f6a78c9a9cd 000000000038f354 000000000038f199 00007f6a78c7c83a
0709 13:12:48.497439 (+  2051us) raft_consensus.cc:1685] finished
0709 13:12:48.497554 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:48.497682 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":116991,"prepare.queue_time_us":237341,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"raft.queue_time_us":121638,"raft.run_cpu_time_us":5304,"raft.run_wall_time_us":131152,"spinlock_wait_cycles":14143232,"thread_start_us":166589,"threads_started":2,"wal-append.queue_time_us":102086}
I20260709 13:12:48.486081 32618 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.499976 32669 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.473070 32589 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:48.501776 29524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2574) took 1081 ms. Trace:
W20260709 13:12:48.506476 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:48.507079 32643 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:48.456620 32586 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:48.474522 32719 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:48.507575 32736 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:48.487620 29449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2092) took 1726 ms. Trace:
I20260709 13:12:48.531849 32734 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:48.523676 30119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:48.528251 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:48.540858 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 67567.2us
I20260709 13:12:48.527462 32735 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:48.477142 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:48.555255 29421 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:48.556385 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:48.553099 29449 rpcz_store.cc:276] 0709 13:12:46.769158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:46.769446 (+   288us) service_pool.cc:224] Handling call
0709 13:12:47.428435 (+658989us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:47.493588 (+ 65153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:48.487360 (+993772us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b5400260a50. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd858ad 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:48.487526 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1434817408}
I20260709 13:12:48.574739 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:48.554437 29527 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:12:48.545682 32661 raft_consensus.cc:2749] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:48.548187 32671 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.599855 29447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 245) took 1432 ms. Trace:
I20260709 13:12:48.587623 32736 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:48.608127 32661 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:48.545909 29524 rpcz_store.cc:276] 0709 13:12:47.420535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:47.707232 (+286697us) service_pool.cc:224] Handling call
0709 13:12:47.916933 (+209701us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:47.917176 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:12:47.956442 (+ 39266us) log.cc:844] Serialized 14 byte log entry
0709 13:12:48.090648 (+134206us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:48.090705 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:48.090751 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:48.090828 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:48.501410 (+410582us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b54003039d0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd858ad 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:48.501673 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20082,"prepare.queue_time_us":35584,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":3542,"raft.queue_time_us":106,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"spinlock_wait_cycles":481346304,"thread_start_us":172295,"threads_started":2,"wal-append.queue_time_us":133984}
I20260709 13:12:48.558028 32662 raft_consensus.cc:3060] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:48.609733 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:48.551134 32586 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:48.598295 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:48.552712 32719 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:48.617156 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:48.618147 29454 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:12:48.608012 29447 rpcz_store.cc:276] 0709 13:12:47.167184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:47.740986 (+573802us) service_pool.cc:224] Handling call
0709 13:12:47.755197 (+ 14211us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:47.755660 (+   463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:47.755688 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:47.756189 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 13:12:47.853495 (+ 97306us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:47.871454 (+ 17959us) log.cc:844] Serialized 14 byte log entry
0709 13:12:48.046504 (+175050us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b18003d5ac0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c99522 00007f6a78c9b7c1 00007f6a78c9b779 00007f6a78c9b709 00007f6a78c9b6d1 00007f6a78c9a9cd 000000000038f354 000000000038f199 00007f6a78c7c83a
0709 13:12:48.246281 (+199777us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b18003d5ac0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c672a6 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd01733 00007f6a7bd86dbf 00007f6a7bd8583e
0709 13:12:48.599473 (+353192us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b540026aaa0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd01733 00007f6a7bd86dbf 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c
0709 13:12:48.599557 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:48.599630 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:48.599671 (+    41us) raft_consensus.cc:1685] finished
0709 13:12:48.599678 (+     7us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:48.599800 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":17769,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":61,"raft.queue_time_us":1440,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":9279,"spinlock_wait_cycles":84713984,"thread_start_us":96872,"threads_started":1,"wal-append.queue_time_us":99772}
I20260709 13:12:48.613159 29449 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
W20260709 13:12:48.593180 32629 consensus_meta.cc:287] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.515s	user 0.012s	sys 0.001s
I20260709 13:12:48.595544 32643 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:48.643536 29530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 1400) took 1225 ms. Trace:
I20260709 13:12:48.545498 32618 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:48.558821 32734 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:48.554175 32739 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.643535 29450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 236) took 1478 ms. Trace:
I20260709 13:12:48.548230 32669 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:48.622201 29454 raft_consensus.cc:1240] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 13:12:48.644068 29530 rpcz_store.cc:276] 0709 13:12:47.418313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:47.474216 (+ 55903us) service_pool.cc:224] Handling call
0709 13:12:47.474718 (+   502us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:48.312254 (+837536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:48.643221 (+330967us) spinlock_profiling.cc:243] Waited 830 ms on lock 0x7b54000a3a54. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:48.643425 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1910141312}
I20260709 13:12:48.653371 29529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2583) took 1230 ms. Trace:
I20260709 13:12:48.650465 29450 rpcz_store.cc:276] 0709 13:12:47.164849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:47.524253 (+359404us) service_pool.cc:224] Handling call
0709 13:12:47.628908 (+104655us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:47.665302 (+ 36394us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:48.643251 (+977949us) spinlock_profiling.cc:243] Waited 43.3 ms on lock 0x7b54001c1950. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd858ad 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:48.643424 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99667328}
I20260709 13:12:48.540334 32733 consensus_queue.cc:260] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:48.612139 32671 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:48.679535 32724 raft_consensus.cc:2804] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:48.647074 32629 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:48.692255 32733 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:48.693666 32629 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:48.696849 32671 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:48.697538 32671 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:48.697996 32738 raft_consensus.cc:493] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:48.678786 32408 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:48.699039 32738 raft_consensus.cc:515] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:48.698966 32408 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:48.698061 32671 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:48.708379   307 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:48.710269 32671 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:48.684876 32739 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:48.711783 32408 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:48.713761 32721 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:48.714916 32739 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:48.716104 29521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37958 (request call id 1405) took 1296 ms. Trace:
I20260709 13:12:48.716511 29521 rpcz_store.cc:276] 0709 13:12:47.419933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:47.494070 (+ 74137us) service_pool.cc:224] Handling call
0709 13:12:48.715852 (+1221782us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b54000b72d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:48.716006 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":442120576}
W20260709 13:12:48.721614 30119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:48.608852 32661 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:48.725335 32661 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:48.726142 32397 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:48.728374 32736 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:48.730744 32618 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:48.732511 29522 raft_consensus.cc:2410] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:12:48.732343 32424 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:48.737157 32669 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:48.702471 32738 leader_election.cc:290] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:48.765486 32685 consensus_queue.cc:237] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 2, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:12:48.789988   322 log.cc:927] Time spent T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.355s	user 0.004s	sys 0.000s
I20260709 13:12:48.794030 29522 raft_consensus.cc:1240] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:48.796198 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:48.797397 29453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45798 (request call id 2106) took 1055 ms. Trace:
I20260709 13:12:48.797755 29453 rpcz_store.cc:276] 0709 13:12:47.742293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:48.795821 (+1053528us) service_pool.cc:224] Handling call
0709 13:12:48.797311 (+  1490us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:48.799665 32401 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:48.800333 32401 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:48.802038 29522 raft_consensus.cc:1240] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 8. Current term is 9. Ops: []
W20260709 13:12:48.794231   333 log.cc:927] Time spent T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:12:48.734665 32424 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:48.719090 32720 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:48.832378   341 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:48.817906 29455 raft_consensus.cc:2955] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:12:48.837960   341 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:48.839560 32401 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:48.840215   341 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:48.842099 32720 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:48.863909 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:48.869843 29526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2576) took 1448 ms. Trace:
I20260709 13:12:48.858695 32721 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:48.865525 32720 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:48.873905   341 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:48.894205 32560 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:48.658984 29529 rpcz_store.cc:276] 0709 13:12:47.423067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:47.851997 (+428930us) service_pool.cc:224] Handling call
0709 13:12:47.852370 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:47.852598 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:12:47.852917 (+   319us) log.cc:844] Serialized 14 byte log entry
0709 13:12:47.985173 (+132256us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b18003eb900. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c993f3 00007f6a78c9b7c1 00007f6a78c9b779 00007f6a78c9b709 00007f6a78c9b6d1 00007f6a78c9a9cd 000000000038f354 000000000038f199 00007f6a78c7c83a
0709 13:12:48.641514 (+656341us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b18003eb900. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a7b92e4bc 00007f6a78c7c48b 00007f6a81ad6ab9 00007f6a78c9869b 00007f6a78c9693f 00007f6a78c98c02 00007f6a7b92020b 00007f6a7b925d23 00007f6a7b92623a
0709 13:12:48.652949 (+ 11435us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:48.653013 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:48.653058 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:48.653146 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:48.653292 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1685,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":398,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":3504,"spinlock_wait_cycles":59909632,"thread_start_us":4495,"threads_started":1,"wal-append.queue_time_us":4829}
I20260709 13:12:48.862291 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:48.914988 32724 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:48.945786 29448 raft_consensus.cc:1275] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:48.946069 32724 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:48.946583 29278 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35182 (request call id 64) took 4614 ms. Trace:
I20260709 13:12:48.947242 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:48.925103 29419 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:48.927747 29451 raft_consensus.cc:1275] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:12:48.932358 32719 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:48.933308   344 log.cc:927] Time spent T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.118s	user 0.000s	sys 0.002s
I20260709 13:12:48.938055 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:48.940016 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:48.944255 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:48.945277 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:48.966890 29450 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:48.967790 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:48.953585 29495 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:12:48.955291 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:48.956756 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:48.969046 29378 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:48.957316 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:48.970193 29529 raft_consensus.cc:2393] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 10: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:48.946983 29278 rpcz_store.cc:276] 0709 13:12:44.331973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:44.332182 (+   209us) service_pool.cc:224] Handling call
0709 13:12:48.946474 (+4614292us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:46.733548 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:46.734347 (+   799us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:46.734404 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:12:46.734433 (+    29us) tablet.cc:662] Decoding operations
0709 13:12:46.735099 (+   666us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:46.735176 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:46.735223 (+    47us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:12:46.735595 (+   372us) tablet.cc:701] Row locks acquired
0709 13:12:46.735625 (+    30us) write_op.cc:260] PREPARE: finished
0709 13:12:46.739351 (+  3726us) write_op.cc:270] Start()
0709 13:12:46.760295 (+ 20944us) write_op.cc:276] Timestamp: P: 1783602766739283 usec, L: 0
0709 13:12:46.764040 (+  3745us) op_driver.cc:348] REPLICATION: starting
0709 13:12:46.892279 (+128239us) log.cc:844] Serialized 988 byte log entry
0709 13:12:48.142289 (+1250010us) spinlock_profiling.cc:243] Waited 7.26 ms on lock 0x7b18002789e0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c993f3 00007f6a78c9b7c1 00007f6a78c9b779 00007f6a78c9b709 00007f6a78c9b6d1 00007f6a78c9a9cd 000000000038f354 000000000038f199 00007f6a78c7c83a
0709 13:12:48.351099 (+208810us) op_driver.cc:464] REPLICATION: finished
0709 13:12:48.555023 (+203924us) write_op.cc:301] APPLY: starting
0709 13:12:48.555164 (+   141us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:48.555296 (+   132us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:48.555321 (+    25us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:48.555754 (+   433us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:48.555944 (+   190us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:12:48.555988 (+    44us) write_op.cc:312] APPLY: finished
0709 13:12:48.556225 (+   237us) log.cc:844] Serialized 28 byte log entry
0709 13:12:48.556426 (+   201us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:48.556528 (+   102us) write_op.cc:454] Released schema lock
0709 13:12:48.556575 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:48.557021 (+   446us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:48.557056 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1050034,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":195078,"apply.run_cpu_time_us":2018,"apply.run_wall_time_us":6724,"num_ops":2,"prepare.queue_time_us":208331,"prepare.run_cpu_time_us":16949,"prepare.run_wall_time_us":287266,"raft.queue_time_us":131636,"raft.run_cpu_time_us":22856,"raft.run_wall_time_us":174232,"replication_time_us":1574525,"spinlock_wait_cycles":16692864,"thread_start_us":334816,"threads_started":4,"wal-append.queue_time_us":128010}]]}
I20260709 13:12:48.960067 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
W20260709 13:12:48.961396 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:48.962899 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:48.971807 29523 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:12:48.958688 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:48.975207 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:48.977291 29525 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
W20260709 13:12:48.950318 32407 log.cc:927] Time spent T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:12:48.981177 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:48.981685 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:48.991616 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:48.995241 29344 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:48.999785 29378 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 10.
I20260709 13:12:48.979310 32397 consensus_queue.cc:1048] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:12:48.875646 29526 rpcz_store.cc:276] 0709 13:12:47.421055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:47.707808 (+286753us) service_pool.cc:224] Handling call
0709 13:12:47.708114 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:47.708698 (+   584us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:12:47.709076 (+   378us) log.cc:844] Serialized 14 byte log entry
0709 13:12:48.739856 (+1030780us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b1800383ce0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c7be07 00007f6a81ad6ab9 00007f6a78c9869b 00007f6a78c9693f 00007f6a78c98c02 00007f6a7b92020b 00007f6a7b925d23 00007f6a7b92623a 00007f6a7bd90a2a
0709 13:12:48.869413 (+129557us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:48.869473 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:48.869520 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:48.869592 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:48.869772 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":163,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":4761,"raft.queue_time_us":5229,"spinlock_wait_cycles":5714816,"thread_start_us":128302,"threads_started":1}
I20260709 13:12:48.945818 32560 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:49.045367 29450 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
I20260709 13:12:49.045748 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:48.990007 32589 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:48.964540 32733 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.971213 32568 raft_consensus.cc:2804] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:48.972358 32721 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.052093 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:12:49.053278 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:49.055830 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 53479.2us
I20260709 13:12:49.063751 32741 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:48.898478 32734 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:49.066078 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:49.190478 29522 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:12:48.935516 32720 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:49.106381 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:49.115620 29380 raft_consensus.cc:1275] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:12:49.118232 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:49.113806 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:49.124130 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 131193us
I20260709 13:12:49.200893 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:49.202164 29529 raft_consensus.cc:2393] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 9: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:49.049811 32735 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:49.137341 32586 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:48.965044   341 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:49.141273 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:49.143100 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:49.056864 32719 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:49.126348 32407 log.cc:927] Time spent T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2: Append to log took a long time: real 0.071s	user 0.004s	sys 0.000s
I20260709 13:12:49.158840 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:49.144907 32680 raft_consensus.cc:2804] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:12:49.126221 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 131113us
I20260709 13:12:49.228392 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:49.234238 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:49.215924 29276 catalog_manager.cc:5697] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:49.158766 32568 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:49.254495 29378 raft_consensus.cc:2393] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 12: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:49.253350 29377 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:49.255654 29529 raft_consensus.cc:1240] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:49.276536 32589 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:49.278100 32407 tablet_bootstrap.cc:492] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=1 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:49.242794 32678 consensus_queue.cc:1059] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:12:49.279237 32407 tablet_bootstrap.cc:492] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap complete.
I20260709 13:12:49.279718 32678 raft_consensus.cc:3055] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:49.279959 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:49.295161 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:49.167730 32733 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:49.281211 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:49.282521 32586 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:49.276539 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:49.285197 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:49.236003   343 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.244477   339 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:49.299791 29380 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:12:49.300823 29375 raft_consensus.cc:2393] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 13: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:49.301774 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:49.307672 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:49.307888 29372 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 8.
I20260709 13:12:49.252583 32680 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:49.190572 32721 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:49.317795 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:49.285254 32568 raft_consensus.cc:3060] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:49.206710 32741 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:49.303009 32629 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:49.330574 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:49.332945 29521 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.017s	sys 0.041s
I20260709 13:12:49.334096 29375 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:49.346211 29521 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.018s	sys 0.041s
I20260709 13:12:49.293958 32678 raft_consensus.cc:740] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:49.314641   343 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:49.331823 32738 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:49.327931 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:49.347987 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:49.356637 29372 raft_consensus.cc:2393] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 11: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:49.356673 29377 raft_consensus.cc:2410] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:12:49.355436 29378 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:49.328233 32680 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:49.359663 32733 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:49.361258 32587 raft_consensus.cc:3055] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:49.327406 32745 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.342464 32407 ts_tablet_manager.cc:1403] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent bootstrapping tablet: real 1.842s	user 0.059s	sys 0.042s
I20260709 13:12:49.345100 32424 raft_consensus.cc:2804] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:49.413225 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:49.413090 29276 catalog_manager.cc:5697] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:49.352463 32741 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:49.354806 32735 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:49.435287 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:49.462414 29377 raft_consensus.cc:2393] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 10: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:49.317984   339 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:49.443964 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:49.445236 29524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 1433) took 1140 ms. Trace:
I20260709 13:12:49.447371 32424 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:49.448557 32720 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:49.354640 32629 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:49.399621 32738 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:49.470747 29376 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:12:49.408053 32587 raft_consensus.cc:740] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:12:49.473919 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 370520us
I20260709 13:12:49.524155 29378 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
I20260709 13:12:49.710315 29375 raft_consensus.cc:1275] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:12:49.473419 29524 rpcz_store.cc:276] 0709 13:12:48.304336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:48.741255 (+436919us) service_pool.cc:224] Handling call
0709 13:12:48.741652 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:48.750718 (+  9066us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:48.750761 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:48.751298 (+   537us) log.cc:844] Serialized 26 byte log entry
0709 13:12:49.183830 (+432532us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:49.229541 (+ 45711us) log.cc:844] Serialized 14 byte log entry
0709 13:12:49.230261 (+   720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:49.230394 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:49.444997 (+214603us) raft_consensus.cc:1685] finished
0709 13:12:49.445020 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:49.445168 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22698,"prepare.queue_time_us":45340,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":10610,"raft.queue_time_us":680,"raft.run_cpu_time_us":346,"raft.run_wall_time_us":30715,"thread_start_us":432027,"threads_started":1,"wal-append.queue_time_us":660483}
I20260709 13:12:49.725476 29527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 1428) took 1450 ms. Trace:
W20260709 13:12:49.736972 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:49.584170 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:49.566195 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 300052us
I20260709 13:12:49.756382 29447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2117) took 1159 ms. Trace:
I20260709 13:12:49.789933 29527 rpcz_store.cc:276] 0709 13:12:48.275005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:48.616423 (+341418us) service_pool.cc:224] Handling call
0709 13:12:48.648689 (+ 32266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:48.649106 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:48.649139 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:48.909314 (+260175us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b180033dc60. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c672a6 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7a67fa11 00007f6a7a68f372 00007f6a7bdc1a01 00007f6a7bd8643a
0709 13:12:48.910735 (+  1421us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b2c001231f8. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7a67fa11 00007f6a7a68f372 00007f6a7bdc1a01 00007f6a7bd8643a 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2
0709 13:12:48.911384 (+   649us) log.cc:844] Serialized 26 byte log entry
0709 13:12:49.360011 (+448627us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:49.429140 (+ 69129us) log.cc:844] Serialized 14 byte log entry
0709 13:12:49.429488 (+   348us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:49.429608 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:49.725214 (+295606us) raft_consensus.cc:1685] finished
0709 13:12:49.725238 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:49.725400 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51750,"prepare.queue_time_us":98317,"raft.queue_time_us":1935,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":43957,"spinlock_wait_cycles":20316416,"thread_start_us":369748,"threads_started":1,"wal-append.queue_time_us":742538}
I20260709 13:12:49.795982 29447 rpcz_store.cc:276] 0709 13:12:48.596413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:48.641324 (+ 44911us) service_pool.cc:224] Handling call
0709 13:12:48.646041 (+  4717us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:48.679265 (+ 33224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:48.681764 (+  2499us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:48.682260 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 13:12:48.967829 (+285569us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b18002888e0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c7be07 00007f6a81ad6ab9 00007f6a78c9869b 00007f6a78c9693f 00007f6a78c98c02 00007f6a7b92020b 00007f6a7b925d23 00007f6a7b9260d1 00007f6a7bd41a0f
0709 13:12:49.414624 (+446795us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:49.418605 (+  3981us) log.cc:844] Serialized 14 byte log entry
0709 13:12:49.418888 (+   283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:49.445694 (+ 26806us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b18002888e0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c993f3 00007f6a78c9b7c1 00007f6a78c9b779 00007f6a78c9b709 00007f6a78c9b6d1 00007f6a78c9a9cd 000000000038f354 000000000038f199 00007f6a78c7c83a
0709 13:12:49.755882 (+310188us) spinlock_profiling.cc:243] Waited 32.7 ms on lock 0x7b54003421d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:49.755956 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:49.756011 (+    55us) raft_consensus.cc:1685] finished
0709 13:12:49.756024 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:49.756256 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3515,"prepare.queue_time_us":5283,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"raft.queue_time_us":207,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":22542,"spinlock_wait_cycles":135832448,"thread_start_us":446325,"threads_started":1,"wal-append.queue_time_us":1013823}
I20260709 13:12:49.531857 29374 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
W20260709 13:12:49.856722 29344 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.012s	sys 0.006s
W20260709 13:12:49.859184 29344 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.013s	sys 0.006s
W20260709 13:12:49.669502   338 log.cc:927] Time spent T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.325s	user 0.002s	sys 0.000s
W20260709 13:12:49.601933   349 log.cc:927] Time spent T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
W20260709 13:12:49.859879 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 534797us
I20260709 13:12:49.776234 29276 catalog_manager.cc:5697] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 5 to 6, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 6 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
W20260709 13:12:49.529493   345 log.cc:927] Time spent T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.080s	user 0.002s	sys 0.000s
I20260709 13:12:49.472172   307 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.861557 29372 raft_consensus.cc:1240] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:49.753100   341 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:49.804591 32589 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:49.610852 32670 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.890282 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:49.913630 29372 raft_consensus.cc:2376] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11. Re-sending same reply.
W20260709 13:12:49.863000 29495 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.000s	sys 0.025s
I20260709 13:12:49.418524 32745 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:49.744187   346 log.cc:927] Time spent T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
W20260709 13:12:49.729282   351 log.cc:927] Time spent T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
W20260709 13:12:49.742830   350 log.cc:927] Time spent T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:12:49.633306 32735 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:49.722849   347 log.cc:927] Time spent T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.398s	user 0.000s	sys 0.001s
W20260709 13:12:49.524536 32724 consensus_meta.cc:287] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.578s	user 0.010s	sys 0.002s
I20260709 13:12:49.889874 32765 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.717482 32613 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:49.881075 29344 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:49.888628 29449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2118) took 1291 ms. Trace:
I20260709 13:12:49.857122 32680 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:49.889214 32397 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.957315 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:49.889336   343 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:49.804811 32748 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:49.762970 32741 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
W20260709 13:12:49.915906 29495 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.001s	sys 0.026s
I20260709 13:12:49.806511 32424 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:49.890631   307 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:49.882426 32587 consensus_queue.cc:260] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:12:49.932159 29525 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.029s	sys 0.060s
W20260709 13:12:49.973148 29525 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.030s	sys 0.060s
I20260709 13:12:49.910182 32730 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:49.915555 32589 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:49.961354 29528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 1435) took 1588 ms. Trace:
W20260709 13:12:49.963943 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 725727us
I20260709 13:12:49.933758 29449 rpcz_store.cc:276] 0709 13:12:48.597090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:48.621389 (+ 24299us) service_pool.cc:224] Handling call
0709 13:12:48.646746 (+ 25357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:48.648077 (+  1331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:48.648114 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:48.680265 (+ 32151us) log.cc:844] Serialized 26 byte log entry
0709 13:12:48.972011 (+291746us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:49.001288 (+ 29277us) log.cc:844] Serialized 14 byte log entry
0709 13:12:49.055790 (+ 54502us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:49.055891 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:49.888364 (+832473us) raft_consensus.cc:1685] finished
0709 13:12:49.888387 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:49.888543 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54256,"prepare.queue_time_us":28951,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":54921,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":27968,"thread_start_us":284195,"threads_started":1,"wal-append.queue_time_us":653422}
I20260709 13:12:49.990145 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:12:49.936774 32685 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.003s	sys 0.018s
W20260709 13:12:49.936580 32728 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.012s	sys 0.038s
I20260709 13:12:49.489138 32678 consensus_queue.cc:260] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:49.933871 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 52912.6us
I20260709 13:12:49.877853 32407 raft_consensus.cc:359] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:12:49.975625   362 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:49.975773 32734 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:49.966594 32397 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:50.009615 29344 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:49.967141 32748 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:49.980015 32730 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:49.982384 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:49.918552 32670 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:49.961812 32613 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:49.985572 32662 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.986475 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:50.034900 29376 raft_consensus.cc:2410] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:12:49.990871 29372 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:49.988977 29528 rpcz_store.cc:276] 0709 13:12:48.372692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:48.773233 (+400541us) service_pool.cc:224] Handling call
0709 13:12:48.773754 (+   521us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:48.774202 (+   448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:48.774244 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:48.774815 (+   571us) log.cc:844] Serialized 26 byte log entry
0709 13:12:49.338883 (+564068us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:49.338942 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:49.339037 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:49.960997 (+621960us) raft_consensus.cc:1685] finished
0709 13:12:49.961032 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:49.961263 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":870,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":111,"thread_start_us":473318,"threads_started":1,"wal-append.queue_time_us":695976}
I20260709 13:12:49.963716 32669 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:49.996807 29521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 1432) took 1693 ms. Trace:
I20260709 13:12:50.042586 29521 rpcz_store.cc:276] 0709 13:12:48.303540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:48.717573 (+414033us) service_pool.cc:224] Handling call
0709 13:12:48.717985 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:48.741235 (+ 23250us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:12:48.741286 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:48.741995 (+   709us) log.cc:844] Serialized 26 byte log entry
0709 13:12:49.346755 (+604760us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:49.346819 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:49.346919 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:49.996526 (+649607us) raft_consensus.cc:1685] finished
0709 13:12:49.996552 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:49.996732 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22669,"raft.queue_time_us":23824,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"spinlock_wait_cycles":36224,"thread_start_us":604240,"threads_started":1,"wal-append.queue_time_us":800106}
I20260709 13:12:49.998391 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:49.934864 32735 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:49.933976 32724 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:49.956396 32765 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:49.994825 32685 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.003s	sys 0.019s
I20260709 13:12:49.582921 32618 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.019516 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:50.025022 29346 connection.cc:256] RPC call timeout handler was delayed by -1.2558722220001073s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1845s for a response
I20260709 13:12:50.025169 29530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 1430) took 1748 ms. Trace:
W20260709 13:12:50.004312 32728 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.012s	sys 0.039s
I20260709 13:12:50.028633 29344 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:49.971247 32741 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:50.033428   341 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:50.004842 32407 raft_consensus.cc:740] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Initialized, Role: LEARNER
I20260709 13:12:50.059659 29373 raft_consensus.cc:1240] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:12:50.061585 32738 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:50.052699 29376 raft_consensus.cc:1240] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:12:50.075515 29346 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:50.070055 29530 rpcz_store.cc:276] 0709 13:12:48.276922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:48.658112 (+381190us) service_pool.cc:224] Handling call
0709 13:12:48.658625 (+   513us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:48.720472 (+ 61847us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:48.720525 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:48.733492 (+ 12967us) log.cc:844] Serialized 26 byte log entry
0709 13:12:48.868006 (+134514us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:48.868056 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:48.914086 (+ 46030us) spinlock_profiling.cc:243] Waited 61.3 ms on lock 0x7b5400231ed4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:48.914154 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:50.006397 (+1092243us) raft_consensus.cc:1685] finished
0709 13:12:50.006422 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:50.025041 (+ 18619us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":672,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":102,"spinlock_wait_cycles":140877696,"thread_start_us":133627,"threads_started":1,"wal-append.queue_time_us":739647}
I20260709 13:12:50.049513 32678 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:50.079758 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 51233.2us
I20260709 13:12:50.090458 29372 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
I20260709 13:12:50.086989 29376 raft_consensus.cc:1240] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:12:50.081472 29375 raft_consensus.cc:1240] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:12:50.069108   307 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:50.016737   362 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:50.107231 29373 raft_consensus.cc:1275] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:12:50.077445   341 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:50.079679   343 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.080045 32720 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:50.113308 29379 raft_consensus.cc:1275] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:12:50.133014 29381 raft_consensus.cc:1275] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:50.092427   363 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.056790 32662 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:50.057215 32669 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:50.150874 32669 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:50.134363 29380 raft_consensus.cc:1217] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 8.5->[9.6-9.6]   Dedup: 9.6->[]
I20260709 13:12:50.079597 32685 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.136575   339 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:50.136673 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:50.115537 32719 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:50.151477 32669 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.154933 32669 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:50.142629   343 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:50.157226 32669 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:50.157793   343 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:50.074348 32618 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:50.154076 32670 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:50.121344   341 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:50.152048 32685 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:50.160905 32618 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:50.137790 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:50.161823 32685 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:50.154284 32741 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:50.137883 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:50.163105 29522 raft_consensus.cc:2368] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 11. Current term is 12.
I20260709 13:12:50.138583 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:50.164438   363 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:50.165308 32662 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:50.166939   363 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:50.136929 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:50.175240 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:50.176227 29529 raft_consensus.cc:1240] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:50.112380 32613 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:50.138494 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:50.177897 29524 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:12:50.092028 32629 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:50.122833 29344 leader_election.cc:304] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:50.148466   362 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:50.151919 29380 raft_consensus.cc:1240] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:12:50.140472 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:50.181869 32721 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:50.141976 32407 consensus_queue.cc:260] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:12:50.188084 32407 ts_tablet_manager.cc:1434] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent starting tablet: real 0.769s	user 0.009s	sys 0.005s
I20260709 13:12:50.188180 32587 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:50.188715 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:50.189256 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:50.216629 32424 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:50.218933 32589 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:50.220439 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 308791us
I20260709 13:12:50.223340 29529 raft_consensus.cc:2410] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:12:50.227246 29372 raft_consensus.cc:1240] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:12:50.106544 32734 raft_consensus.cc:2764] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:12:50.229564   339 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.229725 32719 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:50.230947 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 108258us
I20260709 13:12:50.269932 29344 leader_election.cc:400] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 11. Current term is 12.
I20260709 13:12:50.233480 32720 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:50.236581 32724 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:50.188508 32407 ts_tablet_manager.cc:1467] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2: Tablet startup took 775ms
W20260709 13:12:50.239442 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:50.272782 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:50.273501 29521 raft_consensus.cc:2468] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 7.
I20260709 13:12:50.276286 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:50.277170 29530 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
W20260709 13:12:50.237317 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 244985us
I20260709 13:12:50.258370 29276 catalog_manager.cc:5697] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:50.231604 32685 raft_consensus.cc:2749] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:50.280292 29344 leader_election.cc:403] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:50.275187 30119 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:12:50.287621 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:50.296271 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:50.279883 29276 catalog_manager.cc:5697] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:50.219352 32424 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:50.309628 30158 raft_consensus.cc:1275] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 LEARNER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:12:50.310875 32735 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:50.310958 30157 raft_consensus.cc:1217] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 LEARNER]: Deduplicated request from leader. Original: 8.5->[8.6-8.6]   Dedup: 8.6->[]
W20260709 13:12:50.270037 32568 consensus_meta.cc:287] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.925s	user 0.013s	sys 0.001s
I20260709 13:12:50.312626 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:50.317761 29344 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:50.322793 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:50.323719 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:50.324453 29522 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:12:50.323765 29528 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:12:50.302171 29276 catalog_manager.cc:5697] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 6 to 8, now has a pending config: VOTER 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129), VOTER 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130), VOTER 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131), NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132). New cstate: current_term: 8 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:12:50.361271   374 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:50.354130 32670 consensus_queue.cc:1048] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:12:50.366667 29495 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:50.311939   300 raft_consensus.cc:2804] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:50.307307 32589 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 11. Current term is 12.
W20260709 13:12:50.357971 32698 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.013s	sys 0.015s
I20260709 13:12:50.326656 32735 raft_consensus.cc:2804] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:50.289363 32719 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:50.369995 32735 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:50.369818   374 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:50.370460 32735 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:50.328995 32613 consensus_queue.cc:1059] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:12:50.326321 32568 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:50.372159 32719 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:50.372820 29454 raft_consensus.cc:1240] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:50.372888   374 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:50.368625 32698 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.014s	sys 0.016s
I20260709 13:12:50.343139   373 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:50.368184   300 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:50.374459   300 raft_consensus.cc:3060] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:50.374233   373 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:50.375335 32568 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Requested vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:12:50.354650 29279 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37608 (request call id 153) took 12436 ms (client timeout 15000 ms). Trace:
I20260709 13:12:50.376880 32568 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:50.377321   373 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:50.377468 32568 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:50.288931 32720 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:50.367987 29276 catalog_manager.cc:5697] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 7 to 9, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 9 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:50.380133 29276 catalog_manager.cc:5697] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:50.343547 32748 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:50.324153 32680 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:50.377064 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:50.286607   339 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:50.385515   339 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:50.271931 32407 ts_tablet_manager.cc:1469] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2: Trace:
0709 13:12:44.121868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:44.122060 (+   192us) service_pool.cc:224] Handling call
0709 13:12:44.123177 (+  1117us) ts_tablet_manager.cc:934] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2: Initiating tablet copy from peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127)
0709 13:12:45.321290 (+1198113us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:12:46.031838 (+710548us) tablet_metadata.cc:665] Metadata flushed
0709 13:12:46.037742 (+  5904us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:12:46.464606 (+426864us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:12:46.465069 (+   463us) tablet_replica.cc:206] Creating consensus instance
0709 13:12:46.465506 (+   437us) ts_tablet_manager.cc:989] Replica registered.
0709 13:12:46.465591 (+    85us) inbound_call.cc:177] Queueing success response
0709 13:12:47.057320 (+591729us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b180037fc00. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c13c0a 00007f6a82353219 00007f6a78b3ded8 00007f6a78c98de2 00007f6a80cfdd23 00007f6a80cfd55d 00007f6a80d993d8 00007f6a80dcaf4e 00007f6a80daffdd
0709 13:12:47.500307 (+442987us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:12:49.419357 (+1919050us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:12:49.738517 (+319160us) tablet_replica.cc:261] Starting instrumentation
0709 13:12:49.739486 (+   969us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":29953,"mutex_wait_us":57397,"raft.queue_time_us":3462,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":120,"spinlock_wait_cycles":2856192,"tablet-copy.queue_time_us":198,"tablet-download-pool.queue_time_us":51095,"tablet-download-pool.run_cpu_time_us":1864,"tablet-download-pool.run_wall_time_us":232537,"thread_start_us":105724,"threads_started":1}
W20260709 13:12:50.387538 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:50.390883 29344 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:50.376573 29279 rpcz_store.cc:269] 0709 13:12:37.917918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:37.920255 (+  2337us) service_pool.cc:224] Handling call
0709 13:12:50.354529 (+12434274us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:44.951440 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:44.952274 (+   834us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:44.952321 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:12:44.952339 (+    18us) tablet.cc:662] Decoding operations
0709 13:12:44.954420 (+  2081us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:44.954475 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:44.954502 (+    27us) tablet.cc:685] Acquiring locks for 25 operations
0709 13:12:45.090444 (+135942us) tablet.cc:701] Row locks acquired
0709 13:12:45.090461 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:12:45.090667 (+   206us) write_op.cc:270] Start()
0709 13:12:45.090810 (+   143us) write_op.cc:276] Timestamp: P: 1783602765090614 usec, L: 0
0709 13:12:45.090832 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:12:45.130583 (+ 39751us) log.cc:844] Serialized 9928 byte log entry
0709 13:12:45.325580 (+194997us) op_driver.cc:464] REPLICATION: finished
0709 13:12:45.391036 (+ 65456us) write_op.cc:301] APPLY: starting
0709 13:12:45.391129 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:45.391680 (+   551us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:45.391857 (+   177us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:45.461485 (+ 69628us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:45.461876 (+   391us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=25
0709 13:12:45.461934 (+    58us) write_op.cc:312] APPLY: finished
0709 13:12:45.462534 (+   600us) log.cc:844] Serialized 169 byte log entry
0709 13:12:45.462746 (+   212us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:45.463012 (+   266us) write_op.cc:454] Released schema lock
0709 13:12:45.463102 (+    90us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:45.524146 (+ 61044us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:45.525384 (+  1238us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":20402,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":65153,"apply.run_cpu_time_us":10439,"apply.run_wall_time_us":72507,"num_ops":25,"prepare.queue_time_us":263286,"prepare.run_cpu_time_us":8219,"prepare.run_wall_time_us":186494,"replication_time_us":234547,"thread_start_us":163511,"threads_started":2}]]}
I20260709 13:12:50.374091   374 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:50.392890 32568 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:50.382120 29276 catalog_manager.cc:5697] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:50.417841 29276 catalog_manager.cc:5697] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 7 to 10, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 10 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:50.423275 29276 catalog_manager.cc:5697] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:50.409884   339 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:50.440629   339 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:50.441251 29276 catalog_manager.cc:5697] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:50.415427 32670 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:50.441051   339 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:50.449896   367 log.cc:927] Time spent T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:12:50.420799 29344 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:50.455693 29454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 260) took 1154 ms. Trace:
I20260709 13:12:50.461366 29276 catalog_manager.cc:5697] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 9 to 10, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 10 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:50.464610 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:50.465626 29529 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:50.467767   307 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.438405 32568 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:50.406606 32401 consensus_queue.cc:1048] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.041s
W20260709 13:12:50.468978 29495 connection.cc:256] RPC call timeout handler was delayed by -1.2700884880000558s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1523s for a response
I20260709 13:12:50.458039 29454 rpcz_store.cc:276] 0709 13:12:49.301322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.301499 (+   177us) service_pool.cc:224] Handling call
0709 13:12:49.301801 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:50.373849 (+1072048us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:50.455278 (+ 81429us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400252bd4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:50.455589 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2462689536}
I20260709 13:12:50.414036 32720 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:50.477257 29495 connection.cc:256] RPC call timeout handler was delayed by -1.2484884880000209s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1547s for a response
W20260709 13:12:50.477814 29495 connection.cc:256] RPC call timeout handler was delayed by -1.1350884880000649s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1673s for a response
W20260709 13:12:50.478210 29495 connection.cc:256] RPC call timeout handler was delayed by -1.1296884880000562s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16790000000000002s for a response
W20260709 13:12:50.478601 29495 connection.cc:256] RPC call timeout handler was delayed by -1.0594884879999427s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1757s for a response
I20260709 13:12:50.451220 32735 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:50.479255 29495 connection.cc:256] RPC call timeout handler was delayed by -1.0171884880001016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1804s for a response
I20260709 13:12:50.493559 29344 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:50.474949 29525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 1442) took 1272 ms. Trace:
I20260709 13:12:50.493062 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:50.499742 29528 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
W20260709 13:12:50.500633 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 395194us
I20260709 13:12:50.481019 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:50.493985 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:50.503945 29522 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:50.488279 29421 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.592s (SENT) [suppressed 9 similar messages]
W20260709 13:12:50.454852   368 log.cc:927] Time spent T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:12:50.447209 32397 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:50.517566 29346 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:50.497633 29495 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:50.501431 29525 rpcz_store.cc:276] 0709 13:12:49.202278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.263339 (+ 61061us) service_pool.cc:224] Handling call
0709 13:12:49.263736 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:49.298313 (+ 34577us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:49.298346 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:49.298873 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 13:12:49.973547 (+674674us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:49.982067 (+  8520us) log.cc:844] Serialized 14 byte log entry
0709 13:12:50.474454 (+492387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:50.474582 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:50.474651 (+    69us) raft_consensus.cc:1685] finished
0709 13:12:50.474673 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:50.474852 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41965,"prepare.queue_time_us":8959,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":163880,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":14255,"thread_start_us":1137758,"threads_started":2,"wal-append.queue_time_us":793084}
I20260709 13:12:50.496573 29344 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:50.469482 32670 raft_consensus.cc:697] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:50.427850   374 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:50.476320 32680 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:50.480010   373 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:50.520614 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 414120us
I20260709 13:12:50.537271 29495 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:50.472289 32734 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:50.482863 32765 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:50.533113 29346 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:50.512619 32589 raft_consensus.cc:2804] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:50.468422   307 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:12:50.559342   307 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:50.559540 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:50.494488 32730 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:50.561777 32730 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:50.562366 32730 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:50.563325 32735 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:50.522644 32721 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:50.564344 32721 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:50.566154 32765 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.566934 32765 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:50.570714 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:50.570994 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:50.571664 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:50.571988   377 raft_consensus.cc:2749] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:50.516644   372 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:50.572686 29373 raft_consensus.cc:2393] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 5: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:50.573022   372 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:50.571854 29381 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:12:50.571269 32765 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:50.576007 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:50.577764 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:50.578612 29374 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11.
I20260709 13:12:50.564891 32730 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:50.550637 29495 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:50.552992   343 raft_consensus.cc:2804] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:50.553182 32720 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:50.553640   384 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:50.543663 32734 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:50.554198 32629 raft_consensus.cc:2749] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:50.522399 32738 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:50.555711 29391 tablet_copy_service.cc:342] P 429e58eb058349e3bf72b5a870c8f6e5: Request end of tablet copy session ca041dab9b2f44409ed7bf4c6cf66ab2-829dc08ee0ca4212a3b2c870b0ea1b35 received from {username='slave'} at 127.0.0.1:58422
I20260709 13:12:50.546458 32589 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:50.480261 32568 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:50.564401   300 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:50.571854 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:50.630834 29376 raft_consensus.cc:2393] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 9: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:50.598546 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:50.632887 29378 raft_consensus.cc:2393] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 7: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:50.546322   373 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:50.597386 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 46885.7us
I20260709 13:12:50.552416 32670 consensus_queue.cc:237] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:50.521443 32397 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:50.616063 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:50.617197 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:50.614673 32734 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:50.615444 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:50.675669 29454 raft_consensus.cc:2393] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 10: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:50.543820   363 raft_consensus.cc:2804] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:50.682729 29522 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:50.619552 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:50.684969 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:50.686374 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:50.687068 29374 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
I20260709 13:12:50.621459 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:50.688544 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:50.689160 29452 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:50.623868 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:50.620957 32738 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:50.691874 29455 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:50.625046 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:50.692996 29450 raft_consensus.cc:2393] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 11: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:50.575335   372 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:50.693769 32738 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:50.694778 32568 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:50.682981   363 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:50.696617   363 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:50.674238   379 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:50.700090   379 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:50.701110   373 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:50.702941   379 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:50.725168 29455 raft_consensus.cc:1275] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:12:50.731069 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 195632us
I20260709 13:12:50.620844 29391 tablet_copy_service.cc:434] P 429e58eb058349e3bf72b5a870c8f6e5: ending tablet copy session ca041dab9b2f44409ed7bf4c6cf66ab2-829dc08ee0ca4212a3b2c870b0ea1b35 on tablet 829dc08ee0ca4212a3b2c870b0ea1b35 with peer ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:50.607873   343 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:50.613206   377 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:50.611037 32745 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:50.652208 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:50.750389 29456 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:50.646410 32397 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:12:50.715129   386 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.615227 32721 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:50.545812 32680 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:50.769913 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:50.769858   386 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:50.771991 32680 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:50.654824 32629 consensus_queue.cc:1059] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:12:50.778039 32629 raft_consensus.cc:3055] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:50.778467 32629 raft_consensus.cc:740] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:50.779414 32629 consensus_queue.cc:260] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:50.780964 32629 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:50.658779 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:50.783958 29451 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:50.660296 29372 raft_consensus.cc:1240] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:50.785753 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:50.786926 29372 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:50.661283 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:50.787979 29448 raft_consensus.cc:2393] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 13: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:50.789021 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:50.789657 29448 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:12:50.790637 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:50.649643 29495 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:50.778067 32724 raft_consensus.cc:3055] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:12:50.793030 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 143491us
I20260709 13:12:50.793315 32724 raft_consensus.cc:740] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:50.794081 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:50.794788 29375 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
I20260709 13:12:50.795068 29495 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:50.640278 29381 raft_consensus.cc:2393] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 9: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:50.816949 32424 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:50.817929 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:50.817847 32424 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:50.645026   385 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:50.619652 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:50.529460 32685 consensus_queue.cc:1048] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.090s
I20260709 13:12:50.638019 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:50.620451   384 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:50.794549 32724 consensus_queue.cc:260] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:50.831353 29449 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
W20260709 13:12:50.830063 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:50.707718 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:50.832846 29529 raft_consensus.cc:3060] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:50.832939 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:50.682421 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:50.833691 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:50.735674 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:50.834352 29453 raft_consensus.cc:2393] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 10: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
W20260709 13:12:50.704862   369 log.cc:927] Time spent T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:12:50.692989   300 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 8 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:50.614478 32730 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:50.623792 32589 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:50.761344   339 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:50.749588   343 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:50.765341 29421 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:50.768550   374 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:50.656139 30157 raft_consensus.cc:2393] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 8: Already voted for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in this term.
I20260709 13:12:50.775534   386 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:50.784307 29452 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
W20260709 13:12:50.668040 29377 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.009s	sys 0.040s
I20260709 13:12:50.795871   380 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:50.882086 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:50.797580 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:50.883005 29375 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
I20260709 13:12:50.883942 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:50.884156 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:12:50.884969 29375 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:12:50.885900 29375 raft_consensus.cc:606] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:12:50.886080 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:50.886343 29375 raft_consensus.cc:614] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:50.887337 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:50.888025 29449 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:12:50.889529 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:50.890419 30158 raft_consensus.cc:2368] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 7. Current term is 8.
I20260709 13:12:50.892083   389 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.892351 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:50.893150 29449 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:12:50.806209 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:50.894228 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:50.894903 29449 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:50.896241 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:50.897516 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:50.861416   324 consensus_queue.cc:1059] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:12:50.808359 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:50.899103 32764 raft_consensus.cc:3055] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:50.844175 32741 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:50.899540 32764 raft_consensus.cc:740] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:12:50.833864 29454 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:50.899816 29380 raft_consensus.cc:1240] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:50.638650 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:50.901610 32764 consensus_queue.cc:260] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:50.746225 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:50.910383 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:50.837867 29451 raft_consensus.cc:2410] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:12:50.838112 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:50.911427 29521 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:50.839390 29456 raft_consensus.cc:2410] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:12:50.912781 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:50.850003   377 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:50.841652 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:50.917735 29526 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:12:50.831468 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:50.834622 29455 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
I20260709 13:12:50.843480 29525 raft_consensus.cc:1240] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:50.843953 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:50.844939 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 49955.3us
I20260709 13:12:50.899883 32741 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:50.920163 29495 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:50.850196 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:50.920378 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:50.852083 29372 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
I20260709 13:12:50.919409 29454 raft_consensus.cc:2468] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:12:50.852415 29346 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:50.861402 29529 raft_consensus.cc:2468] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 8.
W20260709 13:12:50.922806 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 70499.8us
W20260709 13:12:50.881784 29377 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.009s	sys 0.040s
I20260709 13:12:50.924759 29377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1186) took 1568 ms. Trace:
I20260709 13:12:50.925375 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:50.926507 29455 raft_consensus.cc:2393] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 12: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:50.892724   389 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:12:50.899348   339 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:50.921465 29450 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:12:50.898080 29453 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:12:50.819435 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:50.928800 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:50.929246 29381 raft_consensus.cc:2393] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 10: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:50.903102 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:50.929440 29454 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:12:50.899394 29448 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:12:50.773051 29344 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:50.923667 30119 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:12:50.904528 32724 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:50.834466 29527 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:50.905988 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:50.804921   341 consensus_meta.cc:287] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.645s	user 0.011s	sys 0.002s
W20260709 13:12:50.906785 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 141804us
I20260709 13:12:50.933615 32670 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:50.908160 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:50.938019 32639 raft_consensus.cc:2804] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:50.913621 29456 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
I20260709 13:12:50.839929 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:50.945009 29523 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:12:50.915766 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:50.946928 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:50.921418 29376 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
I20260709 13:12:50.890321   384 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:12:50.930513 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 157557us
I20260709 13:12:50.950558 29344 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:50.807204 32397 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:50.951892 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:50.952773 29451 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:12:50.953795 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:50.954475 29451 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:12:50.955849 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:50.930843 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:50.925856 29377 rpcz_store.cc:276] 0709 13:12:49.356106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.463081 (+106975us) service_pool.cc:224] Handling call
0709 13:12:49.787372 (+324291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:49.787657 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:12:50.121805 (+334148us) log.cc:844] Serialized 14 byte log entry
0709 13:12:50.924362 (+802557us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:50.924430 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:50.924476 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:50.924549 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:50.924694 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":197707,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":26,"thread_start_us":1063620,"threads_started":2,"wal-append.queue_time_us":559144}
I20260709 13:12:50.932367 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:50.926512 29346 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:50.933328 29495 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:50.931346 32735 raft_consensus.cc:2749] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:50.938205 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:50.938954 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:50.975133 29447 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
I20260709 13:12:50.975047 29450 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:50.955375 32685 raft_consensus.cc:2804] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:50.914279 32568 consensus_queue.cc:1059] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:12:50.966214 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:50.959718 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:50.862676 32730 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:50.989614 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:50.990792 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:50.931828 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:50.942310 29421 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:50.943378 29452 raft_consensus.cc:3060] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:12:50.992204 29454 raft_consensus.cc:2393] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 9: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:50.992871 29451 raft_consensus.cc:1240] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:50.930608 32733 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:50.944254 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:51.005662 29456 raft_consensus.cc:1275] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:12:51.007161 29452 raft_consensus.cc:2468] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 8.
I20260709 13:12:51.007377 29456 raft_consensus.cc:1240] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:51.011202 29456 raft_consensus.cc:1240] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:50.974375 29521 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:12:50.976275 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:50.975803 32397 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:50.982931 29419 leader_election.cc:400] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Vote denied by peer ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671) with higher term. Message: Invalid argument: T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 7. Current term is 8.
I20260709 13:12:50.983696 29527 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:12:51.018769 29419 leader_election.cc:403] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:50.983946 29344 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:50.985410 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 58986.3us
W20260709 13:12:50.985819 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 52589.4us
I20260709 13:12:51.022125 29346 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:51.022485 29495 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:12:50.848758   385 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:50.973278 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:50.988801   382 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:50.995347 32568 raft_consensus.cc:3055] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:50.942495   372 consensus_queue.cc:1048] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.079s
I20260709 13:12:50.985282 32639 raft_consensus.cc:697] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:12:50.997612   390 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:51.048611 32639 consensus_queue.cc:237] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:51.050372 32589 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:50.939460 32680 raft_consensus.cc:2804] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:51.001914 29450 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:51.051728 32680 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:51.052153 32680 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:51.053318 29379 raft_consensus.cc:2393] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 7: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:51.012458 29447 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
I20260709 13:12:50.911666   386 raft_consensus.cc:2804] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:51.056674   386 raft_consensus.cc:697] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 10 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:50.941668   389 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:51.023375 29346 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:51.058010   386 consensus_queue.cc:237] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.024966 29449 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:12:51.029728 29455 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:12:51.061247 32741 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:51.026008 32735 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:51.059351 29346 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:51.064188 32735 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:51.034502 32670 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:51.065163 29346 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:51.065798 32670 raft_consensus.cc:697] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:51.066721   339 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:51.068713   339 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:50.999866 32685 raft_consensus.cc:697] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:12:50.996250 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 54039.3us
I20260709 13:12:51.077345 29421 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:51.078823 29421 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:50.992053   380 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:12:51.035955 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 69791.6us
I20260709 13:12:51.041916   385 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:51.026484 32745 raft_consensus.cc:2749] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671) with higher term. Message: Invalid argument: T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 7. Current term is 8.
I20260709 13:12:51.043612   378 consensus_queue.cc:1048] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:51.034585 32568 raft_consensus.cc:740] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:51.101608 32589 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:51.044488   381 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:51.102701   381 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:51.103304   381 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:51.045676 32678 consensus_queue.cc:1048] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:51.050904   376 consensus_queue.cc:1059] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:12:51.108201   376 raft_consensus.cc:3055] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:51.108631   376 raft_consensus.cc:740] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:51.109604   376 consensus_queue.cc:260] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.064781 32735 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:51.111734 32735 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:51.112630 32685 consensus_queue.cc:237] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.036616 32424 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:51.071918 29346 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:50.994663 32764 raft_consensus.cc:3060] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:51.122568 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 50741.3us
I20260709 13:12:51.120859 32589 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.123788 29346 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:51.124017 32589 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.126832 32589 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:51.126937 29346 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:51.087320 29452 raft_consensus.cc:1240] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:12:51.121436 32748 consensus_queue.cc:1048] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:12:51.090503 32629 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.037461 32401 consensus_queue.cc:1059] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:12:51.066777 32670 consensus_queue.cc:237] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:50.941102   341 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.111173   376 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:51.084358   372 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:51.028698 32397 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:51.132676 29344 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:12:51.130617 29421 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:51.084172   374 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:51.134199   339 consensus_queue.cc:1059] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:12:51.159821   339 raft_consensus.cc:3055] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:51.160326   339 raft_consensus.cc:740] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:51.133934 29346 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:51.142400 32730 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:51.161186   339 consensus_queue.cc:260] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.162144 29346 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:51.162472   339 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:51.127698 32733 raft_consensus.cc:2804] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:51.143878   363 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.139178 32401 raft_consensus.cc:3055] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:51.164559 32401 raft_consensus.cc:740] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:51.164788   363 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:51.148499 32734 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.165598 32401 consensus_queue.cc:260] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.166996 32734 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:51.167230 32401 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:51.152392 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:51.167692 32733 raft_consensus.cc:697] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:51.169130 32721 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:51.168706 32733 consensus_queue.cc:237] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.168802 32720 raft_consensus.cc:2749] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:51.151610 32568 consensus_queue.cc:260] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.136144   382 raft_consensus.cc:2804] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:12:51.153240 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 60797.3us
I20260709 13:12:51.142431   341 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:51.153844 32765 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:51.186923 29421 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:51.128659 32629 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.156250 29344 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:51.192523 29344 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:51.151072   343 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.130645 32589 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:51.174505 29346 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:51.218607 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 44197.5us
I20260709 13:12:51.220213 29346 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:51.183449 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 154114us
I20260709 13:12:51.221068 29378 raft_consensus.cc:1240] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:51.155162   385 raft_consensus.cc:2804] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:51.189581 29421 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:51.142782 32397 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:12:51.199081 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:51.208431 29527 raft_consensus.cc:1240] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:51.232533 32745 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:51.209427 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:12:51.233330 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 43835.9us
I20260709 13:12:51.210448 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:51.233947 29523 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:51.234300 29421 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:51.211400 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:51.235201 29530 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:51.212391 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:51.239770 32730 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:51.233880 32734 raft_consensus.cc:2804] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:51.240423 32730 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:51.240684 32734 raft_consensus.cc:697] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:51.240873 32730 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:51.201125 32765 raft_consensus.cc:697] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:51.241671 32734 consensus_queue.cc:237] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.242624 29523 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:12:51.242403 32765 consensus_queue.cc:237] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.239907 29525 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:12:51.246522 32745 consensus_queue.cc:1059] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:51.248652   372 raft_consensus.cc:3055] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:51.249498   372 raft_consensus.cc:740] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:51.216290 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:51.185323   382 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:51.252717   382 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:51.252717 29526 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:51.202013   341 raft_consensus.cc:2804] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:51.250870   372 consensus_queue.cc:260] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.255105   341 raft_consensus.cc:697] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:51.256393   341 consensus_queue.cc:237] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.260535   363 raft_consensus.cc:1064] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5: attempting to promote NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 to VOTER
I20260709 13:12:51.217099 32738 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:51.264183 32738 raft_consensus.cc:697] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:51.265556 32738 consensus_queue.cc:237] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.217403   365 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:51.267405   365 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.267897 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:51.268875 29523 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:12:51.270159   365 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:51.274816 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:51.276232 29529 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:51.278002 32735 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.279583 32424 consensus_queue.cc:1048] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:12:51.280382 32735 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:51.282496 32680 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:51.281251 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 61130.8us
W20260709 13:12:51.284845 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 62900.8us
I20260709 13:12:51.214913 29521 raft_consensus.cc:1240] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 LEADER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:51.286218 29495 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:51.289191 29346 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:51.294342 29495 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:51.300637 29346 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:51.312989 32589 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:51.309971 29344 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:51.287245   337 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:51.318442 29495 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:51.231905   385 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:51.313503   372 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:51.308060 32397 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.333573 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:51.338892 29346 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:51.311885 32724 raft_consensus.cc:2804] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:51.317307   380 raft_consensus.cc:2804] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:51.331965 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:51.308151   376 consensus_queue.cc:1059] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:12:51.373072 29529 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:12:51.306150 29530 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:51.362692 29346 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:51.363920   396 log.cc:927] Time spent T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:12:51.342222   390 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:51.314402 32678 consensus_queue.cc:1059] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:12:51.409770   339 raft_consensus.cc:2804] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:51.410311   339 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:51.410763   339 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:51.314988 32735 consensus_queue.cc:1059] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:12:51.411387   390 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:51.411962   390 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:51.410334 32678 raft_consensus.cc:3055] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:51.412577 32678 raft_consensus.cc:740] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:51.413620 32678 consensus_queue.cc:260] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.401885   382 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.370527 29525 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:12:51.342327   365 raft_consensus.cc:2804] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:51.424952   365 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:51.425524   365 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:51.342163 32589 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:51.427735 32589 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:51.449715 32678 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:51.456048   363 consensus_queue.cc:237] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 4, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:51.460044   382 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:51.461308 29526 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
W20260709 13:12:51.358281 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 48434.4us
I20260709 13:12:51.369017   378 raft_consensus.cc:2804] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:51.468099   378 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:51.369400   380 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
W20260709 13:12:51.468353 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 105796us
I20260709 13:12:51.368815 32397 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.469293   378 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:51.471046 32397 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:51.382248 32680 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:51.367528 32587 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:51.472301 32587 raft_consensus.cc:697] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:51.473407 32587 consensus_queue.cc:237] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.384318 32568 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:51.475903 29344 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:51.477164 32685 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:51.477600 32685 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:51.477952 32685 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:51.478615 32738 consensus_queue.cc:1059] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:51.358772   385 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:51.479609 32738 consensus_queue.cc:1243] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer 71aa3578fd924765ab9ac0729c8d1483 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:12:51.480060 32721 raft_consensus.cc:3055] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:51.480716 32721 raft_consensus.cc:740] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:51.481822 32721 consensus_queue.cc:260] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.366227 32720 raft_consensus.cc:2749] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:51.385365   381 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.485633   381 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:51.385818 32730 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.387861   343 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:51.389110 32629 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:51.389727 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:51.490809 32730 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:51.392309 32424 raft_consensus.cc:3055] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:51.491997 32424 raft_consensus.cc:740] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:51.492957 32424 consensus_queue.cc:260] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.494210 32424 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:51.355365   337 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:51.495810   337 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:51.498488   390 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:51.399689 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:51.404397 29523 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:12:51.468734   380 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:51.501793 32721 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:51.366590 32724 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:51.503746 32724 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:51.390029   376 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:51.504473   376 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.506569 29344 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:51.506986   376 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:51.520215 29344 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:51.524303 29344 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:51.525799 29346 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:51.524483   382 raft_consensus.cc:2804] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:12:51.530277 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:51.532173 29344 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:51.545651 29346 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:51.556353   390 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:51.557582   385 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.529213   378 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.547974   343 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:51.565177   343 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:51.565609   343 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:51.548310   382 raft_consensus.cc:697] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:51.528187 32738 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:51.567353   382 consensus_queue.cc:237] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:51.570288 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:51.571537 29344 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:51.577569 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:51.577927 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:51.578697 29523 raft_consensus.cc:2393] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 10: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:51.579833 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:51.580852 29529 raft_consensus.cc:1275] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:51.590699 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:51.591962 29529 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:51.612462 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 294110us
I20260709 13:12:51.571734   378 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:51.573311 32733 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:51.624668 29495 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:51.626284 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:51.527774 32589 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.629382 32587 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:51.621146   381 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:51.630383 32685 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.632028 32724 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.625702   341 raft_consensus.cc:2804] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:51.622107 29529 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:12:51.629990   365 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.609683   300 consensus_queue.cc:1048] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:12:51.672142 29452 raft_consensus.cc:1275] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:51.648167 29526 raft_consensus.cc:1240] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:51.673916   300 consensus_queue.cc:1048] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:51.674145 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:51.626299 32680 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:51.608700   380 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.626134 32738 raft_consensus.cc:697] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:51.659386   365 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:51.648545   385 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:51.653412 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:51.653695 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:51.655180 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:51.675457 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:51.626044 32733 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:51.652359   378 raft_consensus.cc:2804] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:51.606752   337 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.658818 32589 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:51.659309   381 raft_consensus.cc:697] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:51.656287 32735 raft_consensus.cc:3055] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:51.716723 32735 raft_consensus.cc:740] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:51.716396   343 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.717185   337 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:51.659929   341 raft_consensus.cc:697] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:51.718768   343 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:51.663375 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:51.663914 29522 raft_consensus.cc:1240] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:51.664844 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:51.721324 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:51.665858   339 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.682268 29530 raft_consensus.cc:1240] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:51.683998 29525 raft_consensus.cc:2393] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 7: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:51.684408 29521 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:12:51.724666 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:51.725540 29521 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
I20260709 13:12:51.683324 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:51.727219 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:51.727670 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:51.728259 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:51.729017 29523 raft_consensus.cc:2368] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 7. Current term is 8.
I20260709 13:12:51.728749 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:51.691970 29526 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:12:51.730909 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:51.735852 29526 raft_consensus.cc:2393] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 8: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:51.677402   380 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:51.681288 32724 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:51.679031 32685 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:51.694938 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:51.733405 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:51.734375 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:51.654999 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:51.755291 29527 raft_consensus.cc:2468] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:12:51.737258 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:51.756597 29526 raft_consensus.cc:2393] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 9: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:51.729815 29521 raft_consensus.cc:2393] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 9: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:51.729874 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:51.696252 32733 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:51.751523 29530 raft_consensus.cc:1240] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10. Ops: []
W20260709 13:12:51.753734 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:51.717764 32735 consensus_queue.cc:260] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:51.762373 29524 raft_consensus.cc:2393] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 11: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:51.769114 29523 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 7.
I20260709 13:12:51.763094 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:51.758555 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:51.720536   378 raft_consensus.cc:697] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:51.773993 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:51.783815 29524 raft_consensus.cc:1275] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:12:51.675915 32680 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:51.795897 29451 raft_consensus.cc:1240] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:51.810393 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:51.799937 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:51.677049 32738 consensus_queue.cc:237] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.805594 29454 raft_consensus.cc:1240] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:51.806524 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:51.807703 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:51.809760 32735 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:51.816921 29453 raft_consensus.cc:1240] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 13:12:51.716440   381 consensus_queue.cc:237] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.722633   341 consensus_queue.cc:237] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.856485 29448 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
I20260709 13:12:51.828892   339 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:51.830054   378 consensus_queue.cc:237] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:51.881132 29278 catalog_manager.cc:5697] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:51.889889 32680 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:51.901100 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:51.901399 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:51.902024 29453 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
W20260709 13:12:51.905875 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 360286us
W20260709 13:12:51.906749 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:51.918296 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:51.919370 29528 raft_consensus.cc:2393] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 10: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:51.931442 29278 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35182 (request call id 65) took 2075 ms. Trace:
W20260709 13:12:51.911113   417 log.cc:927] Time spent T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.178s	user 0.004s	sys 0.000s
I20260709 13:12:52.054738 30158 raft_consensus.cc:1275] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 LEARNER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:12:52.056143 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 136393us
I20260709 13:12:52.015336 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:12:52.021245 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:51.967424 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:52.005997 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:52.022017 29279 catalog_manager.cc:5697] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 10 to 11, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 11 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:51.933490 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:52.062122 29453 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:51.932906 29278 rpcz_store.cc:276] 0709 13:12:49.856444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:49.856658 (+   214us) service_pool.cc:224] Handling call
0709 13:12:51.931283 (+2074625us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:51.892987 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:51.893577 (+   590us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:51.893755 (+   178us) write_op.cc:435] Acquired schema lock
0709 13:12:51.893767 (+    12us) tablet.cc:662] Decoding operations
0709 13:12:51.894174 (+   407us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:51.894246 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:51.894274 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:12:51.894474 (+   200us) tablet.cc:701] Row locks acquired
0709 13:12:51.894488 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:12:51.894647 (+   159us) write_op.cc:270] Start()
0709 13:12:51.894766 (+   119us) write_op.cc:276] Timestamp: P: 1783602771894596 usec, L: 0
0709 13:12:51.894783 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:12:51.895435 (+   652us) log.cc:844] Serialized 534 byte log entry
0709 13:12:51.897636 (+  2201us) op_driver.cc:464] REPLICATION: finished
0709 13:12:51.898205 (+   569us) write_op.cc:301] APPLY: starting
0709 13:12:51.898318 (+   113us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:51.898468 (+   150us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:51.898615 (+   147us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:51.898915 (+   300us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:51.899117 (+   202us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:12:51.899190 (+    73us) write_op.cc:312] APPLY: finished
0709 13:12:51.899445 (+   255us) log.cc:844] Serialized 22 byte log entry
0709 13:12:51.899660 (+   215us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:51.899751 (+    91us) write_op.cc:454] Released schema lock
0709 13:12:51.899790 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:51.900180 (+   390us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:51.900218 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":172605,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":305,"apply.run_cpu_time_us":1937,"apply.run_wall_time_us":1936,"num_ops":1,"prepare.queue_time_us":142,"prepare.run_cpu_time_us":2632,"prepare.run_wall_time_us":2761,"replication_time_us":2663}]]}
W20260709 13:12:51.981562 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:52.070124 29419 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:52.071380 29419 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:52.075863 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:52.076490 29521 raft_consensus.cc:1275] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:12:52.076576 29529 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:52.080354 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:52.094800 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:52.097808 29344 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:52.099395 29495 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:52.100680 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:52.100910 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:52.101624 29379 raft_consensus.cc:2410] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:12:52.104343 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:52.104780 29529 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:12:52.105407 29376 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
I20260709 13:12:52.106614 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:52.107407 30158 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
W20260709 13:12:52.110231 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:52.111459 29378 raft_consensus.cc:1240] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:12:52.112577 29495 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:52.113318 29377 raft_consensus.cc:1275] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:52.116500 29377 raft_consensus.cc:1240] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:52.081535 32678 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.117940 29379 raft_consensus.cc:1240] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 13:12:52.118445 29522 raft_consensus.cc:1240] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:52.119571 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:52.119740 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:52.124855 29495 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:52.080157 32765 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.125536 29377 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
I20260709 13:12:52.121604 29378 raft_consensus.cc:1240] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:52.126868 29379 raft_consensus.cc:1240] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:52.128031 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:52.128326   410 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:52.151046 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:52.130908 29495 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:52.152499 29375 raft_consensus.cc:1275] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:12:52.128031 32724 raft_consensus.cc:2804] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:52.110534 32589 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:52.080490   390 raft_consensus.cc:2749] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:52.144112 29372 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
I20260709 13:12:52.148922 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:52.163311 29374 raft_consensus.cc:2393] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 10: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:52.155990 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:52.156090 29529 raft_consensus.cc:1275] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:52.110253   337 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:52.122969 32720 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:52.110065   343 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:52.165161 29279 catalog_manager.cc:5697] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 9 to 10, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 10 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:52.157958 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:52.168329 29378 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:52.167783 29375 raft_consensus.cc:2393] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 10: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:52.158591 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:52.158862 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:52.171451 29379 raft_consensus.cc:2393] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 12: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:52.122566 32424 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:52.159751 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:52.172303 29522 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:12:52.088971 32568 consensus_queue.cc:1059] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:12:52.174494 32568 raft_consensus.cc:3055] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:52.175052 32568 raft_consensus.cc:740] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:52.167258   337 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:52.177687 29380 raft_consensus.cc:2393] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 10: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:52.156638 32724 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:52.183982 29522 raft_consensus.cc:1275] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:12:52.109177 32730 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:52.119714   380 consensus_queue.cc:1048] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:12:52.152254 32765 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:52.191087 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:52.167759 32589 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:52.142174 32678 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:52.195999 32720 raft_consensus.cc:697] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:52.196516 32724 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:52.183486   410 raft_consensus.cc:2749] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:52.161211 32733 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:52.205780 29373 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:12:52.206321 29344 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:52.215878 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:52.225067 29525 raft_consensus.cc:1240] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 6. Current term is 7. Ops: []
W20260709 13:12:52.218112 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:52.222836 29375 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 8.
W20260709 13:12:52.230319 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:52.231649 32568 consensus_queue.cc:260] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:52.233765 32568 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:52.238024 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:52.239279 29375 raft_consensus.cc:2393] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 9: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:52.199007   343 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:52.251227 29377 raft_consensus.cc:1240] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:52.252053 29344 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:12:52.252799 29527 raft_consensus.cc:1275] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:12:52.207154 32680 consensus_queue.cc:1048] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:12:52.230048   382 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:12:52.254860 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 183544us
I20260709 13:12:52.259862 29419 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:52.261276 29419 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:52.262708 29419 leader_election.cc:400] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 7. Current term is 8.
I20260709 13:12:52.263746 29419 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:52.264340 32730 raft_consensus.cc:2764] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:12:52.269767   343 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:52.270453   343 consensus_queue.cc:1048] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:52.266680 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:52.274662 32733 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:52.274874 32720 consensus_queue.cc:237] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:52.275642   382 raft_consensus.cc:697] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:52.276830   382 consensus_queue.cc:237] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:52.277309 32678 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:52.267518 32685 raft_consensus.cc:2804] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:52.280567 32685 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:52.280958 32685 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:52.281010 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:52.283556 32765 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:52.266481   372 raft_consensus.cc:2804] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:52.285984   372 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:52.286379   372 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:52.287626   337 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:52.266695   390 raft_consensus.cc:2764] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:12:52.265904   421 consensus_queue.cc:1048] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
W20260709 13:12:52.292704 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:52.292476 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:52.294092 29419 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:52.296105 29378 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
I20260709 13:12:52.297690 29419 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:52.299542 29453 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
I20260709 13:12:52.297876 29375 raft_consensus.cc:2393] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 9: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
W20260709 13:12:52.326118 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 195250us
I20260709 13:12:52.327651 29495 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:52.274675 32589 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:52.334007 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:52.337602 29495 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:52.348219 29419 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:52.296813   390 raft_consensus.cc:2749] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:52.257709   381 consensus_queue.cc:1048] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:12:52.360013 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:52.359881 32730 raft_consensus.cc:2764] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:12:52.364800 32730 consensus_queue.cc:1059] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:52.362378   430 consensus_queue.cc:1059] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:12:52.369486 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:52.370661 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:52.371816 29379 raft_consensus.cc:1240] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:12:52.371948 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:52.372601 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:52.372947 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:52.373575 29372 raft_consensus.cc:2410] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:12:52.370750 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:52.367318   390 raft_consensus.cc:3055] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:52.375368   390 raft_consensus.cc:740] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:52.376371   390 consensus_queue.cc:260] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:52.378880 29373 raft_consensus.cc:1240] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:52.329655 32765 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:52.380426 29495 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:52.385133   380 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:52.385627   380 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:52.385954   380 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:52.388244 29380 raft_consensus.cc:1240] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:12:52.352905 32424 raft_consensus.cc:2749] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:52.389031 29372 raft_consensus.cc:1240] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:52.391415 29377 raft_consensus.cc:1240] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:52.400027 29279 catalog_manager.cc:5697] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 8 to 9, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 9 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:52.406239 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:52.411300 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:52.412309 29375 raft_consensus.cc:2393] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 7: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:52.402333 29279 catalog_manager.cc:5697] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 8 to 9, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 9 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:52.426442 29276 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37586 (request call id 135) took 8393 ms. Trace:
I20260709 13:12:52.423662 29279 catalog_manager.cc:5697] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 8 to 9, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 9 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:52.353940 32678 consensus_queue.cc:1048] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:12:52.490139 29377 raft_consensus.cc:2393] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 12: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:52.392333   410 raft_consensus.cc:2764] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:12:52.494293 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:52.497303 29375 raft_consensus.cc:1275] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:12:52.495608 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 235494us
I20260709 13:12:52.504082 29372 raft_consensus.cc:1240] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:52.505548 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:52.505961 29375 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:12:52.506616 29379 raft_consensus.cc:2410] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:12:52.506620 29375 raft_consensus.cc:606] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 LEADER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:12:52.508731 29421 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:52.510437 29421 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:52.510648 32765 raft_consensus.cc:2749] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:52.473390 29279 catalog_manager.cc:5697] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 7 to 8, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 8 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:52.512985 29279 catalog_manager.cc:5697] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 8 to 9, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 9 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:52.427865 29276 rpcz_store.cc:276] 0709 13:12:44.032902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:44.033096 (+   194us) service_pool.cc:224] Handling call
0709 13:12:44.179320 (+146224us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b5400422054. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcf0090 00007f6a7bd8ef3a 00007f6a81b451cc 00007f6a81c4337e 00007f6a801042a4 00007f6a80104232 00007f6a80104161 00007f6a801040dc 00007f6a80103392 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:52.426353 (+8247033us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:50.986229 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:51.066638 (+ 80409us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:51.066677 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:12:51.066695 (+    18us) tablet.cc:662] Decoding operations
0709 13:12:51.067945 (+  1250us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:51.068042 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:51.068080 (+    38us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:12:51.069305 (+  1225us) tablet.cc:701] Row locks acquired
0709 13:12:51.069326 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:12:51.069512 (+   186us) write_op.cc:270] Start()
0709 13:12:51.069662 (+   150us) write_op.cc:276] Timestamp: P: 1783602771069444 usec, L: 0
0709 13:12:51.069684 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:12:51.153490 (+ 83806us) log.cc:844] Serialized 5487 byte log entry
0709 13:12:51.650217 (+496727us) op_driver.cc:464] REPLICATION: finished
0709 13:12:51.700492 (+ 50275us) write_op.cc:301] APPLY: starting
0709 13:12:51.700693 (+   201us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:51.701227 (+   534us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:51.701412 (+   185us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:51.845796 (+144384us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:51.846076 (+   280us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 13:12:51.846121 (+    45us) write_op.cc:312] APPLY: finished
0709 13:12:51.846467 (+   346us) log.cc:844] Serialized 94 byte log entry
0709 13:12:51.846684 (+   217us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:51.846875 (+   191us) write_op.cc:454] Released schema lock
0709 13:12:51.846938 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:51.869076 (+ 22138us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:51.869117 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1168614,"reported_tablets":48,"spinlock_wait_cycles":299521920,"child_traces":[["op",{"apply.queue_time_us":49902,"apply.run_cpu_time_us":5985,"apply.run_wall_time_us":154066,"num_ops":13,"prepare.queue_time_us":384126,"prepare.run_cpu_time_us":49545,"prepare.run_wall_time_us":507944,"raft.queue_time_us":220337,"raft.run_cpu_time_us":5198,"raft.run_wall_time_us":53072,"replication_time_us":580159,"spinlock_wait_cycles":1936768,"thread_start_us":815594,"threads_started":4,"wal-append.queue_time_us":273053}]]}
I20260709 13:12:52.532657 29279 catalog_manager.cc:5697] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:52.534741 29279 catalog_manager.cc:5697] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 7 to 8, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 8 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:52.542876 29377 raft_consensus.cc:1240] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:52.542737 29279 catalog_manager.cc:5697] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 7 to 8, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 8 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:52.529093   324 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:52.551128 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 191282us
W20260709 13:12:52.573230 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:52.589882 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 208352us
I20260709 13:12:52.595844 29279 catalog_manager.cc:5697] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 7 to 9, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 9 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:52.594041 29419 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:52.593941   436 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.594967   324 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:52.605690   390 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:52.606808   324 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:52.612949   430 raft_consensus.cc:2749] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:52.613802   430 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.614253   430 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:52.614972   390 raft_consensus.cc:2764] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:12:52.624496   430 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:52.550181 32724 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:52.629398 32724 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:52.630033 32724 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.630515 32724 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:52.634359 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:52.635119 29526 raft_consensus.cc:2468] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 5.
I20260709 13:12:52.636544 32678 consensus_queue.cc:1059] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 10.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:52.602675   436 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:52.638090   410 raft_consensus.cc:3055] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:52.638634   410 raft_consensus.cc:740] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
W20260709 13:12:52.644348 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:52.603607 29279 catalog_manager.cc:5697] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: config changed from index -1 to 6, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added, no longer has a pending config: VOTER 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129), VOTER 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130), VOTER 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131), NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132). New cstate: current_term: 8 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:12:52.641930 30119 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:12:52.641341 29495 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:52.654347 29495 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:52.661512 29279 catalog_manager.cc:5697] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 7 to 8, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 8 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:52.638959   380 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:52.665824 29279 catalog_manager.cc:5697] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 7 to 9, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 9 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:52.674979 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 164591us
I20260709 13:12:52.677575 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:52.603798   438 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:52.652280 32738 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.684778 29421 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:52.681258 29279 catalog_manager.cc:5697] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:52.639854   410 consensus_queue.cc:260] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:52.688133 29421 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:52.690999 29377 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:12:52.689299 29279 catalog_manager.cc:5697] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 7 to 8, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 8 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:52.695564 29377 raft_consensus.cc:606] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:12:52.696089 29377 raft_consensus.cc:614] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:52.697149 29279 catalog_manager.cc:5697] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 8 to 9, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 9 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:52.667548   416 raft_consensus.cc:2804] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:52.699927 29421 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:52.699365 29279 catalog_manager.cc:5697] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 4 to 6, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 6 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:52.710201 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 55924.9us
W20260709 13:12:52.711333 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 117412us
I20260709 13:12:52.703282 29421 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:52.707743 29279 catalog_manager.cc:5697] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 6 to 8, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 8 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:52.720688 29279 catalog_manager.cc:5697] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 3 to 4, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 4 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:52.701364   436 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:52.722838 29279 catalog_manager.cc:5697] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 3 to 8, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 8 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:52.702416   430 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:52.703632   390 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:52.701884   416 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:52.709579   410 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:52.700258   439 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:52.709306 32730 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:52.733377 32724 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:52.741734 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:52.754454 29453 raft_consensus.cc:2468] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 6.
I20260709 13:12:52.758718 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:52.759380 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:52.760228 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:52.760892 29454 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:52.761302 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:52.729159 29279 catalog_manager.cc:5697] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 5 to 6, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 6 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:12:52.691341 32738 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:52.767089 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:52.767321 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:52.769522 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:52.769716 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:52.776028 29447 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:52.776412 29449 raft_consensus.cc:2393] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 10: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:52.777110 29378 raft_consensus.cc:1240] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:52.774228 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:52.777777 29450 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:52.778290 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:52.775626 29456 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:52.779042 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:52.768504 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:12:52.779865 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 76686.8us
I20260709 13:12:52.779973 29451 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:52.780874 29421 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:52.785442 29452 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:52.786543 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:52.788450 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:52.789609 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:52.791285 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:52.791965 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:52.792450 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:52.797780 29346 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:52.800127 29449 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:12:52.729925   443 raft_consensus.cc:2804] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:52.731655   390 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:52.730959   416 raft_consensus.cc:3060] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:52.728770   430 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:52.809906 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:52.804260 32720 raft_consensus.cc:2749] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:52.790203 32568 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:52.812489 29346 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:52.814872 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:52.846622   380 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:52.846968 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:52.848276 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:52.848910 32738 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:52.849516 32738 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:52.815426 29450 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:12:52.852238 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:52.735256   439 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:52.798658   421 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.817723 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:52.857648 29455 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:52.789417   453 raft_consensus.cc:2804] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:52.861215 29449 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:12:52.866827 29346 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:52.825131 29447 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:52.872794 29447 raft_consensus.cc:1275] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:12:52.874439 29447 raft_consensus.cc:1275] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:12:52.723585 32685 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:52.829409 29448 raft_consensus.cc:2393] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 12: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:52.842746   430 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:52.814039 29456 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:12:52.824579   443 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:52.868115 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:52.827890   390 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:52.883323 29449 raft_consensus.cc:2410] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 13:12:52.876770 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 77434.3us
I20260709 13:12:52.812322 29421 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:52.876642 29374 raft_consensus.cc:2393] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 7: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:52.881666 29456 raft_consensus.cc:1275] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:52.863425   453 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:52.879591   433 log.cc:927] Time spent T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
W20260709 13:12:52.883350   445 log.cc:927] Time spent T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:12:52.779655   372 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
W20260709 13:12:52.883996 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 172213us
I20260709 13:12:52.880458 29448 raft_consensus.cc:1275] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:12:52.901206 29495 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:52.885913 29447 raft_consensus.cc:1275] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:52.892597 29455 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
I20260709 13:12:52.893306 29451 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
W20260709 13:12:52.893525 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 81388us
I20260709 13:12:52.895845 29346 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:52.823421 29454 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
W20260709 13:12:52.886274   440 log.cc:927] Time spent T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:12:52.882443 29453 raft_consensus.cc:1275] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:12:52.904217 29421 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:52.882211   456 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:52.883644   443 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:52.868633   421 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:52.892241   381 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:52.894295   453 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:52.905349 29346 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:53.058070 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 152683us
W20260709 13:12:53.063400 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 150424us
I20260709 13:12:52.907610 29453 pending_rounds.cc:85] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 5
I20260709 13:12:52.950776 29452 raft_consensus.cc:2393] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 7: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:53.065224 29453 pending_rounds.cc:107] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:12:53.065850 29453 raft_consensus.cc:2889] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:52.950455 29449 raft_consensus.cc:1275] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:12:52.911298 29421 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:53.069896 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:53.071892 29453 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
I20260709 13:12:53.074195 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:52.905339 29456 raft_consensus.cc:1275] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:12:53.077369 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 165955us
I20260709 13:12:53.085229 29421 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:52.941357 29495 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:53.101052 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:53.105382 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:53.107916 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:12:53.122699 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 181336us
I20260709 13:12:53.111054 29451 raft_consensus.cc:3055] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:53.124074 29451 raft_consensus.cc:740] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:53.125178 29346 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:53.111361 29526 raft_consensus.cc:1240] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:52.941193 29525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe"
dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:52288
I20260709 13:12:53.128414 29525 raft_consensus.cc:606] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:12:53.130435 29495 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:53.113694 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:53.129586 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:53.133595 29527 raft_consensus.cc:1275] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:53.113863 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:53.115144 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:53.135449 29456 raft_consensus.cc:1240] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 12. Current term is 13. Ops: [9.6-12.8]
W20260709 13:12:53.138588 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:53.157379 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 85325.4us
I20260709 13:12:53.139299 29525 raft_consensus.cc:1275] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:12:53.139814 29521 raft_consensus.cc:1275] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:12:53.137971 29529 raft_consensus.cc:1275] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:12:53.135885 29527 raft_consensus.cc:1275] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:12:53.161273 29447 raft_consensus.cc:1240] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:12:53.163146 29448 raft_consensus.cc:1275] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:12:53.126093 29451 consensus_queue.cc:260] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:53.184336 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 59456.5us
I20260709 13:12:52.982617   430 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:53.188015   463 consensus_queue.cc:1048] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:52.945236 32685 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:52.908195   454 raft_consensus.cc:2804] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:52.910286 32738 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:53.191875 29452 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:53.192595 29447 raft_consensus.cc:1240] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:52.961345   372 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:52.985838   390 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:53.195855 29447 raft_consensus.cc:1240] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:52.908861   450 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:53.197508   390 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:52.922703   439 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:52.993911   441 log.cc:927] Time spent T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.264s	user 0.004s	sys 0.000s
I20260709 13:12:53.200593   430 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:53.201699 29346 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:53.202821 29376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1228) took 1095 ms. Trace:
I20260709 13:12:53.203455 29376 rpcz_store.cc:276] 0709 13:12:52.107302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.109293 (+  1991us) service_pool.cc:224] Handling call
0709 13:12:52.109629 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:52.110751 (+  1122us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:52.110786 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:52.377679 (+266893us) spinlock_profiling.cc:243] Waited 7.53 ms on lock 0x7b2c00062108. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7a67fa11 00007f6a7a68f372 00007f6a7bdc1a01 00007f6a7bd8643a 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2
0709 13:12:52.378141 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:12:52.594568 (+216427us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:52.594620 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:52.594724 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:52.971024 (+376300us) spinlock_profiling.cc:243] Waited 3.95 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:12:53.202138 (+231114us) raft_consensus.cc:1685] finished
0709 13:12:53.202193 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:53.202473 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":703,"raft.queue_time_us":1151,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":6793,"spinlock_wait_cycles":26406656,"thread_start_us":215954,"threads_started":1,"wal-append.queue_time_us":306715}
I20260709 13:12:52.961345   456 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.208596   456 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:53.210057 29453 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:12:53.211783 32678 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.212901 32678 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:12:53.216215   341 raft_consensus.cc:2804] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:52.980587 32730 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:52.956367   421 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:53.217026   341 raft_consensus.cc:697] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:52.942742 32568 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:53.006170   438 raft_consensus.cc:2749] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:53.220477 29454 raft_consensus.cc:1275] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:12:53.222393   421 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.223317   421 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:53.224109   339 raft_consensus.cc:2804] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:53.224824   339 raft_consensus.cc:697] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:53.228315   382 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:53.228554 29346 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:53.229422   382 consensus_queue.cc:1048] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:53.231840   421 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:53.233088   432 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.234012   432 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:53.231838   378 consensus_queue.cc:1059] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:12:53.237654   460 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.238586   460 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:53.239924 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:53.239672 29452 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
I20260709 13:12:53.240994 29530 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:12:53.242089 32424 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.242869 32424 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:53.221370   464 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:53.244429   464 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:53.188084 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:12:53.245529 32424 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:53.245867 30158 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 LEARNER]: Advancing to term 7
I20260709 13:12:53.246763 29449 raft_consensus.cc:1240] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:52.979274   443 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:12:53.261248   443 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:53.266275 29451 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:53.270876   432 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:52.972506 32765 raft_consensus.cc:3055] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:53.272127 32765 raft_consensus.cc:740] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:53.273646 32765 consensus_queue.cc:260] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:53.274207 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 79258.2us
I20260709 13:12:53.249606   460 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:53.280081   372 consensus_queue.cc:1059] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:53.281308   372 consensus_queue.cc:1243] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer 71aa3578fd924765ab9ac0729c8d1483 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:12:53.282953   372 raft_consensus.cc:3055] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:53.232385   453 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:53.274323   454 raft_consensus.cc:697] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 10 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:53.283375   372 raft_consensus.cc:740] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:53.285246 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:53.286721 29522 raft_consensus.cc:1275] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:53.286938 29529 raft_consensus.cc:2410] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:12:53.286823 29527 raft_consensus.cc:1275] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:53.285353 29525 raft_consensus.cc:1275] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:53.288034 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:53.284566 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:53.296706 29522 raft_consensus.cc:2410] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:12:53.275255 32765 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:53.163477 29495 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:12:53.289105   454 consensus_queue.cc:237] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:53.280874   416 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:53.220216   341 consensus_queue.cc:237] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:53.226306   339 consensus_queue.cc:237] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:53.304114 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 69803.6us
I20260709 13:12:53.351662   436 consensus_queue.cc:1048] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:53.347450   460 raft_consensus.cc:2804] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:53.349960   463 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.350353   443 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:53.353646   463 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:53.354005   443 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:53.237695   380 raft_consensus.cc:3055] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:53.326316 29521 raft_consensus.cc:2393] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 7: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:12:53.346942 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 183787us
W20260709 13:12:53.368825 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 81203.9us
I20260709 13:12:53.369153 32724 raft_consensus.cc:2749] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:53.370028 29344 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:53.371558   436 consensus_queue.cc:1059] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:53.374249   381 raft_consensus.cc:3055] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:53.374832   381 raft_consensus.cc:740] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:53.376269   381 consensus_queue.cc:260] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:53.377985   381 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:53.381011   463 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:53.371872 32738 raft_consensus.cc:2749] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:53.352661 32685 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.383985 32685 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:53.387180 32685 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:53.355309   421 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.292824   456 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:53.298123   432 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:53.352375   453 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:53.320154   410 raft_consensus.cc:2749] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:53.367280   380 raft_consensus.cc:740] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:53.391964 29451 raft_consensus.cc:1275] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:12:53.403162   421 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:53.406142 29344 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:53.397776 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 45487.9us
I20260709 13:12:53.421094 30158 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 LEARNER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:53.363859   460 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:53.302353   382 raft_consensus.cc:2749] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:53.396123 32678 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:53.442739   460 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:53.443300   453 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.456945   432 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:53.461942   443 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:53.465489   380 consensus_queue.cc:260] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:53.471647   470 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.472889 29346 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:53.455464 32685 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:12:53.475667 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 69737us
I20260709 13:12:53.479945 29346 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:53.480321   421 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:53.481191   382 consensus_queue.cc:1048] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:53.483031   416 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 7 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:53.348218   372 consensus_queue.cc:260] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:53.492362 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:53.495834 29450 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:12:53.496862 32735 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:53.486068   453 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:53.498878 32724 consensus_queue.cc:1059] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:12:53.501164   453 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:53.500864 32724 raft_consensus.cc:3055] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:53.502821 32685 consensus_queue.cc:1048] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:53.503213 32724 raft_consensus.cc:740] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:53.504748 32738 consensus_queue.cc:1048] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:53.504889 32724 consensus_queue.cc:260] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:53.505775 32685 consensus_queue.cc:1048] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:53.506121   436 consensus_queue.cc:1048] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:53.508066 32720 consensus_queue.cc:1048] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:53.508260   436 consensus_queue.cc:1048] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:53.492743   443 consensus_queue.cc:1048] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:12:53.495393 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:53.503244 29451 raft_consensus.cc:3060] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:53.510994 29521 raft_consensus.cc:3060] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:12:53.489779 32678 consensus_queue.cc:1059] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:12:53.512065 32678 raft_consensus.cc:3055] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:53.512487 32678 raft_consensus.cc:740] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:53.512740 32424 consensus_queue.cc:1048] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:53.513926 32678 consensus_queue.cc:260] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:53.515547 29495 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:12:53.502466 29344 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:53.502334 32735 raft_consensus.cc:697] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:53.501835   455 consensus_queue.cc:1059] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:53.532770   455 raft_consensus.cc:3055] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:53.532398 32735 consensus_queue.cc:237] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:53.533466   455 raft_consensus.cc:740] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:53.531599 29451 raft_consensus.cc:2468] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 7.
I20260709 13:12:53.507064 32738 consensus_queue.cc:1048] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:12:53.473038   470 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:53.515625   421 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:53.523438   380 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:53.560142   421 raft_consensus.cc:697] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:53.561641   421 consensus_queue.cc:237] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:53.563952 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:53.542704 32720 consensus_queue.cc:1048] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:12:53.547940 32424 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:53.527696   453 consensus_queue.cc:1059] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:12:53.536639 32678 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:53.579308 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:53.584805 29456 raft_consensus.cc:2410] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:12:53.582474 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:53.589589 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:12:53.588419 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 86058.2us
I20260709 13:12:53.569197   436 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:53.573371 32424 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:53.598266 29447 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:12:53.602406 29451 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:12:53.607937 29521 raft_consensus.cc:2468] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 7.
I20260709 13:12:53.610073 30119 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:12:53.611570   446 raft_consensus.cc:2804] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:53.612237   446 raft_consensus.cc:697] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:12:53.613399   446 consensus_queue.cc:237] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:53.595594 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:53.597240 32424 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:53.615944   470 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:53.615422   450 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:53.617412 29449 raft_consensus.cc:2410] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:12:53.617904 29453 raft_consensus.cc:2393] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 7: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
W20260709 13:12:53.628847 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:53.633315 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 548486us
I20260709 13:12:53.624061 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:53.634356 29421 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:53.635972 29456 raft_consensus.cc:2410] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:12:53.651947 29344 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:53.639086 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:53.635169   455 consensus_queue.cc:260] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:53.645380 29455 raft_consensus.cc:1240] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:53.647511   443 raft_consensus.cc:3055] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:12:53.648057 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 133793us
W20260709 13:12:53.661777 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:53.650436 32724 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:53.654774   372 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:53.654919   443 raft_consensus.cc:740] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:53.680506   443 consensus_queue.cc:260] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:53.682351   443 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:53.683461 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 88875.5us
I20260709 13:12:53.685016 29344 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:53.687822 32738 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:53.688915 29495 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:53.670914   436 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:53.690692 29495 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:12:53.690521 32738 consensus_queue.cc:1048] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:53.690740   469 raft_consensus.cc:2749] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:53.693213   454 raft_consensus.cc:2749] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:53.706333   381 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.706327 32720 consensus_queue.cc:1048] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:53.707253   381 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:53.709859 32424 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:53.712301 32424 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:53.716207 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 82068.9us
I20260709 13:12:53.718204 29421 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:53.719645 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:53.722612 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:53.723701 29374 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
I20260709 13:12:53.723940   432 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:53.724481 29378 raft_consensus.cc:1275] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:12:53.725201 32765 raft_consensus.cc:2749] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:53.726222 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:53.727393 29421 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:53.735343   473 log.cc:927] Time spent T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:12:53.736063   341 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.736624   341 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:53.737396 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:53.738437 29377 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:53.738945   341 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:53.740027 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:53.740731 29373 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:12:53.741115 29421 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:12:53.742460 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 51971us
W20260709 13:12:53.744966 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:53.740036   444 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:53.731242 32720 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.747635   444 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:53.748209 32720 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:53.728533   470 raft_consensus.cc:2804] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:53.752609   455 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:53.745513   454 consensus_queue.cc:1059] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:12:53.759966   444 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:53.761890   470 raft_consensus.cc:697] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:53.734401 32735 consensus_queue.cc:1048] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:12:53.744856 29495 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:53.763204   470 consensus_queue.cc:237] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:53.764310   380 raft_consensus.cc:2804] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:53.764773   380 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:53.765314   380 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:53.693663 32738 consensus_queue.cc:1048] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:12:53.762945   454 raft_consensus.cc:3055] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:53.778923 29528 raft_consensus.cc:1240] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:53.785081 29521 raft_consensus.cc:1240] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:53.790314 29376 raft_consensus.cc:1240] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9. Ops: []
W20260709 13:12:53.779316   472 log.cc:927] Time spent T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:12:53.785828 29346 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:53.729925   436 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:53.793361 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:53.745334   381 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:53.774230 32765 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:53.769912   454 raft_consensus.cc:740] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:53.775362   469 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:53.810426 29346 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:53.811223 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:53.818569 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:53.819715 29526 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:12:53.827152 32424 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.830644 32720 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:53.833539 29453 raft_consensus.cc:1275] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:12:53.834893 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 93967.8us
I20260709 13:12:53.824647   381 raft_consensus.cc:2804] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:53.835909 32424 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:53.826370 32738 raft_consensus.cc:2804] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:53.839890 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:53.815266   436 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:53.844305 29453 raft_consensus.cc:2410] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:12:53.847321 32424 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:53.834188   464 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:53.848320   464 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:53.852277 32678 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.791778   444 consensus_queue.cc:1048] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:12:53.852932 32678 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:53.854987 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 81425.6us
I20260709 13:12:53.838156 32738 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:53.864995 29452 raft_consensus.cc:3055] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:53.865222 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:53.865499 29452 raft_consensus.cc:740] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:53.843281   381 raft_consensus.cc:697] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:12:53.852309   480 log.cc:927] Time spent T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:12:53.878491 29344 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:53.878679 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:53.880291 29521 raft_consensus.cc:2393] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 7: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:53.879658 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:53.863811 32738 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:53.898200 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:53.906263 29421 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:53.908397   381 consensus_queue.cc:237] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:53.909963   438 consensus_queue.cc:1059] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:12:53.911079   339 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:53.911618 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:53.902930 29452 consensus_queue.cc:260] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:53.912767   483 log.cc:927] Time spent T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:12:53.923664 29524 raft_consensus.cc:2393] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 9: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:12:53.924122   485 log.cc:927] Time spent T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:12:53.879606   341 consensus_queue.cc:1048] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:12:53.924453   469 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:12:53.926153   481 log.cc:927] Time spent T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:12:53.856463   460 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:53.915680 32685 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:53.947984 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:53.948711 29450 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
I20260709 13:12:53.931437 29452 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:53.923801 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:53.941534 29526 raft_consensus.cc:2368] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10.
W20260709 13:12:53.945714 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 76593.2us
I20260709 13:12:53.962280 29522 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 13.
I20260709 13:12:53.921751   470 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:53.966144 29453 raft_consensus.cc:1275] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:12:53.974058 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 67996.5us
I20260709 13:12:53.985332   460 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:53.994410 29452 raft_consensus.cc:1275] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:12:53.980284 32685 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:53.995071 29452 pending_rounds.cc:85] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 6
I20260709 13:12:53.995543   454 consensus_queue.cc:260] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:53.995514 29452 pending_rounds.cc:107] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:12:53.996690 29452 raft_consensus.cc:2889] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:53.996948   454 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:54.002434 29455 raft_consensus.cc:2410] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:12:54.003479 32678 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:53.958103   382 consensus_queue.cc:1048] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:12:54.030699 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:54.032166 29522 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11.
I20260709 13:12:54.041756 29377 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
I20260709 13:12:54.010438 29381 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
W20260709 13:12:54.010742 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:53.975771   470 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:54.050944   470 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:54.061578   494 consensus_queue.cc:1048] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:12:54.064604 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 127682us
I20260709 13:12:54.060251 29421 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:54.072376   372 raft_consensus.cc:2749] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:12:54.082875 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.096220   495 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:54.096971   495 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:54.069749   436 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:54.105347 29448 raft_consensus.cc:1275] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:54.108243 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:54.109128 29447 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
I20260709 13:12:54.110450 29524 raft_consensus.cc:1240] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:54.110894 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:54.113011 29455 raft_consensus.cc:1275] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:12:54.116987 29455 pending_rounds.cc:85] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 6
I20260709 13:12:54.138855 29455 pending_rounds.cc:107] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:12:54.099259   495 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:54.139209 29455 raft_consensus.cc:2889] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:54.141546 29421 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:54.143108 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 76082.1us
I20260709 13:12:54.146123 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:54.147006 29452 raft_consensus.cc:1240] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:54.147527 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:54.149531 29453 raft_consensus.cc:2393] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 7: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:54.151075 29447 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
I20260709 13:12:54.151769 29450 raft_consensus.cc:1240] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:54.115393 32685 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:54.148663   438 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.163470   380 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:54.163769   438 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:54.165833   380 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:54.147904 29346 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:12:54.162693   491 log.cc:927] Time spent T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.118s	user 0.002s	sys 0.000s
W20260709 13:12:54.163251 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.175451 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:12:54.173126 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 222712us
I20260709 13:12:54.179178 29456 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:54.181870 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:54.155196 32738 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:54.200804 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:54.167083   438 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:54.231850 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 114939us
I20260709 13:12:54.200948   372 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:54.235987 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:12:54.238181 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 51231.3us
I20260709 13:12:54.241969 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:54.243615 29454 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
I20260709 13:12:54.243767 29455 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
I20260709 13:12:54.250494   466 consensus_queue.cc:1048] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:54.253350   464 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:54.225488   382 raft_consensus.cc:2804] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:54.259938   382 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.260443   382 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:54.260906 32738 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:54.263589   497 consensus_queue.cc:1048] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:12:54.265247   492 log.cc:927] Time spent T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.217s	user 0.000s	sys 0.002s
I20260709 13:12:54.266777   456 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.267467   456 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:54.267784 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:54.277233 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:54.284515 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:12:54.291343 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.287662   454 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.293664   454 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:54.283380 32738 consensus_queue.cc:1048] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:12:54.296677 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:54.297034 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:54.297657 29455 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
I20260709 13:12:54.298108 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:54.298525 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:54.300782 29419 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:54.302173 29419 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:54.302896   372 raft_consensus.cc:2749] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:54.303721   372 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:54.304075   372 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:54.304458   372 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:54.304877   456 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:54.305958 29278 catalog_manager.cc:5697] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:12:54.321862 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:54.322474 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.308257 32765 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:54.327961 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 71946.4us
I20260709 13:12:54.315936   380 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.331923 29419 leader_election.cc:400] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10.
I20260709 13:12:54.332283 29419 leader_election.cc:403] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:12:54.334148 29453 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
W20260709 13:12:54.326215 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 139796us
I20260709 13:12:54.336633 29344 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:54.351310 29344 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:54.324412   455 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:54.329847   460 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.351284 29419 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:54.356046 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.360426 29456 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
I20260709 13:12:54.366328 29419 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:54.370299   466 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:54.370896   466 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.371338   466 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:54.374994 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:54.377974 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:54.390630 29456 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:12:54.353423 32765 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10.
I20260709 13:12:54.336458   380 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:54.350284   494 consensus_queue.cc:1048] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
W20260709 13:12:54.401032 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 50812.3us
I20260709 13:12:54.360375   454 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:54.368374   505 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:54.372154   456 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:54.408130 29448 raft_consensus.cc:1275] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:54.401922 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:54.409776 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:54.410475 29455 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:12:54.365023   460 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:54.419116 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:54.422855 29377 raft_consensus.cc:2368] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10.
I20260709 13:12:54.422921 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:54.427150 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:54.427611 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:54.462992 29373 raft_consensus.cc:2368] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10.
I20260709 13:12:54.406540   506 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:54.412712   456 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.476639 29381 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:54.476856 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 55508us
I20260709 13:12:54.477456 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:54.478120 29377 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 13.
I20260709 13:12:54.475116 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:54.402140   455 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:54.478832 29374 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11.
I20260709 13:12:54.486863 29454 raft_consensus.cc:1275] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:12:54.492509   501 log.cc:927] Time spent T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:12:54.452828   505 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.427292   511 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:54.481163   456 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:54.501717 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:54.506649   506 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:54.512959 29495 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:54.514636 29376 raft_consensus.cc:1240] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:54.529192 29378 raft_consensus.cc:2393] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 7: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:54.529914 29374 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:12:54.518030 32678 consensus_queue.cc:1059] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:54.521251   460 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:54.526283   455 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:54.534639 29452 raft_consensus.cc:1275] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:12:54.544847 29455 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:12:54.554122 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:54.565618 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 214369us
W20260709 13:12:54.570952 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.574260 29381 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:12:54.581874 29495 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:54.556033   460 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:54.584950 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:54.527828   505 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:54.563329   372 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:54.587873   460 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.715009 29376 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 12.
I20260709 13:12:54.721601   450 raft_consensus.cc:3055] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:54.722111   450 raft_consensus.cc:740] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:54.715862   454 consensus_queue.cc:1059] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:12:54.724087 29453 raft_consensus.cc:1240] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:54.690222   460 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:54.697012   470 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:54.710237 32678 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:12:54.728684 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 148243us
I20260709 13:12:54.730492   380 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:54.756332 29376 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:12:54.757175 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:54.859944 29376 raft_consensus.cc:606] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:12:54.759958 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:54.863878 29374 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
I20260709 13:12:54.759095 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:54.761426 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:54.759351   505 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:54.760774 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:54.758140 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:54.756678 32720 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.776814   436 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.853698   380 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.878499 32720 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:54.879099   380 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:54.879627   372 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:54.880394   341 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:54.880820   518 log.cc:927] Time spent T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:12:54.881095 32720 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:54.881381   380 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:54.778928 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 56136.3us
I20260709 13:12:54.760494 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:54.882462 29372 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
I20260709 13:12:54.883477 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:54.884245 29372 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
W20260709 13:12:54.793023 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:54.885656 29379 raft_consensus.cc:2410] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:12:54.825944 29421 leader_election.cc:400] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10.
W20260709 13:12:54.886387 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 68155.3us
W20260709 13:12:54.829104   382 consensus_meta.cc:287] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.566s	user 0.008s	sys 0.008s
I20260709 13:12:54.755401   470 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:54.849797   528 raft_consensus.cc:3055] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:12:54.852149 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 118572us
I20260709 13:12:54.876087 29380 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:54.881749 32738 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.723029   450 consensus_queue.cc:260] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:54.817538   493 log.cc:927] Time spent T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.773s	user 0.003s	sys 0.006s
I20260709 13:12:54.900033 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:54.900712 29377 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
I20260709 13:12:54.889614 29421 leader_election.cc:400] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10.
I20260709 13:12:54.887923 29346 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:54.845991   506 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:54.915227 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:54.897677 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:54.918561   470 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:54.919160 29374 raft_consensus.cc:2393] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 11: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:54.843120   466 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:54.920423 29378 raft_consensus.cc:1240] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:54.921329   466 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:54.895063 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:54.907819   450 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:54.908078 29451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2212) took 1136 ms. Trace:
W20260709 13:12:54.909049   527 log.cc:927] Time spent T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:12:54.909614 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:54.910276 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:54.880925   341 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:54.911197 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:54.936483 29377 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
I20260709 13:12:54.891196   380 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:54.913040   456 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:54.895968   528 raft_consensus.cc:740] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:54.899777 32738 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:54.901479 29421 leader_election.cc:403] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:54.925361 29451 rpcz_store.cc:276] 0709 13:12:53.771757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:53.773435 (+  1678us) service_pool.cc:224] Handling call
0709 13:12:53.780065 (+  6630us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:53.823980 (+ 43915us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:53.824024 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:53.833827 (+  9803us) log.cc:844] Serialized 26 byte log entry
0709 13:12:54.043287 (+209460us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:54.043337 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:54.043419 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:54.649842 (+606423us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:12:54.907703 (+257861us) raft_consensus.cc:1685] finished
0709 13:12:54.907725 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:54.907984 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30463,"raft.queue_time_us":38917,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":12411,"spinlock_wait_cycles":35962752,"thread_start_us":182662,"threads_started":1,"wal-append.queue_time_us":197318}
W20260709 13:12:54.900148   520 log.cc:927] Time spent T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:12:54.912210 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:54.947749 29380 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
I20260709 13:12:54.878628   436 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:54.950012 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 70481us
I20260709 13:12:54.948834   454 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.893946   382 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:54.972436 29527 raft_consensus.cc:1275] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:12:54.980597 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:54.923051   494 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:54.986883 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:54.968690 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:54.989283 29525 raft_consensus.cc:2410] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:12:54.982138 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:54.991055 30158 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:12:54.989691 29522 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:12:54.994773 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:55.017992 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:55.013375 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 48164.5us
I20260709 13:12:55.026865   531 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:12:55.027849 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 52443.8us
I20260709 13:12:55.028067   534 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:55.030272 29495 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:55.030701   534 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:55.033250 29495 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:55.034039   534 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:55.028998   531 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:55.052824 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:55.053344   531 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:55.054816   531 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:55.030287   535 consensus_queue.cc:1048] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:12:55.055897   528 consensus_queue.cc:260] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:55.057183   436 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:55.059867 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 170343us
I20260709 13:12:54.986920   466 raft_consensus.cc:2749] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10.
I20260709 13:12:54.953807   380 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:55.035207   534 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:55.068970 29421 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:55.055258   531 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.991124 32678 raft_consensus.cc:697] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:55.018014   498 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.057365   528 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:55.097393 29376 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:12:55.098206 29376 raft_consensus.cc:606] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:12:55.098615 29376 raft_consensus.cc:614] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:12:55.098343 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 63962.2us
I20260709 13:12:55.095379 29344 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
W20260709 13:12:55.099413 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.059398   372 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:54.987568   454 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:54.993204   438 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.104395 29495 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:55.097361 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:55.057439   535 consensus_queue.cc:1059] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:12:55.076475   531 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:55.074575   534 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:54.991026   523 consensus_queue.cc:1048] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.116s
I20260709 13:12:54.993630   494 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:55.103282   495 raft_consensus.cc:2804] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:55.121098   466 raft_consensus.cc:2804] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:55.123739 29495 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:55.122610 29522 raft_consensus.cc:2393] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 11: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:55.120219   534 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:55.101634   498 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:55.134084   464 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:55.144680 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:55.130084   470 raft_consensus.cc:2804] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:55.147447 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:55.132304   495 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.163142 29495 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:55.114066   372 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:55.171088 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:55.171943 29522 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:55.139565   466 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.180768 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:55.182577 32662 consensus_queue.cc:1048] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.088s
I20260709 13:12:55.182971   537 consensus_queue.cc:1048] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:12:55.108393 32678 consensus_queue.cc:237] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:55.149745   535 raft_consensus.cc:2804] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:55.162473   470 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.125771   438 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:55.184813 29495 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:55.185582 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 116717us
I20260709 13:12:55.162380   380 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:55.180042   495 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:55.192629 29526 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:12:55.187063   466 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:55.189924   525 log.cc:927] Time spent T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 13:12:55.202844 29495 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:55.207032   536 raft_consensus.cc:3055] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:55.183000   539 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:55.182578   464 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:55.196904   470 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:55.208571   438 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:55.212944   536 raft_consensus.cc:740] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:55.219095   382 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:55.208804   456 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:55.219692   341 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:55.191865   535 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.259579   535 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:55.260052 28234 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:12:55.260336 29346 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:55.261946   436 raft_consensus.cc:2804] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:55.262477   436 raft_consensus.cc:697] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:55.223927   380 raft_consensus.cc:2804] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:55.263828   380 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.263533   436 consensus_queue.cc:237] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:55.264266   380 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:55.205116 32738 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:55.228637 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:55.191346   522 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:55.216624 32730 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:55.266171 29526 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:12:55.266608 32730 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:55.268069 29526 raft_consensus.cc:1275] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:12:55.268524 29526 pending_rounds.cc:85] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 3
I20260709 13:12:55.268822 29526 pending_rounds.cc:107] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:12:55.231446 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:55.269843 29528 raft_consensus.cc:2393] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 13: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:55.232722 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:55.233798 29522 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:12:55.236717 29421 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:55.250197 29344 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:55.252457 32764 consensus_queue.cc:1048] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:55.243295   497 consensus_queue.cc:1048] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:12:55.237475   539 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.213209   530 raft_consensus.cc:2804] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:55.256104   524 raft_consensus.cc:993] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5: : Instructing follower 183db85c071f489fbc8de63a9edd8a3a to start an election
I20260709 13:12:55.257270   494 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:55.258572   454 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:55.269127 29526 raft_consensus.cc:2889] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:55.279027 29344 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:55.281028 29522 raft_consensus.cc:1275] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:12:55.305480 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 68860.3us
I20260709 13:12:55.235955   455 raft_consensus.cc:3055] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:12:55.272421   460 consensus_meta.cc:287] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.520s	user 0.005s	sys 0.009s
I20260709 13:12:55.282806 32730 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:55.270768   438 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.285295   540 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.312075 29344 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:55.316498 29495 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:12:55.283420   341 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:55.306623 29421 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:55.291376   539 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:12:55.360379 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 48415.9us
I20260709 13:12:55.364517 29344 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:55.357343 29526 raft_consensus.cc:1275] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:12:55.310127   455 raft_consensus.cc:740] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:55.305279   530 raft_consensus.cc:697] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:55.312799   456 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:55.365429 29526 pending_rounds.cc:85] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 7
I20260709 13:12:55.379945 29526 pending_rounds.cc:107] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:12:55.380378 29526 raft_consensus.cc:2889] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:55.310539   524 raft_consensus.cc:1081] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Signalling peer 183db85c071f489fbc8de63a9edd8a3a to start an election
I20260709 13:12:55.318390 32720 raft_consensus.cc:2749] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:12:55.400441 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 92462.5us
I20260709 13:12:55.362994   494 raft_consensus.cc:2749] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:12:55.410403 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 94069.2us
I20260709 13:12:55.368026   372 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:55.406430 29344 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:55.372892   382 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:55.321767   460 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:55.419421 29344 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:55.389670   537 raft_consensus.cc:2804] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:12:55.425321 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 118779us
I20260709 13:12:55.429930 29421 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:55.358932   438 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:55.367449   531 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:55.444312 29523 raft_consensus.cc:2393] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 14: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:55.422441 32685 raft_consensus.cc:2804] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:12:55.430616   490 log.cc:927] Time spent T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 1.063s	user 0.008s	sys 0.004s
I20260709 13:12:55.431162   542 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.448463 29495 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:12:55.434710   341 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:55.459937   341 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:55.460539   341 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:55.460919   552 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:55.461431   552 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.461776   552 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:55.463272   550 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:55.427448   456 raft_consensus.cc:697] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:55.364670   540 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:55.456877   512 consensus_queue.cc:1048] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:55.437664   498 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:55.463925   550 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:55.472309   516 consensus_queue.cc:1048] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:12:55.453044   464 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:55.451269 32685 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.452194   372 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:55.363905   536 consensus_queue.cc:260] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:55.492748   450 consensus_meta.cc:287] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.557s	user 0.011s	sys 0.002s
W20260709 13:12:55.516311 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 86511.1us
I20260709 13:12:55.501322 32685 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:55.490356   543 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:55.527441 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.545439   558 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:55.546558   456 consensus_queue.cc:237] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:55.552304   549 log.cc:927] Time spent T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:12:55.523900   454 consensus_queue.cc:1059] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
W20260709 13:12:55.560962 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 112532us
I20260709 13:12:55.562351 29495 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:55.527684   537 raft_consensus.cc:697] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 11 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:55.505434   372 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:55.488117   542 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:55.569238 29449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2211) took 1800 ms. Trace:
I20260709 13:12:55.541014   516 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.598130 29449 rpcz_store.cc:276] 0709 13:12:53.769102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:53.775553 (+  6451us) service_pool.cc:224] Handling call
0709 13:12:53.781370 (+  5817us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:53.815633 (+ 34263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:53.815675 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:53.818469 (+  2794us) log.cc:844] Serialized 26 byte log entry
0709 13:12:53.914193 (+ 95724us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:53.914235 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:53.914305 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:55.095061 (+1180756us) spinlock_profiling.cc:243] Waited 6.52 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:12:55.559381 (+464320us) raft_consensus.cc:1685] finished
0709 13:12:55.559409 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:55.569130 (+  9721us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11856,"raft.queue_time_us":25392,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":138,"spinlock_wait_cycles":14993280,"thread_start_us":82974,"threads_started":1,"wal-append.queue_time_us":217907}
I20260709 13:12:55.486871   530 consensus_queue.cc:237] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:55.602900   553 log.cc:927] Time spent T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 13:12:55.610236 32730 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:55.534051   543 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:55.636854   558 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
W20260709 13:12:55.752380 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 190176us
W20260709 13:12:55.668057 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:55.753388 29495 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:55.636394   460 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:55.767531   558 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:55.762791   450 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:55.816898 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 63615.2us
I20260709 13:12:55.819857 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:55.761811   531 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:55.820700 29526 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
W20260709 13:12:55.816782   466 consensus_meta.cc:287] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.592s	user 0.014s	sys 0.000s
I20260709 13:12:55.638166   516 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:55.829406 29495 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:55.660557 32730 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:55.801416   438 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:55.820286   460 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:55.843420 29495 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:55.858973   577 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:55.859284   550 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:55.859652   561 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:55.860265   561 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:55.860875   565 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.858719   564 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:55.861543   565 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:55.862020   564 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:55.863837   568 consensus_queue.cc:1059] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:55.865504   564 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:55.867286 29495 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:55.870702 29495 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:55.856792   540 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:55.873207   516 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:55.842082   560 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.874585   560 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:55.876070   576 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:55.876917   576 raft_consensus.cc:2749] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:55.877727   560 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:55.878260 29495 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:55.880122   562 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:55.880616   560 raft_consensus.cc:2749] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:55.859956   577 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:55.864161 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:55.858811   572 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.882369 29495 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:12:55.829469 32678 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:12:55.842303   547 log.cc:927] Time spent T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.254s	user 0.002s	sys 0.000s
I20260709 13:12:55.885241   460 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:55.886590   380 consensus_meta.cc:287] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.622s	user 0.014s	sys 0.000s
I20260709 13:12:55.822700   450 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:55.903993   341 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:55.860903   561 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:55.897667   535 consensus_meta.cc:287] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.637s	user 0.008s	sys 0.006s
W20260709 13:12:55.899842   528 consensus_meta.cc:287] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.793s	user 0.000s	sys 0.015s
I20260709 13:12:55.811947   537 consensus_queue.cc:237] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:55.842947   466 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:55.910480 32730 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:55.904666   438 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:55.920390   564 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.932778   543 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:55.940896   341 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:55.909623   372 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:55.942102   455 consensus_queue.cc:260] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:55.945490 29372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1257) took 1169 ms. Trace:
I20260709 13:12:55.882861   572 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:55.945714   552 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:55.946832   565 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:55.948974 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:55.949810   539 consensus_meta.cc:287] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.560s	user 0.010s	sys 0.000s
I20260709 13:12:55.949899   542 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:55.951030 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:55.953310   450 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:55.954571 29524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2690) took 1004 ms. Trace:
I20260709 13:12:55.990638   575 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.909431   380 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:12:55.930145   558 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:12:55.921816   495 consensus_meta.cc:287] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.685s	user 0.006s	sys 0.007s
I20260709 13:12:55.924494   535 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:56.012934 29522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2706) took 1014 ms. Trace:
I20260709 13:12:55.994299 29372 rpcz_store.cc:276] 0709 13:12:54.775971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:54.918023 (+142052us) service_pool.cc:224] Handling call
0709 13:12:54.918387 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:54.954571 (+ 36184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:54.954595 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:54.979977 (+ 25382us) log.cc:844] Serialized 26 byte log entry
0709 13:12:55.064557 (+ 84580us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:55.064633 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:55.064741 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:55.234170 (+169429us) spinlock_profiling.cc:243] Waited 4.15 ms on lock 0x7b180004ae00. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c672a6 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a80cafaa1 00007f6a80ca6b37 00007f6a80ca69ca 00007f6a80d9e26f
0709 13:12:55.390869 (+156699us) spinlock_profiling.cc:243] Waited 5.08 ms on lock 0x7b4800080058. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a80cafaa1 00007f6a80ca6b37 00007f6a80ca69ca 00007f6a80d9e26f 00007f6a80d9df37 00007f6a80db255c 00007f6a80db2508 00007f6a80db2488 00007f6a80db2443 00007f6a80db16ec 00007f6a7fcdba96
0709 13:12:55.944887 (+554018us) spinlock_profiling.cc:243] Waited 8.98 ms on lock 0x7b5400058fa0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bcfbdbe 00007f6a7bd06930 00007f6a7bd068d8 00007f6a7bd06858 00007f6a7bd06813 00007f6a7bd05a9c 00007f6a81bf1626 00007f6a81bebdd8 00007f6a7bd427cb 00007f6a7bd452c0
0709 13:12:55.945232 (+   345us) raft_consensus.cc:1685] finished
0709 13:12:55.945251 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:55.945416 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35641,"raft.queue_time_us":39933,"raft.run_cpu_time_us":4719,"raft.run_wall_time_us":435159,"spinlock_wait_cycles":41869696,"thread_start_us":47359,"threads_started":1,"wal-append.queue_time_us":46630}
I20260709 13:12:56.005713 29524 rpcz_store.cc:276] 0709 13:12:54.950296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:54.958568 (+  8272us) service_pool.cc:224] Handling call
0709 13:12:54.958939 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:55.090681 (+131742us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:55.090724 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:55.101961 (+ 11237us) log.cc:844] Serialized 26 byte log entry
0709 13:12:55.240136 (+138175us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:55.240180 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:55.240255 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:55.954291 (+714036us) raft_consensus.cc:1685] finished
0709 13:12:55.954315 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:55.954494 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":53996,"raft.run_cpu_time_us":63,"raft.run_wall_time_us":63,"thread_start_us":189328,"threads_started":2,"wal-append.queue_time_us":177284}
I20260709 13:12:56.016537 29453 raft_consensus.cc:1275] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:12:55.975147   438 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:56.017748 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:56.018059 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:56.019196 29454 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
I20260709 13:12:56.021248 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:56.021708 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:55.994938   564 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:56.035646 29523 raft_consensus.cc:2393] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 13: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:56.013441 29522 rpcz_store.cc:276] 0709 13:12:54.998686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:55.306250 (+307564us) service_pool.cc:224] Handling call
0709 13:12:55.306661 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:55.317416 (+ 10755us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:55.317468 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:55.363456 (+ 45988us) log.cc:844] Serialized 26 byte log entry
0709 13:12:55.606076 (+242620us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:55.787116 (+181040us) log.cc:844] Serialized 14 byte log entry
0709 13:12:56.010166 (+223050us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:56.010297 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:56.010367 (+    70us) raft_consensus.cc:1685] finished
0709 13:12:56.010389 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:56.012824 (+  2435us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26208,"prepare.queue_time_us":276368,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":113,"raft.queue_time_us":46643,"raft.run_cpu_time_us":352,"raft.run_wall_time_us":61885,"thread_start_us":505332,"threads_started":3,"wal-append.queue_time_us":403083}
I20260709 13:12:56.021857 29449 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:56.012140   531 raft_consensus.cc:2749] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:56.041584 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:56.042098 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:56.038877 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:56.005263   539 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:56.161367 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:56.163985 29453 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
W20260709 13:12:56.164278   583 log.cc:927] Time spent T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:12:56.161428   466 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:56.166364   577 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:56.166831 29453 raft_consensus.cc:1240] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:12:56.164003   552 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:56.168385 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:56.169356 29453 raft_consensus.cc:2393] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 14: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:56.013882   575 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:56.171625 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:56.172395 29453 raft_consensus.cc:2393] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 12: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:56.172732   575 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:56.173188 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:56.173775 29453 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:12:56.174516   564 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:56.136871 29456 raft_consensus.cc:1275] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:56.126248 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:56.177392 29451 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
I20260709 13:12:56.161854 29529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2695) took 1208 ms. Trace:
I20260709 13:12:56.079736 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:56.193866 29450 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
I20260709 13:12:56.046177 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:56.046243 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:12:56.197206 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.195914 29455 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
I20260709 13:12:56.041051   455 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:56.135027   534 consensus_meta.cc:287] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.964s	user 0.005s	sys 0.007s
W20260709 13:12:56.121302   581 log.cc:927] Time spent T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:12:56.021006   558 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:56.198836 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:56.175344   562 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:56.212991 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:56.180634 29529 rpcz_store.cc:276] 0709 13:12:54.953410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:54.953574 (+   164us) service_pool.cc:224] Handling call
0709 13:12:54.969487 (+ 15913us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:55.187428 (+217941us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:55.187465 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:55.952835 (+765370us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b2c001231f8. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7a67fa11 00007f6a7a68f372 00007f6a7bdc1a01 00007f6a7bd8643a 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2
0709 13:12:55.953319 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 13:12:56.008576 (+ 55257us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:56.008621 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:56.008698 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:56.161498 (+152800us) raft_consensus.cc:1685] finished
0709 13:12:56.161522 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:56.161759 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":537,"raft.queue_time_us":41742,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"spinlock_wait_cycles":3091328,"thread_start_us":240555,"threads_started":2,"wal-append.queue_time_us":180955}
I20260709 13:12:56.225793 29522 raft_consensus.cc:2393] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 10: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:56.195640   567 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.117054   543 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.128866   380 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:56.130066   572 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:56.222821 29451 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
I20260709 13:12:56.260001   543 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:56.261562   536 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:56.212234   552 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:56.268813   552 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:56.080523   372 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:56.271742   372 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:56.134104   535 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:56.096755   542 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:56.016170   495 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:56.193702   575 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:56.195358   565 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:56.127213   529 log.cc:927] Time spent T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 1.159s	user 0.003s	sys 0.003s
I20260709 13:12:56.132972   438 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:56.239123   558 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:56.240268   470 consensus_meta.cc:287] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.963s	user 0.016s	sys 0.000s
I20260709 13:12:56.250250   539 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:56.251611   522 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:56.256379 29526 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:12:56.263032   543 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:56.183760   564 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:56.264111 32685 consensus_meta.cc:287] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.727s	user 0.014s	sys 0.001s
I20260709 13:12:56.271144   552 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:56.258702   561 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:56.286706 29452 raft_consensus.cc:1240] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:56.198756   528 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:56.287237 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:56.333398 29448 raft_consensus.cc:2410] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:12:56.220969   466 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:56.306957   495 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:56.307452   575 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:56.308386   565 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:56.342298 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:56.343489 29522 raft_consensus.cc:2393] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 14: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:56.223325   534 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:56.318696 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:56.321590 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:56.321127 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:56.340245 29495 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:56.347910   539 consensus_queue.cc:1048] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:56.285367   567 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:56.318359   522 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:56.353552   565 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:56.351691   528 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:56.353927   561 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:56.300041   542 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:56.355957   575 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:56.361313   564 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:56.423604 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:56.547205 29454 raft_consensus.cc:2468] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
I20260709 13:12:56.547902 29453 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:12:56.495740   339 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.549057 29528 raft_consensus.cc:1240] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
W20260709 13:12:56.572304 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 232157us
I20260709 13:12:56.548851 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:56.550120   534 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:56.550678   528 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:56.424193 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 51606.5us
I20260709 13:12:56.343953 32685 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:56.371835   506 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:56.359686   466 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:56.617586 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:56.552138   567 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:56.552690 29455 raft_consensus.cc:2393] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 11: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:56.318120   470 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:56.372344 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:56.432540   572 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.557274 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:56.557657   495 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.558686   511 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.560020 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:56.561502 29522 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 10.
I20260709 13:12:56.572191 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:56.574729 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:56.575309 29495 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:56.595293 29449 consensus_meta.cc:287] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.515s	user 0.009s	sys 0.001s
I20260709 13:12:56.631453 29451 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:12:56.631729 29449 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:12:56.603367 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:56.606861 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
W20260709 13:12:56.620357 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:56.632647 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 57514.7us
I20260709 13:12:56.632970 29521 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:56.633076 30157 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 LEARNER]: Advancing to term 10
I20260709 13:12:56.565105   382 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:56.634476 29495 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:56.631323 29453 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:12:56.621356 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:56.639750 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:56.640010 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:56.640210   382 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:56.640969 29451 raft_consensus.cc:2393] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 10: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:56.641945 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:56.642565 29451 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
I20260709 13:12:56.643847   528 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:56.642618   382 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:56.644872 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:56.645045 29495 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:56.649420 29451 raft_consensus.cc:2393] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 13: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:56.649685 29495 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:56.640038 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:56.650938 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:56.612910   539 raft_consensus.cc:2804] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:56.653618   565 raft_consensus.cc:2804] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:56.653926   539 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.654117   565 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:56.654207 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:56.654628   565 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:56.655004 29451 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:56.652673   568 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:56.655844 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:56.656615 29453 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:12:56.644240   528 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:56.648666   558 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:56.659309   528 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:56.653369 29495 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:56.652928   530 raft_consensus.cc:2804] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:56.660061   530 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:56.660270   535 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:56.660507   530 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:56.655711   568 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.660935   535 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:56.661373   568 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:56.661547   535 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:56.662853   561 consensus_queue.cc:1048] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:56.653666   382 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:56.654374   539 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:56.652904 29521 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:12:56.660475 29495 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:56.673283 29495 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:56.674219   560 raft_consensus.cc:2804] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:56.674625   560 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.664762   382 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:56.648841   460 consensus_queue.cc:1059] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:12:56.674732 29495 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:56.687687 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:56.651813 29455 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:12:56.689266 29451 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
I20260709 13:12:56.571305   504 consensus_queue.cc:1059] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:12:56.691200 29530 raft_consensus.cc:2393] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 10: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:56.692651 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:56.700009 29529 raft_consensus.cc:2393] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 12: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:56.644660   534 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.710783 29455 raft_consensus.cc:1275] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:56.619115   339 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:56.682476   560 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:56.622753   506 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:56.719025 29521 raft_consensus.cc:1240] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:56.720163 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:56.724152 29529 raft_consensus.cc:1240] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:56.724846   466 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:56.725565 32685 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:56.698081   561 raft_consensus.cc:2804] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:56.732041 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:56.733103 29523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2716) took 1053 ms. Trace:
I20260709 13:12:56.733125   382 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:56.735172   522 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:56.735829 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
W20260709 13:12:56.780627 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 221376us
I20260709 13:12:56.736193 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:56.737430 29527 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:12:56.707624   380 raft_consensus.cc:3055] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:56.752357 30157 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 LEARNER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:12:56.637168   495 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:56.738127   455 consensus_meta.cc:287] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.506s	user 0.004s	sys 0.004s
I20260709 13:12:56.645241   572 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:56.772990 29419 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:56.707929   585 raft_consensus.cc:2804] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:56.789453 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:56.790280 29521 raft_consensus.cc:1240] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:56.735080   565 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:56.736835   530 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:56.800437 29455 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:12:56.764269   552 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.649873   511 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:56.760105   575 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:56.738426   534 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:56.757973   535 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:56.801542 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:57.306412 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:56.841708 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:57.306977 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.307161 29447 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:12:56.953819 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:56.904598 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:57.157806   513 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:57.308915 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:57.309433 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:57.309700   552 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:57.209869   504 consensus_queue.cc:1048] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.102s
I20260709 13:12:57.310994 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:57.312479 29377 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
I20260709 13:12:56.969717 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:57.316569 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:56.970232 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:57.311900 29380 raft_consensus.cc:2393] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 13: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:57.215162   470 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:57.210529 29525 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.009s	sys 0.020s
I20260709 13:12:57.313638 29521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 1502) took 1007 ms. Trace:
I20260709 13:12:57.054625 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:56.970688 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:56.901598 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:57.097615 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.324326 29377 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:56.770073 29523 rpcz_store.cc:276] 0709 13:12:55.680137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:56.036679 (+356542us) service_pool.cc:224] Handling call
0709 13:12:56.194155 (+157476us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:56.222116 (+ 27961us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:56.222159 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:56.239840 (+ 17681us) log.cc:844] Serialized 26 byte log entry
0709 13:12:56.454545 (+214705us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:56.454597 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:56.454687 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:56.732850 (+278163us) raft_consensus.cc:1685] finished
0709 13:12:56.732877 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:56.733034 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27934,"raft.queue_time_us":28070,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":15313,"thread_start_us":214164,"threads_started":1,"wal-append.queue_time_us":487723}
W20260709 13:12:57.319593 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 546683us
I20260709 13:12:57.324579 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:57.279991   528 consensus_meta.cc:287] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.620s	user 0.011s	sys 0.000s
W20260709 13:12:57.319711 29451 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.014s	sys 0.027s
I20260709 13:12:57.308454   575 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:57.309315   513 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:57.311159 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:12:57.322686 29525 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.009s	sys 0.023s
I20260709 13:12:57.326061   552 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:57.312772   596 log.cc:927] Time spent T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.472s	user 0.001s	sys 0.000s
W20260709 13:12:57.214896   497 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.013s	sys 0.015s
W20260709 13:12:57.326969 29453 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.013s	sys 0.018s
W20260709 13:12:57.386940 29453 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.014s	sys 0.019s
I20260709 13:12:57.323050 29521 rpcz_store.cc:276] 0709 13:12:56.306086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:56.773873 (+467787us) service_pool.cc:224] Handling call
0709 13:12:56.790003 (+ 16130us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:57.313254 (+523251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:57.313556 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:57.327804 29449 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:56.803563   567 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.125918   531 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.326453 29419 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:57.329339 29378 raft_consensus.cc:2393] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 9: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:57.326377 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:57.394515 29381 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:57.329962 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:57.395187 29380 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:57.350574 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:12:57.208817   593 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.016s	sys 0.013s
I20260709 13:12:57.353015 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:57.397310 29374 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:57.397505 29376 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:56.792699   380 raft_consensus.cc:740] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:57.021073   382 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:57.317672   585 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.313387   536 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:57.361280 29529 raft_consensus.cc:1240] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 10. Current term is 11. Ops: []
W20260709 13:12:57.362741 29454 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45796 (request call id 1352) took 1334 ms (client timeout 1655 ms). Trace:
W20260709 13:12:57.364120   598 log.cc:927] Time spent T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
I20260709 13:12:57.364264 29528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2700) took 2409 ms. Trace:
I20260709 13:12:57.366470 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:56.788991   456 consensus_queue.cc:1059] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.539s
I20260709 13:12:57.313839   558 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:12:57.361765 29526 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37968 (request call id 2721) took 1647 ms (client timeout 1731 ms). Trace:
I20260709 13:12:57.372988 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:57.379429   506 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:57.379305 29448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45796 (request call id 1345) took 1367 ms. Trace:
I20260709 13:12:57.381523 29523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53428 (request call id 523) took 1073 ms. Trace:
I20260709 13:12:57.432925 29523 rpcz_store.cc:276] 0709 13:12:56.308204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.371327 (+1063123us) service_pool.cc:224] Handling call
0709 13:12:57.380854 (+  9527us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:57.381111 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:57.381149 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:57.381205 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:57.381249 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:57.381318 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:57.381453 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:57.328584   522 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:56.803860   561 raft_consensus.cc:697] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:57.384305 29525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2709) took 2326 ms. Trace:
I20260709 13:12:56.898821   568 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:57.392518 29453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2235) took 1120 ms. Trace:
I20260709 13:12:57.404706 29447 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:57.353920   528 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:57.403034 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:57.390172   497 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.015s	sys 0.015s
W20260709 13:12:57.416530 29454 rpcz_store.cc:269] 0709 13:12:56.028229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:56.028381 (+   152us) service_pool.cc:224] Handling call
0709 13:12:57.362500 (+1334119us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b5400261954. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:57.362645 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":809380224}
W20260709 13:12:57.425737 29526 rpcz_store.cc:269] 0709 13:12:55.682550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:55.845026 (+162476us) service_pool.cc:224] Handling call
0709 13:12:57.330163 (+1485137us) spinlock_profiling.cc:243] Waited 374 ms on lock 0x7b54002323d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:57.330311 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":859753216}
I20260709 13:12:57.424197 29528 rpcz_store.cc:276] 0709 13:12:54.954753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:55.270524 (+315771us) service_pool.cc:224] Handling call
0709 13:12:55.300837 (+ 30313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:56.573018 (+1272181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:57.363858 (+790840us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54001018d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:57.364196 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2870059392}
W20260709 13:12:57.375299 29451 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.014s	sys 0.027s
W20260709 13:12:57.400627   593 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.884s	user 0.018s	sys 0.015s
I20260709 13:12:57.432029 29448 rpcz_store.cc:276] 0709 13:12:56.015174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:56.015711 (+   537us) service_pool.cc:224] Handling call
0709 13:12:57.379017 (+1363306us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b54002535d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:57.379242 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":389661440}
I20260709 13:12:57.398304   552 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:57.403604   567 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:57.413007   531 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:57.438211 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 410202us
W20260709 13:12:57.442236 29452 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.010s	sys 0.034s
W20260709 13:12:57.560379 29452 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.883s	user 0.010s	sys 0.034s
I20260709 13:12:57.468653 29524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53428 (request call id 519) took 2260 ms. Trace:
I20260709 13:12:57.442961 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:57.463410 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:57.574117 29450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2234) took 1301 ms. Trace:
W20260709 13:12:57.449519 30121 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.033s	sys 0.050s
W20260709 13:12:57.436594   539 consensus_meta.cc:287] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.772s	user 0.009s	sys 0.005s
I20260709 13:12:57.517733 29449 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:12:57.578385 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:57.577283 30121 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.034s	sys 0.051s
W20260709 13:12:57.579820 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 861796us
I20260709 13:12:57.587436 29380 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
I20260709 13:12:57.572399 29381 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:12:57.417110   585 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:57.589681 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:57.561777 29524 rpcz_store.cc:276] 0709 13:12:55.208127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:56.039950 (+831823us) service_pool.cc:224] Handling call
0709 13:12:56.040298 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:56.159463 (+119165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:56.159532 (+    69us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:56.180397 (+ 20865us) log.cc:844] Serialized 26 byte log entry
0709 13:12:56.426843 (+246446us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:56.426919 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:56.427029 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:57.468339 (+1041310us) raft_consensus.cc:1685] finished
0709 13:12:57.468364 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:57.468560 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84776,"raft.queue_time_us":129267,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":92,"thread_start_us":201748,"threads_started":1,"wal-append.queue_time_us":539560}
I20260709 13:12:57.574745 29450 rpcz_store.cc:276] 0709 13:12:56.272304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:56.272938 (+   634us) service_pool.cc:224] Handling call
0709 13:12:56.273276 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:56.273665 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:56.273698 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:56.274315 (+   617us) log.cc:844] Serialized 26 byte log entry
0709 13:12:56.563421 (+289106us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:56.563533 (+   112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:56.563640 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:57.573888 (+1010248us) raft_consensus.cc:1685] finished
0709 13:12:57.573907 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:57.574054 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17480,"raft.queue_time_us":1435,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":7303,"thread_start_us":261684,"threads_started":1,"wal-append.queue_time_us":489325}
I20260709 13:12:57.584795 29378 raft_consensus.cc:2393] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 11: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:57.593870 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:57.594667 29378 raft_consensus.cc:2393] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 10: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:57.594426 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:57.435738   495 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:57.594970 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 268580us
I20260709 13:12:57.596122 29419 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:57.439767   506 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.441313 29525 rpcz_store.cc:276] 0709 13:12:55.058437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:55.360444 (+302007us) service_pool.cc:224] Handling call
0709 13:12:56.610515 (+1250071us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b5800060c98. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61b71 00007f6a78c61a22 00007f6a81b7ac09 00007f6a80cd4ee0 00007f6a80d9e0ab 00007f6a80d9e131 00007f6a80d5ffc0 00007f6a80d4a929 00007f6a80d4a3d2 00007f6a7a2c1bd4
0709 13:12:56.610806 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:56.611079 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:12:56.620696 (+  9617us) log.cc:844] Serialized 14 byte log entry
0709 13:12:57.383601 (+762905us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:57.383686 (+    85us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:57.383956 (+   270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:57.384056 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:57.384233 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13276,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":48,"raft.queue_time_us":1206,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":11216,"spinlock_wait_cycles":23581440,"thread_start_us":762383,"threads_started":1,"wal-append.queue_time_us":865430}
W20260709 13:12:57.485420 29421 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.537s (SENT) [suppressed 4 similar messages]
I20260709 13:12:57.602159 29522 raft_consensus.cc:2393] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 10: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:57.597352 29344 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:57.553385   470 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:57.524742   565 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:57.564652 29453 rpcz_store.cc:276] 0709 13:12:56.272540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:56.657325 (+384785us) service_pool.cc:224] Handling call
0709 13:12:56.657664 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:56.657905 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:12:56.658255 (+   350us) log.cc:844] Serialized 14 byte log entry
0709 13:12:57.392042 (+733787us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:57.392111 (+    69us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:57.392176 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:57.392265 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:57.392415 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4202,"prepare.queue_time_us":726,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":38,"spinlock_wait_cycles":10336256,"thread_start_us":728750,"threads_started":1,"wal-append.queue_time_us":710688}
I20260709 13:12:57.553747   339 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:57.582842   511 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:57.611972   572 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:57.596818   534 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:57.613878 29525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2728) took 1044 ms. Trace:
I20260709 13:12:57.659834 29525 rpcz_store.cc:276] 0709 13:12:56.569243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.603729 (+1034486us) service_pool.cc:224] Handling call
0709 13:12:57.613331 (+  9602us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:57.613541 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:57.613566 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:57.613611 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:57.613642 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:57.613692 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:57.613806 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:57.614270   372 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:57.425769   382 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:57.607985 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:57.607169 29344 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:57.623407 29374 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
I20260709 13:12:57.667798 29374 raft_consensus.cc:1275] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:57.632254 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:57.525966   600 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:57.582026   535 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:57.636237 29454 raft_consensus.cc:1275] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:12:57.640309   608 log.cc:927] Time spent T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:12:57.677655 29454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 1366) took 1363 ms. Trace:
I20260709 13:12:57.429405   536 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:57.662004 29452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2236) took 1389 ms. Trace:
I20260709 13:12:57.662078 29525 raft_consensus.cc:1275] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:57.670986   572 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:57.641678 29448 raft_consensus.cc:1275] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:12:57.683375 29454 rpcz_store.cc:276] 0709 13:12:56.314207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.597441 (+1283234us) service_pool.cc:224] Handling call
0709 13:12:57.630713 (+ 33272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:57.677228 (+ 46515us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:57.677567 (+   339us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:12:57.683516 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 76413us
I20260709 13:12:57.636073   470 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:57.521905   380 consensus_queue.cc:260] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:57.685822 29374 raft_consensus.cc:1275] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:12:57.720510 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:57.721275 29374 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
W20260709 13:12:57.689970 29345 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.010s	sys 0.014s
W20260709 13:12:57.691190 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 89858.2us
I20260709 13:12:57.704437 29456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 309) took 1433 ms. Trace:
I20260709 13:12:57.722337 29456 rpcz_store.cc:276] 0709 13:12:56.271353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:56.274797 (+  3444us) service_pool.cc:224] Handling call
0709 13:12:56.297397 (+ 22600us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:56.320175 (+ 22778us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:56.320208 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:56.335797 (+ 15589us) log.cc:844] Serialized 26 byte log entry
0709 13:12:57.125366 (+789569us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b18003e6020. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c7be07 00007f6a81ad6ab9 00007f6a78c9869b 00007f6a78c9693f 00007f6a78c98c02 00007f6a7b92020b 00007f6a7b925d23 00007f6a7b9260d1 00007f6a7bd41a0f
0709 13:12:57.572893 (+447527us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:57.572937 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:57.573040 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:57.704123 (+131083us) raft_consensus.cc:1685] finished
0709 13:12:57.704145 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:57.704373 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22012,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":9975,"spinlock_wait_cycles":26347904,"thread_start_us":447246,"threads_started":1,"wal-append.queue_time_us":1343006}
I20260709 13:12:57.725669 29456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2248) took 1370 ms. Trace:
I20260709 13:12:57.586786   539 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:57.693393 29530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2722) took 1126 ms. Trace:
I20260709 13:12:57.727245 29528 raft_consensus.cc:1240] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:12:57.726671 29530 rpcz_store.cc:276] 0709 13:12:56.566961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.361867 (+794906us) service_pool.cc:224] Handling call
0709 13:12:57.374699 (+ 12832us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:57.375009 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:12:57.592081 (+217072us) log.cc:844] Serialized 14 byte log entry
0709 13:12:57.692849 (+100768us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:57.692934 (+    85us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:57.693003 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:57.693108 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:57.693305 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":260911,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":55,"raft.queue_time_us":362,"thread_start_us":305155,"threads_started":2}
I20260709 13:12:57.728461   539 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:57.729125 29530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53428 (request call id 524) took 1095 ms. Trace:
I20260709 13:12:57.729535 29530 rpcz_store.cc:276] 0709 13:12:56.633508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.728132 (+1094624us) service_pool.cc:224] Handling call
0709 13:12:57.728541 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:57.728753 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:57.728792 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:57.728841 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:57.728882 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:57.728948 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:57.729061 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:57.720011 29448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2241) took 1446 ms. Trace:
I20260709 13:12:57.733829 29448 rpcz_store.cc:276] 0709 13:12:56.274045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.601600 (+1327555us) service_pool.cc:224] Handling call
0709 13:12:57.637326 (+ 35726us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:57.709341 (+ 72015us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:57.719919 (+ 10578us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:57.621505   506 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:57.564813   561 consensus_queue.cc:237] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:57.443102   558 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:57.662735   615 raft_consensus.cc:2804] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:57.726104 29456 rpcz_store.cc:276] 0709 13:12:56.355450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.724261 (+1368811us) service_pool.cc:224] Handling call
0709 13:12:57.724816 (+   555us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:57.725085 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:57.725108 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:57.725152 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:57.725179 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:57.725237 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:57.725376 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:57.755962 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:57.716877 29525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2731) took 1124 ms. Trace:
I20260709 13:12:57.677274   602 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.739243 29374 raft_consensus.cc:1275] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:12:57.742506 29377 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
I20260709 13:12:57.758419 29377 raft_consensus.cc:1240] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:57.756910 29379 raft_consensus.cc:2393] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 9: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:57.686235   617 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:57.701972   568 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:57.703960   531 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:57.736142   560 consensus_meta.cc:287] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.967s	user 0.013s	sys 0.002s
I20260709 13:12:57.765060 29525 rpcz_store.cc:276] 0709 13:12:56.592064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.661164 (+1069100us) service_pool.cc:224] Handling call
0709 13:12:57.661616 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:57.688413 (+ 26797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:57.716794 (+ 28381us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:57.781316 29447 raft_consensus.cc:2410] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:12:57.789028 29455 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
I20260709 13:12:57.791050 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:57.686550   600 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:57.785230 29530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53428 (request call id 525) took 1133 ms. Trace:
I20260709 13:12:57.785282 29376 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:12:57.775573   380 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:12:57.786880 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 301500us
I20260709 13:12:57.827191 29530 rpcz_store.cc:276] 0709 13:12:56.651625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.764345 (+1112720us) service_pool.cc:224] Handling call
0709 13:12:57.784542 (+ 20197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:57.784814 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:57.784859 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:57.784912 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:57.784945 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:57.784999 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:57.785146 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:57.766585   513 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:57.756275   615 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
W20260709 13:12:57.862944 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.783599   614 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.877328 29451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2240) took 1603 ms. Trace:
I20260709 13:12:57.861972 28234 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:57.878026 29451 rpcz_store.cc:276] 0709 13:12:56.273800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:56.690038 (+416238us) service_pool.cc:224] Handling call
0709 13:12:56.690514 (+   476us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:56.699869 (+  9355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:56.699905 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:56.701967 (+  2062us) log.cc:844] Serialized 26 byte log entry
0709 13:12:57.560587 (+858620us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:57.560635 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:57.560716 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:57.876978 (+316262us) raft_consensus.cc:1685] finished
0709 13:12:57.877010 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:57.877234 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15845,"raft.queue_time_us":8683,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":8860,"thread_start_us":828557,"threads_started":1,"wal-append.queue_time_us":750480}
I20260709 13:12:57.825922   567 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:57.759140   585 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:57.783062 32685 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:57.788570   617 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:57.830699   339 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:57.855046   528 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:57.775300   602 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:57.820832   560 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:57.859733   615 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:57.895936 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:57.897780 29376 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 10.
W20260709 13:12:57.896540 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:57.899807 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:57.900079 29523 raft_consensus.cc:1240] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:57.902370 29448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2250) took 1546 ms. Trace:
I20260709 13:12:57.908238 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:57.909708 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:57.910983 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:57.912436 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:57.914063   617 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:57.914492   558 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:57.687897 29452 rpcz_store.cc:276] 0709 13:12:56.272795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:56.676434 (+403639us) service_pool.cc:224] Handling call
0709 13:12:56.676829 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:56.677163 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:12:56.677568 (+   405us) log.cc:844] Serialized 14 byte log entry
0709 13:12:57.661517 (+983949us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:57.661596 (+    79us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:57.661658 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:57.661754 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:57.661929 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2065,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":3632,"raft.queue_time_us":109408,"thread_start_us":983439,"threads_started":2}
I20260709 13:12:57.902968 29448 rpcz_store.cc:276] 0709 13:12:56.356073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.735416 (+1379343us) service_pool.cc:224] Handling call
0709 13:12:57.762732 (+ 27316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:57.762949 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:12:57.819280 (+ 56331us) log.cc:844] Serialized 14 byte log entry
0709 13:12:57.901940 (+ 82660us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:57.902005 (+    65us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:57.902058 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:57.902145 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:57.902298 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":119,"thread_start_us":117761,"threads_started":2}
I20260709 13:12:57.922884 29376 raft_consensus.cc:1240] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:57.922945 29521 raft_consensus.cc:1240] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:57.932974 29448 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:57.892220 32685 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:57.882974   614 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:57.937243   466 raft_consensus.cc:2804] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:57.939764   614 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:57.943631   506 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:57.944777   382 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:57.945956   560 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:57.952587 29373 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:12:57.924649   536 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:57.937217 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 199180us
I20260709 13:12:57.967234 29344 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:58.054096 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 86976.6us
W20260709 13:12:58.054396 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 63474.1us
I20260709 13:12:58.053884 29456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2253) took 1696 ms. Trace:
I20260709 13:12:58.061193 29456 rpcz_store.cc:276] 0709 13:12:56.357117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.755199 (+1398082us) service_pool.cc:224] Handling call
0709 13:12:57.775840 (+ 20641us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:57.776117 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:12:57.875425 (+ 99308us) log.cc:844] Serialized 14 byte log entry
0709 13:12:57.977359 (+101934us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:57.977431 (+    72us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:58.053563 (+ 76132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:58.053643 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:58.053810 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6955,"prepare.queue_time_us":155523,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":9330,"raft.queue_time_us":76168,"thread_start_us":149137,"threads_started":2}
I20260709 13:12:57.953065   600 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:57.957605   470 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:57.980269   592 log.cc:927] Time spent T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 1.506s	user 0.005s	sys 0.000s
W20260709 13:12:58.103513 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 221438us
I20260709 13:12:58.112044 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:58.163973 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:58.165064 29450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2247) took 1810 ms. Trace:
I20260709 13:12:58.165380 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:58.166570 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:58.165587 29450 rpcz_store.cc:276] 0709 13:12:56.355129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.592201 (+1237072us) service_pool.cc:224] Handling call
0709 13:12:57.592568 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:57.682646 (+ 90078us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:57.682695 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:57.715383 (+ 32688us) log.cc:844] Serialized 26 byte log entry
0709 13:12:57.934424 (+219041us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:57.934467 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:57.934548 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:58.164817 (+230269us) raft_consensus.cc:1685] finished
0709 13:12:58.164841 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:58.164997 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":77544,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":276,"thread_start_us":280054,"threads_started":2,"wal-append.queue_time_us":335687}
I20260709 13:12:58.167160 29372 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 10.
I20260709 13:12:58.062038   523 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:58.169342 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:58.175073   631 log.cc:927] Time spent T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:12:58.175572 29372 raft_consensus.cc:2393] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 9: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:58.176553 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:58.177827 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:58.178395 29372 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:12:58.173316 29452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 1376) took 1466 ms. Trace:
I20260709 13:12:58.173722   523 raft_consensus.cc:697] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:58.171241 32685 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:58.181767 29452 rpcz_store.cc:276] 0709 13:12:56.706822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.919049 (+1212227us) service_pool.cc:224] Handling call
0709 13:12:57.919541 (+   492us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:57.919958 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:57.919999 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:57.923944 (+  3945us) log.cc:844] Serialized 26 byte log entry
0709 13:12:58.050555 (+126611us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:58.050634 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:58.050760 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:58.173055 (+122295us) raft_consensus.cc:1685] finished
0709 13:12:58.173081 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:58.173245 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":878,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":2979,"thread_start_us":20490,"threads_started":1,"wal-append.queue_time_us":183381}
I20260709 13:12:58.182246 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:58.185204 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:58.186441 29448 raft_consensus.cc:1275] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:12:58.187546 29448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 1377) took 1480 ms. Trace:
I20260709 13:12:58.188171   612 raft_consensus.cc:493] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:58.189072   612 raft_consensus.cc:515] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:58.188067 29448 rpcz_store.cc:276] 0709 13:12:56.707142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.923139 (+1215997us) service_pool.cc:224] Handling call
0709 13:12:57.932796 (+  9657us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:58.187145 (+254349us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:58.187422 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:58.189082   436 raft_consensus.cc:3055] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:58.190104   436 raft_consensus.cc:740] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:58.189436 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:58.191001   436 consensus_queue.cc:260] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:58.193042 29372 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11.
I20260709 13:12:58.199268 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:58.199615 29529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 1501) took 1893 ms. Trace:
I20260709 13:12:58.201485 29529 rpcz_store.cc:276] 0709 13:12:56.305798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:56.768122 (+462324us) service_pool.cc:224] Handling call
0709 13:12:57.330461 (+562339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:57.424931 (+ 94470us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:58.196205 (+771274us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b54002323d0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd858ad 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:58.199513 (+  3308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1218127104}
I20260709 13:12:58.209194 29372 raft_consensus.cc:2393] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 10: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:58.183292   523 consensus_queue.cc:237] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:58.226665 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:58.200456   615 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:58.231247 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:58.231942   624 consensus_queue.cc:1059] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:58.233667   558 raft_consensus.cc:3055] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:58.234088   558 raft_consensus.cc:740] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:58.234977   558 consensus_queue.cc:260] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:58.236418   558 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:58.236989   575 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:58.243192 29528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2726) took 1674 ms. Trace:
I20260709 13:12:58.226233   436 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:58.243742 29528 rpcz_store.cc:276] 0709 13:12:56.568592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.597232 (+1028640us) service_pool.cc:224] Handling call
0709 13:12:57.635789 (+ 38557us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:57.727893 (+ 92104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:58.242880 (+514987us) spinlock_profiling.cc:243] Waited 91 ms on lock 0x7b54000cb2d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:58.243119 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":209349888}
I20260709 13:12:58.247891 29374 raft_consensus.cc:1240] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:58.244004 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:58.226008   612 leader_election.cc:290] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:58.248929 29372 raft_consensus.cc:2393] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 13: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:58.250790   615 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:58.251204   602 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:58.262929 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:12:58.262902 29346 connection.cc:256] RPC call timeout handler was delayed by -1.4845406409999669s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2076s for a response
W20260709 13:12:58.264998 29346 connection.cc:256] RPC call timeout handler was delayed by -1.4755406409999523s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2086s for a response
I20260709 13:12:58.267328 29521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2723) took 1699 ms. Trace:
I20260709 13:12:58.267961 29521 rpcz_store.cc:276] 0709 13:12:56.567483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.387696 (+820213us) service_pool.cc:224] Handling call
0709 13:12:57.404976 (+ 17280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:57.923707 (+518731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:58.267052 (+343345us) spinlock_profiling.cc:243] Waited 518 ms on lock 0x7b540006efd4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:58.267260 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1190607232}
W20260709 13:12:58.265625 29346 connection.cc:256] RPC call timeout handler was delayed by -1.3627082410000639s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1718s for a response
W20260709 13:12:58.269959 29346 connection.cc:256] RPC call timeout handler was delayed by -1.3317702310000641s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1978s for a response
W20260709 13:12:58.270330 29346 connection.cc:256] RPC call timeout handler was delayed by -1.251037186000076s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1865s for a response
W20260709 13:12:58.270699 29346 connection.cc:256] RPC call timeout handler was delayed by -1.244788146000019s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17310000000000003s for a response
W20260709 13:12:58.271046 29346 connection.cc:256] RPC call timeout handler was delayed by -1.1205371860000923s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20099999999999998s for a response
W20260709 13:12:58.271390 29346 connection.cc:256] RPC call timeout handler was delayed by -1.059876253000084s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2323s for a response
I20260709 13:12:58.274204 29346 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:58.275672 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:58.276489 29455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45796 (request call id 1374) took 1579 ms. Trace:
I20260709 13:12:58.277148 29372 raft_consensus.cc:2393] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 14: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:58.276949 29455 rpcz_store.cc:276] 0709 13:12:56.697252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.310854 (+613602us) service_pool.cc:224] Handling call
0709 13:12:58.276305 (+965451us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b5400260f54. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:58.276421 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":933946112}
I20260709 13:12:58.277842   615 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:58.281176 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:58.282397 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:58.282759 29451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 1373) took 1585 ms. Trace:
I20260709 13:12:58.278852 29346 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:58.284093   615 raft_consensus.cc:2804] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:58.284607   615 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.284947   615 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:58.283232 29451 rpcz_store.cc:276] 0709 13:12:56.696950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.880479 (+1183529us) service_pool.cc:224] Handling call
0709 13:12:57.880848 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:57.899758 (+ 18910us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:57.899808 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:57.900493 (+   685us) log.cc:844] Serialized 26 byte log entry
0709 13:12:58.060091 (+159598us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:58.124939 (+ 64848us) log.cc:844] Serialized 14 byte log entry
0709 13:12:58.126324 (+  1385us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:58.126436 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:58.282527 (+156091us) raft_consensus.cc:1685] finished
0709 13:12:58.282550 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:58.282693 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18378,"prepare.queue_time_us":63810,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":61,"raft.queue_time_us":66719,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":20544,"thread_start_us":140981,"threads_started":1,"wal-append.queue_time_us":197940}
I20260709 13:12:58.291651 29346 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:58.292645 29346 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:58.293483   602 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:58.293637   621 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:58.294037   602 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.294433   602 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:58.294217   621 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:58.296712   621 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:12:58.301036 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:58.293493   575 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:12:58.304932   575 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:12:58.307178   575 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:12:58.308723 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.313385 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:58.314607 29377 raft_consensus.cc:2393] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 10: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
W20260709 13:12:58.315588   637 log.cc:927] Time spent T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:12:58.318699 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:58.324234 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:58.325013 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:58.321092 29346 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:58.322580 32685 raft_consensus.cc:2749] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:58.330389 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:58.325299 29379 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 10.
I20260709 13:12:58.345752 29380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1288) took 1318 ms. Trace:
I20260709 13:12:58.339334 29346 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:58.346395 29380 rpcz_store.cc:276] 0709 13:12:57.026846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.680860 (+654014us) service_pool.cc:224] Handling call
0709 13:12:57.681259 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:57.681503 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:12:57.744078 (+ 62575us) log.cc:844] Serialized 14 byte log entry
0709 13:12:58.316573 (+572495us) spinlock_profiling.cc:243] Waited 5.38 ms on lock 0x7b18003399a0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c7be07 00007f6a81ad6ab9 00007f6a78c9869b 00007f6a78c9693f 00007f6a78c98c02 00007f6a7b92020b 00007f6a7b925d23 00007f6a7b92623a 00007f6a7bd90a2a
0709 13:12:58.345420 (+ 28847us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:58.345472 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:58.345517 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:58.345582 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:58.345690 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":56505,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":4621,"spinlock_wait_cycles":12378368,"thread_start_us":28587,"threads_started":1}
I20260709 13:12:58.351289 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:58.352106 29452 raft_consensus.cc:2393] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 10: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:58.353660 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:58.353073 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:58.355746 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:58.356513 29377 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:12:58.329833   558 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.359113 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:58.362982 29450 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:12:58.348981 29451 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96"
dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:45798
I20260709 13:12:58.365268 29451 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:58.365864 29451 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:58.366714   552 raft_consensus.cc:3055] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:58.367115   552 raft_consensus.cc:740] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:58.351614   382 raft_consensus.cc:2804] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:58.368407   382 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.368826   382 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:58.353849   339 consensus_queue.cc:1048] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:12:58.370460 29523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2724) took 1802 ms. Trace:
I20260709 13:12:58.372968 29378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1285) took 1347 ms. Trace:
I20260709 13:12:58.373413 29378 rpcz_store.cc:276] 0709 13:12:57.025948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.595288 (+569340us) service_pool.cc:224] Handling call
0709 13:12:57.600339 (+  5051us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:57.880967 (+280628us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:12:57.892463 (+ 11496us) log.cc:844] Serialized 14 byte log entry
0709 13:12:58.173757 (+281294us) log.cc:844] Serialized 14 byte log entry
0709 13:12:58.173955 (+   198us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:58.174007 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:58.174058 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:58.372663 (+198605us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b54003f3254. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:58.372716 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:58.372899 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48108,"prepare.queue_time_us":13618,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":90,"raft.queue_time_us":96543,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":129,"spinlock_wait_cycles":644582784,"thread_start_us":184383,"threads_started":1,"wal-append.queue_time_us":301625}
I20260709 13:12:58.375806   575 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.376415   575 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:12:58.370868 29523 rpcz_store.cc:276] 0709 13:12:56.567873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.442525 (+874652us) service_pool.cc:224] Handling call
0709 13:12:57.457223 (+ 14698us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:57.916317 (+459094us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:58.370177 (+453860us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b54000a4454. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:58.370389 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1018033024}
I20260709 13:12:58.368129   552 consensus_queue.cc:260] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:58.382184 29522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37968 (request call id 2727) took 1813 ms. Trace:
I20260709 13:12:58.386333 29524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2725) took 1818 ms. Trace:
I20260709 13:12:58.390305 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:58.390970 29455 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:58.392099   558 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:58.394706 29448 raft_consensus.cc:1275] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:58.402170   530 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:58.407955 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:58.409051 29529 raft_consensus.cc:2393] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 8: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:58.410137 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:58.411585 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:58.412343 29448 raft_consensus.cc:1240] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:58.413678   466 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:58.414157   466 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:58.416726 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 51923.2us
I20260709 13:12:58.412338 29525 raft_consensus.cc:2368] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10.
I20260709 13:12:58.418329 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:58.419430 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:58.427139 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.382764 29522 rpcz_store.cc:276] 0709 13:12:56.568916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:56.639811 (+ 70895us) service_pool.cc:224] Handling call
0709 13:12:58.381872 (+1742061us) spinlock_profiling.cc:243] Waited 951 ms on lock 0x7b54003589d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:58.382093 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2187924864}
I20260709 13:12:58.349483   523 raft_consensus.cc:2804] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:58.430141 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:58.440160 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:58.386869 29524 rpcz_store.cc:276] 0709 13:12:56.568274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.592284 (+1024010us) service_pool.cc:224] Handling call
0709 13:12:57.592568 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:57.592926 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:57.592952 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:57.593469 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 13:12:58.385454 (+791985us) spinlock_profiling.cc:243] Waited 8.51 ms on lock 0x7b180036ad80. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a7b92e4bc 00007f6a78c7c48b 00007f6a81ad6ab9 00007f6a78c9869b 00007f6a78c9693f 00007f6a78c98c02 00007f6a7b92020b 00007f6a7b925d23 00007f6a7b9260d1
0709 13:12:58.385703 (+   249us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:58.385759 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:58.385867 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:58.385931 (+    64us) raft_consensus.cc:1685] finished
0709 13:12:58.385950 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:58.386250 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":40311,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":29204,"spinlock_wait_cycles":19582208,"thread_start_us":77656,"threads_started":1,"wal-append.queue_time_us":172022}
I20260709 13:12:58.444521 29452 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:12:58.445267 29522 raft_consensus.cc:2468] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 8.
I20260709 13:12:58.448251 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:58.451484 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:58.451669 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:12:58.452024 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.452252 29452 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:58.453631 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:58.452286 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:58.457024 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.455112 29522 raft_consensus.cc:2393] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 11: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:58.457464 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:58.440771 29456 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:12:58.458199 29528 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:58.443291 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:58.459056 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:58.432053   552 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:58.471079 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:58.470376 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:58.447541   523 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:58.460086 29344 connection.cc:256] RPC call timeout handler was delayed by -1.0701716579999356s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17310000000000003s for a response
W20260709 13:12:58.484431 29344 connection.cc:256] RPC call timeout handler was delayed by -1.047040485000025s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20099999999999998s for a response
I20260709 13:12:58.464694 29421 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:58.486541 29421 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:58.459216 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:58.479915 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:58.478152 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:58.488227 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:58.489089 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:58.489846 29525 raft_consensus.cc:2393] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 11: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:58.484215 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:58.492226 29455 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:12:58.492915 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:58.491272 29523 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:58.496251 29521 raft_consensus.cc:2393] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 10: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:58.498097 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:58.493534 29379 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:12:58.501919 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:58.495703 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:58.506068 29451 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:58.455696   576 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.503530 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:58.506412 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:58.441679   497 consensus_queue.cc:1048] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:12:58.452795   612 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:58.455622   558 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:58.517124 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:58.510404 29455 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:12:58.491099   523 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:58.496809   621 raft_consensus.cc:2804] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:58.522382 29451 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:58.520664 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:58.460024   470 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:58.557061 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:58.583550 29448 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:58.515998   564 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:58.563946 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:58.518249   576 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:58.581696 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:58.599815 29455 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:12:58.582763 29521 raft_consensus.cc:2393] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 10: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:58.582472 29528 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:12:58.508859 30154 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:12:58.584986 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:58.601815 29523 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:12:58.601858 29452 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:12:58.587848 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:58.585816 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:58.564999   558 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:58.586755 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:58.564775   621 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.611780   621 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:58.603327 29376 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:12:58.591084   470 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:58.604880 29525 raft_consensus.cc:1240] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:58.609903 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:58.626262 29377 raft_consensus.cc:2393] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 11: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:12:58.610237   646 log.cc:927] Time spent T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:12:58.619899 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:58.626132 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:58.631217 29448 raft_consensus.cc:2393] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 10: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:12:58.627863 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:58.629053 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:58.632387 29447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45796 (request call id 1372) took 1936 ms. Trace:
I20260709 13:12:58.632795 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:58.634369   575 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:58.635977   470 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:58.511471   612 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:58.639211 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:58.623050 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:58.632807 29447 rpcz_store.cc:276] 0709 13:12:56.696618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.308639 (+612021us) service_pool.cc:224] Handling call
0709 13:12:58.632199 (+1323560us) spinlock_profiling.cc:243] Waited 95 ms on lock 0x7b5400019ad4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:58.632328 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":218578304}
I20260709 13:12:58.647553 29523 raft_consensus.cc:2410] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:12:58.652735 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:58.621793   558 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.680310 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:58.680866 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:58.681277 29528 raft_consensus.cc:2393] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 10: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:58.682389 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:58.684201 29455 raft_consensus.cc:1240] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:58.685963 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:58.662052 29523 raft_consensus.cc:2393] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 12: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:58.662598 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:58.668711   615 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:58.674271 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:58.678591 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:58.678742 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:58.698062 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:58.689723 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:58.699928 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:58.699950 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:58.700973 29450 raft_consensus.cc:2410] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:12:58.700839 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:58.701578 29528 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:12:58.702459 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:58.703184 29528 raft_consensus.cc:2393] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 10: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:58.703437 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:58.704732 29522 raft_consensus.cc:2393] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 10: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:58.704288 29523 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 8.
I20260709 13:12:58.707967 29524 raft_consensus.cc:1275] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:12:58.709197 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 222450us
I20260709 13:12:58.711113 29421 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:58.716202 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:58.716544 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:12:58.719027 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:58.724515 29524 raft_consensus.cc:1240] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:58.726349 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:58.727514 29523 raft_consensus.cc:2468] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:12:58.719323 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:58.736089 29528 raft_consensus.cc:1240] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 10. Current term is 11. Ops: []
W20260709 13:12:58.707739   644 log.cc:927] Time spent T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.070s	user 0.000s	sys 0.002s
I20260709 13:12:58.697010   558 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:58.739567 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:12:58.745198 29375 raft_consensus.cc:2393] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 11: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:58.746003 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:58.748119 29522 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 10.
I20260709 13:12:58.722044   624 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:12:58.786850 29527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37968 (request call id 2717) took 3097 ms (client timeout 2010 ms). Trace:
I20260709 13:12:58.737361   470 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.754580 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:12:58.790161 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:58.787441 29527 rpcz_store.cc:269] 0709 13:12:55.680564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:55.950741 (+270177us) service_pool.cc:224] Handling call
0709 13:12:58.777695 (+2826954us) spinlock_profiling.cc:243] Waited 732 ms on lock 0x7b54002bbe54. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:58.777832 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1684635008}
I20260709 13:12:58.794816 29523 raft_consensus.cc:2393] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 13: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:12:58.800367 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.807936 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:58.779336   530 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.825054 29454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2252) took 2468 ms. Trace:
I20260709 13:12:58.832490 29454 rpcz_store.cc:276] 0709 13:12:56.356761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.744489 (+1387728us) service_pool.cc:224] Handling call
0709 13:12:57.780222 (+ 35733us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:12:57.878930 (+ 98708us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:57.878953 (+    23us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:12:57.888138 (+  9185us) log.cc:844] Serialized 78 byte log entry
0709 13:12:58.310055 (+421917us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b1800149320. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c7be07 00007f6a81ad6ab9 00007f6a78c9869b 00007f6a78c9693f 00007f6a78c98c02 00007f6a7b92020b 00007f6a7b925d23 00007f6a7b9260d1 00007f6a7bd41a0f
0709 13:12:58.416222 (+106167us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:58.455686 (+ 39464us) log.cc:844] Serialized 14 byte log entry
0709 13:12:58.456064 (+   378us) log.cc:844] Serialized 14 byte log entry
0709 13:12:58.456248 (+   184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:58.456324 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:58.631205 (+174881us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b1800149320. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c993f3 00007f6a78c9b7c1 00007f6a78c9b779 00007f6a78c9b709 00007f6a78c9b6d1 00007f6a78c9a9cd 000000000038f354 000000000038f199 00007f6a78c7c83a
0709 13:12:58.672652 (+ 41447us) spinlock_profiling.cc:243] Waited 4.88 ms on lock 0x7b1800149320. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c993f3 00007f6a78c9b7c1 00007f6a78c9b779 00007f6a78c9b709 00007f6a78c9b6d1 00007f6a78c9a9cd 000000000038f354 000000000038f199 00007f6a78c7c83a
0709 13:12:58.824689 (+152037us) raft_consensus.cc:1685] finished
0709 13:12:58.824725 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:58.824953 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74228,"prepare.queue_time_us":215016,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":71,"raft.queue_time_us":95681,"raft.run_cpu_time_us":478,"raft.run_wall_time_us":27915,"spinlock_wait_cycles":63787904,"thread_start_us":105892,"threads_started":1,"wal-append.queue_time_us":693537}
I20260709 13:12:58.851774   615 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:58.856717 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:12:58.880467 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:58.894673 29449 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45796 (request call id 1369) took 2553 ms (client timeout 2095 ms). Trace:
W20260709 13:12:58.895321 29449 rpcz_store.cc:269] 0709 13:12:56.339274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:56.639414 (+300140us) service_pool.cc:224] Handling call
0709 13:12:58.892750 (+2253336us) spinlock_profiling.cc:243] Waited 687 ms on lock 0x7b5400127354. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:58.892926 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1580842752}
I20260709 13:12:58.892026   455 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:12:58.902530   604 log.cc:927] Time spent T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 1.533s	user 0.009s	sys 0.004s
W20260709 13:12:58.904247   648 log.cc:927] Time spent T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:12:58.905539 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:12:58.906500 29378 raft_consensus.cc:2393] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 10: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:58.918005 29374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52172 (request call id 1641) took 1216 ms. Trace:
I20260709 13:12:58.918529 29374 rpcz_store.cc:276] 0709 13:12:57.701146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.764387 (+ 63241us) service_pool.cc:224] Handling call
0709 13:12:57.764665 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:58.248384 (+483719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:58.907376 (+658992us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b5400081454. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:58.917917 (+ 10541us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1110863616}
I20260709 13:12:58.902630   455 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:58.846361   542 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:58.952672 29276 catalog_manager.cc:5697] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 11 to 12, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 12 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:58.917303 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:58.959860   585 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:58.980156 29278 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35182 (request call id 66) took 6724 ms. Trace:
W20260709 13:12:59.012219 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:59.088313 29344 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.018s	sys 0.032s
W20260709 13:12:59.088985 29344 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.018s	sys 0.032s
W20260709 13:12:59.089386 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 603968us
W20260709 13:12:59.119372 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:59.163298 29526 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.000s	sys 0.016s
W20260709 13:12:59.164113 29526 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.001s	sys 0.016s
I20260709 13:12:58.957551 29276 catalog_manager.cc:5697] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 11 to 12, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 12 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:59.177759 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:59.179701 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 408572us
I20260709 13:12:59.179340 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:59.181800 29522 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:12:59.180682 29421 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:12:59.185675 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 65046.5us
I20260709 13:12:59.187572 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:59.187647 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:59.188907 29523 raft_consensus.cc:2393] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 11: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:59.188405 29522 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
W20260709 13:12:59.191452 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:58.981263 29278 rpcz_store.cc:276] 0709 13:12:52.255398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:52.255571 (+   173us) service_pool.cc:224] Handling call
0709 13:12:58.980005 (+6724434us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:55.301844 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:55.465252 (+163408us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:55.474566 (+  9314us) write_op.cc:435] Acquired schema lock
0709 13:12:55.477947 (+  3381us) tablet.cc:662] Decoding operations
0709 13:12:55.528147 (+ 50200us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:55.532385 (+  4238us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:55.539218 (+  6833us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:12:55.570544 (+ 31326us) tablet.cc:701] Row locks acquired
0709 13:12:55.597607 (+ 27063us) write_op.cc:260] PREPARE: finished
0709 13:12:55.609371 (+ 11764us) write_op.cc:270] Start()
0709 13:12:55.635374 (+ 26003us) write_op.cc:276] Timestamp: P: 1783602775604503 usec, L: 0
0709 13:12:55.638012 (+  2638us) op_driver.cc:348] REPLICATION: starting
0709 13:12:55.831134 (+193122us) log.cc:844] Serialized 538 byte log entry
0709 13:12:56.516514 (+685380us) op_driver.cc:464] REPLICATION: finished
0709 13:12:57.521378 (+1004864us) write_op.cc:301] APPLY: starting
0709 13:12:57.525820 (+  4442us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:57.553513 (+ 27693us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:57.596114 (+ 42601us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:57.596444 (+   330us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:57.609150 (+ 12706us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:12:57.609201 (+    51us) write_op.cc:312] APPLY: finished
0709 13:12:57.609441 (+   240us) log.cc:844] Serialized 22 byte log entry
0709 13:12:57.686455 (+ 77014us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:57.706216 (+ 19761us) write_op.cc:454] Released schema lock
0709 13:12:57.716758 (+ 10542us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:57.820566 (+103808us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:57.824438 (+  3872us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1063449,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":946954,"apply.run_cpu_time_us":12198,"apply.run_wall_time_us":265318,"num_ops":1,"prepare.queue_time_us":100202,"prepare.run_cpu_time_us":58707,"prepare.run_wall_time_us":726615,"raft.queue_time_us":206948,"raft.run_cpu_time_us":45427,"raft.run_wall_time_us":1191488,"replication_time_us":858068,"thread_start_us":1379739,"threads_started":5,"wal-append.queue_time_us":273903,"wal-append.run_cpu_time_us":33969,"wal-append.run_wall_time_us":2294798}]]}
I20260709 13:12:59.198041 29421 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:59.209511 29421 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:59.213685 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:59.226368 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:59.227602   649 consensus_queue.cc:1059] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:12:59.228621   542 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:59.230273 29524 raft_consensus.cc:1240] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10. Ops: []
W20260709 13:12:59.230846 29530 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.006s	sys 0.013s
I20260709 13:12:59.231680 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:59.237743 29346 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:59.235634 29522 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 10.
I20260709 13:12:59.203855   564 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:59.245117 29523 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 10.
I20260709 13:12:58.805765   470 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:59.219015   575 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:59.246166 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:59.246762 29530 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.006s	sys 0.013s
W20260709 13:12:59.246975 29455 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.023s	sys 0.050s
I20260709 13:12:59.241974 29344 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:59.248152 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:59.278261 29522 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:59.186048   530 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:59.281234 29455 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.024s	sys 0.050s
I20260709 13:12:59.259266 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:59.212024   600 consensus_queue.cc:1059] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:12:59.283213 29524 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 7.
I20260709 13:12:59.280022 29523 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11.
W20260709 13:12:59.283573 29521 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.006s	sys 0.013s
W20260709 13:12:59.287410 29521 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.006s	sys 0.013s
I20260709 13:12:59.293133 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:59.229873   634 consensus_queue.cc:1048] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:12:59.249142   636 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:59.250169   564 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.297426 29449 raft_consensus.cc:1275] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:12:59.299868   661 log.cc:927] Time spent T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:12:59.235945   436 consensus_queue.cc:1059] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:12:59.289847   576 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:59.310003   530 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:59.312475   612 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:12:59.313237   382 consensus_meta.cc:287] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.944s	user 0.014s	sys 0.008s
I20260709 13:12:59.314960 29279 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37594 (request call id 136) took 8319 ms. Trace:
I20260709 13:12:59.244483   542 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:59.296422 29276 catalog_manager.cc:5697] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 6 to 7, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 7 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:59.340407 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:59.283776   575 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.382876 29524 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 7.
I20260709 13:12:59.391287 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:59.391621 29522 raft_consensus.cc:2468] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
I20260709 13:12:59.392830 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:59.372912 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:59.244999   339 consensus_queue.cc:1059] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 13:12:59.378358   382 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:59.388195 29276 catalog_manager.cc:5697] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:59.408866 29523 raft_consensus.cc:2368] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10.
I20260709 13:12:59.393591 29522 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:12:59.315011   455 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:59.332965   649 raft_consensus.cc:3055] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:59.235031   615 consensus_queue.cc:1059] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.131s
I20260709 13:12:59.341851   504 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:59.341044   564 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:59.376718 29279 rpcz_store.cc:276] 0709 13:12:50.995615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:51.012700 (+ 17085us) service_pool.cc:224] Handling call
0709 13:12:51.429255 (+416555us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b5400422054. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcf0090 00007f6a7bd8ef3a 00007f6a81b451cc 00007f6a81c4337e 00007f6a801042a4 00007f6a80104232 00007f6a80104161 00007f6a801040dc 00007f6a80103392 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:12:59.314732 (+7885477us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:53.048972 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:53.050043 (+  1071us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:53.050151 (+   108us) write_op.cc:435] Acquired schema lock
0709 13:12:53.050188 (+    37us) tablet.cc:662] Decoding operations
0709 13:12:53.316810 (+266622us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:53.390394 (+ 73584us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:53.397195 (+  6801us) tablet.cc:685] Acquiring locks for 22 operations
0709 13:12:53.440806 (+ 43611us) tablet.cc:701] Row locks acquired
0709 13:12:53.440868 (+    62us) write_op.cc:260] PREPARE: finished
0709 13:12:53.441084 (+   216us) write_op.cc:270] Start()
0709 13:12:53.441283 (+   199us) write_op.cc:276] Timestamp: P: 1783602773441006 usec, L: 0
0709 13:12:53.441333 (+    50us) op_driver.cc:348] REPLICATION: starting
0709 13:12:53.484529 (+ 43196us) log.cc:844] Serialized 8810 byte log entry
0709 13:12:53.808562 (+324033us) op_driver.cc:464] REPLICATION: finished
0709 13:12:53.848270 (+ 39708us) write_op.cc:301] APPLY: starting
0709 13:12:53.848394 (+   124us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:53.848955 (+   561us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:53.849162 (+   207us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:53.933297 (+ 84135us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:53.933866 (+   569us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=22
0709 13:12:53.933925 (+    59us) write_op.cc:312] APPLY: finished
0709 13:12:53.934585 (+   660us) log.cc:844] Serialized 151 byte log entry
0709 13:12:53.948920 (+ 14335us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:53.963542 (+ 14622us) write_op.cc:454] Released schema lock
0709 13:12:53.974307 (+ 10765us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:54.131053 (+156746us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:54.139206 (+  8153us) write_op.cc:454] Released schema lock
0709 13:12:54.491636 (+352430us) spinlock_profiling.cc:243] Waited 7.35 ms on lock 0x7b5400422054. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8332a 00007f6a7bd08f14 00007f6a7bd08ec3 00007f6a7bd08e38 00007f6a7bd08df3 00007f6a7bd080dc 00007f6a7bd31e16 00007f6a7bd19cbb 00007f6a7bd0439d 00007f6a7bd07d75
Metrics: {"mutex_wait_us":1452722,"reported_tablets":48,"spinlock_wait_cycles":755705600,"child_traces":[["op",{"apply.queue_time_us":39296,"apply.run_cpu_time_us":8167,"apply.run_wall_time_us":215819,"num_ops":22,"prepare.queue_time_us":192343,"prepare.run_cpu_time_us":27873,"prepare.run_wall_time_us":538980,"raft.queue_time_us":93128,"raft.run_cpu_time_us":13806,"raft.run_wall_time_us":703873,"replication_time_us":357719,"spinlock_wait_cycles":16913152,"thread_start_us":323006,"threads_started":4,"wal-append.queue_time_us":177808,"wal-append.run_cpu_time_us":18576,"wal-append.run_wall_time_us":1286442}]]}
I20260709 13:12:59.414422 29276 catalog_manager.cc:5697] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 5 to 6, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 6 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:59.431509 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:59.435115 29522 raft_consensus.cc:2468] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:12:59.417100 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:59.438266 29524 raft_consensus.cc:2393] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 11: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:59.386233   542 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:59.429009 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:12:59.438949   602 consensus_meta.cc:287] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 1.144s	user 0.011s	sys 0.022s
I20260709 13:12:59.441267   602 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:59.444479   602 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:59.437291   621 consensus_meta.cc:287] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.825s	user 0.010s	sys 0.012s
W20260709 13:12:59.445639 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:59.445340   621 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:59.445384 29523 raft_consensus.cc:2468] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:12:59.437124 29276 catalog_manager.cc:5697] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:59.448199   470 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:12:59.448868   621 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:59.451524   382 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:59.406898   575 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:59.431910 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:59.455469 29529 raft_consensus.cc:2393] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 10: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:59.374850   522 consensus_queue.cc:1059] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:12:59.463011 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:59.464066 29521 raft_consensus.cc:2410] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:12:59.465371 29495 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:59.466097 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:59.466418   612 raft_consensus.cc:2804] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:59.465025 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:59.466969   612 raft_consensus.cc:697] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:12:59.467406 29521 raft_consensus.cc:2393] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 12: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:59.468561 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:59.468166   612 consensus_queue.cc:237] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:12:59.469316 29521 raft_consensus.cc:2393] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 11: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:12:59.470623   523 consensus_meta.cc:287] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.892s	user 0.014s	sys 0.007s
I20260709 13:12:59.470196 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:59.471097   523 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:59.472357 29372 raft_consensus.cc:2393] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 11: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:12:59.473562   523 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:59.475033   466 consensus_meta.cc:287] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 1.060s	user 0.011s	sys 0.009s
I20260709 13:12:59.474929 29381 raft_consensus.cc:1240] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:59.475678   466 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:59.477679 29381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1286) took 2451 ms. Trace:
I20260709 13:12:59.478245 29381 rpcz_store.cc:276] 0709 13:12:57.026281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:57.598345 (+572064us) service_pool.cc:224] Handling call
0709 13:12:58.926540 (+1328195us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b5800010298. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61b71 00007f6a78c61a22 00007f6a81b7ac09 00007f6a80cd4ee0 00007f6a80d9e0ab 00007f6a80d9e131 00007f6a80d5ffc0 00007f6a80d4a929 00007f6a80d4a3d2 00007f6a7a2c1bd4
0709 13:12:59.474676 (+548136us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:59.475744 (+  1068us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:59.477402 (+  1658us) spinlock_profiling.cc:243] Waited 548 ms on lock 0x7b5400191250. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd858ad 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:12:59.477595 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1262974720}
I20260709 13:12:59.479662 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:59.480470 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:59.480521 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:59.480839 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:59.481524 29521 raft_consensus.cc:2393] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 8: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:59.477713   466 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:59.482092 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:59.472393 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:59.482532 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:59.483227 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:12:59.485772   615 raft_consensus.cc:3055] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:59.486176   615 raft_consensus.cc:740] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:59.487679 29448 raft_consensus.cc:1240] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:59.499977 29521 raft_consensus.cc:2410] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:12:59.481559 29524 raft_consensus.cc:2393] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 10: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:59.508641 29529 raft_consensus.cc:2393] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 12: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:12:59.509716 29495 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:59.518306 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:12:59.529479 29495 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:59.430965   339 raft_consensus.cc:3055] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:59.430117   649 raft_consensus.cc:740] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:12:59.535358 29495 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:59.494172   602 raft_consensus.cc:3055] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:59.433936   504 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:59.533103 29526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2741) took 1042 ms. Trace:
I20260709 13:12:59.541934   530 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:59.542513   455 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:59.536628   339 raft_consensus.cc:740] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:59.553949   602 raft_consensus.cc:740] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:59.560855   504 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:59.482532   466 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:12:59.602563 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:59.478777   542 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:59.570291   576 raft_consensus.cc:2804] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:59.573537   530 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:59.573273   455 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:59.544445   615 consensus_queue.cc:260] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:59.631985 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 384542us
I20260709 13:12:59.633381 29346 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:59.634029 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 426155us
I20260709 13:12:59.641270 29421 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:59.644508 29421 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:12:59.645587 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:59.622704   576 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:59.628391   530 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:59.630585   455 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:59.635226 29346 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:12:59.556521 29526 rpcz_store.cc:276] 0709 13:12:58.515827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.515983 (+   156us) service_pool.cc:224] Handling call
0709 13:12:58.565623 (+ 49640us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:58.565912 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:12:59.164719 (+598807us) log.cc:844] Serialized 14 byte log entry
0709 13:12:59.532611 (+367892us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:59.532687 (+    76us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:59.532759 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:59.532857 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:59.533024 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":331931,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":121,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":10404,"thread_start_us":935527,"threads_started":2}
I20260709 13:12:59.619988   466 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:59.641212   634 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:59.693584 29455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2283) took 1020 ms. Trace:
I20260709 13:12:59.637706   470 consensus_queue.cc:1048] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:12:59.657838   576 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:59.656973   615 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:59.714103 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 432968us
I20260709 13:12:59.618218   649 consensus_queue.cc:260] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:59.746395 29530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2745) took 1124 ms. Trace:
I20260709 13:12:59.688962   523 raft_consensus.cc:3055] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:59.671821   524 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:59.694232 29455 rpcz_store.cc:276] 0709 13:12:58.673180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.701040 (+ 27860us) service_pool.cc:224] Handling call
0709 13:12:58.701442 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:58.701664 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:12:58.731073 (+ 29409us) log.cc:844] Serialized 14 byte log entry
0709 13:12:59.693076 (+962003us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:59.693160 (+    84us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:59.693226 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:59.693319 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:59.693501 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3817,"prepare.queue_time_us":53439,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":372732,"thread_start_us":957660,"threads_started":2,"wal-append.queue_time_us":644203}
W20260709 13:12:59.737699 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 70668.4us
I20260709 13:12:59.625937   339 consensus_queue.cc:260] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:59.715190 29344 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:59.764004 29346 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:59.782845 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 67769.1us
I20260709 13:12:59.783591 29346 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:12:59.757612 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 200204us
I20260709 13:12:59.648944   602 consensus_queue.cc:260] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:59.762557   558 consensus_meta.cc:287] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.984s	user 0.018s	sys 0.009s
I20260709 13:12:59.761673   524 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:59.803615 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 159141us
I20260709 13:12:59.755483   523 raft_consensus.cc:740] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:12:59.808843 29495 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:59.790809 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:59.788223 29344 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:12:59.790920 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:59.754048   634 consensus_queue.cc:1048] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:12:59.780242   669 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:59.788131 29346 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:59.810634 29421 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:59.831084 29346 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:59.807222   649 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:59.784677   674 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:12:59.812592   670 log.cc:927] Time spent T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:12:59.813076   666 log.cc:927] Time spent T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:12:59.840672 29421 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:12:59.753310 29530 rpcz_store.cc:276] 0709 13:12:58.622461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.622731 (+   270us) service_pool.cc:224] Handling call
0709 13:12:58.633049 (+ 10318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:58.633311 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:12:59.282225 (+648914us) log.cc:844] Serialized 14 byte log entry
0709 13:12:59.745660 (+463435us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:59.745749 (+    89us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:59.745821 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:59.745936 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:59.746290 (+   354us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6854,"prepare.queue_time_us":269494,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":7012,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":9811,"thread_start_us":1102757,"threads_started":2}
I20260709 13:12:59.770256   564 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:59.788950   382 raft_consensus.cc:2804] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:59.810825   339 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:59.857306 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:59.825322   602 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:59.815517   524 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:59.796478   600 raft_consensus.cc:2804] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:59.808947   680 raft_consensus.cc:2749] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:59.813401   675 raft_consensus.cc:2804] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:12:59.876004 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 45181.1us
I20260709 13:12:59.841470   585 raft_consensus.cc:2804] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:59.874058   382 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.836302   669 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:12:59.884308   552 consensus_meta.cc:287] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 1.395s	user 0.018s	sys 0.007s
I20260709 13:12:59.856108   674 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:12:59.835772   677 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:59.813745   667 consensus_queue.cc:1048] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:12:59.936429   382 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:59.839860   624 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:59.893193   672 log.cc:927] Time spent T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
W20260709 13:12:59.900153   668 log.cc:927] Time spent T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:12:59.815081   558 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:59.915659 29346 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:59.872398   436 raft_consensus.cc:2804] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:59.841678   673 consensus_queue.cc:1059] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:12:59.914947   675 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.925806   575 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:59.917724   585 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:12:59.927594   522 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.889151   506 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:59.903904   636 raft_consensus.cc:3055] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:59.879935   523 consensus_queue.cc:260] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:59.943171   674 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:59.943440   677 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:12:59.969044   677 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:59.936514   676 consensus_queue.cc:1059] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:12:59.946532   624 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:59.973599   455 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:59.975457   624 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:59.948256   466 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:59.949184   558 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:12:59.953430 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:59.937611 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 119718us
W20260709 13:12:59.994918 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 79510.7us
I20260709 13:12:59.997368 29346 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:12:59.994990 29495 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:12:59.916384   690 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:59.999722 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:00.000332 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:00.004551 29452 raft_consensus.cc:1240] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:00.006959 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:00.007076 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:00.025508 29450 raft_consensus.cc:2393] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 11: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
W20260709 13:13:00.016253 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 179951us
W20260709 13:13:00.077643 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 72273.8us
I20260709 13:13:00.078256 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:00.078943 29452 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:12:59.950088   436 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:00.031140 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:00.084234 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 86899.9us
I20260709 13:13:00.085425 29346 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:00.078624 29344 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:00.101152 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:00.101954 29447 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:00.102131 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:59.960570   542 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:59.959590   564 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:00.108837 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 99882.1us
I20260709 13:13:00.128185 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:12:59.951598   682 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.076031   693 raft_consensus.cc:3055] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:59.955402   585 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:59.967294   523 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:00.009974   634 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:59.965787   669 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:12:59.940323   684 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:59.955178   575 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:00.110680 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:00.134102 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:00.134382 29452 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
I20260709 13:12:59.953138   675 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:00.160017   504 consensus_meta.cc:287] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.533s	user 0.013s	sys 0.000s
I20260709 13:13:00.132151   455 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:00.108090   680 consensus_queue.cc:1059] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:13:00.154366   673 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:13:00.009840   558 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.977432   530 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:59.945515   689 raft_consensus.cc:2749] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:00.074124   470 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:00.145519   694 consensus_queue.cc:1059] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:12:59.961855   506 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:00.111804   602 raft_consensus.cc:2749] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:59.958328   522 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:12:59.962117   636 raft_consensus.cc:740] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:00.182016 29447 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
I20260709 13:13:00.183959   671 raft_consensus.cc:3055] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:13:00.186514 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 93880.9us
I20260709 13:13:00.198871   564 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.201278 29451 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
I20260709 13:13:00.240466 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:00.108182   690 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:00.202205 29452 raft_consensus.cc:1240] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:00.107642   436 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:00.242496 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:00.212476 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:00.214459 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:00.214797 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:00.219854 29421 leader_election.cc:336] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.987s (SENT)
I20260709 13:13:00.243481 29451 raft_consensus.cc:2393] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 10: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
W20260709 13:13:00.243896 29421 leader_election.cc:336] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 2.036s (SENT)
I20260709 13:13:00.172799   693 raft_consensus.cc:740] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:00.170746   682 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:00.246528   636 consensus_queue.cc:260] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:00.247042 29456 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:13:00.246697   693 consensus_queue.cc:260] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:00.247925   693 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:00.248090 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:00.248791 29454 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
W20260709 13:13:00.249234   576 consensus_meta.cc:287] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.506s	user 0.011s	sys 0.000s
I20260709 13:13:00.249768 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:00.249660   576 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:00.250504 29454 raft_consensus.cc:2393] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 6: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:00.174162   600 raft_consensus.cc:697] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:00.252250   636 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:00.229604   558 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:00.252377   600 consensus_queue.cc:237] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:00.244427 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:00.254926   558 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:00.255398   680 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:00.256026   680 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:00.258168   680 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:00.258261   530 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:00.255405 29451 raft_consensus.cc:1275] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:13:00.261507 29451 raft_consensus.cc:1275] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:13:00.244067   564 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:00.251358 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:00.265129   564 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:00.233063   669 consensus_queue.cc:1048] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:13:00.269425   690 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:00.270124   522 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:00.270638 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:00.271714 29447 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:00.273485 29448 raft_consensus.cc:2393] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 10: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:00.232749   673 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:13:00.225111 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 96211us
I20260709 13:13:00.213675   634 raft_consensus.cc:697] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:00.238169 29346 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:00.232844 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 154284us
I20260709 13:12:59.977648   674 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:00.244513 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:00.293280 29450 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:00.245198 29452 raft_consensus.cc:2393] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 11: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:00.233186   506 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:00.228075 29419 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:00.297533 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 69872.3us
I20260709 13:13:00.298413 29419 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:00.278782 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:00.216225   504 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:00.301827   674 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:00.279759 29454 raft_consensus.cc:1240] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:00.302484   674 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:00.302573   504 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:00.234947   470 raft_consensus.cc:697] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:00.289388 29447 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
W20260709 13:13:00.291405 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:00.258303   677 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:00.237596   671 raft_consensus.cc:740] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:00.316519   669 raft_consensus.cc:2749] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:00.317519   687 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.318228   680 raft_consensus.cc:2804] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:00.318147   687 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:00.318710   680 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:00.319108   680 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:00.319993   634 consensus_queue.cc:237] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:00.285531   673 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:00.321503   673 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:00.323431   671 consensus_queue.cc:260] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:00.324314 29456 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45798 (request call id 2268) took 1854 ms (client timeout 2075 ms). Trace:
I20260709 13:13:00.325037   671 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:00.299196 29451 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:13:00.325661   470 consensus_queue.cc:237] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:00.300578 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 62505us
W20260709 13:13:00.324770 29456 rpcz_store.cc:269] 0709 13:12:58.469951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.470078 (+   127us) service_pool.cc:224] Handling call
0709 13:13:00.324063 (+1853985us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b54003d1dd4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:00.324237 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4067230976}
I20260709 13:13:00.305123 29419 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:00.325237   677 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:00.330641 29419 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:00.289678 29344 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:00.294113   615 consensus_meta.cc:287] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.577s	user 0.012s	sys 0.003s
I20260709 13:13:00.332877 29419 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:13:00.342255 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 52651.4us
W20260709 13:13:00.346812 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:00.359880 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:00.363811 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:00.374125 29419 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:00.376317 29419 leader_election.cc:400] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10.
I20260709 13:13:00.376680 29419 leader_election.cc:403] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:00.378333 29419 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:00.379328 29419 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:00.383088 29419 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:00.333951   669 raft_consensus.cc:2804] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:00.386462 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:00.397796 29450 raft_consensus.cc:2410] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 13:13:00.398859 29495 connection.cc:256] RPC call timeout handler was delayed by -2.7259704269999929s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1521s for a response
I20260709 13:13:00.400897 29419 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:00.402209 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 74699.1us
I20260709 13:13:00.403002 29346 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:00.395920   669 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:00.286305   524 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:00.407536 29527 raft_consensus.cc:1240] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:00.408761 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:00.407383 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:00.415701 29523 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:00.416754 29419 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:00.408252 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:00.374045   576 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:00.385044   558 raft_consensus.cc:2804] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:00.379562   530 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:00.409658 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:13:00.434648 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:00.438308 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:00.362183   690 raft_consensus.cc:2804] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:00.373724   676 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:00.382242   564 raft_consensus.cc:2804] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:00.447567 29529 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
W20260709 13:13:00.399296 29495 connection.cc:256] RPC call timeout handler was delayed by -2.6764704269999129s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15760000000000002s for a response
I20260709 13:13:00.436928 29419 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:00.502703 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:00.381804   649 raft_consensus.cc:2804] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:00.454273 29530 raft_consensus.cc:1240] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:00.382041   684 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10.
I20260709 13:13:00.438743 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:00.498020 29526 raft_consensus.cc:1275] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:13:00.502954 29495 connection.cc:256] RPC call timeout handler was delayed by -2.6386704269998518s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16180000000000003s for a response
I20260709 13:13:00.503337 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:00.540558 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:00.516674 29525 raft_consensus.cc:2393] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 10: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:00.548949 29529 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:00.538002 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 101173us
I20260709 13:13:00.550243 29419 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:00.550475 29526 raft_consensus.cc:1240] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 5. Current term is 6. Ops: []
W20260709 13:13:00.550567 29495 connection.cc:256] RPC call timeout handler was delayed by -2.6053704270000253s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1655s for a response
I20260709 13:13:00.408988   689 raft_consensus.cc:2749] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:00.449676   677 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:00.418272   697 raft_consensus.cc:2804] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:00.418097   669 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:00.440461   624 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:00.449430   466 raft_consensus.cc:2749] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:13:00.551198 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 91619.4us
I20260709 13:13:00.501507   676 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:00.587877 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:00.601558 29526 raft_consensus.cc:2393] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 10: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:00.458724   558 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:00.502696   564 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:00.505018   690 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:00.454334   680 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:00.614033 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:00.555009 29524 raft_consensus.cc:1240] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:00.555564 29523 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
I20260709 13:13:00.395047   382 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:00.557807   695 raft_consensus.cc:2749] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:00.642385 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:00.568075   687 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:00.570385 29521 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:13:00.643451 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:00.570437 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:00.602762   676 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:00.538995   649 raft_consensus.cc:697] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 6 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:00.551898   621 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:00.576201 29529 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:13:00.582263   575 raft_consensus.cc:3055] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:00.650947 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:00.551398 29495 connection.cc:256] RPC call timeout handler was delayed by -2.5963704270000107s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1665s for a response
I20260709 13:13:00.589118 29344 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:00.620327   682 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:00.550163 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:00.640604 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:00.640347 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:00.560814   524 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:00.643885 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:00.572515   436 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:00.642644 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:00.644975 29530 raft_consensus.cc:2410] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 15 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:13:00.567234   585 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:00.645058 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:00.659963 29374 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
I20260709 13:13:00.611618   564 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:00.515889   530 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:00.541029   698 consensus_queue.cc:1048] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.104s
W20260709 13:13:00.652822 29495 connection.cc:256] RPC call timeout handler was delayed by -2.4460704269999951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18320000000000003s for a response
I20260709 13:13:00.608338   558 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:13:00.656383 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 67361.4us
I20260709 13:13:00.655823 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:00.660168 29372 raft_consensus.cc:2393] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 10: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:00.588443   697 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:00.646571 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:00.676308 29376 raft_consensus.cc:2410] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:13:00.613675   690 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:00.663406 29378 raft_consensus.cc:2393] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 10: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:00.663247 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:00.662801 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:00.599876   504 consensus_queue.cc:1059] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:13:00.628865   701 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:00.678743 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:00.611766   684 consensus_queue.cc:1059] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:13:00.646838   602 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.647081   522 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.661319 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:00.668895 29495 connection.cc:256] RPC call timeout handler was delayed by -2.4235704269999587s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1857s for a response
I20260709 13:13:00.660385   674 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:00.685346 29527 raft_consensus.cc:1240] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:00.655872   575 raft_consensus.cc:740] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:00.707185   575 consensus_queue.cc:260] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:00.708765   575 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:00.681135 29344 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:00.712987 29344 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:00.714713   694 consensus_queue.cc:1059] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:00.716722 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:00.692588 29381 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:13:00.658753   600 raft_consensus.cc:2749] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:13:00.727924 29373 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
I20260709 13:13:00.701678 29374 raft_consensus.cc:2393] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 10: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
W20260709 13:13:00.701514 29495 connection.cc:256] RPC call timeout handler was delayed by -2.3704704269998729s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1916s for a response
W20260709 13:13:00.730329 29495 connection.cc:256] RPC call timeout handler was delayed by -2.2930704269999751s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2002s for a response
W20260709 13:13:00.730686 29495 connection.cc:256] RPC call timeout handler was delayed by -2.2372704269998849s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20640000000000003s for a response
W20260709 13:13:00.730959 29495 connection.cc:256] RPC call timeout handler was delayed by -2.1985704269998223s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21070000000000003s for a response
W20260709 13:13:00.731220 29495 connection.cc:256] RPC call timeout handler was delayed by -2.1841704270000264s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21230000000000004s for a response
W20260709 13:13:00.731474 29495 connection.cc:256] RPC call timeout handler was delayed by -2.1454704269999638s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21660000000000001s for a response
W20260709 13:13:00.731799 29495 connection.cc:256] RPC call timeout handler was delayed by -2.1040704269998969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22120000000000004s for a response
W20260709 13:13:00.732189 29495 connection.cc:256] RPC call timeout handler was delayed by -1.8132634649998636s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2088s for a response
W20260709 13:13:00.732632 29495 connection.cc:256] RPC call timeout handler was delayed by -1.8069634649998534s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20950000000000002s for a response
W20260709 13:13:00.732929 29495 connection.cc:256] RPC call timeout handler was delayed by -1.7467704270000013s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2609s for a response
W20260709 13:13:00.733299 29495 connection.cc:256] RPC call timeout handler was delayed by -1.6350634650000302s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22860000000000003s for a response
W20260709 13:13:00.733732 29495 connection.cc:256] RPC call timeout handler was delayed by -1.5669160849997752s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1935s for a response
W20260709 13:13:00.734232 29495 connection.cc:256] RPC call timeout handler was delayed by -1.4220160849997683s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2096s for a response
W20260709 13:13:00.734573 29495 connection.cc:256] RPC call timeout handler was delayed by -1.3104160849998152s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22200000000000003s for a response
W20260709 13:13:00.735004 29495 connection.cc:256] RPC call timeout handler was delayed by -1.0473634649999894s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2939s for a response
I20260709 13:13:00.736807 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:00.719681 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:00.699728   615 consensus_queue.cc:1059] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:13:00.703262   339 consensus_queue.cc:1059] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:13:00.728235   600 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:00.680020 29378 raft_consensus.cc:2393] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 12: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:00.749557 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:00.771896 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:00.774120 29372 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 13.
I20260709 13:13:00.679667   697 raft_consensus.cc:3060] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:00.780638 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:00.779666 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:00.807193 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:13:00.808264 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:00.811872 29376 raft_consensus.cc:3055] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:00.812620 29376 raft_consensus.cc:740] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:00.771235 29495 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:00.814823   612 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:13:00.815026 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 43883.7us
I20260709 13:13:00.816900 29495 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:00.813835 29376 consensus_queue.cc:260] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:00.817979   585 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:00.819260 29495 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:00.834005 29376 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:00.844873 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:00.845943 29372 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 8.
I20260709 13:13:00.835237 29374 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11.
I20260709 13:13:00.836606 29377 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
I20260709 13:13:00.842258 29495 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:00.848073 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:00.701045   524 consensus_queue.cc:1048] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.107s
I20260709 13:13:00.851384 29495 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:00.852842 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:00.864161 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:00.873241 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 160360us
I20260709 13:13:00.860131 29421 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:00.699232   701 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:00.835150   674 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:00.853096   696 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:00.818303   612 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:00.852980   636 raft_consensus.cc:3055] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:00.732091   602 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:00.731921   522 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:00.876312 29421 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:00.875164 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:00.895785 29421 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:00.875653 29344 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:00.716284   675 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:00.884012 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:00.897625 29372 raft_consensus.cc:2393] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 10: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:00.844506   667 raft_consensus.cc:2749] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:00.899189 29378 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
W20260709 13:13:00.898850 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 348687us
I20260709 13:13:00.899979 29374 raft_consensus.cc:2410] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:13:00.901953   682 raft_consensus.cc:2804] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:13:00.904831 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 53576.8us
I20260709 13:13:00.905222 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:00.879314   684 raft_consensus.cc:2804] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:00.905879 29495 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:00.905916 29374 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:13:00.908356 29419 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:00.903416 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:00.913707 29449 raft_consensus.cc:2393] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 10: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:00.902793   466 raft_consensus.cc:2804] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:00.911178 29376 raft_consensus.cc:2468] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
I20260709 13:13:00.912278 29380 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
I20260709 13:13:00.917287 29419 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:00.918076 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:00.899991   506 consensus_meta.cc:287] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.579s	user 0.009s	sys 0.004s
I20260709 13:13:00.917471   382 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:00.915616   696 raft_consensus.cc:2749] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:13:00.887869   636 raft_consensus.cc:740] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:00.918346 29495 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:00.909757   684 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:00.919395   718 raft_consensus.cc:2749] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:00.920810   674 raft_consensus.cc:697] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:13:00.936753   712 log.cc:927] Time spent T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.267s	user 0.002s	sys 0.000s
I20260709 13:13:00.911387 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:00.937582   674 consensus_queue.cc:237] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:00.915660 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:13:00.925176 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 49928.1us
I20260709 13:13:00.939663   382 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:00.940280   382 raft_consensus.cc:697] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:00.941308   382 consensus_queue.cc:237] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:00.904528   682 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:00.942996   682 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:00.930454 29419 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:00.946334 29419 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:00.865255   649 consensus_queue.cc:237] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:00.931908   624 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:00.936374   542 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.949633 29525 raft_consensus.cc:1240] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:00.936563   667 consensus_queue.cc:1048] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:00.919109   506 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:00.908443   687 raft_consensus.cc:2804] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:00.938556 29374 raft_consensus.cc:2393] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 10: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:00.966943 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:00.968015 29374 raft_consensus.cc:2393] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 11: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:00.948228 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:00.970417 29372 raft_consensus.cc:2393] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 6: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:00.948509 29419 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:00.951262 29495 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:00.972155 29419 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:00.952467 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:00.952956 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:00.926947 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:00.974215 29529 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:00.974978 29376 raft_consensus.cc:2410] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 12 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:13:00.916432   715 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.985460 29419 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:00.981070 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:00.934861   684 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:00.947012   718 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:00.996896 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:00.998122 29374 raft_consensus.cc:2393] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 8: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:00.947404   612 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:00.935200   680 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:00.966190   689 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:01.004254 29374 raft_consensus.cc:1275] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:13:01.006434 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:01.000473 29495 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:01.007511 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:01.019781 29372 raft_consensus.cc:2393] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 11: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:00.984462   624 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.981977   600 raft_consensus.cc:697] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:00.991443   687 raft_consensus.cc:697] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:01.003106   696 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:00.968161   585 consensus_queue.cc:1048] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:13:01.004020   436 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:00.968582   542 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:01.051631 29376 raft_consensus.cc:1240] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 11. Current term is 12. Ops: []
W20260709 13:13:01.046609   673 consensus_meta.cc:287] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.725s	user 0.002s	sys 0.011s
I20260709 13:13:01.074492   673 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:01.075151   600 consensus_queue.cc:237] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:01.076856   673 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:01.077630 29379 raft_consensus.cc:2393] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 9: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:01.005844   455 consensus_queue.cc:1048] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:13:01.024298   680 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:01.023928   612 raft_consensus.cc:697] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:01.100042   634 raft_consensus.cc:3055] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:01.099727   612 consensus_queue.cc:237] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:01.100466   634 raft_consensus.cc:740] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:13:01.101529   693 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:13:01.044359   576 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:01.103663   576 raft_consensus.cc:697] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
W20260709 13:13:01.103958   708 log.cc:927] Time spent T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.252s	user 0.001s	sys 0.001s
I20260709 13:13:01.104756   576 consensus_queue.cc:237] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:01.070188 29529 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:13:01.013775   530 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:01.089533 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 227299us
I20260709 13:13:01.112213 29421 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:01.115878   506 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:00.995565   715 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:01.138705   715 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:01.062994   624 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:13:01.150133 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:01.155540 29376 raft_consensus.cc:1240] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:01.156661   701 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:01.068713   466 raft_consensus.cc:697] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 11 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
W20260709 13:13:01.163609 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 178281us
I20260709 13:13:01.164674 29419 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:01.166031 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 147679us
I20260709 13:13:01.168774   585 consensus_queue.cc:1059] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:01.170126   530 raft_consensus.cc:3055] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:01.170637   530 raft_consensus.cc:740] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:01.171792   530 consensus_queue.cc:260] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:01.173568   530 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:01.174588 29495 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:01.175800   455 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:01.176347   455 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:01.176769   455 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:01.071530   718 raft_consensus.cc:2749] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:01.005146   636 consensus_queue.cc:260] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:01.072949   696 raft_consensus.cc:697] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:01.215994 29524 raft_consensus.cc:1275] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:13:01.211910 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:13:01.217514 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.217581 29530 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:01.221272 29521 raft_consensus.cc:1240] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:01.225116 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:01.225571 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:01.225796 29524 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
I20260709 13:13:01.227739 29523 raft_consensus.cc:3055] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:01.176783 29495 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:01.228138 29523 raft_consensus.cc:740] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:01.204025 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:01.229501 29376 raft_consensus.cc:2393] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 10: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:01.208189   723 raft_consensus.cc:2749] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:01.207257 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:01.213475 29449 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45796 (request call id 1378) took 1210 ms (client timeout 1589 ms). Trace:
I20260709 13:13:01.231238 29526 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
W20260709 13:13:01.231155 29449 rpcz_store.cc:269] 0709 13:13:00.003328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.006689 (+  3361us) service_pool.cc:224] Handling call
0709 13:13:01.213238 (+1206549us) spinlock_profiling.cc:243] Waited 836 ms on lock 0x7b54000d6954. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:01.213398 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1923880064}
I20260709 13:13:01.208508   718 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:13:01.248061 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 71368.1us
I20260709 13:13:01.249455 29495 leader_election.cc:304] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:01.240302 29523 consensus_queue.cc:260] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:01.259344 29523 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:01.278744 29523 raft_consensus.cc:1275] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:13:01.290443 29495 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:01.244354   636 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:01.315383 29344 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:01.316294   696 consensus_queue.cc:237] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:01.317267   506 consensus_queue.cc:1059] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:01.334736   506 raft_consensus.cc:3055] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:01.335217   506 raft_consensus.cc:740] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:01.318604   339 consensus_queue.cc:1059] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:01.288990   466 consensus_queue.cc:237] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:01.325582   728 raft_consensus.cc:2804] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:01.244045   718 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:01.245507   675 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:01.319366   673 consensus_queue.cc:1048] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:13:01.306514 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:13:01.331178 29374 raft_consensus.cc:1240] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10. Ops: [9.7-9.7]
W20260709 13:13:01.366606 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 51300.4us
W20260709 13:13:01.258744   669 consensus_meta.cc:287] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.654s	user 0.015s	sys 0.000s
I20260709 13:13:01.320003   615 consensus_queue.cc:1059] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:13:01.319856   612 raft_consensus.cc:2749] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:01.257622   667 raft_consensus.cc:2804] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:13:01.342344   621 consensus_meta.cc:287] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.687s	user 0.010s	sys 0.003s
W20260709 13:13:01.341033   671 consensus_meta.cc:287] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 1.005s	user 0.012s	sys 0.002s
I20260709 13:13:01.367728 29344 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:01.289548   522 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:01.337334   677 consensus_meta.cc:287] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.742s	user 0.015s	sys 0.000s
I20260709 13:13:01.265475   723 raft_consensus.cc:2749] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:13:01.346483   714 log.cc:927] Time spent T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.529s	user 0.000s	sys 0.011s
I20260709 13:13:01.401729 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:01.404865 29525 raft_consensus.cc:1240] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 11. Current term is 12. Ops: []
W20260709 13:13:01.355430   564 consensus_meta.cc:287] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.679s	user 0.007s	sys 0.005s
I20260709 13:13:01.347393   728 raft_consensus.cc:697] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 10 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:01.369541   718 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:01.419274 29523 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:13:01.250715   687 consensus_queue.cc:237] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:01.437637 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.382616   701 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:13:01.389220 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 224631us
I20260709 13:13:01.413802   621 raft_consensus.cc:2749] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:01.465616 29344 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:01.340265   724 consensus_queue.cc:1059] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.081s
W20260709 13:13:01.470010 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:01.391290   690 consensus_meta.cc:287] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.691s	user 0.006s	sys 0.006s
I20260709 13:13:01.482504   542 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:01.383158   727 consensus_queue.cc:1048] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.116s
I20260709 13:13:01.463631   564 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:01.497956   564 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:01.486409   728 consensus_queue.cc:237] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:01.383438   669 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:01.471990   701 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:01.480096   693 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:13:01.388605   697 consensus_meta.cc:287] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.531s	user 0.012s	sys 0.000s
W20260709 13:13:01.462886   558 consensus_meta.cc:287] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.762s	user 0.005s	sys 0.009s
I20260709 13:13:01.458566   716 raft_consensus.cc:2804] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:01.512984   716 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:01.513418   716 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:01.513478 29375 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:13:01.513907   669 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:01.514632   697 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:13:01.480115 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.435284   726 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.474437   671 consensus_queue.cc:1059] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:13:01.421600   615 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.416567   667 raft_consensus.cc:697] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
W20260709 13:13:01.477497   713 log.cc:927] Time spent T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:13:01.391934   684 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:01.486934 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 175231us
W20260709 13:13:01.502120   575 consensus_meta.cc:287] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.793s	user 0.017s	sys 0.000s
I20260709 13:13:01.512293 29530 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:13:01.492571   690 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
W20260709 13:13:01.502020   682 consensus_meta.cc:287] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.558s	user 0.011s	sys 0.000s
I20260709 13:13:01.464628   725 consensus_queue.cc:1048] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 13:13:01.510102   693 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:01.523823   436 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.527326 29495 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:01.545439   436 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:01.545974 29495 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:01.547386   576 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:01.548038   585 consensus_queue.cc:1059] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:01.548846   576 raft_consensus.cc:697] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 11 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:01.549346   585 raft_consensus.cc:3055] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:01.549850   585 raft_consensus.cc:740] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:01.549947   576 consensus_queue.cc:237] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:01.550770   585 consensus_queue.cc:260] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:01.539870   682 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:01.552560   585 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:13:01.553480   689 consensus_meta.cc:287] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.528s	user 0.011s	sys 0.000s
I20260709 13:13:01.553715   682 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:01.553977   689 raft_consensus.cc:2749] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:01.555220   667 consensus_queue.cc:237] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:01.420524   677 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:01.530927 29344 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:01.560544   697 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Requested vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:01.530897   523 raft_consensus.cc:3055] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:01.563365   523 raft_consensus.cc:740] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:01.339478   506 consensus_queue.cc:260] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:01.508831   701 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:01.547297 29495 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:01.547770   612 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:01.518036   558 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:01.565493 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:01.586812 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:01.384789 30154 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 LEARNER]: Advancing to term 8
I20260709 13:13:01.590914 29381 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
I20260709 13:13:01.564308   725 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:01.522207   726 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:01.598109 29452 raft_consensus.cc:1275] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:13:01.576138 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:01.547601   693 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:01.563401 29523 raft_consensus.cc:1240] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:01.602535 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:01.603253 29523 raft_consensus.cc:2393] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 12: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:01.589650 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:01.591959 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:01.604637 29449 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:01.604802 29529 raft_consensus.cc:2393] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 14: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:01.593797 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:13:01.606410 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.606637 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:01.587703 29524 raft_consensus.cc:2393] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 11: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:01.609279 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:01.610059 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:01.610699 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:01.596750 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:01.611809 29450 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:01.612098 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:01.613385 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:01.597158 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:01.525473   615 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:01.472535 29419 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:01.616496 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:01.599702 29525 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:01.579862 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:01.607057 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.594470 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:01.619553 29530 raft_consensus.cc:2393] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 11: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:01.614467 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:01.615556 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:01.581346   612 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:01.618692 29521 raft_consensus.cc:2376] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6. Re-sending same reply.
I20260709 13:13:01.619778 29455 raft_consensus.cc:2393] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 6: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:01.624053 29524 raft_consensus.cc:2393] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 8: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:01.633246 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:01.624748 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:01.635022 29376 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
I20260709 13:13:01.584371   695 raft_consensus.cc:3055] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:13:01.628407 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 159342us
I20260709 13:13:01.636782 29419 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:01.631770 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:01.640174 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:01.641275 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:01.641317 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:01.642452 29447 raft_consensus.cc:1275] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:13:01.642491 29450 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:01.642520 29449 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
I20260709 13:13:01.590451   727 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:01.649058 29530 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486"
dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
mode: GRACEFUL
new_leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
 from {username='slave'} at 127.0.0.1:52288
I20260709 13:13:01.644891 29495 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:01.647943 29453 raft_consensus.cc:2393] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 11: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:01.651641 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:01.647743 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 111293us
I20260709 13:13:01.650672 29530 raft_consensus.cc:606] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Received request to transfer leadership to TS 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:01.653188 29530 raft_consensus.cc:614] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:01.655103 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:13:01.657864 29451 raft_consensus.cc:1240] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:01.658080 29455 raft_consensus.cc:1240] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:01.658335 29448 raft_consensus.cc:1240] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:01.640771   612 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:01.665143 29380 raft_consensus.cc:1275] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:13:01.666412 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:01.616416   725 raft_consensus.cc:697] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:01.564322   523 consensus_queue.cc:260] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:01.667254 29451 raft_consensus.cc:1240] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:13:01.678894 29380 raft_consensus.cc:1240] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:01.663040 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:01.680352 29380 raft_consensus.cc:1240] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:13:01.680606 29448 raft_consensus.cc:2393] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 10: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:01.681836 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:01.660135   466 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.683058   466 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:01.684878   696 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:01.685650 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:01.685745   466 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:01.674015 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:01.699797 29447 raft_consensus.cc:2393] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 12: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:01.650671   695 raft_consensus.cc:740] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:01.676570 29495 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:01.676048 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:01.682669 29448 raft_consensus.cc:2368] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 10. Current term is 11.
I20260709 13:13:01.701937 29455 raft_consensus.cc:2410] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 15 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:13:01.649333   689 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:13:01.690302 29374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52172 (request call id 1698) took 1034 ms. Trace:
I20260709 13:13:01.655959   727 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:01.687372   558 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:01.717350   727 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:01.662513   735 log.cc:927] Time spent T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.120s	user 0.001s	sys 0.001s
W20260709 13:13:01.720228   738 log.cc:927] Time spent T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:13:01.687197 29453 raft_consensus.cc:1240] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:01.648957   682 raft_consensus.cc:2749] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:01.696684 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:01.659601   669 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:01.701812 29495 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:01.726306 29495 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:01.727473 29495 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:01.686177 29379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 1317) took 1037 ms. Trace:
I20260709 13:13:01.659996   564 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:01.702342 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:01.728567 29379 rpcz_store.cc:276] 0709 13:13:00.649013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.650647 (+  1634us) service_pool.cc:224] Handling call
0709 13:13:01.685958 (+1035311us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b54003dc554. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:01.686119 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":978899712}
I20260709 13:13:01.732100 29448 raft_consensus.cc:2393] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 8: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:01.702514 29374 rpcz_store.cc:276] 0709 13:13:00.655459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.032768 (+377309us) service_pool.cc:224] Handling call
0709 13:13:01.033346 (+   578us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:01.364479 (+331133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:01.690009 (+325530us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b54003f3754. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:01.690231 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":684220160}
I20260709 13:13:01.733793 29374 raft_consensus.cc:1240] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 13:13:01.675438   676 consensus_meta.cc:287] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 1.010s	user 0.014s	sys 0.000s
I20260709 13:13:01.708846 29525 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 10.
I20260709 13:13:01.713052   695 consensus_queue.cc:260] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:01.714043   687 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:01.716176 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:01.743958 29451 raft_consensus.cc:2393] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 10: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:01.716825 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:01.650172   455 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:01.739729 29495 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:01.667021   739 consensus_queue.cc:1059] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:13:01.741312 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:01.744937 29455 raft_consensus.cc:2393] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 10: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:01.730391   523 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:01.749193 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:01.759866 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 99042.7us
I20260709 13:13:01.760358 29451 raft_consensus.cc:2393] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 13: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:01.750016 29453 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:13:01.760726 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:01.751557 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:01.753573   455 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:01.754233 29529 raft_consensus.cc:2393] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 11: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:01.753839   736 consensus_queue.cc:1059] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:13:01.756498   726 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:01.741696   585 raft_consensus.cc:2804] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:01.738371   728 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:13:01.743626 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 87022.9us
I20260709 13:13:01.761415 29447 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:13:01.780073 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:13:01.752295   741 log.cc:927] Time spent T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:13:01.763928 29454 raft_consensus.cc:1240] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:01.738539   696 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:01.770810 29451 raft_consensus.cc:1240] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:01.774379 29455 raft_consensus.cc:1240] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:01.778992 29381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 1318) took 1129 ms. Trace:
I20260709 13:13:01.792361 29381 rpcz_store.cc:276] 0709 13:13:00.649171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.779193 (+130022us) service_pool.cc:224] Handling call
0709 13:13:01.778755 (+999562us) spinlock_profiling.cc:243] Waited 783 ms on lock 0x7b54001ee1d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:01.778922 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1799750528}
I20260709 13:13:01.779139 29372 raft_consensus.cc:1240] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:01.780984 29453 raft_consensus.cc:2393] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 11: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:01.782683 29495 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:01.742134   737 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:01.741844   676 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:01.738373   669 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:01.797441   687 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:01.798007   600 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:01.804437 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:01.798478   745 log.cc:927] Time spent T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:13:01.775008   585 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:01.738997   564 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:13:01.801010 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.802498 30154 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 LEARNER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:13:01.804522 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:01.798095   717 log.cc:927] Time spent T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.984s	user 0.013s	sys 0.007s
I20260709 13:13:01.794029   690 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:01.796156   684 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:01.830283 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.852694   676 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:01.812963   600 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:01.813297   585 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:01.813419   725 consensus_queue.cc:237] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:01.824474 29377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52172 (request call id 1703) took 1157 ms. Trace:
W20260709 13:13:01.879261 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 96656.4us
I20260709 13:13:01.879026   669 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:01.868692   728 raft_consensus.cc:697] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:01.890901 29377 rpcz_store.cc:276] 0709 13:13:00.667359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:00.903097 (+235738us) service_pool.cc:224] Handling call
0709 13:13:01.819402 (+916305us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b54003c46d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:01.824350 (+  4948us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1269716352}
I20260709 13:13:01.891462 29495 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:01.892195   728 consensus_queue.cc:237] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:01.893399 29495 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:01.880316 29279 catalog_manager.cc:5697] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:01.851053   716 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:01.888474   696 raft_consensus.cc:697] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:01.890561   687 raft_consensus.cc:2804] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:01.808666   737 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:01.898720   470 raft_consensus.cc:2749] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:01.897794   615 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:01.921653   339 raft_consensus.cc:3055] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:01.920150   576 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:01.922953   600 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:01.945987   339 raft_consensus.cc:740] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:01.953723   756 consensus_queue.cc:1048] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:13:01.954658   339 consensus_queue.cc:260] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:01.956847   602 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:01.957962   716 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:01.932387   687 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:01.915608   667 consensus_queue.cc:1048] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:13:01.925556   701 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:02.004578 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:01.978360   687 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:02.043331   339 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:02.056984 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:02.057965 29453 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:13:02.061687 29453 raft_consensus.cc:1275] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:13:02.076555 29453 raft_consensus.cc:1275] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:13:02.091333 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 193233us
I20260709 13:13:02.092672 29495 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:01.993307   696 consensus_queue.cc:237] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:02.084218   693 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:02.102522   693 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:02.102914 29455 raft_consensus.cc:1240] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:02.104930   634 consensus_queue.cc:260] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:02.113018 29453 raft_consensus.cc:1240] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:02.114477   755 raft_consensus.cc:2749] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:13:02.115729 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:02.120365   634 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:02.123912 29495 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:02.123354   754 log.cc:927] Time spent T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:13:02.127602   737 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:13:02.130992 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:02.143705 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:02.145345 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.079380   727 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:02.149817 29495 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:02.158785   728 raft_consensus.cc:2749] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:13:02.162154 29495 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:02.165014 29495 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:02.167344 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 44720.5us
W20260709 13:13:02.168064 29419 leader_election.cc:336] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.593s (SENT)
I20260709 13:13:02.157786   667 raft_consensus.cc:2804] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:02.171976 29495 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:02.168677 29419 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:02.168772   728 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:13:02.190009 29419 leader_election.cc:336] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.883s (SENT)
I20260709 13:13:02.194936 29419 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:02.169800   755 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:02.164149   696 consensus_queue.cc:1048] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:13:02.224223 29453 raft_consensus.cc:1275] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:13:02.218647 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.225512 29456 raft_consensus.cc:1240] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:13:02.165221   757 consensus_queue.cc:1048] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:13:02.226197 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:02.244419 29447 raft_consensus.cc:2393] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 11: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:02.188194   470 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:02.195994   701 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:02.189394   667 raft_consensus.cc:697] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:02.207695   737 raft_consensus.cc:2749] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:02.256894 29373 raft_consensus.cc:1240] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:02.267863   506 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:02.224263   684 raft_consensus.cc:2749] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 6 LEADER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:13:02.275013 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:02.276789 29419 leader_election.cc:336] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.914s (SENT)
I20260709 13:13:02.280864 29419 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:02.282037 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.284940 29344 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
W20260709 13:13:02.286345 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:02.286971 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.226815   728 raft_consensus.cc:697] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:02.288683 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
W20260709 13:13:02.299243 29419 leader_election.cc:336] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 2.059s (SENT)
I20260709 13:13:02.300468 29419 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:02.302071 29419 leader_election.cc:336] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 2.078s (SENT)
I20260709 13:13:02.316111 29419 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:02.303766 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:02.275894   718 consensus_meta.cc:287] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.798s	user 0.009s	sys 0.006s
I20260709 13:13:02.305510 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:02.318742 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:02.256038   660 consensus_queue.cc:1059] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:13:02.320026   660 raft_consensus.cc:3055] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:02.320411   660 raft_consensus.cc:740] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
W20260709 13:13:02.320739   760 log.cc:927] Time spent T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:13:02.321401   660 consensus_queue.cc:260] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:13:02.322477   758 log.cc:927] Time spent T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 13:13:02.319013   669 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:02.322722   660 raft_consensus.cc:3060] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:02.305431   725 raft_consensus.cc:2804] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:02.289711   621 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:02.327363   621 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:02.329497   728 consensus_queue.cc:237] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:02.330706   621 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:02.305894   684 raft_consensus.cc:2749] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:02.296459   697 consensus_queue.cc:1059] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:13:02.332333 30154 raft_consensus.cc:1275] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 LEARNER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:13:02.332412   697 consensus_queue.cc:1243] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer 429e58eb058349e3bf72b5a870c8f6e5 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:13:02.333248   697 raft_consensus.cc:3055] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:02.333664   697 raft_consensus.cc:740] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:02.334820   530 consensus_queue.cc:1048] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:02.306123   737 raft_consensus.cc:2749] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:02.335783   667 consensus_queue.cc:237] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:02.337795   576 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:02.313175   687 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:02.341714   687 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:02.348367 29344 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:02.334529   697 consensus_queue.cc:260] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:02.349747   725 raft_consensus.cc:697] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:02.362551   725 consensus_queue.cc:237] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:02.350183   718 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:02.366565   718 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:02.368319 29452 raft_consensus.cc:2393] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 11: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:02.370157   727 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:02.372332   752 raft_consensus.cc:3055] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:02.373087 29527 raft_consensus.cc:1275] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:13:02.373167   752 raft_consensus.cc:740] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:02.375624 29372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52172 (request call id 1695) took 1721 ms. Trace:
I20260709 13:13:02.376088 29372 rpcz_store.cc:276] 0709 13:13:00.654582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.020647 (+366065us) service_pool.cc:224] Handling call
0709 13:13:01.778933 (+758286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:01.795894 (+ 16961us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:02.375382 (+579488us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b54001ee1d0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd858ad 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:02.375554 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1644385024}
I20260709 13:13:02.381928 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:02.351264 29419 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:02.389674 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:02.390051 29381 raft_consensus.cc:1240] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 10. Current term is 11. Ops: []
W20260709 13:13:02.403208 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 54023us
W20260709 13:13:02.413826 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.401336 29377 raft_consensus.cc:1275] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:13:02.394235 29381 raft_consensus.cc:1275] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:13:02.396309 29378 raft_consensus.cc:1275] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:13:02.411214 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.419234 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:02.420001 29346 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:02.423041 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:02.420778   693 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.425406   737 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.425841   693 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:02.426199   737 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:02.427953 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:02.428181   693 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:02.428628 29528 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:02.428746 29372 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "71aa3578fd924765ab9ac0729c8d1483"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:13:02.429365 29372 raft_consensus.cc:606] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Received request to transfer leadership to TS 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:02.429761 29372 raft_consensus.cc:614] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:02.430038   737 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:02.416924   690 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:13:02.433560 29526 raft_consensus.cc:1240] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:02.435866 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:02.436105 29373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52172 (request call id 1707) took 1766 ms. Trace:
I20260709 13:13:02.436682 29373 rpcz_store.cc:276] 0709 13:13:00.669334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.053417 (+384083us) service_pool.cc:224] Handling call
0709 13:13:01.687670 (+634253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:02.257644 (+569974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:02.435152 (+177508us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b54003dc554. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:02.435834 (+   682us) spinlock_profiling.cc:243] Waited 618 ms on lock 0x7b54003dc550. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd858ad 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:02.436020 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2729980032}
I20260709 13:13:02.440204   715 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.440807   715 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:02.441262 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:02.441884 29529 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:02.443143   715 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:02.419981 29527 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:13:02.448741   716 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.450938   436 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:13:02.421550   612 consensus_meta.cc:287] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.726s	user 0.013s	sys 0.001s
W20260709 13:13:02.462661 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 281599us
I20260709 13:13:02.385281   382 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:13:02.400914   585 consensus_meta.cc:287] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.503s	user 0.004s	sys 0.008s
I20260709 13:13:02.467679 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:02.469684 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:02.478237   765 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.501739   765 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:02.443683   600 consensus_queue.cc:1059] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:13:02.505591   612 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:02.507009 29525 raft_consensus.cc:2368] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 13. Current term is 14.
I20260709 13:13:02.497736 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:02.508095   612 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:02.461369   697 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:02.374922   752 consensus_queue.cc:260] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:02.391657   755 raft_consensus.cc:697] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:02.401212   718 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.362527   455 raft_consensus.cc:3055] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:02.535544 29374 raft_consensus.cc:1275] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:13:02.536118 29374 pending_rounds.cc:85] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5: Aborting all ops after (but not including) 6
I20260709 13:13:02.521274 29523 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:13:02.537768 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:13:02.474308 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 54747.3us
I20260709 13:13:02.521306 29450 raft_consensus.cc:1275] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:13:02.538866 29375 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
I20260709 13:13:02.540275 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:02.541316 29450 raft_consensus.cc:2393] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 10: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:02.542999 29450 raft_consensus.cc:1275] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:13:02.526036 29455 raft_consensus.cc:1275] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:13:02.529353 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:13:02.529779 29495 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.973s (SENT) [suppressed 60 similar messages]
I20260709 13:13:02.545094 29451 raft_consensus.cc:2393] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 8: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:02.485176 29528 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
I20260709 13:13:02.551064 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:02.552397 29455 raft_consensus.cc:1275] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:13:02.552390 29529 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:13:02.553428 29346 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:02.554171 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.554576 29523 raft_consensus.cc:2393] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 6: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:13:02.555570 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.557868 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:02.546789 29495 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:02.560834 29453 raft_consensus.cc:1240] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:02.561311 29495 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:02.565917 29346 leader_election.cc:400] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 10. Current term is 11.
I20260709 13:13:02.566977 29346 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:02.567714 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:02.573716 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:02.480332   716 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:02.549551   718 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:02.486500   715 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:02.584942 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.520232   436 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:13:02.593739 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:02.594669 29455 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:02.606504 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:02.607765 29453 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:02.612633 29450 raft_consensus.cc:1275] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:13:02.536366 29374 pending_rounds.cc:107] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 8.7
I20260709 13:13:02.615288 29374 raft_consensus.cc:2917] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Aborting config change with OpId 8.7: Aborted: Op aborted by new leader
W20260709 13:13:02.616365 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.534832   455 raft_consensus.cc:740] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:02.621141 29374 raft_consensus.cc:2889] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:02.583235   737 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.581209   755 consensus_queue.cc:237] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:02.529932   585 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:02.585852   506 raft_consensus.cc:3055] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:02.598023   767 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:02.598819   612 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:02.665289 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:02.666656 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:02.621174   436 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:02.661434   757 consensus_queue.cc:1048] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:13:02.592401   382 consensus_queue.cc:1059] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:13:02.615729   728 consensus_queue.cc:1059] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:13:02.673440 29522 raft_consensus.cc:1240] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:02.666047   612 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:02.605994   756 consensus_queue.cc:1048] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.059s
W20260709 13:13:02.675364 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 219955us
I20260709 13:13:02.680786 29455 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
I20260709 13:13:02.617892   696 consensus_queue.cc:1059] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:13:02.597479   715 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:02.678697 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:02.626212   716 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:02.663870   506 raft_consensus.cc:740] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:02.622767   530 consensus_queue.cc:1048] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:13:02.671446 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:02.628373   739 consensus_queue.cc:1048] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:13:02.628597   470 consensus_queue.cc:1048] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:13:02.695127 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:02.657963   737 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:02.701607 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:02.702488 29528 raft_consensus.cc:2393] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 11: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:02.701004 29344 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:02.726653 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 92651.7us
W20260709 13:13:02.706069 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.731611 29419 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:02.727720 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 160827us
I20260709 13:13:02.700918 29455 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:13:02.704802 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:02.689814   382 raft_consensus.cc:3055] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:02.738871 29455 raft_consensus.cc:1275] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:02.740118 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:02.740892 29450 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:02.741308 29419 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:02.681576   612 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:02.744326 29419 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:02.745519 29455 raft_consensus.cc:1240] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 13. Current term is 14. Ops: [11.6-13.7]
I20260709 13:13:02.680323   767 consensus_queue.cc:1048] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:13:02.765513 29449 raft_consensus.cc:2393] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 13: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:02.681423   600 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:02.745653 29344 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:02.773572 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.766848 29346 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:02.776556 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:02.699306   687 consensus_queue.cc:1059] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 13:13:02.737833   382 raft_consensus.cc:740] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:02.760138   621 raft_consensus.cc:2749] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:13:02.806634 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 61134.3us
I20260709 13:13:02.831323 29344 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:02.781476   506 consensus_queue.cc:260] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:02.832545 29344 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:02.832844 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:02.833101 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:02.833753 29527 raft_consensus.cc:2393] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 8: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:02.760820   716 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.834285 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:02.834558 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:02.835168 29528 raft_consensus.cc:2393] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 11: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:02.834717   716 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:02.836014 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:02.837069   716 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:02.837803   716 raft_consensus.cc:2804] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:02.838043 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:02.838315   716 raft_consensus.cc:697] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:02.838950   624 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:02.743157   718 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:02.775727   680 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:13:02.844063   600 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:02.846062   602 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.764874   523 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:02.847570   523 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:02.848192   523 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:02.851404   564 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:02.854242   765 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:02.854256 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:02.855962 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:02.856773 29522 raft_consensus.cc:2393] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 11: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:02.856949   585 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:02.857589 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:02.858695 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:02.859027   660 consensus_meta.cc:287] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent flushing consensus metadata: real 0.516s	user 0.012s	sys 0.000s
I20260709 13:13:02.860313 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:02.861508 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:02.862087 29523 raft_consensus.cc:2376] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 10. Re-sending same reply.
I20260709 13:13:02.862859 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:02.863873 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:02.865121 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:02.866521 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:02.820542   382 consensus_queue.cc:260] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:02.822894   701 raft_consensus.cc:2804] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:13:02.823648   774 log.cc:927] Time spent T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.150s	user 0.000s	sys 0.002s
I20260709 13:13:02.824103 29451 raft_consensus.cc:1275] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:13:02.896539   674 raft_consensus.cc:2749] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:02.896991 29451 pending_rounds.cc:85] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 6
I20260709 13:13:02.897279 29451 pending_rounds.cc:107] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:13:02.897560 29451 raft_consensus.cc:2889] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:02.897593   701 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:02.898119   701 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:02.898368 29452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45796 (request call id 1410) took 1290 ms. Trace:
I20260709 13:13:02.824800   715 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:02.825169   739 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.759791   684 raft_consensus.cc:2749] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:02.825826   737 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:02.826004   771 log.cc:927] Time spent T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.209s	user 0.002s	sys 0.000s
I20260709 13:13:02.826061 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:02.718055   339 consensus_queue.cc:1048] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.103s
W20260709 13:13:02.828147 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.867031   564 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.844702   600 raft_consensus.cc:697] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:02.846998   602 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:02.871395 29453 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:13:02.877490   752 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:02.820267   775 log.cc:927] Time spent T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 13:13:02.881049 29375 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 1327) took 1277 ms (client timeout 1666 ms). Trace:
I20260709 13:13:02.883967 29523 raft_consensus.cc:2393] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 11: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:13:02.886893 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:02.888751 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:02.977244 29527 raft_consensus.cc:2393] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 8: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:02.889609 29448 raft_consensus.cc:1275] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:13:02.889916 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:02.978190 29522 raft_consensus.cc:2393] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 11: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:02.978263   787 consensus_queue.cc:1048] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:02.979144 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:02.980612 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:02.981252 29522 raft_consensus.cc:2468] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:13:02.982277 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:02.982805   787 consensus_queue.cc:1059] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:13:02.975593 29375 rpcz_store.cc:269] 0709 13:13:01.603791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.606290 (+  2499us) service_pool.cc:224] Handling call
0709 13:13:02.880834 (+1274544us) spinlock_profiling.cc:243] Waited 903 ms on lock 0x7b54003dc054. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:02.880950 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2077547392}
I20260709 13:13:02.988623 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:02.989442 29527 raft_consensus.cc:2393] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 14: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:02.992774 29523 raft_consensus.cc:1240] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10. Ops: [9.7-9.7]
W20260709 13:13:02.895157 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 128401us
I20260709 13:13:02.898813 29452 rpcz_store.cc:276] 0709 13:13:01.607841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.609710 (+  1869us) service_pool.cc:224] Handling call
0709 13:13:02.898125 (+1288415us) spinlock_profiling.cc:243] Waited 757 ms on lock 0x7b54003d1dd4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:02.898298 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1740542848}
I20260709 13:13:02.883428   695 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:02.910835 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:02.952517 29419 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:02.935537 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:02.966610 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:02.967362 29450 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:13:03.001814 29449 raft_consensus.cc:1240] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:13:03.002358 29450 raft_consensus.cc:1275] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:13:02.995216 29346 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:02.995625 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:02.990391 29527 raft_consensus.cc:1240] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:03.005738 29346 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:02.997929 29523 raft_consensus.cc:1240] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:03.000038 29530 raft_consensus.cc:2393] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 8: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:03.000037 29525 raft_consensus.cc:1240] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:02.970305   564 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:02.996860 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:13:03.087252 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:03.247146 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 249546us
W20260709 13:13:03.110915 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:03.193775   725 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.010s	sys 0.007s
I20260709 13:13:02.950851   737 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:02.966080   382 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:03.007943   600 consensus_queue.cc:237] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:02.839293   716 consensus_queue.cc:237] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:02.964931   778 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.295715 29526 raft_consensus.cc:1275] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:13:03.182435 29447 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.010s	sys 0.012s
W20260709 13:13:03.245625 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:03.297809 29447 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.010s	sys 0.013s
W20260709 13:13:03.245430 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 293055us
I20260709 13:13:03.247722 29344 leader_election.cc:400] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 13. Current term is 14.
I20260709 13:13:03.299741 29344 leader_election.cc:403] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:13:03.268504   506 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:03.300382 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 58757.5us
I20260709 13:13:03.249042 29521 raft_consensus.cc:1240] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:03.301704   693 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:03.259100   436 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.303733   778 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:03.303951   436 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:02.986028   667 consensus_queue.cc:1048] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:13:02.909430   739 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:03.255951   564 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:03.256117   762 log.cc:927] Time spent T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.895s	user 0.009s	sys 0.006s
I20260709 13:13:03.256239   634 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:03.275061   755 consensus_queue.cc:1048] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:03.257937 29448 raft_consensus.cc:2393] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 11: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
W20260709 13:13:03.264531 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:03.278503 29527 raft_consensus.cc:1275] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:13:03.251307 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 245623us
I20260709 13:13:03.334908 29346 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:03.260934   777 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:03.307253 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:03.335873   777 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:03.240289 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:03.312333 29419 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:03.316320 29344 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:03.257448   696 raft_consensus.cc:3055] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:13:03.278327   725 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.857s	user 0.011s	sys 0.008s
I20260709 13:13:03.337105   696 raft_consensus.cc:740] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:03.337545   725 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:13:03.338207   777 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:03.338076   696 consensus_queue.cc:260] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:03.272215   624 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.339388   624 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:03.340161   769 log.cc:927] Time spent T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.520s	user 0.011s	sys 0.013s
I20260709 13:13:03.340524   436 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:03.341737   624 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:03.341828 29454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 1417) took 1161 ms. Trace:
I20260709 13:13:03.250485   718 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:13:03.352983 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:03.281221   695 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:03.253482   787 consensus_queue.cc:1048] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:13:03.282974   737 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:03.278492   779 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:13:03.319089   715 consensus_queue.cc:1059] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:13:03.386282   715 raft_consensus.cc:3055] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:03.386766   715 raft_consensus.cc:740] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:03.387645   715 consensus_queue.cc:260] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:03.388293   455 consensus_queue.cc:260] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:03.388918   715 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:03.389380   455 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:03.365281 29527 raft_consensus.cc:1275] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:03.391786 29452 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
I20260709 13:13:03.359267 29525 raft_consensus.cc:1275] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:13:03.369702 29521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2802) took 1053 ms. Trace:
W20260709 13:13:03.370170   714 log.cc:927] Time spent T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.547s	user 0.002s	sys 0.000s
I20260709 13:13:03.370623   718 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:03.371289   602 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:03.372146   695 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:03.375178 29448 raft_consensus.cc:1275] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:03.377354   785 raft_consensus.cc:3055] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:03.379114   778 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:03.382236 29380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1332) took 1776 ms. Trace:
I20260709 13:13:03.417349 29380 rpcz_store.cc:276] 0709 13:13:01.605678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.692328 (+ 86650us) service_pool.cc:224] Handling call
0709 13:13:01.692674 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:01.700591 (+  7917us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:13:01.700627 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:01.722092 (+ 21465us) log.cc:844] Serialized 26 byte log entry
0709 13:13:02.134698 (+412606us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b18002f8720. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c7be07 00007f6a81ad6ab9 00007f6a78c9869b 00007f6a78c9693f 00007f6a78c98c02 00007f6a7b92020b 00007f6a7b925d23 00007f6a7b9260d1 00007f6a7bd41a0f
0709 13:13:02.350959 (+216261us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:02.351051 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:02.351163 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:02.861321 (+510158us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:13:03.255757 (+394436us) spinlock_profiling.cc:243] Waited 38.4 ms on lock 0x7b2400116558. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78b1f9c4 00007f6a78b1dacb 00007f6a78cd8dc9 00007f6a78cd8a55 00007f6a78cd809d 00007f6a7b90a10e 00007f6a7b92188c 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221
0709 13:13:03.381980 (+126223us) raft_consensus.cc:1685] finished
0709 13:13:03.382006 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:03.382165 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7599,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":22138,"spinlock_wait_cycles":125279232,"thread_start_us":215988,"threads_started":1,"wal-append.queue_time_us":625420}
I20260709 13:13:03.393424 29521 rpcz_store.cc:276] 0709 13:13:02.316029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.316148 (+   119us) service_pool.cc:224] Handling call
0709 13:13:02.316414 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:03.301377 (+984963us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:03.369314 (+ 67937us) spinlock_profiling.cc:243] Waited 932 ms on lock 0x7b54000b7cd4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:03.369620 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2144370944}
I20260709 13:13:03.342350 29454 rpcz_store.cc:276] 0709 13:13:02.180306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.181190 (+   884us) service_pool.cc:224] Handling call
0709 13:13:02.181634 (+   444us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:02.196938 (+ 15304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:02.196984 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:02.226506 (+ 29522us) log.cc:844] Serialized 52 byte log entry
0709 13:13:02.587693 (+361187us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:02.587780 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:02.587895 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:03.305400 (+717505us) spinlock_profiling.cc:243] Waited 47.5 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:13:03.341462 (+ 36062us) raft_consensus.cc:1685] finished
0709 13:13:03.341487 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:03.341755 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13240,"raft.queue_time_us":802,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":17648,"spinlock_wait_cycles":109325184,"thread_start_us":331571,"threads_started":1,"wal-append.queue_time_us":444796}
I20260709 13:13:03.400468   621 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.386210   737 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:03.411602   718 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:03.416196 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:03.365655   436 raft_consensus.cc:2804] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:03.421432 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:03.408888   695 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:03.424924 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:03.400134   696 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:03.357458   701 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:03.433267   602 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:13:03.437327 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 125214us
W20260709 13:13:03.439010 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:03.420225 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:03.471671 29521 raft_consensus.cc:2468] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:13:03.435842 29528 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 10.
I20260709 13:13:03.417032   785 raft_consensus.cc:740] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:03.476060 29419 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:03.439693   624 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:13:03.474630 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 138534us
I20260709 13:13:03.443290   436 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:03.520922 29419 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:03.525527 29346 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:03.526701 29419 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:03.449234   339 consensus_queue.cc:1048] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:13:03.530074 29419 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:03.516397   585 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.540764   585 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:03.514986   602 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:03.543830   790 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:03.531925   737 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:03.545678   602 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:03.527760   436 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:03.549068   564 raft_consensus.cc:2804] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:03.549706   564 raft_consensus.cc:697] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 10 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:03.550681   564 consensus_queue.cc:237] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:03.553663 29419 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:03.524075   695 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:03.441692   621 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:03.523741   779 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.543274   585 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:03.514060   778 consensus_queue.cc:1048] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:13:03.540119   781 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.555635   737 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:03.558228   680 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:13:03.583307   612 consensus_meta.cc:287] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.807s	user 0.013s	sys 0.005s
I20260709 13:13:03.585114   612 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:03.588066 29529 raft_consensus.cc:2393] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 11: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:13:03.582576   523 consensus_meta.cc:287] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.734s	user 0.019s	sys 0.003s
I20260709 13:13:03.587469   612 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:03.596601   791 log.cc:927] Time spent T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:13:03.569974   779 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:03.581697   781 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:03.604970   739 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:03.572041   785 consensus_queue.cc:260] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:03.611050   789 log.cc:927] Time spent T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.191s	user 0.001s	sys 0.001s
W20260709 13:13:03.614975   786 log.cc:927] Time spent T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:13:03.597318   523 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:03.625325   792 log.cc:927] Time spent T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:13:03.740653   382 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.742162   382 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:03.656738 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 240270us
I20260709 13:13:03.751262   779 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:03.751394   701 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:03.710244   523 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:03.757031   781 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:03.676637 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:03.758168   716 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:03.665045 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 109801us
I20260709 13:13:03.759044   716 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:03.624670   785 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:03.664172 29447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 1422) took 1145 ms. Trace:
I20260709 13:13:03.768062 29447 rpcz_store.cc:276] 0709 13:13:02.518649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.519677 (+  1028us) service_pool.cc:224] Handling call
0709 13:13:02.560483 (+ 40806us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:02.562014 (+  1531us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:02.562061 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:02.587047 (+ 24986us) log.cc:844] Serialized 26 byte log entry
0709 13:13:03.298297 (+711250us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:03.298338 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:03.298413 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:03.663410 (+364997us) raft_consensus.cc:1685] finished
0709 13:13:03.663452 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:03.663927 (+   475us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1063,"raft.queue_time_us":1781,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":9458,"thread_start_us":636663,"threads_started":1,"wal-append.queue_time_us":844476}
W20260709 13:13:03.771075 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:03.712983 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:03.777529 29523 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:03.778046   718 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:03.659837 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 128192us
I20260709 13:13:03.662523 29522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2817) took 1211 ms. Trace:
I20260709 13:13:03.763037   716 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:03.762960 29419 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:03.784595 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:03.781343   382 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:03.797884 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:03.790095 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:03.812654 29526 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:03.815343   680 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.783759 29522 rpcz_store.cc:276] 0709 13:13:02.450989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.983242 (+532253us) service_pool.cc:224] Handling call
0709 13:13:02.998352 (+ 15110us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:02.998627 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:13:03.097362 (+ 98735us) log.cc:844] Serialized 14 byte log entry
0709 13:13:03.390555 (+293193us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b18000fbfe0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c7be07 00007f6a81ad6ab9 00007f6a78c9869b 00007f6a78c9693f 00007f6a78c98c02 00007f6a7b92020b 00007f6a7b925d23 00007f6a7b92623a 00007f6a7bd90a2a
0709 13:13:03.661280 (+270725us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:03.661433 (+   153us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:03.661631 (+   198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:03.661780 (+   149us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:03.662150 (+   370us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5790,"prepare.queue_time_us":1360,"prepare.run_cpu_time_us":12429,"prepare.run_wall_time_us":217631,"raft.queue_time_us":41269,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":329,"spinlock_wait_cycles":48309120,"thread_start_us":269899,"threads_started":1,"wal-append.queue_time_us":365681}
I20260709 13:13:03.816308   680 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:03.817689 29528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37958 (request call id 1610) took 1309 ms. Trace:
I20260709 13:13:03.818181 29528 rpcz_store.cc:276] 0709 13:13:02.508279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.835758 (+327479us) service_pool.cc:224] Handling call
0709 13:13:03.817284 (+981526us) spinlock_profiling.cc:243] Waited 545 ms on lock 0x7b54000cb7d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:03.817477 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1252439296}
I20260709 13:13:03.800385   693 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 13. Current term is 14.
W20260709 13:13:03.822628 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:03.817591 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:03.824395 29522 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:13:03.816211 29529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37958 (request call id 1613) took 1307 ms. Trace:
W20260709 13:13:03.839386 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:03.840386   693 consensus_queue.cc:1048] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:03.828244 29529 rpcz_store.cc:276] 0709 13:13:02.509067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:02.837769 (+328702us) service_pool.cc:224] Handling call
0709 13:13:03.815723 (+977954us) spinlock_profiling.cc:243] Waited 749 ms on lock 0x7b54002bb954. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:03.815961 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1722894208}
W20260709 13:13:03.851519 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 88851.4us
I20260709 13:13:03.853953 29452 raft_consensus.cc:1275] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:13:03.853662   436 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:03.855062   695 raft_consensus.cc:2749] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:13:03.856163   737 consensus_queue.cc:1059] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:03.858129 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:03.819476   680 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:03.879637 29452 raft_consensus.cc:1275] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:13:03.886029   783 log.cc:927] Time spent T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 1.059s	user 0.005s	sys 0.001s
I20260709 13:13:03.901881   687 raft_consensus.cc:1064] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483: attempting to promote NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 to VOTER
W20260709 13:13:03.902729   687 raft_consensus.cc:1068] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483: Unable to promote non-voter ca041dab9b2f44409ed7bf4c6cf66ab2: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:13:03.906787 30154 raft_consensus.cc:1275] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 LEARNER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:13:03.910588 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:03.918036 29344 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:03.919886 29528 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:13:03.923230 29451 raft_consensus.cc:1240] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:13:03.926222 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:03.926978 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:03.925879   621 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:03.927738 29451 raft_consensus.cc:2410] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:13:03.928191 29454 raft_consensus.cc:2393] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 11: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:03.930804   382 consensus_queue.cc:1048] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:03.931602 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:03.934122   624 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:03.934886   624 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:03.937425   624 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:03.946457 29346 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:03.940485 29523 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
I20260709 13:13:03.940980   680 raft_consensus.cc:3055] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:03.948107   680 raft_consensus.cc:740] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:03.948189 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:03.949206 29454 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
I20260709 13:13:03.950192   680 consensus_queue.cc:260] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:03.952636   739 raft_consensus.cc:1064] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483: attempting to promote NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 to VOTER
I20260709 13:13:03.952775   680 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:03.953156   739 raft_consensus.cc:1068] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483: Unable to promote non-voter ca041dab9b2f44409ed7bf4c6cf66ab2: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:13:03.964427 29452 raft_consensus.cc:1240] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 13. Current term is 14. Ops: [11.6-13.7]
W20260709 13:13:03.982326 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 56218.9us
I20260709 13:13:04.000276   607 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:04.008788 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 62524.8us
I20260709 13:13:04.009384   607 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:03.991289   624 consensus_queue.cc:1048] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:13:03.999505   382 raft_consensus.cc:2749] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:04.004637   693 raft_consensus.cc:2804] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:04.016093   693 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:04.016508   693 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:04.014389 29521 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 14.
I20260709 13:13:04.036139 29344 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:04.038086   725 raft_consensus.cc:2804] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:04.038537   725 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:04.038311 29344 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:04.039013   725 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:04.033533   624 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:04.040081   624 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:04.040539   781 raft_consensus.cc:2804] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:04.041056   781 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:04.041456   781 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:04.041946   737 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:04.043287   737 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:04.036131   785 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.046711   785 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:04.049441   785 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:04.051959   790 consensus_meta.cc:287] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.507s	user 0.016s	sys 0.007s
I20260709 13:13:04.052827   607 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:04.053527   436 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:04.064699 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.065618 29526 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
I20260709 13:13:04.074205 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:04.075541 29528 raft_consensus.cc:2468] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 5.
I20260709 13:13:04.076941   564 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.043394   624 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:04.084707 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 73531.9us
I20260709 13:13:04.067355 29344 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:04.032670   621 consensus_queue.cc:1048] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
W20260709 13:13:04.088382 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 102356us
I20260709 13:13:04.052845   790 raft_consensus.cc:2749] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:04.077579   564 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:04.090830   737 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:04.106580 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 45568.6us
I20260709 13:13:04.119604 30119 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:13:04.119797   785 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:04.142835   436 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:04.156962   559 raft_consensus.cc:2804] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:13:04.158476   696 consensus_meta.cc:287] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.642s	user 0.012s	sys 0.010s
I20260709 13:13:04.158118 29277 catalog_manager.cc:5697] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 10 to 11, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 11 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:04.161350   564 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:04.162256 29346 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:04.167682 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.155339 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:13:04.174335 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.164693   559 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:04.181309 29344 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:04.179826   436 raft_consensus.cc:697] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:04.196766   436 consensus_queue.cc:237] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:04.170471   785 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:04.188370   559 raft_consensus.cc:3060] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:04.210184 29529 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:04.181632   696 consensus_queue.cc:1059] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:13:04.217236   790 raft_consensus.cc:2804] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:13:04.220814   823 log.cc:927] Time spent T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.122s	user 0.005s	sys 0.000s
W20260709 13:13:04.226195 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.227406 29344 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:04.226272   790 raft_consensus.cc:697] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:04.237126   790 consensus_queue.cc:237] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:04.238178   785 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:04.239959 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 112823us
I20260709 13:13:04.242179   621 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:13:04.223955   715 consensus_meta.cc:287] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.744s	user 0.009s	sys 0.015s
I20260709 13:13:04.246883   803 consensus_queue.cc:1048] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:13:04.246562   621 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:04.253890   788 raft_consensus.cc:3055] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:04.254432   788 raft_consensus.cc:740] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:04.255609 29530 raft_consensus.cc:1275] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:13:04.255559   788 consensus_queue.cc:260] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:04.264178   715 consensus_queue.cc:1048] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:04.265192   739 consensus_queue.cc:1048] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:04.259611   621 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:04.209492   716 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:04.272174 29277 catalog_manager.cc:5697] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 8 to 9, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 9 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:04.274495 29277 catalog_manager.cc:5697] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 12 to 13, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 13 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:04.276531 29277 catalog_manager.cc:5697] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:04.278182 29277 catalog_manager.cc:5697] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:04.280915 29277 catalog_manager.cc:5697] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 9 to 10, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 10 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:04.285228 29276 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37608 (request call id 154) took 10648 ms. Trace:
I20260709 13:13:04.265290   788 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:04.286242 29346 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:04.288664 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 79618.8us
I20260709 13:13:04.293643 29529 raft_consensus.cc:2468] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
W20260709 13:13:04.296744 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.298926   715 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.299620   715 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:04.301790   715 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:04.278998   559 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:04.286767   725 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:04.313779 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 47698.2us
I20260709 13:13:04.316931   559 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 7 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:04.318341 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:04.319329 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:04.320308 29375 raft_consensus.cc:2393] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 11: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:04.319224 29380 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 10.
I20260709 13:13:04.320151 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:04.302358   680 raft_consensus.cc:476] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 6 LEADER]: Not starting pre-election -- already a leader
I20260709 13:13:04.303015   621 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.320799 29277 catalog_manager.cc:5697] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:04.321659 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:04.333491 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:04.334717   725 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:04.302620   693 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:04.335400 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:04.335569   790 consensus_queue.cc:1048] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:04.337507   693 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:04.339138   680 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.339952 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:04.287662 29276 rpcz_store.cc:276] 0709 13:12:53.636264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:53.636581 (+   317us) service_pool.cc:224] Handling call
0709 13:13:04.284780 (+10648199us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:59.904850 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:59.968081 (+ 63231us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:59.968139 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:12:59.968167 (+    28us) tablet.cc:662] Decoding operations
0709 13:12:59.969257 (+  1090us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:59.969321 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:59.969349 (+    28us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:12:59.969921 (+   572us) tablet.cc:701] Row locks acquired
0709 13:12:59.969937 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:12:59.970128 (+   191us) write_op.cc:270] Start()
0709 13:12:59.970266 (+   138us) write_op.cc:276] Timestamp: P: 1783602779970066 usec, L: 0
0709 13:12:59.970286 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:12:59.971072 (+   786us) log.cc:844] Serialized 2499 byte log entry
0709 13:13:00.538669 (+567597us) op_driver.cc:464] REPLICATION: finished
0709 13:13:00.693721 (+155052us) write_op.cc:301] APPLY: starting
0709 13:13:00.693827 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:00.694027 (+   200us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:00.694184 (+   157us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:00.695032 (+   848us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:00.695278 (+   246us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:13:00.695598 (+   320us) write_op.cc:312] APPLY: finished
0709 13:13:00.696025 (+   427us) log.cc:844] Serialized 52 byte log entry
0709 13:13:00.696999 (+   974us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:00.697132 (+   133us) write_op.cc:454] Released schema lock
0709 13:13:00.697189 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:00.697736 (+   547us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:00.697772 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":581902,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":141951,"apply.run_cpu_time_us":2779,"apply.run_wall_time_us":3897,"num_ops":6,"prepare.queue_time_us":449756,"prepare.run_cpu_time_us":75398,"prepare.run_wall_time_us":310956,"raft.queue_time_us":146806,"raft.run_cpu_time_us":48682,"raft.run_wall_time_us":226249,"replication_time_us":531551,"thread_start_us":684205,"threads_started":4,"wal-append.queue_time_us":298559,"wal-append.run_cpu_time_us":6353,"wal-append.run_wall_time_us":1429003}]]}
I20260709 13:13:04.343590   715 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:13:04.346585 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.347039 29277 catalog_manager.cc:5697] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:04.339783   680 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:04.334659 29378 raft_consensus.cc:2368] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 6. Current term is 7.
I20260709 13:13:04.350622 29277 catalog_manager.cc:5697] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:04.353683 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:04.359928 29526 raft_consensus.cc:3060] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:13:04.328795   701 raft_consensus.cc:2804] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:04.364197   701 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:04.364877   701 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:04.369426   827 log.cc:927] Time spent T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.098s	user 0.003s	sys 0.000s
W20260709 13:13:04.372920 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.369235   715 raft_consensus.cc:697] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:13:04.384851 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 55160.8us
I20260709 13:13:04.386543 29344 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:04.393756 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:04.394531 29449 raft_consensus.cc:2468] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 6.
I20260709 13:13:04.395161   680 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:13:04.398869 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.402567   716 raft_consensus.cc:2804] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:04.404083 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:04.404620 29372 raft_consensus.cc:1240] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:04.405462 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:04.405897 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:04.424218 29524 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:04.409812 29526 raft_consensus.cc:2468] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 7.
I20260709 13:13:04.415750 29373 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 8.
I20260709 13:13:04.416698 29277 catalog_manager.cc:5697] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:04.426811 30119 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:13:04.427613   715 consensus_queue.cc:237] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:04.428328   660 raft_consensus.cc:2804] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:04.430019 29529 raft_consensus.cc:2410] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:13:04.435978   660 raft_consensus.cc:697] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:13:04.352656   621 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:04.438961 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:04.439736 29523 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:04.450362 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:04.450752 29495 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:04.451176 29449 raft_consensus.cc:3060] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:04.454694   660 consensus_queue.cc:237] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:04.460726   781 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:04.496279 29374 raft_consensus.cc:2368] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 8. Current term is 9.
I20260709 13:13:04.498061 29449 raft_consensus.cc:2468] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 7.
I20260709 13:13:04.431849   716 raft_consensus.cc:697] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:04.498807 29277 catalog_manager.cc:5697] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 9 to 10, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 10 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:04.501574 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:04.508230 29279 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35182 (request call id 67) took 4703 ms. Trace:
W20260709 13:13:04.500326 29421 leader_election.cc:336] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 2.180s (SENT)
I20260709 13:13:04.571165 29421 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:04.587656 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.518467   564 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:04.516664   680 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:04.610714 29380 raft_consensus.cc:1240] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:04.606017 29277 catalog_manager.cc:5697] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:04.618763 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.636792 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:04.517217 29279 rpcz_store.cc:276] 0709 13:12:59.671691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:59.681814 (+ 10123us) service_pool.cc:224] Handling call
0709 13:13:04.375331 (+4693517us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:03.573448 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:03.613804 (+ 40356us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:03.613862 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:13:03.613889 (+    27us) tablet.cc:662] Decoding operations
0709 13:13:03.617678 (+  3789us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:03.617726 (+    48us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:03.617745 (+    19us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:13:03.617947 (+   202us) tablet.cc:701] Row locks acquired
0709 13:13:03.617956 (+     9us) write_op.cc:260] PREPARE: finished
0709 13:13:03.618090 (+   134us) write_op.cc:270] Start()
0709 13:13:03.618175 (+    85us) write_op.cc:276] Timestamp: P: 1783602783618048 usec, L: 0
0709 13:13:03.618186 (+    11us) op_driver.cc:348] REPLICATION: starting
0709 13:13:03.624800 (+  6614us) log.cc:844] Serialized 538 byte log entry
0709 13:13:04.213568 (+588768us) op_driver.cc:464] REPLICATION: finished
0709 13:13:04.286961 (+ 73393us) spinlock_profiling.cc:243] Waited 3.92 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a78c7c0ac 00007f6a81ad6ab9 00007f6a78c9869b 00007f6a78c9693f 00007f6a78c98c02 00007f6a7f7bcef0
0709 13:13:04.368165 (+ 81204us) write_op.cc:301] APPLY: starting
0709 13:13:04.368336 (+   171us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:04.368542 (+   206us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:04.368602 (+    60us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:04.369066 (+   464us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:04.369416 (+   350us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:13:04.369494 (+    78us) write_op.cc:312] APPLY: finished
0709 13:13:04.369912 (+   418us) log.cc:844] Serialized 22 byte log entry
0709 13:13:04.370158 (+   246us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:04.370295 (+   137us) write_op.cc:454] Released schema lock
0709 13:13:04.370365 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:04.370944 (+   579us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:04.370983 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1834097,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":62991,"apply.run_cpu_time_us":2824,"apply.run_wall_time_us":39173,"num_ops":1,"prepare.queue_time_us":561886,"prepare.run_cpu_time_us":5682,"prepare.run_wall_time_us":187768,"raft.queue_time_us":248099,"replication_time_us":562570,"spinlock_wait_cycles":13359744,"thread_start_us":811238,"threads_started":4,"wal-append.queue_time_us":1881}]]}
I20260709 13:13:04.637483   687 raft_consensus.cc:2804] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:13:04.667060 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 94101.6us
I20260709 13:13:04.619906   680 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:04.622926   564 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:04.683254   839 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
W20260709 13:13:04.683684   840 log.cc:927] Time spent T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
W20260709 13:13:04.684620   838 log.cc:927] Time spent T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:13:04.684933   716 consensus_queue.cc:237] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:04.687785 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:04.692971 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 246593us
W20260709 13:13:04.696386 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 251233us
I20260709 13:13:04.643819   737 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:13:04.662093   687 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:04.695951 29277 catalog_manager.cc:5697] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 7 to 8, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 8 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:04.731822   781 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:04.733065   621 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:04.733879   621 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:04.734527   621 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:04.737208 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.733093 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:04.741436   564 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:04.748294 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:04.751031 29495 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:04.751811   621 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:04.752890   715 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.753533   715 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:04.738138   839 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:04.776836 29523 raft_consensus.cc:2468] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:13:04.764791 29378 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
I20260709 13:13:04.717370   687 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:13:04.785910 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 50390us
I20260709 13:13:04.787380 29277 catalog_manager.cc:5697] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 6 to 7, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 7 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:04.801052   847 raft_consensus.cc:2804] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:04.801636   847 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:04.802049   847 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:04.735893   835 consensus_queue.cc:1048] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:04.770637   680 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:04.786914   838 log.cc:927] Time spent T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:13:04.825156 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:04.791098   564 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.826017 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:04.826218 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:04.826471   564 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:04.827456 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:04.828908   564 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:04.810449 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.820653   839 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:04.786954   621 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:04.844667 29277 catalog_manager.cc:5697] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 9 to 10, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 10 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:04.857110 29524 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:13:04.870007 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:04.870476 29528 raft_consensus.cc:1275] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:13:04.870954 29373 raft_consensus.cc:2410] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:13:04.871745 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:04.871852   836 consensus_queue.cc:1048] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 13:13:04.872360 29527 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:04.866050 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:04.868453   701 consensus_meta.cc:287] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.503s	user 0.014s	sys 0.000s
W20260709 13:13:04.896790 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:04.906096   832 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.906592 29377 raft_consensus.cc:1240] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:04.917309 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:04.895869 29277 catalog_manager.cc:5697] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 4 to 5, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 5 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:04.878875   715 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:04.906615 32662 consensus_queue.cc:1048] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:13:04.926242 29277 catalog_manager.cc:5697] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:04.907119   832 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:04.866658   621 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:04.910990   701 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:04.969519 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:04.969745 29277 catalog_manager.cc:5697] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 6 to 7, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 7 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:05.013381 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:05.015908 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:05.016888 29378 raft_consensus.cc:2410] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:13:05.020540   701 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:05.021620 29372 raft_consensus.cc:2393] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 14: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:05.015089 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:05.028556 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:05.027767 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:05.028527 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:05.026922 29530 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11.
I20260709 13:13:05.038420 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:04.949137   564 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:05.043288 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:05.043591   832 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:05.044863 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:05.051514 29374 raft_consensus.cc:2393] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 11: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:05.046947 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:05.048650 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:05.052675 29375 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:05.054788 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:05.055289 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:05.054718 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:05.057438 29380 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11.
I20260709 13:13:05.060055 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:05.061965 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:05.065922 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:05.049762 29373 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 10.
I20260709 13:13:05.048157 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:05.066787 29374 raft_consensus.cc:2368] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 8. Current term is 9.
I20260709 13:13:05.055873 29378 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11.
I20260709 13:13:05.063419 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:05.066359 29344 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:05.049016 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.071714 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:05.071985 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:05.072722 29373 raft_consensus.cc:2393] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 11: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:05.064208   621 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:05.076246 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:05.078254 29528 raft_consensus.cc:1240] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 6. Current term is 7. Ops: [6.5-6.5]
W20260709 13:13:05.081092 29419 leader_election.cc:336] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 2.040s (SENT)
I20260709 13:13:05.081449 29380 raft_consensus.cc:2393] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 11: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:05.081650 29419 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:05.086308 29372 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 12.
I20260709 13:13:05.067540   564 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:05.117362 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:05.117733 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:05.118781   848 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.119204   564 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:05.129189 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:05.119561 29525 raft_consensus.cc:1240] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 11. Current term is 12. Ops: [10.7-11.8]
I20260709 13:13:05.119412   848 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:05.131460 29524 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11.
I20260709 13:13:05.132529 29374 raft_consensus.cc:2393] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 12: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:05.132812   848 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:05.135638   788 consensus_meta.cc:287] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.841s	user 0.004s	sys 0.011s
I20260709 13:13:05.137682 29375 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11.
I20260709 13:13:05.137765   687 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:05.077652   832 raft_consensus.cc:2804] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:13:05.125932 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 54984.2us
I20260709 13:13:05.125775 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:05.126636   855 raft_consensus.cc:2749] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:05.123201 29527 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:13:05.078830   680 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:05.149554 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.145898 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:05.147179 29372 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 13.
I20260709 13:13:05.151911 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:05.153403 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:05.155649 29529 raft_consensus.cc:2368] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 11. Current term is 12.
I20260709 13:13:05.157003 29530 raft_consensus.cc:1275] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:13:05.157872 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:05.158099 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:05.159305 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:05.154001 29528 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:13:05.159404 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:05.176560 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:05.175339 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:05.074791   847 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:05.179013 29525 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:13:05.181686 29530 raft_consensus.cc:1275] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 13:13:05.184096 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:05.179638 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 61247us
I20260709 13:13:05.185653 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:05.186079 29527 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 14.
I20260709 13:13:05.186781 29344 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:05.189309 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:05.168638   832 raft_consensus.cc:697] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:05.194072 29526 raft_consensus.cc:2368] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 12. Current term is 13.
I20260709 13:13:05.193655   687 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:05.201148 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:05.198993   847 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:05.202188 29378 raft_consensus.cc:2393] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 11: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:05.195564 29344 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:05.163198   680 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:05.192821   701 raft_consensus.cc:2804] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:05.228482 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:13:05.231674 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 83592us
I20260709 13:13:05.224498 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:05.231344   847 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.229797 29376 raft_consensus.cc:2376] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 8. Re-sending same reply.
I20260709 13:13:05.248188 29447 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
I20260709 13:13:05.250115   847 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:05.257998   847 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:05.260362 29451 raft_consensus.cc:1275] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:13:05.232208   862 raft_consensus.cc:2804] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:13:05.246683 29495 connection.cc:256] RPC call timeout handler was delayed by -1.259347931000093s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1875s for a response
W20260709 13:13:05.270867 29495 connection.cc:256] RPC call timeout handler was delayed by -1.1677296590000878s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16000000000000003s for a response
W20260709 13:13:05.272200 29495 connection.cc:256] RPC call timeout handler was delayed by -1.0048296590000518s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1781s for a response
I20260709 13:13:05.270867   693 consensus_queue.cc:1048] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:13:05.280022   832 consensus_queue.cc:237] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:05.247085   701 raft_consensus.cc:697] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:05.281868 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:05.267278   866 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.304160   855 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:05.309279 29376 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:13:05.309754   855 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:05.310245   815 consensus_queue.cc:1048] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:05.311970 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:05.312760   855 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:05.289273   862 raft_consensus.cc:697] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:13:05.326953 29495 leader_election.cc:336] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.551s (SENT)
W20260709 13:13:05.329303 29421 leader_election.cc:336] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.559s (SENT)
I20260709 13:13:05.330911 29421 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:05.334251 29495 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:13:05.335211 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 89292.9us
I20260709 13:13:05.336792 29344 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:05.348903 29419 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:05.357035 29381 raft_consensus.cc:1275] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:13:05.324174   866 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:05.342232   847 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:05.375984 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:05.341497   687 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.383112 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:05.383821 29381 raft_consensus.cc:2376] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11. Re-sending same reply.
I20260709 13:13:05.384023   860 raft_consensus.cc:1064] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483: attempting to promote NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 to VOTER
I20260709 13:13:05.385571   680 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:05.387249   862 consensus_queue.cc:237] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:05.355155   855 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:05.390406 29376 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 7.
W20260709 13:13:05.393097 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:05.397835 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 68601.5us
W20260709 13:13:05.399819 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 75994.1us
I20260709 13:13:05.369516   856 raft_consensus.cc:2804] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:13:05.415324 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.420372 29419 leader_election.cc:400] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 11. Current term is 12.
I20260709 13:13:05.420802 29419 leader_election.cc:403] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:05.380213   564 consensus_queue.cc:1059] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:13:05.389595   621 consensus_queue.cc:1059] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:13:05.424064 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:05.405789   856 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:05.351897   701 consensus_queue.cc:237] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:05.432303 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:05.449344 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:05.451684   860 consensus_queue.cc:237] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:05.471530 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:05.476126 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 85215.8us
I20260709 13:13:05.478014 29419 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:05.470388 29381 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 12.
I20260709 13:13:05.429260   877 raft_consensus.cc:2804] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:05.422729   687 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:05.430961   856 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:05.490774 29452 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
I20260709 13:13:05.495518 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:05.502589 29381 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 10.
I20260709 13:13:05.479712   876 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:05.509832 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 97563.2us
I20260709 13:13:05.493903   877 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:05.526546 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:05.510584   564 raft_consensus.cc:3055] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:05.513180   887 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:05.534880 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 57002.1us
I20260709 13:13:05.537364 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:05.539444 29452 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:13:05.543891   621 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:13:05.556876 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.523999   877 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:13:05.568126 29421 leader_election.cc:336] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.687s (SENT)
I20260709 13:13:05.534025   564 raft_consensus.cc:740] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:05.572105 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:05.604897 29381 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
W20260709 13:13:05.607779 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.523550   876 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:05.576519   881 log.cc:927] Time spent T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:13:05.575994   854 log.cc:927] Time spent T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2: Append to log took a long time: real 0.713s	user 0.001s	sys 0.007s
I20260709 13:13:05.611079 29421 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:05.611660   889 raft_consensus.cc:2749] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:05.618127   727 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.618191 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:05.592862   885 raft_consensus.cc:3055] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:05.607962   866 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:05.626055 29495 leader_election.cc:336] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.973s (SENT)
I20260709 13:13:05.626619   727 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:05.638024   727 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:05.638681 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:05.639761 29381 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 8.
I20260709 13:13:05.644104 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:05.645061 29378 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11.
I20260709 13:13:05.646449 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:05.647965   564 consensus_queue.cc:260] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:05.648376 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:05.649086   687 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:05.649278 29381 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 10.
W20260709 13:13:05.650053   886 log.cc:927] Time spent T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b: Append to log took a long time: real 0.066s	user 0.000s	sys 0.002s
I20260709 13:13:05.651459   876 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:05.652333 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:05.653365   880 log.cc:927] Time spent T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:13:05.633780   888 consensus_queue.cc:1048] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:05.656999   888 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:05.649426   564 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:05.652244 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:05.653470 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.659986 29374 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 8.
I20260709 13:13:05.628289   885 raft_consensus.cc:740] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:05.683130 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:05.686513 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:05.687330 29527 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:13:05.694645 29344 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:05.697335 29344 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:05.696353   866 raft_consensus.cc:2804] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:05.703826 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:05.704676 29376 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 10.
I20260709 13:13:05.585291   887 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:05.704030   866 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:05.718521 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:05.720016 30158 raft_consensus.cc:1275] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 LEARNER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:13:05.720621   887 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:05.732096   872 raft_consensus.cc:2804] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:05.732803   872 raft_consensus.cc:697] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:05.733029   687 consensus_queue.cc:1048] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:05.733911   872 consensus_queue.cc:237] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:05.735788 30154 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54212 (request call id 131) took 1335 ms. Trace:
I20260709 13:13:05.736230 30154 rpcz_store.cc:276] 0709 13:13:04.400795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:04.401144 (+   349us) service_pool.cc:224] Handling call
0709 13:13:04.401926 (+   782us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:04.402660 (+   734us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:04.402699 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:04.618000 (+215301us) log.cc:844] Serialized 598 byte log entry
0709 13:13:04.798063 (+180063us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:04.798116 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:04.798215 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:05.574973 (+776758us) spinlock_profiling.cc:243] Waited 5.81 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:13:05.715712 (+140739us) raft_consensus.cc:1685] finished
0709 13:13:05.715737 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:05.735702 (+ 19965us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3516,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":202,"spinlock_wait_cycles":13363456,"thread_start_us":126167,"threads_started":1,"wal-append.queue_time_us":215607}
I20260709 13:13:05.738801   885 consensus_queue.cc:260] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:05.740088   885 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:05.632395 29495 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:05.629375 29452 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:13:05.740725 29450 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
W20260709 13:13:05.759687 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:05.768338 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.741003   866 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:05.780432 29344 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:05.805660   715 raft_consensus.cc:2804] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:05.806294   715 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:05.806655   715 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:05.769868   687 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:13:05.830605 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 87659.9us
I20260709 13:13:05.833482   888 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.833820 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:05.847355 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 95380.4us
W20260709 13:13:05.849313 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 281250us
I20260709 13:13:05.788812   680 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.864763 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:05.864939 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 238977us
I20260709 13:13:05.865892 29449 raft_consensus.cc:2410] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:13:05.869489 29421 leader_election.cc:336] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.705s (SENT)
I20260709 13:13:05.870500 29421 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:05.829284   621 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 11. Current term is 12.
I20260709 13:13:05.834951   716 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:05.882982 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.884593 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:05.885462 29449 raft_consensus.cc:2468] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
W20260709 13:13:05.891917 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.886344 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:05.910522 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:05.917515 29449 raft_consensus.cc:2410] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 13:13:05.928767 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 61570.7us
I20260709 13:13:05.931659 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:05.943583 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:05.945528 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:05.952162 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.884078   895 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:05.877626   680 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:05.968918 29495 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:05.852833   888 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:05.944567   890 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.893734   716 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:05.980530 29495 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:05.987447 29495 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:05.993374 29495 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:05.978801   860 raft_consensus.cc:2804] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:13:06.005846 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 136416us
W20260709 13:13:06.006906 29421 leader_election.cc:336] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.772s (SENT)
I20260709 13:13:06.007409 29421 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:05.957049   856 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:06.019222 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:05.991726   848 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:06.021065   687 raft_consensus.cc:2804] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:05.993600   847 raft_consensus.cc:2804] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:06.029448   687 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:05.989413   890 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:06.044281   687 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:06.046875   890 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:05.980068   895 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:06.053646   895 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:06.055123 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:06.056059 29456 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:13:06.057132 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:06.057715 29456 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:13:06.036978   897 log.cc:927] Time spent T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 13:13:06.037940   896 log.cc:927] Time spent T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:13:06.026386   848 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:06.002889   893 raft_consensus.cc:2749] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:13:06.065783 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:06.003448   860 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:06.071550 29453 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
I20260709 13:13:06.097122 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:06.098402 29449 raft_consensus.cc:2410] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:13:06.099516 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:06.100484 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 109177us
I20260709 13:13:06.071789   848 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:06.070817   860 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:06.071381   847 raft_consensus.cc:697] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 13 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:06.083103   564 raft_consensus.cc:2749] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:13:06.070981   912 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
W20260709 13:13:06.236690 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 229832us
I20260709 13:13:06.244243 29377 raft_consensus.cc:1275] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:06.245705 29373 raft_consensus.cc:1275] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:13:06.247269 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:06.250377 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:06.252662 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:06.257390 29374 raft_consensus.cc:1275] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:13:06.263190 29449 raft_consensus.cc:2393] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 14: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:06.263777 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:06.263535 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:13:06.258280 29421 leader_election.cc:336] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.768s (SENT)
I20260709 13:13:06.265318 29421 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:06.263516 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:06.267670 29380 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
I20260709 13:13:06.268174 29376 raft_consensus.cc:2393] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 8: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:06.263231 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:06.273499 29372 raft_consensus.cc:1275] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:13:06.232790   832 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:06.276201 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:06.322825 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:06.279250   894 log.cc:927] Time spent T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:13:06.279803 29372 raft_consensus.cc:1275] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:13:06.280143 29375 raft_consensus.cc:1240] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:13:06.280571 29380 raft_consensus.cc:1240] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:06.281184 29374 raft_consensus.cc:1275] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:13:06.297277 29379 raft_consensus.cc:1275] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:13:06.305660   877 consensus_meta.cc:287] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.691s	user 0.007s	sys 0.005s
W20260709 13:13:06.350013 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:06.329563 29377 raft_consensus.cc:1240] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:13:06.338554 29450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 1471) took 1003 ms. Trace:
W20260709 13:13:06.374940 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:06.384492 29377 raft_consensus.cc:1275] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:13:06.396607   866 consensus_meta.cc:287] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.601s	user 0.013s	sys 0.000s
W20260709 13:13:06.396922   907 log.cc:927] Time spent T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:13:06.397167   866 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:06.400632   913 log.cc:927] Time spent T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:13:06.404335   785 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.405035   785 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:06.353448 29450 rpcz_store.cc:276] 0709 13:13:05.335837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.996175 (+660338us) service_pool.cc:224] Handling call
0709 13:13:06.013299 (+ 17124us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:06.059290 (+ 45991us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:13:06.059683 (+   393us) log.cc:844] Serialized 14 byte log entry
0709 13:13:06.338076 (+278393us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:06.338159 (+    83us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:06.338224 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:06.338319 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:06.338472 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9608,"prepare.queue_time_us":669,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"raft.queue_time_us":9899,"thread_start_us":268208,"threads_started":1}
I20260709 13:13:06.408982 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:06.410494 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:06.410580   716 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:06.412595   847 consensus_queue.cc:237] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:06.418527 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 160294us
W20260709 13:13:06.419276 29421 leader_election.cc:336] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.777s (SENT)
I20260709 13:13:06.419700 29421 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:06.241472   912 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:06.393460   832 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:13:06.384034   877 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:06.348598   893 raft_consensus.cc:2749] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:06.432252 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:06.436220 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:06.432379 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:06.437523 29374 raft_consensus.cc:2393] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 11: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:06.431990 29373 raft_consensus.cc:2368] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 11. Current term is 12.
I20260709 13:13:06.431874 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:06.443226 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:06.432263 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:06.445453 29372 raft_consensus.cc:2368] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 11. Current term is 12.
I20260709 13:13:06.443889 29374 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
I20260709 13:13:06.338593   680 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:06.448985 29380 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
I20260709 13:13:06.452621 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:06.453279 29374 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:06.459131 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:06.462693 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:06.427443   912 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:06.472983 29448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 348) took 1221 ms. Trace:
I20260709 13:13:06.473500 29448 rpcz_store.cc:276] 0709 13:13:05.251233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.298502 (+ 47269us) service_pool.cc:224] Handling call
0709 13:13:06.470714 (+1172212us) spinlock_profiling.cc:243] Waited 7.78 ms on lock 0x7b5800193598. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61b71 00007f6a78c61a22 00007f6a81b7ac09 00007f6a80cd4ee0 00007f6a80d9e0ab 00007f6a80d9e131 00007f6a80d5ffc0 00007f6a80d4a929 00007f6a80d4a3d2 00007f6a7a2c1bd4
0709 13:13:06.472238 (+  1524us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:06.472453 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:06.472481 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:06.472538 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:06.472571 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:06.472640 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:06.472753 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17896832}
I20260709 13:13:06.428921   832 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:06.430382   877 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:06.442394   887 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.447979   785 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:06.428102   866 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:06.446054   856 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:06.527727 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:06.538249 29528 raft_consensus.cc:1275] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:13:06.549728 29374 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:13:06.470858   893 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:06.562505 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:06.589335 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:06.558547   687 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:06.559918 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:06.515466   832 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:06.602484 29452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 1470) took 1285 ms. Trace:
I20260709 13:13:06.608837 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:06.607435 29452 rpcz_store.cc:276] 0709 13:13:05.317067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.967235 (+650168us) service_pool.cc:224] Handling call
0709 13:13:05.986825 (+ 19590us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:05.998846 (+ 12021us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:13:05.998906 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:06.008931 (+ 10025us) log.cc:844] Serialized 26 byte log entry
0709 13:13:06.240389 (+231458us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:06.240437 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:06.240518 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:06.483859 (+243341us) raft_consensus.cc:1685] finished
0709 13:13:06.483886 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:06.602393 (+118507us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41152,"raft.queue_time_us":5806,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":7506,"thread_start_us":166026,"threads_started":1,"wal-append.queue_time_us":436928}
W20260709 13:13:06.610781 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 509290us
W20260709 13:13:06.611229 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:06.613063 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 193821us
W20260709 13:13:06.613592 29456 consensus_meta.cc:287] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.555s	user 0.017s	sys 0.000s
W20260709 13:13:06.621868 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:06.621901 29456 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
I20260709 13:13:06.618294 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
W20260709 13:13:06.611136   885 consensus_meta.cc:287] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.871s	user 0.012s	sys 0.004s
W20260709 13:13:06.633076 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 254422us
I20260709 13:13:06.641073 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:06.642866 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:06.641789 29377 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
I20260709 13:13:06.644522 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:06.564554   887 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:06.645320 29377 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:06.645711 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:06.647535 29454 raft_consensus.cc:2410] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 13:13:06.631160   715 consensus_meta.cc:287] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.824s	user 0.001s	sys 0.014s
I20260709 13:13:06.654198 29378 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:06.652860 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:06.658605 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:06.652885 29451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 1462) took 1382 ms. Trace:
I20260709 13:13:06.658442 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:06.659611 29527 raft_consensus.cc:2393] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 11: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:06.661448 29452 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:13:06.662920 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:06.664449 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:06.664525 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:06.665342 29527 raft_consensus.cc:2410] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:13:06.665525 29448 raft_consensus.cc:2410] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:13:06.666522 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:06.672824 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:06.677861 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:06.639828   832 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:06.681598 29522 raft_consensus.cc:1240] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 11. Current term is 12. Ops: [10.7-11.8]
I20260709 13:13:06.673799 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:06.670977 29523 raft_consensus.cc:2368] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 11. Current term is 12.
I20260709 13:13:06.687096 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:06.692027 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:06.693550 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:06.694754 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:06.692732 29448 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:13:06.680028   693 consensus_queue.cc:1048] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:13:06.716033 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:06.716809 29528 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:13:06.719211 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:06.720330 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:06.720816   887 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:06.720999 29456 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:06.728814 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:06.730242 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:06.694101 29452 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:06.653658   715 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:06.730962 29523 raft_consensus.cc:2468] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 8.
I20260709 13:13:06.736958 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:06.742697 29456 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
W20260709 13:13:06.749356 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:06.751576 29377 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
I20260709 13:13:06.751982 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:06.725865   918 log.cc:927] Time spent T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:13:06.758512 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:06.761055 29448 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:06.754158 29421 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:06.767392 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:06.766290 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:06.768671 29375 raft_consensus.cc:2393] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 11: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:06.768785 29456 raft_consensus.cc:2393] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 13: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:13:06.770905 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 127263us
I20260709 13:13:06.787310 29419 leader_election.cc:400] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 12. Current term is 13.
I20260709 13:13:06.791867 29419 leader_election.cc:403] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:06.770615   887 raft_consensus.cc:2804] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:13:06.796545 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 60001.6us
W20260709 13:13:06.809973 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 131213us
W20260709 13:13:06.813134 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 52614.3us
I20260709 13:13:06.818048   932 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:06.818806   932 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:06.820281   885 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 12. Current term is 13.
I20260709 13:13:06.821094   885 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:06.821625   885 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:06.822484   932 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:06.828852 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 54525.8us
I20260709 13:13:06.829082 29419 leader_election.cc:400] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 11. Current term is 12.
I20260709 13:13:06.829566 29419 leader_election.cc:403] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:06.831796 29528 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 12.
I20260709 13:13:06.832379 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:06.797201   925 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.831341 29452 raft_consensus.cc:2468] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:13:06.835683 29456 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
I20260709 13:13:06.798233   887 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:06.808173   924 raft_consensus.cc:493] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
W20260709 13:13:06.830933   930 log.cc:927] Time spent T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:13:06.836504 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:06.849131 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:06.842423 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:06.850021 29530 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 14.
I20260709 13:13:06.853536   939 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:06.853749 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:06.854224   939 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:06.854753 29529 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:06.856613 29421 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:06.858331   912 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:06.859071 29421 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:06.866565   889 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:06.866987   889 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:06.867345   889 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:06.867448 29454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45798 (request call id 2333) took 1075 ms. Trace:
I20260709 13:13:06.868305 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:06.869263 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:06.869874 29449 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:06.870078 30119 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:06.870515   937 log.cc:927] Time spent T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:13:06.871770   933 log.cc:927] Time spent T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:13:06.873386 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:06.874104 29447 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
I20260709 13:13:06.877069 29453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45796 (request call id 1474) took 1490 ms. Trace:
I20260709 13:13:06.863338 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:06.877679 29453 rpcz_store.cc:276] 0709 13:13:05.386548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.628168 (+241620us) service_pool.cc:224] Handling call
0709 13:13:06.876874 (+1248706us) spinlock_profiling.cc:243] Waited 28.7 ms on lock 0x7b54000c26d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:06.877007 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66018688}
I20260709 13:13:06.878515 29456 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 8.
I20260709 13:13:06.863168   885 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:06.879467 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:06.849102   856 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:13:06.879267 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:06.881786 29456 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:13:06.659400 29451 rpcz_store.cc:276] 0709 13:13:05.270220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.295808 (+ 25588us) service_pool.cc:224] Handling call
0709 13:13:06.440213 (+1144405us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b5800193598. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61b71 00007f6a78c61a22 00007f6a81b7ac09 00007f6a80cd4ee0 00007f6a80d9e0ab 00007f6a80d9e131 00007f6a80d5ffc0 00007f6a80d4a929 00007f6a80d4a3d2 00007f6a7a2c1bd4
0709 13:13:06.440461 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:06.443699 (+  3238us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:13:06.461538 (+ 17839us) log.cc:844] Serialized 14 byte log entry
0709 13:13:06.652426 (+190888us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:06.652498 (+    72us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:06.652563 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:06.652655 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:06.652798 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":26856,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":38,"raft.queue_time_us":109,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":3657,"spinlock_wait_cycles":3162880,"thread_start_us":137520,"threads_started":1}
I20260709 13:13:06.882359 29453 raft_consensus.cc:2410] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 13 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:13:06.882772 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:06.882969 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:06.885146   832 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:06.888530   848 consensus_meta.cc:287] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.657s	user 0.013s	sys 0.000s
I20260709 13:13:06.889025   848 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:06.891114   848 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:06.836102   917 consensus_queue.cc:1048] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:13:06.902827 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:06.903860 29452 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:06.875350 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:06.865072 29530 raft_consensus.cc:1275] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:13:06.896919 29421 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:06.868006 29454 rpcz_store.cc:276] 0709 13:13:05.792571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.818917 (+ 26346us) service_pool.cc:224] Handling call
0709 13:13:06.867213 (+1048296us) spinlock_profiling.cc:243] Waited 799 ms on lock 0x7b5400261e54. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:06.867365 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1838846720}
I20260709 13:13:06.917938 29529 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
I20260709 13:13:06.862123 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:06.921116 29528 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:06.864308   928 consensus_queue.cc:1048] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:13:06.846856   887 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:13:06.935771 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:06.906028 29447 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
W20260709 13:13:06.865501   860 consensus_meta.cc:287] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.630s	user 0.010s	sys 0.003s
W20260709 13:13:06.877099   867 log.cc:927] Time spent T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 1.508s	user 0.003s	sys 0.006s
I20260709 13:13:06.931391 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:06.863767 30158 raft_consensus.cc:2955] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 4 to 5, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:13:06.944074 29449 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
I20260709 13:13:06.943993 29448 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
I20260709 13:13:06.946643 29525 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
W20260709 13:13:06.950304 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 69425.8us
I20260709 13:13:06.856614   939 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:06.954289 29449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 350) took 1171 ms. Trace:
I20260709 13:13:06.952108 29448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 351) took 1169 ms. Trace:
I20260709 13:13:06.860077   715 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:06.955375 29346 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:06.956126 29530 raft_consensus.cc:1275] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:13:06.957001 29530 pending_rounds.cc:85] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 5
I20260709 13:13:06.955125 29448 rpcz_store.cc:276] 0709 13:13:05.782829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.950818 (+1167989us) service_pool.cc:224] Handling call
0709 13:13:06.951405 (+   587us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:06.951647 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:06.951677 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:06.951725 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:06.951755 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:06.951813 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:06.951924 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:06.959558 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 107661us
W20260709 13:13:06.963721 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 49044us
I20260709 13:13:06.954691 29449 rpcz_store.cc:276] 0709 13:13:05.782532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.952496 (+1169964us) service_pool.cc:224] Handling call
0709 13:13:06.953767 (+  1271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:06.953961 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:06.953990 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:06.954040 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:06.954075 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:06.954131 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:06.954232 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:06.967712 29421 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:06.938843   893 raft_consensus.cc:2749] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:06.846632   925 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:06.957336 29530 pending_rounds.cc:107] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:13:06.979647 29530 raft_consensus.cc:2889] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:06.980480 29528 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
I20260709 13:13:06.971330 29448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 352) took 1188 ms. Trace:
I20260709 13:13:06.971892 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:06.981423 29449 raft_consensus.cc:1275] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:06.982214 29449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2335) took 1147 ms. Trace:
I20260709 13:13:06.988564   680 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:06.990331 29346 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:06.895850   924 raft_consensus.cc:515] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:06.982517 29448 rpcz_store.cc:276] 0709 13:13:05.783108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.957801 (+1174693us) service_pool.cc:224] Handling call
0709 13:13:06.970796 (+ 12995us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:06.970997 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:06.971030 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:06.971070 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:06.971103 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:06.971152 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:06.971261 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:07.002039 29449 rpcz_store.cc:276] 0709 13:13:05.834508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.966587 (+1132079us) service_pool.cc:224] Handling call
0709 13:13:06.967002 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:06.981930 (+ 14928us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:06.982157 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:07.002650 29421 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:07.015599 29530 raft_consensus.cc:1275] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:13:07.010248 29452 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:13:06.950840   860 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:06.981127   945 raft_consensus.cc:2749] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:06.978201   848 consensus_queue.cc:1048] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:13:06.983861   727 consensus_queue.cc:1048] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:13:07.034786 29526 raft_consensus.cc:1240] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:06.983570   785 consensus_queue.cc:1048] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
W20260709 13:13:07.039806   934 log.cc:927] Time spent T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:13:06.992055   847 consensus_queue.cc:1048] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:13:07.046636 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:07.027652   693 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:07.025686 29525 raft_consensus.cc:2955] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 4 to 5, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
W20260709 13:13:07.047250 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 72473.2us
I20260709 13:13:07.049350 29521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53428 (request call id 596) took 1980 ms. Trace:
I20260709 13:13:07.035313   893 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:07.035677   885 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.057945   871 raft_consensus.cc:2955] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Committing config change with OpId 5.5: config changed from index 4 to 5, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:13:07.047889   947 consensus_queue.cc:1048] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
W20260709 13:13:07.066015 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 75767.1us
I20260709 13:13:07.052595 29521 rpcz_store.cc:276] 0709 13:13:05.061278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.061494 (+   216us) service_pool.cc:224] Handling call
0709 13:13:05.061846 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:05.062281 (+   435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:05.062311 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:05.062864 (+   553us) log.cc:844] Serialized 26 byte log entry
0709 13:13:05.269978 (+207114us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:05.270023 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:05.270091 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:06.775703 (+1505612us) spinlock_profiling.cc:243] Waited 6.98 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:13:07.030871 (+255168us) raft_consensus.cc:1685] finished
0709 13:13:07.030894 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:07.040974 (+ 10080us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":131,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":118,"spinlock_wait_cycles":16045952,"thread_start_us":206658,"threads_started":1,"wal-append.queue_time_us":267425}
I20260709 13:13:07.076483 29346 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:07.067478   888 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:07.067781 30154 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54234 (request call id 197) took 1095 ms. Trace:
W20260709 13:13:07.068149 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 65597.5us
I20260709 13:13:07.085572 29421 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:07.069497   856 raft_consensus.cc:2749] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 11. Current term is 12.
I20260709 13:13:07.072506   925 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:07.080176 29344 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:07.084364 29523 raft_consensus.cc:1275] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:07.115423 29344 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:07.128216   935 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:07.129006   935 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:07.129678   935 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:07.129729 29346 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:07.128881 29421 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:07.084246   860 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:07.137909 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 85064.8us
I20260709 13:13:07.135866 29344 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:07.116802   945 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:07.118695   888 raft_consensus.cc:2749] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:07.159286 29344 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:07.084024   885 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:07.084887 30154 rpcz_store.cc:276] 0709 13:13:05.973582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.983877 (+ 10295us) service_pool.cc:224] Handling call
0709 13:13:06.089261 (+105384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:06.261896 (+172635us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:06.265588 (+  3692us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:06.419655 (+154067us) log.cc:844] Serialized 572 byte log entry
0709 13:13:06.735931 (+316276us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:06.745749 (+  9818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:06.765128 (+ 19379us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:07.067462 (+302334us) raft_consensus.cc:1685] finished
0709 13:13:07.067529 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:07.067703 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":313292,"threads_started":1,"wal-append.queue_time_us":408418}
I20260709 13:13:07.138746   893 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:07.130911   856 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.192726   872 consensus_queue.cc:1048] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:07.137643   701 raft_consensus.cc:2804] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:07.158481   832 raft_consensus.cc:2749] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:07.122359   877 consensus_queue.cc:1048] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:13:07.224958 29455 raft_consensus.cc:1275] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:13:07.173622   866 raft_consensus.cc:2804] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:07.229197   785 consensus_queue.cc:1048] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
W20260709 13:13:07.234917   891 log.cc:927] Time spent T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 1.355s	user 0.003s	sys 0.004s
W20260709 13:13:07.235649 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 61226.5us
I20260709 13:13:07.236604 29421 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:07.238230 29421 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:07.197019   779 raft_consensus.cc:2804] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:13:07.241823 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:07.252379   924 leader_election.cc:290] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:07.256518   885 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:07.208591   893 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:13:07.280349 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 51684.6us
W20260709 13:13:07.280576 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 98852us
W20260709 13:13:07.288348 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 167348us
I20260709 13:13:07.289253 29346 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:07.240782   866 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:07.262465   701 raft_consensus.cc:697] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:07.324244 29346 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:07.286428   893 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:07.228237   856 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:07.289674   885 raft_consensus.cc:2804] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:07.286011   888 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:07.298004   938 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:07.287635   779 raft_consensus.cc:697] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:07.300081   866 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:07.301385   785 consensus_queue.cc:1048] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:13:07.347734   779 consensus_queue.cc:237] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:07.330016   889 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:07.321981   876 consensus_queue.cc:1048] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:13:07.350859   889 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:07.331951 29346 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:07.353284 29454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 349) took 1571 ms. Trace:
I20260709 13:13:07.354557 29453 raft_consensus.cc:1240] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:07.301738   727 consensus_queue.cc:1048] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:13:07.355536   848 consensus_queue.cc:1048] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:07.328132   945 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:07.343299   917 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:07.357090   945 raft_consensus.cc:2749] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:13:07.323082   949 log.cc:927] Time spent T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:13:07.374672 29452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2351) took 1141 ms. Trace:
I20260709 13:13:07.375074   935 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:07.375240 29452 rpcz_store.cc:276] 0709 13:13:06.232997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.026321 (+793324us) service_pool.cc:224] Handling call
0709 13:13:07.026758 (+   437us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:07.094254 (+ 67496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:07.095459 (+  1205us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:07.096140 (+   681us) log.cc:844] Serialized 26 byte log entry
0709 13:13:07.285959 (+189819us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:07.324068 (+ 38109us) log.cc:844] Serialized 14 byte log entry
0709 13:13:07.324359 (+   291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:07.324471 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:07.374420 (+ 49949us) raft_consensus.cc:1685] finished
0709 13:13:07.374443 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:07.374599 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":40990,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":32593,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":223,"thread_start_us":137872,"threads_started":1,"wal-append.queue_time_us":250771}
I20260709 13:13:07.377386   935 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:07.377801 29452 raft_consensus.cc:1275] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:13:07.353750 29454 rpcz_store.cc:276] 0709 13:13:05.781976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.950133 (+1168157us) service_pool.cc:224] Handling call
0709 13:13:06.962602 (+ 12469us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:06.963004 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:06.963038 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:06.976386 (+ 13348us) log.cc:844] Serialized 26 byte log entry
0709 13:13:07.159073 (+182687us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:07.159118 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:07.159524 (+   406us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:07.353043 (+193519us) raft_consensus.cc:1685] finished
0709 13:13:07.353068 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:07.353216 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5632,"raft.queue_time_us":218,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":12577,"thread_start_us":170626,"threads_started":1,"wal-append.queue_time_us":299714}
I20260709 13:13:07.354329 29346 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:07.357430   917 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:07.433343 29449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2353) took 1064 ms. Trace:
I20260709 13:13:07.431123 29523 raft_consensus.cc:1275] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:13:07.396328 29495 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:07.379402 29452 raft_consensus.cc:1275] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:07.392287 29455 raft_consensus.cc:1275] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:13:07.457311 29455 pending_rounds.cc:85] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 7
I20260709 13:13:07.457697 29455 pending_rounds.cc:107] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:13:07.458020 29455 raft_consensus.cc:2889] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:07.438004 29454 raft_consensus.cc:1275] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:13:07.459365 29452 raft_consensus.cc:1275] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:13:07.459653 29454 pending_rounds.cc:85] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 4
I20260709 13:13:07.460040 29454 pending_rounds.cc:107] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:13:07.460285 29454 raft_consensus.cc:2889] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:07.466495 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 112220us
I20260709 13:13:07.340423   939 raft_consensus.cc:2749] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:07.470891 29451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2356) took 1058 ms. Trace:
I20260709 13:13:07.477497 29451 rpcz_store.cc:276] 0709 13:13:06.412502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.073242 (+660740us) service_pool.cc:224] Handling call
0709 13:13:07.073606 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:07.073884 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:07.073907 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:07.074472 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 13:13:07.130961 (+ 56489us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:07.275193 (+144232us) log.cc:844] Serialized 14 byte log entry
0709 13:13:07.469773 (+194580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:07.469880 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:07.470694 (+   814us) raft_consensus.cc:1685] finished
0709 13:13:07.470712 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:07.470834 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":126309,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":45203,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":15350,"thread_start_us":372422,"threads_started":3,"wal-append.queue_time_us":177400}
I20260709 13:13:07.455807 29449 rpcz_store.cc:276] 0709 13:13:06.369013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.060419 (+691406us) service_pool.cc:224] Handling call
0709 13:13:07.172990 (+112571us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:07.173313 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:13:07.279070 (+105757us) log.cc:844] Serialized 14 byte log entry
0709 13:13:07.432891 (+153821us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:07.432961 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:07.433020 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:07.433113 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:07.433267 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":298,"prepare.queue_time_us":84262,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":53,"raft.queue_time_us":3286,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":29387,"thread_start_us":217508,"threads_started":2}
I20260709 13:13:07.420493   687 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:07.340624   888 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:07.415333   885 raft_consensus.cc:697] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 8 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:07.501147 29346 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:07.502393 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 106225us
I20260709 13:13:07.503556 29495 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:07.504487 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:07.505419 29529 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:13:07.507102 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 268947us
I20260709 13:13:07.508813 29421 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:07.470170   935 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:07.330370   832 consensus_queue.cc:1048] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.141s
I20260709 13:13:07.512095 29421 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:07.438530   866 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:07.549494 29495 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.654s (SENT) [suppressed 27 similar messages]
I20260709 13:13:07.550799 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:07.551822 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:07.552528 29451 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:13:07.556319 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 44344.1us
I20260709 13:13:07.557610   889 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:07.517490   970 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:07.558589   970 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:07.559019   970 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:07.560066 29421 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:07.560969   968 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:07.561528   968 raft_consensus.cc:697] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 11 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:07.562484   968 consensus_queue.cc:237] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:07.564208   964 log.cc:927] Time spent T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:13:07.566663 29450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2357) took 1153 ms. Trace:
I20260709 13:13:07.512715   951 raft_consensus.cc:2749] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:13:07.502533   888 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:07.567050 29450 rpcz_store.cc:276] 0709 13:13:06.412777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.133280 (+720503us) service_pool.cc:224] Handling call
0709 13:13:07.133775 (+   495us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:07.162914 (+ 29139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:07.162964 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:07.163782 (+   818us) log.cc:844] Serialized 26 byte log entry
0709 13:13:07.224213 (+ 60431us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:07.537464 (+313251us) log.cc:844] Serialized 14 byte log entry
0709 13:13:07.559298 (+ 21834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:07.559383 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:07.566389 (+  7006us) raft_consensus.cc:1685] finished
0709 13:13:07.566413 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:07.566594 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14793,"prepare.queue_time_us":33601,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":108910,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":29247,"thread_start_us":369659,"threads_started":3,"wal-append.queue_time_us":165991}
I20260709 13:13:07.569340 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:07.571163 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:07.558374   889 consensus_queue.cc:1048] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:07.573710 29449 raft_consensus.cc:2468] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
I20260709 13:13:07.510911   785 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:07.583344 29529 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:13:07.379998   701 consensus_queue.cc:237] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:07.598806 29421 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:07.592087   963 log.cc:927] Time spent T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
W20260709 13:13:07.593016 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 114489us
I20260709 13:13:07.602563 29346 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:07.604903 29344 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:07.608461 29421 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:07.538123   939 raft_consensus.cc:2749] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:07.614988 29421 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:07.619380 29529 raft_consensus.cc:1275] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:13:07.643229   982 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:07.643872   982 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:07.644243   982 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:07.644826 29421 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:07.655067 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 105617us
W20260709 13:13:07.657590 29495 leader_election.cc:336] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.666s (SENT)
W20260709 13:13:07.654860 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 44656us
I20260709 13:13:07.658156 29495 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:07.661010 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:07.664376 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:07.615420   944 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:07.588733   877 consensus_queue.cc:1048] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:13:07.618103   872 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:07.627830   959 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:13:07.677266   963 log.cc:927] Time spent T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:13:07.695081 29529 raft_consensus.cc:1275] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:13:07.737321   715 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.738003   971 raft_consensus.cc:2804] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:07.738547   971 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:07.666139 29381 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:13:07.746495   917 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:07.695392   856 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:07.738941 29447 raft_consensus.cc:1275] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:13:07.686627   785 raft_consensus.cc:2749] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:13:07.753813 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 96257.3us
I20260709 13:13:07.746804   866 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:07.754899 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 110165us
I20260709 13:13:07.755185 29381 raft_consensus.cc:606] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:07.761801 29421 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:07.755451 29451 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
I20260709 13:13:07.783419 29421 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:07.785295 29421 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:07.786342 29421 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:07.738044   715 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:07.774240   889 raft_consensus.cc:2804] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:07.789664   889 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:07.790073   889 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:07.790520   715 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:07.794160   939 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:07.794762   939 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:07.797451   970 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:07.800809   970 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:07.801664   970 raft_consensus.cc:2804] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:07.806221   939 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:07.822918 29495 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:07.932602 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 109821us
I20260709 13:13:07.933740 29495 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:07.934870 29495 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:07.683840   885 consensus_queue.cc:237] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:07.762809   971 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:07.966759 29421 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:07.802196   970 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:07.825085   856 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:07.786394   912 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:07.787310   872 raft_consensus.cc:697] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:13:08.052459   680 consensus_meta.cc:287] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 1.034s	user 0.008s	sys 0.006s
I20260709 13:13:08.053766   781 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.057044 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:08.078554 29373 raft_consensus.cc:2368] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9.
I20260709 13:13:08.079742 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:08.058265 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:08.080924 29375 raft_consensus.cc:2376] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12. Re-sending same reply.
I20260709 13:13:07.787115   959 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:08.058746 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:08.060168 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:08.060897 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:08.070771   887 consensus_meta.cc:287] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 1.119s	user 0.015s	sys 0.000s
I20260709 13:13:07.968252   785 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:08.058876   892 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.063155 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:08.065168   982 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:08.068087 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:08.069941 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:08.107743 29528 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:08.071338 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:08.058843 29374 raft_consensus.cc:1275] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:13:07.970492   924 raft_consensus.cc:2804] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:08.112835   924 raft_consensus.cc:697] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:08.083815 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:08.070468   856 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:08.088235 29380 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
I20260709 13:13:08.061723 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:08.036188   832 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:08.103636 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:08.157164 29375 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:08.157416 29379 raft_consensus.cc:2410] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 13:13:08.009325   893 consensus_meta.cc:287] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.667s	user 0.012s	sys 0.000s
I20260709 13:13:08.071133   970 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:08.086967   963 log.cc:927] Time spent T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:13:08.083112   680 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:08.207127 29528 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:13:08.236646 29373 raft_consensus.cc:1275] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:13:08.237989 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:08.075435   877 consensus_queue.cc:1048] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.101s
I20260709 13:13:08.247018 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:08.105835   785 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:08.251166 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:08.156572   892 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:08.178503   856 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:08.114225   887 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:13:08.082820   436 consensus_queue.cc:1048] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.133s
I20260709 13:13:08.258728 29451 raft_consensus.cc:1275] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:13:08.274039 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:08.274757 29451 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:13:08.275797 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:08.276329 29451 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:08.278594   917 raft_consensus.cc:493] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:08.279695   680 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:08.280069   981 log.cc:927] Time spent T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 13:13:08.280224   680 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:08.282087 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:08.282738 29522 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:13:08.234930   832 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:08.287060   832 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:08.114794   935 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.260208 29447 raft_consensus.cc:1275] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:13:08.288722 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:08.290159 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:08.290779 29447 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:13:08.291751   935 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:08.258925 29379 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:08.294118 29455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2366) took 1878 ms. Trace:
I20260709 13:13:08.262596 29375 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
I20260709 13:13:08.279357   917 raft_consensus.cc:515] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:08.294749 29455 rpcz_store.cc:276] 0709 13:13:06.415475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.264138 (+848663us) service_pool.cc:224] Handling call
0709 13:13:07.285643 (+ 21505us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:07.458564 (+172921us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:08.293774 (+835210us) spinlock_profiling.cc:243] Waited 95 ms on lock 0x7b5400261e54. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:08.294032 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":218425216}
I20260709 13:13:08.296413 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:08.297441   917 leader_election.cc:290] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:08.298092 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:08.297012 29455 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:13:08.087363   781 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:08.262034 29450 consensus_meta.cc:287] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.690s	user 0.011s	sys 0.000s
I20260709 13:13:08.302098 29450 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
I20260709 13:13:08.302928 29526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2884) took 1922 ms. Trace:
I20260709 13:13:08.304694 29450 raft_consensus.cc:1275] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:13:08.311976 29419 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:08.318842 29419 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:13:08.320770   889 consensus_meta.cc:287] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.530s	user 0.013s	sys 0.000s
I20260709 13:13:08.320638 29451 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:13:08.321599 29450 raft_consensus.cc:1275] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:13:08.236351   936 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:08.295238   935 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:08.326074 29447 raft_consensus.cc:1275] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:13:08.327579 29419 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:08.303555 29526 rpcz_store.cc:276] 0709 13:13:06.380340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.380563 (+   223us) service_pool.cc:224] Handling call
0709 13:13:06.401115 (+ 20552us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:07.035272 (+634157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:08.302589 (+1267317us) spinlock_profiling.cc:243] Waited 633 ms on lock 0x7b54002e36d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:08.302839 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1456896768}
I20260709 13:13:08.332648 29448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2354) took 1920 ms. Trace:
I20260709 13:13:08.333252 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:08.264490   785 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:08.243937   983 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:08.341476 29456 raft_consensus.cc:2393] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 11: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:08.337127 29448 rpcz_store.cc:276] 0709 13:13:06.411851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.071858 (+660007us) service_pool.cc:224] Handling call
0709 13:13:07.072412 (+   554us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:07.072946 (+   534us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:13:07.159794 (+ 86848us) log.cc:844] Serialized 14 byte log entry
0709 13:13:07.325637 (+165843us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:07.331858 (+  6221us) log.cc:844] Serialized 26 byte log entry
0709 13:13:07.332088 (+   230us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:07.341973 (+  9885us) log.cc:844] Serialized 14 byte log entry
0709 13:13:07.445600 (+103627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:07.445720 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:08.332382 (+886662us) raft_consensus.cc:1685] finished
0709 13:13:08.332412 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:08.332572 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23166,"prepare.queue_time_us":156117,"prepare.run_cpu_time_us":152,"prepare.run_wall_time_us":17226,"raft.queue_time_us":48141,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":5730,"thread_start_us":342701,"threads_started":3,"wal-append.queue_time_us":278350}
I20260709 13:13:08.345644 29450 raft_consensus.cc:1275] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:13:08.238080   893 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:08.374732   701 raft_consensus.cc:493] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:08.375277   893 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:08.371263   969 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:08.376251 29344 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:08.376972   887 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:08.376745   969 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:08.377462 29344 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:08.377962   832 raft_consensus.cc:2804] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:08.378153   781 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:08.378796   781 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:08.379069   969 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:08.379155   781 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:08.379539   892 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:08.379675   781 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:08.380355   832 raft_consensus.cc:697] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:08.381423   832 consensus_queue.cc:237] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:08.384603   778 consensus_queue.cc:1059] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:08.385757   935 raft_consensus.cc:3055] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:08.386121   935 raft_consensus.cc:740] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:08.393852 29379 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
I20260709 13:13:08.345435   912 raft_consensus.cc:2749] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:08.387085   935 consensus_queue.cc:260] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:08.192319   924 consensus_queue.cc:237] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:08.344403   983 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:08.339999   889 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:08.421132   935 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:08.395248   959 raft_consensus.cc:2804] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:08.443776   959 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting leader election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:08.444482   959 raft_consensus.cc:3060] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:08.388825   701 raft_consensus.cc:515] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:08.448242   701 leader_election.cc:290] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:08.433008   982 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:08.333611   872 consensus_queue.cc:237] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:08.343559   936 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:08.410051   983 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:08.436187   680 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:08.395691   968 raft_consensus.cc:2804] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:09.214334   968 raft_consensus.cc:697] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 12 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
W20260709 13:13:08.656862   986 log.cc:927] Time spent T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.054s	user 0.000s	sys 0.002s
I20260709 13:13:08.663570   983 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:09.215474   968 consensus_queue.cc:237] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:09.217628   983 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:08.668220   985 log.cc:927] Time spent T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.087s	user 0.000s	sys 0.002s
W20260709 13:13:08.670001   995 log.cc:927] Time spent T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
W20260709 13:13:08.668124   990 log.cc:927] Time spent T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:13:08.686985 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:08.694301 29529 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.038s	sys 0.046s
I20260709 13:13:08.750941 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:09.221508 29529 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.184s	user 0.039s	sys 0.046s
I20260709 13:13:08.867347   982 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
W20260709 13:13:08.874148   715 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.016s	sys 0.027s
W20260709 13:13:08.460736   848 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.044s	sys 0.090s
W20260709 13:13:08.883750 29421 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.845s	user 0.000s	sys 0.024s
W20260709 13:13:09.240008 29421 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.201s	user 0.000s	sys 0.025s
W20260709 13:13:08.914980 30119 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.031s	sys 0.036s
W20260709 13:13:08.916041 29346 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.012s	sys 0.010s
I20260709 13:13:08.924664   999 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:13:08.952015 29526 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.001s	sys 0.018s
W20260709 13:13:09.241055 29526 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.867s	user 0.001s	sys 0.018s
I20260709 13:13:09.241852 29526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2927) took 1134 ms. Trace:
I20260709 13:13:09.242213 29526 rpcz_store.cc:276] 0709 13:13:08.107170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.337323 (+230153us) service_pool.cc:224] Handling call
0709 13:13:08.352518 (+ 15195us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:08.353068 (+   550us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:08.353111 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:08.358257 (+  5146us) log.cc:844] Serialized 26 byte log entry
0709 13:13:09.241465 (+883208us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:09.241511 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.241588 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:09.241630 (+    42us) raft_consensus.cc:1685] finished
0709 13:13:09.241643 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.241793 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2814,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":13828,"thread_start_us":867411,"threads_started":1,"wal-append.queue_time_us":293374}
W20260709 13:13:08.954332   832 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.000s	sys 0.033s
W20260709 13:13:09.244344   832 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.000s	sys 0.034s
W20260709 13:13:08.970758   781 consensus_meta.cc:287] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.590s	user 0.006s	sys 0.008s
I20260709 13:13:08.993592   936 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:09.247557   999 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:09.248201 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:09.249341 29522 raft_consensus.cc:2468] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 2.
I20260709 13:13:09.249927   999 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:08.997234   888 consensus_meta.cc:287] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 1.428s	user 0.014s	sys 0.004s
W20260709 13:13:09.013573   892 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.004s	sys 0.021s
W20260709 13:13:09.016294   935 consensus_meta.cc:287] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.594s	user 0.011s	sys 0.003s
I20260709 13:13:09.021876 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:09.253450   888 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:09.255338 29521 raft_consensus.cc:1275] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:13:09.255858   888 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:09.256640 29449 raft_consensus.cc:1240] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 13. Current term is 14. Ops: []
W20260709 13:13:09.062080   885 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.009s	user 0.024s	sys 0.026s
W20260709 13:13:09.253415   892 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.872s	user 0.004s	sys 0.021s
W20260709 13:13:09.257171   885 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.205s	user 0.024s	sys 0.026s
I20260709 13:13:09.071604   680 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:09.222946   982 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:09.257954   680 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:09.259949   982 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:08.496184   970 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:09.084065 29376 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.011s	sys 0.006s
I20260709 13:13:09.086434 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:09.088541   971 consensus_meta.cc:287] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 1.014s	user 0.010s	sys 0.004s
W20260709 13:13:09.088744 29373 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.837s	user 0.002s	sys 0.020s
W20260709 13:13:09.279707 29373 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.028s	user 0.003s	sys 0.021s
I20260709 13:13:09.281039 29373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1387) took 1206 ms. Trace:
W20260709 13:13:09.093837   924 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.028s	sys 0.007s
I20260709 13:13:09.099526 29525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2918) took 1661 ms. Trace:
I20260709 13:13:09.103087 29379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1392) took 1023 ms. Trace:
I20260709 13:13:09.104084 29374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1393) took 1023 ms. Trace:
I20260709 13:13:09.123914 29454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 1480) took 2335 ms. Trace:
I20260709 13:13:09.125900 29453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 1472) took 3767 ms. Trace:
I20260709 13:13:09.291656 29453 rpcz_store.cc:276] 0709 13:13:05.358790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.882955 (+1524165us) service_pool.cc:224] Handling call
0709 13:13:06.883236 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:07.354982 (+471746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.125594 (+1770612us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b54000190d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:09.125795 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1083353344}
W20260709 13:13:09.131763 29456 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45798 (request call id 2375) took 2454 ms (client timeout 3085 ms). Trace:
W20260709 13:13:09.148007 29419 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.804s	user 0.009s	sys 0.002s
W20260709 13:13:09.293949 29419 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.951s	user 0.010s	sys 0.003s
W20260709 13:13:09.149946 29527 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.906s	user 0.004s	sys 0.012s
W20260709 13:13:09.294668 29527 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.051s	user 0.004s	sys 0.013s
W20260709 13:13:09.150560   940 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.020s	sys 0.010s
W20260709 13:13:09.151786 29375 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.854s	user 0.007s	sys 0.021s
W20260709 13:13:09.157629   959 consensus_meta.cc:287] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.713s	user 0.008s	sys 0.007s
I20260709 13:13:09.157925 29530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2929) took 1002 ms. Trace:
I20260709 13:13:09.289495 29374 rpcz_store.cc:276] 0709 13:13:08.080468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.042400 (+961932us) service_pool.cc:224] Handling call
0709 13:13:09.042943 (+   543us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:09.066634 (+ 23691us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:09.066673 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:09.067295 (+   622us) log.cc:844] Serialized 26 byte log entry
0709 13:13:09.084924 (+ 17629us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:09.091144 (+  6220us) log.cc:844] Serialized 14 byte log entry
0709 13:13:09.091421 (+   277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.091553 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:09.103855 (+ 12302us) raft_consensus.cc:1685] finished
0709 13:13:09.103879 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.104019 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23155,"prepare.queue_time_us":5324,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":24900,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":197,"thread_start_us":22848,"threads_started":2,"wal-append.queue_time_us":16793}
I20260709 13:13:09.170600   889 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:09.301744 29530 rpcz_store.cc:276] 0709 13:13:08.155587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.156847 (+1001260us) service_pool.cc:224] Handling call
0709 13:13:09.157298 (+   451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:09.157534 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:09.157566 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:09.157615 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:09.157659 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.157718 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.157857 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:09.182081   969 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:09.183874   987 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:09.184461   951 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:09.187584   928 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:13:09.188094 30121 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.897s	user 0.013s	sys 0.018s
W20260709 13:13:09.188222 29381 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.837s	user 0.002s	sys 0.017s
W20260709 13:13:09.309509 29381 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.959s	user 0.003s	sys 0.017s
I20260709 13:13:09.190708   917 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:09.222234 29529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2920) took 1639 ms. Trace:
W20260709 13:13:09.243956 29346 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.962s	user 0.012s	sys 0.010s
I20260709 13:13:09.260375   680 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:09.310599 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 1.20495e+06us
I20260709 13:13:09.246348   939 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:13:09.244446 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 1.27775e+06us
W20260709 13:13:09.243252 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:09.315990 29421 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:09.245748 29452 raft_consensus.cc:1240] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 10. Current term is 11. Ops: []
W20260709 13:13:09.246681 30119 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.968s	user 0.031s	sys 0.037s
W20260709 13:13:09.317744 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 1.0396e+06us
I20260709 13:13:09.246552   781 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:09.237605   715 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.954s	user 0.017s	sys 0.028s
W20260709 13:13:09.239935   848 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.447s	user 0.048s	sys 0.090s
I20260709 13:13:09.329820   781 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:09.334136 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:09.334594 29449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 1485) took 1785 ms. Trace:
I20260709 13:13:09.223142   727 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:09.341862   727 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:09.342623   727 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:13:09.026537 29495 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.086s	user 0.054s	sys 0.069s
I20260709 13:13:09.346531   701 consensus_queue.cc:1048] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:13:09.346601 29495 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.406s	user 0.054s	sys 0.070s
I20260709 13:13:09.348611 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
W20260709 13:13:09.284538 29376 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.911s	user 0.011s	sys 0.011s
I20260709 13:13:09.283656 29524 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:13:09.349952 29452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 1479) took 2585 ms. Trace:
I20260709 13:13:09.350351 29452 rpcz_store.cc:276] 0709 13:13:06.764543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.469911 (+705368us) service_pool.cc:224] Handling call
0709 13:13:09.245493 (+1775582us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:09.317182 (+ 71689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.349697 (+ 32515us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b54000c2bd0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd858ad 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:09.349873 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4075804032}
I20260709 13:13:09.351212   687 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:09.351454 29524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53428 (request call id 609) took 1076 ms. Trace:
I20260709 13:13:09.351907 29524 rpcz_store.cc:276] 0709 13:13:08.275100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.350499 (+1075399us) service_pool.cc:224] Handling call
0709 13:13:09.350831 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:09.351128 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:09.351156 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:09.351206 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:09.351237 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.351295 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.351399 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:09.352026   917 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:09.353757 29344 leader_election.cc:304] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:09.290781 29454 rpcz_store.cc:276] 0709 13:13:06.788541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.472813 (+684272us) service_pool.cc:224] Handling call
0709 13:13:07.513692 (+ 40879us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:07.514020 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:13:07.572890 (+ 58870us) log.cc:844] Serialized 14 byte log entry
0709 13:13:08.958593 (+1385703us) spinlock_profiling.cc:243] Waited 7.42 ms on lock 0x7b18003acea0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c993f3 00007f6a78c9b7c1 00007f6a78c9b779 00007f6a78c9b709 00007f6a78c9b6d1 00007f6a78c9a9cd 000000000038f354 000000000038f199 00007f6a78c7c83a
0709 13:13:09.122998 (+164405us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b18003acea0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a7b92e4bc 00007f6a78c7c48b 00007f6a81ad6ab9 00007f6a78c9869b 00007f6a78c9693f 00007f6a78c98c02 00007f6a7b92020b 00007f6a7b925d23 00007f6a7b92623a
0709 13:13:09.123356 (+   358us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:09.123418 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:09.123484 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.123615 (+   131us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.123819 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23469,"prepare.queue_time_us":59027,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":108,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":96,"spinlock_wait_cycles":22998656,"thread_start_us":82106,"threads_started":1,"wal-append.queue_time_us":75226}
I20260709 13:13:09.297346 29527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2922) took 1229 ms. Trace:
W20260709 13:13:09.298998 29375 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.001s	user 0.008s	sys 0.022s
I20260709 13:13:09.356091 29521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2934) took 1087 ms. Trace:
W20260709 13:13:09.292963 29456 rpcz_store.cc:269] 0709 13:13:06.677386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.882498 (+205112us) service_pool.cc:224] Handling call
0709 13:13:09.131456 (+2248958us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b54000c2bd4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:09.131657 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3352690048}
W20260709 13:13:09.294267 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 951560us
I20260709 13:13:09.356467 29521 rpcz_store.cc:276] 0709 13:13:08.268628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.256261 (+987633us) service_pool.cc:224] Handling call
0709 13:13:09.256752 (+   491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:09.355145 (+ 98393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:09.355180 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:09.355223 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:09.355251 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.355855 (+   604us) spinlock_profiling.cc:243] Waited 98.2 ms on lock 0x7b54002e3bd4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:09.355899 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.356034 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":225779072}
I20260709 13:13:09.358413 29521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2936) took 1034 ms. Trace:
I20260709 13:13:09.297979   971 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:09.358745 29521 rpcz_store.cc:276] 0709 13:13:08.324436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.357592 (+1033156us) service_pool.cc:224] Handling call
0709 13:13:09.357907 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:09.358104 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:09.358128 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:09.358166 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:09.358196 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.358250 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.358361 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:09.361505   971 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:09.361720 29521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2937) took 1021 ms. Trace:
I20260709 13:13:09.362429 29378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1398) took 1254 ms. Trace:
I20260709 13:13:09.321632   928 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:09.363641 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:09.365334   936 raft_consensus.cc:2804] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:09.365957   936 raft_consensus.cc:493] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:09.366334   936 raft_consensus.cc:3060] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:09.362783 29378 rpcz_store.cc:276] 0709 13:13:08.085059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.182122 (+1097063us) service_pool.cc:224] Handling call
0709 13:13:09.182756 (+   634us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:09.185070 (+  2314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:09.185108 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:09.220225 (+ 35117us) log.cc:844] Serialized 52 byte log entry
0709 13:13:09.302961 (+ 82736us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:09.304403 (+  1442us) log.cc:844] Serialized 14 byte log entry
0709 13:13:09.304849 (+   446us) log.cc:844] Serialized 14 byte log entry
0709 13:13:09.338290 (+ 33441us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b18001b4720. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c13c0a 00007f6a82353219 00007f6a78c9ba40 00007f6a78c964e4 00007f6a78c96455 00007f6a7bd7e060 00007f6a7bd90716 00007f6a7bda1287 00007f6a7bda1208
0709 13:13:09.338561 (+   271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.338669 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:09.338851 (+   182us) raft_consensus.cc:1685] finished
0709 13:13:09.338874 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.339067 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30652,"prepare.queue_time_us":202,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":45158,"raft.run_cpu_time_us":435,"raft.run_wall_time_us":3434,"spinlock_wait_cycles":4961280,"thread_start_us":55083,"threads_started":1,"wal-append.queue_time_us":60504}
I20260709 13:13:09.367421   877 consensus_queue.cc:1048] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:09.355576 29527 rpcz_store.cc:276] 0709 13:13:08.068137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.068988 (+   851us) service_pool.cc:224] Handling call
0709 13:13:08.069296 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:08.076118 (+  6822us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:08.076157 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:08.105640 (+ 29483us) log.cc:844] Serialized 26 byte log entry
0709 13:13:09.295338 (+1189698us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:09.295478 (+   140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.297067 (+  1589us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:09.297116 (+    49us) raft_consensus.cc:1685] finished
0709 13:13:09.297129 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.297282 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16978,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":8701,"thread_start_us":1051626,"threads_started":1,"wal-append.queue_time_us":501730}
W20260709 13:13:09.371580   997 log.cc:927] Time spent T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
W20260709 13:13:09.373126   785 consensus_meta.cc:287] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 1.000s	user 0.011s	sys 0.003s
I20260709 13:13:09.373034   778 consensus_queue.cc:1048] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:09.373697   785 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:09.313048   987 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:09.376121   931 consensus_queue.cc:1048] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:09.377832   987 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:09.378441   872 consensus_queue.cc:1048] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:09.379781   871 consensus_queue.cc:1048] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:09.311439   969 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:09.385684   969 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:09.386679 29528 raft_consensus.cc:2393] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 11: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:09.375033   778 consensus_queue.cc:1048] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
W20260709 13:13:09.286728   924 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.028s	sys 0.007s
I20260709 13:13:09.310282 29529 rpcz_store.cc:276] 0709 13:13:07.583389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.732039 (+148650us) service_pool.cc:224] Handling call
0709 13:13:07.772753 (+ 40714us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:07.778346 (+  5593us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:07.778381 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:07.779608 (+  1227us) log.cc:844] Serialized 26 byte log entry
0709 13:13:09.221898 (+1442290us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:09.221930 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.222020 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:09.222062 (+    42us) raft_consensus.cc:1685] finished
0709 13:13:09.222074 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.222183 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4976,"raft.queue_time_us":6083,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":2587,"thread_start_us":1184487,"threads_started":1,"wal-append.queue_time_us":672443}
I20260709 13:13:09.305704   959 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:13:09.311771   940 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.924s	user 0.020s	sys 0.011s
I20260709 13:13:09.327284 29530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53428 (request call id 607) took 1052 ms. Trace:
I20260709 13:13:09.403971 29530 rpcz_store.cc:276] 0709 13:13:08.274535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.321235 (+1046700us) service_pool.cc:224] Handling call
0709 13:13:09.326758 (+  5523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:09.326951 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:09.326976 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:09.327022 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:09.327054 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.327109 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.327222 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:09.092986   856 consensus_meta.cc:287] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.766s	user 0.015s	sys 0.000s
W20260709 13:13:09.348665 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 1.40822e+06us
I20260709 13:13:09.281442 29373 rpcz_store.cc:276] 0709 13:13:08.074232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.247223 (+172991us) service_pool.cc:224] Handling call
0709 13:13:08.247625 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:08.250686 (+  3061us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:13:08.251140 (+   454us) log.cc:844] Serialized 14 byte log entry
0709 13:13:09.280498 (+1029358us) log.cc:844] Serialized 14 byte log entry
0709 13:13:09.280664 (+   166us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:09.280709 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:09.280750 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.280832 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.280975 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":921,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":53,"thread_start_us":1028662,"threads_started":1,"wal-append.queue_time_us":407507}
W20260709 13:13:09.408697 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 92835.3us
I20260709 13:13:09.409536 29421 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:09.412585 29495 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:09.420063 29495 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:09.355101   917 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:09.288197 29379 rpcz_store.cc:276] 0709 13:13:08.080154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.399520 (+319366us) service_pool.cc:224] Handling call
0709 13:13:08.402545 (+  3025us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:08.408353 (+  5808us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:08.408400 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:09.035233 (+626833us) log.cc:844] Serialized 26 byte log entry
0709 13:13:09.053610 (+ 18377us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:09.101363 (+ 47753us) log.cc:844] Serialized 14 byte log entry
0709 13:13:09.102691 (+  1328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.102785 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:09.102833 (+    48us) raft_consensus.cc:1685] finished
0709 13:13:09.102854 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.103016 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":36336,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":57,"raft.queue_time_us":217,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":4700,"thread_start_us":65085,"threads_started":2,"wal-append.queue_time_us":15671}
I20260709 13:13:09.388279   935 consensus_queue.cc:1048] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:09.365358   928 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:09.391171 29344 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:09.335129 29449 rpcz_store.cc:276] 0709 13:13:07.549399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.593726 (+ 44327us) service_pool.cc:224] Handling call
0709 13:13:07.594447 (+   721us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:09.257046 (+1662599us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.334227 (+ 77181us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b5400127354. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:09.334511 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3822260480}
I20260709 13:13:09.286895 29525 rpcz_store.cc:276] 0709 13:13:07.438243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:07.592384 (+154141us) service_pool.cc:224] Handling call
0709 13:13:07.592768 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:07.621313 (+ 28545us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:13:07.621596 (+   283us) log.cc:844] Serialized 14 byte log entry
0709 13:13:07.641644 (+ 20048us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:07.641705 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:07.641767 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:07.793195 (+151428us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b180005f080. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c99522 00007f6a78c9b7c1 00007f6a78c9b779 00007f6a78c9b709 00007f6a78c9b6d1 00007f6a78c9a9cd 000000000038f354 000000000038f199 00007f6a78c7c83a
0709 13:13:09.099134 (+1305939us) spinlock_profiling.cc:243] Waited 28.3 ms on lock 0x7b54000cb2d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:09.099207 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.099419 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22709,"prepare.queue_time_us":6495,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":60,"raft.queue_time_us":20273,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":18840,"spinlock_wait_cycles":70467200}
I20260709 13:13:09.362150 29521 rpcz_store.cc:276] 0709 13:13:08.340645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.360709 (+1020064us) service_pool.cc:224] Handling call
0709 13:13:09.361229 (+   520us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:09.361428 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:09.361454 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:09.361498 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:09.361528 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.361581 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.361666 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:09.399387 30121 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.109s	user 0.013s	sys 0.018s
I20260709 13:13:09.394937 29523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53428 (request call id 608) took 1120 ms. Trace:
I20260709 13:13:09.430289 29526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2930) took 1194 ms. Trace:
I20260709 13:13:09.440541 29526 rpcz_store.cc:276] 0709 13:13:08.235669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.243669 (+1008000us) service_pool.cc:224] Handling call
0709 13:13:09.244017 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:09.376751 (+132734us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:09.376789 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:09.376836 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:09.376878 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.429937 (+ 53059us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b54000a3f54. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:09.430011 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.430200 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":304749824}
I20260709 13:13:09.432957 29522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2932) took 1183 ms. Trace:
I20260709 13:13:09.443598 29522 rpcz_store.cc:276] 0709 13:13:08.249950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.250142 (+1000192us) service_pool.cc:224] Handling call
0709 13:13:09.250521 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:09.384888 (+134367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:09.384938 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:09.385002 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:09.385049 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.432662 (+ 47613us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b540019f354. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:09.432727 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.432884 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":308415872}
I20260709 13:13:09.447039 29374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 614) took 1158 ms. Trace:
I20260709 13:13:09.447930 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:09.447749 29374 rpcz_store.cc:276] 0709 13:13:08.288766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.410655 (+1121889us) service_pool.cc:224] Handling call
0709 13:13:09.446289 (+ 35634us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:09.446582 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:09.446621 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:09.446682 (+    61us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:09.446729 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.446807 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.446961 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:09.378501   987 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:09.439100 29523 rpcz_store.cc:276] 0709 13:13:08.274838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.394030 (+1119192us) service_pool.cc:224] Handling call
0709 13:13:09.394373 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:09.394599 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:09.394625 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:09.394668 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:09.394700 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.394753 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.394876 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:09.452064 29528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37968 (request call id 2926) took 1337 ms. Trace:
I20260709 13:13:09.465001 29528 rpcz_store.cc:276] 0709 13:13:08.086436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.237705 (+151269us) service_pool.cc:224] Handling call
0709 13:13:09.423746 (+1186041us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54000cb7d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:09.424158 (+   412us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2639631104}
I20260709 13:13:09.399680   932 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:09.481040 29379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 615) took 1191 ms. Trace:
I20260709 13:13:09.482988 29379 rpcz_store.cc:276] 0709 13:13:08.289218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.424816 (+1135598us) service_pool.cc:224] Handling call
0709 13:13:09.480523 (+ 55707us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:09.480709 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:09.480740 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:09.480782 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:09.480817 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.480876 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.480981 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:09.403273   889 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:09.431931   885 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:09.486624 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:09.415741   982 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:09.395735   939 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:09.491268 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 81811.6us
I20260709 13:13:09.508720 29421 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:09.351791   687 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:09.410782   781 consensus_queue.cc:1048] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:13:09.450435   999 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:09.312824   951 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:09.462877   680 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:09.419806   856 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:09.482702   785 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:09.537709 29421 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:09.541723 29421 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:09.544158 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 151001us
I20260709 13:13:09.497605   928 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:09.479283   971 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:09.547745 29421 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:09.550192 29346 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:09.553376 29379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 617) took 1262 ms. Trace:
W20260709 13:13:09.555538 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 134564us
I20260709 13:13:09.556416 29495 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:09.557343  1018 raft_consensus.cc:2804] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:09.557897  1018 raft_consensus.cc:697] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:09.480361   987 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:09.511094 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:09.553850 29379 rpcz_store.cc:276] 0709 13:13:08.290737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.522100 (+1231363us) service_pool.cc:224] Handling call
0709 13:13:09.552785 (+ 30685us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:09.553009 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:09.553037 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:09.553090 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:09.553124 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.553186 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.553311 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:09.514355   778 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:13:09.543742  1001 log.cc:927] Time spent T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:13:09.523851   999 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:13:09.566334 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 175059us
I20260709 13:13:09.531220   893 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:09.500356   924 consensus_queue.cc:1048] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:13:09.555280 29421 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:09.586086 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 85179.6us
W20260709 13:13:09.592147 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 52265.8us
W20260709 13:13:09.612306 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 57152.3us
I20260709 13:13:09.517452   982 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:09.561934   912 raft_consensus.cc:2804] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:09.492511   932 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:09.553812   888 raft_consensus.cc:2804] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:09.512571   885 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:09.615451 29526 raft_consensus.cc:1275] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:13:09.566867   983 raft_consensus.cc:2749] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:09.620545   701 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:13:09.617080 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 59106.7us
I20260709 13:13:09.575896   778 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:09.608604  1000 log.cc:927] Time spent T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:13:09.574839   928 raft_consensus.cc:697] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:09.610044   999 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:09.570760   785 consensus_queue.cc:1059] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:13:09.553148   680 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:09.611085   917 raft_consensus.cc:2804] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:09.612942   968 raft_consensus.cc:2749] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:09.568347   971 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:09.616464   912 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:09.678490   912 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:09.679253   893 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:09.680045   893 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:09.575136   969 consensus_queue.cc:1059] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:13:09.682447   893 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:09.683650 29310 debug-util.cc:398] Leaking SignalData structure 0x7b080003ad80 after lost signal to thread 28237
I20260709 13:13:09.684111   987 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:09.635671   970 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:09.684815   885 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:09.685026 29310 debug-util.cc:398] Leaking SignalData structure 0x7b080003b2e0 after lost signal to thread 29313
I20260709 13:13:09.685870   715 raft_consensus.cc:993] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5: : Instructing follower 183db85c071f489fbc8de63a9edd8a3a to start an election
I20260709 13:13:09.686546   706 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:09.686622   856 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:09.687417   706 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:09.559366  1018 consensus_queue.cc:237] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:09.692440  1021 consensus_queue.cc:1059] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:09.694095 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:09.695688 29527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2938) took 1321 ms. Trace:
I20260709 13:13:09.696077 29527 rpcz_store.cc:276] 0709 13:13:08.374371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.369253 (+994882us) service_pool.cc:224] Handling call
0709 13:13:09.369582 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:09.531027 (+161445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:09.531067 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:09.531615 (+   548us) log.cc:844] Serialized 26 byte log entry
0709 13:13:09.593301 (+ 61686us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:09.593402 (+   101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.593579 (+   177us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:09.695418 (+101839us) raft_consensus.cc:1685] finished
0709 13:13:09.695444 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.695623 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16311,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"thread_start_us":216472,"threads_started":2,"wal-append.queue_time_us":113118}
W20260709 13:13:09.649389  1017 log.cc:927] Time spent T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.323s	user 0.001s	sys 0.000s
I20260709 13:13:09.675979 29372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1394) took 1595 ms. Trace:
I20260709 13:13:09.676465   982 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:09.630610   888 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:09.634245   701 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:09.686582 29310 debug-util.cc:398] Leaking SignalData structure 0x7b080036ca60 after lost signal to thread 29405
I20260709 13:13:09.647051   778 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:09.699998 29524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2935) took 1391 ms. Trace:
I20260709 13:13:09.736621 29524 rpcz_store.cc:276] 0709 13:13:08.308351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.353177 (+1044826us) service_pool.cc:224] Handling call
0709 13:13:09.353474 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:09.560582 (+207108us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:09.560632 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:09.560694 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:09.560736 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.699673 (+138937us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b54000b63d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:09.699741 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.699922 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":448325888}
I20260709 13:13:09.652231 29376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1388) took 1563 ms. Trace:
I20260709 13:13:09.636965   848 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:13:09.728734 29310 debug-util.cc:398] Leaking SignalData structure 0x7b08002feea0 after lost signal to thread 29406
I20260709 13:13:09.633013   892 consensus_queue.cc:1048] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.080s
W20260709 13:13:09.740854 29310 debug-util.cc:398] Leaking SignalData structure 0x7b080031d360 after lost signal to thread 29480
W20260709 13:13:09.786162 29310 debug-util.cc:398] Leaking SignalData structure 0x7b0800372900 after lost signal to thread 29481
W20260709 13:13:09.787777 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 236364us
I20260709 13:13:09.709224 29372 rpcz_store.cc:276] 0709 13:13:08.080766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.104678 (+1023912us) service_pool.cc:224] Handling call
0709 13:13:09.105118 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:09.105517 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:09.105544 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:09.106073 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 13:13:09.479456 (+373383us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:09.479526 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.479630 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:09.675651 (+196021us) raft_consensus.cc:1685] finished
0709 13:13:09.675684 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.675879 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3870,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":105,"thread_start_us":372545,"threads_started":1,"wal-append.queue_time_us":468498}
I20260709 13:13:09.789232 29346 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:09.788076 29310 debug-util.cc:398] Leaking SignalData structure 0x7b08002a9880 after lost signal to thread 29554
I20260709 13:13:09.783723 29375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1389) took 1709 ms. Trace:
W20260709 13:13:09.790298 29310 debug-util.cc:398] Leaking SignalData structure 0x7b080025f9e0 after lost signal to thread 29555
W20260709 13:13:09.793432 29310 debug-util.cc:398] Leaking SignalData structure 0x7b08001ec580 after lost signal to thread 30182
W20260709 13:13:09.794375 29310 debug-util.cc:398] Leaking SignalData structure 0x7b0800145320 after lost signal to thread 30183
W20260709 13:13:09.794983 29310 debug-util.cc:398] Leaking SignalData structure 0x7b08003964e0 after lost signal to thread 693
W20260709 13:13:09.795431 29310 debug-util.cc:398] Leaking SignalData structure 0x7b08002fd260 after lost signal to thread 779
W20260709 13:13:09.795396 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 125291us
W20260709 13:13:09.797155 29310 debug-util.cc:398] Leaking SignalData structure 0x7b080039afc0 after lost signal to thread 866
W20260709 13:13:09.797719 29310 debug-util.cc:398] Leaking SignalData structure 0x7b08002f4180 after lost signal to thread 867
I20260709 13:13:09.797925 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:09.798354 29310 debug-util.cc:398] Leaking SignalData structure 0x7b0800310600 after lost signal to thread 891
I20260709 13:13:09.798828 29449 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 8.
I20260709 13:13:09.699729   706 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:09.789945 29381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1386) took 1717 ms. Trace:
I20260709 13:13:09.728084   888 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:09.738670   701 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:13:09.855635 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 220671us
I20260709 13:13:09.899830 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:09.900080 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:09.900684 29525 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11.
I20260709 13:13:09.902494 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:09.902880 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:09.903666 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:09.780807 29376 rpcz_store.cc:276] 0709 13:13:08.074494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.307898 (+233404us) service_pool.cc:224] Handling call
0709 13:13:08.338426 (+ 30528us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:08.348159 (+  9733us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:08.348212 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:08.357467 (+  9255us) log.cc:844] Serialized 26 byte log entry
0709 13:13:09.350148 (+992681us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:09.478093 (+127945us) log.cc:844] Serialized 14 byte log entry
0709 13:13:09.634026 (+155933us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.637476 (+  3450us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:09.637525 (+    49us) raft_consensus.cc:1685] finished
0709 13:13:09.637538 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.637699 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60031,"prepare.queue_time_us":193484,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":5121,"raft.queue_time_us":32944,"raft.run_cpu_time_us":354,"raft.run_wall_time_us":18939,"thread_start_us":1131555,"threads_started":2,"wal-append.queue_time_us":292342}
W20260709 13:13:09.813705 29310 debug-util.cc:398] Leaking SignalData structure 0x7b0800286340 after lost signal to thread 916
W20260709 13:13:09.904938 29310 debug-util.cc:398] Leaking SignalData structure 0x7b080039bac0 after lost signal to thread 934
W20260709 13:13:09.905256 29310 debug-util.cc:398] Leaking SignalData structure 0x7b0800310b40 after lost signal to thread 937
W20260709 13:13:09.905548 29310 debug-util.cc:398] Leaking SignalData structure 0x7b0800348a00 after lost signal to thread 942
W20260709 13:13:09.905769 29310 debug-util.cc:398] Leaking SignalData structure 0x7b080036f200 after lost signal to thread 944
W20260709 13:13:09.905987 29310 debug-util.cc:398] Leaking SignalData structure 0x7b08003a8640 after lost signal to thread 948
W20260709 13:13:09.906292 29310 debug-util.cc:398] Leaking SignalData structure 0x7b08003bce80 after lost signal to thread 957
W20260709 13:13:09.906533 29310 debug-util.cc:398] Leaking SignalData structure 0x7b0800257c80 after lost signal to thread 958
I20260709 13:13:09.906514 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:09.907033 29310 debug-util.cc:398] Leaking SignalData structure 0x7b0800376ac0 after lost signal to thread 967
W20260709 13:13:09.907563 29310 debug-util.cc:398] Leaking SignalData structure 0x7b08002efd80 after lost signal to thread 978
I20260709 13:13:09.736721   885 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:09.907606 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:09.740504   968 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:09.911826 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:09.790699 29375 rpcz_store.cc:276] 0709 13:13:08.074865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.295982 (+221117us) service_pool.cc:224] Handling call
0709 13:13:08.296388 (+   406us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:08.296838 (+   450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:08.296871 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:08.297548 (+   677us) log.cc:844] Serialized 52 byte log entry
0709 13:13:09.356420 (+1058872us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:09.490044 (+133624us) log.cc:844] Serialized 14 byte log entry
0709 13:13:09.572665 (+ 82621us) log.cc:844] Serialized 14 byte log entry
0709 13:13:09.783189 (+210524us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.783316 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:09.783385 (+    69us) raft_consensus.cc:1685] finished
0709 13:13:09.783404 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.783633 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":204275,"prepare.queue_time_us":399906,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":120908,"raft.run_cpu_time_us":452,"raft.run_wall_time_us":32240,"spinlock_wait_cycles":51594624,"thread_start_us":1241957,"threads_started":2,"wal-append.queue_time_us":367136}
I20260709 13:13:09.917831 29377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1397) took 1836 ms. Trace:
I20260709 13:13:09.744463   856 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:13:09.918601 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 129463us
I20260709 13:13:09.920182 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:09.924306 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:09.747459   982 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:09.889487 29381 rpcz_store.cc:276] 0709 13:13:08.073897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:08.247449 (+173552us) service_pool.cc:224] Handling call
0709 13:13:08.247922 (+   473us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:08.264876 (+ 16954us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:08.264921 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:08.298596 (+ 33675us) log.cc:844] Serialized 52 byte log entry
0709 13:13:09.309920 (+1011324us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:09.521925 (+212005us) log.cc:844] Serialized 14 byte log entry
0709 13:13:09.572729 (+ 50804us) log.cc:844] Serialized 14 byte log entry
0709 13:13:09.788425 (+215696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.788589 (+   164us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:09.788656 (+    67us) raft_consensus.cc:1685] finished
0709 13:13:09.788676 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.789854 (+  1178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":166059,"prepare.queue_time_us":245662,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":82,"raft.queue_time_us":204213,"raft.run_cpu_time_us":423,"raft.run_wall_time_us":35893,"thread_start_us":1272428,"threads_started":3,"wal-append.queue_time_us":333527}
W20260709 13:13:09.919237 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 122585us
I20260709 13:13:09.801862  1023 raft_consensus.cc:3055] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:09.801544   715 raft_consensus.cc:1081] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Signalling peer 183db85c071f489fbc8de63a9edd8a3a to start an election
I20260709 13:13:10.057513 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:10.057844 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:09.928038 29529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2944) took 1522 ms. Trace:
I20260709 13:13:10.072356 29522 raft_consensus.cc:1275] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:13:09.929205 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:10.058637 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:10.072019 29529 rpcz_store.cc:276] 0709 13:13:08.406418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.420205 (+1013787us) service_pool.cc:224] Handling call
0709 13:13:09.478467 (+ 58262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:09.478702 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:13:09.494022 (+ 15320us) log.cc:844] Serialized 14 byte log entry
0709 13:13:09.927404 (+433382us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:09.927520 (+   116us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:09.927607 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.927728 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.927930 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1986,"prepare.queue_time_us":15677,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":105436,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":36070,"thread_start_us":397551,"threads_started":2}
I20260709 13:13:09.855561   970 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:10.055366 29377 rpcz_store.cc:276] 0709 13:13:08.081687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.116741 (+1035054us) service_pool.cc:224] Handling call
0709 13:13:09.117192 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:09.117630 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:09.117660 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:09.118224 (+   564us) log.cc:844] Serialized 26 byte log entry
0709 13:13:09.305138 (+186914us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:09.554508 (+249370us) log.cc:844] Serialized 14 byte log entry
0709 13:13:09.729768 (+175260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.729895 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:09.917552 (+187657us) raft_consensus.cc:1685] finished
0709 13:13:09.917580 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:09.917755 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61443,"prepare.queue_time_us":2027,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":8395,"raft.queue_time_us":77978,"raft.run_cpu_time_us":380,"raft.run_wall_time_us":7957,"thread_start_us":610302,"threads_started":3,"wal-append.queue_time_us":184845}
I20260709 13:13:10.093092 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:09.786943   848 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:10.057327   872 raft_consensus.cc:2804] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:10.058425  1038 raft_consensus.cc:3055] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:09.949959   893 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:09.927047  1027 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:13:10.115696 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 57855.4us
W20260709 13:13:10.115298 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 58905.5us
I20260709 13:13:10.131032  1027 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:10.068684  1023 raft_consensus.cc:740] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:10.133351  1027 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:10.133224  1023 consensus_queue.cc:260] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:10.134467  1023 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:09.930047   885 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:10.135862  1034 log.cc:927] Time spent T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.429s	user 0.000s	sys 0.001s
I20260709 13:13:10.136520   971 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:10.137683   885 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:10.124912   680 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:13:10.138188   727 consensus_meta.cc:287] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.795s	user 0.012s	sys 0.001s
I20260709 13:13:10.138269 29373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1400) took 2049 ms. Trace:
W20260709 13:13:10.139521  1016 log.cc:927] Time spent T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.403s	user 0.000s	sys 0.001s
I20260709 13:13:10.138814   727 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:10.115356   872 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:10.141723   872 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:10.142421   917 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:10.142941   917 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:10.127679 29530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2939) took 1752 ms. Trace:
I20260709 13:13:10.107733   939 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:10.103097   687 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:10.130229   893 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:10.145349   727 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:10.146431   893 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:10.138037   932 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:10.129130   951 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:10.056876   982 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:10.148134  1041 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:10.148814  1041 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:10.151840 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:10.152237   931 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.152766   931 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:10.128661  1030 log.cc:927] Time spent T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2: Append to log took a long time: real 0.202s	user 0.000s	sys 0.000s
I20260709 13:13:10.141193 29380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1396) took 2059 ms. Trace:
I20260709 13:13:10.138792 29373 rpcz_store.cc:276] 0709 13:13:08.089373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.420295 (+1330922us) service_pool.cc:224] Handling call
0709 13:13:09.420683 (+   388us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:09.421061 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:09.421089 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:09.479551 (+ 58462us) log.cc:844] Serialized 52 byte log entry
0709 13:13:09.558911 (+ 79360us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:09.757162 (+198251us) log.cc:844] Serialized 14 byte log entry
0709 13:13:09.898149 (+140987us) log.cc:844] Serialized 14 byte log entry
0709 13:13:10.103680 (+205531us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:10.103788 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:10.138018 (+ 34230us) raft_consensus.cc:1685] finished
0709 13:13:10.138043 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:10.138202 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":351619,"prepare.queue_time_us":127665,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":75,"raft.queue_time_us":423355,"raft.run_cpu_time_us":344,"raft.run_wall_time_us":22463,"spinlock_wait_cycles":23764736,"thread_start_us":179654,"threads_started":2,"wal-append.queue_time_us":143606}
I20260709 13:13:10.162894 29528 raft_consensus.cc:2393] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 12: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:10.172792 29452 raft_consensus.cc:1240] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:10.178910 29453 raft_consensus.cc:1240] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:10.154290 29530 rpcz_store.cc:276] 0709 13:13:08.374768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.414414 (+1039646us) service_pool.cc:224] Handling call
0709 13:13:09.414813 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:09.487633 (+ 72820us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:09.487680 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:09.488275 (+   595us) log.cc:844] Serialized 26 byte log entry
0709 13:13:09.727563 (+239288us) spinlock_profiling.cc:243] Waited 5.08 ms on lock 0x7b18002f20c0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c7be07 00007f6a81ad6ab9 00007f6a78c9869b 00007f6a78c9693f 00007f6a78c98c02 00007f6a7b92020b 00007f6a7b925d23 00007f6a7b9260d1 00007f6a7bd41a0f
0709 13:13:10.087936 (+360373us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:10.087980 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:10.088059 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:10.127179 (+ 39120us) raft_consensus.cc:1685] finished
0709 13:13:10.127204 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:10.127594 (+   390us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39346,"raft.queue_time_us":86981,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":4872,"spinlock_wait_cycles":11683584,"thread_start_us":359791,"threads_started":1,"wal-append.queue_time_us":611155}
W20260709 13:13:10.185078 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 53831.3us
I20260709 13:13:10.055717   856 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:10.194119 29456 raft_consensus.cc:1240] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:10.163582 29380 rpcz_store.cc:276] 0709 13:13:08.081388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.107249 (+1025861us) service_pool.cc:224] Handling call
0709 13:13:09.107695 (+   446us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:09.108087 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:09.108120 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:09.108662 (+   542us) log.cc:844] Serialized 26 byte log entry
0709 13:13:09.463103 (+354441us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:09.570234 (+107131us) log.cc:844] Serialized 14 byte log entry
0709 13:13:09.570507 (+   273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.570605 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:10.140955 (+570350us) raft_consensus.cc:1685] finished
0709 13:13:10.140981 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:10.141127 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80619,"prepare.queue_time_us":170711,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":70846,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":5420,"thread_start_us":353908,"threads_started":1,"wal-append.queue_time_us":513804}
I20260709 13:13:10.206511 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:10.207553 29449 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
I20260709 13:13:10.116643  1038 raft_consensus.cc:740] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
W20260709 13:13:10.218981 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 270578us
I20260709 13:13:10.220219 29419 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:10.224251 29454 raft_consensus.cc:1240] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:10.149608   982 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:10.235870 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:10.227808 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:10.098093   970 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:10.151443  1041 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:10.236668 29455 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:13:09.910809   928 consensus_queue.cc:237] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:10.246802  1028 consensus_queue.cc:1048] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:10.237289   893 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:10.249832 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:10.250227   893 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:10.251071   893 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:10.251782 29447 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
I20260709 13:13:10.083283   968 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:10.253474 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:10.254492 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:10.254743   968 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:10.255173 29448 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
I20260709 13:13:10.256214 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:10.257125 29448 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
I20260709 13:13:10.258483 29448 raft_consensus.cc:1240] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:10.256142 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:10.250609 29451 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:10.261837   959 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 election: Requested vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:10.243391  1031 consensus_queue.cc:1048] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
W20260709 13:13:10.209209   936 consensus_meta.cc:287] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.842s	user 0.011s	sys 0.004s
I20260709 13:13:10.176960   832 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.272645 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:10.291052 29452 raft_consensus.cc:2393] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in current term 11: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:10.266431 29455 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
W20260709 13:13:10.276895   862 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.013s	sys 0.020s
I20260709 13:13:10.282896 29451 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
W20260709 13:13:10.305166 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 65322.3us
W20260709 13:13:10.322453 30120 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.008s	sys 0.015s
W20260709 13:13:10.323295 30120 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.008s	sys 0.015s
I20260709 13:13:10.332616 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:10.333583 29454 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
I20260709 13:13:10.307080   936 raft_consensus.cc:515] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:10.339553 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:10.339982 29452 raft_consensus.cc:1240] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:10.340301 29454 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
I20260709 13:13:10.341460   936 leader_election.cc:290] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Requested vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:13:10.304946   862 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.014s	sys 0.020s
I20260709 13:13:10.348778   856 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:10.350746   970 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:10.356427   893 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:10.358783   893 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:10.362085   848 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:10.319262   832 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:10.365373   832 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:10.374564   778 consensus_meta.cc:287] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.581s	user 0.008s	sys 0.001s
I20260709 13:13:10.374454   970 consensus_queue.cc:1048] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:10.375907  1038 consensus_queue.cc:260] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:10.377121  1038 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:13:10.378183  1029 log.cc:927] Time spent T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:13:10.379733   701 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:10.382164   701 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:10.336148 29276 catalog_manager.cc:5697] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:10.384347 29374 raft_consensus.cc:1240] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:10.385488 29378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1399) took 2300 ms. Trace:
I20260709 13:13:10.386158   924 raft_consensus.cc:3055] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:10.386817   924 raft_consensus.cc:740] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:10.385893 29378 rpcz_store.cc:276] 0709 13:13:08.085382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.367044 (+1281662us) service_pool.cc:224] Handling call
0709 13:13:09.367386 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:09.371103 (+  3717us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:09.371134 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:09.371709 (+   575us) log.cc:844] Serialized 26 byte log entry
0709 13:13:09.526318 (+154609us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:09.526374 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:09.526452 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:10.385219 (+858767us) raft_consensus.cc:1685] finished
0709 13:13:10.385244 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:10.385414 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3396,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":88,"thread_start_us":154174,"threads_started":1,"wal-append.queue_time_us":826722}
W20260709 13:13:10.350890 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.391363 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:10.391665 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:10.392184 29455 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:10.392186 29447 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
I20260709 13:13:10.395141 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:10.395782 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 74022.3us
I20260709 13:13:10.395946 29448 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
I20260709 13:13:10.406039 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:10.407006 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:13:10.407588 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:10.407546   931 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:10.408883   912 consensus_meta.cc:287] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.730s	user 0.011s	sys 0.000s
I20260709 13:13:10.408964   872 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:10.409490   912 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:10.410095   888 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:10.411288   872 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:10.414052   917 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:10.415719   999 consensus_meta.cc:287] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.739s	user 0.008s	sys 0.003s
W20260709 13:13:10.417026 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 284536us
W20260709 13:13:10.392727  1018 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.006s	sys 0.010s
I20260709 13:13:10.375293   778 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:10.429632 29346 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:10.431871 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 245702us
I20260709 13:13:10.435528 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
W20260709 13:13:10.427042  1018 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.006s	sys 0.010s
I20260709 13:13:10.443809 30121 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:10.426667   999 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:10.441663   872 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:13:10.445689   912 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:10.486572   938 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:10.508282 29455 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
I20260709 13:13:10.508869 29449 raft_consensus.cc:1240] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:10.484498   893 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:10.431962   924 consensus_queue.cc:260] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:10.495343  1028 consensus_queue.cc:1048] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:13:10.492961  1049 consensus_queue.cc:1048] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
W20260709 13:13:10.524883 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 123727us
W20260709 13:13:10.522404 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.525938 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:10.526821 29526 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:10.535887 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:10.538743 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:10.516494   888 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:10.545482 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:10.542357 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:10.516517  1031 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:10.546294 29527 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
W20260709 13:13:10.553033 29495 connection.cc:256] RPC call timeout handler was delayed by -2.0130230069999016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16000000000000003s for a response
I20260709 13:13:10.553584 29523 raft_consensus.cc:1240] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 11. Current term is 12. Ops: []
W20260709 13:13:10.554714 29495 connection.cc:256] RPC call timeout handler was delayed by -1.8501230069998655s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1781s for a response
W20260709 13:13:10.555161 29495 connection.cc:256] RPC call timeout handler was delayed by -1.7655230069999561s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1875s for a response
W20260709 13:13:10.555594 29495 connection.cc:256] RPC call timeout handler was delayed by -1.6899230070000613s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19590000000000002s for a response
I20260709 13:13:10.555636 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:10.555894 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:13:10.556021 29495 connection.cc:256] RPC call timeout handler was delayed by -1.6683230070000263s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19830000000000003s for a response
W20260709 13:13:10.556593 29495 connection.cc:256] RPC call timeout handler was delayed by -1.5999230069999157s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20590000000000003s for a response
I20260709 13:13:10.556838 29530 raft_consensus.cc:2393] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 11: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:10.592499 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:10.599455 29374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 616) took 2309 ms. Trace:
I20260709 13:13:10.600267 29374 rpcz_store.cc:276] 0709 13:13:08.290422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:09.448963 (+1158541us) service_pool.cc:224] Handling call
0709 13:13:09.449238 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:10.384796 (+935558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:10.599046 (+214250us) spinlock_profiling.cc:243] Waited 935 ms on lock 0x7b54003705d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:10.599350 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2150145280}
I20260709 13:13:10.601994 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:13:10.595252 29276 catalog_manager.cc:5697] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 8 to 10, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 10 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
W20260709 13:13:10.607374 29495 connection.cc:256] RPC call timeout handler was delayed by -1.491023006999967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21800000000000003s for a response
W20260709 13:13:10.607906 29495 connection.cc:256] RPC call timeout handler was delayed by -1.4289230069998666s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22490000000000002s for a response
W20260709 13:13:10.608189 29495 connection.cc:256] RPC call timeout handler was delayed by -1.1499230069998703s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2559s for a response
W20260709 13:13:10.608471 29495 connection.cc:256] RPC call timeout handler was delayed by -1.1310474890001387s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
W20260709 13:13:10.608754 29495 connection.cc:256] RPC call timeout handler was delayed by -1.1085474890001024s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1688s for a response
W20260709 13:13:10.609038 29495 connection.cc:256] RPC call timeout handler was delayed by -1.1076474890001009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16890000000000002s for a response
I20260709 13:13:10.517182   893 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:10.622424 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 136243us
I20260709 13:13:10.614336  1043 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.555215   872 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:10.630439 29495 leader_election.cc:400] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9.
I20260709 13:13:10.630908 29495 leader_election.cc:403] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:13:10.645043 29526 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
W20260709 13:13:10.650169 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:10.593847  1031 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:10.635655  1018 raft_consensus.cc:2749] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9.
I20260709 13:13:10.644925   778 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:10.674899 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:10.643251  1060 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:10.641039   872 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:10.681931 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:10.688892 29456 raft_consensus.cc:2468] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
I20260709 13:13:10.680766 29450 raft_consensus.cc:1240] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:10.650554   917 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:10.695129  1064 log.cc:927] Time spent T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 13:13:10.695294  1060 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:10.697984  1040 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:10.698222  1060 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:10.698372 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 59643.4us
I20260709 13:13:10.693404 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:10.698652  1040 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:10.635047  1043 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:10.701390  1058 log.cc:927] Time spent T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 13:13:10.704406 29449 raft_consensus.cc:1240] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:10.726576 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:10.705739 29455 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:10.706382 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 83113.9us
I20260709 13:13:10.728350 29346 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:10.708716 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:10.729378 29378 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 10.
I20260709 13:13:10.724375 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:10.731992  1031 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:10.727309 29530 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:10.735311  1048 consensus_queue.cc:1048] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:13:10.737213  1043 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:10.683918   912 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.717064   999 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:10.773250 29455 raft_consensus.cc:2468] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:13:10.772390 29450 raft_consensus.cc:1240] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:10.766227 29344 leader_election.cc:304] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:10.780690 29344 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:10.732409  1040 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:10.782261 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 54019us
I20260709 13:13:10.791826 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:10.792964 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:10.793731 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:10.798034 30121 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:10.778635 29495 leader_election.cc:336] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.600s (SENT)
I20260709 13:13:10.800297 29495 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:10.800891 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:10.801821 29453 raft_consensus.cc:2393] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 12: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:10.803158 29447 raft_consensus.cc:1275] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:13:10.805214 29450 raft_consensus.cc:2393] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 14: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:10.807262 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:10.809369 29455 raft_consensus.cc:2393] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 10: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:10.816401 29452 raft_consensus.cc:3055] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:10.816983 29452 raft_consensus.cc:740] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:10.817870 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:10.818935 29448 raft_consensus.cc:2393] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 13: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:10.823894  1052 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:13:10.825204 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 46618us
I20260709 13:13:10.757831   912 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:10.785920   936 raft_consensus.cc:2749] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:13:10.831808 29495 leader_election.cc:336] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.875s (SENT)
I20260709 13:13:10.842094 29495 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:10.832875 29344 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:10.802084  1049 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:10.810251  1042 raft_consensus.cc:2804] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:10.826632   862 consensus_queue.cc:1059] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:13:10.849166 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:10.831317  1056 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:10.852346 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:10.906795 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:10.907073 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:10.853130 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:10.907917 29374 raft_consensus.cc:2393] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 11: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:10.858247 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:10.868445 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:10.874056 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:10.908687 29455 raft_consensus.cc:2393] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 12: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:10.908890 29451 raft_consensus.cc:2393] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 8: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:10.840917   715 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.910843 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:10.856158 29452 consensus_queue.cc:260] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:10.851573 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:10.887722 29381 raft_consensus.cc:1275] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:13:10.911914 29452 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:10.806696  1057 consensus_queue.cc:1059] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:13:10.919299 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:10.919941 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:10.920411 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 59339.2us
W20260709 13:13:10.921187 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:10.923169 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 91383.5us
I20260709 13:13:10.909413 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:10.884526  1042 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:10.911952 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:10.904335 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:10.941494 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:10.914942 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:10.942278 29448 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:13:10.913296 29373 raft_consensus.cc:2393] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 3: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:10.858944   832 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:10.861595 29276 catalog_manager.cc:5697] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 5 to 8, now has a pending config: VOTER 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129), VOTER 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130), VOTER 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131), VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132). New cstate: current_term: 8 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:13:10.884927  1060 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:10.947868  1042 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:10.916507  1031 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:10.948622 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:10.902746   987 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:13:10.918601   715 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:10.950709 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:10.968693 29456 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
I20260709 13:13:10.956343 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:13:10.947110 29495 leader_election.cc:336] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 2.059s (SENT)
I20260709 13:13:10.958770 29523 raft_consensus.cc:1240] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:10.970580 29495 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:10.971647   917 raft_consensus.cc:2749] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:13:10.972550 29495 leader_election.cc:336] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 2.249s (SENT)
I20260709 13:13:10.973769 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:10.944463   936 raft_consensus.cc:3055] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:10.964011 29449 raft_consensus.cc:2393] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 11: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:10.961469 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:10.943183   893 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:10.961469 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:10.975312 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:10.985216 29495 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:10.987229 29375 raft_consensus.cc:1275] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:13:10.988372 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:10.970293 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:10.992664 29528 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:13:10.993319 29456 raft_consensus.cc:2393] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 9: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:11.001080   935 consensus_queue.cc:1059] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:10.958346   832 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:11.015949 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:10.977284   936 raft_consensus.cc:740] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:10.976714  1031 raft_consensus.cc:697] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:11.007690   987 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:13:11.025230 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 52705.8us
I20260709 13:13:10.962580  1060 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:11.049892 29452 raft_consensus.cc:1275] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:13:11.007216   938 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:10.990451   872 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:11.051195 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.051278 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:11.057382 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:11.056629 29452 pending_rounds.cc:85] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 6
I20260709 13:13:11.058354 29452 pending_rounds.cc:107] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:13:11.060784 29530 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
I20260709 13:13:11.063980 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:11.060137 29456 raft_consensus.cc:2393] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 15: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
W20260709 13:13:11.066900 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 243851us
I20260709 13:13:11.060793 29452 raft_consensus.cc:2889] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:11.089680 29380 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
I20260709 13:13:11.103474 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:11.109017 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:11.099998 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:11.104004 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 112289us
I20260709 13:13:11.120682 29456 raft_consensus.cc:2393] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 13: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:11.133744 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:11.103232 29452 raft_consensus.cc:1240] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
W20260709 13:13:11.097642  1076 log.cc:927] Time spent T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
W20260709 13:13:11.174397 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.176992 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:11.177722 29373 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:11.179083 29344 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:11.180464 29344 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:11.099562  1067 log.cc:927] Time spent T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:13:11.088104   999 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.191057 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:11.192144 29526 raft_consensus.cc:2393] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 12: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:11.204348 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:11.105365   715 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:11.206087 29452 raft_consensus.cc:1275] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:13:11.218789 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:11.219714 29375 raft_consensus.cc:2368] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 11. Current term is 12.
I20260709 13:13:11.195087  1041 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:11.201719   912 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:11.241822 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:11.242568 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:11.243302 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:11.246963 29379 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:13:11.253832 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 73439.7us
I20260709 13:13:11.258168 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:11.259474 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 161158us
I20260709 13:13:11.260560 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:11.261831 29372 raft_consensus.cc:2393] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 12: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:11.112035   936 consensus_queue.cc:260] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:11.261521 29373 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 12.
I20260709 13:13:11.202203   999 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:11.273460 29379 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 15.
I20260709 13:13:11.280303 29379 raft_consensus.cc:1240] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:13:11.256398  1041 raft_consensus.cc:697] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:11.300043 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:11.207587  1031 consensus_queue.cc:237] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:11.301442 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:11.305256 29379 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:11.275882   778 raft_consensus.cc:2764] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:13:11.306924 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:11.308924 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:11.319643 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:11.321126 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:11.339043 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:11.352720 29523 raft_consensus.cc:2393] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 11: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:11.365942 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:11.302821   936 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:11.376889 29379 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 10.
I20260709 13:13:11.376602 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:11.379963 29447 raft_consensus.cc:1240] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:13:11.381731 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:11.383250 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:11.456775 29495 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:11.386204 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:11.467924   917 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:11.468070 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:11.468408   917 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:11.468873   917 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:11.469328 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:11.458359 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:11.471239 29379 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:11.403143  1049 consensus_meta.cc:287] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.544s	user 0.008s	sys 0.003s
I20260709 13:13:11.476210  1049 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:11.426273   924 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:13:11.476904  1085 log.cc:927] Time spent T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:13:11.478464   917 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:11.478943 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:11.421662  1089 consensus_queue.cc:1059] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:13:11.415863 29447 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6"
dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:45798
I20260709 13:13:11.403389  1042 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:11.480036   872 raft_consensus.cc:3055] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:11.421408  1050 consensus_queue.cc:1059] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.059s
W20260709 13:13:11.408317  1073 log.cc:927] Time spent T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 13:13:11.420997  1071 log.cc:927] Time spent T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.459s	user 0.000s	sys 0.004s
W20260709 13:13:11.486212 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.516168 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:11.516830 29372 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:13:11.487845  1077 log.cc:927] Time spent T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.433s	user 0.000s	sys 0.002s
I20260709 13:13:11.489152 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:11.406724   832 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:11.490037 29525 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.837s	user 0.001s	sys 0.009s
W20260709 13:13:11.519192 29525 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.001s	sys 0.009s
I20260709 13:13:11.490497 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:11.493976 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.494022  1043 consensus_queue.cc:1059] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:11.466506   929 raft_consensus.cc:3055] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:11.493717 29495 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:11.557587 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:11.558547 29376 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:11.368144  1072 log.cc:927] Time spent T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
W20260709 13:13:11.495167 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 374814us
I20260709 13:13:11.501435 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:13:11.571775 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.572490 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:11.488654 29379 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 13.
I20260709 13:13:11.512657   872 raft_consensus.cc:740] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:11.506753 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:11.575441 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:11.576579 29421 leader_election.cc:336] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.670s (SENT)
I20260709 13:13:11.576800 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:11.380892  1080 log.cc:927] Time spent T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 13:13:11.511428 29447 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:11.580154 29447 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:11.418237   928 consensus_queue.cc:1059] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.094s
I20260709 13:13:11.529435 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:11.414518  1060 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:11.539723 29373 raft_consensus.cc:1240] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:13:11.541378  1042 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:11.542035 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:11.548796 29529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2955) took 1017 ms. Trace:
I20260709 13:13:11.550046 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:11.591681 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:11.592460 29528 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:13:11.550549 29372 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11.
I20260709 13:13:11.505527 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:11.594683 29376 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 13.
W20260709 13:13:11.595554 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.588472 29529 rpcz_store.cc:276] 0709 13:13:10.531148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.531264 (+   116us) service_pool.cc:224] Handling call
0709 13:13:10.531652 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:10.590498 (+ 58846us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:10.590535 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:10.629444 (+ 38909us) log.cc:844] Serialized 26 byte log entry
0709 13:13:10.857411 (+227967us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:10.857457 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:10.857535 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:11.487199 (+629664us) spinlock_profiling.cc:243] Waited 6.35 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:13:11.548415 (+ 61216us) raft_consensus.cc:1685] finished
0709 13:13:11.548439 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:11.548714 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24161,"raft.queue_time_us":11748,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":130,"spinlock_wait_cycles":14616320,"thread_start_us":201217,"threads_started":1,"wal-append.queue_time_us":334349}
I20260709 13:13:11.577903 29523 raft_consensus.cc:2393] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 8: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:11.600600 29523 raft_consensus.cc:1275] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:13:11.601078 29447 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:11.601025 29529 raft_consensus.cc:1240] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:13:11.605031 29380 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11.
I20260709 13:13:11.579291 29379 raft_consensus.cc:1240] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:11.530164  1052 raft_consensus.cc:3055] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:13:11.583555 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 89949.2us
I20260709 13:13:11.579118 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:11.552651   929 raft_consensus.cc:740] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:13:11.608244 29526 raft_consensus.cc:2393] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 12: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:11.609755 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:11.611557 29379 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:11.607105 29495 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:11.620537 29528 raft_consensus.cc:1240] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:11.625967 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:11.626157 29447 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:11.622588 29495 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:11.578481   999 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:11.633076 29495 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:11.633976 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:11.513271  1041 consensus_queue.cc:237] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:11.631345 29344 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:11.643821 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:11.644600 29526 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:11.643865 29379 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 12.
I20260709 13:13:11.612924  1052 raft_consensus.cc:740] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
W20260709 13:13:11.658143 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.649210 29523 raft_consensus.cc:1240] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:11.655876 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:11.660140 29379 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:11.633180  1038 raft_consensus.cc:2804] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:11.673686 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:11.674678 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:11.675457 29373 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:11.675545 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:11.693158 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:11.696326 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:11.706846 29526 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
I20260709 13:13:11.636109  1054 consensus_queue.cc:1059] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:13:11.715963 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:11.717159 29372 raft_consensus.cc:2368] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 11. Current term is 12.
I20260709 13:13:11.712780 29447 raft_consensus.cc:1240] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:11.712759 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:11.718704 29380 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:11.672145  1026 raft_consensus.cc:2804] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:11.672520  1038 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:11.740324   935 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:11.762086  1038 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:11.762228   935 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:11.764642   935 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:11.742130  1018 consensus_queue.cc:1059] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:11.765558  1018 raft_consensus.cc:2804] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:11.765910  1018 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:11.766269  1018 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:11.742461 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:11.768818 29421 leader_election.cc:336] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.816s (SENT)
I20260709 13:13:11.769083 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:11.769678 29378 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:11.744087 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:11.770723 29381 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 13.
I20260709 13:13:11.771700 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:11.772850 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:11.773866 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:11.747624   928 raft_consensus.cc:2804] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:11.774437   928 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:13:11.752007  1088 log.cc:927] Time spent T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 13:13:11.757544   924 raft_consensus.cc:3055] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:11.735507  1082 consensus_queue.cc:1059] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:13:11.742071 29376 raft_consensus.cc:2410] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:13:11.750026   929 consensus_queue.cc:260] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:13:11.776273 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:11.775774 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:11.787896 29525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 2953) took 1259 ms. Trace:
I20260709 13:13:11.788702 29380 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 15.
I20260709 13:13:11.792011 29372 raft_consensus.cc:1275] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:13:11.793169 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 160196us
I20260709 13:13:11.799057 29379 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
I20260709 13:13:11.796279 29373 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:13:11.804153 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:11.805428 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:11.802290 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:11.806891 29380 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:11.805711 29525 rpcz_store.cc:276] 0709 13:13:10.528309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.528536 (+   227us) service_pool.cc:224] Handling call
0709 13:13:10.528973 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:10.529248 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:13:10.652372 (+123124us) log.cc:844] Serialized 14 byte log entry
0709 13:13:11.787246 (+1134874us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:11.787556 (+   310us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:11.787617 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.787695 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:11.787834 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":208118,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":58567,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":14484,"thread_start_us":1228885,"threads_started":3,"wal-append.queue_time_us":909352}
I20260709 13:13:11.807922 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:11.810665 29381 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:11.812115 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:11.812685 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:11.648020   872 consensus_queue.cc:260] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:11.806499 29495 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:11.786578   928 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:11.783967  1026 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:11.832239 29344 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:11.829252 29495 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:11.831555  1099 log.cc:927] Time spent T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
W20260709 13:13:11.844619  1097 log.cc:927] Time spent T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:13:11.847213  1095 log.cc:927] Time spent T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:13:11.850284 29455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2406) took 1053 ms. Trace:
I20260709 13:13:11.850926 29455 rpcz_store.cc:276] 0709 13:13:10.797231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.194389 (+397158us) service_pool.cc:224] Handling call
0709 13:13:11.194744 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:11.209034 (+ 14290us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:13:11.234379 (+ 25345us) log.cc:844] Serialized 14 byte log entry
0709 13:13:11.613501 (+379122us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:11.614163 (+   662us) log.cc:844] Serialized 26 byte log entry
0709 13:13:11.614338 (+   175us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:11.614382 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.614481 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:11.849980 (+235499us) raft_consensus.cc:1685] finished
0709 13:13:11.850007 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:11.850188 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":65532,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":5033,"raft.run_cpu_time_us":381,"raft.run_wall_time_us":21100,"thread_start_us":327816,"threads_started":1,"wal-append.queue_time_us":431208}
W20260709 13:13:11.855511 29419 leader_election.cc:336] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.587s (SENT)
I20260709 13:13:11.794251   924 raft_consensus.cc:740] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:11.811517  1050 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:11.799379   917 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:11.881870 29378 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11.
I20260709 13:13:11.873246 29448 raft_consensus.cc:2955] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 4 to 5, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:13:11.897384 29381 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:13:11.836745  1026 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:11.835387   832 raft_consensus.cc:2804] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:13:11.866567  1088 log.cc:927] Time spent T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:13:11.814162   936 consensus_queue.cc:1059] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
W20260709 13:13:11.948413 29521 consensus_meta.cc:287] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.566s	user 0.011s	sys 0.003s
I20260709 13:13:11.984714 29521 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 15.
W20260709 13:13:11.949311 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 120180us
I20260709 13:13:11.876587  1102 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.787742  1052 consensus_queue.cc:260] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:11.986382 29495 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:11.977440  1050 raft_consensus.cc:697] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:11.992329  1107 raft_consensus.cc:2804] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:12.009768  1103 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:11.950124  1108 raft_consensus.cc:3055] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:11.993405   832 raft_consensus.cc:697] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:12.013877   924 consensus_queue.cc:260] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:12.015079  1102 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:11.977793   917 consensus_queue.cc:1059] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
W20260709 13:13:12.029891  1098 log.cc:927] Time spent T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 13:13:12.046267 29449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2400) took 1251 ms. Trace:
W20260709 13:13:12.093037 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:12.127732  1104 log.cc:927] Time spent T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:13:12.129666   928 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:12.042265  1038 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:12.142156 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.254204 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:13:12.162703 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.255213 29374 raft_consensus.cc:2376] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 15. Re-sending same reply.
I20260709 13:13:12.180980  1018 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:12.210696 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 224452us
W20260709 13:13:12.210805 29419 leader_election.cc:336] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.823s (SENT)
W20260709 13:13:12.213037 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:12.272670 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 61904.8us
I20260709 13:13:12.272799 29495 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:12.273149 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:12.273087 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:12.215080 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.210861 29380 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11.
W20260709 13:13:12.273362 29419 leader_election.cc:336] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.843s (SENT)
I20260709 13:13:12.223609 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:12.227406 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:12.228789 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:12.229806 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:12.212353  1103 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:13:12.275996 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.266266 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:12.215087   872 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:12.212797  1107 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:12.235232 29449 rpcz_store.cc:276] 0709 13:13:10.795368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:10.978685 (+183317us) service_pool.cc:224] Handling call
0709 13:13:10.979100 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:10.980037 (+   937us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:13:11.017438 (+ 37401us) log.cc:844] Serialized 14 byte log entry
0709 13:13:11.275889 (+258451us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:11.276520 (+   631us) log.cc:844] Serialized 26 byte log entry
0709 13:13:11.276675 (+   155us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:11.509445 (+232770us) log.cc:844] Serialized 14 byte log entry
0709 13:13:11.511813 (+  2368us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.511900 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:11.755733 (+243833us) spinlock_profiling.cc:243] Waited 4.02 ms on lock 0x7b480012e7d8. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a80cafaa1 00007f6a80ca6b37 00007f6a80ca69ca 00007f6a80d9e26f 00007f6a80d9df37 00007f6a80db255c 00007f6a80db2508 00007f6a80db2488 00007f6a80db2443 00007f6a80db16ec 00007f6a7fcdba96
0709 13:13:12.046004 (+290271us) raft_consensus.cc:1685] finished
0709 13:13:12.046033 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:12.046196 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1996,"prepare.queue_time_us":380938,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":100,"raft.queue_time_us":3771,"raft.run_cpu_time_us":2946,"raft.run_wall_time_us":254010,"spinlock_wait_cycles":9241856,"thread_start_us":443386,"threads_started":2,"wal-append.queue_time_us":447280}
I20260709 13:13:12.221201  1106 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:12.294898 29521 raft_consensus.cc:1240] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:12.278184 29381 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 12.
I20260709 13:13:12.279212 29495 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:12.277738 29379 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 12.
I20260709 13:13:12.214751  1108 raft_consensus.cc:740] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:12.283521 29374 raft_consensus.cc:2376] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11. Re-sending same reply.
W20260709 13:13:12.286542 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.289749 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:12.278704 29378 raft_consensus.cc:3055] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:12.296391 29495 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:12.297170 29455 raft_consensus.cc:1240] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:12.299937 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:12.259552  1052 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:12.304535 29378 raft_consensus.cc:740] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:12.312598 29527 raft_consensus.cc:1240] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:12.318182 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:12.318943 29380 raft_consensus.cc:2376] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9. Re-sending same reply.
I20260709 13:13:12.276597   917 raft_consensus.cc:3055] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:12.276379   924 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:12.331168 29528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 1681) took 1026 ms. Trace:
I20260709 13:13:12.331699 29528 rpcz_store.cc:276] 0709 13:13:11.304587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.593214 (+288627us) service_pool.cc:224] Handling call
0709 13:13:11.611381 (+ 18167us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:11.621120 (+  9739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.330931 (+709811us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b540039ce50. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd858ad 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:12.331099 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40768256}
I20260709 13:13:12.323843 29530 raft_consensus.cc:1240] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:12.325114 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:12.333223 29380 raft_consensus.cc:2376] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11. Re-sending same reply.
I20260709 13:13:12.304574 29379 raft_consensus.cc:2376] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 15. Re-sending same reply.
I20260709 13:13:12.312000 29378 consensus_queue.cc:260] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:12.335116 29378 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:12.335601 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:12.336513 29380 raft_consensus.cc:2376] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 13. Re-sending same reply.
I20260709 13:13:12.286685  1103 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:12.295212  1106 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:12.344956 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:12.311259   987 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:12.293782  1107 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:12.342638 29523 raft_consensus.cc:1240] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:12.299919  1113 raft_consensus.cc:2804] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:12.348308 29456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2404) took 1551 ms. Trace:
I20260709 13:13:12.351056 29378 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:13:12.352795 29452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2408) took 1516 ms. Trace:
I20260709 13:13:12.356546 29452 rpcz_store.cc:276] 0709 13:13:10.836473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.243397 (+406924us) service_pool.cc:224] Handling call
0709 13:13:11.264865 (+ 21468us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:11.265374 (+   509us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:11.265413 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:11.265997 (+   584us) log.cc:844] Serialized 26 byte log entry
0709 13:13:11.605336 (+339339us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:13:11.605395 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.605476 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:12.352537 (+747061us) raft_consensus.cc:1685] finished
0709 13:13:12.352559 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:12.352718 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":149,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":6534,"thread_start_us":248935,"threads_started":1,"wal-append.queue_time_us":433876}
I20260709 13:13:12.354398 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:12.364825 29380 raft_consensus.cc:2376] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 12. Re-sending same reply.
I20260709 13:13:12.326254   917 raft_consensus.cc:740] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:12.386600 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:12.350019  1106 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:12.381953  1108 consensus_queue.cc:260] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:12.389395   928 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:12.390072  1108 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:12.349411   987 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:12.399328 29380 raft_consensus.cc:2393] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 12: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:12.406701 29451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2422) took 1454 ms. Trace:
I20260709 13:13:12.407217 29451 rpcz_store.cc:276] 0709 13:13:10.951965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.502985 (+551020us) service_pool.cc:224] Handling call
0709 13:13:11.503373 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:11.509706 (+  6333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:11.509755 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:11.535845 (+ 26090us) log.cc:844] Serialized 26 byte log entry
0709 13:13:11.708709 (+172864us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:11.786937 (+ 78228us) log.cc:844] Serialized 14 byte log entry
0709 13:13:11.787336 (+   399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.787432 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:12.406448 (+619016us) raft_consensus.cc:1685] finished
0709 13:13:12.406468 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:12.406634 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10951,"prepare.queue_time_us":86182,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":6940,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":13002,"spinlock_wait_cycles":9181568,"thread_start_us":146043,"threads_started":1,"wal-append.queue_time_us":329225}
I20260709 13:13:12.408907 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:12.411109   917 consensus_queue.cc:260] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:12.413038  1117 log.cc:927] Time spent T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 13:13:12.413390   917 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:12.417116 29454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2418) took 1513 ms. Trace:
I20260709 13:13:12.339852   832 consensus_queue.cc:237] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:12.402294   987 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:12.380066  1054 consensus_queue.cc:1059] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:13:12.412247  1043 raft_consensus.cc:3055] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:12.430227  1038 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:12.431643 30120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.440198  1084 raft_consensus.cc:3055] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:12.352818  1050 consensus_queue.cc:237] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:12.444904  1102 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:12.448397   892 consensus_queue.cc:1059] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:12.449190   936 consensus_queue.cc:1059] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:12.449841  1028 consensus_queue.cc:1059] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:12.450479  1042 consensus_queue.cc:1059] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:12.468384   928 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:13:12.452761  1110 log.cc:927] Time spent T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.241s	user 0.000s	sys 0.001s
I20260709 13:13:12.453692  1049 raft_consensus.cc:3055] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:12.456270 29376 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:13:12.503783 29376 raft_consensus.cc:606] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:12.504420 29376 raft_consensus.cc:614] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:12.375109  1113 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:12.511715  1113 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:12.514977 29346 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:12.516016  1037 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:13:12.458657 29419 leader_election.cc:336] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 2.132s (SENT)
W20260709 13:13:12.517530 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 58906.3us
I20260709 13:13:12.517609 29346 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:12.519601 29346 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:12.410375 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 81577.5us
I20260709 13:13:12.455715  1018 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:12.469372 29454 rpcz_store.cc:276] 0709 13:13:10.903727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.488670 (+584943us) service_pool.cc:224] Handling call
0709 13:13:11.489307 (+   637us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:11.502241 (+ 12934us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:13:11.742985 (+240744us) log.cc:844] Serialized 14 byte log entry
0709 13:13:11.875648 (+132663us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:11.938522 (+ 62874us) log.cc:844] Serialized 26 byte log entry
0709 13:13:11.938747 (+   225us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:11.939083 (+   336us) log.cc:844] Serialized 14 byte log entry
0709 13:13:12.281766 (+342683us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b1800370000. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c13c0a 00007f6a82353219 00007f6a78c9ba40 00007f6a78c964e4 00007f6a78c96455 00007f6a7bd7e060 00007f6a7bd90716 00007f6a7bda1287 00007f6a7bda1208
0709 13:13:12.281952 (+   186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.282030 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:12.416768 (+134738us) raft_consensus.cc:1685] finished
0709 13:13:12.416795 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:12.416996 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68870,"prepare.queue_time_us":218913,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":96,"raft.queue_time_us":354797,"raft.run_cpu_time_us":518,"raft.run_wall_time_us":60429,"spinlock_wait_cycles":58274560,"thread_start_us":346143,"threads_started":2,"wal-append.queue_time_us":629754}
I20260709 13:13:12.476404 29421 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:12.509567   936 raft_consensus.cc:3055] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:12.529134 29346 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:12.510308   924 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.510470  1042 raft_consensus.cc:3055] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:12.510567  1103 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:12.520738 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:12.523442 29523 raft_consensus.cc:1275] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:13:12.526229 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:12.481093  1084 raft_consensus.cc:740] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:13:12.528398 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:12.477430  1043 raft_consensus.cc:740] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:12.535272 29448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2427) took 1446 ms. Trace:
I20260709 13:13:12.536939 29346 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:12.567768 29346 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:12.566692 29448 rpcz_store.cc:276] 0709 13:13:11.089317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.606306 (+516989us) service_pool.cc:224] Handling call
0709 13:13:11.635625 (+ 29319us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:11.636292 (+   667us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:11.636335 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:11.652134 (+ 15799us) log.cc:844] Serialized 598 byte log entry
0709 13:13:11.873070 (+220936us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:12.025210 (+152140us) log.cc:844] Serialized 14 byte log entry
0709 13:13:12.502406 (+477196us) log.cc:844] Serialized 14 byte log entry
0709 13:13:12.534958 (+ 32552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.535035 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:12.535078 (+    43us) raft_consensus.cc:1685] finished
0709 13:13:12.535088 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:12.535202 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":173634,"prepare.queue_time_us":7893,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":202155,"raft.run_cpu_time_us":526,"raft.run_wall_time_us":32846,"thread_start_us":358686,"threads_started":2,"wal-append.queue_time_us":670191}
I20260709 13:13:12.503415  1049 raft_consensus.cc:740] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:12.478083   999 consensus_queue.cc:1059] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:13:12.495749  1123 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:12.544579 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:12.576804 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:12.577148 29455 raft_consensus.cc:2393] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 9: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:12.543448 29451 raft_consensus.cc:2393] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 11: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:12.564886 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:12.578003 29447 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:13:12.569250 29448 raft_consensus.cc:1240] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 8. Current term is 9. Ops: []
W20260709 13:13:12.534220 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 238017us
I20260709 13:13:12.533051   892 raft_consensus.cc:2749] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:12.572710 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 96423.3us
I20260709 13:13:12.528756   936 raft_consensus.cc:740] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:12.533053   781 raft_consensus.cc:2749] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:12.532944  1121 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.577606 29454 raft_consensus.cc:2393] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 11: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:12.562050   924 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:12.581202  1049 consensus_queue.cc:260] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:12.543638   877 raft_consensus.cc:2749] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:12.583285 29495 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:12.583966  1018 consensus_queue.cc:1059] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:13:12.585389  1115 log.cc:927] Time spent T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.371s	user 0.004s	sys 0.000s
I20260709 13:13:12.587092  1106 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:12.542582  1042 raft_consensus.cc:740] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:12.556754  1132 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:13:12.614004 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 87247.5us
I20260709 13:13:12.525382   928 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:12.572294  1102 raft_consensus.cc:2749] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:12.565442   935 consensus_queue.cc:1048] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:13:12.649968  1042 consensus_queue.cc:260] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:12.651451  1042 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:12.652508  1124 raft_consensus.cc:3055] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:12.652957  1124 raft_consensus.cc:740] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:12.653812  1124 consensus_queue.cc:260] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:12.655061  1124 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:12.655352  1132 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:12.656930  1103 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:12.661990   924 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:13:12.663617 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.664175 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:12.664906 30157 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
I20260709 13:13:12.632961  1028 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:12.620139  1121 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:12.667011   928 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:12.667826   936 consensus_queue.cc:260] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:12.669720   936 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:12.670307 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.592943  1037 raft_consensus.cc:2749] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:13:12.636402 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 53213.4us
I20260709 13:13:12.616741  1123 raft_consensus.cc:697] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:12.672446 29495 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:12.673163  1113 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:12.674132 29453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2428) took 1503 ms. Trace:
I20260709 13:13:12.675702 29522 raft_consensus.cc:1240] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:12.674566 29453 rpcz_store.cc:276] 0709 13:13:11.170463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.651719 (+481256us) service_pool.cc:224] Handling call
0709 13:13:11.652142 (+   423us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:11.661145 (+  9003us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:11.661196 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:11.675004 (+ 13808us) log.cc:844] Serialized 52 byte log entry
0709 13:13:11.810493 (+135489us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:11.855328 (+ 44835us) log.cc:844] Serialized 14 byte log entry
0709 13:13:11.865843 (+ 10515us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:11.865963 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:12.673757 (+807794us) raft_consensus.cc:1685] finished
0709 13:13:12.673794 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:12.674054 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54618,"prepare.queue_time_us":44874,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":10753,"raft.run_cpu_time_us":423,"raft.run_wall_time_us":29579,"thread_start_us":70651,"threads_started":1,"wal-append.queue_time_us":500410}
I20260709 13:13:12.675815  1018 consensus_queue.cc:1059] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:12.672366  1123 consensus_queue.cc:237] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:12.677075  1103 raft_consensus.cc:2804] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:12.360600 29456 rpcz_store.cc:276] 0709 13:13:10.796427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.123003 (+326576us) service_pool.cc:224] Handling call
0709 13:13:11.123401 (+   398us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:13:11.183768 (+ 60367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:11.183836 (+    68us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:13:11.213701 (+ 29865us) log.cc:844] Serialized 78 byte log entry
0709 13:13:11.490667 (+276966us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:12.327924 (+837257us) spinlock_profiling.cc:243] Waited 5.36 ms on lock 0x7b18003c4a80. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a7b92e4bc 00007f6a78c7c48b 00007f6a81ad6ab9 00007f6a78c9869b 00007f6a78c9693f 00007f6a78c96455 00007f6a7f77e3c7 00007f6a7bd909a7 00007f6a7bda00bf
0709 13:13:12.328146 (+   222us) log.cc:844] Serialized 14 byte log entry
0709 13:13:12.329634 (+  1488us) log.cc:844] Serialized 14 byte log entry
0709 13:13:12.337668 (+  8034us) log.cc:844] Serialized 14 byte log entry
0709 13:13:12.341914 (+  4246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.347907 (+  5993us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:12.347965 (+    58us) raft_consensus.cc:1685] finished
0709 13:13:12.347978 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:12.348127 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79606,"prepare.queue_time_us":194137,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":83,"raft.queue_time_us":36260,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":15721,"spinlock_wait_cycles":22580864,"thread_start_us":456306,"threads_started":2,"wal-append.queue_time_us":430280}
I20260709 13:13:12.592008  1122 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.616267   999 raft_consensus.cc:3055] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:12.635996  1049 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:12.640579  1038 raft_consensus.cc:2804] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:12.668670  1121 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:12.690883 29372 raft_consensus.cc:2410] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:13:12.680891 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:12.637162 29447 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
I20260709 13:13:12.684273 29451 raft_consensus.cc:1275] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:13:12.685665 29455 raft_consensus.cc:1240] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:12.685648   924 consensus_queue.cc:1059] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:13:12.701355   924 raft_consensus.cc:3055] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:12.701901   924 raft_consensus.cc:740] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:12.703099   924 consensus_queue.cc:260] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:12.690547  1038 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:12.687661  1122 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:12.706559 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:12.758571 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.716089  1106 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:12.718973 29447 raft_consensus.cc:1240] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:12.685395   999 raft_consensus.cc:740] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:12.759092 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:12.760478 29455 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:12.761528 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:12.762079 29447 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:12.721493 29451 raft_consensus.cc:1275] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:13:12.722270 29456 raft_consensus.cc:1240] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:12.728776  1107 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:12.689457  1113 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:12.693539  1026 consensus_meta.cc:287] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.710s	user 0.001s	sys 0.016s
I20260709 13:13:12.733628 29419 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:12.837031 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:12.837675 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:12.838037 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:12.838526 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:12.838907 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.721395   778 raft_consensus.cc:3055] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:12.765494 29526 raft_consensus.cc:1240] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 9. Current term is 10. Ops: []
W20260709 13:13:12.839650 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.768563 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:13:12.812101 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.843175 29455 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
I20260709 13:13:12.843909 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:13:12.849267 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.752612   877 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:12.851043 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 117531us
W20260709 13:13:12.856946 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 289232us
W20260709 13:13:12.859170 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.853351 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:12.864316 29455 raft_consensus.cc:2393] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 9: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:12.758958  1038 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:12.839339 29447 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:13:12.868835 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:12.869895 29455 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
I20260709 13:13:12.860558 29346 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:12.872975 29495 connection.cc:256] RPC call timeout handler was delayed by -1.080722114000082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
W20260709 13:13:12.876174 29495 connection.cc:256] RPC call timeout handler was delayed by -1.0195221140002104s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
W20260709 13:13:12.876623 29495 connection.cc:256] RPC call timeout handler was delayed by -1.0006221140001799s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1675s for a response
I20260709 13:13:12.850193   924 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:12.904951 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:12.913386 29447 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
I20260709 13:13:12.849119   778 raft_consensus.cc:740] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:12.832854  1103 raft_consensus.cc:697] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:12.854199   893 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:12.927845 29346 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:12.840714  1031 consensus_queue.cc:1048] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:13:12.918825  1137 consensus_queue.cc:1048] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:13:12.933699 29346 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:12.933606 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 76387.8us
I20260709 13:13:12.884187  1113 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.917747   935 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:12.855059   892 consensus_queue.cc:1059] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:13:12.847955  1026 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:12.866777   877 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:12.920477   832 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:12.963357 29495 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:12.913658  1131 consensus_queue.cc:1059] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:13:12.971947  1136 raft_consensus.cc:2749] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:13:13.015074   987 consensus_meta.cc:287] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.531s	user 0.010s	sys 0.002s
I20260709 13:13:12.983760  1103 consensus_queue.cc:237] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:13.015601   987 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:13.016693 29527 raft_consensus.cc:1240] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:12.985045  1052 consensus_queue.cc:1048] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:12.985795   832 raft_consensus.cc:493] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.019745  1132 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:12.987952 29522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35"
dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:37954
I20260709 13:13:13.020714 29522 raft_consensus.cc:606] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Received request to transfer leadership
I20260709 13:13:13.021129 29522 raft_consensus.cc:614] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:12.952741  1113 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:12.997882 29495 leader_election.cc:304] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:13:12.998617 30120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:12.972337  1106 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:13.016647  1038 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:13.032362 29495 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:13.041756 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:13.044014 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:13.045225 29521 raft_consensus.cc:2393] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 9: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:13.046387 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:13.047077 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:13.047359 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:13.047766 29447 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:13.048252 29529 raft_consensus.cc:2368] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 11. Current term is 12.
I20260709 13:13:13.049481 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:13.052287 29456 raft_consensus.cc:1240] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:13.053208 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:13.054978 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:13.055886 29455 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:12.923261   999 consensus_queue.cc:260] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:12.953593   893 consensus_queue.cc:1048] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:13:13.061390 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:12.955370   935 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:12.980528  1107 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:13.073267 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:13.036566  1132 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:13:13.065508 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 131883us
I20260709 13:13:13.013512   781 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:13:13.019798   832 raft_consensus.cc:515] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:13.072000 29447 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
I20260709 13:13:13.064143   924 raft_consensus.cc:2804] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:13.065014  1050 consensus_queue.cc:1048] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:13:13.039732  1137 consensus_queue.cc:1048] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:13:13.063985 29495 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:13.067134 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:13.030519  1052 raft_consensus.cc:3060] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:13.076658 29346 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:13.065127  1123 consensus_queue.cc:1059] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:13:13.083305 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:13:13.094275 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.074126 29455 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
I20260709 13:13:13.096364 29495 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
W20260709 13:13:13.084156 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 111471us
I20260709 13:13:13.101868 29346 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:13.108398 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:13.115768  1145 raft_consensus.cc:2749] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:13.117784   781 consensus_queue.cc:1048] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:13.062952  1138 consensus_queue.cc:1048] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:13:13.122395 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:13.131919  1141 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:13.133575  1141 consensus_queue.cc:1048] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:13.136509   936 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.137166   936 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:13.140250  1122 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:13.140501  1113 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:13.140988  1122 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.141537  1122 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:13.082393  1028 raft_consensus.cc:2749] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:13.143664 29495 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:13.089619   924 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:13.065402   778 consensus_queue.cc:260] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:13.147831   924 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:13.148149  1113 raft_consensus.cc:2804] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:13.148187   778 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:13.149282  1113 raft_consensus.cc:697] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:13.151350  1113 consensus_queue.cc:237] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:13.157431 29495 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:13.111152  1107 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:13.081200  1132 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:13.073331  1128 consensus_queue.cc:1059] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:13:13.120095  1106 raft_consensus.cc:3055] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:13.128844  1123 raft_consensus.cc:2804] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:13.165854 29495 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:13.160862  1089 raft_consensus.cc:3055] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:13:13.178643 29406 heartbeater.cc:646] Failed to heartbeat to 127.27.146.190:37499 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.27.146.190:37499 timed out after 15.000s (SENT)
I20260709 13:13:13.179343   924 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:13.167537  1107 raft_consensus.cc:697] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:13.189430   832 leader_election.cc:290] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:13.190464  1107 consensus_queue.cc:237] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:13.192265  1038 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:13.192976   936 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:13.169076  1050 consensus_queue.cc:1059] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:13:13.179711  1128 raft_consensus.cc:3055] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:13.197341  1128 raft_consensus.cc:740] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:13.199903  1153 raft_consensus.cc:2804] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:13.200045   987 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:13.200644  1153 raft_consensus.cc:697] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:13.201555   929 raft_consensus.cc:3060] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:13.169935  1123 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.201725  1153 consensus_queue.cc:237] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:13.202333  1123 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:13.208755   935 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:13.213286  1122 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:13.189476   924 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:13.216202   928 raft_consensus.cc:3055] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:13.216686   928 raft_consensus.cc:740] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:13.198755  1128 consensus_queue.cc:260] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:13.220759 29346 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:13.221407  1128 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:13.222707 29346 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:13.223258  1043 consensus_queue.cc:260] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:13.224331   877 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:13.228471 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.165199  1106 raft_consensus.cc:740] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:13.232594   832 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:13:13.233207  1124 consensus_meta.cc:287] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.548s	user 0.012s	sys 0.000s
I20260709 13:13:13.232161  1060 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:13.235142 29346 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:13.239140   832 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:13.182020  1089 raft_consensus.cc:740] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:13.240466  1089 consensus_queue.cc:260] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:13.241788  1089 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:13.168035  1103 raft_consensus.cc:2804] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:13:13.254568 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.243348  1132 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:13.254269  1103 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:13.247689 29346 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:13.262773  1041 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.910s	user 0.008s	sys 0.002s
I20260709 13:13:13.258701  1043 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:13.256558   941 consensus_queue.cc:1059] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
W20260709 13:13:13.266543  1041 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.928s	user 0.009s	sys 0.002s
I20260709 13:13:13.276211 29375 raft_consensus.cc:1240] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:13.277475  1084 consensus_queue.cc:260] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:13.263891  1106 consensus_queue.cc:260] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:13.286531 29521 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11.
I20260709 13:13:13.278980  1084 raft_consensus.cc:3060] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:13.292047 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:13.293012 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:13.293840 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:13.296495  1130 log.cc:927] Time spent T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.377s	user 0.004s	sys 0.000s
I20260709 13:13:13.300727  1026 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:13.304615 29376 raft_consensus.cc:2410] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:13:13.305917 29375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52172 (request call id 1791) took 1934 ms. Trace:
I20260709 13:13:13.289992  1041 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:13.306377 29375 rpcz_store.cc:276] 0709 13:13:11.371365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.371881 (+   516us) service_pool.cc:224] Handling call
0709 13:13:11.496768 (+124887us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:13.276810 (+1780042us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:13.305635 (+ 28825us) spinlock_profiling.cc:243] Waited 1.78 s on lock 0x7b54003dbb54. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:13.305848 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4091757312}
I20260709 13:13:13.309072 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:13.310040 29380 raft_consensus.cc:2376] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 12. Re-sending same reply.
I20260709 13:13:13.311797 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:13.312657 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:13.315323 29451 raft_consensus.cc:3055] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:13.315800 29451 raft_consensus.cc:740] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
W20260709 13:13:13.317054 29421 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 2.973s (SENT) [suppressed 57 similar messages]
I20260709 13:13:13.265794  1103 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:13.315958 29373 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11.
I20260709 13:13:13.318650 29452 raft_consensus.cc:1240] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:13:13.322275 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:13.329246 29447 raft_consensus.cc:2468] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:13:13.325627 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:13.315856 29376 raft_consensus.cc:2376] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 10. Re-sending same reply.
I20260709 13:13:13.330883 29453 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
I20260709 13:13:13.316673 29451 consensus_queue.cc:260] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:13.335965 29451 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:13:13.338119 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 172379us
I20260709 13:13:13.339838 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:13.340579 29447 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:13:13.340813 29454 raft_consensus.cc:1275] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:13:13.338984 29495 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:13.346767 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:13.346988 29526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3012) took 1046 ms. Trace:
I20260709 13:13:13.347728 29526 rpcz_store.cc:276] 0709 13:13:12.300719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.301007 (+   288us) service_pool.cc:224] Handling call
0709 13:13:12.301421 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:12.839958 (+538537us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:13.346661 (+506703us) spinlock_profiling.cc:243] Waited 464 ms on lock 0x7b54000cb2d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:13.346907 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1066732416}
I20260709 13:13:13.351486 29419 leader_election.cc:400] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 11. Current term is 12.
I20260709 13:13:13.351930 29419 leader_election.cc:403] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:13.353361 29419 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:13.355134 29419 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:13.355165 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:13:13.355460 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.357210 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:13.357529 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:13.358373 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:13.358455 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:13.357823  1050 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:13.358975 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:13.359392  1050 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:13.360275 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:13.361866 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:13.356823 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:13.362907 29452 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:13.363340 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:13.363778 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:13.370242 29373 raft_consensus.cc:2376] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13. Re-sending same reply.
W20260709 13:13:13.371012 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 53996.3us
I20260709 13:13:13.364276 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:13.372087 29530 raft_consensus.cc:2410] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 16 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:13:13.364471 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:13.373164 29375 raft_consensus.cc:2376] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12. Re-sending same reply.
I20260709 13:13:13.371194 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:13.374312 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:13.374683 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:13.365818 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:13.375893 29374 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
I20260709 13:13:13.376217 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:13.376850 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:13.366086 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:13.377681 29374 raft_consensus.cc:2410] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:13:13.366393 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:13.373036 29421 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:13.365159 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:13.378137 29377 raft_consensus.cc:2376] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12. Re-sending same reply.
I20260709 13:13:13.378427 29379 raft_consensus.cc:2393] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 11: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:13.379069 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:13.379166 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:13.380630 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:13.377584 29378 raft_consensus.cc:2376] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12. Re-sending same reply.
I20260709 13:13:13.383121 29375 raft_consensus.cc:2393] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 11: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:13.366488 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:13.384130 29525 raft_consensus.cc:2393] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 10: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:13.384217 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:13.384739 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:13.384878 29447 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:13.388490 29452 raft_consensus.cc:1275] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:13:13.392971 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:13:13.397348 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.396836 29419 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:13.360899  1038 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:13.400175 29379 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
W20260709 13:13:13.400715 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 136986us
I20260709 13:13:13.396781 29495 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:13.403811 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:13.404410 29421 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:13.404647 29375 raft_consensus.cc:2393] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 9: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:13.364923  1026 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.407893 29447 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
I20260709 13:13:13.408001 29378 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:13:13.375674   893 raft_consensus.cc:2749] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:13:13.410341 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:13.410915 29495 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:13.411755 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:13.413623 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:13.416534 29375 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
I20260709 13:13:13.417821 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:13.419647 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:13.423877  1152 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:13.399992  1052 raft_consensus.cc:2749] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:13.434945 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:13.452399 29377 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:13:13.414309  1124 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:13.467079 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:13.468971 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:13.420117  1038 raft_consensus.cc:697] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:13.413936   924 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.464795 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:13.471468 29346 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:13.458214 29377 raft_consensus.cc:1240] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:13.482091 29379 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:13.483533 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:13.484345 29379 raft_consensus.cc:2393] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 7: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:13.414610  1108 consensus_queue.cc:1048] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:13:13.443651   893 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:13.484386 29377 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:13:13.415529  1026 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:13.486845 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.493265 29381 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
I20260709 13:13:13.488865 29377 raft_consensus.cc:606] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:13.521045 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:13.486586 29346 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:13.523373 29346 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:13.489141 29379 raft_consensus.cc:1240] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:13.485500   778 raft_consensus.cc:2804] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:13.465987  1124 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.489162 29374 raft_consensus.cc:1240] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:13.495597  1150 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 11. Current term is 12.
I20260709 13:13:13.496450  1151 raft_consensus.cc:2749] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:13:13.498587  1157 log.cc:927] Time spent T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:13:13.501721  1050 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:13.504066   893 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:13.505760  1134 raft_consensus.cc:3055] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:13.485986   924 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:13.508980   928 consensus_queue.cc:260] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:13.509586  1038 consensus_queue.cc:237] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:13.510278 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:13.513406  1026 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:13.518698  1147 raft_consensus.cc:493] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.519434 29373 raft_consensus.cc:2376] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12. Re-sending same reply.
W20260709 13:13:13.519661 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 122895us
I20260709 13:13:13.617640 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:13.560065 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:13.620023 29377 raft_consensus.cc:2376] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 13. Re-sending same reply.
I20260709 13:13:13.621507 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:13.622387 29377 raft_consensus.cc:2376] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11. Re-sending same reply.
I20260709 13:13:13.561009 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:13.625288 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:13.626138 29381 raft_consensus.cc:2376] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9. Re-sending same reply.
I20260709 13:13:13.628050 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:13.619128 29451 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
I20260709 13:13:13.633172 29495 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:13.635133  1050 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:13.635776  1050 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.636226  1050 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:13.642653 29495 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:13.644032 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:13.645015 29377 raft_consensus.cc:2376] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11. Re-sending same reply.
I20260709 13:13:13.572587 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:13.537201  1060 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:13.560101   778 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.590026   935 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:13.590557  1124 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:13.606521 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:13.602308  1134 raft_consensus.cc:740] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:13.592984  1037 consensus_queue.cc:1048] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:13:13.648617 29379 raft_consensus.cc:2376] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14. Re-sending same reply.
I20260709 13:13:13.602758  1150 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:13.650049 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:13.652145 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 247821us
I20260709 13:13:13.610282   924 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:13.598049  1123 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:13:13.690330 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.648145  1060 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.722172 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:13.656472  1152 raft_consensus.cc:697] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:13.655292   778 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:13.713416 29421 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:13.715284 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:13.716162 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.655998  1043 raft_consensus.cc:2749] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:13.684913 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:13.674628 29451 raft_consensus.cc:1275] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:13:13.657017   935 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:13.732276 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:13.660387   928 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:13.753319 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:13.724349  1060 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:13.757707 30122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.643806  1147 raft_consensus.cc:515] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:13.762665 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:13.777210 29374 raft_consensus.cc:2393] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 10: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:13.794776 29372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52172 (request call id 1813) took 2047 ms. Trace:
I20260709 13:13:13.760999   935 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:13.795418 29372 rpcz_store.cc:276] 0709 13:13:11.742120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.812431 (+ 70311us) service_pool.cc:224] Handling call
0709 13:13:13.789453 (+1977022us) spinlock_profiling.cc:243] Waited 873 ms on lock 0x7b54001905d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:13.789634 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2008086784}
I20260709 13:13:13.733167   936 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:13.805123   936 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:13.807585  1163 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:13:13.799798  1128 consensus_meta.cc:287] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.578s	user 0.007s	sys 0.007s
W20260709 13:13:13.836275 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.858858  1123 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:13.862900  1147 leader_election.cc:290] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:13.863981 29450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2410) took 3025 ms. Trace:
I20260709 13:13:13.864562 29450 rpcz_store.cc:276] 0709 13:13:10.838259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:11.412742 (+574483us) service_pool.cc:224] Handling call
0709 13:13:11.507678 (+ 94936us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:11.731530 (+223852us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:13:11.825746 (+ 94216us) log.cc:844] Serialized 14 byte log entry
0709 13:13:12.286209 (+460463us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:12.286737 (+   528us) log.cc:844] Serialized 26 byte log entry
0709 13:13:12.286930 (+   193us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:12.287220 (+   290us) log.cc:844] Serialized 14 byte log entry
0709 13:13:12.374482 (+ 87262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:12.374598 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:12.434722 (+ 60124us) spinlock_profiling.cc:243] Waited 5.79 ms on lock 0x7b180034e880. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c99522 00007f6a78c9b7c1 00007f6a78c9b779 00007f6a78c9b709 00007f6a78c9b6d1 00007f6a78c9a9cd 000000000038f354 000000000038f199 00007f6a78c7c83a
0709 13:13:13.858471 (+1423749us) spinlock_profiling.cc:243] Waited 9.61 ms on lock 0x7b24001c96b8. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78b1f9c4 00007f6a78b1dacb 00007f6a78cd8dc9 00007f6a78cd8a55 00007f6a78cd7fb0 00007f6a7b94e488 00007f6a7b94ebe8 00007f6a7b926398 00007f6a7b92176a 00007f6a7b920bb6
0709 13:13:13.863666 (+  5195us) raft_consensus.cc:1685] finished
0709 13:13:13.863701 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:13.863896 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":178799,"prepare.queue_time_us":121215,"prepare.run_cpu_time_us":121,"prepare.run_wall_time_us":8222,"raft.queue_time_us":171302,"raft.run_cpu_time_us":468,"raft.run_wall_time_us":50261,"spinlock_wait_cycles":35418112,"thread_start_us":596823,"threads_started":3,"wal-append.queue_time_us":347624}
I20260709 13:13:13.837428  1026 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.867985  1026 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:13.870842  1026 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:13.807637  1152 consensus_queue.cc:237] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:13.880764  1103 consensus_meta.cc:287] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.542s	user 0.012s	sys 0.000s
I20260709 13:13:13.881554  1103 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:13.887079  1166 consensus_queue.cc:1048] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:13:13.890931  1142 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
W20260709 13:13:13.897799  1135 log.cc:927] Time spent T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.986s	user 0.003s	sys 0.001s
I20260709 13:13:13.881891 29527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3020) took 1386 ms. Trace:
I20260709 13:13:13.899143 29527 rpcz_store.cc:276] 0709 13:13:12.495668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:12.496331 (+   663us) service_pool.cc:224] Handling call
0709 13:13:12.496783 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:13.017220 (+520437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:13.881535 (+864315us) spinlock_profiling.cc:243] Waited 520 ms on lock 0x7b54000b63d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:13.881801 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1195260288}
I20260709 13:13:13.887444  1103 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:13.875173 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
W20260709 13:13:13.908607 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 178663us
I20260709 13:13:13.908623 30157 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:13.909763 29421 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:13:13.905733 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:13.913126 29421 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:13.920094 29421 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:13.917032  1089 consensus_meta.cc:287] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.675s	user 0.005s	sys 0.009s
I20260709 13:13:13.923686  1131 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:13:13.928416  1168 log.cc:927] Time spent T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:13:13.914971  1121 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:13.935842 29421 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:13.971876 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:13.979517 30158 raft_consensus.cc:2468] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
W20260709 13:13:13.983729 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 48005us
I20260709 13:13:13.986667   778 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:13.933327  1102 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:13:13.995826 30157 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
I20260709 13:13:14.000532 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:14.001246 29527 raft_consensus.cc:2468] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 3.
I20260709 13:13:13.987847  1150 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:14.004437  1018 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.004817   778 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:14.002933  1103 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:14.004967  1018 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:14.005656  1103 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:14.007251  1018 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:14.011014  1103 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:14.016057 29528 raft_consensus.cc:1240] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 LEADER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 10. Current term is 11. Ops: []
W20260709 13:13:13.995980  1170 log.cc:927] Time spent T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:13:14.026052  1150 raft_consensus.cc:697] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 15 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:14.041447  1050 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:14.035707   940 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:14.045576   999 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:14.049726   940 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:14.060446  1150 consensus_queue.cc:237] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:14.124181 29344 leader_election.cc:304] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:13:13.931674 29376 raft_consensus.cc:1275] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:13:14.137674 29419 leader_election.cc:336] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.506s (SENT)
I20260709 13:13:14.140676 29421 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:14.145632 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:14.146449 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.153208 29421 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:14.158826 29528 raft_consensus.cc:1240] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:14.055719   935 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:14.174829  1152 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:14.059671   940 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:14.165766 29421 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:14.175446  1050 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:14.182128  1150 raft_consensus.cc:2804] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:14.180078  1137 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.183918 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:14.184572  1137 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:14.187996   832 raft_consensus.cc:2804] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:14.188616   832 raft_consensus.cc:493] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:14.188428  1060 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:14.189519  1137 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:14.183239  1150 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:14.180521   892 consensus_queue.cc:1059] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:13:14.190738  1150 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:14.191259   892 raft_consensus.cc:3055] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:14.181044  1152 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:14.191794  1171 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:14.180860 29421 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:14.193383  1132 raft_consensus.cc:2804] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:14.194065  1132 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:14.194569  1132 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:14.194662  1152 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:14.191859   892 raft_consensus.cc:740] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:14.180929  1153 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.196729  1153 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:14.197780 29421 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:14.193397  1171 raft_consensus.cc:2804] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:14.198398   892 consensus_queue.cc:260] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:14.164022 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:14.201267 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:14.202091 29527 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:13:14.207845  1171 raft_consensus.cc:697] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 11 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:14.208232  1166 raft_consensus.cc:2804] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:14.209151  1166 raft_consensus.cc:697] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:14.191567   935 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:14.186981 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:14.189240   832 raft_consensus.cc:3060] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:14.203305 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:14.212571 29526 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 8.
I20260709 13:13:14.213195 29527 raft_consensus.cc:2393] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 7: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:14.215359  1060 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:14.217063  1153 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:14.217597  1166 consensus_queue.cc:237] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:14.220373 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:14.209906  1171 consensus_queue.cc:237] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:14.221968 29526 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:13:14.220469 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:14.175180 30119 leader_election.cc:304] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:13:14.232081  1060 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.233096  1060 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:14.236652  1060 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:14.231660 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:14.238862 29528 raft_consensus.cc:2468] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
I20260709 13:13:14.240497   935 consensus_queue.cc:1059] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:14.242375 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:14.242642  1041 raft_consensus.cc:3055] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:14.243147  1041 raft_consensus.cc:740] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:14.244724  1041 consensus_queue.cc:260] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:14.245597 29524 raft_consensus.cc:1275] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:13:14.246153 29372 raft_consensus.cc:1275] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:13:14.246039 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:14.247131 29373 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
I20260709 13:13:14.219461  1134 consensus_queue.cc:260] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:14.250768   778 consensus_queue.cc:1059] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:14.253893   778 consensus_queue.cc:1243] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer 71aa3578fd924765ab9ac0729c8d1483 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:13:14.254127  1134 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:14.254603   778 raft_consensus.cc:3055] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:14.255118   778 raft_consensus.cc:740] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:14.216584 29421 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:14.256742 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:14.272054 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.265381   778 consensus_queue.cc:260] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:14.275552   778 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:14.274011 29454 raft_consensus.cc:1275] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:13:14.268138 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 93508.8us
I20260709 13:13:14.278791  1167 raft_consensus.cc:2804] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:14.285879   936 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:14.286108 29453 raft_consensus.cc:1275] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:13:14.280831  1167 raft_consensus.cc:697] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 11 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:14.279340  1159 raft_consensus.cc:2804] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:13:14.296634 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 80431.1us
I20260709 13:13:14.277074  1153 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.304558 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:14.300603 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:14.306813 29530 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:14.306418 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:14.307960 29448 raft_consensus.cc:1275] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:13:14.311895 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 51831.8us
I20260709 13:13:14.314862 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:14.305382  1159 raft_consensus.cc:493] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:14.322558 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:14.336172  1159 raft_consensus.cc:3060] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:14.340955  1167 consensus_queue.cc:237] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:13:14.323112 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:14.324025 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:14.324505 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:14.324060 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:14.321357 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:14.325491 29521 raft_consensus.cc:1240] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:14.326450 29526 raft_consensus.cc:1240] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:14.330828 29524 raft_consensus.cc:1275] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:13:14.331933 30122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:14.335551  1169 log.cc:927] Time spent T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.407s	user 0.002s	sys 0.004s
W20260709 13:13:14.353185 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 51315.8us
I20260709 13:13:14.361434  1026 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.362340  1026 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:14.363230 29421 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:14.384917 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 68301.2us
I20260709 13:13:14.364902  1132 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:14.368235 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:14.369520 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:14.374650 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:14.376928 29451 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:13:14.377637 29448 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:14.380295  1166 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.347293  1153 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:14.398366 29452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 1540) took 1029 ms. Trace:
I20260709 13:13:14.394166  1166 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:14.398937 29452 rpcz_store.cc:276] 0709 13:13:13.368516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.389332 (+ 20816us) service_pool.cc:224] Handling call
0709 13:13:13.389631 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:13.390334 (+   703us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:13:13.391944 (+  1610us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:13.412043 (+ 20099us) log.cc:844] Serialized 26 byte log entry
0709 13:13:13.641754 (+229711us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:13.641822 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:13.641927 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:14.299824 (+657897us) spinlock_profiling.cc:243] Waited 2.73 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:13:14.397788 (+ 97964us) raft_consensus.cc:1685] finished
0709 13:13:14.397809 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:14.398173 (+   364us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":132,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":106,"spinlock_wait_cycles":6275968,"thread_start_us":166744,"threads_started":1,"wal-append.queue_time_us":328687}
I20260709 13:13:14.401104   999 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:14.401656  1153 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:14.400367 29421 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:14.408336 29530 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
W20260709 13:13:14.408581 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 69593us
I20260709 13:13:14.410872 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:14.411397   999 raft_consensus.cc:697] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 15 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:14.411799 29379 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:14.412019  1106 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:14.413033   999 consensus_queue.cc:237] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:14.416064 29455 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 8.
I20260709 13:13:14.422360   888 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:14.423103   888 raft_consensus.cc:697] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 13 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:14.424415   888 consensus_queue.cc:237] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:14.429128 29421 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:14.430233  1026 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:14.430528  1151 raft_consensus.cc:2749] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:14.432708 29421 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:14.435379 29453 raft_consensus.cc:1240] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
W20260709 13:13:14.450700 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.423192  1041 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:14.450773 29344 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:14.452780  1146 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:13:14.436185  1124 consensus_meta.cc:287] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.746s	user 0.013s	sys 0.013s
I20260709 13:13:14.453938  1124 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:14.454792 29344 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:14.455967  1146 raft_consensus.cc:2804] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:14.443857 29376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1433) took 1076 ms. Trace:
I20260709 13:13:14.444651  1054 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.445927   917 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.456382  1146 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:14.456722 29376 rpcz_store.cc:276] 0709 13:13:13.367411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.381511 (+ 14100us) service_pool.cc:224] Handling call
0709 13:13:13.931145 (+549634us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:14.134043 (+202898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:14.443381 (+309338us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b54003b0950. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd858ad 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:14.443631 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1263276288}
I20260709 13:13:14.459085  1132 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:14.472373  1132 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:14.472983 29421 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:14.474825  1165 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:14.475458  1165 raft_consensus.cc:697] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 12 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:14.465011   917 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:14.472527 29380 raft_consensus.cc:1240] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:14.473308  1132 raft_consensus.cc:697] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:14.466759  1146 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:14.478721   917 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:14.479112  1132 consensus_queue.cc:237] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:14.487660 29378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1444) took 1051 ms. Trace:
I20260709 13:13:14.488262  1054 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:13:14.481119 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.488291 29378 rpcz_store.cc:276] 0709 13:13:13.436335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:13.437268 (+   933us) service_pool.cc:224] Handling call
0709 13:13:13.437855 (+   587us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:13.451104 (+ 13249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:13.451153 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:13.452100 (+   947us) log.cc:844] Serialized 52 byte log entry
0709 13:13:13.656000 (+203900us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:13.910903 (+254903us) log.cc:844] Serialized 14 byte log entry
0709 13:13:13.921823 (+ 10920us) log.cc:844] Serialized 14 byte log entry
0709 13:13:14.277844 (+356021us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b1800333d60. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c7be07 00007f6a81ad6ab9 00007f6a78c9869b 00007f6a78c9693f 00007f6a78c96455 00007f6a7bd7e060 00007f6a7bd90716 00007f6a7bda1287 00007f6a7bda1208
0709 13:13:14.405610 (+127766us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:14.417968 (+ 12358us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:14.467176 (+ 49208us) raft_consensus.cc:1685] finished
0709 13:13:14.467211 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:14.487359 (+ 20148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13696,"prepare.queue_time_us":438473,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":93,"raft.queue_time_us":69747,"raft.run_cpu_time_us":674,"raft.run_wall_time_us":29580,"spinlock_wait_cycles":484693760,"thread_start_us":433435,"threads_started":3,"wal-append.queue_time_us":320699}
I20260709 13:13:14.498437  1166 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:14.501427 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 44179.5us
I20260709 13:13:14.475469 29421 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:14.491176  1054 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:14.515638 29379 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
I20260709 13:13:14.442363  1159 raft_consensus.cc:515] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:14.522204  1153 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.523280  1153 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:14.526250  1153 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:14.526880  1159 leader_election.cc:290] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:14.528048 29448 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
I20260709 13:13:14.505497  1124 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:14.511826   917 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:14.541483 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 67546us
I20260709 13:13:14.535458 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:14.544533 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.554031 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:14.554517 30121 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:13:14.551679  1166 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:14.507951  1165 consensus_queue.cc:237] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:14.540544  1150 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:14.566789 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:14.564785 29529 raft_consensus.cc:1240] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 9. Current term is 10. Ops: []
W20260709 13:13:14.571686 29327 auto_rebalancer.cc:893] Removing replace marker failed: Replica 71aa3578fd924765ab9ac0729c8d1483 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } } pending_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
W20260709 13:13:14.568007 29277 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37586 (request call id 136) took 15945 ms (client timeout 15000 ms). Trace:
I20260709 13:13:14.576102 29526 raft_consensus.cc:1240] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 6. Current term is 7. Ops: []
W20260709 13:13:14.576792 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.577545 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:14.555927  1137 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:13:14.578575 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 103274us
W20260709 13:13:14.579535 29327 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:13:14.579984 29327 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:13:14.581368  1137 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:14.568037  1128 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:14.579994 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:14.584040  1137 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:14.584247  1147 raft_consensus.cc:2804] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:14.584687  1147 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:14.584059  1128 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:14.585186  1147 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:14.592852 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:14.555029   917 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:14.594967 29522 raft_consensus.cc:3060] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:14.596622 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.597545 29379 raft_consensus.cc:2393] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 16: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:14.598502 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:14.605811 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:14.611442 29421 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:14.614109 29378 raft_consensus.cc:1240] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:14.613812 29279 catalog_manager.cc:5697] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 10 to 11, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 11 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:14.620241 29448 raft_consensus.cc:2468] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 9.
I20260709 13:13:14.631589 29268 maintenance_manager.cc:419] P 4fe079bd41744b15a21e1f8c8d83890b: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033353
I20260709 13:13:14.619059  1137 consensus_queue.cc:1048] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.020s
W20260709 13:13:14.641202 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:14.644991 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.648892   781 consensus_queue.cc:1048] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:14.650249  1145 consensus_queue.cc:1059] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:14.651587 29344 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:14.658715 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:14.659382 29376 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:14.664655 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:14.670439 29279 catalog_manager.cc:5697] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 10 to 11, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 11 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:14.671936   781 raft_consensus.cc:3055] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:14.672415   781 raft_consensus.cc:740] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:14.672559 29279 catalog_manager.cc:5697] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 9 to 10, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 10 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:14.673756 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:14.673451   781 consensus_queue.cc:260] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:14.674172 29279 catalog_manager.cc:5697] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 11 to 12, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 12 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:14.675066 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:14.662206  1026 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:14.675210   781 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:14.678081   917 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:14.678232  1196 log.cc:927] Time spent T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:13:14.680802  1026 raft_consensus.cc:697] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:14.680962  1128 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:14.662112   892 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:14.682430  1026 consensus_queue.cc:237] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:14.660952  1171 raft_consensus.cc:2749] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:14.689327  1150 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:14.691788 29526 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 10.
I20260709 13:13:14.706502 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:14.707523 29530 raft_consensus.cc:2410] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
W20260709 13:13:14.707854 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.686048 29276 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35182 (request call id 68) took 8263 ms. Trace:
I20260709 13:13:14.723163 29376 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
I20260709 13:13:14.724599 29522 raft_consensus.cc:2468] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 4.
I20260709 13:13:14.619282  1190 consensus_queue.cc:1048] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.120s
W20260709 13:13:14.727229 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 123878us
I20260709 13:13:14.654433   832 raft_consensus.cc:515] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:14.730677 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:14.734905 29526 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
W20260709 13:13:14.729815 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 83911.5us
I20260709 13:13:14.732847 30119 leader_election.cc:304] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:13:14.661509   888 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:14.735745 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:14.745884 29344 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:14.728235  1128 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:14.574297 29277 rpcz_store.cc:269] 0709 13:12:58.619159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:58.619394 (+   235us) service_pool.cc:224] Handling call
0709 13:13:14.563199 (+15943805us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:05.440346 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:05.441300 (+   954us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:05.441367 (+    67us) write_op.cc:435] Acquired schema lock
0709 13:13:05.441405 (+    38us) tablet.cc:662] Decoding operations
0709 13:13:05.446609 (+  5204us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:05.446730 (+   121us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:05.446775 (+    45us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:13:05.449220 (+  2445us) tablet.cc:701] Row locks acquired
0709 13:13:05.449282 (+    62us) write_op.cc:260] PREPARE: finished
0709 13:13:05.449597 (+   315us) write_op.cc:270] Start()
0709 13:13:05.449791 (+   194us) write_op.cc:276] Timestamp: P: 1783602785449445 usec, L: 0
0709 13:13:05.449821 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:13:05.451034 (+  1213us) log.cc:844] Serialized 7187 byte log entry
0709 13:13:05.994418 (+543384us) op_driver.cc:464] REPLICATION: finished
0709 13:13:06.474850 (+480432us) write_op.cc:301] APPLY: starting
0709 13:13:06.501738 (+ 26888us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:06.649090 (+147352us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:06.656308 (+  7218us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:06.823260 (+166952us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:06.823761 (+   501us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 13:13:06.823901 (+   140us) write_op.cc:312] APPLY: finished
0709 13:13:06.908510 (+ 84609us) log.cc:844] Serialized 124 byte log entry
0709 13:13:07.120909 (+212399us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:07.154004 (+ 33095us) write_op.cc:454] Released schema lock
0709 13:13:07.171831 (+ 17827us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:07.244006 (+ 72175us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:07.244052 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":655898,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":445739,"apply.run_cpu_time_us":50313,"apply.run_wall_time_us":773216,"num_ops":18,"prepare.queue_time_us":109325,"prepare.run_cpu_time_us":16458,"prepare.run_wall_time_us":35941,"raft.queue_time_us":249117,"raft.run_cpu_time_us":54425,"raft.run_wall_time_us":299927,"replication_time_us":529960,"thread_start_us":540192,"threads_started":5,"wal-append.queue_time_us":407450,"wal-append.run_cpu_time_us":19444,"wal-append.run_wall_time_us":2402354}]]}
I20260709 13:13:14.797842 29375 raft_consensus.cc:2393] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in current term 4: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:14.799180 29421 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:14.800271 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.768353  1159 raft_consensus.cc:2804] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:14.807790  1186 consensus_queue.cc:1059] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 13:13:14.809404  1186 raft_consensus.cc:3055] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:14.809865  1186 raft_consensus.cc:740] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:14.821195  1186 consensus_queue.cc:260] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:14.823108  1186 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:14.782020  1134 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:14.803105   936 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.829842 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:14.839553 29376 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:13:14.840951  1165 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:14.841230  1124 consensus_queue.cc:1048] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:14.842697   832 leader_election.cc:290] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 election: Requested vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:14.847023 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:13:14.842707 29279 catalog_manager.cc:5697] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 11 to 14, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 14 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:14.831789  1134 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:14.714157 29276 rpcz_store.cc:276] 0709 13:13:06.422079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.422280 (+   201us) service_pool.cc:224] Handling call
0709 13:13:14.685715 (+8263435us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:11.771382 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:11.771995 (+   613us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:11.772041 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:13:11.772060 (+    19us) tablet.cc:662] Decoding operations
0709 13:13:11.772692 (+   632us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:11.772781 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:11.772809 (+    28us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:13:11.773163 (+   354us) tablet.cc:701] Row locks acquired
0709 13:13:11.773184 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:13:11.773345 (+   161us) write_op.cc:270] Start()
0709 13:13:11.773469 (+   124us) write_op.cc:276] Timestamp: P: 1783602791773283 usec, L: 0
0709 13:13:11.773490 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:13:12.036826 (+263336us) log.cc:844] Serialized 1689 byte log entry
0709 13:13:12.538488 (+501662us) op_driver.cc:464] REPLICATION: finished
0709 13:13:12.644032 (+105544us) write_op.cc:301] APPLY: starting
0709 13:13:12.644131 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:12.644286 (+   155us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:12.644440 (+   154us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:12.644934 (+   494us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:12.645123 (+   189us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:13:12.645164 (+    41us) write_op.cc:312] APPLY: finished
0709 13:13:12.645390 (+   226us) log.cc:844] Serialized 34 byte log entry
0709 13:13:12.645590 (+   200us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:12.645690 (+   100us) write_op.cc:454] Released schema lock
0709 13:13:12.645734 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:12.716091 (+ 70357us) spinlock_profiling.cc:243] Waited 35.1 ms on lock 0x7b5400422054. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd81e28 00007f6a7f7bc581 00007f6a7f7bbd58 00007f6a7f7c09f1 00007f6a7f7c09a9 00007f6a7f7c0939 00007f6a7f7c0901 00007f6a7f7bfb2d 000000000038f354 000000000038f199
0709 13:13:12.716354 (+   263us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:12.716390 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2644641,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":105226,"apply.run_cpu_time_us":2086,"apply.run_wall_time_us":2087,"num_ops":3,"prepare.queue_time_us":247311,"prepare.run_cpu_time_us":60121,"prepare.run_wall_time_us":957409,"raft.queue_time_us":110254,"raft.run_cpu_time_us":15844,"raft.run_wall_time_us":53477,"replication_time_us":764838,"spinlock_wait_cycles":80773376,"thread_start_us":513254,"threads_started":4,"wal-append.queue_time_us":341254,"wal-append.run_cpu_time_us":29271,"wal-append.run_wall_time_us":1261265}]]}
I20260709 13:13:14.796098   888 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:14.854471 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:14.858662 29529 raft_consensus.cc:2393] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 4: Already voted for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in this term.
W20260709 13:13:14.859144 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.837347   936 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:14.840346  1159 raft_consensus.cc:697] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:13:14.831200  1128 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:14.843906  1150 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:14.872303  1159 consensus_queue.cc:237] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:14.873623   936 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:14.874115 29279 catalog_manager.cc:5697] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 8 to 9, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 9 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
W20260709 13:13:14.878046  1197 log.cc:927] Time spent T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
W20260709 13:13:14.878906 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 115530us
I20260709 13:13:14.855631  1134 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:14.889798 29279 catalog_manager.cc:5697] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 10 to 12, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 12 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:14.896309 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:14.897292 29524 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:13:14.859344  1146 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:14.915930  1174 consensus_queue.cc:1048] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:13:14.923840 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 186077us
I20260709 13:13:14.926012 29373 raft_consensus.cc:2393] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 12: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:14.922111 29421 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:14.892336  1106 consensus_queue.cc:1048] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:13:14.932382 29344 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:14.903482  1150 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:14.940734 30121 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:14.943454  1199 log.cc:927] Time spent T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:13:14.953364  1087 raft_consensus.cc:2804] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:14.959162  1087 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:14.959574  1087 raft_consensus.cc:3060] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:14.960386   936 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:14.961119   936 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:14.942008  1190 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.972136  1190 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:14.974045   888 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:14.974629  1190 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:14.952265  1167 raft_consensus.cc:2749] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:14.947886   917 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:14.978518   778 consensus_meta.cc:287] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.702s	user 0.014s	sys 0.002s
I20260709 13:13:14.997251 29279 catalog_manager.cc:5697] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 7 to 8, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 8 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
W20260709 13:13:15.009522 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:14.987195  1190 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.034372  1137 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.035172  1166 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:15.035063  1137 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:15.035778 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 130788us
I20260709 13:13:15.035934 29495 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:15.036674 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 86178us
I20260709 13:13:15.036815 29421 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:15.037360  1137 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:15.037509  1203 log.cc:927] Time spent T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:13:15.037799  1136 raft_consensus.cc:2804] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:15.038262  1136 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.038619  1136 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:15.039229  1124 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:15.039673  1124 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.040066  1124 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:15.040972   892 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.041468   892 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:15.038884 29279 catalog_manager.cc:5697] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 8 to 10, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 10 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:15.038571 29495 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:15.043744  1206 log.cc:927] Time spent T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:13:15.043684 29279 catalog_manager.cc:5697] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:15.044555  1145 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.045185  1145 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:15.045495 29279 catalog_manager.cc:5697] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 5 to 6, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 6 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:15.048070 29279 catalog_manager.cc:5697] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 10 to 13, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 13 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:15.050073 29279 catalog_manager.cc:5697] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 10 to 11, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 11 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:15.050577  1124 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:15.052874  1124 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:15.053505  1124 consensus_queue.cc:1059] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:15.053326  1087 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:15.055991  1087 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 10 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:15.056934 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:15.059187   892 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:15.038967   778 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.061570   778 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:15.062382  1106 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:15.063002  1106 raft_consensus.cc:697] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:15.062227 29279 catalog_manager.cc:5697] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 8 to 10, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 10 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
W20260709 13:13:15.085959 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 49259.6us
I20260709 13:13:15.088967 29421 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:15.089519   778 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:15.065260 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:15.097842 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:15.098764 29527 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
W20260709 13:13:15.111840 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.047374  1145 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:15.089931  1167 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:15.120733 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:15.100515  1166 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:15.136235 29279 catalog_manager.cc:5697] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:15.138415 29279 catalog_manager.cc:5697] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
W20260709 13:13:15.142055 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 53279.2us
I20260709 13:13:15.143193 29421 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:15.144136   888 raft_consensus.cc:2764] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:13:15.111297  1137 raft_consensus.cc:3055] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:15.149530  1137 raft_consensus.cc:740] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:15.152334  1137 consensus_queue.cc:260] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:15.159795  1128 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:15.161135  1137 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:15.163671  1106 consensus_queue.cc:237] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:15.158614  1136 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:15.168216  1167 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:15.169919  1167 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:15.172683  1167 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:15.174918  1136 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:15.174986  1147 consensus_meta.cc:287] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent flushing consensus metadata: real 0.589s	user 0.000s	sys 0.011s
W20260709 13:13:15.168942 29421 connection.cc:256] RPC call timeout handler was delayed by -1.9739932640000006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33490000000000003s for a response
I20260709 13:13:15.175328   936 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:15.096073  1190 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:15.082259   917 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:15.187083 29421 connection.cc:256] RPC call timeout handler was delayed by -1.1995988570001828s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1506s for a response
I20260709 13:13:15.154639  1146 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:15.153592  1166 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:15.193424 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 190841us
W20260709 13:13:15.193719 29421 connection.cc:256] RPC call timeout handler was delayed by -1.1482988570000998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1563s for a response
W20260709 13:13:15.196698 29421 connection.cc:256] RPC call timeout handler was delayed by -1.0051988570000958s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17220000000000002s for a response
W20260709 13:13:15.201715 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 163218us
W20260709 13:13:15.205960 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.196285  1166 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:15.214771 29452 raft_consensus.cc:1240] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:15.216406 29454 raft_consensus.cc:1275] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:13:15.236181 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:15.236725 29448 raft_consensus.cc:1275] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:13:15.236990 29451 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:13:15.231361 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:15.238147 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:15.238853 29455 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:15.240132   917 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:15.242046  1150 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:15.249294 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:15.190227  1147 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:15.250406 29454 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
I20260709 13:13:15.251421 30158 raft_consensus.cc:1240] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:15.253072  1147 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:15.224713   999 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.253924   999 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:15.254819  1190 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:15.256618   999 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:15.262140 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:13:15.262517 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.232172  1134 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:15.268391  1134 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:15.268705 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:15.269510 29449 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
I20260709 13:13:15.272956 29448 raft_consensus.cc:1275] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:13:15.274380 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.279999 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:15.280745 29454 raft_consensus.cc:3060] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:15.283341 29452 raft_consensus.cc:1275] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:13:15.291955 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:13:15.294023  1208 log.cc:927] Time spent T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.172s	user 0.002s	sys 0.000s
I20260709 13:13:15.296803   917 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.297524   917 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:15.298650  1165 consensus_queue.cc:1059] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:13:15.302201 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:15.302677 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:15.302989 29452 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:15.305387   917 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:15.307813 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:15.308645 29451 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 15.
W20260709 13:13:15.311784 29421 leader_election.cc:336] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.506s (SENT)
I20260709 13:13:15.312366 29421 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:15.318316  1165 raft_consensus.cc:3055] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:15.318903  1165 raft_consensus.cc:740] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:15.322005 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:15.327016 29344 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:15.332625 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:15.333443 29528 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:15.323174 29419 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:15.334961 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:15.336668 29523 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:15.338688 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:15.338855 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:15.339527 29530 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:15.319937  1165 consensus_queue.cc:260] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:15.345528 29527 raft_consensus.cc:1275] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:13:15.347803 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:15.347887 30119 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:15.348676 29524 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:13:15.349100  1147 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:13:15.349807 29421 leader_election.cc:336] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.563s (SENT)
I20260709 13:13:15.350301 29421 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:15.360656  1166 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:15.366268 29452 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 9.
I20260709 13:13:15.366302 29344 leader_election.cc:304] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:15.367865 30155 raft_consensus.cc:1240] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 12 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:15.369711   999 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:13:15.373389 29421 leader_election.cc:336] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.722s (SENT)
I20260709 13:13:15.374118 29421 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:15.336352   935 raft_consensus.cc:2804] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:13:15.387277 29495 leader_election.cc:336] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.688s (SENT)
W20260709 13:13:15.387753 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.389576 29495 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:13:15.391326 29495 leader_election.cc:336] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.689s (SENT)
I20260709 13:13:15.350517  1150 raft_consensus.cc:2804] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:15.375715   999 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:13:15.403460 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:15.404301 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:15.407326 29451 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:15.409922 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.384903  1132 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:13:15.393290   892 raft_consensus.cc:2749] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:15.401996   781 consensus_queue.cc:1059] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:13:15.411868  1165 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:15.388795   935 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.415773   781 raft_consensus.cc:3055] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:15.425302   781 raft_consensus.cc:740] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:13:15.417265  1218 log.cc:927] Time spent T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:13:15.394886  1153 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.419900   935 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:15.426949  1153 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:15.420331 29449 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
I20260709 13:13:15.428746  1132 consensus_queue.cc:1059] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:15.429618  1132 consensus_queue.cc:1243] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer ca041dab9b2f44409ed7bf4c6cf66ab2 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:13:15.430203  1132 raft_consensus.cc:3055] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:15.430534  1132 raft_consensus.cc:740] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:15.392820  1213 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:13:15.401764  1150 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.433815  1181 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:15.434062  1150 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:15.434474  1181 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:15.429546  1153 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:15.437757 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:15.443046 29455 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 15.
I20260709 13:13:15.444679 29449 raft_consensus.cc:1240] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:13:15.447088 29344 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:15.452790 29454 raft_consensus.cc:2468] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 10.
I20260709 13:13:15.388600 29528 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 14.
I20260709 13:13:15.454768 29451 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:15.454660 30121 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:15.400276 29530 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:13:15.452315  1145 raft_consensus.cc:2804] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:15.431444  1132 consensus_queue.cc:260] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:13:15.460668  1209 raft_consensus.cc:2804] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:15.461544  1209 raft_consensus.cc:697] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:13:15.453330  1134 consensus_queue.cc:1048] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:13:15.463375   999 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.463980   999 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:15.467031 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.467741  1145 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.468467  1145 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:15.479619 29523 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
I20260709 13:13:15.478605   781 consensus_queue.cc:260] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:13:15.483654   892 consensus_queue.cc:1175] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "71aa3578fd924765ab9ac0729c8d1483" responder_term: 8 status { last_received { term: 8 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 8 index: 6 } }
I20260709 13:13:15.484061   781 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:15.462960  1209 consensus_queue.cc:237] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:13:15.489048 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.492275 29344 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:15.494053  1190 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:15.494619  1190 raft_consensus.cc:697] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:15.495671  1190 consensus_queue.cc:237] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:15.498993 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 106607us
I20260709 13:13:15.503086 29344 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:15.504331 29344 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:15.520394 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.511919   832 raft_consensus.cc:2804] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:13:15.535105 29421 leader_election.cc:336] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 2.024s (SENT)
I20260709 13:13:15.531756   892 raft_consensus.cc:2804] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:15.531530  1132 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:15.535687  1134 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:15.553551 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.541486 29421 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:15.564863   935 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:15.566423 28234 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:13:15.567641  1181 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:15.568058 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:15.569636  1221 log.cc:927] Time spent T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:13:15.575896   892 raft_consensus.cc:697] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:15.580065  1166 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:15.581918   999 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:15.584599 29451 raft_consensus.cc:1240] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 11. Current term is 12. Ops: []
W20260709 13:13:15.609256 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:15.617105 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 167910us
I20260709 13:13:15.554359   832 raft_consensus.cc:697] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:15.668282 29373 raft_consensus.cc:1275] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:13:15.669927 29530 raft_consensus.cc:1275] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:13:15.973663  1145 consensus_meta.cc:287] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.505s	user 0.015s	sys 0.005s
I20260709 13:13:15.955188 28234 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:13:15.884958 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.671674  1146 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:15.697919 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:15.788825 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:16.066506 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:16.067565 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:16.068020 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:15.681262  1136 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.676054  1134 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:15.948078 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 260216us
I20260709 13:13:16.001330 29453 raft_consensus.cc:1240] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 10. Current term is 11. Ops: []
W20260709 13:13:15.973667 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 442040us
I20260709 13:13:15.975760  1165 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:16.044318   832 consensus_queue.cc:237] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:15.980391  1150 consensus_meta.cc:287] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.546s	user 0.015s	sys 0.002s
I20260709 13:13:16.091259 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:16.081282   781 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:16.127004 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.052819  1145 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:16.131990  1165 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:13:16.133189 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 87083.9us
I20260709 13:13:16.084112  1209 consensus_queue.cc:1048] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:13:16.085737  1136 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:16.083613  1146 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:16.155342 29450 raft_consensus.cc:1240] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:16.093997  1150 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:16.166538 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.180020  1134 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:16.182487  1145 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:16.157685   935 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:16.139544   781 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:16.184005 29528 raft_consensus.cc:3060] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:13:16.185106 29448 raft_consensus.cc:1240] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:16.185321   781 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:16.186273 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:16.187399 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:16.188269  1232 log.cc:927] Time spent T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:13:16.190835 29495 leader_election.cc:304] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:16.191063 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:16.205659 29495 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:16.142758   892 consensus_queue.cc:237] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:16.208655  1231 log.cc:927] Time spent T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 13:13:16.207715  1216 raft_consensus.cc:2749] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:16.211669  1153 raft_consensus.cc:2804] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:16.212144  1153 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:16.212615  1153 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:16.213023  1150 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:16.216480  1229 log.cc:927] Time spent T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:13:16.156287  1165 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:16.234599 29528 raft_consensus.cc:1275] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:13:16.237064 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 151321us
I20260709 13:13:16.239465 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:16.245772  1236 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.264526  1236 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:13:16.248944   935 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.268085   935 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:16.273728 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:16.274209 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 68708.7us
I20260709 13:13:16.275063 29448 raft_consensus.cc:2393] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 12: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:16.275542 29495 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:16.276655 29448 pending_rounds.cc:85] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 6
I20260709 13:13:16.277078 29448 pending_rounds.cc:107] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:13:16.277441 29448 raft_consensus.cc:2889] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:16.278512 29495 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:16.279814  1216 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:13:16.289175 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.271109   935 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:16.242728  1212 consensus_queue.cc:1048] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:13:16.313863  1240 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.340339  1146 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:16.341380  1240 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:16.343712  1240 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:16.335830 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 185950us
W20260709 13:13:16.345481 29421 leader_election.cc:336] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 2.079s (SENT)
I20260709 13:13:16.313998   935 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.340154 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:16.351016 29525 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:13:16.321770  1236 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:16.355659 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:16.356532 29522 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:16.359630 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:16.360481 29529 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:16.370592 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:16.372185 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:16.373041 29530 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:13:16.379539 29524 raft_consensus.cc:2393] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 15: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:16.354401 29421 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:16.387142 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:16.389389 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:16.389902 29530 raft_consensus.cc:1275] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:13:16.390280 29453 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
I20260709 13:13:16.392113 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:16.393009 29454 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:13:16.358117  1136 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:16.400820 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:16.370301  1241 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.382463  1145 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.379472  1235 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.419744 29449 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:13:16.424338 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:16.426323 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.425254 29453 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
I20260709 13:13:16.427315 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:16.427331 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:16.429750 29530 raft_consensus.cc:2410] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:13:16.432552 29449 raft_consensus.cc:3055] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:16.433432 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:16.399916  1166 raft_consensus.cc:2749] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:13:16.435086 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 89690.5us
I20260709 13:13:16.358862   935 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:16.441064 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 102798us
I20260709 13:13:16.434779 29449 raft_consensus.cc:740] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:16.382751  1243 consensus_queue.cc:1048] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:13:16.450569   935 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:16.451781  1253 raft_consensus.cc:2749] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:16.453589 29447 raft_consensus.cc:1275] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:13:16.454813 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:16.456151 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:16.456951 29454 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:13:16.457818 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:16.458389 29453 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:16.459286  1153 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:16.423637  1241 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:16.472096 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 193732us
I20260709 13:13:16.428181  1145 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:16.470475 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:16.480186 29421 leader_election.cc:336] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 2.196s (SENT)
I20260709 13:13:16.483560 29522 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
W20260709 13:13:16.485781 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.493862 29529 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:13:16.496593 29421 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:16.498999 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.500952 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:16.501900 29454 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 11
W20260709 13:13:16.497186 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 50859.3us
I20260709 13:13:16.506058 29344 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:16.512238   935 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:16.513010   935 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:16.513857 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:16.513715   935 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:16.521193  1145 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:16.525925 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:16.526819 29522 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
I20260709 13:13:16.527590  1153 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:16.529672  1241 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:16.537331 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:16.542639 29344 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:16.508083 29449 consensus_queue.cc:260] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:16.553700 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.554479 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:16.560281 29344 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:16.555444 29447 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:13:16.562619 29344 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:16.435403  1235 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:16.536358  1166 raft_consensus.cc:2749] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:13:16.565279 29454 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:13:16.567581 29449 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:16.560593  1248 consensus_queue.cc:1048] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
W20260709 13:13:16.575924  1228 log.cc:927] Time spent T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.603s	user 0.005s	sys 0.000s
I20260709 13:13:16.579428  1216 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:16.568033  1240 raft_consensus.cc:2804] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:16.564365  1237 raft_consensus.cc:2804] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:13:16.580178 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.583523 29454 raft_consensus.cc:3055] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:16.559581  1145 raft_consensus.cc:2804] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:16.584630 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:16.591722  1165 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:16.595291 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.617121 29447 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:16.597306   935 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:16.598788  1245 log.cc:927] Time spent T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:13:16.602005   892 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:16.602698 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 110609us
W20260709 13:13:16.603826 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 132212us
I20260709 13:13:16.604214 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:16.605101 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:16.629397 29448 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:13:16.607370  1235 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:16.607795  1209 consensus_queue.cc:1048] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:16.608269  1041 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:16.599233  1244 log.cc:927] Time spent T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.146s	user 0.003s	sys 0.000s
I20260709 13:13:16.636070 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:16.637439 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:16.609934 29453 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:13:16.580916 29344 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:16.625828 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:16.638367 29421 leader_election.cc:336] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 2.226s (SENT)
I20260709 13:13:16.638823 29421 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:16.638994 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:16.639761 29453 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
W20260709 13:13:16.640545 29421 leader_election.cc:336] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 2.249s (SENT)
I20260709 13:13:16.640975 29346 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:16.641299 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:16.642720  1136 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.643281  1136 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:16.614080 29454 raft_consensus.cc:740] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:16.635816  1041 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:16.646004  1165 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:16.646785  1236 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.647400  1236 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:16.649760  1236 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:16.650362  1236 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:13:16.651630 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.651825  1242 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.652310  1242 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:16.654614  1242 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:16.655086  1242 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:16.628091 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:16.645512  1136 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:16.655666  1146 consensus_queue.cc:1048] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:16.646654 29454 consensus_queue.cc:260] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:16.626197  1240 raft_consensus.cc:697] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:13:16.641541 29421 leader_election.cc:336] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 2.254s (SENT)
I20260709 13:13:16.656884 29454 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:16.657141 29421 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:16.638222 29448 raft_consensus.cc:2393] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 12: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:16.650894  1236 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:16.658874 29450 raft_consensus.cc:2393] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 15: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:16.619642  1147 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.616689  1145 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:16.621698  1166 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:16.659273 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 90873.6us
I20260709 13:13:16.620988  1237 raft_consensus.cc:697] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:13:16.690413 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.680146  1240 consensus_queue.cc:237] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:16.698424 29454 raft_consensus.cc:1275] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:13:16.651654   832 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:13:16.700397 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 49317.6us
I20260709 13:13:16.705125 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:16.706848 29530 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:13:16.708338 29456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 1574) took 1372 ms. Trace:
I20260709 13:13:16.705646  1166 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:13:16.708781 29456 rpcz_store.cc:276] 0709 13:13:15.335805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:15.335944 (+   139us) service_pool.cc:224] Handling call
0709 13:13:15.353812 (+ 17868us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:15.374585 (+ 20773us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:15.374619 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:15.375410 (+   791us) log.cc:844] Serialized 52 byte log entry
0709 13:13:15.517261 (+141851us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:15.517305 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:15.517388 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:16.575526 (+1058138us) spinlock_profiling.cc:243] Waited 59.7 ms on lock 0x7b24001c96b8. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78b1f9c4 00007f6a78b1dacb 00007f6a78cd8dc9 00007f6a78cd8a55 00007f6a78cd809d 00007f6a7b90a10e 00007f6a7b92188c 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221
0709 13:13:16.707853 (+132327us) raft_consensus.cc:1685] finished
0709 13:13:16.707875 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:16.708113 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20222,"raft.queue_time_us":21765,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":7931,"spinlock_wait_cycles":137266944,"thread_start_us":141318,"threads_started":1,"wal-append.queue_time_us":295313}
I20260709 13:13:16.710268 29453 raft_consensus.cc:2410] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 13:13:16.714370 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.721150 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:16.722055 29528 raft_consensus.cc:2393] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 13: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:16.661015   781 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:16.679090  1236 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:16.720098 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:16.732476 29527 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:13:16.725826 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:16.733929 29529 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
I20260709 13:13:16.722965 29447 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:13:16.675201  1190 raft_consensus.cc:2804] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:16.684106  1145 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:16.634140   892 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:16.752300 29454 pending_rounds.cc:85] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 8
W20260709 13:13:16.753783 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.754403 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:16.753755 29454 pending_rounds.cc:107] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:13:16.752043 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:16.755175 29454 raft_consensus.cc:2889] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:16.755209 29523 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:13:16.756619 29524 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
W20260709 13:13:16.758796 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 82649.4us
W20260709 13:13:16.761723 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 120199us
I20260709 13:13:16.655483  1242 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:16.704876  1165 raft_consensus.cc:2749] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:16.768128 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:16.739017  1190 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:16.771238 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:16.773765 29527 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:13:16.698776  1147 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:16.731101  1041 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:16.777263 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 136341us
I20260709 13:13:16.785203  1242 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:16.785854 29346 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:13:16.788014 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 61815.4us
W20260709 13:13:16.793171 29421 leader_election.cc:336] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 2.331s (SENT)
I20260709 13:13:16.776204  1190 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:16.728751   832 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:16.796670 29421 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:16.802217 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:16.804852   892 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:16.805779   935 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:16.807039   832 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:16.811844 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.812688  1150 raft_consensus.cc:2749] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:16.814088  1150 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.814541  1150 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:16.815946 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:16.816740 29528 raft_consensus.cc:2468] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:13:16.817145  1150 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:16.822013 29524 raft_consensus.cc:1275] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:13:16.786861  1237 consensus_queue.cc:237] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:16.821223 29344 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:16.792572  1165 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:13:16.849411 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 57897.1us
I20260709 13:13:16.840732 29449 raft_consensus.cc:1275] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:13:16.852756 29449 pending_rounds.cc:85] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 8
I20260709 13:13:16.799388  1134 raft_consensus.cc:2749] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:16.861217  1147 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:16.862664 29449 pending_rounds.cc:107] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:13:16.864787 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:16.865490 29527 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 12.
I20260709 13:13:16.852406  1150 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:16.863072 29449 raft_consensus.cc:2889] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:16.850596  1041 raft_consensus.cc:2804] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:16.863005 29344 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:16.880471 29346 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:16.882956 29344 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:16.886147 29495 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:16.891197 29344 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:16.848237  1165 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:16.901077  1216 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:16.881799  1041 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:16.902491  1041 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:16.907572 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 114769us
I20260709 13:13:16.910485 29344 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:16.885743  1153 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:16.890442   892 raft_consensus.cc:2804] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:16.896126  1241 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:13:16.912470 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.912127 29346 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:16.913684  1134 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:16.915086  1241 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:16.927981  1241 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:16.933748 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:16.937434 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 75107.2us
I20260709 13:13:16.935096  1134 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:16.949206  1166 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:16.951406 29495 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:13:16.960570 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 50181.1us
I20260709 13:13:16.922353  1145 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:16.923247 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:16.923545  1153 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:16.926293  1165 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:16.909955  1026 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:16.885627  1150 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:16.914309   892 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:16.972615 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 55904.5us
I20260709 13:13:16.963560 29276 catalog_manager.cc:5697] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: config changed from index 4 to 5, term changed from 8 to 9, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to <none>, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129), VOTER 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130), VOTER 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131), VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132). New cstate: current_term: 9 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:13:16.978457 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:16.979852 29452 raft_consensus.cc:2410] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca041dab9b2f44409ed7bf4c6cf66ab2 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:13:16.978166 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:16.980607 29373 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 12.
I20260709 13:13:16.983366 29344 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:16.985095 29276 catalog_manager.cc:5697] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:16.972343  1216 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:16.986961 30121 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:13:16.972610  1242 raft_consensus.cc:2804] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:16.988649 29421 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:16.977442  1026 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.016898  1026 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:17.021519  1153 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:17.022205  1242 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:17.022557  1134 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:17.022744  1242 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:17.025027 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.027032  1241 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:17.029392  1241 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:17.032788  1145 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:17.036823 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 85589.7us
I20260709 13:13:17.037911 29495 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:13:17.040879 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 46280.3us
I20260709 13:13:17.043718  1153 raft_consensus.cc:2749] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:16.996173 29344 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:16.981418   892 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:16.999753  1084 raft_consensus.cc:2804] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:13:17.048105 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 74794.1us
I20260709 13:13:17.011664  1190 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:17.049054 29421 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:17.050280  1190 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:16.989037  1240 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:17.050988  1240 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.051414  1240 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:17.048153  1084 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.052006  1084 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:17.015829  1150 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:17.046571  1273 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:17.045913 29346 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:17.056941  1166 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:17.056959  1165 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.060168  1165 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:13:17.061723 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.039321 29495 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
W20260709 13:13:17.064175 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 68121.6us
I20260709 13:13:17.004755  1041 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:17.066174 29346 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:17.070041 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:17.070719 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:17.070720 29527 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:13:17.073917 29279 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37594 (request call id 137) took 12031 ms (client timeout 15000 ms). Trace:
I20260709 13:13:17.080806 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:17.081537 29528 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:17.084017 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:17.084744 29530 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:13:17.086218 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:17.086846 29521 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:17.087476 29346 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:17.089542 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:17.089854 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:17.090278  1134 raft_consensus.cc:2804] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:17.090469 30155 raft_consensus.cc:2393] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 9: Already voted for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in this term.
I20260709 13:13:17.090777  1134 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:17.090461 29525 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:17.067026  1190 raft_consensus.cc:2804] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:17.072610   935 raft_consensus.cc:2804] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:17.091352  1134 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:17.080178  1237 consensus_queue.cc:1048] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:13:17.087328  1216 raft_consensus.cc:2764] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:13:17.102511 29344 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:17.124212   892 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:17.138990 29525 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
W20260709 13:13:17.140249 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 52909.6us
I20260709 13:13:17.141928 29346 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:17.142726 29521 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
I20260709 13:13:17.100150  1190 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.152338 29344 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:17.074451 29279 rpcz_store.cc:269] 0709 13:13:05.043163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:05.043585 (+   422us) service_pool.cc:224] Handling call
0709 13:13:17.072458 (+12028873us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:15.311970 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:15.312658 (+   688us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:15.312712 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:13:15.312730 (+    18us) tablet.cc:662] Decoding operations
0709 13:13:15.314312 (+  1582us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:15.314398 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:15.314436 (+    38us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:13:15.315983 (+  1547us) tablet.cc:701] Row locks acquired
0709 13:13:15.316048 (+    65us) write_op.cc:260] PREPARE: finished
0709 13:13:15.353750 (+ 37702us) write_op.cc:270] Start()
0709 13:13:15.353949 (+   199us) write_op.cc:276] Timestamp: P: 1783602795339948 usec, L: 0
0709 13:13:15.353978 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:13:15.354918 (+   940us) log.cc:844] Serialized 6409 byte log entry
0709 13:13:16.183899 (+828981us) op_driver.cc:464] REPLICATION: finished
0709 13:13:16.434714 (+250815us) write_op.cc:301] APPLY: starting
0709 13:13:16.447179 (+ 12465us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:16.516817 (+ 69638us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:16.516968 (+   151us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:16.518608 (+  1640us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:16.519071 (+   463us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=32
0709 13:13:16.519132 (+    61us) write_op.cc:312] APPLY: finished
0709 13:13:16.566660 (+ 47528us) log.cc:844] Serialized 112 byte log entry
0709 13:13:16.577275 (+ 10615us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:16.577498 (+   223us) write_op.cc:454] Released schema lock
0709 13:13:16.577582 (+    84us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:16.578042 (+   460us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:16.578083 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":150457,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":209785,"apply.run_cpu_time_us":6693,"apply.run_wall_time_us":167737,"num_ops":16,"prepare.queue_time_us":163311,"prepare.run_cpu_time_us":37800,"prepare.run_wall_time_us":143637,"raft.queue_time_us":655998,"raft.run_cpu_time_us":14759,"raft.run_wall_time_us":193250,"replication_time_us":793072,"spinlock_wait_cycles":71552,"thread_start_us":778072,"threads_started":4,"wal-append.queue_time_us":108065}]]}
I20260709 13:13:17.153573 29527 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
I20260709 13:13:17.101568   935 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.155217 29528 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 14.
I20260709 13:13:17.128636 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:17.156787 30155 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:13:17.157155  1261 raft_consensus.cc:2804] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:17.157423 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:17.157791  1261 raft_consensus.cc:697] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:17.147779  1241 raft_consensus.cc:2804] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:17.159271  1241 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.158756  1261 consensus_queue.cc:237] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:17.159698  1241 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:17.166033 29346 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:17.166924 29344 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:17.169150 29344 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:17.101362  1153 consensus_queue.cc:1059] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:13:17.120344  1041 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:17.174191 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.177567 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:17.177865  1026 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:17.198407  1026 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:17.180354  1146 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:17.199115  1146 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.144181  1237 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:17.199596  1146 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:17.155149  1190 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:17.204659 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.163965   935 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:17.184556 29525 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:17.154433  1134 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:17.132771  1240 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:17.140223  1165 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:17.188305 29344 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:17.195145  1242 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:17.183683  1248 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:17.189991  1041 raft_consensus.cc:2804] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:17.147574   832 raft_consensus.cc:2749] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:17.185107 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 61318.4us
I20260709 13:13:17.120898  1084 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:17.232684  1248 raft_consensus.cc:697] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:17.233928  1248 consensus_queue.cc:237] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:17.223824  1145 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.235848 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:17.236511 29530 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:17.228374  1237 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:17.235100  1084 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 13 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:17.241153  1145 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:17.243706  1041 raft_consensus.cc:697] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:17.244828  1041 consensus_queue.cc:237] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:17.246665  1145 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:17.247900  1237 raft_consensus.cc:697] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:17.249276 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:17.248981  1237 consensus_queue.cc:237] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:17.249922 29376 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:17.241240   892 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:17.253999 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:17.254758 30155 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:13:17.261940 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:17.262687 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:17.263417 29527 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:17.263643 29376 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 13.
I20260709 13:13:17.265146 29525 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:13:17.262817 29528 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:13:17.266932 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:17.267787 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:17.282382 29344 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:17.275636 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.282683 29452 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:17.274919 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:17.282572 29522 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:17.284147 29344 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:13:17.285614  1145 raft_consensus.cc:2804] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:17.286099  1145 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.286536  1145 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:17.276798 29530 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:13:17.277252  1134 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:17.300678 29527 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
I20260709 13:13:17.306902 29528 raft_consensus.cc:1275] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:13:17.310184 29344 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:17.296553   892 raft_consensus.cc:2804] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:17.311743   892 raft_consensus.cc:697] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:17.311925   832 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:17.312518   832 raft_consensus.cc:697] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:17.312985  1146 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:17.312816   892 consensus_queue.cc:237] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:17.313388   832 consensus_queue.cc:237] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:17.314898  1026 consensus_queue.cc:1048] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:17.315161  1146 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:17.342909 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:17.336512  1277 consensus_queue.cc:1048] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:17.384961 29452 raft_consensus.cc:2410] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ca041dab9b2f44409ed7bf4c6cf66ab2 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:13:17.390295  1241 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:17.398308  1241 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:17.410403 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 244437us
I20260709 13:13:17.412446 29346 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:17.417711  1279 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:13:17.420516 29522 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 13.
I20260709 13:13:17.422405 30119 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a
W20260709 13:13:17.426940 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:17.430648 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.433655 29346 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:17.437486 29346 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:17.438719 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:17.443584 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 195398us
I20260709 13:13:17.436671  1084 raft_consensus.cc:2804] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:17.444561  1241 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:17.463798 29346 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:17.469329 29376 raft_consensus.cc:1240] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 11. Current term is 12. Ops: []
W20260709 13:13:17.469862  1280 log.cc:927] Time spent T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:13:17.466775  1236 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:17.461154  1242 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:17.467082  1084 raft_consensus.cc:697] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 13 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:13:17.483441 29378 raft_consensus.cc:1275] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:13:17.483747 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:17.477121  1278 consensus_queue.cc:1048] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:13:17.485213 29373 raft_consensus.cc:1275] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:13:17.483445 29380 raft_consensus.cc:1275] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:13:17.462049  1134 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:13:17.497866 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.501272  1084 consensus_queue.cc:237] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:17.505540  1283 raft_consensus.cc:3055] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:17.506137  1283 raft_consensus.cc:740] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:17.507225  1283 consensus_queue.cc:260] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:17.509423  1283 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:17.511957 29376 raft_consensus.cc:1240] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:17.517069 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:17.518628 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:17.520555 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:17.521451  1240 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:17.522394 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:17.524439  1145 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:17.527100  1241 raft_consensus.cc:2749] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:13:17.528896 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.550096 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:17.550776 29521 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:17.553252  1145 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:17.556330 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:17.531800 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:17.479691  1237 consensus_queue.cc:1048] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:13:17.544063 29344 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:17.540602 29276 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35182 (request call id 69) took 2279 ms. Trace:
I20260709 13:13:17.515394  1190 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:17.550661 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:17.545524   935 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:17.558732 29276 rpcz_store.cc:276] 0709 13:13:15.261084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:15.262852 (+  1768us) service_pool.cc:224] Handling call
0709 13:13:17.540503 (+2277651us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:17.190610 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:17.191339 (+   729us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:17.191376 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:13:17.191393 (+    17us) tablet.cc:662] Decoding operations
0709 13:13:17.210738 (+ 19345us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:17.224105 (+ 13367us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:17.227261 (+  3156us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:13:17.255870 (+ 28609us) tablet.cc:701] Row locks acquired
0709 13:13:17.255891 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:13:17.256047 (+   156us) write_op.cc:270] Start()
0709 13:13:17.256187 (+   140us) write_op.cc:276] Timestamp: P: 1783602797255997 usec, L: 0
0709 13:13:17.256219 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:13:17.256940 (+   721us) log.cc:844] Serialized 954 byte log entry
0709 13:13:17.298467 (+ 41527us) op_driver.cc:464] REPLICATION: finished
0709 13:13:17.464590 (+166123us) write_op.cc:301] APPLY: starting
0709 13:13:17.467163 (+  2573us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:17.498878 (+ 31715us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:17.499010 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:17.499331 (+   321us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:17.499553 (+   222us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:13:17.499618 (+    65us) write_op.cc:312] APPLY: finished
0709 13:13:17.499826 (+   208us) log.cc:844] Serialized 28 byte log entry
0709 13:13:17.500002 (+   176us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:17.500101 (+    99us) write_op.cc:454] Released schema lock
0709 13:13:17.500148 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:17.500596 (+   448us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:17.500623 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":110562,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":154603,"apply.run_cpu_time_us":2486,"apply.run_wall_time_us":41313,"num_ops":2,"prepare.queue_time_us":188535,"prepare.run_cpu_time_us":3694,"prepare.run_wall_time_us":68367,"replication_time_us":42077,"thread_start_us":178241,"threads_started":2}]]}
I20260709 13:13:17.568105 29521 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:13:17.533356  1134 raft_consensus.cc:2749] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:13:17.569443 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 87272.1us
I20260709 13:13:17.570780 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:17.571547 29527 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:17.575413 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:17.576356 29528 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:13:17.576205 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:17.589538 29344 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:17.596637 29529 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
I20260709 13:13:17.575160  1145 raft_consensus.cc:2804] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:17.599964 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:13:17.600418 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:17.598785  1165 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.598991   781 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:17.606232 29373 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:17.606220 29344 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:17.608042 29527 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:13:17.608832 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:17.608870  1165 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:17.651170  1165 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:17.611740  1286 consensus_queue.cc:1048] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:13:17.608937 30155 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:17.617865 29380 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 15.
I20260709 13:13:17.622069   781 raft_consensus.cc:697] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:17.624620 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:17.625919 29379 raft_consensus.cc:1240] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 10. Current term is 12. Ops: [10.5-10.5]
I20260709 13:13:17.626940  1145 raft_consensus.cc:697] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:17.628196  1273 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:17.630900 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:17.631893 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:17.635360 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:17.657426 29381 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:17.637576 29373 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:17.638477 29278 catalog_manager.cc:5697] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 8 to 10, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 10 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:17.658605 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:17.610010 29495 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:17.646106  1041 raft_consensus.cc:2804] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:17.649008 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:17.656847 29377 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 12.
I20260709 13:13:17.661510 29380 raft_consensus.cc:1240] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:17.661345   781 consensus_queue.cc:237] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:17.662286  1273 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:17.662843 29378 raft_consensus.cc:1240] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 11. Current term is 13. Ops: []
I20260709 13:13:17.670358 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:17.671038 29380 raft_consensus.cc:1240] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 6. Current term is 8. Ops: []
I20260709 13:13:17.671331  1273 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:17.671761   935 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:17.661367 29379 raft_consensus.cc:1240] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:17.671056 30155 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:13:17.668670 29278 catalog_manager.cc:5697] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 13 to 14, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 14 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:17.673208  1041 raft_consensus.cc:697] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:17.670423 29377 raft_consensus.cc:1240] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:17.678618 29373 raft_consensus.cc:1240] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:17.647390 29528 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:13:17.688948 29344 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:17.674680  1190 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:17.691915  1286 raft_consensus.cc:2764] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:13:17.692338  1248 raft_consensus.cc:2804] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:17.692925  1248 raft_consensus.cc:697] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:17.693063  1145 consensus_queue.cc:237] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:17.693902  1248 consensus_queue.cc:237] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:17.699113 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:17.699867 29525 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:17.700663 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:17.700965 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:17.701460 29377 raft_consensus.cc:2393] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 12: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:17.703009 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:17.703640 29377 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 12.
I20260709 13:13:17.704367 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:17.705232 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:17.706081 29380 raft_consensus.cc:2410] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:13:17.706895 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:17.707623 29380 raft_consensus.cc:2393] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 13: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:17.704495 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:17.707867 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:17.708281 29344 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:13:17.692374 29278 catalog_manager.cc:5697] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:17.712527 29381 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 13.
I20260709 13:13:17.713836 29525 raft_consensus.cc:2468] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:13:17.715425 29344 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:17.717563   935 raft_consensus.cc:2804] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:17.717618  1241 raft_consensus.cc:2804] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:17.718165   935 raft_consensus.cc:697] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:17.718875  1241 raft_consensus.cc:697] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:17.719105   935 consensus_queue.cc:237] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:17.720352 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:17.721329 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.721125 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:17.722623 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:17.723345 29375 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 10.
I20260709 13:13:17.726408 29278 catalog_manager.cc:5697] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 8 to 9, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 9 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:17.734777 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:17.741101 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:17.742102 29453 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:13:17.752734 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:17.753723 29528 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:17.674185  1041 consensus_queue.cc:237] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:17.767645 29373 raft_consensus.cc:1240] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:17.771234 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:17.773193 29278 catalog_manager.cc:5697] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 8 to 10, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 10 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:17.776155 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:17.780992 29528 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
I20260709 13:13:17.797544 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:17.799542 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:17.719928  1241 consensus_queue.cc:237] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:13:17.823798 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.826104 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:17.827250 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:17.811977 29278 catalog_manager.cc:5697] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 8 to 9, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 9 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:17.804631 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:17.830081 29379 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 12.
I20260709 13:13:17.836123 29344 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:17.833035 29378 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 12.
I20260709 13:13:17.838505 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:17.838806 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:17.839486 29453 raft_consensus.cc:2468] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:13:17.840363 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:17.840849 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:17.841013 29378 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11.
I20260709 13:13:17.842198 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:17.843466 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:17.844703 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:17.845412 29379 raft_consensus.cc:2393] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 13: Already voted for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in this term.
I20260709 13:13:17.845886 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:17.849200 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:17.850068 29451 raft_consensus.cc:2393] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 13: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:17.850389 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:17.852571 29448 raft_consensus.cc:2393] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 13: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
W20260709 13:13:17.845844 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 235923us
I20260709 13:13:17.856848 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:17.857077 29375 raft_consensus.cc:1240] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:17.857461 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:17.857815 29381 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 12.
I20260709 13:13:17.858443 29378 raft_consensus.cc:2368] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 8. Current term is 9.
I20260709 13:13:17.864802 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:17.865465 29452 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:13:17.867722  1146 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.868306  1146 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:17.869707 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:17.870661  1146 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:17.867301 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:17.872061 29451 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:13:17.873564 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:17.874663 29495 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:17.797500  1273 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:17.859154 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:17.864081 29454 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
I20260709 13:13:17.876583 29529 raft_consensus.cc:1275] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:17.878057 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:17.882196 29450 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:17.882809 29377 raft_consensus.cc:1240] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:17.884017 29346 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:17.884440 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:17.883252 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:17.885424 29447 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
I20260709 13:13:17.841751  1279 raft_consensus.cc:2804] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:17.887008 29451 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 14.
I20260709 13:13:17.889561 29421 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:17.885128 29456 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:13:17.893159 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:17.893817 29525 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:13:17.895677 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:17.852003  1165 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:17.905705 29346 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:17.906620 29495 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:17.909029 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:17.909755 29380 raft_consensus.cc:2376] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 13. Re-sending same reply.
I20260709 13:13:17.914388 29528 raft_consensus.cc:1275] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:13:17.914920 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.918174 29344 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:17.918489 29495 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:17.892994  1146 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:17.926028 29452 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:13:17.926669 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:17.903074  1216 raft_consensus.cc:2749] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:17.927840 29456 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:17.903370  1279 raft_consensus.cc:697] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:17.888872  1240 consensus_queue.cc:1048] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:13:17.926576 29278 catalog_manager.cc:5697] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:17.917411  1286 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:17.887094  1273 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:17.969712 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:17.974011 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.922708  1242 raft_consensus.cc:2804] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:17.982642 29278 catalog_manager.cc:5697] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 9 to 10, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 10 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:17.919625  1134 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:17.914721  1165 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:17.996483 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:17.922191  1283 consensus_queue.cc:1059] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:13:17.985630 29452 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:13:17.994472  1242 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.001454  1216 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:18.006685 29278 catalog_manager.cc:5697] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: config changed from index 5 to 4, term changed from 9 to 8, leader changed from <none> to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from VOTER to NON_VOTER, now has a pending config: VOTER 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129), VOTER 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130), VOTER 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131), VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132). New cstate: current_term: 8 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:13:17.972862  1237 consensus_queue.cc:1048] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:13:18.024679 29278 catalog_manager.cc:5697] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 7 to 8, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 8 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:18.031543 29278 catalog_manager.cc:5697] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 9 to 12, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 12 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:18.043908 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:18.044966 29452 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:18.027117  1242 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:18.050377 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:18.051864 29451 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:18.080525 29454 raft_consensus.cc:1275] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:13:18.080613 29447 raft_consensus.cc:3055] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:18.082108 29447 raft_consensus.cc:740] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
W20260709 13:13:18.084209 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 165791us
I20260709 13:13:18.085892 29495 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:18.088750 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:18.089450 29454 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:18.093544 29451 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
I20260709 13:13:18.097692 29450 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
I20260709 13:13:18.070653  1216 raft_consensus.cc:3055] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:18.120684  1216 raft_consensus.cc:740] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:18.132843 29495 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:18.128041 29447 consensus_queue.cc:260] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:18.134792 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:18.135830 29447 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:18.133185 29454 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:13:18.136744 29450 raft_consensus.cc:2393] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 13: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
W20260709 13:13:18.141500 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:18.142976 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 253534us
I20260709 13:13:18.181181 29456 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
I20260709 13:13:18.050864  1279 consensus_queue.cc:237] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:18.123031  1216 consensus_queue.cc:260] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:18.186012 29452 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 14.
I20260709 13:13:18.204982 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:18.229292  1298 raft_consensus.cc:2749] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:18.269934  1312 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:18.668426 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:18.669139 29450 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:18.271742  1301 log.cc:927] Time spent T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:13:18.243984  1273 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:18.233974  1299 consensus_queue.cc:1059] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:13:18.676079  1299 consensus_queue.cc:1243] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer 429e58eb058349e3bf72b5a870c8f6e5 log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:13:18.676783  1299 raft_consensus.cc:3055] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:18.677170  1299 raft_consensus.cc:740] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:18.678131  1299 consensus_queue.cc:260] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:18.268512  1165 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:18.258235  1216 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:18.286923  1277 consensus_queue.cc:1059] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:18.684595  1277 raft_consensus.cc:3055] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:18.685093  1277 raft_consensus.cc:740] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:18.287861  1313 raft_consensus.cc:2749] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:18.690037 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:18.294788  1146 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:18.297279  1242 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:18.313493 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 81407.8us
I20260709 13:13:18.693148  1242 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:18.332360  1314 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:18.696065  1314 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:18.697535 29374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52172 (request call id 1860) took 1067 ms. Trace:
I20260709 13:13:18.697994 29374 rpcz_store.cc:276] 0709 13:13:17.629623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.630377 (+   754us) service_pool.cc:224] Handling call
0709 13:13:18.697291 (+1066914us) spinlock_profiling.cc:243] Waited 930 ms on lock 0x7b540009d3d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:18.697438 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2138531200}
I20260709 13:13:18.699117  1314 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:18.717900 29448 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.003s	sys 0.007s
I20260709 13:13:18.446388  1322 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.722957  1322 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:18.725821  1322 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:18.450445 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:18.726751 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:18.727401 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:18.450811  1323 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.728178  1323 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:18.730705  1323 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:18.480598 29419 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.573s (SENT) [suppressed 18 similar messages]
W20260709 13:13:18.496477 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 337784us
I20260709 13:13:18.510556 29447 raft_consensus.cc:1275] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:13:18.735538 29447 pending_rounds.cc:85] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 7
I20260709 13:13:18.735973 29447 pending_rounds.cc:107] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:13:18.736272 29447 raft_consensus.cc:2889] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:18.686400  1277 consensus_queue.cc:260] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:18.529242 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:13:18.567373 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:18.738294 29455 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:13:18.612708 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 459526us
I20260709 13:13:18.742297 29495 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:18.618132 29346 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:18.621206 29456 raft_consensus.cc:1275] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:13:18.744827  1312 consensus_queue.cc:1048] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:18.626945 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:18.641506 29267 thread.cc:641] dir /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/master-0-root/data [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.004s	sys 0.027s
W20260709 13:13:18.746523 29267 thread.cc:608] dir /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/master-0-root/data [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.005s	sys 0.028s
W20260709 13:13:18.656239 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:18.665916  1325 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:18.748450  1325 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:18.352352  1321 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.751669  1313 consensus_queue.cc:1048] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:18.751852  1321 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:18.753443  1313 consensus_queue.cc:1048] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:18.754876  1313 consensus_queue.cc:1059] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:13:18.370133 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:18.760871  1313 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:18.703150 29528 raft_consensus.cc:1275] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:13:18.702672 29380 raft_consensus.cc:1275] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:13:18.744257 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 126231us
I20260709 13:13:18.764806 29346 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:18.763141 29452 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
W20260709 13:13:18.786186 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 50883.8us
I20260709 13:13:18.787827 29421 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:18.789194 29421 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:18.792599  1314 consensus_queue.cc:1059] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:18.793892 29454 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:18.824355 29448 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.005s	sys 0.008s
I20260709 13:13:18.837291  1323 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:18.838140  1323 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:18.838723  1323 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:18.851194  1319 raft_consensus.cc:3055] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:18.851982  1319 raft_consensus.cc:740] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:18.853209  1319 consensus_queue.cc:260] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:18.859225  1313 raft_consensus.cc:697] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:18.860862  1313 consensus_queue.cc:237] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:18.867964  1322 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:18.928167 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 163445us
I20260709 13:13:18.930037  1321 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:18.930593 29452 raft_consensus.cc:1275] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:13:18.930768  1321 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:18.928170  1325 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:18.932121 29452 raft_consensus.cc:1275] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:13:18.928090 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 138975us
I20260709 13:13:18.933498 29452 raft_consensus.cc:1275] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:18.936048  1319 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:18.937747 29346 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:18.970554  1312 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:18.971385  1312 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:18.974259  1312 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:18.976359  1190 raft_consensus.cc:2804] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:18.977083  1190 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:18.977689  1190 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:19.014580 29455 raft_consensus.cc:2468] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:13:19.016001 29421 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:13:19.018600 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 83088.9us
W20260709 13:13:19.016882 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 77607.9us
I20260709 13:13:18.931313  1321 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:19.027887  1321 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:19.032228   892 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:19.032898   892 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.033335   892 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:19.037827  1277 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:19.039402 29451 raft_consensus.cc:1275] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:13:19.040025  1321 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:19.043169  1321 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:19.043731  1241 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.045397  1321 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:19.045524   781 consensus_queue.cc:1048] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:19.050971   781 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:19.051831   781 raft_consensus.cc:697] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:19.052194  1286 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:19.052752  1286 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:19.055383  1286 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:19.048148  1241 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:19.020540 29421 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:19.077199 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 56722.1us
I20260709 13:13:19.077383  1241 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:19.078691 29454 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
I20260709 13:13:19.083065  1322 raft_consensus.cc:2749] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:19.081211 29450 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:13:19.083936  1322 consensus_queue.cc:1059] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:19.084786  1322 consensus_queue.cc:1243] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer 429e58eb058349e3bf72b5a870c8f6e5 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:13:19.085809  1322 raft_consensus.cc:2749] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:19.086526  1322 raft_consensus.cc:3055] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:19.086228  1323 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:19.086918  1322 raft_consensus.cc:740] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:19.087891  1322 consensus_queue.cc:260] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:19.089046  1323 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:19.089314  1322 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:18.743328 29495 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:19.097347 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 616763us
W20260709 13:13:19.100651 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 357368us
I20260709 13:13:19.102808 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:13:19.105845 29344 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.023s	user 0.008s	sys 0.030s
W20260709 13:13:19.106277 29344 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.023s	user 0.008s	sys 0.030s
W20260709 13:13:19.106540 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 1.02353e+06us
I20260709 13:13:19.106948 29528 raft_consensus.cc:1240] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:19.110656 29527 raft_consensus.cc:1240] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:19.119274 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:19.119786 29527 raft_consensus.cc:1275] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:13:19.120054 29525 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
I20260709 13:13:19.121179 29346 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:19.052973   781 consensus_queue.cc:237] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:19.130378 29525 raft_consensus.cc:1275] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:13:19.133260 29525 raft_consensus.cc:1240] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:19.114894  1286 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:19.136001 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:19.151597 29527 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11.
W20260709 13:13:19.159533 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:19.145351   892 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:19.133113  1312 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.175705 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:19.174285  1314 consensus_queue.cc:1243] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer 429e58eb058349e3bf72b5a870c8f6e5 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:13:19.177731 29527 raft_consensus.cc:1275] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:13:19.179801 29521 raft_consensus.cc:1240] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:19.182082 29522 raft_consensus.cc:1275] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:13:19.187367 29527 raft_consensus.cc:1240] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:19.175051  1312 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:19.177234  1190 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:19.199913 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:19.200330 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:19.202950 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:19.205134 29522 raft_consensus.cc:1275] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:13:19.205724 29521 raft_consensus.cc:1275] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:13:19.208201 29521 raft_consensus.cc:1275] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:13:19.210304   892 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:19.211447 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:19.212636 29524 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:19.226135 29530 raft_consensus.cc:1275] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:13:19.212244 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:19.259011 29522 raft_consensus.cc:1275] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:13:19.255832  1286 raft_consensus.cc:697] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:19.261538  1286 consensus_queue.cc:237] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:19.262933  1321 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:19.267020  1190 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:19.268411  1321 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:19.211190  1299 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:19.223348  1312 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:19.271692 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:19.273646  1319 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:19.278803 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:19.279148 29522 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:19.274226 29527 raft_consensus.cc:1240] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 12. Current term is 13. Ops: []
W20260709 13:13:19.274829  1216 consensus_meta.cc:287] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.594s	user 0.020s	sys 0.000s
I20260709 13:13:19.275867 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:19.284979 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:19.286430 29529 raft_consensus.cc:2393] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 13: Already voted for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in this term.
I20260709 13:13:19.283991  1319 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:19.290238 29522 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 12.
I20260709 13:13:19.294373 29525 raft_consensus.cc:2410] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 13:13:19.296248 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:19.283632  1312 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:19.297578  1312 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:19.299470  1312 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:19.300753 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:19.302440 29527 raft_consensus.cc:1240] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:19.304454 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:19.304807 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:19.305191 29521 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 13.
I20260709 13:13:19.305672 29529 raft_consensus.cc:2393] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 8: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:19.307638 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:19.310119 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:19.332319 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:19.333264 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:19.333760 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:19.334291 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:19.334991 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:19.338778 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:19.339883 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:19.340936 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:19.332460 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:19.337162 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:19.306632 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:19.343895 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:19.344686 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:19.349572  1319 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:19.350617 29524 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
W20260709 13:13:19.357971 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:19.358410 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:19.359040 29495 connection.cc:256] RPC call timeout handler was delayed by -2.709055502999945s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1554s for a response
I20260709 13:13:19.359128  1319 raft_consensus.cc:493] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
W20260709 13:13:19.359458 29495 connection.cc:256] RPC call timeout handler was delayed by -2.6469555029998446s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1623s for a response
W20260709 13:13:19.359875 29495 connection.cc:256] RPC call timeout handler was delayed by -2.6289555030000429s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1643s for a response
W20260709 13:13:19.360229 29495 connection.cc:256] RPC call timeout handler was delayed by -2.6028555030000007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16720000000000002s for a response
W20260709 13:13:19.360565 29495 connection.cc:256] RPC call timeout handler was delayed by -2.4021555029999035s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1895s for a response
I20260709 13:13:19.359998  1319 raft_consensus.cc:515] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:13:19.360869 29495 connection.cc:256] RPC call timeout handler was delayed by -2.3166555029999927s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.199s for a response
W20260709 13:13:19.361196 29495 connection.cc:256] RPC call timeout handler was delayed by -2.3022555029999694s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2006s for a response
W20260709 13:13:19.361496 29495 connection.cc:256] RPC call timeout handler was delayed by -2.2644555029999083s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2048s for a response
I20260709 13:13:19.346487  1084 consensus_queue.cc:1048] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:13:19.361946 29495 connection.cc:256] RPC call timeout handler was delayed by -2.097055502999865s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22340000000000002s for a response
W20260709 13:13:19.362450 29495 connection.cc:256] RPC call timeout handler was delayed by -2.0844555029998446s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22480000000000003s for a response
I20260709 13:13:19.364326  1312 consensus_queue.cc:1048] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:19.365918  1312 consensus_queue.cc:1048] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:19.368429 29495 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:19.369416  1312 raft_consensus.cc:2764] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:13:19.335752 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:19.370463 29522 raft_consensus.cc:2393] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 13: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:19.370931 29495 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:19.371953  1312 raft_consensus.cc:2749] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:19.373281 29495 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:19.374065  1312 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:19.374455  1312 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:19.374845  1312 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:19.388564  1319 leader_election.cc:290] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:19.392386 29495 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:19.394188 29495 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:19.394901  1319 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:19.395816  1286 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:19.409590  1286 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:19.410262  1286 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:19.411652  1319 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:19.412125  1319 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:19.402597  1312 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:19.403940 29495 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:19.416049  1277 raft_consensus.cc:2749] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:19.399286 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:19.421030  1286 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:19.423702  1286 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:19.408545  1243 consensus_queue.cc:1048] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:19.418743 29495 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:19.432426  1312 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:19.433513  1302 raft_consensus.cc:2764] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:13:19.435474 29495 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:19.436359  1302 raft_consensus.cc:2749] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:19.439690  1302 consensus_queue.cc:1059] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:19.441395  1277 raft_consensus.cc:3055] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:19.441813  1277 raft_consensus.cc:740] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:19.442759  1277 consensus_queue.cc:260] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:19.444263  1277 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:19.452518 29452 raft_consensus.cc:1275] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:13:19.453023 29452 pending_rounds.cc:85] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 9
I20260709 13:13:19.453243 29452 pending_rounds.cc:107] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:13:19.453461 29452 raft_consensus.cc:2889] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:19.457111 29452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2545) took 1134 ms. Trace:
I20260709 13:13:19.457592 29452 rpcz_store.cc:276] 0709 13:13:18.322233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:18.934412 (+612179us) service_pool.cc:224] Handling call
0709 13:13:18.934859 (+   447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:19.453906 (+519047us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:19.456196 (+  2290us) spinlock_profiling.cc:243] Waited 517 ms on lock 0x7b54002922d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:19.457042 (+   846us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1189468416}
I20260709 13:13:19.461928  1319 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:19.464507  1319 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:19.468251  1325 raft_consensus.cc:3055] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:19.468789  1325 raft_consensus.cc:740] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:19.469803  1325 consensus_queue.cc:260] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:19.470952  1325 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:19.490008 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:19.495775  1243 consensus_queue.cc:1048] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:19.496642  1243 consensus_queue.cc:1243] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Peer 183db85c071f489fbc8de63a9edd8a3a log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:13:19.502977 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 424898us
I20260709 13:13:19.509737 29421 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:19.510733  1298 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:19.511303  1298 raft_consensus.cc:697] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 12 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:19.512251  1283 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.512425  1298 consensus_queue.cc:237] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:19.512974  1283 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:19.515892 29421 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:19.516618  1283 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:19.517817  1165 raft_consensus.cc:2804] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:19.518546  1165 raft_consensus.cc:697] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 12 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:19.519622  1165 consensus_queue.cc:237] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:19.524153 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:19.523967 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:19.525481 29421 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:19.526515 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:13:19.527172 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:19.533895  1338 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.534114  1299 raft_consensus.cc:2749] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:19.534631  1338 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:19.550995 29452 pending_rounds.cc:85] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 7
I20260709 13:13:19.551602 29452 pending_rounds.cc:107] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:13:19.552042 29452 raft_consensus.cc:2889] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:19.556110  1338 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:19.556713 29456 raft_consensus.cc:1275] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:13:19.558528 29456 raft_consensus.cc:1275] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:13:19.558892 29456 pending_rounds.cc:85] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 6
I20260709 13:13:19.559106 29456 pending_rounds.cc:107] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:13:19.561295 29451 raft_consensus.cc:1275] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:13:19.562704 29451 raft_consensus.cc:1275] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:19.559353 29456 raft_consensus.cc:2889] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:19.564497 29421 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:19.594206 29456 raft_consensus.cc:1275] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:13:19.590469 29421 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:19.589929  1338 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:19.588361  1299 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:19.603992 29451 raft_consensus.cc:3055] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:19.603888  1299 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.604446 29451 raft_consensus.cc:740] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:19.604700  1299 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:19.605314 29451 consensus_queue.cc:260] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:19.606417 29451 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:19.610791 29450 raft_consensus.cc:1275] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:13:19.611408 29450 pending_rounds.cc:85] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 5
I20260709 13:13:19.611739 29450 pending_rounds.cc:107] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:13:19.612062 29450 raft_consensus.cc:2889] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:19.616216 29451 raft_consensus.cc:1275] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:13:19.616684 29451 pending_rounds.cc:85] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 8
I20260709 13:13:19.616938 29451 pending_rounds.cc:107] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:13:19.617170 29451 raft_consensus.cc:2889] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:19.620321 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:19.620950 29451 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:19.622805 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:19.623901 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:19.624584 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:19.625149 29530 raft_consensus.cc:2376] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 12. Re-sending same reply.
W20260709 13:13:19.626164 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 504066us
I20260709 13:13:19.629065 30155 raft_consensus.cc:1275] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:13:19.632216 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:19.633356 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:19.633699 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:19.633771  1315 raft_consensus.cc:2804] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:19.634473  1315 raft_consensus.cc:697] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:19.635378  1315 consensus_queue.cc:237] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:19.637861  1146 consensus_queue.cc:1048] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:19.639052  1134 consensus_queue.cc:1048] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:19.638026  1261 consensus_queue.cc:1048] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:19.644714 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:19.645329 29451 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:13:19.646364 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:19.646783 29419 leader_election.cc:336] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.828s (SENT)
W20260709 13:13:19.648213 29419 leader_election.cc:336] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.901s (SENT)
W20260709 13:13:19.633162 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 512060us
I20260709 13:13:19.648801 29419 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:19.647109 29451 raft_consensus.cc:2410] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:13:19.668169 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:13:19.673575 29419 leader_election.cc:336] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 2.093s (SENT)
I20260709 13:13:19.674144 29419 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:19.676375  1298 raft_consensus.cc:2764] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 13:13:19.696842 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 46629.5us
I20260709 13:13:19.678505  1322 raft_consensus.cc:2749] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:19.643352  1338 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:19.702306 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 112092us
I20260709 13:13:19.683843  1273 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:19.678898  1325 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:19.706413 29421 leader_election.cc:400] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 8. Current term is 9.
I20260709 13:13:19.678560  1278 consensus_queue.cc:1048] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
W20260709 13:13:19.708396  1349 log.cc:927] Time spent T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:13:19.708107  1325 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:19.710564  1325 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:19.695930  1335 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.706791 29421 leader_election.cc:403] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:19.717306  1338 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:19.700194  1321 consensus_queue.cc:1059] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:13:19.707167  1242 consensus_queue.cc:1048] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:13:19.719693   781 consensus_queue.cc:1048] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:19.720330  1273 raft_consensus.cc:3055] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:19.720795  1273 raft_consensus.cc:740] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:19.721177  1242 consensus_queue.cc:1048] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:19.711339   935 consensus_queue.cc:1048] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:13:19.690266  1299 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:19.723150  1325 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:19.724323  1299 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:19.719724  1335 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:19.719813 29551 debug-util.cc:398] Leaking SignalData structure 0x7b080014b220 after lost signal to thread 28237
W20260709 13:13:19.729117 29551 debug-util.cc:398] Leaking SignalData structure 0x7b080016efa0 after lost signal to thread 29313
W20260709 13:13:19.730583 29551 debug-util.cc:398] Leaking SignalData structure 0x7b0800167d80 after lost signal to thread 29405
W20260709 13:13:19.730882 29551 debug-util.cc:398] Leaking SignalData structure 0x7b0800167980 after lost signal to thread 29406
W20260709 13:13:19.733382 29551 debug-util.cc:398] Leaking SignalData structure 0x7b080035b9a0 after lost signal to thread 29480
W20260709 13:13:19.735251 29551 debug-util.cc:398] Leaking SignalData structure 0x7b080035b8c0 after lost signal to thread 29481
I20260709 13:13:19.741695 29421 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:19.742677  1322 raft_consensus.cc:2804] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:19.743211  1322 raft_consensus.cc:697] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 13 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:19.744581 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:19.745265 29451 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16.
I20260709 13:13:19.746227 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:19.747375 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:19.748173 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:19.749116 29451 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:13:19.750524 29449 raft_consensus.cc:2393] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 12: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:19.706795  1134 consensus_queue.cc:1048] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:13:19.754060 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:19.752995 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:19.753508  1298 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.759948  1298 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:19.760226 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:19.761477 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:19.762154  1298 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:19.738404  1190 consensus_queue.cc:1048] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:13:19.762163 29449 raft_consensus.cc:2368] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 9. Current term is 10.
I20260709 13:13:19.762753  1146 consensus_queue.cc:1048] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:13:19.766024  1335 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:19.748301  1248 consensus_queue.cc:1048] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:13:19.749675  1279 consensus_queue.cc:1048] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:13:19.750458  1322 consensus_queue.cc:237] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:19.771680   781 consensus_queue.cc:1048] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:19.773120   935 consensus_queue.cc:1048] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:19.752238  1309 consensus_queue.cc:1048] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:13:19.755384  1165 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.778905 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:19.779043  1165 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:19.779701  1240 consensus_queue.cc:1048] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:19.780371 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:19.786291 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:19.721594  1273 consensus_queue.cc:260] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:19.787144 29456 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
I20260709 13:13:19.750734  1242 consensus_queue.cc:1048] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:13:19.790504 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:19.775214  1298 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:19.763782  1315 consensus_queue.cc:1048] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:13:19.788393  1278 consensus_queue.cc:1048] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:13:19.805725 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:19.806574 29379 raft_consensus.cc:2393] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 13: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:19.781039  1335 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:13:19.799988 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 111037us
I20260709 13:13:19.802910 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:19.803877 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:19.824445 29449 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:19.824584 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:19.806456 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:19.797001  1325 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 8. Current term is 9.
I20260709 13:13:19.810354 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:19.810945  1279 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.812450 29344 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:19.812559 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:19.815941 29379 raft_consensus.cc:1240] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:13:19.816088 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:19.816980 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:19.802372  1190 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.817238  1335 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:19.819017  1165 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:19.784585   832 consensus_queue.cc:1048] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
W20260709 13:13:19.823725 29551 debug-util.cc:398] Leaking SignalData structure 0x7b08003af980 after lost signal to thread 29554
W20260709 13:13:19.838372 29551 debug-util.cc:398] Leaking SignalData structure 0x7b080035d9e0 after lost signal to thread 29555
I20260709 13:13:19.838707 29524 raft_consensus.cc:1275] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:13:19.828809 29419 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:19.829254 29495 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:19.846931 29449 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:13:19.851805 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:19.852769 29377 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:19.851038 29419 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:19.856596 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:19.857425 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:19.858999 29495 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:19.860452 29530 raft_consensus.cc:1275] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:13:19.861157 29452 raft_consensus.cc:1240] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 13 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:19.862475 29456 raft_consensus.cc:1240] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:19.863864 29456 raft_consensus.cc:1240] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:19.863631 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:19.864603 29449 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:13:19.849882  1165 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.805244  1298 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:19.866542 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:19.871245 29495 leader_election.cc:400] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 9. Current term is 10.
I20260709 13:13:19.871624 29495 leader_election.cc:403] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:19.879684 29456 raft_consensus.cc:1240] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:13:19.885475 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:19.886874 29456 raft_consensus.cc:1240] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:19.883567 29495 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:19.866386  1261 raft_consensus.cc:2804] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:19.831990  1190 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:19.831048  1279 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:19.872617  1165 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:19.868660  1325 raft_consensus.cc:2749] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:19.869346  1356 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:19.869987  1322 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:19.896330 29523 raft_consensus.cc:1240] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:19.881692  1302 raft_consensus.cc:2804] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:19.907653 29456 raft_consensus.cc:1275] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:13:19.901845 29495 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:19.905002 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:19.911574 29495 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:19.918217 29381 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 12.
I20260709 13:13:19.909714  1216 raft_consensus.cc:2804] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:19.934700 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:19.910595  1302 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.920917  1358 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.921283  1312 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:13:19.980576 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 129666us
I20260709 13:13:19.983479  1364 consensus_queue.cc:1048] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:19.985175 29419 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:19.992559 29419 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:20.037176  1335 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:20.038868  1357 log.cc:927] Time spent T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.101s	user 0.000s	sys 0.003s
I20260709 13:13:20.037799 29267 maintenance_manager.cc:643] P 4fe079bd41744b15a21e1f8c8d83890b: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 5.377s	user 0.161s	sys 0.109s Metrics: {"bytes_written":31087,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":285301,"dirs.run_cpu_time_us":515,"dirs.run_wall_time_us":1353,"drs_written":1,"lbm_read_time_us":412,"lbm_reads_lt_1ms":4,"lbm_write_time_us":50195,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":33,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":701267,"threads_started":1,"update_count":29}
W20260709 13:13:20.042608 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 50116.3us
I20260709 13:13:20.044090 29419 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:19.932416  1261 raft_consensus.cc:697] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:20.050480 29419 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:20.054255 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 175271us
W20260709 13:13:20.069684 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 149599us
I20260709 13:13:20.075965 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:19.935596  1216 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:19.980589  1360 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.923755  1283 consensus_queue.cc:1059] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:13:19.981607  1302 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:19.983557  1359 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:20.040359  1277 raft_consensus.cc:2804] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:20.126963  1277 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:20.126783  1370 consensus_queue.cc:1059] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:20.127426  1277 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:19.911839  1356 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:20.165266 29268 maintenance_manager.cc:419] P 4fe079bd41744b15a21e1f8c8d83890b: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9273 bytes on disk
I20260709 13:13:20.042363  1358 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:20.079898  1325 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:20.045305  1335 raft_consensus.cc:2749] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:20.113557  1165 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:20.113950  1362 consensus_queue.cc:1048] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:20.045327  1322 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:20.101974  1366 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:20.104372  1261 consensus_queue.cc:237] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:20.165014  1359 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:20.191409  1359 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:13:20.086449 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:20.192813  1313 consensus_queue.cc:1059] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:20.069437  1286 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 9. Current term is 10.
I20260709 13:13:20.125953  1319 raft_consensus.cc:2764] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:13:20.197219 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:20.198137 29450 raft_consensus.cc:2393] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 13: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:20.123066 29377 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 12.
I20260709 13:13:20.199004 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:20.093050  1216 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:20.068986  1312 raft_consensus.cc:697] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:20.168087 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:20.177307 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:20.116358  1360 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:20.126776  1373 consensus_queue.cc:1048] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 13:13:20.129814  1297 raft_consensus.cc:2955] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 13 LEADER]: Committing config change with OpId 10.8: config changed from index 6 to 8, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:13:20.187477 29267 maintenance_manager.cc:643] P 4fe079bd41744b15a21e1f8c8d83890b: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.015s	user 0.001s	sys 0.001s Metrics: {"cfile_init":1,"lbm_read_time_us":456,"lbm_reads_lt_1ms":4}
I20260709 13:13:20.200533 29372 raft_consensus.cc:1240] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:20.269726  1360 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:20.212977 29377 raft_consensus.cc:1240] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:20.237728 29448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2521) took 2336 ms. Trace:
I20260709 13:13:20.200945 29449 raft_consensus.cc:1275] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:13:20.283399 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:20.284019 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:20.285830 29379 raft_consensus.cc:2468] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
W20260709 13:13:20.287361 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 191900us
I20260709 13:13:20.283757 29448 rpcz_store.cc:276] 0709 13:13:17.901404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.901547 (+   143us) service_pool.cc:224] Handling call
0709 13:13:17.901887 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:18.008761 (+106874us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:13:18.107067 (+ 98306us) log.cc:844] Serialized 14 byte log entry
0709 13:13:19.047059 (+939992us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:19.047124 (+    65us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:19.047189 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:20.237297 (+1190108us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54003d1dd4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:20.237369 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:20.237576 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":158751,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":46,"raft.queue_time_us":214649,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"spinlock_wait_cycles":245064064,"thread_start_us":1035237,"threads_started":3,"wal-append.queue_time_us":205362,"wal-append.run_cpu_time_us":1697,"wal-append.run_wall_time_us":1007175}
I20260709 13:13:20.282503 29450 raft_consensus.cc:2955] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 6 to 8, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:13:20.294979 29421 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:20.208943  1358 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:20.297806 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:20.214234  1365 log.cc:927] Time spent T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
I20260709 13:13:20.311635 29449 raft_consensus.cc:1275] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:13:20.301704 29421 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:20.315104 29421 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:20.317009 29421 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:20.318856 29421 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:20.305150  1354 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:20.203626  1356 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:20.298686 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:20.304881 29346 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:20.320143 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:20.322794 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:20.323356 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:20.324167 29449 raft_consensus.cc:2468] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:13:20.324201 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:20.325006 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:20.325531 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:20.329231 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:20.330904  1356 raft_consensus.cc:2749] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:20.332733  1387 raft_consensus.cc:2749] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:20.331982  1367 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.335565  1367 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:20.325836 29449 raft_consensus.cc:2410] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:13:20.339707  1389 raft_consensus.cc:3055] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:20.340278  1389 raft_consensus.cc:740] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:20.340408 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:20.341632 29449 raft_consensus.cc:2393] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 11: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:20.341452  1389 consensus_queue.cc:260] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:20.344214 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:20.299743  1362 consensus_queue.cc:1059] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:13:20.349236 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:20.350136 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:20.353376 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:20.355166 29376 raft_consensus.cc:1240] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:13:20.345842  1354 raft_consensus.cc:2749] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:20.362309  1305 raft_consensus.cc:3055] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:20.362824  1305 raft_consensus.cc:740] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:20.363794  1305 consensus_queue.cc:260] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:20.366433 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:20.367640 29456 raft_consensus.cc:2410] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:13:20.367478  1388 raft_consensus.cc:2749] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:20.345410  1389 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:20.347191  1356 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:13:20.376214 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 48720.5us
I20260709 13:13:20.357053  1360 raft_consensus.cc:493] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:20.378141 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:20.378280 29346 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:20.380118 29449 raft_consensus.cc:2410] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:13:20.380565 29346 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:20.382025  1358 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:20.382543  1380 consensus_queue.cc:1048] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:13:20.386705 29380 raft_consensus.cc:1240] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:20.381933  1360 raft_consensus.cc:515] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:20.390441  1360 leader_election.cc:290] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:13:20.390558 29454 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45798 (request call id 2541) took 2069 ms (client timeout 2529 ms). Trace:
I20260709 13:13:20.391855 29375 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:13:20.393997  1358 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:20.394699 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:20.391199 29454 rpcz_store.cc:269] 0709 13:13:18.320844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:18.689776 (+368932us) service_pool.cc:224] Handling call
0709 13:13:20.390299 (+1700523us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b5400253ad4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:20.390448 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":237127936}
I20260709 13:13:20.402951 29377 raft_consensus.cc:1240] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:13:20.405858 29379 raft_consensus.cc:2393] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 12: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
W20260709 13:13:20.409469 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 90730.5us
I20260709 13:13:20.410657 29421 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:20.411686 29377 raft_consensus.cc:1240] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:13:20.415836 29421 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:20.416024 29346 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:20.455519  1387 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:20.456171  1387 raft_consensus.cc:697] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 12 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:20.457023 29377 raft_consensus.cc:1275] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:13:20.457192  1387 consensus_queue.cc:237] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:20.460299  1362 raft_consensus.cc:2804] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:20.460757  1362 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:20.461118  1362 raft_consensus.cc:3060] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:20.471015 29377 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:13:20.473898 29377 raft_consensus.cc:606] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:20.476765 29421 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:20.416831  1354 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:20.416675  1356 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.488778  1362 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:20.493003  1362 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:20.489465 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:20.498907 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:20.452221  1380 consensus_queue.cc:1048] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:13:20.500510 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:20.500672  1356 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:20.501986 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:20.503034  1356 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:20.503105 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:20.499010  1393 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:20.522913 29380 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 15.
I20260709 13:13:20.522977  1393 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:20.524488 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:20.525653  1393 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:20.525880 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:20.508812 29379 raft_consensus.cc:1240] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:20.528378 29380 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
I20260709 13:13:20.530633 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:20.201745  1298 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:20.534974 29380 raft_consensus.cc:1275] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:13:20.536417 29447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 435) took 1005 ms. Trace:
I20260709 13:13:20.536851 29447 rpcz_store.cc:276] 0709 13:13:19.530516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.535398 (+1004882us) service_pool.cc:224] Handling call
0709 13:13:20.535924 (+   526us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:20.536113 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:20.536138 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:20.536180 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:20.536209 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:20.536265 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:20.536358 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:20.538295 29380 raft_consensus.cc:1275] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:13:20.538429 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:20.493628  1277 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:20.541968 29421 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:20.542727 29380 raft_consensus.cc:1275] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:13:20.548480 29421 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:20.544001  1354 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:20.549666  1354 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:20.542836  1356 raft_consensus.cc:2749] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:20.552141  1356 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:20.552609  1356 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:20.552953  1356 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:20.558362 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:20.563897  1298 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:20.564529  1298 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:20.564917  1298 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:20.565234  1394 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.565874  1366 consensus_queue.cc:1048] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:20.566044  1394 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:20.570289  1321 consensus_queue.cc:1048] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:20.571252  1394 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:20.580331  1354 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:20.581055  1354 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.581565  1354 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:20.583142 29453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2534) took 2264 ms. Trace:
I20260709 13:13:20.599848 29453 rpcz_store.cc:276] 0709 13:13:18.318305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:18.516069 (+197764us) service_pool.cc:224] Handling call
0709 13:13:18.516533 (+   464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:18.790782 (+274249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:18.790829 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:18.791483 (+   654us) log.cc:844] Serialized 26 byte log entry
0709 13:13:19.024151 (+232668us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:19.024490 (+   339us) log.cc:844] Serialized 14 byte log entry
0709 13:13:19.024688 (+   198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:20.582690 (+1558002us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b54000cf8d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:20.582744 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:20.582796 (+    52us) raft_consensus.cc:1685] finished
0709 13:13:20.582903 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:20.583072 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36245,"prepare.queue_time_us":863,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":38,"raft.queue_time_us":238864,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":225,"spinlock_wait_cycles":546104064,"thread_start_us":232291,"threads_started":1,"wal-append.queue_time_us":232499,"wal-append.run_cpu_time_us":2758,"wal-append.run_wall_time_us":1015762}
I20260709 13:13:20.609856  1354 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:20.612813 29522 raft_consensus.cc:1240] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:20.625802  1354 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:20.626565  1354 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:20.628232 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:20.630836 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:20.634325  1354 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:20.591924  1277 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:20.634416 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:20.644089 29522 raft_consensus.cc:1240] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:13:20.648619  1298 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:20.649812 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 97621.8us
I20260709 13:13:20.643199 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:20.651252 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:20.662420 29529 raft_consensus.cc:2410] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:13:20.651384 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:20.655716  1165 consensus_queue.cc:1048] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:20.652017 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:20.677807 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:20.211468  1190 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:20.680282 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:20.680528 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:20.647286  1356 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:20.694046 29447 raft_consensus.cc:2393] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 15: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:20.696779  1277 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:20.207345  1279 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:20.699656  1277 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:20.703692  1277 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:20.705346  1298 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:20.714156 29522 raft_consensus.cc:1275] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:13:20.712031  1165 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:20.723218 30120 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.012s	sys 0.008s
I20260709 13:13:20.723382  1356 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:20.723733 30120 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.013s	sys 0.008s
I20260709 13:13:20.738860 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:20.739251 29522 raft_consensus.cc:1275] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:13:20.722105  1165 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:20.791350 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:20.794118 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:20.794914 29456 raft_consensus.cc:2376] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13. Re-sending same reply.
I20260709 13:13:20.776661  1356 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:20.807314 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:20.847963 29452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 1581) took 1107 ms. Trace:
I20260709 13:13:20.848498 29452 rpcz_store.cc:276] 0709 13:13:19.740749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.743814 (+  3065us) service_pool.cc:224] Handling call
0709 13:13:19.744123 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:19.861682 (+117559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:20.847650 (+985968us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b54000c26d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:20.847889 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":268536576}
I20260709 13:13:20.853938 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:20.854732 29374 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:20.799615  1356 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:20.860395 29530 raft_consensus.cc:1275] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:13:20.860944 29530 pending_rounds.cc:85] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 7
I20260709 13:13:20.861151 29530 pending_rounds.cc:107] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:13:20.861334 29530 raft_consensus.cc:2889] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:20.850920  1216 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:20.868489  1405 log.cc:927] Time spent T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:13:20.898675 29522 raft_consensus.cc:1240] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:20.899683  1216 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:20.908363  1407 log.cc:927] Time spent T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.103s	user 0.000s	sys 0.002s
I20260709 13:13:20.910513 29453 raft_consensus.cc:1240] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:20.910501 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:20.914853 29378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52172 (request call id 1906) took 1107 ms. Trace:
I20260709 13:13:20.915243 29378 rpcz_store.cc:276] 0709 13:13:19.807060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.910216 (+1103156us) service_pool.cc:224] Handling call
0709 13:13:20.914781 (+  4565us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:20.916373 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:20.917217 29378 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:20.920584 29421 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:20.924546 29344 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:20.926353 29344 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:20.928706  1237 consensus_queue.cc:1059] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:20.930112  1279 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:20.935460 29378 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 16.
I20260709 13:13:20.937536  1237 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:20.939895  1394 raft_consensus.cc:3055] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:20.945413  1388 raft_consensus.cc:3055] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:20.948879 29344 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:20.943209  1273 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:20.969587   832 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:20.980821 29521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3216) took 1119 ms. Trace:
I20260709 13:13:20.981288 29521 rpcz_store.cc:276] 0709 13:13:19.846408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.846557 (+   149us) service_pool.cc:224] Handling call
0709 13:13:19.846940 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:19.857844 (+ 10904us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:19.857887 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:19.858534 (+   647us) log.cc:844] Serialized 26 byte log entry
0709 13:13:20.846159 (+987625us) spinlock_profiling.cc:243] Waited 950 us on lock 0x7b18003d8ee0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c7be07 00007f6a81ad6ab9 00007f6a78c9869b 00007f6a78c9693f 00007f6a78c98c02 00007f6a7b92020b 00007f6a7b925d23 00007f6a7b9260d1 00007f6a7bd41a0f
0709 13:13:20.901903 (+ 55744us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:20.901942 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:20.902021 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:20.948333 (+ 46312us) raft_consensus.cc:1685] finished
0709 13:13:20.948370 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:20.965824 (+ 17454us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14547,"raft.queue_time_us":21243,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":4755,"spinlock_wait_cycles":2185984,"thread_start_us":55537,"threads_started":1,"wal-append.queue_time_us":1072140}
I20260709 13:13:20.958889  1237 consensus_queue.cc:1059] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:13:20.964905  1394 raft_consensus.cc:740] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:20.966358  1388 raft_consensus.cc:740] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:20.997589  1388 consensus_queue.cc:260] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:20.999987  1420 raft_consensus.cc:493] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:21.000648  1420 raft_consensus.cc:515] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:21.001083  1311 consensus_queue.cc:1048] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:20.992733 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:20.985512  1165 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:21.003376  1420 leader_election.cc:290] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:13:21.017097 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 46145.8us
I20260709 13:13:21.029070 29374 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 15.
I20260709 13:13:21.030339  1283 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:21.032192  1298 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.032840  1298 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:21.038684 29455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 429) took 2685 ms. Trace:
I20260709 13:13:21.040339  1394 consensus_queue.cc:260] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:21.041975  1394 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:21.030943  1283 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:21.060492 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
W20260709 13:13:21.064145 29381 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52172 (request call id 1908) took 1240 ms (client timeout 1591 ms). Trace:
W20260709 13:13:21.064621 29381 rpcz_store.cc:269] 0709 13:13:19.824161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.824308 (+   147us) service_pool.cc:224] Handling call
0709 13:13:21.063924 (+1239616us) spinlock_profiling.cc:243] Waited 92.9 ms on lock 0x7b54003b0954. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:21.064071 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":213673344}
I20260709 13:13:21.067130  1279 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:13:21.067961 29495 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.997s	user 0.020s	sys 0.041s
W20260709 13:13:21.068308 29495 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.997s	user 0.020s	sys 0.041s
W20260709 13:13:21.068749 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 997694us
I20260709 13:13:21.068221  1283 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:21.073031  1305 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:21.074970  1216 consensus_queue.cc:1059] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:21.039142 29455 rpcz_store.cc:276] 0709 13:13:18.352769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.023396 (+670627us) service_pool.cc:224] Handling call
0709 13:13:19.023734 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:19.100362 (+ 76628us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:19.100426 (+    64us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:19.100498 (+    72us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:19.100553 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:21.038380 (+1937827us) spinlock_profiling.cc:243] Waited 76.3 ms on lock 0x7b54001c1954. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:21.038436 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:21.038608 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175482624}
I20260709 13:13:21.076895 29451 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
W20260709 13:13:21.082211 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 61571.8us
I20260709 13:13:21.080725  1277 consensus_queue.cc:1048] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:13:21.072340  1359 raft_consensus.cc:3055] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:21.084982  1359 raft_consensus.cc:740] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:13:21.085984 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:21.087235 29456 raft_consensus.cc:1275] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:13:21.085866  1359 consensus_queue.cc:260] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:21.090126  1359 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:13:21.090577   781 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.035s	user 0.006s	sys 0.019s
W20260709 13:13:21.090946   781 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.036s	user 0.006s	sys 0.019s
W20260709 13:13:21.096056  1242 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.159s	user 0.011s	sys 0.004s
W20260709 13:13:21.096481  1242 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.168s	user 0.012s	sys 0.004s
I20260709 13:13:21.099622  1242 consensus_queue.cc:1048] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:13:21.105782 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 185343us
W20260709 13:13:21.109762 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 131523us
I20260709 13:13:21.117108  1354 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:13:21.143831 29346 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:21.126960  1216 raft_consensus.cc:3055] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:21.125916  1366 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:21.112035  1277 consensus_queue.cc:1048] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:13:21.153745  1216 raft_consensus.cc:740] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:21.140651  1278 consensus_queue.cc:1048] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
W20260709 13:13:21.181866 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 73421.9us
I20260709 13:13:21.182973 29421 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:21.162850  1240 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:21.207103 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:21.240993 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 74544.9us
I20260709 13:13:21.261008 29421 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:21.265332 29421 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:21.180555  1298 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:21.166829   892 consensus_queue.cc:1059] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 13:13:21.188220  1273 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:21.182011  1354 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:13:21.277510 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 99878.4us
W20260709 13:13:21.281847 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:21.282532 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:21.245213  1283 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:21.268244  1387 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:21.243764  1362 consensus_queue.cc:1059] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:13:21.166831  1366 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:21.274681  1298 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:21.286615  1354 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:21.293092  1273 raft_consensus.cc:697] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 16 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:21.269709  1216 consensus_queue.cc:260] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:21.306330  1387 raft_consensus.cc:697] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 15 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
W20260709 13:13:21.348918 29477 debug-util.cc:398] Leaking SignalData structure 0x7b08001c8ee0 after lost signal to thread 28237
W20260709 13:13:21.349943  1427 log.cc:927] Time spent T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:13:21.351943 29450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2573) took 1067 ms. Trace:
I20260709 13:13:21.352527 29450 rpcz_store.cc:276] 0709 13:13:20.284433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.903237 (+618804us) service_pool.cc:224] Handling call
0709 13:13:20.903635 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:21.128837 (+225202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:21.128869 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:21.129349 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 13:13:21.241728 (+112379us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:21.241772 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:21.241849 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:21.351590 (+109741us) raft_consensus.cc:1685] finished
0709 13:13:21.351621 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:21.351849 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":222435,"raft.queue_time_us":239710,"spinlock_wait_cycles":4381568,"thread_start_us":75537,"threads_started":1,"wal-append.queue_time_us":134343}
I20260709 13:13:21.326185  1424 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.301729  1283 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:21.370914   892 raft_consensus.cc:3055] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:21.406421   892 raft_consensus.cc:740] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:21.407572   892 consensus_queue.cc:260] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:21.409228   892 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:21.330063  1298 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:13:21.417285  1430 log.cc:927] Time spent T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:13:21.421473 29453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2576) took 1127 ms. Trace:
I20260709 13:13:21.414844  1298 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:21.422626 29453 rpcz_store.cc:276] 0709 13:13:20.294275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.912857 (+618582us) service_pool.cc:224] Handling call
0709 13:13:20.913104 (+   247us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:21.105406 (+192302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:21.105436 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:21.105910 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 13:13:21.146280 (+ 40370us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:21.146322 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:21.146398 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:21.421164 (+274766us) raft_consensus.cc:1685] finished
0709 13:13:21.421191 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:21.421392 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":212192,"raft.queue_time_us":194319,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":4685,"thread_start_us":13895,"threads_started":1,"wal-append.queue_time_us":56407}
I20260709 13:13:21.403151  1216 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:13:21.436187 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 365597us
I20260709 13:13:21.442606 29453 raft_consensus.cc:1275] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:13:21.446532  1309 raft_consensus.cc:993] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5: : Instructing follower 183db85c071f489fbc8de63a9edd8a3a to start an election
I20260709 13:13:21.472424  1309 raft_consensus.cc:1081] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Signalling peer 183db85c071f489fbc8de63a9edd8a3a to start an election
I20260709 13:13:21.435043  1273 consensus_queue.cc:237] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:21.400017  1424 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:21.476612  1041 raft_consensus.cc:3055] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:21.446026  1387 consensus_queue.cc:237] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:21.498235 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:21.667786 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:21.677078 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:21.677882 29380 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 13.
I20260709 13:13:21.682335 29380 raft_consensus.cc:1275] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:13:21.686774 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:21.687690 29373 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11.
I20260709 13:13:21.689188 29373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52172 (request call id 1903) took 1885 ms. Trace:
I20260709 13:13:21.689581 29373 rpcz_store.cc:276] 0709 13:13:19.803301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.686453 (+1883152us) service_pool.cc:224] Handling call
0709 13:13:21.689122 (+  2669us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:21.697208 29477 debug-util.cc:398] Leaking SignalData structure 0x7b08000b7880 after lost signal to thread 29313
I20260709 13:13:21.701138 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:21.569768  1423 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:21.532896  1366 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:21.683921  1283 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:21.666397  1041 raft_consensus.cc:740] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:21.710413  1431 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.711913 29373 raft_consensus.cc:2468] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:13:21.691316  1354 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:20.198815  1319 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:21.723218 29421 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:21.723593  1426 consensus_queue.cc:1059] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:21.757730  1426 consensus_queue.cc:1243] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer 183db85c071f489fbc8de63a9edd8a3a log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:13:21.759182  1312 consensus_queue.cc:237] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:21.727298  1438 log.cc:927] Time spent T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
W20260709 13:13:21.730113  1305 consensus_meta.cc:287] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.657s	user 0.009s	sys 0.004s
W20260709 13:13:21.731349  1447 log.cc:927] Time spent T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
I20260709 13:13:21.568704  1449 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:21.731724 29276 catalog_manager.cc:5697] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:13:21.741257  1261 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.549s	user 0.003s	sys 0.013s
I20260709 13:13:21.741628 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:21.748962 29456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2593) took 1244 ms. Trace:
I20260709 13:13:21.753752  1431 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:21.725703  1441 log.cc:927] Time spent T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
W20260709 13:13:21.764750 29376 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.022s	sys 0.041s
W20260709 13:13:21.785413 29376 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.022s	sys 0.041s
I20260709 13:13:21.775978 29456 rpcz_store.cc:276] 0709 13:13:20.504526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.088148 (+583622us) service_pool.cc:224] Handling call
0709 13:13:21.088486 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:21.126485 (+ 37999us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:21.126537 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:21.135592 (+  9055us) log.cc:844] Serialized 26 byte log entry
0709 13:13:21.466061 (+330469us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:21.466106 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:21.466187 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:21.748608 (+282421us) raft_consensus.cc:1685] finished
0709 13:13:21.748645 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:21.748873 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37292,"raft.queue_time_us":51215,"spinlock_wait_cycles":6161792,"thread_start_us":308638,"threads_started":1,"wal-append.queue_time_us":541670}
I20260709 13:13:21.788995  1442 raft_consensus.cc:493] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
W20260709 13:13:21.789806  1297 consensus_meta.cc:287] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent flushing consensus metadata: real 0.741s	user 0.013s	sys 0.000s
I20260709 13:13:21.789716  1442 raft_consensus.cc:515] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:21.765187  1354 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:21.772333  1283 raft_consensus.cc:3055] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:21.806255 29455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2591) took 1333 ms. Trace:
I20260709 13:13:21.807102 29455 rpcz_store.cc:276] 0709 13:13:20.473301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.081887 (+608586us) service_pool.cc:224] Handling call
0709 13:13:21.083686 (+  1799us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:21.121404 (+ 37718us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:21.121454 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:21.122129 (+   675us) log.cc:844] Serialized 26 byte log entry
0709 13:13:21.475090 (+352961us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:21.475144 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:21.475261 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:21.806005 (+330744us) raft_consensus.cc:1685] finished
0709 13:13:21.806028 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:21.806173 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37239,"raft.queue_time_us":55982,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":2461,"thread_start_us":352528,"threads_started":1,"wal-append.queue_time_us":376562}
W20260709 13:13:21.810992 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:21.812600 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:21.813314 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:21.764961  1319 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:21.797469 29454 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.017s	sys 0.012s
W20260709 13:13:21.799079 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:21.821204 29454 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.018s	sys 0.012s
W20260709 13:13:21.824553  1261 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.632s	user 0.004s	sys 0.014s
W20260709 13:13:21.801542 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 364403us
I20260709 13:13:21.828531 29380 raft_consensus.cc:1240] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 15. Current term is 16. Ops: []
W20260709 13:13:21.831916 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 59277.3us
I20260709 13:13:21.784631  1449 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:21.773998  1423 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:21.841063 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:21.920572 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:21.922011 29454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2580) took 1614 ms. Trace:
I20260709 13:13:21.894968 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:21.922564 29454 rpcz_store.cc:276] 0709 13:13:20.307631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.973464 (+665833us) service_pool.cc:224] Handling call
0709 13:13:20.973772 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:21.266526 (+292754us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:21.266560 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:21.267052 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 13:13:21.822755 (+555703us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:21.822830 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:21.822938 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:21.921787 (+ 98849us) raft_consensus.cc:1685] finished
0709 13:13:21.921812 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:21.921946 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":159617,"raft.queue_time_us":173466,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":5062,"thread_start_us":687992,"threads_started":2,"wal-append.queue_time_us":652105}
I20260709 13:13:21.924592 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:21.925012 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:21.896755 29525 raft_consensus.cc:2410] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:13:21.927342 29449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2594) took 1420 ms. Trace:
I20260709 13:13:21.872812 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:21.929965 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:21.930277 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:21.934298 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:21.936123 29453 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
I20260709 13:13:21.939764 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:21.929452 29372 raft_consensus.cc:2468] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:13:21.928587 29449 rpcz_store.cc:276] 0709 13:13:20.506514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.240383 (+733869us) service_pool.cc:224] Handling call
0709 13:13:21.265709 (+ 25326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:21.265979 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:21.266006 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:21.269205 (+  3199us) log.cc:844] Serialized 26 byte log entry
0709 13:13:21.365864 (+ 96659us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:21.365920 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:21.366024 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:21.927063 (+561039us) raft_consensus.cc:1685] finished
0709 13:13:21.927089 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:21.927274 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":69317,"threads_started":1,"wal-append.queue_time_us":199243}
I20260709 13:13:21.802528  1283 raft_consensus.cc:740] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:21.927809 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:21.951076 29453 raft_consensus.cc:2468] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 2.
W20260709 13:13:21.927700   892 consensus_meta.cc:287] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.513s	user 0.016s	sys 0.000s
I20260709 13:13:21.856477  1366 raft_consensus.cc:2804] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:21.805534  1354 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:21.891098  1305 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:21.923666   781 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:21.922061  1448 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
W20260709 13:13:21.970757  1393 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.012s	sys 0.017s
W20260709 13:13:21.979112  1278 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.012s	sys 0.021s
W20260709 13:13:21.976611  1359 consensus_meta.cc:287] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.884s	user 0.015s	sys 0.001s
I20260709 13:13:21.970803  1366 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:21.983749   781 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:22.029278  1354 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:22.030519  1442 leader_election.cc:290] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:22.033388 29380 raft_consensus.cc:2410] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 13:13:21.993016  1393 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.012s	sys 0.018s
W20260709 13:13:22.017688  1278 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.012s	sys 0.021s
I20260709 13:13:22.017406  1424 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:22.082607 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:22.090378  1460 log.cc:927] Time spent T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.130s	user 0.000s	sys 0.002s
I20260709 13:13:22.090629  1319 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:21.983960  1448 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:13:22.068732  1216 consensus_meta.cc:287] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.637s	user 0.009s	sys 0.005s
W20260709 13:13:22.099396  1451 log.cc:927] Time spent T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:13:22.101341  1456 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:22.103935   781 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:22.104282  1423 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:22.105274 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:22.108738 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
W20260709 13:13:22.111035  1465 log.cc:927] Time spent T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:13:20.242132  1302 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:22.112577  1462 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:22.033304  1283 consensus_queue.cc:260] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:22.097229 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:22.109539  1393 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:22.120918  1464 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:22.098459  1319 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:22.119911  1455 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:22.111776  1463 consensus_queue.cc:1048] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.128s
I20260709 13:13:22.040356  1366 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:21.981246  1305 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:22.146166 29530 raft_consensus.cc:1240] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 LEADER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:22.125252   781 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:22.163594 29528 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.274s	user 0.005s	sys 0.012s
I20260709 13:13:22.155993  1423 consensus_queue.cc:1048] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:13:22.160418  1356 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:22.124336  1424 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:22.171056 29523 raft_consensus.cc:1240] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:13:22.129917  1335 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:22.172688  1449 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:22.136018  1431 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:22.183290 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 350504us
I20260709 13:13:22.186323 29419 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:22.158264  1393 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:22.193576  1298 consensus_meta.cc:287] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.771s	user 0.016s	sys 0.000s
I20260709 13:13:22.220916 29450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2596) took 1565 ms. Trace:
W20260709 13:13:22.174431  1370 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.047s	user 0.027s	sys 0.048s
I20260709 13:13:22.102144  1456 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:22.211886  1335 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:22.243806  1456 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:22.244227  1335 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:22.245522  1302 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:22.245761  1448 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:22.183894  1319 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:22.235900 29421 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:22.194264   781 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:22.193905  1364 consensus_queue.cc:1048] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
W20260709 13:13:22.254688 29528 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.365s	user 0.007s	sys 0.014s
W20260709 13:13:22.241777  1370 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.114s	user 0.027s	sys 0.049s
I20260709 13:13:22.239257 29450 rpcz_store.cc:276] 0709 13:13:20.655005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.369919 (+714914us) service_pool.cc:224] Handling call
0709 13:13:21.370250 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:21.370521 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:13:21.405305 (+ 34784us) log.cc:844] Serialized 14 byte log entry
0709 13:13:21.709964 (+304659us) spinlock_profiling.cc:243] Waited 7.4 ms on lock 0x7b18003fdc00. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c7be07 00007f6a81ad6ab9 00007f6a78c9869b 00007f6a78c9693f 00007f6a78c98c02 00007f6a7b92020b 00007f6a7b925d23 00007f6a7b92623a 00007f6a7bd90a2a
0709 13:13:22.207595 (+497631us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:22.207673 (+    78us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:22.207727 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.207803 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:22.220841 (+ 13038us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":34526,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":2851,"raft.queue_time_us":254723,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":3894,"spinlock_wait_cycles":17029888,"thread_start_us":497227,"threads_started":2,"wal-append.queue_time_us":500929}
I20260709 13:13:22.210315  1356 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:22.250578 29421 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:22.241439  1387 raft_consensus.cc:2749] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:22.258894 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:22.164191  1462 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:22.260766 29449 raft_consensus.cc:1240] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 16 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 15. Current term is 16. Ops: [15.7-15.7]
I20260709 13:13:22.260915 29528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3215) took 2411 ms. Trace:
I20260709 13:13:22.239416  1449 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:22.263823 29528 rpcz_store.cc:276] 0709 13:13:19.844788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.844940 (+   152us) service_pool.cc:224] Handling call
0709 13:13:19.845335 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:19.857284 (+ 11949us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:19.857331 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:19.862487 (+  5156us) log.cc:844] Serialized 26 byte log entry
0709 13:13:22.255278 (+2392791us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:22.255339 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:22.255455 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:22.255542 (+    87us) raft_consensus.cc:1685] finished
0709 13:13:22.255561 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:22.255755 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11429,"raft.queue_time_us":21290,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":5932,"thread_start_us":2365236,"threads_started":1,"wal-append.queue_time_us":489861,"wal-append.run_cpu_time_us":2099,"wal-append.run_wall_time_us":1003173}
I20260709 13:13:22.208802  1424 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:22.236752 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 50110.8us
I20260709 13:13:22.254487  1335 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:22.255954  1437 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:22.282305 29419 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:22.286653 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:22.287725 29454 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
I20260709 13:13:22.263074  1448 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.247241  1298 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:22.267017  1463 raft_consensus.cc:2804] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:13:22.293284 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:22.209127  1455 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:13:22.294703 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 101861us
I20260709 13:13:22.296066  1462 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:22.282955  1302 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:13:22.310621 29493 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.211s	user 0.023s	sys 0.022s
W20260709 13:13:22.311177 29493 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.211s	user 0.023s	sys 0.022s
W20260709 13:13:22.302757 29495 connection.cc:256] RPC call timeout handler was delayed by -1.1377368880000631s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15300000000000002s for a response
I20260709 13:13:22.269198  1370 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:22.287560  1456 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:13:22.322743 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:22.314301 29495 connection.cc:256] RPC call timeout handler was delayed by -1.0486368879999191s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16290000000000002s for a response
I20260709 13:13:22.288465  1273 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.274290  1335 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:22.321501 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:22.323634 29495 connection.cc:256] RPC call timeout handler was delayed by -1.0315368880001188s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1648s for a response
I20260709 13:13:22.197777  1464 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:22.264789  1356 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:22.271199  1449 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:22.305383  1463 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:22.298028  1387 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.326707  1216 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:22.324867  1286 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:22.341404 29495 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:22.343472 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
W20260709 13:13:22.344556 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:22.345954  1458 log.cc:927] Time spent T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.118s	user 0.001s	sys 0.001s
I20260709 13:13:22.365206  1464 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:22.366007  1464 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:22.366876   781 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:22.327124  1335 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:22.327642 29373 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 13.
I20260709 13:13:22.326624 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:22.350821  1473 log.cc:927] Time spent T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:13:22.324878  1462 raft_consensus.cc:2749] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:22.327047  1431 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:22.358100  1478 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:22.305516  1448 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:22.359660 29450 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
I20260709 13:13:22.377434  1305 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:22.355887  1463 raft_consensus.cc:3060] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:22.352805 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:22.327333  1442 raft_consensus.cc:493] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:22.318463  1302 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:22.397775 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:22.401145  1470 log.cc:927] Time spent T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:13:22.366957  1041 consensus_queue.cc:260] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:22.402683  1302 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:22.403038  1338 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:22.327135  1456 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:22.329660  1273 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:22.405139  1472 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:22.324941  1370 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:22.415647  1461 raft_consensus.cc:493] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:22.293767  1437 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:22.415714  1319 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:22.423019  1472 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:22.369956  1387 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:22.378119  1216 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:22.434653  1455 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:22.435209 29522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164"
dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:52288
I20260709 13:13:22.366536  1464 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:22.436303  1298 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:22.394837  1431 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:22.437479  1387 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:22.438560  1469 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:22.438992  1356 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:22.441293  1370 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:22.484118  1367 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:22.445519  1273 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:22.450554 29376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1492) took 2237 ms. Trace:
I20260709 13:13:22.451037  1393 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:22.485090 29376 rpcz_store.cc:276] 0709 13:13:20.212807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.359863 (+147056us) service_pool.cc:224] Handling call
0709 13:13:21.070941 (+711078us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:21.094072 (+ 23131us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:21.094107 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:21.094754 (+   647us) log.cc:844] Serialized 52 byte log entry
0709 13:13:21.114464 (+ 19710us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:21.155025 (+ 40561us) log.cc:844] Serialized 14 byte log entry
0709 13:13:21.163734 (+  8709us) log.cc:844] Serialized 14 byte log entry
0709 13:13:21.785981 (+622247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:21.786107 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:21.786188 (+    81us) raft_consensus.cc:1685] finished
0709 13:13:21.786206 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:22.135255 (+349049us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b1800252700. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c993f3 00007f6a78c9b7c1 00007f6a78c9b779 00007f6a78c9b709 00007f6a78c9b6d1 00007f6a78c9a9cd 000000000038f354 000000000038f199 00007f6a78c7c83a
0709 13:13:22.450312 (+315057us) spinlock_profiling.cc:243] Waited 711 ms on lock 0x7b54003b0950. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd858ad 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:22.450473 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65668,"prepare.queue_time_us":1650,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":62,"raft.queue_time_us":131654,"raft.run_cpu_time_us":604,"raft.run_wall_time_us":13374,"spinlock_wait_cycles":1637417984,"thread_start_us":658988,"threads_started":3,"wal-append.queue_time_us":19555,"wal-append.run_cpu_time_us":5241,"wal-append.run_wall_time_us":1240664}
I20260709 13:13:22.422060  1302 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:22.380928  1286 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:22.462482 29447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45798 (request call id 2590) took 1991 ms. Trace:
I20260709 13:13:22.462698 29455 raft_consensus.cc:1240] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 15 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:13:22.491236 29447 rpcz_store.cc:276] 0709 13:13:20.470649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.542037 (+ 71388us) service_pool.cc:224] Handling call
0709 13:13:22.462206 (+1920169us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b54002909d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:22.462405 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":309892480}
I20260709 13:13:22.420013  1442 raft_consensus.cc:515] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:22.416682  1462 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:22.464762  1312 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:22.436018  1448 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:22.464674 29522 raft_consensus.cc:606] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:22.507485 29522 raft_consensus.cc:614] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:22.486097  1364 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.466861  1449 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:22.449196  1463 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:22.493920  1393 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:13:22.467656 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 192664us
I20260709 13:13:22.467638  1461 raft_consensus.cc:515] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:22.485603  1387 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:22.488307  1356 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:22.407087  1478 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:22.495002  1472 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:22.491192  1424 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:22.524580  1456 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:22.525842  1457 log.cc:927] Time spent T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.283s	user 0.002s	sys 0.000s
W20260709 13:13:22.541136 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 223978us
I20260709 13:13:22.543138 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:22.509379  1462 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:22.495347  1302 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:22.531555  1364 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:22.547771  1464 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:22.548583  1478 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:22.551532  1462 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:22.539459 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:22.509677  1312 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:22.556852  1302 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:22.558514  1216 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:22.527611  1393 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:22.530526  1387 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:22.535866  1356 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:22.567358  1431 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:22.570092  1366 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:22.495841  1469 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:22.584738 29527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3260) took 1301 ms. Trace:
I20260709 13:13:22.585724  1356 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:22.583827  1462 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:22.606379  1462 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:22.585141 29527 rpcz_store.cc:276] 0709 13:13:21.282968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.283126 (+   158us) service_pool.cc:224] Handling call
0709 13:13:21.283476 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:21.427843 (+144367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:21.427879 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:21.428427 (+   548us) log.cc:844] Serialized 26 byte log entry
0709 13:13:21.859844 (+431417us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:21.859910 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:21.860026 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:22.377368 (+517342us) spinlock_profiling.cc:243] Waited 8.88 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:13:22.583514 (+206146us) raft_consensus.cc:1685] finished
0709 13:13:22.583538 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:22.584660 (+  1122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":282811,"raft.run_cpu_time_us":54,"raft.run_wall_time_us":54,"spinlock_wait_cycles":20418816,"thread_start_us":554936,"threads_started":2,"wal-append.queue_time_us":598695}
I20260709 13:13:22.610526  1462 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:22.612353 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 85795.4us
W20260709 13:13:22.614101 29419 leader_election.cc:336] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.868s (SENT)
W20260709 13:13:22.614331 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 273071us
I20260709 13:13:22.614605 29419 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:22.615180 29495 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:22.618749 29495 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:13:22.620850 29419 leader_election.cc:336] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 2.040s (SENT)
I20260709 13:13:22.621353 29419 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:22.621546  1490 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.622608  1442 leader_election.cc:290] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:22.623709  1387 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:22.626423  1386 raft_consensus.cc:3055] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:22.642494  1386 raft_consensus.cc:740] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:22.628492  1485 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:22.621155 29454 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82"
dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:45798
I20260709 13:13:22.644598 29454 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:22.644974 29454 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:22.627066  1469 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:22.631659 29495 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:22.633718  1364 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:22.627702  1356 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:22.634543  1464 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:22.635149  1463 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:22.636775  1366 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:22.630511  1489 raft_consensus.cc:2749] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:13:22.628899 29419 leader_election.cc:336] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 2.069s (SENT)
I20260709 13:13:22.717026 29419 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:22.718034 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 89165.4us
W20260709 13:13:22.718571 29419 leader_election.cc:336] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 2.137s (SENT)
I20260709 13:13:22.718811 29419 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:22.616567  1393 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:22.616170  1335 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:22.725739 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:22.777417 29451 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45796 (request call id 1585) took 2995 ms (client timeout 1826 ms). Trace:
W20260709 13:13:22.778682  1495 log.cc:927] Time spent T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 13:13:22.779227 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 147662us
I20260709 13:13:22.782083 29495 leader_election.cc:304] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:13:22.720013  1408 log.cc:927] Time spent T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:13:22.788496 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
W20260709 13:13:22.778286 29451 rpcz_store.cc:269] 0709 13:13:19.741883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.752715 (+ 10832us) service_pool.cc:224] Handling call
0709 13:13:22.736827 (+2984112us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54000d7354. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:22.737009 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2929117440}
I20260709 13:13:22.790334 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:22.790942 29451 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
W20260709 13:13:22.799055 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:22.803328 29495 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:22.804955  1456 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:22.807938 29495 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:22.723353  1462 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:22.775209  1431 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:22.792202  1302 consensus_queue.cc:1059] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:13:22.792685  1478 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:13:22.817245 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:22.792495  1469 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:22.793419  1489 raft_consensus.cc:2804] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:22.705976  1356 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:22.639752  1490 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:22.888063  1356 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:22.888891  1335 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:22.890296  1312 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:22.883191  1469 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:22.723152  1386 consensus_queue.cc:260] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:22.876447  1478 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:22.876170  1489 raft_consensus.cc:493] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:22.883322  1462 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:22.897233 29454 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:22.899433 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:22.921674 29454 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:22.923619  1469 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:22.924422 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:22.925319 29454 raft_consensus.cc:2468] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:13:22.925904  1478 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:22.926844  1386 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:22.917716  1489 raft_consensus.cc:3060] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:22.927748  1462 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:22.937752  1493 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:22.939847  1462 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:22.921981  1484 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:22.917656  1456 raft_consensus.cc:2749] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:13:22.943188  1490 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:22.936632  1469 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:13:22.904580 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 96730.6us
I20260709 13:13:22.944458  1484 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:22.958643  1469 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:22.940994  1493 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:23.053428 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:23.054216 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 99135.3us
I20260709 13:13:23.055258 29495 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:23.056257  1462 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.062525  1456 raft_consensus.cc:2749] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:23.064177 29495 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:13:23.067054 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 343674us
I20260709 13:13:23.062423  1462 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:23.062469  1335 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.073459 29495 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:23.073779  1490 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:13:23.080247  1462 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:23.077384  1335 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:23.082027 29530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3259) took 1799 ms. Trace:
I20260709 13:13:23.082466 29530 rpcz_store.cc:276] 0709 13:13:21.282675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.283202 (+   527us) service_pool.cc:224] Handling call
0709 13:13:21.283625 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:22.183555 (+899930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:23.080970 (+897415us) spinlock_profiling.cc:243] Waited 4.1 ms on lock 0x7b54001f8220. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bcfddc0 00007f6a7bd89a02 00007f6a7bd85dd6 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2
0709 13:13:23.081796 (+   826us) spinlock_profiling.cc:243] Waited 862 ms on lock 0x7b540006f4d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:23.081966 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1992612224}
I20260709 13:13:23.091398 29495 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:23.095031 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:23.077646  1464 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:23.105428  1456 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:23.093336 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:13:23.097509  1469 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:23.088733  1490 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:23.106484 29495 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:23.107376  1490 raft_consensus.cc:2804] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:23.108026  1490 raft_consensus.cc:697] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:23.108546  1493 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:23.110875 29495 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:23.113384 29521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3268) took 1247 ms. Trace:
I20260709 13:13:23.118062 29521 rpcz_store.cc:276] 0709 13:13:21.865821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.438705 (+572884us) service_pool.cc:224] Handling call
0709 13:13:22.439040 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:22.465393 (+ 26353us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:13:22.465417 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:22.465448 (+    31us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:22.465468 (+    20us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:23.113092 (+647624us) spinlock_profiling.cc:243] Waited 26.1 ms on lock 0x7b54002e3bd4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:23.113144 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:23.113315 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59930880}
I20260709 13:13:23.113886  1456 consensus_queue.cc:1059] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:23.101517  1484 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:23.109737  1335 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:23.119904  1468 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:23.124198  1478 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:23.136977  1468 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:23.137902  1478 consensus_queue.cc:1059] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:23.138737  1216 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:13:23.133769  1489 raft_consensus.cc:515] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:23.144374  1489 leader_election.cc:290] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:23.145238  1489 raft_consensus.cc:3055] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:23.145617  1489 raft_consensus.cc:740] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:23.146384 29448 raft_consensus.cc:1275] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:13:23.147135 29448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2560) took 2952 ms. Trace:
I20260709 13:13:23.146776  1489 consensus_queue.cc:260] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:23.148389  1490 consensus_queue.cc:237] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:23.147482 29448 rpcz_store.cc:276] 0709 13:13:20.194962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.290707 (+ 95745us) service_pool.cc:224] Handling call
0709 13:13:23.145742 (+2855035us) spinlock_profiling.cc:243] Waited 8.46 ms on lock 0x7b5800193598. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61b71 00007f6a78c61a22 00007f6a81b7ac09 00007f6a80cd4ee0 00007f6a80d9e0ab 00007f6a80d9e131 00007f6a80d5ffc0 00007f6a80d4a929 00007f6a80d4a3d2 00007f6a7a2c1bd4
0709 13:13:23.146008 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:23.146805 (+   797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:23.147071 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19454848}
I20260709 13:13:23.152271 29452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2572) took 2868 ms. Trace:
I20260709 13:13:23.156213 29452 rpcz_store.cc:276] 0709 13:13:20.284192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.849495 (+565303us) service_pool.cc:224] Handling call
0709 13:13:20.849880 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:20.856883 (+  7003us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:20.856906 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:20.858605 (+  1699us) log.cc:844] Serialized 26 byte log entry
0709 13:13:23.078909 (+2220304us) spinlock_profiling.cc:243] Waited 1.33 ms on lock 0x7b18000a79e0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c7be07 00007f6a81ad6ab9 00007f6a78c9869b 00007f6a78c9693f 00007f6a78c98c02 00007f6a7b92020b 00007f6a7b925d23 00007f6a7b9260d1 00007f6a7bd41a0f
0709 13:13:23.119733 (+ 40824us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:23.119777 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:23.120020 (+   243us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:23.151833 (+ 31813us) raft_consensus.cc:1685] finished
0709 13:13:23.151864 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:23.152181 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26023,"raft.queue_time_us":7667,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":7301,"spinlock_wait_cycles":3063040,"thread_start_us":40624,"threads_started":1,"wal-append.queue_time_us":2278054}
I20260709 13:13:23.172602 29495 leader_election.cc:304] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:23.173815  1484 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:23.126645  1302 consensus_queue.cc:1048] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:13:23.175239 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.176563 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:23.179832 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.173979  1456 raft_consensus.cc:2804] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:23.178942  1484 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:23.192616  1484 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:23.189375  1456 raft_consensus.cc:493] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:23.194285  1456 raft_consensus.cc:3060] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:23.197247 29450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45798 (request call id 2612) took 1011 ms. Trace:
I20260709 13:13:23.197682 29450 rpcz_store.cc:276] 0709 13:13:22.185581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.258477 (+ 72896us) service_pool.cc:224] Handling call
0709 13:13:23.197028 (+938551us) spinlock_profiling.cc:243] Waited 93.7 ms on lock 0x7b54000c2bd4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:23.197171 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":215520000}
W20260709 13:13:23.203184 29477 debug-util.cc:398] Leaking SignalData structure 0x7b08000e87a0 after lost signal to thread 29405
W20260709 13:13:23.203608 29477 debug-util.cc:398] Leaking SignalData structure 0x7b08000d4ea0 after lost signal to thread 29406
W20260709 13:13:23.204859 29477 debug-util.cc:398] Leaking SignalData structure 0x7b08003a4460 after lost signal to thread 29480
W20260709 13:13:23.205116 29477 debug-util.cc:398] Leaking SignalData structure 0x7b08003a4580 after lost signal to thread 29481
I20260709 13:13:23.214011  1437 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:23.221625  1508 log.cc:927] Time spent T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:13:23.206492  1484 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:23.223944  1484 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:23.225658 29524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3213) took 3383 ms. Trace:
I20260709 13:13:23.226305  1484 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:23.232226 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.246376 29530 raft_consensus.cc:2368] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 8. Current term is 9.
I20260709 13:13:23.247836 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.249311 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.233687 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.226076 29524 rpcz_store.cc:276] 0709 13:13:19.841959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.842234 (+   275us) service_pool.cc:224] Handling call
0709 13:13:19.853906 (+ 11672us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:19.866916 (+ 13010us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:19.866949 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:19.867512 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 13:13:23.097733 (+3230221us) spinlock_profiling.cc:243] Waited 3.99 ms on lock 0x7b1800172d80. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c7be07 00007f6a81ad6ab9 00007f6a78c9869b 00007f6a78c9693f 00007f6a78c98c02 00007f6a7b92020b 00007f6a7b925d23 00007f6a7b9260d1 00007f6a7bd41a0f
0709 13:13:23.135128 (+ 37395us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:23.135370 (+   242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:23.135473 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:23.225341 (+ 89868us) raft_consensus.cc:1685] finished
0709 13:13:23.225366 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:23.225583 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16299,"raft.queue_time_us":17813,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":12585,"spinlock_wait_cycles":9186048,"thread_start_us":36815,"threads_started":1,"wal-append.queue_time_us":3355933}
I20260709 13:13:23.265349 29521 raft_consensus.cc:2393] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 13: Already voted for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in this term.
I20260709 13:13:23.267063 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.268646 29530 raft_consensus.cc:2410] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:13:23.269699 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:23.272153 29530 raft_consensus.cc:2410] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:13:23.273840 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.277113 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.277410 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.281617 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.282291 29527 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 13.
I20260709 13:13:23.286674 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.287192 29454 raft_consensus.cc:1240] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:23.287303 29524 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
W20260709 13:13:23.300055 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 79918.2us
I20260709 13:13:23.303831 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.285393 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.317487 29524 raft_consensus.cc:1275] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 13:13:23.319847  1146 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.021s	user 0.000s	sys 0.013s
W20260709 13:13:23.320360  1146 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.024s	user 0.000s	sys 0.014s
I20260709 13:13:23.317466 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.328514 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.329710 29524 raft_consensus.cc:2410] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:13:23.331874 29530 raft_consensus.cc:2393] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 16: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:23.333885 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.336164 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.338431 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.339913 29530 raft_consensus.cc:2393] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 16: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:23.342293 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:23.342372 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.341771 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:23.345781 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:23.352206 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:23.365955  1519 log.cc:927] Time spent T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:13:23.365736 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.369374 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.372294 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:23.374246 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:23.376832  1456 raft_consensus.cc:515] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:23.378569 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:23.375353 29378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52172 (request call id 1941) took 1055 ms. Trace:
I20260709 13:13:23.379562 29378 rpcz_store.cc:276] 0709 13:13:22.320456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.320616 (+   160us) service_pool.cc:224] Handling call
0709 13:13:22.320911 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:22.413893 (+ 92982us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:13:22.413939 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:22.414459 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 13:13:22.611513 (+197054us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:13:22.611578 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:23.374935 (+763357us) spinlock_profiling.cc:243] Waited 92.5 ms on lock 0x7b54003908d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:23.374991 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:23.375044 (+    53us) raft_consensus.cc:1685] finished
0709 13:13:23.375055 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:23.375287 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":30098,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":212772608,"thread_start_us":193382,"threads_started":1,"wal-append.queue_time_us":189428}
I20260709 13:13:23.385040 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.386713 29530 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 12.
I20260709 13:13:23.387779 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:13:23.390654 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.392349  1456 leader_election.cc:290] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:13:23.394232 29551 debug-util.cc:398] Leaking SignalData structure 0x7b08002a1740 after lost signal to thread 30182
W20260709 13:13:23.417030 29477 debug-util.cc:398] Leaking SignalData structure 0x7b08003797c0 after lost signal to thread 29554
W20260709 13:13:23.526371 29477 debug-util.cc:398] Leaking SignalData structure 0x7b08003b7180 after lost signal to thread 29555
I20260709 13:13:23.527145 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:23.528084 29477 debug-util.cc:398] Leaking SignalData structure 0x7b080023cc40 after lost signal to thread 30182
I20260709 13:13:23.452031 29528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3267) took 1586 ms. Trace:
W20260709 13:13:23.530234 29477 debug-util.cc:398] Leaking SignalData structure 0x7b080033b960 after lost signal to thread 30183
I20260709 13:13:23.530395 29528 rpcz_store.cc:276] 0709 13:13:21.865515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.275327 (+409812us) service_pool.cc:224] Handling call
0709 13:13:22.282281 (+  6954us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:22.442292 (+160011us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:22.442331 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:22.442382 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:22.442419 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:23.451813 (+1009394us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54001018d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:23.451860 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:23.451976 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":367414144}
I20260709 13:13:23.430976 29522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3270) took 1559 ms. Trace:
I20260709 13:13:23.410300 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.531939 29522 rpcz_store.cc:276] 0709 13:13:21.871351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:22.521680 (+650329us) service_pool.cc:224] Handling call
0709 13:13:22.522012 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:22.530748 (+  8736us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:22.530779 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:22.530834 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:22.530866 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:23.430748 (+899882us) spinlock_profiling.cc:243] Waited 8.5 ms on lock 0x7b54003ab1d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:23.430795 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:23.430916 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19544960}
W20260709 13:13:23.414902 29526 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 3.539s	user 0.016s	sys 0.024s
I20260709 13:13:23.433480  1461 leader_election.cc:290] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:13:23.420076 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.398686 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:23.401492 29276 catalog_manager.cc:5697] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 10 to 13, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132), now has a pending config: VOTER 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129), VOTER 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130), VOTER 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131), VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132). New cstate: current_term: 13 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:13:23.494959  1283 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:23.490180 29419 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 2.219s (SENT) [suppressed 20 similar messages]
W20260709 13:13:23.537331 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 47199.1us
I20260709 13:13:23.512027  1489 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:23.413705  1388 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:23.437304  1277 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:23.495301 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.544407  1277 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:23.544867 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.546823  1277 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:23.399320  1468 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:23.453895  1286 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:23.430259 29529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3262) took 1566 ms. Trace:
I20260709 13:13:23.549680 29346 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:13:23.529557 29551 debug-util.cc:398] Leaking SignalData structure 0x7b08002a9f40 after lost signal to thread 30183
W20260709 13:13:23.616582 29551 debug-util.cc:398] Leaking SignalData structure 0x7b08002b61a0 after lost signal to thread 1290
W20260709 13:13:23.618637 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 69050.2us
I20260709 13:13:23.451330 29523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3221) took 3567 ms. Trace:
I20260709 13:13:23.513726 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:23.426420 29525 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37968 (request call id 3229) took 2802 ms (client timeout 1816 ms). Trace:
I20260709 13:13:23.464154  1478 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:23.619767 29523 rpcz_store.cc:276] 0709 13:13:19.884215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.929900 (+ 45685us) service_pool.cc:224] Handling call
0709 13:13:19.981957 (+ 52057us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:22.209672 (+2227715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:23.450985 (+1241313us) spinlock_profiling.cc:243] Waited 2.18 s on lock 0x7b5400100ed4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:23.451234 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5018780544}
I20260709 13:13:23.548907 29529 rpcz_store.cc:276] 0709 13:13:21.863583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.863753 (+   170us) service_pool.cc:224] Handling call
0709 13:13:21.909504 (+ 45751us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:21.964657 (+ 55153us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:13:21.977276 (+ 12619us) log.cc:844] Serialized 14 byte log entry
0709 13:13:22.136657 (+159381us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:22.136733 (+    76us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:22.136794 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:23.428875 (+1292081us) spinlock_profiling.cc:243] Waited 2.72 ms on lock 0x7b18001a9260. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c672a6 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419
0709 13:13:23.429992 (+  1117us) spinlock_profiling.cc:243] Waited 54.9 ms on lock 0x7b54002bb454. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:23.430037 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:23.430190 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":12889,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":5870,"raft.queue_time_us":454,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":16460,"spinlock_wait_cycles":132483840,"thread_start_us":158404,"threads_started":1,"wal-append.queue_time_us":264173,"wal-append.run_cpu_time_us":1815,"wal-append.run_wall_time_us":1054768}
I20260709 13:13:23.445222 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:23.624418 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:23.496727 29379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 702) took 3276 ms. Trace:
I20260709 13:13:23.504066  1041 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:23.495743 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:23.511008 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:23.620719 29525 rpcz_store.cc:269] 0709 13:13:20.624348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.627910 (+  3562us) service_pool.cc:224] Handling call
0709 13:13:23.426101 (+2798191us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b540020a154. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:23.426301 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2914469248}
W20260709 13:13:23.627341 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.493701  1312 raft_consensus.cc:3055] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:23.452848 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:23.463577 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:23.432286 29449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 1610) took 1501 ms. Trace:
I20260709 13:13:23.624452 29346 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:23.631436 29449 rpcz_store.cc:276] 0709 13:13:21.930932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.963205 (+ 32273us) service_pool.cc:224] Handling call
0709 13:13:21.981320 (+ 18115us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:22.263454 (+282134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:23.431459 (+1168005us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b5400127354. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:23.432225 (+   766us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":641929472}
I20260709 13:13:23.560196 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.560312 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.632870 29524 raft_consensus.cc:2468] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 10.
I20260709 13:13:23.632967 29528 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 13.
I20260709 13:13:23.633116 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:23.634060 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.634698 29528 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 10.
I20260709 13:13:23.560883 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.631247 29453 raft_consensus.cc:2468] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
W20260709 13:13:23.567653 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 123518us
I20260709 13:13:23.562325 29419 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:23.581103 29526 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.713s	user 0.019s	sys 0.024s
W20260709 13:13:23.589033 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.625396 29379 rpcz_store.cc:276] 0709 13:13:20.220522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:20.410569 (+190047us) service_pool.cc:224] Handling call
0709 13:13:20.475998 (+ 65429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:20.528245 (+ 52247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:23.496389 (+2968144us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b5400190d54. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:23.496627 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40155520}
I20260709 13:13:23.636488 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.431427 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:23.479996  1216 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:23.408255 29421 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:13:23.642282 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 234148us
I20260709 13:13:23.625437 29456 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:13:23.628896 29495 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:23.629148 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:23.636879 29522 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11.
I20260709 13:13:23.638339 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.638401 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:23.645190 29447 raft_consensus.cc:2410] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
W20260709 13:13:23.639971 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 77957us
I20260709 13:13:23.624452  1364 raft_consensus.cc:2804] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:23.640056 29526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3211) took 3803 ms. Trace:
W20260709 13:13:23.648473 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 338637us
I20260709 13:13:23.644572 29495 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:23.644796 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.649773 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.605898 29530 raft_consensus.cc:2468] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:13:23.650856 29523 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 16.
I20260709 13:13:23.644501 29528 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11.
I20260709 13:13:23.650709 29495 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:23.651984 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.652774 29528 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 10.
I20260709 13:13:23.652854 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:23.630460  1286 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.654623 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:23.655058 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:23.630722  1312 raft_consensus.cc:740] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:23.670315  1312 consensus_queue.cc:260] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:23.668692 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:23.659333 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:23.660476 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:23.701712 29522 raft_consensus.cc:2393] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 11: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:23.647468  1364 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:23.655972  1456 raft_consensus.cc:2804] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:13:23.668800 29278 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37608 (request call id 155) took 17199 ms (client timeout 15000 ms). Trace:
I20260709 13:13:23.630779  1478 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:23.656581 29451 raft_consensus.cc:2468] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
I20260709 13:13:23.675336  1477 consensus_queue.cc:1059] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:23.674842  1437 consensus_queue.cc:1059] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:23.674057 29495 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:23.657438 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:23.671947 29379 raft_consensus.cc:2955] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 6 to 8, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:13:23.713092 29453 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:13:23.671713 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:23.698287  1525 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:23.679811 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:13:23.680120 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.667546 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.683116 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.722440 29523 raft_consensus.cc:2410] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:13:23.639812 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:23.687937 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:23.723658 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.723811 29449 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
I20260709 13:13:23.692126 29521 raft_consensus.cc:2410] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 16 because replica has last-logged OpId of term: 15 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 13:13:23.695604  1436 raft_consensus.cc:2804] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:23.647222  1321 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:23.695390  1312 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:23.696602 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.731534  1426 raft_consensus.cc:2804] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:23.655922  1377 consensus_queue.cc:1059] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:13:23.727818  1436 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:23.732034  1426 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:23.732322  1436 raft_consensus.cc:3060] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:23.732508  1426 raft_consensus.cc:3060] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:23.732679  1377 raft_consensus.cc:3055] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:23.733088  1377 raft_consensus.cc:740] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:13:23.734057  1377 consensus_queue.cc:260] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:23.672428  1286 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:23.741328  1286 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:23.698976 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:23.742751 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:23.744998 29448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2621) took 1015 ms. Trace:
I20260709 13:13:23.745432 29448 rpcz_store.cc:276] 0709 13:13:22.729263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.154451 (+425188us) service_pool.cc:224] Handling call
0709 13:13:23.154949 (+   498us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:23.155249 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:23.155289 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:23.155964 (+   675us) log.cc:844] Serialized 26 byte log entry
0709 13:13:23.597364 (+441400us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:23.597427 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:23.597542 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:23.744760 (+147218us) raft_consensus.cc:1685] finished
0709 13:13:23.744781 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:23.744935 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":419361,"threads_started":1,"wal-append.queue_time_us":538397}
I20260709 13:13:23.747005 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:23.747804  1426 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:23.749737 29527 raft_consensus.cc:1275] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:13:23.750186  1426 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:23.750330  1379 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.731880 29529 raft_consensus.cc:2468] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:13:23.752244 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.704263  1364 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:23.641701  1488 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:23.645957  1354 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:23.647202  1461 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:23.750890  1379 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:23.665364 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:23.700126 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 51003.1us
I20260709 13:13:23.770352 29525 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:23.708081 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:23.707933 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:23.648388 29526 rpcz_store.cc:276] 0709 13:13:19.836884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:19.837022 (+   138us) service_pool.cc:224] Handling call
0709 13:13:19.837374 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:19.837819 (+   445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:19.837849 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:19.865854 (+ 28005us) log.cc:844] Serialized 26 byte log entry
0709 13:13:23.639580 (+3773726us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:23.639642 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:23.639752 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:23.639810 (+    58us) raft_consensus.cc:1685] finished
0709 13:13:23.639829 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:23.639985 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7406,"raft.queue_time_us":489,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":5477,"thread_start_us":3771552,"threads_started":1,"wal-append.queue_time_us":454293,"wal-append.run_cpu_time_us":1983,"wal-append.run_wall_time_us":1039495}
I20260709 13:13:23.715377 29450 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
I20260709 13:13:23.647725  1216 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:23.713073  1456 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:23.780242  1456 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:23.782627  1216 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:23.716862  1279 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.720348 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.784279  1477 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:23.783857  1279 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:23.784693 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.784852  1477 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:23.785552 29522 raft_consensus.cc:2393] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 12: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:23.786566 29524 raft_consensus.cc:2410] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:13:23.727103 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:13:23.728298 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 54294.3us
I20260709 13:13:23.735699  1321 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:23.736085  1437 consensus_queue.cc:1243] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer 183db85c071f489fbc8de63a9edd8a3a log is divergent from this leader: its last log entry 15.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:13:23.737046 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:23.737941 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:23.792120 29449 raft_consensus.cc:2468] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
I20260709 13:13:23.738260  1367 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.794147 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.799753 29522 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 12.
I20260709 13:13:23.801036 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.802119 29522 raft_consensus.cc:2410] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:13:23.755750 29448 raft_consensus.cc:2468] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 7.
I20260709 13:13:23.756448 29530 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11.
I20260709 13:13:23.756893 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:23.803537 29456 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
W20260709 13:13:23.704198 29278 rpcz_store.cc:269] 0709 13:13:06.469761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:06.472539 (+  2778us) service_pool.cc:224] Handling call
0709 13:13:23.668668 (+17196129us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:18.640016 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:18.640716 (+   700us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:18.640753 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:13:18.640774 (+    21us) tablet.cc:662] Decoding operations
0709 13:13:18.641950 (+  1176us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:18.642034 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:18.642073 (+    39us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:13:18.643194 (+  1121us) tablet.cc:701] Row locks acquired
0709 13:13:18.643217 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:13:18.643392 (+   175us) write_op.cc:270] Start()
0709 13:13:18.643529 (+   137us) write_op.cc:276] Timestamp: P: 1783602798643338 usec, L: 0
0709 13:13:18.643550 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:13:18.644316 (+   766us) log.cc:844] Serialized 4768 byte log entry
0709 13:13:18.662446 (+ 18130us) op_driver.cc:464] REPLICATION: finished
0709 13:13:19.380453 (+718007us) spinlock_profiling.cc:243] Waited 32.4 ms on lock 0x7b18000d4500. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c993f3 00007f6a78c9b7c1 00007f6a78c9b779 00007f6a78c9b709 00007f6a78c9b6d1 00007f6a78c9a9cd 000000000038f354 000000000038f199 00007f6a78c7c83a
0709 13:13:19.380653 (+   200us) write_op.cc:301] APPLY: starting
0709 13:13:19.380743 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:19.381592 (+   849us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:19.381617 (+    25us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:19.382774 (+  1157us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:19.383031 (+   257us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=22
0709 13:13:19.383078 (+    47us) write_op.cc:312] APPLY: finished
0709 13:13:19.383437 (+   359us) log.cc:844] Serialized 82 byte log entry
0709 13:13:19.387318 (+  3881us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:19.387512 (+   194us) write_op.cc:454] Released schema lock
0709 13:13:19.387570 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:19.388101 (+   531us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:19.388134 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":480617,"apply.run_cpu_time_us":3754,"apply.run_wall_time_us":7411,"num_ops":11,"prepare.queue_time_us":1211,"prepare.run_cpu_time_us":11096,"prepare.run_wall_time_us":11978,"raft.queue_time_us":7617,"raft.run_cpu_time_us":12692,"raft.run_wall_time_us":480562,"replication_time_us":18707,"spinlock_wait_cycles":74631552,"thread_start_us":483779,"threads_started":4,"wal-append.queue_time_us":7354,"wal-append.run_cpu_time_us":10145,"wal-append.run_wall_time_us":2060428}]]}
W20260709 13:13:23.697649 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 73298.6us
I20260709 13:13:23.772071 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:23.806768 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.772177 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.764945  1377 raft_consensus.cc:3060] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:23.774974  1478 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:23.787031 29451 raft_consensus.cc:1240] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:23.813508 29447 raft_consensus.cc:1240] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 12 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:13:23.725469 29455 raft_consensus.cc:2468] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
I20260709 13:13:23.789367 29495 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:23.816728 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:23.792313 29523 raft_consensus.cc:2410] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:13:23.817878 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:23.816968 29495 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:23.819557 29346 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:23.823308 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.797370  1321 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:23.823065 29346 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:23.825582 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.826968 29495 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:23.830750 29525 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 13.
I20260709 13:13:23.830909 29495 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:23.826958 29526 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
I20260709 13:13:23.832371 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.833241 29526 raft_consensus.cc:2410] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:13:23.834403 29526 raft_consensus.cc:1275] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:13:23.804684  1525 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.835026 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:23.828048 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.842207 29529 raft_consensus.cc:2410] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:13:23.843530 29495 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:23.836774 29526 pending_rounds.cc:85] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 6
I20260709 13:13:23.844239 29526 pending_rounds.cc:107] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:13:23.845286 29526 raft_consensus.cc:2889] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:23.823771  1478 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:23.836252  1380 raft_consensus.cc:2804] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:23.828573  1311 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:23.872967 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:23.845916  1525 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:23.813030  1367 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:23.844782  1216 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:23.860049  1315 consensus_queue.cc:1048] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:23.864202  1426 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:23.865232 29344 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:23.879963 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:23.865386  1522 consensus_queue.cc:1059] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:23.866911  1436 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:23.827087  1437 raft_consensus.cc:2804] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:23.868929  1478 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:23.905805 29529 raft_consensus.cc:1240] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:23.871563 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:23.870532 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:23.869596 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:23.872641 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:23.874979 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:23.876907 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:23.844172  1461 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:23.852407 29523 raft_consensus.cc:2955] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 6 to 8, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:13:23.869885 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:23.912798 29372 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:23.870791  1380 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:23.919247 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:23.901055 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:23.908831 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:23.921116 29456 raft_consensus.cc:3060] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:23.874944  1311 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:23.927381 29381 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
W20260709 13:13:23.902868 29344 connection.cc:256] RPC call timeout handler was delayed by -1.7435153160001846s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2028s for a response
I20260709 13:13:23.923806 29526 raft_consensus.cc:1240] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 2. Current term is 3. Ops: []
W20260709 13:13:23.928107 29344 connection.cc:256] RPC call timeout handler was delayed by -1.722200138000062s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1774s for a response
I20260709 13:13:23.924259 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:23.925161 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:23.875380  1216 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:23.932885 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:23.933720 29455 raft_consensus.cc:2368] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 13. Current term is 14.
I20260709 13:13:23.934670 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:23.935267 29455 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:13:23.936805 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:23.937275 29455 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
I20260709 13:13:23.937875 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:23.938320 29455 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
I20260709 13:13:23.901022  1360 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:23.901721  1312 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:13:23.945204 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:23.945683 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.901265  1437 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:23.912899  1478 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:23.958109 29376 raft_consensus.cc:2468] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:13:23.918531  1461 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:23.963033 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:23.964180 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.925757  1380 raft_consensus.cc:3060] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:23.930589  1311 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:23.901758  1426 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:23.971388 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:23.965368 29456 raft_consensus.cc:2468] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:13:23.965533 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:23.939036  1216 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:23.966902 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 300085us
I20260709 13:13:23.968660 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.957739  1437 raft_consensus.cc:3060] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:23.979568 29521 raft_consensus.cc:2410] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:13:23.977758 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:23.980196 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:23.974335 29455 raft_consensus.cc:1240] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:23.982945 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.969074  1303 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:23.967800  1461 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:23.988951 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.990949 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:23.992996 29521 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
I20260709 13:13:23.993350 29380 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:23.994043 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:23.995157 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:24.003641 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:23.984561  1165 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:24.009562  1165 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:23.989858  1354 consensus_queue.cc:1048] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:13:23.990576  1303 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:24.021152 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:24.022590  1488 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:24.023211  1488 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:24.025472  1488 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:24.026671 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:24.027921 29526 raft_consensus.cc:2410] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:13:24.032847  1303 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:24.034047 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:24.036180  1165 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:24.040350 29344 connection.cc:256] RPC call timeout handler was delayed by -1.3064001380000718s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22360000000000002s for a response
I20260709 13:13:24.041092 29344 leader_election.cc:304] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:24.041875  1360 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:24.042399  1360 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:24.042694 29344 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:24.042763  1448 raft_consensus.cc:2749] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:13:24.041172  1321 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:24.044543  1360 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:24.046175 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:24.046363 29454 raft_consensus.cc:1240] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:24.050998  1321 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:24.051824 29493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 374755us
I20260709 13:13:24.052762  1477 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:24.053426 29493 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:24.055207  1488 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:13:24.056175  1534 log.cc:927] Time spent T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:13:24.059042  1279 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:24.062040  1367 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:24.051206  1456 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:24.071765 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:24.068048  1440 raft_consensus.cc:3055] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:24.063930  1424 raft_consensus.cc:3055] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:24.046380 29373 raft_consensus.cc:1240] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:24.146742 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:24.078504 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:24.148706 29372 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 13.
I20260709 13:13:24.150667 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:24.152406 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:24.087963 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:24.156401 29527 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:13:24.089772 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:24.159288 29530 raft_consensus.cc:1275] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 7. (term mismatch)
I20260709 13:13:24.159657 29530 pending_rounds.cc:85] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 6
I20260709 13:13:24.159874 29530 pending_rounds.cc:107] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 15.7
I20260709 13:13:24.160091 29530 raft_consensus.cc:2889] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:24.091202 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:24.087347 29380 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
I20260709 13:13:24.162801 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:24.097546 29495 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:24.163959 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 66521us
I20260709 13:13:24.164915 29495 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:13:24.107792 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:24.051831 29455 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
I20260709 13:13:24.167204 29495 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:24.117816 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:24.118283 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:24.118120 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:24.118911 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:24.124111 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:13:24.130327 29528 raft_consensus.cc:2393] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 13: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:24.130861 29525 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 16.
I20260709 13:13:24.177718 29380 raft_consensus.cc:1275] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:13:24.178440 29525 raft_consensus.cc:1240] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:24.131120  1440 raft_consensus.cc:740] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:24.180542  1440 consensus_queue.cc:260] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:24.182137  1440 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:24.175287 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:24.139426 29521 raft_consensus.cc:1240] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 3. Current term is 4. Ops: []
W20260709 13:13:24.139545 29381 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 1514) took 2265 ms (client timeout 1599 ms). Trace:
I20260709 13:13:24.081820 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:24.132958  1456 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:24.143747 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:24.139194 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:24.191325 29529 raft_consensus.cc:2410] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:13:24.191648 29374 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11.
I20260709 13:13:24.192102 29521 raft_consensus.cc:1240] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:24.145093 29526 raft_consensus.cc:1275] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:13:24.117926 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:24.192726 29526 pending_rounds.cc:85] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 7
I20260709 13:13:24.192938 29378 raft_consensus.cc:3055] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:13:24.189651 29381 rpcz_store.cc:269] 0709 13:13:21.871443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:21.872192 (+   749us) service_pool.cc:224] Handling call
0709 13:13:24.136762 (+2264570us) spinlock_profiling.cc:243] Waited 1.98 s on lock 0x7b54001ef0d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:24.136900 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4544775040}
I20260709 13:13:24.193905 29378 raft_consensus.cc:740] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:24.193099 29526 pending_rounds.cc:107] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:13:24.194705 29526 raft_consensus.cc:2889] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:24.197352 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:24.198345 29526 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 10.
I20260709 13:13:24.200590 29530 raft_consensus.cc:1240] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:24.201112 29528 raft_consensus.cc:1240] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:24.202432 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:24.194736 29378 consensus_queue.cc:260] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:24.211441 29375 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11.
I20260709 13:13:24.225482 29495 leader_election.cc:400] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 13. Current term is 14.
I20260709 13:13:24.227818 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:24.228529 29372 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:24.095858  1533 log.cc:927] Time spent T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.065s	user 0.002s	sys 0.000s
I20260709 13:13:24.226624 29495 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:24.077281  1426 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:24.096915  1525 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:24.235137 29378 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:24.088830  1481 raft_consensus.cc:3055] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:24.098060  1477 consensus_queue.cc:1059] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.142s
I20260709 13:13:24.190712  1283 raft_consensus.cc:2804] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:24.185654  1488 raft_consensus.cc:2804] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:24.241919 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:13:24.125392  1436 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:24.131186  1424 raft_consensus.cc:740] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:24.242200 29495 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:24.172017  1446 raft_consensus.cc:2749] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:13:24.078817  1379 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:24.097729  1209 consensus_queue.cc:1059] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.146s
I20260709 13:13:24.254703 29373 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:13:24.274085 29373 raft_consensus.cc:606] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:24.274171 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:24.232496  1489 raft_consensus.cc:2804] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:24.256423 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:24.193424  1377 consensus_queue.cc:1059] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:13:24.258147 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:24.262154 29495 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:24.281055 29495 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:24.247918  1481 raft_consensus.cc:740] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:13:24.285177 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:24.262759 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 616729us
I20260709 13:13:24.289608 29419 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:24.291054  1321 raft_consensus.cc:2749] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:24.264039 29372 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
I20260709 13:13:24.126694  1311 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:24.075414  1364 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:24.232713  1277 consensus_queue.cc:1059] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:13:24.250602  1456 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:24.276192 29375 raft_consensus.cc:2410] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:13:24.275911 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:24.277169 29378 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 13.
I20260709 13:13:24.258810  1488 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:24.325608 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:24.324790 29379 raft_consensus.cc:2468] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
I20260709 13:13:24.324476 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:24.329154 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:24.330420 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:24.272006  1426 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:24.255563  1283 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:24.315097 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:24.313311 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:24.282980  1489 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:24.346848 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:24.346201 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:24.333091 29419 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:24.337003 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:24.336025 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:24.327205  1456 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:24.342003  1209 raft_consensus.cc:3055] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:24.315699  1379 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:24.355089 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:24.370044 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:24.335947  1488 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:24.345216  1426 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:24.348212  1283 raft_consensus.cc:3060] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:24.332152  1286 raft_consensus.cc:2804] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:24.252351  1380 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:24.363093  1322 raft_consensus.cc:2749] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:24.232857  1467 consensus_queue.cc:1059] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.138s
I20260709 13:13:24.235720  1466 consensus_queue.cc:1059] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.135s
I20260709 13:13:24.355130  1489 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:24.364460  1456 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:24.363562  1209 raft_consensus.cc:740] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:13:24.331983  1436 consensus_queue.cc:1059] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:13:24.369160  1379 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:24.394881  1426 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:24.371482  1312 consensus_queue.cc:1059] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:13:24.420926  1379 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:24.364118  1424 consensus_queue.cc:260] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:24.440596  1466 raft_consensus.cc:3055] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:24.439287  1467 raft_consensus.cc:3055] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:24.442262  1311 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:24.452858  1537 log.cc:927] Time spent T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:13:24.452060  1466 raft_consensus.cc:740] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:13:24.469800  1467 raft_consensus.cc:740] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:13:24.450801  1478 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:24.497678  1478 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:24.365427 29375 raft_consensus.cc:1240] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:24.366932 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:24.407464 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 247907us
I20260709 13:13:24.548910 29450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2634) took 1115 ms. Trace:
I20260709 13:13:24.550333 29377 raft_consensus.cc:1240] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 7. Current term is 8. Ops: []
W20260709 13:13:24.539870 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:24.401407 29419 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:24.557011 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 155585us
W20260709 13:13:24.565430 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 273412us
I20260709 13:13:24.571972 29495 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:24.549723 29450 rpcz_store.cc:276] 0709 13:13:23.433664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.772023 (+338359us) service_pool.cc:224] Handling call
0709 13:13:23.772354 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:23.974735 (+202381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:23.974767 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:23.979336 (+  4569us) log.cc:844] Serialized 26 byte log entry
0709 13:13:24.252250 (+272914us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:24.252312 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:24.252420 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:24.548085 (+295665us) raft_consensus.cc:1685] finished
0709 13:13:24.548165 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:24.548565 (+   400us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":201998,"raft.queue_time_us":205266,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":3904,"thread_start_us":206507,"threads_started":1,"wal-append.queue_time_us":454826}
W20260709 13:13:24.537725 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:24.581548 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:24.598882 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:24.600309 29378 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
I20260709 13:13:24.620997 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:13:24.623993 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:24.467728  1424 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:24.591686 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:24.677619 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:24.682765  1461 consensus_meta.cc:287] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.581s	user 0.013s	sys 0.000s
I20260709 13:13:24.681527  1209 consensus_queue.cc:260] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:24.685137 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:13:24.709975  1354 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:24.343713 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:24.460877  1380 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:24.739898 29450 raft_consensus.cc:1240] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 15 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:13:24.741281   832 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:24.742334   832 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:24.743121 29381 raft_consensus.cc:1240] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
W20260709 13:13:24.743677  1216 consensus_meta.cc:287] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.738s	user 0.013s	sys 0.001s
W20260709 13:13:24.745276  1541 log.cc:927] Time spent T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b: Append to log took a long time: real 0.282s	user 0.001s	sys 0.000s
I20260709 13:13:24.745555 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:24.746748 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:24.747905  1364 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:24.751662  1165 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:24.752362 29377 raft_consensus.cc:1240] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:13:24.752580  1165 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:24.753531 29375 raft_consensus.cc:1240] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:24.755152 29379 raft_consensus.cc:1240] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:24.760367 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:24.761653 29451 raft_consensus.cc:3060] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:24.763954  1286 raft_consensus.cc:697] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:24.764678 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:24.766048  1286 consensus_queue.cc:237] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:24.767755   940 raft_consensus.cc:3055] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:24.768395   940 raft_consensus.cc:740] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:13:24.770568   940 consensus_queue.cc:260] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:24.746403 29344 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:24.772944  1559 raft_consensus.cc:2804] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:24.796473  1321 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:24.766621  1558 raft_consensus.cc:3055] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:24.797536  1558 raft_consensus.cc:740] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:24.797617   781 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:24.498704  1488 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:24.798978  1321 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:24.799329  1558 consensus_queue.cc:260] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:24.801254  1488 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:24.802479  1558 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:24.802977 29528 raft_consensus.cc:1240] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:24.771776  1467 consensus_queue.cc:260] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:24.796996  1559 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:24.802851  1321 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:24.468359  1437 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:13:24.804646 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 76109.3us
I20260709 13:13:24.809600 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:24.796049 29373 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
W20260709 13:13:24.811770 30121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:24.813686  1209 raft_consensus.cc:3060] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:24.782232 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:24.744735  1216 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:24.781790 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:24.782651 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:24.783010 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:24.786278 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:24.787510 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:13:24.785781 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 118075us
I20260709 13:13:24.833799  1478 raft_consensus.cc:3055] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:24.778788   940 raft_consensus.cc:3060] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:24.792987 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:24.787462  1547 log.cc:927] Time spent T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.287s	user 0.000s	sys 0.000s
I20260709 13:13:24.774178 29419 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:24.837374 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:24.848160 29377 raft_consensus.cc:2376] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12. Re-sending same reply.
I20260709 13:13:24.850561 29421 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:24.852039  1467 raft_consensus.cc:3060] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:24.853585 29421 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:24.855839   832 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:24.737319  1461 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:24.830344  1559 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:24.487614  1481 consensus_queue.cc:260] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:24.841730  1478 raft_consensus.cc:740] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:24.874274 29523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53428 (request call id 713) took 1565 ms. Trace:
I20260709 13:13:24.878182 29521 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:13:24.865249  1335 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:24.884199 29374 raft_consensus.cc:2393] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 14: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:24.883090 29524 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:13:24.903402  1488 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:24.904532  1488 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:24.912384  1488 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:24.787662  1466 consensus_queue.cc:260] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:24.914770  1478 consensus_queue.cc:260] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:24.914806 29522 raft_consensus.cc:1240] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 10. Current term is 11. Ops: []
W20260709 13:13:24.920360 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:24.921051 30119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:24.924172 29378 raft_consensus.cc:2410] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
W20260709 13:13:24.924894 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 54643.3us
I20260709 13:13:24.881912  1321 raft_consensus.cc:2804] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:24.962061  1299 raft_consensus.cc:2804] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:25.009419 29522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53428 (request call id 715) took 1678 ms. Trace:
I20260709 13:13:24.972302  1165 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:13:24.976608 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:24.966953  1437 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:25.016535 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:24.875972 29523 rpcz_store.cc:276] 0709 13:13:23.278712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.836851 (+558139us) service_pool.cc:224] Handling call
0709 13:13:23.851945 (+ 15094us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:23.852164 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:13:24.133584 (+281420us) log.cc:844] Serialized 14 byte log entry
0709 13:13:24.814622 (+681038us) log.cc:844] Serialized 14 byte log entry
0709 13:13:24.815082 (+   460us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:24.815196 (+   114us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:24.815359 (+   163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:24.815474 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:24.843826 (+ 28352us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":55311,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":110227,"raft.run_cpu_time_us":391,"raft.run_wall_time_us":32245,"thread_start_us":618019,"threads_started":2,"wal-append.queue_time_us":322065}
I20260709 13:13:25.022176  1461 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:24.997345 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:25.009052  1299 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:25.066215  1299 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:25.029870 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 126839us
I20260709 13:13:25.028702  1560 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:25.048858 29522 rpcz_store.cc:276] 0709 13:13:23.279418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:23.847302 (+567884us) service_pool.cc:224] Handling call
0709 13:13:23.847659 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:24.918036 (+1070377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:24.919074 (+  1038us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54002328d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:24.957285 (+ 38211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2383985024}
I20260709 13:13:25.031667 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:25.096555 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 421075us
I20260709 13:13:25.030364  1551 consensus_queue.cc:1059] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:13:25.112387 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:25.116935 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 48450us
I20260709 13:13:25.114884 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:25.121421 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:25.122419 29450 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:25.105230  1461 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.133780 29419 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:25.138562 29450 raft_consensus.cc:2468] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
I20260709 13:13:25.143318 29525 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
I20260709 13:13:25.143735  1564 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.144783  1564 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:25.132134  1216 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:25.147764  1461 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:25.148566 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 278413us
I20260709 13:13:25.150593  1461 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:25.131196 29528 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:13:25.152202 29344 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:25.155021 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:25.116112  1478 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:25.158012 29450 raft_consensus.cc:3060] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:25.164023 29495 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:25.154778  1165 consensus_queue.cc:1048] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:13:25.172063   832 raft_consensus.cc:2804] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:25.172709   832 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:25.173156   832 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:25.178314 29529 raft_consensus.cc:1240] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:13:25.178987 29528 raft_consensus.cc:1240] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 9. Current term is 10. Ops: []
W20260709 13:13:25.182161  1456 consensus_meta.cc:287] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.760s	user 0.015s	sys 0.003s
W20260709 13:13:25.185324  1563 log.cc:927] Time spent T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.338s	user 0.002s	sys 0.000s
W20260709 13:13:25.191074  1379 consensus_meta.cc:287] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.743s	user 0.013s	sys 0.000s
I20260709 13:13:25.156422  1560 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:25.192577  1440 consensus_meta.cc:287] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 1.010s	user 0.017s	sys 0.014s
I20260709 13:13:25.192193 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:25.192076  1299 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:25.193274 29344 leader_election.cc:304] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:25.166940 29524 raft_consensus.cc:2393] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 14: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:25.198616 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:25.199008 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:25.203814 29529 raft_consensus.cc:1240] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 12. Current term is 13. Ops: []
W20260709 13:13:25.205972 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 85798.7us
I20260709 13:13:25.202924  1488 raft_consensus.cc:2804] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:25.208451  1488 raft_consensus.cc:697] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:25.208773 29376 raft_consensus.cc:2410] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:13:25.209674 29455 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:25.209898  1488 consensus_queue.cc:237] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:25.199553  1426 consensus_meta.cc:287] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.767s	user 0.015s	sys 0.011s
I20260709 13:13:25.211905  1426 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:25.212698 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:13:25.213191 29452 raft_consensus.cc:1240] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:13:25.208549 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:25.218786 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:25.182953  1456 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:25.218335 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:25.232545 29451 raft_consensus.cc:2468] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 3.
I20260709 13:13:25.233712 29450 raft_consensus.cc:2468] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
W20260709 13:13:25.234380 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 269054us
I20260709 13:13:25.242596 29521 raft_consensus.cc:2393] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 14: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:25.243145 29449 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
I20260709 13:13:25.236091  1551 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.216233  1559 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:25.254880 29448 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:25.239295  1426 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:25.223788  1379 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:25.259425 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:25.260411 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:25.262423 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:25.249595  1299 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:25.265936 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 72856.8us
I20260709 13:13:25.244736  1335 raft_consensus.cc:697] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 13 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
W20260709 13:13:25.266825 30120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:25.267431  1278 raft_consensus.cc:2749] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:25.275051 29527 raft_consensus.cc:1275] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:13:25.275712 29527 pending_rounds.cc:85] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 7
I20260709 13:13:25.276012 29527 pending_rounds.cc:107] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:13:25.276126 29344 leader_election.cc:304] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:25.277874 29344 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:25.279436  1440 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:25.279856  1440 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.278548  1278 raft_consensus.cc:2749] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:25.251639  1564 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:25.276356 29527 raft_consensus.cc:2889] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:25.265465 29421 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:25.284325 29419 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:25.279911  1552 raft_consensus.cc:3055] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:25.286906 29448 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:13:25.286538  1440 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:13:25.303750 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 56845.3us
I20260709 13:13:25.294992  1552 raft_consensus.cc:740] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
W20260709 13:13:25.310925 29530 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.013s	sys 0.001s
W20260709 13:13:25.315115 29530 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.014s	sys 0.001s
W20260709 13:13:25.309887  1354 consensus_meta.cc:287] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.541s	user 0.040s	sys 0.024s
I20260709 13:13:25.288355  1551 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:25.306156  1321 raft_consensus.cc:697] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 14 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:25.301952  1467 consensus_queue.cc:1059] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:13:25.312397  1299 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:13:25.321941 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:25.326103 30119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:25.329032  1569 raft_consensus.cc:2749] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:13:25.332926 30121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:25.330511  1466 raft_consensus.cc:3060] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:25.323436  1299 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.322862  1354 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:25.336537  1299 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:13:25.345992 30121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:25.346210  1283 consensus_meta.cc:287] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.937s	user 0.023s	sys 0.009s
W20260709 13:13:25.349349  1489 consensus_meta.cc:287] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.882s	user 0.020s	sys 0.002s
I20260709 13:13:25.349669  1283 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:25.346171 29376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 1520) took 1085 ms. Trace:
I20260709 13:13:25.351678 29376 rpcz_store.cc:276] 0709 13:13:24.259857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:24.260266 (+   409us) service_pool.cc:224] Handling call
0709 13:13:25.343720 (+1083454us) spinlock_profiling.cc:243] Waited 933 ms on lock 0x7b540009d3d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:25.344878 (+  1158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2145583360}
I20260709 13:13:25.356652 29526 raft_consensus.cc:1240] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:25.358911  1377 raft_consensus.cc:3055] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:25.345726  1456 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:25.349887  1489 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:25.360924  1377 raft_consensus.cc:740] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:13:25.363296 29530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3298) took 1114 ms. Trace:
I20260709 13:13:25.359020  1560 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:25.372816 29527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 1809) took 2052 ms. Trace:
I20260709 13:13:25.372408  1552 consensus_queue.cc:260] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:25.373235 29527 rpcz_store.cc:276] 0709 13:13:23.320196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:24.157071 (+836875us) service_pool.cc:224] Handling call
0709 13:13:24.157409 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:25.304575 (+1147166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:25.372047 (+ 67472us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540019e454. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:25.372598 (+   551us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2568486784}
I20260709 13:13:25.373862  1552 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:25.378319  1558 consensus_meta.cc:287] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.575s	user 0.012s	sys 0.004s
I20260709 13:13:25.361984  1283 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:25.370105  1379 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:25.363183 29522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3302) took 1077 ms. Trace:
I20260709 13:13:25.386166 29455 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
W20260709 13:13:25.392561 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 155358us
I20260709 13:13:25.364939  1559 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:25.368794 29530 rpcz_store.cc:276] 0709 13:13:24.249314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:24.249748 (+   434us) service_pool.cc:224] Handling call
0709 13:13:24.250155 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:24.250387 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:13:24.605913 (+355526us) log.cc:844] Serialized 14 byte log entry
0709 13:13:25.331088 (+725175us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:25.341414 (+ 10326us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:25.341508 (+    94us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:25.345401 (+  3893us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:25.363237 (+ 17836us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":206632,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":4143,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":8373,"thread_start_us":964128,"threads_started":2,"wal-append.queue_time_us":601872}
I20260709 13:13:25.398154  1299 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:25.392200  1321 consensus_queue.cc:237] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:25.401234 29421 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:25.389134  1570 raft_consensus.cc:2749] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:13:25.409268 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 194187us
I20260709 13:13:25.407863 29525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3307) took 1029 ms. Trace:
I20260709 13:13:25.384490  1209 raft_consensus.cc:3055] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:25.388039  1354 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:25.344334  1335 consensus_queue.cc:237] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:25.389855 29522 rpcz_store.cc:276] 0709 13:13:24.285503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:25.109336 (+823833us) service_pool.cc:224] Handling call
0709 13:13:25.128159 (+ 18823us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:25.128564 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:13:25.129012 (+   448us) log.cc:844] Serialized 14 byte log entry
0709 13:13:25.362898 (+233886us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:25.362948 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:25.362982 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:25.363034 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:25.363132 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15886,"prepare.queue_time_us":4576,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":14665,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":2661,"spinlock_wait_cycles":5376,"thread_start_us":217362,"threads_started":1}
I20260709 13:13:25.428251  1377 consensus_queue.cc:260] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:25.413465  1209 raft_consensus.cc:740] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:13:25.429585  1354 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:25.410842 29525 rpcz_store.cc:276] 0709 13:13:24.378418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:25.146327 (+767909us) service_pool.cc:224] Handling call
0709 13:13:25.146832 (+   505us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:25.147279 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:13:25.195662 (+ 48383us) log.cc:844] Serialized 14 byte log entry
0709 13:13:25.407404 (+211742us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:25.407466 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:25.407556 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:25.407636 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:25.407792 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11426,"prepare.queue_time_us":24204,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":52,"raft.queue_time_us":14647,"thread_start_us":164806,"threads_started":1}
I20260709 13:13:25.446607 29419 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:25.427788  1569 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:25.449105  1209 consensus_queue.cc:260] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:25.449821 29419 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:25.450418  1354 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:25.457849  1165 raft_consensus.cc:2764] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:13:25.461658  1570 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:25.462332  1570 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:25.462795  1570 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:25.483750  1209 raft_consensus.cc:3060] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:25.487792  1489 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:25.492746 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:25.493377 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:25.493848 29451 raft_consensus.cc:2393] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 12: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:25.495105 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:25.495710 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:25.496008 29455 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:25.496631 29448 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:25.500068 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:25.501111 29449 raft_consensus.cc:3060] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:25.503969 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:25.504863 30122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:25.504891 29447 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
I20260709 13:13:25.468465  1569 raft_consensus.cc:697] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 11 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:25.506536 29455 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
I20260709 13:13:25.507773  1552 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.507210  1569 consensus_queue.cc:237] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:25.508555  1377 raft_consensus.cc:3060] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:25.508472 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 58793.9us
I20260709 13:13:25.510686 29419 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:25.474326   832 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:25.507946  1299 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:25.512200  1552 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:25.524312 29523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3303) took 1192 ms. Trace:
I20260709 13:13:25.527791 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:13:25.528805 30156 raft_consensus.cc:1275] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:13:25.530640 29376 raft_consensus.cc:1240] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:25.514384   832 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:25.531373  1481 raft_consensus.cc:3060] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:25.536353 29526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53428 (request call id 722) took 1149 ms. Trace:
I20260709 13:13:25.520067 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:13:25.549162 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:25.527791 29421 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:25.546576 29523 rpcz_store.cc:276] 0709 13:13:24.332280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:25.127559 (+795279us) service_pool.cc:224] Handling call
0709 13:13:25.128159 (+   600us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:25.235793 (+107634us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:13:25.247481 (+ 11688us) log.cc:844] Serialized 14 byte log entry
0709 13:13:25.392164 (+144683us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:25.392253 (+    89us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:25.392305 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:25.524019 (+131714us) spinlock_profiling.cc:243] Waited 99.3 ms on lock 0x7b5400358ed4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:25.524080 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:25.524220 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11694,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":2288,"raft.queue_time_us":2519,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":173,"spinlock_wait_cycles":228303360,"thread_start_us":124980,"threads_started":1,"wal-append.queue_time_us":155511}
I20260709 13:13:25.548804 29526 rpcz_store.cc:276] 0709 13:13:24.387327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:25.158308 (+770981us) service_pool.cc:224] Handling call
0709 13:13:25.290893 (+132585us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b5800060c98. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61b71 00007f6a78c61a22 00007f6a81b7ac09 00007f6a80cd4ee0 00007f6a80d9e0ab 00007f6a80d9e131 00007f6a80d5ffc0 00007f6a80d4a929 00007f6a80d4a3d2 00007f6a7a2c1bd4
0709 13:13:25.294584 (+  3691us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:25.357193 (+ 62609us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:25.536002 (+178809us) spinlock_profiling.cc:243] Waited 61.6 ms on lock 0x7b54002319d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:25.536271 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171177728}
W20260709 13:13:25.555867 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 215468us
I20260709 13:13:25.561333 29419 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:25.549844  1299 raft_consensus.cc:2764] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:13:25.567791 29455 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:25.565076  1321 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:25.569977  1321 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:25.572486 29448 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:25.573637  1321 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:25.579967 30122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:25.581938 30121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:25.585367 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 57615.9us
W20260709 13:13:25.594043 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 177268us
I20260709 13:13:25.578540  1440 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:25.600191 29449 raft_consensus.cc:2468] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
W20260709 13:13:25.607810 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:25.597828  1299 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:25.609676  1440 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:25.609900  1299 raft_consensus.cc:697] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 14 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:25.599834  1321 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:25.611907  1321 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:25.612366  1321 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:25.613745 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:25.597078  1488 consensus_queue.cc:1048] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:13:25.611260  1299 consensus_queue.cc:237] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:25.632383  1574 log.cc:927] Time spent T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:13:25.634341 29421 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:25.635766  1569 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:25.637207  1569 raft_consensus.cc:697] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 13 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:25.638319  1569 consensus_queue.cc:237] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:25.639771 29419 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:25.641264  1572 raft_consensus.cc:2804] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:25.641824  1572 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:25.642166  1572 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:13:25.643453 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:25.648495  1581 consensus_queue.cc:1059] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:13:25.667667  1578 consensus_queue.cc:1059] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:13:25.670689  1209 raft_consensus.cc:3055] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:25.671168  1209 raft_consensus.cc:740] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:13:25.679891 29419 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:25.680191  1209 consensus_queue.cc:260] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:25.681238  1165 raft_consensus.cc:2804] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:25.681552  1581 raft_consensus.cc:3055] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:25.681746  1165 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:25.682015  1209 raft_consensus.cc:3060] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:25.682340  1165 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:25.682184  1581 raft_consensus.cc:740] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:25.684309  1581 consensus_queue.cc:260] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:25.684669  1488 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:25.685891  1581 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:25.685803  1488 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:25.688675  1478 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:25.689373  1478 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:25.693164 29344 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:25.694994 29344 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:25.695240  1489 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:25.695703  1440 consensus_queue.cc:1059] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:13:25.696000  1489 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:25.688706 29419 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:25.699862 29455 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
W20260709 13:13:25.703474 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:25.709906 30120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:25.713585 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:25.720520 30119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:25.728610 29419 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:25.730263  1299 raft_consensus.cc:2749] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:25.733381 29495 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:25.722210  1478 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:25.736027  1478 raft_consensus.cc:2749] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:25.736794  1552 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:25.737051 29419 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:25.738030  1488 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:25.717765  1335 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:25.735430 29495 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:25.738593  1489 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:25.739418  1489 raft_consensus.cc:2749] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:13:25.743808 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:25.739300  1586 raft_consensus.cc:3055] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:25.744863  1440 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:25.752583  1586 raft_consensus.cc:740] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:25.760175  1488 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:25.764257  1488 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:25.750675  1299 raft_consensus.cc:2749] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:25.770236  1488 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:25.772374  1551 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:25.754343  1570 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:25.754499  1440 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.779619  1570 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:25.785804   832 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:25.786536   832 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.786914   832 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:25.788949  1586 consensus_queue.cc:260] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:25.790643  1586 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:13:25.799872 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 62941us
I20260709 13:13:25.801072 29419 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:25.802667 29419 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:25.799772 29276 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35182 (request call id 70) took 8100 ms. Trace:
I20260709 13:13:25.805893  1321 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:25.822470  1440 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:25.805337 29419 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:25.823199  1572 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:25.818164 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:25.838475 29376 raft_consensus.cc:2468] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 5.
I20260709 13:13:25.841192 30121 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:13:25.807771  1570 raft_consensus.cc:2804] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:25.839993  1335 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:25.852954 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:25.853626 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:25.854431 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 159574us
I20260709 13:13:25.854432 29374 raft_consensus.cc:2468] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:13:25.848869  1570 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.817447  1321 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:25.858188 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:25.861938 29419 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:25.848457  1481 raft_consensus.cc:2804] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:13:25.865139 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:25.868964 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:25.869637 29378 raft_consensus.cc:3060] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:25.856591  1299 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 13 LEADER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:13:25.874778 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:25.874634 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:25.875684 29376 raft_consensus.cc:2393] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 8: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:25.876924 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:25.877897 29373 raft_consensus.cc:2393] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 9: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:25.879182 29344 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:25.880939 29344 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:25.881425  1590 raft_consensus.cc:2804] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:25.881920  1590 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.882304  1590 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:25.885142  1595 raft_consensus.cc:2804] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:25.885674  1595 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.886015  1595 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:25.888604  1589 consensus_queue.cc:1059] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:25.889984  1589 raft_consensus.cc:3055] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:25.890360  1589 raft_consensus.cc:740] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:25.806933 29276 rpcz_store.cc:276] 0709 13:13:17.691143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.695959 (+  4816us) service_pool.cc:224] Handling call
0709 13:13:25.791837 (+8095878us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:23.964021 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:24.032180 (+ 68159us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:24.032241 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:13:24.032273 (+    32us) tablet.cc:662] Decoding operations
0709 13:13:24.032987 (+   714us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:24.033096 (+   109us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:24.033140 (+    44us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:13:24.033513 (+   373us) tablet.cc:701] Row locks acquired
0709 13:13:24.033535 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:13:24.033908 (+   373us) write_op.cc:270] Start()
0709 13:13:24.034087 (+   179us) write_op.cc:276] Timestamp: P: 1783602804033687 usec, L: 0
0709 13:13:24.034123 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:13:24.035137 (+  1014us) log.cc:844] Serialized 1243 byte log entry
0709 13:13:25.307379 (+1272242us) op_driver.cc:464] REPLICATION: finished
0709 13:13:25.449875 (+142496us) spinlock_profiling.cc:243] Waited 2.88 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a78c7c0ac 00007f6a81ad6ab9 00007f6a78c9869b 00007f6a78c9693f 00007f6a78c98c02 00007f6a7f7bcef0
0709 13:13:25.601968 (+152093us) write_op.cc:301] APPLY: starting
0709 13:13:25.607769 (+  5801us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:25.755139 (+147370us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:25.760144 (+  5005us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:25.765997 (+  5853us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:25.766350 (+   353us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:13:25.766428 (+    78us) write_op.cc:312] APPLY: finished
0709 13:13:25.766900 (+   472us) log.cc:844] Serialized 32 byte log entry
0709 13:13:25.767180 (+   280us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:25.767349 (+   169us) write_op.cc:454] Released schema lock
0709 13:13:25.767417 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:25.780612 (+ 13195us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:25.780658 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3203482,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":279644,"apply.run_cpu_time_us":16354,"apply.run_wall_time_us":184064,"cfile_cache_hit":6,"cfile_cache_hit_bytes":6258,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6213,"cfile_init":2,"lbm_read_time_us":51797,"lbm_reads_10-100_ms":2,"lbm_reads_lt_1ms":10,"num_ops":2,"prepare.queue_time_us":291755,"prepare.run_cpu_time_us":47674,"prepare.run_wall_time_us":379334,"raft.queue_time_us":441365,"raft.run_cpu_time_us":21967,"raft.run_wall_time_us":309558,"replication_time_us":1254563,"spinlock_wait_cycles":6633344,"thread_start_us":1031389,"threads_started":4,"wal-append.queue_time_us":392022}]]}
I20260709 13:13:25.880941  1165 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:25.901702 30121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:25.859853  1570 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:25.907332 29378 raft_consensus.cc:2468] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 6.
I20260709 13:13:25.908495  1354 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:25.909057 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:25.866578  1481 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.916090 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:25.908406  1590 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:25.918514 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 56688.7us
I20260709 13:13:25.921763 29419 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:13:25.922470 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 65266.8us
I20260709 13:13:25.914587  1481 raft_consensus.cc:3060] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:25.914321  1165 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:25.930889  1572 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:25.931675 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:25.933197  1593 log.cc:927] Time spent T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:13:25.935847 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:25.936765 29373 raft_consensus.cc:2393] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 12: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:25.891378  1589 consensus_queue.cc:260] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:25.946424 29381 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 13.
I20260709 13:13:25.919721  1364 consensus_queue.cc:1059] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:13:25.946966 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:25.954030 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:25.955386 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:25.940089  1321 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:25.956790  1321 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:25.958662  1321 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:25.959076 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:25.959834 29379 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:25.961205  1551 raft_consensus.cc:493] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.961830  1551 raft_consensus.cc:515] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:25.965520 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:25.971161  1489 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.971812  1489 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:25.974218  1489 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:25.976497  1590 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:25.980760 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:25.981614 29526 raft_consensus.cc:2468] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 5.
I20260709 13:13:25.983403 30119 leader_election.cc:304] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:13:25.984167 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:25.984418  1209 raft_consensus.cc:2804] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:25.984545 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:25.984913  1209 raft_consensus.cc:493] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.985303  1209 raft_consensus.cc:3060] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:25.986333 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:13:25.986630 30121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:25.988142 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:25.988852 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:25.989770 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:25.991624 29381 raft_consensus.cc:1275] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:13:25.970667  1595 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:25.992079 29380 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:13:25.992961 29376 raft_consensus.cc:2368] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10.
I20260709 13:13:25.993371 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:25.994216 29380 raft_consensus.cc:2393] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 12: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:25.993116 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:25.995627 29381 raft_consensus.cc:2410] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:13:25.996721  1589 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:25.997897 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:25.998175 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:26.000535  1595 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:25.989915   832 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:26.000882 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.001480 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:26.002636   832 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:25.995353 29372 raft_consensus.cc:2468] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 4.
I20260709 13:13:26.003556  1578 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.004156  1578 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:26.003279  1551 leader_election.cc:290] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:26.007318  1578 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:26.012171 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.011816 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:26.012842 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:26.013837 29373 raft_consensus.cc:2393] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 14: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:26.013760 29372 raft_consensus.cc:2468] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 9.
I20260709 13:13:26.016193 30121 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:13:26.017309  1578 raft_consensus.cc:2804] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:26.029773  1209 raft_consensus.cc:515] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:13:26.023806 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 75865.8us
I20260709 13:13:26.025172  1440 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:26.030383  1578 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.038889 29495 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:26.034489 29379 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:26.040339 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:26.021571  1481 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:26.044366 29377 raft_consensus.cc:2468] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
W20260709 13:13:26.046363 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 87344.1us
I20260709 13:13:26.038125  1489 consensus_queue.cc:1059] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:13:26.047863  1278 raft_consensus.cc:3055] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:26.053081  1278 raft_consensus.cc:740] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:26.054172  1278 consensus_queue.cc:260] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:26.054595  1283 raft_consensus.cc:3055] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:26.056130  1283 raft_consensus.cc:740] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:26.047705  1558 raft_consensus.cc:2749] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:26.057097  1283 consensus_queue.cc:260] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:26.058737  1283 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:26.062381 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.064297 29495 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:26.064766 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:26.065410 29523 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
I20260709 13:13:26.065590 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:26.066416 29521 raft_consensus.cc:2393] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 12: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:26.066473 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:26.067550 29525 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:26.063357 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.068696 29521 raft_consensus.cc:1240] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:26.073534 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:26.073939 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:26.047142  1578 raft_consensus.cc:3060] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:26.076323  1558 raft_consensus.cc:2804] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:26.072278 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:26.078378  1558 raft_consensus.cc:697] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:26.080521 29523 raft_consensus.cc:1240] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:26.074564 29374 raft_consensus.cc:2376] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14. Re-sending same reply.
W20260709 13:13:26.090369 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.084790  1278 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:26.107580 29277 catalog_manager.cc:5697] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:26.168076  1354 raft_consensus.cc:2749] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:26.169024 29277 catalog_manager.cc:5697] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:26.140230 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:26.176512  1440 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:26.140129 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 75977.1us
I20260709 13:13:26.141031 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:26.178658 29521 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:26.142120 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:26.179908 29529 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:26.185459 29344 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:26.187106  1440 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:26.187551  1440 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:26.187939  1440 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:26.188428   940 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.188931   940 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:26.191345   940 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:26.193615 30122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.145543 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:26.195428 29379 raft_consensus.cc:3060] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:13:26.200071 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:26.201011 29530 raft_consensus.cc:2468] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 3.
I20260709 13:13:26.146073  1572 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:26.128829  1551 raft_consensus.cc:493] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.203200  1572 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:26.149163 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:26.204692 29527 raft_consensus.cc:3060] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:26.206427  1572 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:26.207121 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:26.151003 30121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.150815 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:26.207871 29377 raft_consensus.cc:3060] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:26.209642 30119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.210387 30119 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:13:26.151650  1481 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 7 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:26.152899 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 100952us
I20260709 13:13:26.153026 29421 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:26.156314  1321 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:26.145826  1209 leader_election.cc:290] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 6 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:26.079751  1558 consensus_queue.cc:237] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:26.163224 29526 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 14.
I20260709 13:13:26.201457 29525 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
I20260709 13:13:26.203282  1551 raft_consensus.cc:515] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:26.147222 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:26.216897 29377 raft_consensus.cc:2468] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 7.
I20260709 13:13:26.229283 29419 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:26.159086  1570 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:26.223771 29379 raft_consensus.cc:2468] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 6.
I20260709 13:13:26.231859 29495 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:26.229887  1590 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.234025  1590 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:26.236544  1590 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:26.240252  1489 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:26.240940 29521 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:13:26.226176   940 raft_consensus.cc:2804] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:26.246258 30121 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:13:26.244881   940 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.248036   940 raft_consensus.cc:3060] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:26.250191  1572 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:26.250844   832 consensus_queue.cc:1059] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:26.232208 29277 catalog_manager.cc:5697] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 9 to 12, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 12 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:26.257964  1551 leader_election.cc:290] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:26.258313  1209 raft_consensus.cc:2804] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:26.261369 29344 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:26.265061 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:26.267666 30120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.260507 30121 leader_election.cc:304] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:13:26.272939  1570 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:26.273758 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 120807us
I20260709 13:13:26.261107  1209 raft_consensus.cc:697] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:13:26.276742  1209 consensus_queue.cc:237] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:26.278926 29495 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:26.281136  1321 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:26.251658  1595 consensus_queue.cc:1059] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:13:26.275427 29421 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:26.289227 29529 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
I20260709 13:13:26.291643 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:26.294178  1578 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:26.296989  1578 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 10 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:26.297544  1551 raft_consensus.cc:2804] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:26.299636  1283 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:26.300081  1551 raft_consensus.cc:697] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:13:26.300197  1595 raft_consensus.cc:3055] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:26.300652  1595 raft_consensus.cc:740] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:26.301215  1551 consensus_queue.cc:237] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:26.301662  1595 consensus_queue.cc:260] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:26.299042  1489 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.294684 29277 catalog_manager.cc:5697] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:26.303056 29495 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:26.307204 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:26.252089  1165 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:26.315100 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 54529.8us
I20260709 13:13:26.316056 29344 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:26.337687 29375 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
I20260709 13:13:26.340348 29527 raft_consensus.cc:2468] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 6.
I20260709 13:13:26.342643 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:26.343403 29375 raft_consensus.cc:3060] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:26.344972 29344 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:26.346565 29344 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:26.346794 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 107888us
W20260709 13:13:26.348222 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 72853.5us
I20260709 13:13:26.349602 29421 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:26.354219 29521 raft_consensus.cc:2468] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 4.
I20260709 13:13:26.330384  1589 raft_consensus.cc:2804] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:26.357553 29277 catalog_manager.cc:5697] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:26.359236 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:26.360220 29529 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 14.
I20260709 13:13:26.362449  1590 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.363140  1590 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:26.365875  1590 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:26.357146  1592 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:26.368583  1592 raft_consensus.cc:697] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:26.369727  1592 consensus_queue.cc:237] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:26.372100 29495 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:26.373142 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:26.373800 29527 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:26.347723  1321 raft_consensus.cc:2804] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:26.346414  1581 raft_consensus.cc:2804] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:26.349967  1595 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:26.350301   832 raft_consensus.cc:2804] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:26.324558  1489 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:26.376907 30119 leader_election.cc:304] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:13:26.378017 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 93686.2us
I20260709 13:13:26.351640  1558 raft_consensus.cc:2749] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:26.380844  1488 raft_consensus.cc:2749] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:13:26.391857 29419 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:26.393436 29419 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:26.394361  1572 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:26.394776  1572 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:26.395399  1354 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:26.381285  1364 raft_consensus.cc:3055] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:26.399762 29527 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:13:26.399967  1364 raft_consensus.cc:740] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:26.401090 29379 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:13:26.400911  1364 consensus_queue.cc:260] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:26.377944  1570 consensus_queue.cc:1048] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:13:26.379168  1165 raft_consensus.cc:2804] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:26.404269  1165 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:26.404701  1165 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:26.395447  1572 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:26.387753   832 raft_consensus.cc:697] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:13:26.385401 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.388106 29495 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:26.379448  1589 raft_consensus.cc:697] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:26.381659  1321 raft_consensus.cc:697] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 6 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:26.385828  1581 raft_consensus.cc:697] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:26.408627   832 consensus_queue.cc:237] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:26.416028  1578 raft_consensus.cc:2804] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:26.413148 29378 raft_consensus.cc:1275] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:13:26.414335 29495 leader_election.cc:304] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:26.402468  1364 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:26.424345  1321 consensus_queue.cc:237] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:26.394769 29419 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:26.411376 29277 catalog_manager.cc:5697] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 14 to 16, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 16 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:26.414875 29421 leader_election.cc:400] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10.
W20260709 13:13:26.433279 30121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.433547 29421 leader_election.cc:403] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:26.429538  1581 consensus_queue.cc:237] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:26.430160  1586 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.431126  1489 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:26.432082  1283 raft_consensus.cc:2749] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:13:26.417666  1488 raft_consensus.cc:2804] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:26.437955  1488 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.438426  1488 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:26.438625  1570 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:13:26.439694  1586 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:26.429109  1440 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:26.429013  1589 consensus_queue.cc:237] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:26.416596 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:26.436689 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 60348.6us
I20260709 13:13:26.420940  1578 raft_consensus.cc:493] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.442070  1586 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:26.444896 29277 catalog_manager.cc:5697] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 9 to 12, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 12 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:26.447818 29495 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:26.433239 29344 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:26.461426 29527 raft_consensus.cc:2410] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:13:26.470103 29277 catalog_manager.cc:5697] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:26.474308  1572 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:26.465929 29375 raft_consensus.cc:2468] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 10.
I20260709 13:13:26.479892 29495 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:26.482290 30121 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:13:26.483842  1209 raft_consensus.cc:2804] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:13:26.485430 30121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.488049  1572 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:26.413589   940 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:26.469856  1590 raft_consensus.cc:2804] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:13:26.512954 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 118283us
I20260709 13:13:26.468915  1578 raft_consensus.cc:3060] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:26.508831  1489 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:13:26.539278 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 68682.9us
I20260709 13:13:26.509672  1283 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:13:26.542191 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 62374.1us
I20260709 13:13:26.542928 29419 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:26.544507 29495 leader_election.cc:304] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:26.545908 29419 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:26.546053 29495 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:26.552831 29379 raft_consensus.cc:606] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:26.553464 29379 raft_consensus.cc:614] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:26.557135   940 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 4 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:26.558502  1569 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:26.537247 29277 catalog_manager.cc:5697] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: config changed from index 4 to 5, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129), VOTER 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130), VOTER 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131), VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132). New cstate: current_term: 8 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:13:26.562701 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.510751  1354 raft_consensus.cc:2749] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:13:26.567167 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.532506  1590 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.585068 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:26.586578 29527 raft_consensus.cc:3060] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:13:26.603757 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 131714us
I20260709 13:13:26.604686 29344 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:26.569713  1558 raft_consensus.cc:2749] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:26.573235  1590 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:26.572430  1569 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:26.574832  1489 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:26.583853  1283 raft_consensus.cc:697] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:26.647809 29419 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:26.639444 29277 catalog_manager.cc:5697] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
W20260709 13:13:26.640295  1607 log.cc:927] Time spent T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:13:26.572544  1321 consensus_queue.cc:1048] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:13:26.576208  1209 raft_consensus.cc:697] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:13:26.663465 29277 catalog_manager.cc:5697] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 12 to 15, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 15 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:26.622740  1581 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:26.668298 29527 raft_consensus.cc:2468] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 4.
W20260709 13:13:26.670207 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 124205us
W20260709 13:13:26.672497 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.672662 29495 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:26.672098 30119 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
W20260709 13:13:26.681756 30122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.631379  1354 consensus_queue.cc:1048] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:13:26.689970 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:26.690716 29530 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
I20260709 13:13:26.667441  1613 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.695910  1209 consensus_queue.cc:237] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:26.702628  1165 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:26.704170  1608 log.cc:927] Time spent T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:13:26.703953  1283 consensus_queue.cc:237] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:26.706766  1613 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:26.709401  1613 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:26.693035  1278 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.711009  1278 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:26.713428  1278 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:26.685750  1481 raft_consensus.cc:2804] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:26.714397  1481 raft_consensus.cc:697] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:13:26.647977  1488 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:26.691475 29277 catalog_manager.cc:5697] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:26.716450 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 94075.9us
W20260709 13:13:26.765856 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.767024  1165 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:26.767637 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:26.768962 29379 raft_consensus.cc:2468] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 8.
W20260709 13:13:26.770363  1616 log.cc:927] Time spent T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.054s	user 0.004s	sys 0.000s
I20260709 13:13:26.780501 29379 raft_consensus.cc:1275] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:13:26.693064  1581 raft_consensus.cc:697] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:26.784799  1581 consensus_queue.cc:237] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:26.716804  1440 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:26.715363  1570 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10.
I20260709 13:13:26.790805 30121 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:13:26.792182  1618 raft_consensus.cc:2804] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:26.792611  1618 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.792949  1618 raft_consensus.cc:3060] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:26.797078  1488 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:26.796921 29277 catalog_manager.cc:5697] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 9 to 12, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 12 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:26.715420  1481 consensus_queue.cc:237] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:26.803272 29375 raft_consensus.cc:1275] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:13:26.806097  1570 consensus_queue.cc:1048] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:26.806370  1578 raft_consensus.cc:515] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:26.807439  1613 consensus_queue.cc:1048] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:26.809369 29277 catalog_manager.cc:5697] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:26.812650 29419 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:26.813616  1570 raft_consensus.cc:2764] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:13:26.814770  1578 leader_election.cc:290] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 5 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:26.814885 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:13:26.815735 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:26.816239 30119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.815927 29530 raft_consensus.cc:3060] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:13:26.818235 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:26.818717 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:26.825111 30121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.684388  1611 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:26.724085  1558 raft_consensus.cc:2804] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:26.842511 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:26.719869  1621 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:26.846498 29375 raft_consensus.cc:3060] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:13:26.852226 30120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:26.853273 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.856930 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:26.870563 29522 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
I20260709 13:13:26.861436 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:26.871610 29529 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:26.862023 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:13:26.873204 30121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.876194 29375 raft_consensus.cc:2468] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 5.
I20260709 13:13:26.877822 29419 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:26.845342  1558 raft_consensus.cc:697] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:26.902158 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:26.918990 29376 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:26.908600 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:26.878434 30121 leader_election.cc:304] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:13:26.912092 29380 raft_consensus.cc:1240] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:26.920312 29344 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:26.843076  1578 consensus_queue.cc:1048] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
W20260709 13:13:26.921160 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 248576us
I20260709 13:13:26.850044  1489 raft_consensus.cc:697] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:26.921679 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:13:26.926178 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 47831.6us
I20260709 13:13:26.929687 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:26.929839 29495 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:26.943028  1489 consensus_queue.cc:237] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:26.953704 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.960153 29376 raft_consensus.cc:2468] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 10.
W20260709 13:13:26.955168 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 99286.2us
I20260709 13:13:26.930693  1572 raft_consensus.cc:2749] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:26.962522 29495 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:26.940392   940 raft_consensus.cc:2804] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:13:26.981663 30121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:26.988035 29529 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
I20260709 13:13:26.948246  1283 raft_consensus.cc:2749] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:26.987231 29344 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:26.852481  1621 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:26.998652 29375 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 13.
I20260709 13:13:26.989418  1209 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.001896  1209 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:27.004428  1209 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:27.007440  1618 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:27.010128   940 raft_consensus.cc:697] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:13:27.011193   940 consensus_queue.cc:237] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:26.996366  1590 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:27.015776  1558 consensus_queue.cc:237] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:27.017936 29530 raft_consensus.cc:2468] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 5.
I20260709 13:13:27.018505  1618 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:27.023448  1592 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:27.024035  1592 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:27.019840 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 78523us
W20260709 13:13:27.020177  1619 log.cc:927] Time spent T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:13:27.015805 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:27.027907 29376 raft_consensus.cc:3060] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:26.991860  1624 raft_consensus.cc:2764] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 13:13:27.025920 29495 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:26.961262  1622 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:27.032992 29374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:13:27.033676 29374 raft_consensus.cc:606] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:27.024443  1590 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:27.027546  1592 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:27.074644 29495 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:27.036270 29421 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:27.030455  1622 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:27.085912 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 49733.1us
I20260709 13:13:27.088135 29421 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:13:27.091043 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:27.084606 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 86898.5us
W20260709 13:13:27.097806 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 97225.4us
I20260709 13:13:27.035806  1572 consensus_queue.cc:1059] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:13:27.169787 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:27.172071 29530 raft_consensus.cc:1275] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:13:27.167464 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 72183us
I20260709 13:13:27.077696  1283 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:27.037711  1209 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.091821 29495 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:13:27.169070  1625 log.cc:927] Time spent T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
W20260709 13:13:27.144950 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:27.204231 29375 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:13:27.078555  1611 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:13:27.186705 30122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:27.085453  1622 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:27.189760 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 58103.9us
I20260709 13:13:27.197161 29376 raft_consensus.cc:2468] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 9.
W20260709 13:13:27.204312 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 112625us
I20260709 13:13:27.211761 29495 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:27.180254 29374 raft_consensus.cc:1240] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:27.141050  1354 raft_consensus.cc:2804] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:27.214552 29495 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:27.205081 29375 raft_consensus.cc:606] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 LEADER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:27.214221  1321 raft_consensus.cc:2804] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:13:27.213792  1283 raft_consensus.cc:697] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:27.225227  1488 raft_consensus.cc:2804] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:27.167676  1624 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:13:27.234187 30121 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:13:27.238521 29379 raft_consensus.cc:1275] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:13:27.218706  1627 raft_consensus.cc:2749] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:27.227640  1620 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:27.226874  1569 raft_consensus.cc:3055] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:27.226447  1283 consensus_queue.cc:237] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:27.441421  1569 raft_consensus.cc:740] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:27.442595  1569 consensus_queue.cc:260] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:27.444061  1569 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:27.248716  1620 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:27.414568  1592 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:27.444743  1620 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:27.230058  1611 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:27.343420 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 129548us
W20260709 13:13:27.287688 30120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:27.231175  1572 consensus_queue.cc:1048] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.105s
I20260709 13:13:27.447167  1592 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:27.380419 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:27.429826  1622 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:27.344319  1165 consensus_queue.cc:1059] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
W20260709 13:13:27.348119 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 118468us
W20260709 13:13:27.376210 30121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:27.342420  1321 raft_consensus.cc:697] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 10 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
W20260709 13:13:27.324973 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:27.453737  1165 raft_consensus.cc:3055] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:27.455835  1165 raft_consensus.cc:740] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:27.203832  1617 consensus_queue.cc:1048] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:13:27.226563  1488 raft_consensus.cc:697] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 11 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
W20260709 13:13:27.456068 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 241590us
I20260709 13:13:27.457440 29495 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:27.241633   940 raft_consensus.cc:2804] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:27.457355  1321 consensus_queue.cc:237] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:27.438644 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 257465us
I20260709 13:13:27.286777  1621 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:13:27.300787 30119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:27.206878  1209 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:27.230681  1354 raft_consensus.cc:697] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 13 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:27.453219  1611 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:27.312039 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:27.275046  1551 consensus_queue.cc:1048] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:27.458792 29495 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:27.475697 29495 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:27.476662  1354 consensus_queue.cc:237] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:27.479106  1558 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:27.480002  1558 raft_consensus.cc:697] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:27.481218  1558 consensus_queue.cc:237] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:27.458947  1488 consensus_queue.cc:237] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:27.454994 29344 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:27.460345 30121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:27.482947 30121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:27.477784 29419 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:27.453222  1622 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:27.484181  1622 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:27.484690  1622 raft_consensus.cc:697] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:27.478667  1209 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:27.479013  1627 raft_consensus.cc:2804] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:27.494625 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:27.495325 29529 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:27.504580 29529 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
W20260709 13:13:27.510361 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:27.510982 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:27.509018 29493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 281645us
I20260709 13:13:27.505959 28234 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:13:27.469743  1624 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:27.519975 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:27.524725  1620 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:27.526813 29447 raft_consensus.cc:1275] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:13:27.491426   940 raft_consensus.cc:697] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:13:27.529809   940 consensus_queue.cc:237] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:27.508376  1572 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.531900  1572 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:27.532752 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:27.529934 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:27.533742 29448 raft_consensus.cc:2393] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 13: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:27.529912  1622 consensus_queue.cc:237] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:27.513676  1611 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:27.545004 29449 raft_consensus.cc:1275] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:13:27.513569  1645 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.542315 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:27.517784  1627 raft_consensus.cc:697] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:27.456779  1165 consensus_queue.cc:260] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:27.550285 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:27.553982 29448 raft_consensus.cc:2393] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 13: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:27.549925 28234 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:27.556453 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:27.558566 29529 raft_consensus.cc:1275] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:13:27.564775  1647 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.565466  1647 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:27.547857  1644 consensus_queue.cc:1048] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:13:27.549121  1611 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:27.568605  1611 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:27.539578  1624 raft_consensus.cc:697] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:27.536324  1321 raft_consensus.cc:476] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 13 LEADER]: Not starting pre-election -- already a leader
W20260709 13:13:27.589612 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:27.555235  1283 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.593415 29451 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:27.619765 29530 raft_consensus.cc:1275] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:13:27.591220  1644 consensus_queue.cc:1048] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:13:27.621861 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:27.624466 29522 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:27.623412 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:27.553793  1645 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:27.632216 29525 raft_consensus.cc:1275] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:13:27.625604  1354 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.632129  1642 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:27.633792 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:27.636363 29527 raft_consensus.cc:1240] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:27.642454 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:27.643185 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:27.643117 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:27.645380 29452 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:13:27.645824 29450 raft_consensus.cc:2393] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 11: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:27.648360  1620 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:27.644366  1440 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.649585  1440 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:27.650669  1572 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:27.657820 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:27.596774  1283 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:27.659608  1354 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:27.662858 29529 raft_consensus.cc:1275] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:13:27.665356 30122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:27.667958  1440 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:27.668555 29521 raft_consensus.cc:1275] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:13:27.670737 29344 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:27.671051 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:27.683564  1645 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:27.684983  1623 raft_consensus.cc:2804] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:27.685600  1623 raft_consensus.cc:697] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:27.686626  1623 consensus_queue.cc:237] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:27.675361  1624 consensus_queue.cc:237] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:27.710158 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:27.728176 30157 raft_consensus.cc:1240] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:27.754609 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:27.756877 29523 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:27.766345  1283 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:27.768010 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:27.707731  1647 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:27.783000 29522 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 14.
W20260709 13:13:27.787612 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 127689us
I20260709 13:13:27.799222 29455 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
I20260709 13:13:27.676215 29452 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
W20260709 13:13:27.678853 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:27.600795  1627 consensus_queue.cc:237] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:27.688413 29529 raft_consensus.cc:1275] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:13:27.690256  1642 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:27.741925 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:27.627431  1613 consensus_queue.cc:1048] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.159s
W20260709 13:13:27.883885 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 63906us
W20260709 13:13:27.884863 30119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:27.868160 29448 raft_consensus.cc:1275] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:13:27.780172  1622 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:27.888747 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:27.891703 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:27.895169 29450 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:27.896502 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:27.895836 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 65970.9us
I20260709 13:13:27.902179  1440 consensus_queue.cc:1048] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:27.903105 29451 raft_consensus.cc:1275] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:13:27.911217  1642 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:27.912153  1354 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:27.913898 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:27.914355  1602 consensus_queue.cc:1048] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:13:27.914781 30121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:27.915320 30121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:27.917482  1611 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:27.920727 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:27.929993 29377 raft_consensus.cc:1275] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:13:27.930388 29523 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 14.
I20260709 13:13:27.936472 29450 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
W20260709 13:13:27.939006 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 139034us
I20260709 13:13:27.945170 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:27.949326 29523 raft_consensus.cc:1240] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:13:27.950349 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:27.951450 29379 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 13.
I20260709 13:13:27.952953 30157 raft_consensus.cc:1275] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:13:27.953890 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:27.955051 29522 raft_consensus.cc:2410] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:13:27.956138 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:27.895072  1646 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:27.968014 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:27.899365  1572 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:27.983966 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:27.924053  1642 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:27.989071 29381 raft_consensus.cc:1240] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:28.006873 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:28.015996 29522 raft_consensus.cc:2368] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10.
I20260709 13:13:27.988576 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:27.987906 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:27.920293  1622 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:28.021793 30121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:27.943637  1481 consensus_queue.cc:1048] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:13:28.034233 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:28.035125 29527 raft_consensus.cc:2393] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 12: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:28.014920 29421 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:13:28.040643 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 95702.2us
I20260709 13:13:27.957124  1589 consensus_queue.cc:1048] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:13:28.047948 29344 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:28.041051 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:27.938046  1612 consensus_queue.cc:1048] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:13:27.990213  1354 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.050575 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:28.054174 30120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.033891  1642 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:27.995785  1647 consensus_queue.cc:1048] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:13:28.075568 29344 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:27.991156  1572 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:28.081482 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:27.996055  1646 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:28.059793  1570 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:28.057562  1592 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:28.099582 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:28.099866 29452 raft_consensus.cc:1240] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:28.103324 29447 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:28.080785  1209 consensus_queue.cc:1048] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:13:28.107928 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:28.107992 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:28.111788 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:28.116423 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:28.118367 29526 raft_consensus.cc:2393] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 10: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:13:28.118764 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 108105us
W20260709 13:13:28.123875  1648 log.cc:927] Time spent T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:13:28.124876 29524 raft_consensus.cc:1240] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:28.125152 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:28.125726 29521 raft_consensus.cc:1240] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 13. Current term is 14. Ops: []
W20260709 13:13:28.127938 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.128540 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:28.129837 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:28.110469  1678 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:28.132683  1678 raft_consensus.cc:697] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:28.133780  1678 consensus_queue.cc:237] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:28.134450  1283 consensus_queue.cc:1048] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:28.134817 29495 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:28.136049  1283 consensus_queue.cc:1048] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:28.137619  1283 raft_consensus.cc:2804] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:28.138017  1283 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:28.138393  1283 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:13:28.139460 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:28.140079 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.143118  1278 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.143728  1278 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:28.123970 29451 raft_consensus.cc:1240] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:28.101650  1570 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:28.145828  1592 raft_consensus.cc:697] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:28.145998  1278 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:28.146746  1165 raft_consensus.cc:3060] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:28.146984  1592 consensus_queue.cc:237] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:28.125085 29526 raft_consensus.cc:1275] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:13:28.076411  1354 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:28.158334 29447 raft_consensus.cc:1275] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:13:28.150645 29526 pending_rounds.cc:85] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 8
I20260709 13:13:28.184629 29526 pending_rounds.cc:107] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:13:28.184940 29526 raft_consensus.cc:2889] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:28.162019 30122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.159154 29495 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:28.167569  1646 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:28.094600  1633 consensus_queue.cc:1059] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:13:28.146062  1570 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:28.169518  1354 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:28.170783  1572 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:28.171446  1642 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:28.117272  1611 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:28.173882  1622 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:28.176918 29451 raft_consensus.cc:1240] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:28.178194 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:28.231096 29525 raft_consensus.cc:2393] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 14: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:28.180653 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:28.189172 29529 raft_consensus.cc:1240] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:13:28.194761 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:13:28.196475 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:28.191383 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.205104  1661 raft_consensus.cc:2804] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:28.207705 29495 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:28.208339  1647 consensus_queue.cc:1048] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:28.241236 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:28.256156 29528 raft_consensus.cc:2393] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 13: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:28.256618 29449 raft_consensus.cc:2393] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 14: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:28.256738 29379 raft_consensus.cc:1275] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:13:28.243414 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:28.255357 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 47783.5us
I20260709 13:13:28.262140 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:28.267823  1627 consensus_queue.cc:1048] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:28.272213 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:28.263211 29453 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
W20260709 13:13:28.274915 30121 leader_election.cc:336] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 2.034s (SENT)
I20260709 13:13:28.275573 30121 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:28.278163  1551 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:28.280146 29453 raft_consensus.cc:1275] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:13:28.290789 29450 raft_consensus.cc:1240] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:28.260113  1642 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.333207 29450 raft_consensus.cc:1240] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:28.289963  1624 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:28.227067  1621 consensus_queue.cc:1048] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:13:28.288650  1661 raft_consensus.cc:697] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:28.344954 29525 raft_consensus.cc:1275] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:13:28.288549  1617 consensus_queue.cc:1048] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
W20260709 13:13:28.343772  1631 log.cc:927] Time spent T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 13:13:28.366252 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.374269 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:28.375419 29450 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:13:28.348220  1683 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:28.407262 30121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.380733  1572 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:28.346832  1642 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:13:28.455006 30121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.461126 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:28.429450  1683 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:28.488579 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:28.490969 30119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.459954  1678 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:28.463135 29450 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
W20260709 13:13:28.479955  1680 log.cc:927] Time spent T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 13:13:28.451469  1677 consensus_queue.cc:1048] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:13:28.487110  1624 raft_consensus.cc:697] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:28.451649  1572 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:28.543246  1699 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.544075  1699 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:28.546768  1699 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:28.553146 29453 raft_consensus.cc:1240] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:28.530594  1165 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:28.558981  1165 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:28.558727  1624 consensus_queue.cc:237] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:28.561669  1165 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:28.477936  1661 consensus_queue.cc:237] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:28.565313  1689 log.cc:927] Time spent T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:13:28.567826  1685 log.cc:927] Time spent T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 13:13:28.571943 29524 raft_consensus.cc:1275] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:13:28.573573  1686 log.cc:927] Time spent T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 13:13:28.575968  1690 log.cc:927] Time spent T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:13:28.577649 29530 raft_consensus.cc:1240] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 11. Current term is 12. Ops: []
W20260709 13:13:28.577692 30122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:28.579227 30120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:28.582767 30121 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 1.851s (SENT) [suppressed 43 similar messages]
I20260709 13:13:28.580376  1165 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.607851  1165 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:28.610690  1165 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:28.612679  1572 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:28.614172 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:28.615124 29455 raft_consensus.cc:2393] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 14: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:13:28.627465 30121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.532215  1678 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:28.628146 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 122868us
I20260709 13:13:28.661748 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:28.663830 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:28.662352 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:28.668133 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:28.670153 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:28.671280 29376 raft_consensus.cc:2393] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 10: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:28.674317 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:28.674449 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:28.675639 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:28.675868 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:28.676518 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:28.676828 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:28.677002 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:28.677740  1682 consensus_queue.cc:1048] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:28.678236 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:28.679064 29378 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:13:28.680135 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:28.677166 29376 raft_consensus.cc:2376] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10. Re-sending same reply.
I20260709 13:13:28.681434 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:28.684713 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:28.686304 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:28.688910 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:28.690898 29453 raft_consensus.cc:1275] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:13:28.694078 29372 raft_consensus.cc:2393] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 10: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:28.704551 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:28.709508 29453 raft_consensus.cc:1240] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:28.724035 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:28.727545 29375 raft_consensus.cc:2410] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
W20260709 13:13:28.731971 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 56892us
I20260709 13:13:28.742846 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:28.760207 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:28.767093 29453 raft_consensus.cc:1275] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:13:28.730643  1642 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:28.698503  1697 consensus_queue.cc:1048] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:13:28.788571 29527 raft_consensus.cc:1240] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 LEADER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 12. Current term is 13. Ops: []
W20260709 13:13:28.773623  1283 consensus_meta.cc:287] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.631s	user 0.016s	sys 0.000s
I20260709 13:13:28.794116 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:28.796813 29372 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:28.794220 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:28.805168 29453 raft_consensus.cc:3060] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:28.804597 29381 raft_consensus.cc:1275] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:13:28.810832 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:28.793704  1710 consensus_queue.cc:1048] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:13:28.814519 29375 raft_consensus.cc:1240] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 12. Current term is 13. Ops: []
W20260709 13:13:28.821655 30121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.832053 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:28.798450  1683 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:28.841876 29380 raft_consensus.cc:1275] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:13:28.843899 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:28.842660 29374 raft_consensus.cc:1275] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:13:28.795259  1283 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:28.837906  1687 log.cc:927] Time spent T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.344s	user 0.005s	sys 0.001s
I20260709 13:13:28.788627  1624 consensus_queue.cc:1048] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:13:28.847556 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:28.850399 29456 raft_consensus.cc:1275] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:13:28.850630 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:28.850874 29376 raft_consensus.cc:1275] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:13:28.852108 29377 raft_consensus.cc:1275] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:13:28.852901 29378 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:13:28.852841 29524 raft_consensus.cc:1240] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:28.857959 29380 raft_consensus.cc:1275] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:13:28.842024  1713 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:28.867192 29495 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:28.850832  1642 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:28.892233 29346 leader_election.cc:336] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 1.663s (SENT)
I20260709 13:13:28.893057 29346 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:28.887511  1708 log.cc:927] Time spent T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:13:28.885994  1697 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:13:28.929374 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.907811 29454 raft_consensus.cc:1240] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:28.899631 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:28.930802 29456 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:28.928069 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 71503.2us
I20260709 13:13:28.933990 29495 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:13:28.909525 29521 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.007s	sys 0.011s
W20260709 13:13:28.941751 29521 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.008s	sys 0.012s
W20260709 13:13:28.942286 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.894173  1440 raft_consensus.cc:3055] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:28.870167  1681 consensus_queue.cc:1059] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
W20260709 13:13:28.906584  1709 log.cc:927] Time spent T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
W20260709 13:13:28.908682  1705 log.cc:927] Time spent T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 13:13:28.907738  1712 log.cc:927] Time spent T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:13:28.903121  1715 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:28.873265  1713 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:28.894003  1642 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:28.951694  1440 raft_consensus.cc:740] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:28.971365 29375 raft_consensus.cc:1275] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:13:28.972504 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:28.964825 29495 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:28.964958 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:28.975168 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:28.979972 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:28.978753 29495 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:13:28.982841 30122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:28.984237 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:28.982903 29378 raft_consensus.cc:1275] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:13:28.988408 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:28.989185 29374 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
I20260709 13:13:28.989771 29381 raft_consensus.cc:2393] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 10: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:28.973033  1699 raft_consensus.cc:2749] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:28.973270  1681 consensus_queue.cc:1243] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer 429e58eb058349e3bf72b5a870c8f6e5 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:13:28.993362 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:13:28.995707 30119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:29.001654 29346 leader_election.cc:336] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 1.528s (SENT)
I20260709 13:13:29.003913  1572 consensus_queue.cc:1048] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:13:29.005158  1695 log.cc:927] Time spent T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.211s	user 0.000s	sys 0.002s
W20260709 13:13:29.002966 29346 leader_election.cc:336] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 1.536s (SENT)
W20260709 13:13:29.009917  1693 log.cc:927] Time spent T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 13:13:29.010274 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:29.011165 29455 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
I20260709 13:13:29.012703 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:29.014073 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:29.014796 29455 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:29.014632 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:29.016733  1581 raft_consensus.cc:993] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5: : Instructing follower 183db85c071f489fbc8de63a9edd8a3a to start an election
I20260709 13:13:28.981626  1624 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:29.031062 30120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.030926 29453 raft_consensus.cc:2468] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
W20260709 13:13:29.032380 29346 leader_election.cc:336] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 1.683s (SENT)
I20260709 13:13:29.032670 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:29.033162 29346 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:29.035434 29451 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:13:29.039249 29451 raft_consensus.cc:1240] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:29.033659 29453 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
I20260709 13:13:29.040170 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:29.048727 29454 raft_consensus.cc:2393] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 12: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
W20260709 13:13:29.051846 30121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:29.056586  1718 log.cc:927] Time spent T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:13:29.063666 30121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.057621  1642 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:29.065654 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:29.068924 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:29.070436 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:29.071928 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:29.077347 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:29.078751 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:29.079475 29450 raft_consensus.cc:2393] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 14: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:29.080457 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:29.081014 29450 raft_consensus.cc:2376] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10. Re-sending same reply.
I20260709 13:13:29.081945 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:29.083073 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:29.076412 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:29.085078 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:29.086664 29450 raft_consensus.cc:2393] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 12: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:29.050813  1622 raft_consensus.cc:1081] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 LEADER]: Signalling peer 183db85c071f489fbc8de63a9edd8a3a to start an election
W20260709 13:13:29.089119 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 110452us
I20260709 13:13:29.090021 29495 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:29.092092  1661 raft_consensus.cc:2749] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:29.094256  1581 raft_consensus.cc:2749] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:13:29.097599 29448 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
I20260709 13:13:29.107810 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:29.111951 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 79634.1us
W20260709 13:13:29.112720 29346 leader_election.cc:336] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 1.745s (SENT)
W20260709 13:13:29.111199 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 118456us
I20260709 13:13:29.116197 29454 raft_consensus.cc:1275] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:13:29.046985  1710 raft_consensus.cc:2749] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:29.116883 29372 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
W20260709 13:13:29.109979  1705 log.cc:927] Time spent T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
W20260709 13:13:29.122440 29346 leader_election.cc:336] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 1.802s (SENT)
W20260709 13:13:29.127933 29346 leader_election.cc:336] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 1.805s (SENT)
I20260709 13:13:29.128479 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:29.132961 29495 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:29.135831 29454 raft_consensus.cc:3055] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:29.136466 29454 raft_consensus.cc:740] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:29.139743 29529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 1868) took 1007 ms. Trace:
I20260709 13:13:29.141587 29421 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:29.140374 29529 rpcz_store.cc:276] 0709 13:13:28.132760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:28.256422 (+123662us) service_pool.cc:224] Handling call
0709 13:13:28.292173 (+ 35751us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:28.388046 (+ 95873us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:28.388078 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:28.408940 (+ 20862us) log.cc:844] Serialized 26 byte log entry
0709 13:13:28.618222 (+209282us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:28.657309 (+ 39087us) log.cc:844] Serialized 14 byte log entry
0709 13:13:28.657561 (+   252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:28.657657 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:29.139426 (+481769us) raft_consensus.cc:1685] finished
0709 13:13:29.139452 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:29.139669 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":41304,"raft.queue_time_us":144431,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":6930,"spinlock_wait_cycles":26958592,"thread_start_us":255799,"threads_started":2,"wal-append.queue_time_us":353002}
W20260709 13:13:29.153023 29346 leader_election.cc:336] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 1.836s (SENT)
I20260709 13:13:29.153952 29346 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:29.140473 29454 consensus_queue.cc:260] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:29.159384 29454 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:29.163185 29456 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 14.
I20260709 13:13:29.142645  1710 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:29.163214 29455 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:13:29.165052 29495 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:29.061494  1440 consensus_queue.cc:260] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:29.167532 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:29.169610 29456 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:13:29.170892 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:29.171860 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.139088  1354 consensus_queue.cc:1048] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:13:29.175522 29495 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:29.179183 29495 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:29.149823  1728 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:29.169557  1715 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:29.191639 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:29.195091 29455 raft_consensus.cc:2376] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 14. Re-sending same reply.
W20260709 13:13:29.193959 29346 leader_election.cc:336] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 1.990s (SENT)
I20260709 13:13:29.193733 29456 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:13:29.173520  1647 raft_consensus.cc:2749] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:29.179360  1440 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:29.212903 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:29.215790 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:29.212002 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:29.216580 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:29.222710 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:29.213863 29381 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 12.
I20260709 13:13:29.224347 29456 raft_consensus.cc:2376] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8. Re-sending same reply.
I20260709 13:13:29.203042  1707 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:29.181478  1728 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.189807  1621 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:29.229913  1728 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:29.231860  1642 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.233979 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:29.234835 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:13:29.241262 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 58583.1us
I20260709 13:13:29.238662 29455 raft_consensus.cc:1275] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:13:29.236074 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:29.242498 29451 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:13:29.245095 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:29.245972 29448 raft_consensus.cc:2376] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13. Re-sending same reply.
I20260709 13:13:29.247941 29495 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:29.250962 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:29.251174 29346 leader_election.cc:336] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 2.273s (SENT)
I20260709 13:13:29.251802 29456 raft_consensus.cc:1275] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:13:29.256054 29453 raft_consensus.cc:3055] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:29.255000 29421 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:29.256460 29453 raft_consensus.cc:740] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
W20260709 13:13:29.260527 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.266027 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:29.255679  1570 consensus_meta.cc:287] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 1.024s	user 0.019s	sys 0.000s
I20260709 13:13:29.268088  1733 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:29.268111  1647 raft_consensus.cc:2749] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:29.300240 29454 raft_consensus.cc:1275] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:13:29.301247 29454 pending_rounds.cc:85] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 7
I20260709 13:13:29.301576 29454 pending_rounds.cc:107] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:13:29.249514  1642 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:29.300769 29455 raft_consensus.cc:1275] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:13:29.303580 29454 raft_consensus.cc:2889] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:29.307053 29451 raft_consensus.cc:1240] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:29.300408  1733 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.309717  1733 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:29.321873  1283 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:29.326433 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:29.327991 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 80153.4us
I20260709 13:13:29.329172 29495 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:29.329377 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:29.330686 29495 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:29.331259 29450 raft_consensus.cc:1240] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:29.336860  1733 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:29.337939  1642 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:29.267045 29453 consensus_queue.cc:260] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:29.347007 29453 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:29.352109 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:29.356313  1283 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:29.301432  1570 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:29.365595 29449 raft_consensus.cc:1240] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:29.369443  1570 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:29.372985 30154 raft_consensus.cc:1275] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:13:29.373066 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.373754 29450 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
I20260709 13:13:29.364545  1713 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:29.374666 29453 raft_consensus.cc:1275] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:13:29.395278 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:29.392484 29455 raft_consensus.cc:3055] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:29.395942 29455 raft_consensus.cc:740] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
W20260709 13:13:29.396833 30121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.393520 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:29.375324 29454 raft_consensus.cc:1275] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:13:29.397696 29450 raft_consensus.cc:2376] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13. Re-sending same reply.
I20260709 13:13:29.398564 29456 raft_consensus.cc:2393] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 13: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:29.404402 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:29.408576 29529 raft_consensus.cc:1275] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:13:29.412645 29523 raft_consensus.cc:1275] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:13:29.399284  1647 consensus_queue.cc:1048] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:13:29.414108 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:13:29.414660 30122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.415557 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:29.416203 29454 raft_consensus.cc:2376] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17. Re-sending same reply.
W20260709 13:13:29.416265 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 85739.9us
I20260709 13:13:29.417073 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:29.417764 29495 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:29.418195 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:29.418785 29454 raft_consensus.cc:2376] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15. Re-sending same reply.
I20260709 13:13:29.419646 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:29.396780 29455 consensus_queue.cc:260] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:29.421624 29455 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:29.419238 29495 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:13:29.428812  1673 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:13:29.429776 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:29.430464 29454 raft_consensus.cc:2376] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10. Re-sending same reply.
I20260709 13:13:29.431748 29454 raft_consensus.cc:1240] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:29.433869  1278 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.434465  1278 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:29.435822  1713 raft_consensus.cc:2749] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:29.389444  1624 raft_consensus.cc:2749] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:29.432559 29454 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5"
dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:45798
I20260709 13:13:29.458683  1699 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:13:29.462213 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.461887 29495 leader_election.cc:304] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:29.464046  1697 raft_consensus.cc:2749] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:13:29.465008 29530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 1854) took 1360 ms. Trace:
I20260709 13:13:29.465626 29530 rpcz_store.cc:276] 0709 13:13:28.104562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:28.117503 (+ 12941us) service_pool.cc:224] Handling call
0709 13:13:28.577440 (+459937us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:28.578140 (+   700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:29.464735 (+886595us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b54003039d0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd858ad 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:29.464923 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1035992448}
I20260709 13:13:29.466459  1621 raft_consensus.cc:2749] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:13:29.469362 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:29.470125 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:29.477648  1703 log.cc:927] Time spent T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.864s	user 0.002s	sys 0.000s
I20260709 13:13:29.479714 29447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2642) took 1272 ms. Trace:
W20260709 13:13:29.481637 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 53804.5us
I20260709 13:13:29.487885 29495 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:29.480135 29447 rpcz_store.cc:276] 0709 13:13:28.207029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:28.227467 (+ 20438us) service_pool.cc:224] Handling call
0709 13:13:28.261767 (+ 34300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:28.320108 (+ 58341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:28.320156 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:28.350330 (+ 30174us) log.cc:844] Serialized 26 byte log entry
0709 13:13:28.530625 (+180295us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:28.594278 (+ 63653us) log.cc:844] Serialized 14 byte log entry
0709 13:13:28.594601 (+   323us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:28.594699 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:29.476843 (+882144us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:13:29.479325 (+  2482us) raft_consensus.cc:1685] finished
0709 13:13:29.479447 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:29.479621 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10776,"prepare.queue_time_us":67169,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":60,"raft.queue_time_us":3770,"raft.run_cpu_time_us":452,"raft.run_wall_time_us":65103,"spinlock_wait_cycles":41774848,"thread_start_us":88795,"threads_started":1,"wal-append.queue_time_us":201563}
I20260709 13:13:29.489670 29454 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:13:29.492705 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 226464us
I20260709 13:13:29.492933 29495 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:29.493296 29454 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:29.491683  1683 consensus_queue.cc:1059] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:13:29.510046 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.513542 29453 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
I20260709 13:13:29.501554 29495 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:29.515519 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:29.516925 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:29.517618 29379 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:29.519614 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:29.520781 29375 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
I20260709 13:13:29.521108 29495 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:29.522765 29455 raft_consensus.cc:1275] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:13:29.523440 29455 pending_rounds.cc:85] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 7
I20260709 13:13:29.523743 29455 pending_rounds.cc:107] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:13:29.524073 29455 raft_consensus.cc:2889] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:29.499841  1707 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:29.507290  1697 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:13:29.579695 30120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.581315 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:29.582864 29447 raft_consensus.cc:2410] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca041dab9b2f44409ed7bf4c6cf66ab2 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:13:29.512194  1621 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:29.592291 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:29.527619  1617 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.918s	user 0.013s	sys 0.002s
I20260709 13:13:29.519572  1624 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:29.525772  1714 raft_consensus.cc:3055] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:29.610924 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:29.503751  1728 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:29.614321 29455 raft_consensus.cc:2410] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ca041dab9b2f44409ed7bf4c6cf66ab2 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:13:29.615603 30119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.599099 29526 raft_consensus.cc:1240] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:29.600224 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:29.616938 29447 raft_consensus.cc:2468] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 8.
W20260709 13:13:29.596374  1734 log.cc:927] Time spent T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2: Append to log took a long time: real 0.208s	user 0.000s	sys 0.002s
I20260709 13:13:29.602732 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:13:29.596486  1617 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.993s	user 0.016s	sys 0.002s
I20260709 13:13:29.650854 29375 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:29.528153  1699 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:13:29.654412 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:29.655820 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 125087us
I20260709 13:13:29.618363 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:29.601779  1733 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:29.658136 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:29.531767  1647 consensus_queue.cc:1048] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:13:29.528050  1713 consensus_queue.cc:1059] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 13:13:29.625643  1678 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:29.609508  1714 raft_consensus.cc:740] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:29.673281 29447 raft_consensus.cc:3060] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:29.631990 29449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 1687) took 1354 ms. Trace:
I20260709 13:13:29.633548  1728 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:29.634900 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:29.691833 29378 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:29.676748 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:29.612365  1707 consensus_queue.cc:1048] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:13:29.639756 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:13:29.646301 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 58448.7us
I20260709 13:13:29.694440 29454 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:29.698627 29448 raft_consensus.cc:1240] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:29.648408  1278 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:29.700456  1278 consensus_queue.cc:1048] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:29.649533 29452 raft_consensus.cc:1240] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 12. Current term is 14. Ops: []
I20260709 13:13:29.620828  1675 consensus_queue.cc:1048] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:13:29.718276 29378 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 15.
I20260709 13:13:29.719399 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:29.720181 29376 raft_consensus.cc:3055] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:29.720495 29376 raft_consensus.cc:740] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:29.662349 29375 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 13.
I20260709 13:13:29.721400 29376 consensus_queue.cc:260] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:29.722522 29376 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:29.669052 29495 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:29.677318 29379 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
I20260709 13:13:29.634826 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:29.724586 29456 raft_consensus.cc:2393] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 12: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:29.725493 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:29.726074  1713 raft_consensus.cc:3055] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:29.726532  1713 raft_consensus.cc:740] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:29.726738 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:29.693701 29455 raft_consensus.cc:3060] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:29.691332 29449 rpcz_store.cc:276] 0709 13:13:28.277767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:28.277915 (+   148us) service_pool.cc:224] Handling call
0709 13:13:28.278298 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:29.366108 (+1087810us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:29.631634 (+265526us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400019ad4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:29.631913 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2500065664}
I20260709 13:13:29.727564  1713 consensus_queue.cc:260] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:29.728163 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:29.728950  1713 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:29.729363 29449 raft_consensus.cc:1240] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:29.729554 29450 raft_consensus.cc:1240] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:29.708282 29523 raft_consensus.cc:1240] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:29.673182  1699 consensus_queue.cc:1048] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:13:29.726657 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:29.726112 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:29.739764  1714 consensus_queue.cc:260] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:29.740967 29421 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:29.741214  1714 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:29.744686  1694 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:29.745507  1694 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:29.734596 29521 raft_consensus.cc:1275] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:13:29.756240 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 87181.9us
I20260709 13:13:29.730856 29450 raft_consensus.cc:1240] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:29.762993 29447 raft_consensus.cc:2468] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 4.
I20260709 13:13:29.842890 29449 raft_consensus.cc:1240] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 2. Current term is 4. Ops: []
I20260709 13:13:29.807431 29455 raft_consensus.cc:2468] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 9.
I20260709 13:13:29.844461 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:29.845062 29456 raft_consensus.cc:1240] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 7. Current term is 9. Ops: []
I20260709 13:13:29.845294 29455 raft_consensus.cc:2468] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 8.
I20260709 13:13:29.779218 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:29.773144 29495 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:29.841404 29450 raft_consensus.cc:1240] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:13:29.757102 29421 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:29.776629 29454 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:29.850278 29456 raft_consensus.cc:1275] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:13:29.850651 29456 pending_rounds.cc:85] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 7
I20260709 13:13:29.850912 29456 pending_rounds.cc:107] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:13:29.851358 29456 raft_consensus.cc:2889] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:29.858264 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.848417 29529 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:13:29.779006  1728 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:29.866737 29455 raft_consensus.cc:1275] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:13:29.866894 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 109877us
I20260709 13:13:29.870005 29421 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:29.872130 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:29.873150 29530 raft_consensus.cc:2410] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:13:29.880733 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 107723us
I20260709 13:13:29.888701 29344 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:29.889894 29421 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:29.892839 29451 raft_consensus.cc:3060] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:13:29.776453  1694 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:29.897328 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.898265  1694 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:29.791468  1699 consensus_queue.cc:1048] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:13:29.901265 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:29.902061 29454 raft_consensus.cc:2468] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 7.
I20260709 13:13:29.790062  1707 consensus_queue.cc:1048] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:13:29.903414 29450 raft_consensus.cc:1275] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:13:29.904811 30122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.904568 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:29.905227 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:29.904639 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:29.886889  1570 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:29.907096 29450 raft_consensus.cc:2376] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 4. Re-sending same reply.
I20260709 13:13:29.778621  1661 consensus_queue.cc:1048] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.096s
I20260709 13:13:28.600513 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:29.917809 29276 catalog_manager.cc:5697] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 7 to 8, leader changed from ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 8 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:13:29.919646 29276 catalog_manager.cc:5697] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: config changed from index 6 to 8, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129), VOTER 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130), VOTER 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131), VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132). New cstate: current_term: 13 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:29.922135 29276 catalog_manager.cc:5697] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
W20260709 13:13:29.929049  1704 log.cc:927] Time spent T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 1.187s	user 0.013s	sys 0.000s
W20260709 13:13:29.935160 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 46610.2us
I20260709 13:13:29.935927 29375 raft_consensus.cc:1275] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:13:29.936414 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:29.944216 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 271687us
W20260709 13:13:29.945380 30121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.949476 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:29.867480 29376 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 12.
I20260709 13:13:29.868745  1728 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:29.951794 30121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.955084 29376 raft_consensus.cc:1240] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 14. Current term is 15. Ops: [12.7-14.8]
I20260709 13:13:29.847780  1612 consensus_queue.cc:1059] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:13:29.849900  1278 consensus_queue.cc:1048] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:13:29.957473 29377 raft_consensus.cc:1275] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:13:29.985571 30121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:29.986517 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:29.988986  1679 raft_consensus.cc:3055] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:29.994238 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:13:29.944989  1283 consensus_meta.cc:287] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.574s	user 0.016s	sys 0.001s
I20260709 13:13:30.005329 29455 raft_consensus.cc:2376] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 4. Re-sending same reply.
I20260709 13:13:29.945159  1165 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:13:30.007735 30121 leader_election.cc:336] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 1.586s (SENT)
I20260709 13:13:30.008631 29451 raft_consensus.cc:1275] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:13:30.024073 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:29.956789 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:30.093698 29379 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
I20260709 13:13:29.931841  1741 raft_consensus.cc:2804] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:13:30.095216 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 87536.2us
I20260709 13:13:30.100430 29374 raft_consensus.cc:1240] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:13:30.100997 29373 raft_consensus.cc:1240] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
W20260709 13:13:30.052059 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 48360.4us
I20260709 13:13:30.104851  1165 raft_consensus.cc:697] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 13 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:30.113952  1165 consensus_queue.cc:237] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:29.944639  1572 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:30.109654 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:30.118557 30119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:30.122474 30121 leader_election.cc:336] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 1.709s (SENT)
W20260709 13:13:30.125952 30120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:30.129710 30121 leader_election.cc:336] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 1.773s (SENT)
I20260709 13:13:30.134548 29528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3404) took 1979 ms. Trace:
I20260709 13:13:30.136183 29456 raft_consensus.cc:2468] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 7.
I20260709 13:13:29.952657  1570 raft_consensus.cc:697] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 15 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:29.953079  1592 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:30.135051 29528 rpcz_store.cc:276] 0709 13:13:28.155185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:28.421150 (+265965us) service_pool.cc:224] Handling call
0709 13:13:28.442495 (+ 21345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:28.442968 (+   473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:28.443009 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:28.453329 (+ 10320us) log.cc:844] Serialized 26 byte log entry
0709 13:13:28.526542 (+ 73213us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:28.526676 (+   134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:28.526932 (+   256us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:29.927682 (+1400750us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:13:30.109256 (+181574us) raft_consensus.cc:1685] finished
0709 13:13:30.109279 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:30.134451 (+ 25172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":88020,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":17662,"spinlock_wait_cycles":40429440,"thread_start_us":72224,"threads_started":1,"wal-append.queue_time_us":216325}
I20260709 13:13:29.996587  1728 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:30.004702  1679 raft_consensus.cc:740] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:30.010318  1699 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:30.101600  1673 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.012032  1694 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:30.102190  1741 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.208869 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:30.138806  1283 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:30.010577  1707 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:30.062633  1621 consensus_queue.cc:1059] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.100s
I20260709 13:13:30.223831 29456 raft_consensus.cc:2376] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 9. Re-sending same reply.
I20260709 13:13:30.012434  1661 consensus_queue.cc:1048] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.161s
I20260709 13:13:30.100245  1710 consensus_queue.cc:1048] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.076s
W20260709 13:13:30.227955 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.170658  1572 raft_consensus.cc:697] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 14 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:30.233158  1707 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:30.239037 29522 raft_consensus.cc:1240] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 10. Current term is 11. Ops: []
W20260709 13:13:30.234553 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 173029us
I20260709 13:13:30.173099  1592 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:30.248278 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:30.226155  1741 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:30.249099 29456 raft_consensus.cc:2376] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 9. Re-sending same reply.
I20260709 13:13:30.250106 29495 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:30.221899  1699 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:30.254766 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:30.252827  1621 consensus_queue.cc:1048] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:13:30.225610  1694 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:30.248710  1283 raft_consensus.cc:3055] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:30.246428  1592 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:30.222805  1673 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:30.305702  1592 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:30.286916 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:30.273335 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:30.251036  1700 consensus_queue.cc:1059] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.167s
I20260709 13:13:30.308197  1700 consensus_queue.cc:1059] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:30.309103  1700 raft_consensus.cc:3055] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:30.309463  1700 raft_consensus.cc:740] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
W20260709 13:13:30.295849 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.309952  1592 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:30.310847 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.310593  1700 consensus_queue.cc:260] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:30.289072  1743 log.cc:927] Time spent T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
W20260709 13:13:30.288339  1742 log.cc:927] Time spent T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
W20260709 13:13:30.300191  1714 consensus_meta.cc:287] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.559s	user 0.009s	sys 0.003s
I20260709 13:13:30.313144 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:30.273636  1707 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:30.315925 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:30.316627 29451 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
W20260709 13:13:30.318182  1713 consensus_meta.cc:287] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.589s	user 0.010s	sys 0.002s
I20260709 13:13:30.265882  1570 consensus_queue.cc:237] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:30.302500  1749 log.cc:927] Time spent T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:13:30.269135  1624 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:30.273118  1283 raft_consensus.cc:740] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:30.299664  1728 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:30.308408  1699 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:30.297530  1661 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:30.301165  1572 consensus_queue.cc:237] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:30.322047 29451 raft_consensus.cc:1275] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:13:30.307317  1673 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:30.309913 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:30.326980 29455 raft_consensus.cc:1275] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:13:30.330574 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.320689 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:30.299257  1694 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:30.350777 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:30.330344 29381 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 15.
W20260709 13:13:30.352602 30121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.343866 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:30.340940 29530 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 12.
I20260709 13:13:30.354151 29453 raft_consensus.cc:1240] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:30.325263  1624 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:30.251194  1679 consensus_queue.cc:260] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:30.354544 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:30.370039 29530 raft_consensus.cc:2368] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 14. Current term is 15.
W20260709 13:13:30.371922 30122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.375721 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:30.377363 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:30.383936 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:30.356055  1700 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:30.356238  1624 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:30.411131 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:30.415134 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 196521us
I20260709 13:13:30.347007  1661 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:30.387725 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:30.389215 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:30.420814 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:30.421429 29455 raft_consensus.cc:2410] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 16 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:13:30.431357 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:30.437867 29456 raft_consensus.cc:1240] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 13 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:13:30.439185 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:13:30.440400 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.442222 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:30.418233  1354 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:30.447541 29525 raft_consensus.cc:2393] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 4: Already voted for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in this term.
I20260709 13:13:30.443956 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:30.423365  1679 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:30.456573 29527 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:30.444757  1165 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:13:30.476024 29276 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.000s	sys 0.024s
W20260709 13:13:30.482236 29276 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.000s	sys 0.024s
W20260709 13:13:30.497000 29493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 210980us
W20260709 13:13:30.558708 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 54680us
W20260709 13:13:30.499037  1765 log.cc:927] Time spent T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:13:30.453956  1354 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:30.554658 29493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 55954.3us
W20260709 13:13:30.501442 29419 connection.cc:256] RPC call timeout handler was delayed by -1.2930304670001078s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1505s for a response
W20260709 13:13:30.569330 29419 connection.cc:256] RPC call timeout handler was delayed by -1.289430467000102s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1509s for a response
W20260709 13:13:30.569733 29419 connection.cc:256] RPC call timeout handler was delayed by -1.2471304670000336s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15560000000000002s for a response
W20260709 13:13:30.570032 29419 connection.cc:256] RPC call timeout handler was delayed by -1.1247304670000631s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16920000000000002s for a response
W20260709 13:13:30.570374 29419 connection.cc:256] RPC call timeout handler was delayed by -1.0896304670000063s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17310000000000003s for a response
W20260709 13:13:30.570690 29419 connection.cc:256] RPC call timeout handler was delayed by -1.0626304669999627s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1761s for a response
I20260709 13:13:30.502465  1728 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:30.607321 29419 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:30.563789  1592 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:30.601732  1752 log.cc:927] Time spent T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.246s	user 0.002s	sys 0.000s
I20260709 13:13:30.498378  1165 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:30.666869 29527 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 12.
I20260709 13:13:30.671792 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:30.677973 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:13:30.668095  1755 log.cc:927] Time spent T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.280s	user 0.002s	sys 0.005s
I20260709 13:13:30.691136 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:30.693653 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:30.683283 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:30.686069 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 78879.6us
I20260709 13:13:30.682149  1728 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:30.672416  1209 consensus_queue.cc:1048] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:13:30.669523  1592 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:30.690459  1735 raft_consensus.cc:2749] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:30.705598 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:30.710937 29419 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:30.712237 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:30.688649  1729 consensus_queue.cc:1048] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
W20260709 13:13:30.710960  1756 log.cc:927] Time spent T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.256s	user 0.002s	sys 0.000s
I20260709 13:13:30.723855 29452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2650) took 2264 ms. Trace:
I20260709 13:13:30.724614  1209 consensus_queue.cc:1048] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:30.724479 29452 rpcz_store.cc:276] 0709 13:13:28.459780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:28.460058 (+   278us) service_pool.cc:224] Handling call
0709 13:13:29.649340 (+1189282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:29.705504 (+ 56164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:30.723515 (+1018011us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5400019ad0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd858ad 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:30.723736 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2702416256}
I20260709 13:13:30.726775  1209 consensus_queue.cc:1048] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:30.731509 29521 raft_consensus.cc:1275] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:13:30.731990 29521 pending_rounds.cc:85] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 7
I20260709 13:13:30.732226 29521 pending_rounds.cc:107] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:13:30.732497 29521 raft_consensus.cc:2889] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:30.736331  1766 log.cc:927] Time spent T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:13:30.707756  1761 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:30.761514 29527 raft_consensus.cc:1275] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:13:30.739248  1784 raft_consensus.cc:2749] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:30.706743  1728 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:30.717504  1661 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:30.712431  1741 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:30.805540  1612 raft_consensus.cc:493] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
W20260709 13:13:30.812086 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 101276us
I20260709 13:13:30.813275 29419 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:30.814152 29524 raft_consensus.cc:2410] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:13:30.815209  1733 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:30.816623 29419 leader_election.cc:400] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 9. Current term is 10.
I20260709 13:13:30.818182 29419 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:30.803618  1778 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:30.824383 29419 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:30.818939  1759 log.cc:927] Time spent T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.255s	user 0.000s	sys 0.005s
I20260709 13:13:30.836395  1706 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
W20260709 13:13:30.832867  1772 log.cc:927] Time spent T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:13:30.837222  1706 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:30.833352  1762 log.cc:927] Time spent T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 13:13:30.830699  1778 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:30.825560  1622 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:30.840816  1778 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:30.840515  1622 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:30.842135  1783 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:13:30.835996  1741 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:30.761150  1761 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:13:30.844117  1760 log.cc:927] Time spent T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260709 13:13:30.844682  1785 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:30.845615  1761 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:13:30.845937  1777 log.cc:927] Time spent T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:13:30.846643  1706 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:30.847338  1622 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:30.848269 29419 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:30.848388  1773 log.cc:927] Time spent T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:13:30.850404 29419 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:30.851042  1783 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:13:30.852463  1763 log.cc:927] Time spent T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 13:13:30.853021  1783 raft_consensus.cc:2749] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:13:30.862133  1354 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:30.864172 29522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3432) took 1458 ms. Trace:
I20260709 13:13:30.864594 29522 rpcz_store.cc:276] 0709 13:13:29.405532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:29.408073 (+  2541us) service_pool.cc:224] Handling call
0709 13:13:29.408520 (+   447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:30.239612 (+831092us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:30.863880 (+624268us) spinlock_profiling.cc:243] Waited 830 ms on lock 0x7b54000a3f54. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:30.864101 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1909475584}
I20260709 13:13:30.866281  1165 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:30.852638 29419 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:30.873792  1770 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:13:30.873903  1751 log.cc:927] Time spent T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.593s	user 0.003s	sys 0.000s
I20260709 13:13:30.875571 29448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 1697) took 1404 ms. Trace:
I20260709 13:13:30.876003 29448 rpcz_store.cc:276] 0709 13:13:29.471279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:29.735327 (+264048us) service_pool.cc:224] Handling call
0709 13:13:29.735687 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:29.757791 (+ 22104us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:29.757823 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:29.821432 (+ 63609us) log.cc:844] Serialized 26 byte log entry
0709 13:13:30.001894 (+180462us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:30.001940 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:30.002041 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:30.872961 (+870920us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:13:30.875166 (+  2205us) raft_consensus.cc:1685] finished
0709 13:13:30.875189 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:30.875452 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12514,"raft.queue_time_us":21279,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":72005,"spinlock_wait_cycles":52791680,"thread_start_us":129617,"threads_started":1,"wal-append.queue_time_us":364884}
I20260709 13:13:30.879668 29419 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:30.881147  1770 raft_consensus.cc:2749] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:13:30.882910 29419 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:30.884012  1770 raft_consensus.cc:2749] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:30.825752  1612 raft_consensus.cc:515] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:30.886502  1612 leader_election.cc:290] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:30.889480 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:30.890252 29455 raft_consensus.cc:2468] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 4.
I20260709 13:13:30.889941  1770 consensus_queue.cc:1059] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:30.890668  1624 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:30.891310  1165 raft_consensus.cc:3055] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:13:30.892230  1779 log.cc:927] Time spent T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:13:30.892261 29419 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:30.892783 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:30.906227 29526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3431) took 1501 ms. Trace:
I20260709 13:13:30.908998 29526 rpcz_store.cc:276] 0709 13:13:29.405242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:29.407462 (+  2220us) service_pool.cc:224] Handling call
0709 13:13:29.407821 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:29.618682 (+210861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:30.905846 (+1287164us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b54002e36d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:30.906137 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":439362432}
I20260709 13:13:30.909472 29419 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:30.912609 29419 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:30.914194 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.917399 29448 raft_consensus.cc:1240] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 14 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
W20260709 13:13:30.919271 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:30.924821 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:30.925246 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:30.925721 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.907558  1165 raft_consensus.cc:740] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:30.914938  1354 raft_consensus.cc:2749] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:30.912591  1770 raft_consensus.cc:2749] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:30.918692  1673 consensus_queue.cc:1048] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:13:30.929090  1783 raft_consensus.cc:2749] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:30.940173 29421 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:30.883203  1283 consensus_queue.cc:260] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:30.945006 29419 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:30.946892 29449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 447) took 1490 ms. Trace:
W20260709 13:13:30.950016 29346 leader_election.cc:336] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 3.231s (SENT)
I20260709 13:13:30.950234 29449 rpcz_store.cc:276] 0709 13:13:29.456196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:29.730147 (+273951us) service_pool.cc:224] Handling call
0709 13:13:29.842666 (+112519us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:29.843390 (+   724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:30.934078 (+1090688us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b5400127850. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd858ad 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:30.946801 (+ 12723us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":258140032}
I20260709 13:13:30.950789 29346 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:30.930094  1622 raft_consensus.cc:493] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:30.955313 29419 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:30.956624 29419 leader_election.cc:400] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 14. Current term is 15.
I20260709 13:13:30.956919 29419 leader_election.cc:403] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:30.961346 29453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 1699) took 1480 ms. Trace:
I20260709 13:13:30.962960 29419 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:30.961809 29453 rpcz_store.cc:276] 0709 13:13:29.481151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:29.769794 (+288643us) service_pool.cc:224] Handling call
0709 13:13:29.770213 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:30.354677 (+584464us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:30.960977 (+606300us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b5400260554. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:30.961259 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1342405888}
W20260709 13:13:30.965440 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.964445 29419 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:30.968544 29419 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:30.972990 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:30.958264  1783 raft_consensus.cc:2804] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:30.958909  1354 raft_consensus.cc:2804] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:30.960383  1784 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:13:30.963923  1770 raft_consensus.cc:2749] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 14. Current term is 15.
I20260709 13:13:30.967787  1592 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:30.968006  1570 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:30.967588  1735 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:13:30.981647 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 161695us
W20260709 13:13:30.982686 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:30.982725 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 281784us
I20260709 13:13:30.971481  1624 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:30.962633  1622 raft_consensus.cc:515] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:30.986413 30121 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:30.975554  1675 raft_consensus.cc:2749] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:30.988265 29419 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:30.975813  1783 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:30.979993  1728 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:30.988708  1592 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:31.008006  1592 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:31.013248  1592 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:31.007740 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:31.015389  1728 raft_consensus.cc:2749] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:31.016000 29419 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:31.016409  1729 raft_consensus.cc:2749] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:31.017061  1728 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:31.018534  1728 consensus_queue.cc:1048] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:31.019721  1770 consensus_queue.cc:1048] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:31.002461  1783 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:31.019246 29419 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:31.023965  1797 raft_consensus.cc:2749] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:31.025816 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:31.029064  1622 leader_election.cc:290] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:30.990335  1572 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:31.023370 29419 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:31.039083 29419 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:31.041986 29419 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:13:31.042503 30121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:31.045864 29419 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:31.053539 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:31.053792 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:31.042130  1797 raft_consensus.cc:2749] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:31.055053 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:31.041790  1735 raft_consensus.cc:2749] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:31.056389 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:31.058024 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:31.060276 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:31.061443 29450 raft_consensus.cc:2368] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 14. Current term is 15.
I20260709 13:13:31.047425  1770 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:13:31.054971  1679 consensus_meta.cc:287] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.591s	user 0.012s	sys 0.003s
I20260709 13:13:31.047736  1791 consensus_queue.cc:1059] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:13:31.092399  1791 raft_consensus.cc:3055] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:31.092854  1791 raft_consensus.cc:740] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:31.093811  1791 consensus_queue.cc:260] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:31.071967 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:31.051108  1728 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:31.052479  1354 raft_consensus.cc:697] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 12 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:31.080273  1783 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:31.059754 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:31.098905  1714 consensus_queue.cc:1059] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:13:31.111392 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 221724us
I20260709 13:13:31.113972 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:31.116935  1714 raft_consensus.cc:3055] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:31.116637  1354 consensus_queue.cc:237] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:31.117348  1714 raft_consensus.cc:740] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:31.118258  1714 consensus_queue.cc:260] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:31.145998 29346 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:31.099982  1679 consensus_queue.cc:1059] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
W20260709 13:13:31.187770 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:31.193233 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:31.196328 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:31.205973 29523 raft_consensus.cc:2393] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 14: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:31.195546 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:31.126818  1791 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:31.100039  1761 consensus_queue.cc:1059] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.085s
I20260709 13:13:31.213454  1700 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:13:31.214666  1795 log.cc:927] Time spent T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:13:31.207531 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:31.136749  1741 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:13:31.210098 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 97829.4us
I20260709 13:13:31.185705  1714 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:31.210789  1683 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.209381 29525 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:13:31.119962  1675 consensus_queue.cc:1059] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.096s
W20260709 13:13:31.216358  1801 log.cc:927] Time spent T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
W20260709 13:13:31.109514  1697 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.089s	user 0.025s	sys 0.042s
I20260709 13:13:31.206796  1623 raft_consensus.cc:2749] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:31.126113  1710 consensus_queue.cc:1059] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.115s
I20260709 13:13:31.206496  1661 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:31.353122 29495 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:31.242694  1694 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.206650  1622 consensus_queue.cc:1048] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.144s
I20260709 13:13:31.314378  1733 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:31.206584  1789 consensus_queue.cc:1048] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.162s
W20260709 13:13:31.355937  1697 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.337s	user 0.026s	sys 0.043s
W20260709 13:13:31.389882 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 204301us
I20260709 13:13:31.350415  1624 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.242980  1678 consensus_queue.cc:1048] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.117s
I20260709 13:13:31.241582  1699 consensus_queue.cc:1059] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.117s
I20260709 13:13:31.354925  1798 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.356416  1681 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.317335  1700 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:31.387889  1766 log.cc:927] Time spent T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:13:31.429503 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 240888us
W20260709 13:13:31.424649 29381 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 1603) took 1539 ms (client timeout 1798 ms). Trace:
I20260709 13:13:31.324585  1741 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:31.430148 29381 rpcz_store.cc:269] 0709 13:13:29.885047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:29.885279 (+   232us) service_pool.cc:224] Handling call
0709 13:13:31.424375 (+1539096us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b54003dd454. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:31.424562 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":834470656}
I20260709 13:13:31.394054  1627 raft_consensus.cc:2749] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:31.357475  1621 consensus_queue.cc:1048] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:13:31.414938  1209 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:31.360659  1764 consensus_queue.cc:1048] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 13:13:31.392280  1733 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:31.387745  1683 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:31.390025  1661 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:31.389734  1694 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:31.418109  1624 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:31.443094  1570 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.471082  1624 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:31.471784  1570 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:31.473517  1741 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:31.474130  1570 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:31.471820  1783 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:31.431149  1675 consensus_queue.cc:1048] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:13:31.453315  1209 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:31.470444  1683 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:31.471014 29380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1613) took 1446 ms. Trace:
I20260709 13:13:31.442744  1572 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:13:31.493831 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 105623us
I20260709 13:13:31.429836  1681 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:31.496598 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:31.461127  1627 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.424774  1798 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:31.549582 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:31.499454 29380 rpcz_store.cc:276] 0709 13:13:30.024527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:30.024759 (+   232us) service_pool.cc:224] Handling call
0709 13:13:30.025261 (+   502us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:30.099256 (+ 73995us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:30.099306 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:31.125414 (+1026108us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b2c00062108. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7a67fa11 00007f6a7a68f372 00007f6a7bdc1a01 00007f6a7bd8643a 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2
0709 13:13:31.184956 (+ 59542us) log.cc:844] Serialized 26 byte log entry
0709 13:13:31.444462 (+259506us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:31.444512 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:31.444593 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:31.470649 (+ 26056us) raft_consensus.cc:1685] finished
0709 13:13:31.470676 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:31.470920 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":35229,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":17169,"spinlock_wait_cycles":23411584,"thread_start_us":92452,"threads_started":1,"wal-append.queue_time_us":224745}
W20260709 13:13:31.574120 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 139444us
W20260709 13:13:31.582928 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:31.596761 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 132530us
I20260709 13:13:31.497037  1797 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.576267 29346 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:31.596387 30121 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.004s	sys 0.021s
W20260709 13:13:31.598294 30121 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.004s	sys 0.021s
W20260709 13:13:31.598568 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 543604us
I20260709 13:13:31.463697  1805 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:31.577405 29495 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:31.495231  1783 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.497618  1807 consensus_queue.cc:1059] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.124s
I20260709 13:13:31.542953  1741 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:31.641278  1741 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:31.623687  1624 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:31.644126  1624 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:31.647002  1624 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:31.574429  1627 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:31.647984  1661 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:31.649324  1627 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:31.629449 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 53308.6us
I20260709 13:13:31.518263  1622 consensus_queue.cc:1048] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 13:13:31.636355  1675 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:31.655906  1283 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:31.657063 29456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 1700) took 1345 ms. Trace:
I20260709 13:13:31.657152  1798 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:31.657629 29456 rpcz_store.cc:276] 0709 13:13:30.312089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:30.318057 (+  5968us) service_pool.cc:224] Handling call
0709 13:13:30.318429 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:30.438425 (+119996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:31.656769 (+1218344us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b5400262354. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:31.656990 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":274017024}
I20260709 13:13:31.601583  1797 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:31.660161  1807 raft_consensus.cc:3055] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:31.660600  1807 raft_consensus.cc:740] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:31.661556  1797 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:31.599289  1764 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:31.662356  1764 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:31.597661 29344 leader_election.cc:304] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:13:31.664573 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 67018.6us
I20260709 13:13:31.664776  1764 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:31.666134  1661 raft_consensus.cc:2804] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:31.666603  1661 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:31.667052  1661 raft_consensus.cc:3060] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:31.667274  1789 raft_consensus.cc:2749] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:31.670615  1681 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:31.671380  1700 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:31.672654  1733 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:31.675168  1209 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:31.543668  1572 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:13:31.632038 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 54683.1us
I20260709 13:13:31.640565 29521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3459) took 1209 ms. Trace:
I20260709 13:13:31.661439  1807 consensus_queue.cc:260] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:31.678404  1572 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:31.679137  1807 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:31.631827  1805 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:31.686277 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:31.666802 29344 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:31.683223 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:31.695547 29448 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:31.687047 29449 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:13:31.698047 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:31.698714 29449 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
I20260709 13:13:31.699090 29346 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:31.678092 29521 rpcz_store.cc:276] 0709 13:13:30.431259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:30.733718 (+302459us) service_pool.cc:224] Handling call
0709 13:13:30.734266 (+   548us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:31.095090 (+360824us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:13:31.099905 (+  4815us) log.cc:844] Serialized 14 byte log entry
0709 13:13:31.390873 (+290968us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:31.391947 (+  1074us) log.cc:844] Serialized 52 byte log entry
0709 13:13:31.392295 (+   348us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:31.406011 (+ 13716us) log.cc:844] Serialized 14 byte log entry
0709 13:13:31.406281 (+   270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:31.406368 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:31.640258 (+233890us) raft_consensus.cc:1685] finished
0709 13:13:31.640283 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:31.640454 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":468778,"prepare.queue_time_us":12654,"prepare.run_cpu_time_us":129,"prepare.run_wall_time_us":2969,"raft.queue_time_us":385816,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":6667,"thread_start_us":290561,"threads_started":1,"wal-append.queue_time_us":363724}
I20260709 13:13:31.720737 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:31.721608 29449 raft_consensus.cc:2393] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 12: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:31.723775 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:31.724078 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:31.726822 29346 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:31.730458 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:31.724998 29450 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
W20260709 13:13:31.730665 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 92939.1us
I20260709 13:13:31.701872  1700 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.732198 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:31.707739  1675 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:31.702908  1811 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.650604  1783 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:31.701872  1624 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:31.740572 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:31.741734 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:31.708609  1764 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:31.738135 29449 raft_consensus.cc:2393] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 17: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:31.719988  1679 raft_consensus.cc:2749] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:31.744357  1820 consensus_queue.cc:1048] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:13:31.744845 29525 raft_consensus.cc:1240] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:31.744992  1700 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:31.719606  1627 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:13:31.746608  1814 log.cc:927] Time spent T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:13:31.747399  1824 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:31.748869  1805 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:31.750133 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:31.742388  1675 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:31.753623  1621 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:31.709074  1776 consensus_queue.cc:1048] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:13:31.731657  1789 consensus_queue.cc:1059] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:13:31.763331 29448 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:13:31.769727 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:31.770659 30121 leader_election.cc:336] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 1.934s (SENT)
I20260709 13:13:31.821892 29525 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 13.
W20260709 13:13:31.822188 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 51597.6us
I20260709 13:13:31.772423 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:31.777830 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:31.774545 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:31.758203  1710 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:31.781751 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:31.809158 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:31.742430  1741 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:31.820225 29529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53428 (request call id 755) took 1246 ms. Trace:
I20260709 13:13:31.820281 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:31.837497 29529 rpcz_store.cc:276] 0709 13:13:30.573401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:30.759427 (+186026us) service_pool.cc:224] Handling call
0709 13:13:30.856392 (+ 96965us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:30.856593 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:30.856620 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:30.856664 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:30.856697 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:30.856761 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:31.816063 (+959302us) spinlock_profiling.cc:243] Waited 96.5 ms on lock 0x7b54001013d0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd858ad 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:31.820085 (+  4022us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":222049152}
I20260709 13:13:31.821053 29527 raft_consensus.cc:1217] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Deduplicated request from leader. Original: 12.7->[13.8-13.8]   Dedup: 13.8->[]
I20260709 13:13:31.840015 29527 raft_consensus.cc:1240] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:13:31.823585 29450 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
W20260709 13:13:31.803082  1815 log.cc:927] Time spent T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:13:31.778463 29530 raft_consensus.cc:2410] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:13:31.837503 30158 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
I20260709 13:13:31.838186 29528 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 10.
I20260709 13:13:31.805788  1675 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:31.800091  1729 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:31.847209 29525 raft_consensus.cc:3055] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:31.850612 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:31.852082 29525 raft_consensus.cc:740] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:31.776437  1764 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:31.777148  1624 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:31.812719  1813 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:31.862268 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:31.863549 29450 raft_consensus.cc:2393] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 11: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:31.866523  1761 raft_consensus.cc:3055] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:31.779729  1627 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:31.867056  1761 raft_consensus.cc:740] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:31.837793  1823 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:31.867874  1823 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:31.868090  1761 consensus_queue.cc:260] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:31.869236  1627 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:31.869390  1761 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:31.870265  1823 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:31.870792  1661 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:13:31.872095  1825 log.cc:927] Time spent T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:13:31.873356  1661 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:31.767953  1811 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:31.862819  1729 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:31.877048  1811 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:31.803082  1824 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:31.878557  1729 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:31.879483  1824 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:31.879735 29525 consensus_queue.cc:260] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:31.880251  1821 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:31.880973 29525 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:31.880837  1821 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:31.882809 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:31.884630 30121 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:31.886269  1791 consensus_meta.cc:287] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.639s	user 0.012s	sys 0.001s
I20260709 13:13:31.890082 29523 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 13.
W20260709 13:13:31.852599  1714 consensus_meta.cc:287] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.527s	user 0.014s	sys 0.000s
I20260709 13:13:31.847522  1694 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:31.823698  1679 consensus_queue.cc:1048] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:13:31.821967  1621 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:31.911054 29525 raft_consensus.cc:1275] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:13:31.916476 29525 pending_rounds.cc:85] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 7
I20260709 13:13:31.918272  1624 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:31.919353 29525 pending_rounds.cc:107] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:13:31.921720 29525 raft_consensus.cc:2889] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:31.883186  1821 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:31.946957 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:31.950179 29454 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
I20260709 13:13:31.846678  1710 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:31.963897 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 179803us
I20260709 13:13:31.977936 29346 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:31.988160  1729 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:31.993965  1623 raft_consensus.cc:3055] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:32.001027 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:32.001518 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
W20260709 13:13:32.024536 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 46694.5us
I20260709 13:13:32.031932 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:32.032440 29346 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:32.040714 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 178724us
I20260709 13:13:31.982766  1700 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:32.044876 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:32.017675  1783 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:32.030725  1278 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:13:32.028801  1623 raft_consensus.cc:740] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:32.056653 29346 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:32.058032 29346 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:32.054585 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:32.058941 29450 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
I20260709 13:13:32.043625  1706 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:32.060896 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:32.062651 29450 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
I20260709 13:13:32.066890 29346 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:32.067807 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:32.072238 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:32.074272  1828 log.cc:927] Time spent T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:13:32.072690  1776 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:13:32.075831 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:32.076324  1710 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:32.076860  1764 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:32.080986 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:32.071699 29346 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:32.060380  1806 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:32.092239  1602 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:32.091785  1623 consensus_queue.cc:260] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:32.075868  1621 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:32.093860 29346 leader_election.cc:400] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 14. Current term is 15.
I20260709 13:13:32.063405  1278 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:32.102701 29346 leader_election.cc:403] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:13:32.104421 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:32.105214 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:32.106006 29452 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 10.
I20260709 13:13:32.106153 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:32.106923 29450 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:13:32.111541  1165 consensus_queue.cc:260] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:32.112807  1165 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:32.113977  1675 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:32.118206  1810 log.cc:927] Time spent T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.388s	user 0.000s	sys 0.001s
I20260709 13:13:32.122210  1706 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:13:32.122888  1767 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:13:32.124191 29447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 480) took 1021 ms. Trace:
I20260709 13:13:32.124605 29447 rpcz_store.cc:276] 0709 13:13:31.102764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:31.102896 (+   132us) service_pool.cc:224] Handling call
0709 13:13:31.103237 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:31.242908 (+139671us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:31.242960 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:31.243560 (+   600us) log.cc:844] Serialized 26 byte log entry
0709 13:13:31.488584 (+245024us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:31.488669 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:31.488790 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:32.117793 (+629003us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b24001c9628. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78b1f9c4 00007f6a78b1dacb 00007f6a78cd8dc9 00007f6a78cd8a55 00007f6a78cd809d 00007f6a7b90a10e 00007f6a7b92188c 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221
0709 13:13:32.123805 (+  6012us) raft_consensus.cc:1685] finished
0709 13:13:32.123829 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:32.124119 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":135473,"raft.queue_time_us":111908,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":76403,"spinlock_wait_cycles":24574848,"thread_start_us":130206,"threads_started":1,"wal-append.queue_time_us":301583}
I20260709 13:13:32.133837 29455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 478) took 1031 ms. Trace:
I20260709 13:13:32.140374  1790 raft_consensus.cc:3055] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:32.140929  1790 raft_consensus.cc:740] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:32.141782  1790 consensus_queue.cc:260] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:32.143678  1790 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:32.147753 29453 raft_consensus.cc:1275] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:13:32.148257 29453 pending_rounds.cc:85] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 7
I20260709 13:13:32.148509 29453 pending_rounds.cc:107] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:13:32.148746 29453 raft_consensus.cc:2889] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:32.150429 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 56728.2us
I20260709 13:13:32.153611 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:32.134430 29455 rpcz_store.cc:276] 0709 13:13:31.102189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:31.102313 (+   124us) service_pool.cc:224] Handling call
0709 13:13:31.102722 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:31.354020 (+251298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:31.354048 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:31.672957 (+318909us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b2c0005b3b8. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7a67fa11 00007f6a7a68f372 00007f6a7bdc1a01 00007f6a7bd8643a 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2
0709 13:13:31.673403 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:13:31.775664 (+102261us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:32.015771 (+240107us) log.cc:844] Serialized 14 byte log entry
0709 13:13:32.016099 (+   328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:32.133508 (+117409us) spinlock_profiling.cc:243] Waited 8.49 ms on lock 0x7b54002530d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:32.133563 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:32.133621 (+    58us) raft_consensus.cc:1685] finished
0709 13:13:32.133633 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:32.133771 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":303034,"prepare.queue_time_us":113292,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":65,"raft.queue_time_us":246453,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":37198,"spinlock_wait_cycles":25754240,"thread_start_us":290816,"threads_started":2,"wal-append.queue_time_us":173804}
I20260709 13:13:32.156585 29344 leader_election.cc:304] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:32.156754 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:32.157650 29375 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
I20260709 13:13:32.158949 29419 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:32.160552 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:32.162776 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:32.163038 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:32.164117 29375 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:13:32.167873 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:32.168591 29448 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:13:32.168854 29381 raft_consensus.cc:1275] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:13:32.169660 29344 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:32.171425 29419 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:32.172380 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:32.173050 29380 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:32.173907 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:32.174599 29378 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:13:32.177006 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:32.177012 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:32.178238 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:32.178244 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:32.178928 29455 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
I20260709 13:13:32.179272 29381 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:32.180968 29447 raft_consensus.cc:2393] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 15: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:32.181583 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:32.182233 29455 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:13:32.182724 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:32.183739 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:32.158133  1440 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.185794 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:32.190848 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:32.175951  1677 raft_consensus.cc:2749] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:32.191241 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:32.176318  1798 raft_consensus.cc:2749] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:32.179100  1778 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:32.172751  1706 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 14. Current term is 15.
I20260709 13:13:32.197656 29379 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
I20260709 13:13:32.214143 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:32.215022 29372 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:13:32.196714 29376 raft_consensus.cc:2410] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:13:32.176478  1728 consensus_queue.cc:1059] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:13:32.223227 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:32.224326 29374 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
I20260709 13:13:32.225922 29495 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:32.227439 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:32.192320  1165 raft_consensus.cc:2804] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:32.231426 29375 raft_consensus.cc:1240] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 14. Current term is 15. Ops: [12.7-14.8]
I20260709 13:13:32.238646 29381 raft_consensus.cc:2410] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:13:32.242332 29495 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:32.235518  1621 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:32.248710  1621 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:32.249164  1621 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:32.251984 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:32.253229 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:32.253688  1283 raft_consensus.cc:2804] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:32.254140  1283 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:32.254489  1283 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:32.193740  1440 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:32.224002  1675 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:32.262980 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:32.274645 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 88574.8us
I20260709 13:13:32.275483 29372 raft_consensus.cc:2410] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:13:32.265326 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:32.266405 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:32.276475 29376 raft_consensus.cc:2410] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:13:32.273587 29380 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:13:32.271126 29493 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:13:32.268694 29495 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:32.277390 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:32.281992 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:32.279907 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:32.267549 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:32.283006 29381 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 15.
I20260709 13:13:32.284801 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:32.286446 29380 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:13:32.290892 29419 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:32.292462 29277 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37586 (request call id 137) took 16160 ms (client timeout 15000 ms). Trace:
I20260709 13:13:32.294260  1798 raft_consensus.cc:3055] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:32.294636  1806 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:32.294754  1798 raft_consensus.cc:740] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:32.295364  1806 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:32.295904  1798 consensus_queue.cc:260] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:32.297185  1798 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:32.298470  1806 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:32.221664  1757 consensus_queue.cc:1059] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:13:32.232020  1165 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:32.303891 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:32.240643  1735 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:32.308699 29376 raft_consensus.cc:2376] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 15. Re-sending same reply.
I20260709 13:13:32.311064 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:32.303282 29495 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:32.268332  1623 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:32.291671  1728 consensus_queue.cc:1048] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:13:32.317726  1842 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:32.318378  1842 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:32.311066  1700 raft_consensus.cc:2804] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:32.322646  1700 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:13:32.292953 29277 rpcz_store.cc:269] 0709 13:13:16.131991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:16.133560 (+  1569us) service_pool.cc:224] Handling call
0709 13:13:16.413467 (+279907us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b5400422054. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcf0090 00007f6a7bd8ef3a 00007f6a81b451cc 00007f6a81c4337e 00007f6a801042a4 00007f6a80104232 00007f6a80104161 00007f6a801040dc 00007f6a80103392 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:32.292348 (+15878881us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:27.274907 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:27.371985 (+ 97078us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:27.372047 (+    62us) write_op.cc:435] Acquired schema lock
0709 13:13:27.372071 (+    24us) tablet.cc:662] Decoding operations
0709 13:13:27.373886 (+  1815us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:27.374012 (+   126us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:27.374056 (+    44us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:13:27.389398 (+ 15342us) tablet.cc:701] Row locks acquired
0709 13:13:27.389456 (+    58us) write_op.cc:260] PREPARE: finished
0709 13:13:27.389701 (+   245us) write_op.cc:270] Start()
0709 13:13:27.389929 (+   228us) write_op.cc:276] Timestamp: P: 1783602807389610 usec, L: 0
0709 13:13:27.389960 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:13:27.391025 (+  1065us) log.cc:844] Serialized 5686 byte log entry
0709 13:13:27.431914 (+ 40889us) op_driver.cc:464] REPLICATION: finished
0709 13:13:27.439325 (+  7411us) write_op.cc:301] APPLY: starting
0709 13:13:27.439452 (+   127us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:27.655444 (+215992us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:27.662972 (+  7528us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:28.178700 (+515728us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:28.178989 (+   289us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0709 13:13:28.179042 (+    53us) write_op.cc:312] APPLY: finished
0709 13:13:28.179403 (+   361us) log.cc:844] Serialized 128 byte log entry
0709 13:13:28.205087 (+ 25684us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:28.205471 (+   384us) write_op.cc:454] Released schema lock
0709 13:13:28.205538 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:28.206239 (+   701us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:28.206267 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":205282,"reported_tablets":49,"spinlock_wait_cycles":240560512,"child_traces":[["op",{"apply.queue_time_us":7056,"apply.run_cpu_time_us":26732,"apply.run_wall_time_us":766903,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62535,"num_ops":14,"prepare.queue_time_us":110173,"prepare.run_cpu_time_us":12895,"prepare.run_wall_time_us":137106,"raft.queue_time_us":12658,"raft.run_cpu_time_us":1565,"raft.run_wall_time_us":7514,"replication_time_us":41727,"thread_start_us":103958,"threads_started":4,"wal-append.queue_time_us":24602,"wal-append.run_cpu_time_us":4594,"wal-append.run_wall_time_us":1764973}]]}
I20260709 13:13:32.323067  1700 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:32.274075  1764 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:32.322981 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:32.323936  1764 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:32.301281  1767 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.350421  1767 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:32.352986  1767 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:32.354839 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:32.357007  1741 raft_consensus.cc:493] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:32.357635  1741 raft_consensus.cc:515] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:32.347144 29529 raft_consensus.cc:1240] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:32.362170  1741 leader_election.cc:290] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:32.332862  1283 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:32.365348  1283 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:32.333822 29530 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37958 (request call id 1886) took 1982 ms (client timeout 2423 ms). Trace:
I20260709 13:13:32.334233  1624 raft_consensus.cc:2804] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:32.366271  1624 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:13:32.366227 29530 rpcz_store.cc:269] 0709 13:13:30.351190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:30.377088 (+ 25898us) service_pool.cc:224] Handling call
0709 13:13:32.333542 (+1956454us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54001018d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:32.333713 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3219686144}
I20260709 13:13:32.366910  1624 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:32.368283 29379 raft_consensus.cc:1240] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:32.370167 29372 raft_consensus.cc:1240] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:32.308844  1165 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:32.372964  1697 raft_consensus.cc:3055] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:32.373193 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:32.373443  1697 raft_consensus.cc:740] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:32.374430 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:32.375418 29379 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 13.
I20260709 13:13:32.319003  1735 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:32.377854  1735 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:32.377431 29376 consensus_queue.cc:237] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:32.380450  1741 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.347290 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:13:32.381047  1741 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:32.400300 29374 raft_consensus.cc:1240] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:32.306486  1844 raft_consensus.cc:2804] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:32.362843  1682 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.349752 29453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2731) took 1292 ms. Trace:
W20260709 13:13:32.383991 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 57541.7us
I20260709 13:13:32.309280  1710 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:32.404125 29495 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:32.326872  1706 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.389575 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:32.412175 29379 raft_consensus.cc:1275] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:13:32.387928 29276 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35182 (request call id 71) took 6243 ms. Trace:
I20260709 13:13:32.413282 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:32.411037 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:32.414454 29381 raft_consensus.cc:2393] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 13: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
W20260709 13:13:32.390406  1840 log.cc:927] Time spent T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.080s	user 0.001s	sys 0.001s
I20260709 13:13:32.331152  1592 raft_consensus.cc:3055] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:32.410987 29453 rpcz_store.cc:276] 0709 13:13:31.057522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:31.060950 (+  3428us) service_pool.cc:224] Handling call
0709 13:13:31.061272 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:32.149170 (+1087898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:32.349475 (+200305us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54001c1e54. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:32.349656 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2497793280}
W20260709 13:13:32.397886 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:32.415632 29495 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:32.436924 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:32.410540 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:32.443113 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:32.443305 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:32.441087 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:32.441103 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:32.441728 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:32.413177 29276 rpcz_store.cc:276] 0709 13:13:26.144920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:26.145109 (+   189us) service_pool.cc:224] Handling call
0709 13:13:32.387859 (+6242750us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:30.709325 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:30.740239 (+ 30914us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:30.740282 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:13:30.740304 (+    22us) tablet.cc:662] Decoding operations
0709 13:13:30.740958 (+   654us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:30.741033 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:30.741063 (+    30us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:13:30.741442 (+   379us) tablet.cc:701] Row locks acquired
0709 13:13:30.741459 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:13:30.741641 (+   182us) write_op.cc:270] Start()
0709 13:13:30.741763 (+   122us) write_op.cc:276] Timestamp: P: 1783602810741579 usec, L: 0
0709 13:13:30.741786 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:13:30.809470 (+ 67684us) log.cc:844] Serialized 1434 byte log entry
0709 13:13:31.466520 (+657050us) op_driver.cc:464] REPLICATION: finished
0709 13:13:31.744247 (+277727us) write_op.cc:301] APPLY: starting
0709 13:13:31.744376 (+   129us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:31.811916 (+ 67540us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:31.812028 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:31.813917 (+  1889us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:31.814110 (+   193us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:13:31.814166 (+    56us) write_op.cc:312] APPLY: finished
0709 13:13:31.814429 (+   263us) log.cc:844] Serialized 40 byte log entry
0709 13:13:31.827978 (+ 13549us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:31.842312 (+ 14334us) write_op.cc:454] Released schema lock
0709 13:13:31.853246 (+ 10934us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:31.902987 (+ 49741us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:31.905454 (+  2467us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1878544,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":266269,"apply.run_cpu_time_us":7504,"apply.run_wall_time_us":152497,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16643,"num_ops":3,"prepare.queue_time_us":768015,"prepare.run_cpu_time_us":22693,"prepare.run_wall_time_us":272096,"raft.queue_time_us":348756,"raft.run_cpu_time_us":19240,"raft.run_wall_time_us":195132,"replication_time_us":703438,"thread_start_us":933189,"threads_started":4,"wal-append.queue_time_us":186079}]]}
I20260709 13:13:32.405296  1844 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:32.445240 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:32.446519 29381 raft_consensus.cc:1240] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:32.408073  1572 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:32.454422 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:32.430606  1767 raft_consensus.cc:2804] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:32.455626 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:32.381616  1621 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:32.443192  1783 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.430034  1710 raft_consensus.cc:697] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:32.431800  1592 raft_consensus.cc:740] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:32.409438  1682 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:32.462463 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:32.476684 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:32.460088 29448 raft_consensus.cc:1240] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:32.479350 29448 raft_consensus.cc:1240] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:32.466922 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:32.467098 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:32.468403 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:32.461606 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:32.470355 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 54861.8us
I20260709 13:13:32.374495  1697 consensus_queue.cc:260] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:32.430650  1706 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:32.450289  1844 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:32.464380  1767 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:32.490289 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:32.503283 29530 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
W20260709 13:13:32.504643 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:32.508392 29374 raft_consensus.cc:1275] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:13:32.510165 29381 raft_consensus.cc:1275] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:13:32.484716  1757 raft_consensus.cc:2804] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:32.495922 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:32.483621 29495 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:32.516814 29495 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:32.501832 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:32.517910 29379 raft_consensus.cc:2468] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 10.
I20260709 13:13:32.515407 29344 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:32.487566  1440 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:32.488857  1842 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:32.527845  1706 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:32.529229 29377 raft_consensus.cc:1275] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:13:32.524523 29421 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:32.460688  1572 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:32.508551  1767 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:32.520599  1697 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:32.520922  1757 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:32.529338  1820 raft_consensus.cc:2804] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:32.541939 29421 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:32.474069  1783 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:32.539661 29451 raft_consensus.cc:1240] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:32.529266  1647 raft_consensus.cc:2804] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:32.555342  1647 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:32.556107  1647 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:32.562330 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:32.518777 30119 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:32.531378  1283 raft_consensus.cc:2749] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:13:32.572366 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 53912.5us
I20260709 13:13:32.572960 29421 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:32.539148  1728 consensus_queue.cc:1059] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 16.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:13:32.541844  1845 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:32.553287  1820 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:32.551731  1757 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:32.578999 30119 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:32.560375  1764 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:32.596021  1842 consensus_queue.cc:1048] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:32.597903  1845 raft_consensus.cc:2749] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:32.580984  1770 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:32.599207  1770 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:32.599661  1770 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:32.600184  1783 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:32.606169  1794 raft_consensus.cc:2749] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:32.609448  1354 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:32.610226  1354 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:13:32.612042  1843 log.cc:927] Time spent T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:13:32.613627  1354 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:32.624094 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:32.625713  1572 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:32.626601 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:32.589383  1820 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:32.590847 29421 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:32.641480  1572 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:32.630100  1700 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:32.646445  1741 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:32.642908 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 52137.8us
I20260709 13:13:32.582398  1818 raft_consensus.cc:2804] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:32.647756  1818 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:32.648332  1818 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:32.648660 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:32.649400 29451 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 14.
W20260709 13:13:32.652115  1833 log.cc:927] Time spent T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2: Append to log took a long time: real 0.592s	user 0.003s	sys 0.003s
I20260709 13:13:32.546465  1710 consensus_queue.cc:237] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:32.653577  1844 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:32.676566  1682 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:32.677985  1621 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:32.683055 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:13:32.561329  1592 consensus_queue.cc:260] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:32.694777  1592 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:32.698208 29521 raft_consensus.cc:1240] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:32.695990 29421 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:13:32.728147 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 211431us
I20260709 13:13:32.729931 29495 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:32.762563 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:32.761358 29495 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:32.768822  1764 raft_consensus.cc:2804] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:32.769574  1764 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:32.770125  1764 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:32.773530 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 174183us
W20260709 13:13:32.720023  1840 log.cc:927] Time spent T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.222s	user 0.004s	sys 0.000s
I20260709 13:13:32.709544  1700 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:32.724426  1354 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:32.724937  1821 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:32.766609  1682 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.794597 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
W20260709 13:13:32.853528 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:32.807394  1790 consensus_meta.cc:287] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.663s	user 0.014s	sys 0.000s
I20260709 13:13:32.786549  1623 consensus_queue.cc:1048] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
W20260709 13:13:32.906497 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 327590us
I20260709 13:13:32.921828 29378 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
I20260709 13:13:32.931821  1846 consensus_queue.cc:1059] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:13:32.851850  1843 log.cc:927] Time spent T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:13:32.942512  1798 consensus_meta.cc:287] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.645s	user 0.012s	sys 0.003s
I20260709 13:13:32.943532 29455 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 14.
I20260709 13:13:32.944816  1798 consensus_queue.cc:1048] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:32.850852  1700 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:32.907203  1354 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:32.819145  1624 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:32.957016 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:32.831285  1821 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:32.963625  1354 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:32.966512  1354 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:32.967752  1844 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:32.968457  1844 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:32.968641  1624 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:32.969031  1844 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:32.971174  1844 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:13:32.976125  1165 consensus_meta.cc:287] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.604s	user 0.013s	sys 0.000s
I20260709 13:13:32.976975  1821 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:32.976660  1165 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:32.980674  1165 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:32.835600  1682 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:32.994557  1764 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:33.002820 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:32.820618  1770 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:32.954582  1700 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:33.028028  1354 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:33.058817 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 217526us
I20260709 13:13:33.034361  1700 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:33.104000 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 385208us
W20260709 13:13:33.106252 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 344966us
I20260709 13:13:33.105147 29421 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:33.117811 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:33.107924 29495 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:33.092724  1733 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.005s	sys 0.032s
I20260709 13:13:33.119719 29530 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
I20260709 13:13:33.129133 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:33.094775  1697 consensus_meta.cc:287] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.548s	user 0.007s	sys 0.005s
I20260709 13:13:33.134115 29525 raft_consensus.cc:1240] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 10. Current term is 11. Ops: []
W20260709 13:13:33.109671  1810 log.cc:927] Time spent T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:13:33.139349 29529 raft_consensus.cc:2410] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:13:33.141831 29495 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:33.146903 29525 raft_consensus.cc:1240] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 13. Current term is 14. Ops: []
W20260709 13:13:33.131776  1733 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.006s	sys 0.032s
I20260709 13:13:33.122150  1842 raft_consensus.cc:2804] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:33.158766 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:33.130864  1783 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.154049 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:33.154313 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:33.161567 29524 raft_consensus.cc:1275] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:13:33.161927 29524 pending_rounds.cc:85] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 7
I20260709 13:13:33.162153 29524 pending_rounds.cc:107] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:13:33.162441 29524 raft_consensus.cc:2889] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:33.155051 29525 raft_consensus.cc:1275] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:13:33.155081 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:33.164197 29525 pending_rounds.cc:85] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 8
I20260709 13:13:33.156577 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:33.165675 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:33.165773 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:33.091374  1354 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:33.168416 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:33.164532 29525 pending_rounds.cc:107] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:13:33.214781 29525 raft_consensus.cc:2889] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:33.171343 29529 raft_consensus.cc:1275] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:13:33.172092 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:33.151278  1865 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:33.218894 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:33.147292  1868 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:33.225500 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:33.227214 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:33.227684 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:33.159164  1842 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:33.170022  1697 raft_consensus.cc:2804] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:33.233733 29530 raft_consensus.cc:2393] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 15: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:33.229561 29346 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:33.240113 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:33.158128  1572 consensus_queue.cc:1059] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
W20260709 13:13:33.245313 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 308166us
I20260709 13:13:33.251524 29346 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:33.226493  1861 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.230592  1868 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:33.261930 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:33.242449  1842 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:33.170337  1783 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:33.262686 29344 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:33.236549  1165 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.270519 29346 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:33.242156  1697 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:33.282125  1278 raft_consensus.cc:2804] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:33.287200 29346 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:33.255787  1789 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:33.292928 29346 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:33.269320  1868 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:33.232842  1865 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:33.278613  1622 raft_consensus.cc:2749] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:33.282258  1592 consensus_queue.cc:1059] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:13:33.273054  1682 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:33.281011  1857 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.280798  1764 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:33.283245  1816 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:33.288262  1697 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:33.286134  1278 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:33.268898  1861 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:33.300526  1602 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:33.293918  1855 log.cc:927] Time spent T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260709 13:13:33.304176  1806 raft_consensus.cc:2749] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:13:33.294421  1862 log.cc:927] Time spent T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:13:33.321182 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:33.324745 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:33.294240  1770 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:33.282905  1714 consensus_queue.cc:1059] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:13:33.333644 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:33.301715  1878 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:33.291201  1853 log.cc:927] Time spent T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
I20260709 13:13:33.339243 29346 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:33.285800  1165 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:33.344851 29526 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:13:33.341562  1278 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:33.376643 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:33.378681 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:33.379421 29455 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:33.350435  1818 consensus_meta.cc:287] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent flushing consensus metadata: real 0.702s	user 0.012s	sys 0.003s
W20260709 13:13:33.351486  1864 log.cc:927] Time spent T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:13:33.383570 29346 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:33.396234 29346 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:33.396446 29419 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:33.401525 29419 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:33.406744 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:33.409816  1884 log.cc:927] Time spent T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:13:33.412424  1877 log.cc:927] Time spent T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:13:33.382248  1683 raft_consensus.cc:2749] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:13:33.329764  1857 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:33.417995 29346 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:33.401396 29495 connection.cc:256] RPC call timeout handler was delayed by -1.1528142669999397s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21309999999999998s for a response
I20260709 13:13:33.397217  1818 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:13:33.414120  1820 consensus_meta.cc:287] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.778s	user 0.007s	sys 0.005s
I20260709 13:13:33.425513  1805 raft_consensus.cc:3055] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:33.425683 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:13:33.413031  1767 consensus_meta.cc:287] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.852s	user 0.014s	sys 0.000s
I20260709 13:13:33.445071 29453 raft_consensus.cc:2393] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 14: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:33.427294  1865 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:33.434412 29419 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:33.442176 29455 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:33.443012 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:33.432698  1683 raft_consensus.cc:2749] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:13:33.447535  1881 log.cc:927] Time spent T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:13:33.448465 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:33.481604 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:33.482331 29449 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
I20260709 13:13:33.448711  1783 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:33.450196 29495 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:33.488374 29495 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:33.372146  1878 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:33.454550 29452 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:33.456576 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:33.457103 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:33.459193 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:33.459581 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:33.494303 29376 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:33.494371 29380 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:33.495158 29495 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:33.497418 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:33.498364 29495 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:33.498906 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:33.461231  1853 log.cc:927] Time spent T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:13:33.462827 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:33.454248  1354 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:33.464838 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:33.467864  1887 consensus_queue.cc:1048] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:33.461514 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:33.469754  1818 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 11 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:33.470265 29419 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:33.517505 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 47332us
I20260709 13:13:33.518658 29419 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:33.470889  1733 raft_consensus.cc:2749] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:33.472357  1714 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:33.473048 29448 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:33.474635  1857 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:33.474927 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 43541.5us
I20260709 13:13:33.456365  1767 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:33.476945  1861 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:33.478610 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:33.478571 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:33.415248  1770 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:33.416539  1875 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:33.462613 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:33.496121 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:33.453249  1866 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:33.508888 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:33.451829  1805 raft_consensus.cc:740] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:33.433061  1859 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:33.595472  1866 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:33.595822  1859 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:33.598127  1859 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:33.514938 29375 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
I20260709 13:13:33.451597  1869 raft_consensus.cc:2749] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:33.462409  1873 raft_consensus.cc:2764] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:13:33.599241 29455 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:33.599355 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:33.600165 29375 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11.
I20260709 13:13:33.516499 29373 raft_consensus.cc:2393] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 16: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:33.452497  1728 consensus_queue.cc:1048] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 13:13:33.523967 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:33.522501 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:33.535732  1867 consensus_queue.cc:1048] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:13:33.602833 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:33.603468 29373 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:33.506548  1694 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:33.510422  1854 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:33.478214  1865 consensus_queue.cc:1048] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:13:33.510593  1710 raft_consensus.cc:2749] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:33.555233 29452 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
I20260709 13:13:33.560207 29451 raft_consensus.cc:1240] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 13. Current term is 14. Ops: []
W20260709 13:13:33.510026  1757 consensus_meta.cc:287] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.833s	user 0.012s	sys 0.003s
I20260709 13:13:33.569702 29344 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:33.619683 29493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 87372.2us
W20260709 13:13:33.620110 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 50528.2us
I20260709 13:13:33.577273 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:33.584288  1697 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:33.626673 29455 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:13:33.577235 29450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2739) took 1129 ms. Trace:
I20260709 13:13:33.583153 29456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2750) took 1080 ms. Trace:
I20260709 13:13:33.585330 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:33.586177 29421 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:33.586712 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:33.629253 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:33.578505  1714 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:33.589809  1647 consensus_meta.cc:287] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 1.033s	user 0.013s	sys 0.003s
I20260709 13:13:33.646051  1647 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:33.647883 29447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2740) took 1197 ms. Trace:
I20260709 13:13:33.649291  1647 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:33.648384 29447 rpcz_store.cc:276] 0709 13:13:32.450360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:32.450489 (+   129us) service_pool.cc:224] Handling call
0709 13:13:32.450904 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:32.452542 (+  1638us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:32.452591 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:32.979456 (+526865us) spinlock_profiling.cc:243] Waited 33.6 ms on lock 0x7b2c0005b3b8. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7a67fa11 00007f6a7a68f372 00007f6a7bdc1a01 00007f6a7bd8643a 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2
0709 13:13:32.979986 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 13:13:33.137461 (+157475us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:33.234425 (+ 96964us) log.cc:844] Serialized 14 byte log entry
0709 13:13:33.236669 (+  2244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:33.236772 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:33.424388 (+187616us) spinlock_profiling.cc:243] Waited 3.84 ms on lock 0x7b1800034900. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c993f3 00007f6a78c9b7c1 00007f6a78c9b779 00007f6a78c9b709 00007f6a78c9b6d1 00007f6a78c9a9cd 000000000038f354 000000000038f199 00007f6a78c7c83a
0709 13:13:33.643196 (+218808us) spinlock_profiling.cc:243] Waited 5.43 ms on lock 0x7b1800034900. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c993f3 00007f6a78c9b7c1 00007f6a78c9b779 00007f6a78c9b709 00007f6a78c9b6d1 00007f6a78c9a9cd 000000000038f354 000000000038f199 00007f6a78c7c83a
0709 13:13:33.647634 (+  4438us) raft_consensus.cc:1685] finished
0709 13:13:33.647655 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:33.647818 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45349,"prepare.queue_time_us":103881,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":25487,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":6723,"spinlock_wait_cycles":98490624,"thread_start_us":155869,"threads_started":1,"wal-append.queue_time_us":278346}
I20260709 13:13:33.593782  1767 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:33.647940 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:33.656235 29529 raft_consensus.cc:1240] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:33.656430 29380 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 12.
I20260709 13:13:33.583135  1857 consensus_queue.cc:1048] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:13:33.598317 29378 raft_consensus.cc:2393] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 13: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:33.525049  1354 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:33.603228 29374 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 17.
I20260709 13:13:33.607147 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:13:33.607810 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 109532us
I20260709 13:13:33.603636 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:33.665342 29495 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:33.665638 29379 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11.
I20260709 13:13:33.666198  1283 raft_consensus.cc:2749] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:13:33.667390 29495 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:33.668298  1647 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:33.669220 29375 raft_consensus.cc:1240] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:33.607853 29524 raft_consensus.cc:2368] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 13. Current term is 14.
I20260709 13:13:33.672649 30121 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:33.673215  1805 consensus_queue.cc:260] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:33.674242  1675 raft_consensus.cc:3055] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:33.674706  1675 raft_consensus.cc:740] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:33.623764  1783 consensus_queue.cc:1048] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:13:33.675664  1675 consensus_queue.cc:260] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:33.676541  1878 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:33.677024  1675 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:13:33.659430  1886 log.cc:927] Time spent T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.084s	user 0.000s	sys 0.003s
I20260709 13:13:33.679461 29524 raft_consensus.cc:1240] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:13:33.680461  1735 raft_consensus.cc:3055] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:33.680874  1735 raft_consensus.cc:740] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
W20260709 13:13:33.681150  1700 consensus_meta.cc:287] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.571s	user 0.016s	sys 0.000s
I20260709 13:13:33.681586  1700 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:33.681789  1735 consensus_queue.cc:260] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:33.682889  1735 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:33.684264  1874 consensus_queue.cc:1059] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:33.685030 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:33.685273 30156 consensus_queue.cc:237] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:33.623441  1757 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:33.658735  1859 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:33.688335 29521 raft_consensus.cc:1240] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:33.610999 29449 raft_consensus.cc:1275] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:13:33.613879 29376 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:33.585170  1861 raft_consensus.cc:2749] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:33.586931  1621 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:33.699402  1621 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:33.699904  1621 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:33.700357  1697 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:33.700637  1714 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:33.674925  1805 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:33.455245  1820 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:33.705528  1820 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:33.626832 29522 raft_consensus.cc:1240] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:33.507205 30155 raft_consensus.cc:1240] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:33.627329 29450 rpcz_store.cc:276] 0709 13:13:32.447978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:32.448082 (+   104us) service_pool.cc:224] Handling call
0709 13:13:32.448509 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:32.448900 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:13:32.469696 (+ 20796us) log.cc:844] Serialized 14 byte log entry
0709 13:13:33.223983 (+754287us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:33.260485 (+ 36502us) log.cc:844] Serialized 26 byte log entry
0709 13:13:33.260679 (+   194us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:33.263438 (+  2759us) log.cc:844] Serialized 14 byte log entry
0709 13:13:33.267549 (+  4111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:33.267727 (+   178us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:33.577009 (+309282us) raft_consensus.cc:1685] finished
0709 13:13:33.577031 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:33.577169 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45820,"prepare.queue_time_us":26976,"prepare.run_cpu_time_us":217,"prepare.run_wall_time_us":6632,"raft.queue_time_us":309375,"raft.run_cpu_time_us":492,"raft.run_wall_time_us":18767,"thread_start_us":671230,"threads_started":2,"wal-append.queue_time_us":464058}
I20260709 13:13:33.708453  1818 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:13:33.710189  1806 consensus_queue.cc:1059] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:13:33.630708 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 44696.5us
I20260709 13:13:33.711390  1806 raft_consensus.cc:3055] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:33.711804  1806 raft_consensus.cc:740] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:33.712675  1806 consensus_queue.cc:260] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:33.713476 29421 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:33.714262  1700 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:33.714856  1806 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:33.716192  1798 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:33.716637  1798 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:33.717031  1798 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:33.627420 29456 rpcz_store.cc:276] 0709 13:13:32.502426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:32.502569 (+   143us) service_pool.cc:224] Handling call
0709 13:13:32.520089 (+ 17520us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:32.817305 (+297216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:32.817336 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:32.981005 (+163669us) spinlock_profiling.cc:243] Waited 3.47 ms on lock 0x7b2c0005b3b8. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7a67fa11 00007f6a7a68f372 00007f6a7bdc1a01 00007f6a7bd8643a 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2
0709 13:13:32.981411 (+   406us) log.cc:844] Serialized 26 byte log entry
0709 13:13:33.112451 (+131040us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:33.289585 (+177134us) log.cc:844] Serialized 14 byte log entry
0709 13:13:33.295898 (+  6313us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:33.295995 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:33.577991 (+281996us) raft_consensus.cc:1685] finished
0709 13:13:33.582927 (+  4936us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:33.583081 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47520,"prepare.queue_time_us":35113,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":40,"raft.queue_time_us":81519,"raft.run_cpu_time_us":405,"raft.run_wall_time_us":30936,"spinlock_wait_cycles":7982976,"thread_start_us":553068,"threads_started":3,"wal-append.queue_time_us":253402}
I20260709 13:13:33.598127  1866 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:33.729045  1165 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:33.754073  1845 raft_consensus.cc:3055] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:33.754693  1845 raft_consensus.cc:740] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:33.755702 29527 raft_consensus.cc:1240] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:33.755770  1845 consensus_queue.cc:260] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:33.757334  1845 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:33.757802 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:33.766949 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:33.767930 29522 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:33.714687 29421 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:13:33.584050 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 65487.8us
I20260709 13:13:33.635874  1710 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:33.629805  1679 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:33.642398  1868 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:33.594810 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:33.657558 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:33.648310 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:33.613574  1854 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:33.689851 29495 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:33.784722 29372 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 10.
I20260709 13:13:33.674890  1842 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:33.698434  1757 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:33.703361  1794 raft_consensus.cc:3055] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:33.781435 29373 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
I20260709 13:13:33.784792 29381 raft_consensus.cc:2368] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 15. Current term is 16.
I20260709 13:13:33.735936  1278 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:33.787302 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 97541us
I20260709 13:13:33.808812 29525 raft_consensus.cc:1240] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:33.809239 29419 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:33.810014 29495 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:33.812103 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:33.813047 29374 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 15.
W20260709 13:13:33.786696 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 72122.5us
I20260709 13:13:33.816418 29495 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:33.816660 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:33.817610 29374 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 17.
W20260709 13:13:33.791666 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:33.818760 29421 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:33.825729 29453 raft_consensus.cc:1240] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 10. Current term is 11. Ops: []
W20260709 13:13:33.829634 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:33.789403  1854 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:33.830437 29495 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:33.861641 29495 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:33.832160  1697 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:33.806867  1790 consensus_queue.cc:1059] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:13:33.814052  1820 consensus_queue.cc:1059] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:13:33.886691  1278 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:33.792637  1794 raft_consensus.cc:740] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:13:33.877148 29495 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:33.890568  1895 raft_consensus.cc:2804] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:33.891211  1895 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:33.891721  1895 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:33.806417  1621 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:33.896318 29495 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:33.897758  1621 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:33.888667  1794 consensus_queue.cc:260] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:33.899848  1794 raft_consensus.cc:3060] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:33.901127 29495 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:33.839278  1572 raft_consensus.cc:2804] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:33.839468 29421 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:13:33.903890 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 64528.1us
I20260709 13:13:33.828855  1706 consensus_queue.cc:1059] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
W20260709 13:13:33.840579 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 57980.7us
I20260709 13:13:33.841101  1165 raft_consensus.cc:2749] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:33.793176  1865 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:33.849470  1842 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:33.789949  1764 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:33.850721 29279 catalog_manager.cc:5697] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 8 to 9, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 9 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:33.784173  1679 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:33.852313 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:33.858353 29522 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:13:33.786803  1710 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:33.830780  1757 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:13:33.948693 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 47673.6us
W20260709 13:13:33.957715 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 49966.4us
I20260709 13:13:33.959849 29495 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:13:33.957952 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 51627.9us
I20260709 13:13:33.908252  1354 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.904222  1741 raft_consensus.cc:2804] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:33.900254  1798 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:33.907330  1572 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:33.976317 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 68645.2us
I20260709 13:13:33.947127  1866 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:33.910529  1735 raft_consensus.cc:2804] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:33.977618 29495 leader_election.cc:304] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:33.946033  1867 raft_consensus.cc:2764] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 13:13:33.962711  1621 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:33.977360 29279 catalog_manager.cc:5697] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 11 to 12, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 12 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:33.985091 29421 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:33.985091 29495 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:33.957362  1679 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:33.958413  1757 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:33.976575  1898 log.cc:927] Time spent T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2: Append to log took a long time: real 0.160s	user 0.001s	sys 0.001s
I20260709 13:13:33.997331 29344 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:33.974506  1865 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:33.977743  1624 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:13:33.978871  1873 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:34.028721 29372 raft_consensus.cc:1275] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:13:34.029923 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:33.998664  1682 raft_consensus.cc:3055] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:34.004926 29421 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:33.984858  1572 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:33.981812  1866 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:33.978801  1741 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:34.007887  1790 consensus_queue.cc:1059] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:13:33.982048  1842 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:33.999997  1857 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:34.033248  1621 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:34.007689  1757 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:33.993948  1891 raft_consensus.cc:2749] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:33.981316  1677 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:34.008965  1887 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:33.983722  1735 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:33.982200  1728 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:34.034787 29524 raft_consensus.cc:1240] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:34.037617 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:34.007112 29495 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:34.093922 29455 raft_consensus.cc:2393] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in current term 11: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:34.034641 29279 catalog_manager.cc:5697] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 14 to 15, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 15 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:34.055130 29454 raft_consensus.cc:1275] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:13:34.055413 29450 raft_consensus.cc:1240] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:34.057086 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:34.095851 29447 raft_consensus.cc:2393] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 12: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
W20260709 13:13:34.094255 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 87223us
I20260709 13:13:34.057833 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:34.096784  1700 raft_consensus.cc:2804] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:34.058773 29449 raft_consensus.cc:1240] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:34.096858  1677 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.097442  1700 raft_consensus.cc:697] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
W20260709 13:13:34.061659 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 56860.7us
I20260709 13:13:34.098819 29421 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:34.099779 29421 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:34.099668  1728 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.101069 29421 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:33.981133  1354 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.102027  1728 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:34.102648  1728 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:34.104161  1354 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:34.104535  1897 log.cc:927] Time spent T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:13:34.104666  1798 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:34.104033 29279 catalog_manager.cc:5697] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 9 to 12, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 12 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:34.104876  1354 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:34.105369  1354 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:34.093819  1805 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:34.105878  1354 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:34.106140  1805 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.105751 29279 catalog_manager.cc:5697] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 10 to 13, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 13 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:34.093394  1887 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.058725  1278 raft_consensus.cc:2804] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:34.015409  1783 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:34.062944 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:34.108453 29521 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:34.108222  1783 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:34.108862  1805 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:34.110913  1783 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:34.036484  1873 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.111341 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:34.033108  1865 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.118590 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:34.080677  1875 raft_consensus.cc:3055] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:34.128377 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:34.038928  1818 consensus_queue.cc:1048] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
W20260709 13:13:34.082309 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 73355us
I20260709 13:13:34.035378  1682 raft_consensus.cc:740] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:34.037905  1844 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:34.075067  1866 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:34.094807 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:34.159163 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:34.057660 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:34.107595  1887 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:34.160283 29453 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:13:34.098034  1735 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:34.098477  1700 consensus_queue.cc:237] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.017272  1710 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:34.038200 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:34.184511  1679 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.112459 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:34.187079 29449 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:34.077023  1741 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:34.086285  1842 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.115943 29521 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
I20260709 13:13:34.205744 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:34.206876 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 60820.5us
I20260709 13:13:34.116874 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:34.114101  1878 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:13:34.120211 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:34.122907 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:34.124102 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:34.124394 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:34.125563 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:34.216763 29528 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 16.
I20260709 13:13:34.121682 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:34.118914 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:34.219841 29450 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:34.024281  1868 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:34.146135 29454 raft_consensus.cc:1240] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:34.222762 29419 leader_election.cc:400] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 13. Current term is 14.
I20260709 13:13:34.223130 29419 leader_election.cc:403] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:13:34.086937  1621 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.103363  1728 raft_consensus.cc:697] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 14 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:34.105394  1798 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:34.159186 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:34.169970 29279 catalog_manager.cc:5697] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:34.095355  1857 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.127751  1875 raft_consensus.cc:740] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:34.147801  1278 raft_consensus.cc:697] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:34.167430  1817 consensus_queue.cc:1048] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:13:34.182536  1735 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.114761 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:13:34.197321 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 44703.9us
I20260709 13:13:34.200485 29453 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:13:34.252455 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:34.253103 29453 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:34.207813 29495 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:34.152794  1859 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.227038 29530 raft_consensus.cc:1240] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:13:34.233099 29449 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:34.258261 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:34.159552  1683 raft_consensus.cc:3055] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:34.236972 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:34.261090 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:34.261963 29449 raft_consensus.cc:2393] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 13: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
W20260709 13:13:34.245154 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 144159us
I20260709 13:13:34.245616  1798 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.198108  1697 raft_consensus.cc:2749] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:34.262745 29421 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:34.273883 29421 leader_election.cc:400] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 15. Current term is 16.
I20260709 13:13:34.274209 29421 leader_election.cc:403] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:34.274777  1899 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:34.275205  1899 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:34.275564  1899 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:34.282392  1873 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:34.282609  1861 raft_consensus.cc:2749] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 15. Current term is 16.
I20260709 13:13:34.286262  1899 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.288858  1857 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:34.267189  1798 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:34.222826  1790 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:34.295207 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 87493.8us
I20260709 13:13:34.296252 29279 catalog_manager.cc:5697] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:34.296969 29495 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:34.234640  1621 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:34.264767 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:34.300074 29447 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:34.293840 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 138591us
I20260709 13:13:34.303654 29453 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:34.304379 29450 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
I20260709 13:13:34.242136  1845 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:34.166309  1844 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.307715 29495 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:34.305958  1867 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:13:34.258994  1733 raft_consensus.cc:2749] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 13. Current term is 14.
I20260709 13:13:34.283296  1861 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:34.261164  1683 raft_consensus.cc:740] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:34.326548 29495 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:34.335980 29495 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:34.333618 29451 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
I20260709 13:13:34.390980  1694 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:34.391579  1694 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:34.392009  1694 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:34.396306  1624 consensus_queue.cc:1048] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:34.398073  1278 consensus_queue.cc:237] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.317282  1697 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:34.423509  1844 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:34.298336  1682 consensus_queue.cc:260] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.424949  1865 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:34.425856  1682 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:34.425654  1694 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.324144  1572 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.428041  1694 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:34.429518  1572 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:34.269912  1859 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.327456  1728 consensus_queue.cc:237] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.433796  1859 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:34.436905  1806 raft_consensus.cc:3055] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:34.437374  1806 raft_consensus.cc:740] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:34.438263  1806 consensus_queue.cc:260] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.440728  1842 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:34.441847  1735 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:34.333494  1891 consensus_queue.cc:1059] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.109s
I20260709 13:13:34.442952  1891 raft_consensus.cc:3055] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:34.443315  1891 raft_consensus.cc:740] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:34.444242  1891 consensus_queue.cc:260] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.445456  1891 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:34.400009  1895 consensus_meta.cc:287] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.508s	user 0.013s	sys 0.000s
I20260709 13:13:34.446547  1895 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.320546  1845 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.462227  1845 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:34.465452  1899 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:34.469554 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 136637us
I20260709 13:13:34.396389  1867 raft_consensus.cc:2804] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:34.480055  1867 raft_consensus.cc:697] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:34.481114  1867 consensus_queue.cc:237] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.316028  1875 consensus_queue.cc:260] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.448086 29529 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 12.
I20260709 13:13:34.306007  1790 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.486392  1790 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:34.434800  1683 consensus_queue.cc:260] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.488350  1683 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:34.493515 29346 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:34.483419  1875 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:34.498062  1805 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:34.498870  1805 consensus_queue.cc:1059] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:34.403362  1861 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.500741  1805 raft_consensus.cc:3055] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:34.501216  1805 raft_consensus.cc:740] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:34.502096  1805 consensus_queue.cc:260] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:34.508599 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 172733us
I20260709 13:13:34.522948 29495 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:34.419027 29279 catalog_manager.cc:5697] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 8 to 9, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 9 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:34.317085  1764 raft_consensus.cc:2749] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:13:34.544490 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:34.537516  1868 consensus_queue.cc:1059] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:13:34.573212  1757 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.520382  1806 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:34.540271  1893 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:34.581221  1893 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.584213 29525 raft_consensus.cc:1240] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:13:34.585525 29447 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:34.589147 29279 catalog_manager.cc:5697] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 6 to 7, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 7 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:34.471021  1741 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.539223  1845 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:34.598282 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 52574.7us
W20260709 13:13:34.616925 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 94095.1us
I20260709 13:13:34.617415 29279 catalog_manager.cc:5697] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 10 to 11, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 11 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:34.624380  1694 raft_consensus.cc:3055] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:34.634791  1694 raft_consensus.cc:740] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:34.635944  1694 consensus_queue.cc:260] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.637485  1694 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:34.629961  1624 raft_consensus.cc:2804] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:34.640446  1624 raft_consensus.cc:697] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:34.641503  1624 consensus_queue.cc:237] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.620416 29495 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:34.586786  1757 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:34.645926  1887 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.616837  1845 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.690214 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:34.609184  1790 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.583617  1866 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.693761  1715 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.699992  1715 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.701434  1866 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:34.702129  1715 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:34.655954  1844 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.702798  1844 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.704941  1844 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:34.656584 29527 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11.
I20260709 13:13:34.655933 29279 catalog_manager.cc:5697] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 8 to 12, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 12 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:34.707263 29279 catalog_manager.cc:5697] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 5 to 8, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 8 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:34.709921 29279 catalog_manager.cc:5697] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 8 to 12, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 12 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:34.710536  1621 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.540587  1735 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:34.711732  1861 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:34.634187  1854 consensus_meta.cc:287] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.723s	user 0.011s	sys 0.003s
I20260709 13:13:34.711807  1735 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:34.712620  1854 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.662792 29495 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:34.644887  1798 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.684876 29379 raft_consensus.cc:1240] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:13:34.720568 29526 raft_consensus.cc:2393] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 12: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:34.685796 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:34.720504 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:34.721191 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 58556.1us
I20260709 13:13:34.690914 29374 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:34.694756 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:34.702225 29521 raft_consensus.cc:1240] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:13:34.584219  1805 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:34.687043 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:34.727932 29373 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 13.
I20260709 13:13:34.728300 29377 raft_consensus.cc:2393] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 12: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:34.719215 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:34.729015 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:34.729416 29375 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11.
I20260709 13:13:34.729673 29379 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 13.
I20260709 13:13:34.719574 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:34.730449 29381 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 13.
I20260709 13:13:34.731356 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:34.732153 29453 raft_consensus.cc:2393] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 12: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:34.721288 29376 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11.
I20260709 13:13:34.733062 29455 raft_consensus.cc:2368] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 17. Current term is 18.
I20260709 13:13:34.722337 29495 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:34.649217  1741 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:34.742595 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:34.744131 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:34.744755 29379 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:34.676539  1893 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:34.599884  1354 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.724330 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:34.763944 29378 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:34.753118 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:34.764802 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:34.753337 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:34.766043 29377 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
W20260709 13:13:34.766837 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:34.757103 29419 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:34.757885 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:34.757984 29379 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 12.
I20260709 13:13:34.695783  1710 raft_consensus.cc:2804] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:34.717760 29279 catalog_manager.cc:5697] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 9 to 10, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 10 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
W20260709 13:13:34.767427 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:34.818183 29450 raft_consensus.cc:1240] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:34.770202 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:34.773696 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:34.821823 29454 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
W20260709 13:13:34.822160 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 65158.5us
I20260709 13:13:34.823159 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:34.823783 29419 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:34.773629 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:34.824744 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:34.825793 29377 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:34.770603 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:34.829859 29452 raft_consensus.cc:2368] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 11. Current term is 12.
I20260709 13:13:34.813714 29378 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 13.
I20260709 13:13:34.830837 29419 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:34.732913  1757 raft_consensus.cc:2804] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:34.840354 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:34.722553  1790 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.847671  1735 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:34.849611  1790 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:34.833992 29279 catalog_manager.cc:5697] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 11 to 12, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 12 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:34.852519 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:34.852646  1845 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:34.839001  1893 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:13:34.853551 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:34.854638  1854 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:34.856365  1798 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:34.857132  1895 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:34.857291  1602 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.857892  1602 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:34.858896  1354 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:34.860037  1901 consensus_queue.cc:1059] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:34.861002  1901 raft_consensus.cc:3055] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:34.861526  1901 raft_consensus.cc:740] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:34.862424  1901 consensus_queue.cc:260] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:34.864511  1697 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:34.865144  1818 raft_consensus.cc:2955] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 8 to 10, VOTER 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:13:34.866377  1679 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:34.867872 29376 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:34.846103  1861 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:34.872239  1602 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:13:34.883091 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:34.884371 29373 raft_consensus.cc:1240] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:13:34.886273  1868 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.889995 29375 raft_consensus.cc:1275] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:13:34.786535  1741 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:34.787092  1867 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:34.893149  1866 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:34.893626  1757 raft_consensus.cc:697] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:34.894608 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:34.895265  1895 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.896394  1901 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:34.896759 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:34.903043 29527 raft_consensus.cc:1240] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 LEADER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:34.906062 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:34.906867 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:34.908550  1887 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:34.838332  1710 raft_consensus.cc:697] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:34.827617  1621 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:34.913057  1677 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:34.931174  1861 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:34.915426 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:34.918025 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:34.921092 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:34.870904 29374 raft_consensus.cc:2468] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11.
I20260709 13:13:34.935878 29344 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:34.955104 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:35.003777 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:35.003356 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:35.005716 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:35.006381 29525 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:34.954537 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:35.006160 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:35.003906 29381 raft_consensus.cc:1240] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:35.007915 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:34.955310 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:34.982805 29421 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:34.960227 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:34.962069 29455 raft_consensus.cc:2955] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 8 to 10, VOTER 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
W20260709 13:13:35.011364 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 75588us
I20260709 13:13:35.012148 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:34.990677 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:35.012179 29530 raft_consensus.cc:2393] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 12: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:34.989090 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:34.993839 29377 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 18.
I20260709 13:13:34.990707 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:35.014434 29527 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:13:34.913313 29376 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:35.001767 29529 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:13:35.014305 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:35.006096 29378 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:13:34.986935 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:35.017266 29450 raft_consensus.cc:2393] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 14: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:34.968300 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:35.019649 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:35.009860 30157 raft_consensus.cc:2468] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 5.
I20260709 13:13:35.027001 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:35.009924 29421 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:35.032226 29421 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:35.033749 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:35.035779 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:35.035892 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:35.037060 29522 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:13:35.037354 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:35.042022 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:34.987597  1741 raft_consensus.cc:697] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:35.043578 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:35.048274 29377 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
I20260709 13:13:35.050076 29526 raft_consensus.cc:2393] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 14: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:34.989033  1783 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:35.051599 29524 raft_consensus.cc:2393] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 13: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:35.051424 29344 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:35.052476 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:34.965283  1875 consensus_queue.cc:1059] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 13:13:35.053427 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:35.011309  1887 raft_consensus.cc:2764] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:13:35.054641 29373 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
I20260709 13:13:34.938936  1868 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:35.021700  1677 raft_consensus.cc:2804] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:13:35.041638  1682 consensus_meta.cc:287] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.615s	user 0.012s	sys 0.000s
I20260709 13:13:35.063009 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:35.000180 30155 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:13:35.065732 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:35.089296 29530 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:35.066653 29419 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:13:35.059386 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:34.987181  1867 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:35.091874 29377 raft_consensus.cc:2368] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 11. Current term is 12.
I20260709 13:13:35.092839 29377 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:13:35.093475 29377 raft_consensus.cc:606] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:35.094249 29377 raft_consensus.cc:614] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:34.985422  1866 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:35.072474 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:35.072554 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:34.984637  1895 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:35.043403  1354 raft_consensus.cc:2804] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:35.084990 29449 raft_consensus.cc:2393] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 14: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:35.067934 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:35.023144  1861 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:35.096750 29375 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:35.099344 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:35.073436  1715 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:35.103299 29344 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:13:35.093988 29525 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 13.
I20260709 13:13:35.105473 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:35.106033 29525 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:35.107028 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:35.107700 29529 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:35.112949 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:35.113907 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:35.114378 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:35.114732 29455 raft_consensus.cc:2393] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 12: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:35.115123 29451 raft_consensus.cc:2368] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 12. Current term is 13.
I20260709 13:13:35.114832 29521 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
I20260709 13:13:35.095769  1873 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.118144 29526 raft_consensus.cc:2393] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 5: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:35.109117 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:35.066919  1783 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:35.098996  1887 raft_consensus.cc:2804] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:35.138684 29495 leader_election.cc:400] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 11. Current term is 12.
I20260709 13:13:35.139107 29495 leader_election.cc:403] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:13:35.139891 29495 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:35.099995  1354 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:35.099704  1677 raft_consensus.cc:697] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:35.104537  1715 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:35.123096  1714 raft_consensus.cc:2804] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:35.180657 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:35.186095 29524 raft_consensus.cc:2410] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:13:35.089380  1757 consensus_queue.cc:237] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:35.138418  1887 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Starting leader election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:35.197371  1887 raft_consensus.cc:3060] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:35.197600  1677 consensus_queue.cc:237] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:35.154775  1764 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:35.190727  1278 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:35.150225  1354 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:35.137656  1873 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:35.257403 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:35.152689  1715 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:35.234772  1791 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:35.199718  1764 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:13:35.267733 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 127928us
I20260709 13:13:35.268884 29495 leader_election.cc:400] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 17. Current term is 18.
I20260709 13:13:35.269199 29495 leader_election.cc:403] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:13:35.245874 29421 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:13:35.256552 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 160646us
I20260709 13:13:35.191390  1714 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:35.123286  1710 consensus_queue.cc:237] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:35.288371 29524 raft_consensus.cc:1240] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:35.284827 29522 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 18.
I20260709 13:13:35.263329  1624 raft_consensus.cc:493] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:35.276695  1764 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:35.294495 29525 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 18.
I20260709 13:13:35.296804 29530 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 12.
I20260709 13:13:35.285341  1714 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:35.150000  1741 consensus_queue.cc:237] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:35.285611  1866 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:35.264205  1278 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:35.277045  1791 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:35.294477  1783 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:35.297657  1624 raft_consensus.cc:515] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:13:35.309154  1805 consensus_meta.cc:287] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.574s	user 0.016s	sys 0.007s
I20260709 13:13:35.309644  1624 leader_election.cc:290] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:35.301766  1694 raft_consensus.cc:2749] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 11. Current term is 12.
I20260709 13:13:35.329224  1861 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:35.329487  1895 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:35.337303  1791 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:35.305811  1866 raft_consensus.cc:2749] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 17. Current term is 18.
I20260709 13:13:35.342965  1873 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:35.348901  1867 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:35.323386  1868 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:35.364212  1891 consensus_meta.cc:287] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.918s	user 0.016s	sys 0.007s
W20260709 13:13:35.429564 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:35.432612 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:35.438686 29346 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:35.440286 29375 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:35.446171 29378 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:13:35.300364 29529 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 16.
I20260709 13:13:35.449877 29421 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:13:35.451229 29448 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.004s	sys 0.009s
I20260709 13:13:35.456964 29524 raft_consensus.cc:1275] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:13:35.311771  1278 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:35.476191 29380 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.009s	sys 0.018s
W20260709 13:13:35.480281 29380 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.010s	sys 0.018s
I20260709 13:13:35.482060 29380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 793) took 1184 ms. Trace:
W20260709 13:13:35.484161 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 215282us
W20260709 13:13:35.478374 29448 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.004s	sys 0.010s
I20260709 13:13:35.500851 29523 raft_consensus.cc:1240] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 LEADER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:35.482724 29380 rpcz_store.cc:276] 0709 13:13:34.297352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:34.297863 (+   511us) service_pool.cc:224] Handling call
0709 13:13:34.298378 (+   515us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:34.298713 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:34.298737 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:34.919461 (+620724us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b2c00062108. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7a67fa11 00007f6a7a68f372 00007f6a7bdc1a01 00007f6a7bd8643a 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2
0709 13:13:34.920263 (+   802us) log.cc:844] Serialized 508 byte log entry
0709 13:13:35.481187 (+560924us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:35.481319 (+   132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:35.481501 (+   182us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:35.481561 (+    60us) raft_consensus.cc:1685] finished
0709 13:13:35.481575 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:35.481968 (+   393us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27796224,"thread_start_us":560124,"threads_started":1,"wal-append.queue_time_us":403097}
I20260709 13:13:35.516340  1735 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:35.516705  1857 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.517094  1735 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:35.517688  1735 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:35.518788  1900 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.519671  1900 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:35.520008  1757 consensus_queue.cc:1059] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:35.522092  1757 raft_consensus.cc:3055] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:35.522166  1844 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.522697  1757 raft_consensus.cc:740] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:35.523149  1844 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:35.526170  1798 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:13:35.526652 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 242175us
I20260709 13:13:35.529798 29421 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:35.530447  1715 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:35.532305  1875 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.533107  1875 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:35.545951 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 100717us
I20260709 13:13:35.553419 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:35.554795 30155 raft_consensus.cc:2468] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
I20260709 13:13:35.555285 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:35.556509 29529 raft_consensus.cc:2393] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 16: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:35.557729 29448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2764) took 1501 ms. Trace:
I20260709 13:13:35.558426 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:35.560195  1683 raft_consensus.cc:3055] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:35.560751  1683 raft_consensus.cc:740] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:35.561939 29495 leader_election.cc:400] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 12. Current term is 13.
I20260709 13:13:35.562474 29495 leader_election.cc:403] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:13:35.563889  1741 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 12. Current term is 13.
I20260709 13:13:35.565697  1842 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:35.529465  1783 consensus_queue.cc:1059] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:35.567291  1842 raft_consensus.cc:3055] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:35.567739  1842 raft_consensus.cc:740] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:35.569199  1842 consensus_queue.cc:260] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:35.518013  1857 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:35.584021 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:35.585009  1869 raft_consensus.cc:2764] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:13:35.585703 29526 raft_consensus.cc:2393] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 13: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:35.587345  1798 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:35.588850  1798 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:35.592126  1875 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:35.558192 29448 rpcz_store.cc:276] 0709 13:13:34.056021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:34.056747 (+   726us) service_pool.cc:224] Handling call
0709 13:13:34.057094 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:34.083215 (+ 26121us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:34.083249 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:34.083786 (+   537us) log.cc:844] Serialized 26 byte log entry
0709 13:13:34.878168 (+794382us) spinlock_profiling.cc:243] Waited 2.87 ms on lock 0x7b480012e7d8. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a80cafaa1 00007f6a80ca6b37 00007f6a80ca69ca 00007f6a80d9e26f 00007f6a80d9df37 00007f6a80db255c 00007f6a80db2508 00007f6a80db2488 00007f6a80db2443 00007f6a80db16ec 00007f6a7fcdba96
0709 13:13:34.879325 (+  1157us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b1800350260. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c7be07 00007f6a81ad6ab9 00007f6a78c9869b 00007f6a78c9693f 00007f6a78c98c02 00007f6a7b92020b 00007f6a7b925d23 00007f6a7b9260d1 00007f6a7bd41a0f
0709 13:13:35.504137 (+624812us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:35.507041 (+  2904us) log.cc:844] Serialized 14 byte log entry
0709 13:13:35.557077 (+ 50036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:35.557270 (+   193us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:35.557374 (+   104us) raft_consensus.cc:1685] finished
0709 13:13:35.557392 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:35.557599 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66777,"prepare.queue_time_us":4908,"prepare.run_cpu_time_us":717,"prepare.run_wall_time_us":15173,"raft.queue_time_us":25823,"raft.run_cpu_time_us":20162,"raft.run_wall_time_us":793104,"spinlock_wait_cycles":12376448,"thread_start_us":615922,"threads_started":1,"wal-append.queue_time_us":1260573}
I20260709 13:13:35.606238  1757 consensus_queue.cc:260] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:35.607930 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 78443.6us
I20260709 13:13:35.576736 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:35.599860  1715 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:35.611155 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 223723us
I20260709 13:13:35.624858 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:35.627113  1861 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:35.627838  1861 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:35.628444  1861 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:35.632370 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:35.633666 29527 raft_consensus.cc:2393] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 16: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:35.634019 29523 raft_consensus.cc:1275] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:13:35.636401  1900 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:35.637394 29421 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:35.639901  1869 raft_consensus.cc:2804] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:35.562563  1683 consensus_queue.cc:260] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:35.640592  1869 raft_consensus.cc:697] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 12 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:35.641837  1683 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:35.642062  1869 consensus_queue.cc:237] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:35.645448  1891 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:35.646301  1891 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:35.649768  1899 consensus_queue.cc:1059] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:35.636572 29521 raft_consensus.cc:2410] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:13:35.651244  1733 raft_consensus.cc:3055] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:35.651770  1733 raft_consensus.cc:740] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:35.653228  1733 consensus_queue.cc:260] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:35.662339  1857 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:13:35.664048 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 44090.1us
I20260709 13:13:35.611040  1844 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:35.571214  1842 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:35.676744  1733 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:35.686499  1818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:36858 (request call id 0) took 2003 ms. Trace:
W20260709 13:13:35.691012  1928 log.cc:927] Time spent T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.225s	user 0.001s	sys 0.001s
I20260709 13:13:35.698216  1697 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.699137  1697 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:35.668480  1757 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:35.638918 29421 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:35.677898 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:35.717716 29521 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:35.719246  1926 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
W20260709 13:13:35.701551 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 81285.8us
I20260709 13:13:35.719998  1926 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:35.721632 29346 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:35.722880  1926 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:35.709177  1873 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.710168  1278 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.724102  1278 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:35.726703  1278 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:35.728292  1909 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:35.685401 29419 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:35.716771 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 78041.3us
I20260709 13:13:35.733748  1873 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:35.767767 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 82513.4us
I20260709 13:13:35.777699  1899 raft_consensus.cc:2804] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:35.658910  1887 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:35.687819  1818 rpcz_store.cc:276] 0709 13:13:33.682688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:33.682887 (+   199us) service_pool.cc:224] Handling call
0709 13:13:33.716777 (+ 33890us) log.cc:844] Serialized 508 byte log entry
0709 13:13:34.272968 (+556191us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b180029aa00. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c99522 00007f6a78c9b7c1 00007f6a78c9b779 00007f6a78c9b709 00007f6a78c9b6d1 00007f6a78c9a9cd 000000000038f354 000000000038f199 00007f6a78c7c83a
0709 13:13:35.685734 (+1412766us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42568,"raft.queue_time_us":81608,"raft.run_cpu_time_us":2086,"raft.run_wall_time_us":151202,"spinlock_wait_cycles":44735360,"thread_start_us":96771,"threads_started":1,"wal-append.queue_time_us":96080,"wal-append.run_cpu_time_us":3361,"wal-append.run_wall_time_us":1208921}
I20260709 13:13:35.733731  1278 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:13:35.759835 29374 consensus_meta.cc:287] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.752s	user 0.020s	sys 0.004s
I20260709 13:13:35.805375 29374 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:13:35.802824  1887 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 election: Requested vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:35.812578 29521 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:13:35.809864  1844 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:13:35.815884 29493 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:13:35.818192  1694 raft_consensus.cc:2804] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:13:35.818588  1694 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:35.818960  1694 raft_consensus.cc:3060] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:35.821234 29346 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:35.813351  1899 raft_consensus.cc:697] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 13 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:35.830916  1278 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:35.828366  1909 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:35.844638 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:35.846139  1909 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:35.830401  1926 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.848313  1926 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:35.849856 29419 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:35.850759  1926 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:35.851195 29263 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 829dc08ee0ca4212a3b2c870b0ea1b35 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:13:35.854373  1909 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:35.854681  1887 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:35.854455 29419 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:35.837778  1278 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:35.803061  1798 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:35.866186  1715 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:13:35.866890  1932 log.cc:927] Time spent T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.081s	user 0.000s	sys 0.002s
W20260709 13:13:35.873492 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 142077us
I20260709 13:13:35.881173  1887 raft_consensus.cc:2749] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:35.875689  1891 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:35.891664  1764 consensus_meta.cc:287] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.584s	user 0.012s	sys 0.006s
I20260709 13:13:35.894798  1741 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:35.901106  1873 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:35.894899 29377 raft_consensus.cc:2955] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 8 to 10, VOTER 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
W20260709 13:13:35.903640  1354 consensus_meta.cc:287] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.627s	user 0.017s	sys 0.001s
I20260709 13:13:35.904057  1354 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:35.906577  1354 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:35.919153 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 127029us
I20260709 13:13:35.895663  1798 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:35.894423  1697 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:35.899956  1842 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:13:35.917081  1714 consensus_meta.cc:287] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.612s	user 0.014s	sys 0.009s
I20260709 13:13:35.926088 29344 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:35.930792 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:35.898572  1764 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:35.897629  1741 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:35.898092  1735 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:35.920946  1861 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:35.939193  1683 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:35.947679  1683 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:35.948158  1683 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:35.963080  1278 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:35.924230  1899 consensus_queue.cc:237] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:35.959930  1683 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:35.976919 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 77410.7us
I20260709 13:13:35.981986  1715 consensus_queue.cc:1048] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:35.983047  1697 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:35.985283  1697 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:35.987485 29419 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:13:35.987896 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 52186.1us
I20260709 13:13:35.944401  1714 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:35.987960  1697 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:35.994694  1683 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:35.988516  1798 raft_consensus.cc:2749] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:35.991564  1714 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Requested vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:36.000891  1764 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:35.981958  1741 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:36.004881  1930 log.cc:927] Time spent T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:13:36.008529 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:36.011119  1735 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:36.012919 29453 raft_consensus.cc:1275] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:13:36.016768  1861 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:36.009589 29448 raft_consensus.cc:2468] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
I20260709 13:13:36.019675 29344 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:36.019589  1694 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:36.020758  1683 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:36.021296  1683 raft_consensus.cc:697] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:36.022408  1694 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:36.022881  1683 consensus_queue.cc:237] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.023547 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:13:36.037827 30157 raft_consensus.cc:3060] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:35.962126  1842 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.025233 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:36.027238 29346 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:36.028445 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:36.030445 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:36.038884 29521 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:13:36.037710 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:36.040800 29526 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 14.
I20260709 13:13:36.039131 29523 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 14.
I20260709 13:13:36.044241 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:36.045336 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:36.041849  1901 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:36.047813 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:36.048373 29453 raft_consensus.cc:1275] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:13:36.048168  1901 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:36.049364 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:36.050935  1901 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:36.054765  1842 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:36.051772 29448 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 15.
I20260709 13:13:36.049393 29419 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:36.056702 29526 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:36.057344 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:13:36.057722  1735 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:36.058068 30156 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:36.058306  1735 raft_consensus.cc:697] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 18 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:36.059412  1735 consensus_queue.cc:237] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.064409  1869 consensus_queue.cc:1059] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:36.066465  1869 raft_consensus.cc:3055] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:36.066498 29419 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:36.068006  1798 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:36.068703  1798 raft_consensus.cc:697] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 18 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:36.069829  1798 consensus_queue.cc:237] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.067549  1869 raft_consensus.cc:740] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:36.078414 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:36.081091 29452 raft_consensus.cc:1240] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:36.088563  1805 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.088606  1714 raft_consensus.cc:2749] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:36.116071 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 88921us
W20260709 13:13:36.128158 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 64386.9us
W20260709 13:13:36.134357 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:36.139460 29421 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.574s (SENT) [suppressed 24 similar messages]
I20260709 13:13:36.139976 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:36.142203 29526 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
I20260709 13:13:36.151602 30157 raft_consensus.cc:2468] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
I20260709 13:13:36.082309  1869 consensus_queue.cc:260] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:36.163621 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:36.164463  1869 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:36.166426 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:36.167153 29378 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 15.
I20260709 13:13:36.168426 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:36.169279 29380 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 13.
I20260709 13:13:36.170111 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:36.170667 29380 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
I20260709 13:13:36.153409  1694 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.155865 29344 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:36.157347 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:36.168488 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:36.149487  1805 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.171470 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:36.175983 29378 raft_consensus.cc:1275] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:13:36.173394  1714 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:36.176342 29380 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:36.176642  1714 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:36.177062  1714 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:36.173810 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:36.172801  1694 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.178424 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:36.179096 29374 raft_consensus.cc:1813] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Handling vote request from an unknown peer 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:36.179605 29374 raft_consensus.cc:2393] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 12: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:36.180018  1694 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:36.182807 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:36.174297 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:36.172308 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:36.175392 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:36.172343 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:36.184959 29372 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:36.172878 29373 raft_consensus.cc:1240] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:36.184404 29381 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:13:36.188292 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:36.188820 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:36.173209 29344 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:36.195204 29344 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:36.163390 30156 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
I20260709 13:13:36.175541  1805 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:36.203876 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:36.205070 29373 raft_consensus.cc:2393] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 13: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:36.205181  1697 consensus_queue.cc:1048] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:36.206934  1697 consensus_queue.cc:1048] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:36.208683 29344 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:36.207964 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 72201.3us
I20260709 13:13:36.210661 29419 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:36.211048  1790 raft_consensus.cc:2804] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:36.211532  1790 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:36.211552  1798 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:36.212069  1790 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:36.212296  1798 raft_consensus.cc:697] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 16 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:36.213624  1798 consensus_queue.cc:237] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.199980  1278 raft_consensus.cc:2804] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:36.216017  1278 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:36.216423  1278 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:36.216462  1791 raft_consensus.cc:2804] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:36.203084 29495 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:36.217104  1861 consensus_queue.cc:1048] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:13:36.223824 29493 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:13:36.228364 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:36.217043  1791 raft_consensus.cc:697] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:13:36.230259 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 90863.8us
I20260709 13:13:36.227399 29495 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:36.232494 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:36.240347  1791 consensus_queue.cc:237] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:36.243649  1764 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:36.233399  1697 raft_consensus.cc:2804] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:13:36.244987  1901 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:36.254581 29527 raft_consensus.cc:2410] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:13:36.258963 29372 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 18.
I20260709 13:13:36.291309 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:36.331398 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:36.261147  1764 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:36.298533  1901 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.339143  1790 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.331585  1733 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.331636  1861 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.297276  1805 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:36.303982  1741 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:36.335106  1891 consensus_queue.cc:1059] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:13:36.368784 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:13:36.379158 29376 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
W20260709 13:13:36.304921 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:36.387965 29381 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 16.
I20260709 13:13:36.391330 29380 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
I20260709 13:13:36.392627 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:36.399372 30157 raft_consensus.cc:2393] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 12: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:36.391283  1764 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:36.304105  1697 raft_consensus.cc:697] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:36.404527 30156 raft_consensus.cc:2368] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 5. Current term is 6.
I20260709 13:13:36.424083 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:36.397522  1861 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.403549  1805 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.426894  1861 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:36.427165 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:36.428273  1805 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:36.430694 29455 raft_consensus.cc:1275] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:13:36.431568  1714 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.421934  1354 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.432673  1354 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.434022  1714 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:36.435910 29379 raft_consensus.cc:2393] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 18: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:36.437187 29449 raft_consensus.cc:1275] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:13:36.437440  1901 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:36.434818  1354 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:36.410012  1790 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:36.405296  1899 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:36.439813 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:36.444664 29453 raft_consensus.cc:2410] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:13:36.424914 29527 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:36.439071  1675 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.399977  1733 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.422003 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:36.413094 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:36.428306 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:36.450881 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:36.422696  1735 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.457366 29523 raft_consensus.cc:2393] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 15: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:36.454820 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:36.458118 29521 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:13:36.449697 29452 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
I20260709 13:13:36.444290  1694 raft_consensus.cc:3055] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:36.445936  1861 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.465229  1735 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.473275  1861 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.474228 29455 raft_consensus.cc:1275] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:13:36.476006  1861 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:36.478062  1861 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:36.478844  1861 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:36.448624  1675 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.481573  1861 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:36.482295  1675 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:36.468355  1694 raft_consensus.cc:740] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:36.495944  1697 consensus_queue.cc:237] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:13:36.499593  1948 log.cc:927] Time spent T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.058s	user 0.001s	sys 0.001s
I20260709 13:13:36.500340  1891 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.500974  1891 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.502434 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:36.503298 29523 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
I20260709 13:13:36.504102  1891 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:36.448827  1278 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:36.507711 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 105448us
I20260709 13:13:36.508682 29344 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:36.512414 29521 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 18.
I20260709 13:13:36.512708  1735 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:36.514832 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:36.516281 29455 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16.
I20260709 13:13:36.469604  1899 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:36.521745 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:36.522459 29448 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:36.524226  1869 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:36.512938  1715 raft_consensus.cc:2804] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:36.524969  1715 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:36.524897  1869 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:36.525473  1715 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:36.527542  1354 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:36.528118  1354 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.513209 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:36.515362  1733 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:36.521695  1899 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:36.530546  1733 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.522487  1278 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:36.515625 29344 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:36.531147  1733 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.532907  1278 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:36.533571  1278 raft_consensus.cc:697] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:36.532909  1694 consensus_queue.cc:260] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.536217  1694 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:36.527220  1869 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:36.493028  1861 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:36.539147  1354 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:36.540155  1861 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.542850  1861 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:36.544724  1764 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.545735 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:36.546519 29449 raft_consensus.cc:3060] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:36.553476 29452 raft_consensus.cc:1275] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:13:36.554370 29451 raft_consensus.cc:1240] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:36.554737 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:36.555666 29453 raft_consensus.cc:2410] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
W20260709 13:13:36.558779 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:36.567694  1733 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:36.571300 29495 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:36.571731  1741 consensus_queue.cc:1048] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:36.572365  1757 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:36.573139 29495 leader_election.cc:400] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 11. Current term is 12.
I20260709 13:13:36.574955 29495 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:36.547207  1764 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:36.577090 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:36.577821 29521 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:36.578449 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:36.581722 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:36.583189 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:36.558241  1278 consensus_queue.cc:237] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.594622 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:36.595510 29454 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:36.597065 29450 raft_consensus.cc:1275] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:13:36.597498 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:36.598147 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:36.598192 29456 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
I20260709 13:13:36.600508 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:36.600782 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:36.601181 29452 raft_consensus.cc:2468] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
I20260709 13:13:36.601374 29456 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:13:36.598220 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:36.602291 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:36.602602 29447 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:13:36.602865 29452 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:36.604139 29447 raft_consensus.cc:1275] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:13:36.604180 29523 raft_consensus.cc:1275] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:13:36.604596 29447 pending_rounds.cc:85] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 8
I20260709 13:13:36.604940 29447 pending_rounds.cc:107] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:13:36.605247 29447 raft_consensus.cc:2889] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:36.606694 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:36.606768  1675 consensus_queue.cc:1048] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:36.608515 29421 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:36.608848 29450 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
I20260709 13:13:36.609669 29456 raft_consensus.cc:1240] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:36.610374 29421 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:36.611738  1861 raft_consensus.cc:2804] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:36.612227  1861 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:36.612619  1861 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:36.599650 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:36.625406 29449 raft_consensus.cc:2468] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
I20260709 13:13:36.625799 29527 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:13:36.626718 29448 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 18.
I20260709 13:13:36.558066  1950 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:36.627084 29344 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:36.634452 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 59655.7us
I20260709 13:13:36.630609  1869 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:36.662796  1869 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.664237  1861 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.666280  1869 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:36.666656  1861 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:36.642004  1675 raft_consensus.cc:2804] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:13:36.646276 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:36.667423  1675 raft_consensus.cc:697] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:36.672317  1675 consensus_queue.cc:237] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.648555 29521 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:13:36.648484  1950 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.631538  1891 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:13:36.681648  1950 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:36.681707 29454 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16.
I20260709 13:13:36.640682 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:36.683003 29448 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 14.
I20260709 13:13:36.683254  1733 raft_consensus.cc:2764] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:13:36.684300 29344 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:36.685288  1909 raft_consensus.cc:2804] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:36.685870  1909 raft_consensus.cc:697] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:36.686968  1909 consensus_queue.cc:237] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.695618 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:36.696455 29448 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 14.
I20260709 13:13:36.697312 29452 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
W20260709 13:13:36.699867 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 89624.2us
I20260709 13:13:36.713338 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:36.717555 29421 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:36.738950 29421 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:36.743646 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:36.697803  1715 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.699429  1791 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:36.749729 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 52178.5us
I20260709 13:13:36.742964  1950 raft_consensus.cc:2804] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:36.761258  1891 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:36.761943 29419 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:36.761958  1891 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.763212 29419 leader_election.cc:400] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 election: Vote denied by peer ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671) with higher term. Message: Invalid argument: T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 5. Current term is 6.
I20260709 13:13:36.790077 29419 leader_election.cc:403] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:13:36.764145 29453 raft_consensus.cc:1240] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:36.765605  1891 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:36.749297  1735 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:13:36.795150  1791 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.757390  1950 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:36.773205 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:36.796550  1950 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:36.797820  1791 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:36.773495  1733 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:36.801055  1861 consensus_queue.cc:1059] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:36.802073  1861 consensus_queue.cc:1048] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:36.781709 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:36.803977 29526 raft_consensus.cc:2393] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 15: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:36.804198  1899 raft_consensus.cc:3055] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:36.782218 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:36.804474  1798 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.804621  1899 raft_consensus.cc:740] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:36.783187 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:36.783684  1697 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.805140  1798 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.805585  1899 consensus_queue.cc:260] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.805734  1697 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.806937  1899 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:36.784626  1715 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:36.808002  1697 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:36.787317  1790 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:36.808416 29522 raft_consensus.cc:1240] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:36.808746  1790 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.807529  1798 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:36.805787 29528 raft_consensus.cc:2393] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 18: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:36.810719 29521 raft_consensus.cc:1240] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:36.810971  1790 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:36.808142  1891 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:36.820052  1891 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.821943 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:36.822528 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:36.822956 29522 raft_consensus.cc:2393] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 13: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:36.823415 29530 raft_consensus.cc:2393] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 14: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:36.823642 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:36.824456 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:36.825935 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 62929.3us
I20260709 13:13:36.826016  1861 raft_consensus.cc:2749] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671) with higher term. Message: Invalid argument: T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 5. Current term is 6.
I20260709 13:13:36.826159  1891 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:36.827046 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:36.827903 29527 raft_consensus.cc:2393] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 12: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:36.828905 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:36.830351 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:36.835886 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:36.837536 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:36.838228 29523 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:36.843961 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 53877us
I20260709 13:13:36.846868 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:36.848630 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:36.849386 29527 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:13:36.854347 29526 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 12.
I20260709 13:13:36.827036 29419 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:36.856846 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:36.860066 29344 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:36.861619  1683 consensus_queue.cc:1059] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:36.862838  1733 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:36.857031  1899 raft_consensus.cc:2749] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:36.863312  1683 consensus_queue.cc:1059] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:36.864693  1683 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:36.865060  1683 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:36.865422  1683 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:36.867697  1900 raft_consensus.cc:3055] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:13:36.865262 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:36.870862 29521 raft_consensus.cc:2393] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 15: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
W20260709 13:13:36.876029 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:36.877043 29523 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
I20260709 13:13:36.878795 29344 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:36.875517  1714 raft_consensus.cc:3055] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:36.883864 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:36.883219  1714 raft_consensus.cc:740] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:36.886722  1714 consensus_queue.cc:260] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.888051  1714 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:36.894665 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:36.895550 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:36.895817 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:36.896034 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:36.896816 29521 raft_consensus.cc:1275] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:13:36.897123 29527 raft_consensus.cc:1275] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:13:36.901777 29276 catalog_manager.cc:5697] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:36.894862 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:36.903939 29276 catalog_manager.cc:5697] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 10 to 11, leader changed from ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 11 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:13:36.868162  1900 raft_consensus.cc:740] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:36.906589  1900 consensus_queue.cc:260] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.906499 29276 catalog_manager.cc:5697] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:36.897085 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:36.909771 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:36.913940  1733 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.915864  1733 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.916594 29381 raft_consensus.cc:1275] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:13:36.916998 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:36.917337  1675 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.917974  1675 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.918439  1733 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:36.910602  1790 raft_consensus.cc:2804] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:36.919013 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:36.919425  1790 raft_consensus.cc:697] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:36.919919 29381 raft_consensus.cc:2393] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 14: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:36.920167  1675 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:36.920506  1790 consensus_queue.cc:237] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.921599 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:36.921701 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:36.922313 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:36.922793 29380 raft_consensus.cc:2393] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 12: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:36.923170 29375 raft_consensus.cc:2368] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 12. Current term is 13.
I20260709 13:13:36.922320 29381 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 15.
I20260709 13:13:36.924204  1909 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.924732  1909 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.925555 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:36.925851 29379 raft_consensus.cc:1275] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:13:36.930339 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:36.932066 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:36.932096 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:36.929495 29276 catalog_manager.cc:5697] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:36.942960 30155 raft_consensus.cc:1275] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 12 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:13:36.943069 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:36.943843 29525 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 18.
I20260709 13:13:36.933589 29374 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:36.944756 29526 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:13:36.944842 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:36.944422 29276 catalog_manager.cc:5697] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:36.945557 29525 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
I20260709 13:13:36.934401 29530 raft_consensus.cc:1240] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:36.931586  1900 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:36.934391 29528 raft_consensus.cc:1275] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:13:36.948067  1791 consensus_queue.cc:1048] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:36.938107  1909 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:36.939234 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:36.940358 29380 raft_consensus.cc:1275] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:13:36.940248 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:36.940914 29524 raft_consensus.cc:1275] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:13:36.941237 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:36.941540 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:36.880664  1950 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.952122 29344 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:36.952767 29521 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 13.
I20260709 13:13:36.953233  1278 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.955507  1950 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:36.955670  1278 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.958068  1278 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:36.953474 29529 raft_consensus.cc:2393] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 13: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:36.961107  1805 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:36.961511  1805 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:36.961822  1805 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:36.964644 29375 raft_consensus.cc:1275] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:13:36.966349 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:36.966305 29344 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:36.969448 29375 raft_consensus.cc:1275] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:13:36.970801 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:36.971551  1278 raft_consensus.cc:2804] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:36.971849 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:36.971606  1805 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:36.974140  1805 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:36.972221  1278 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:36.974721  1278 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:36.978909 29381 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 18.
I20260709 13:13:36.982511 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:36.986267 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:36.986574 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:36.987380 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:36.988015 29375 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:36.988590 29380 raft_consensus.cc:2468] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
I20260709 13:13:36.991674 29276 catalog_manager.cc:5697] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:36.994506 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:36.994824 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:36.996502 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:36.997103 29524 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:36.997613 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:36.998404 29379 raft_consensus.cc:2376] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14. Re-sending same reply.
I20260709 13:13:36.992286 29376 raft_consensus.cc:1240] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:13:36.999830 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:37.000476 29374 raft_consensus.cc:2376] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11. Re-sending same reply.
I20260709 13:13:37.003717 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:37.004412 29452 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:37.006228 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:37.007651 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:37.008037 29526 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
I20260709 13:13:37.008876 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:37.009240 29419 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:37.011021 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:37.012404 29380 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:37.012867 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:37.014340 29381 raft_consensus.cc:2368] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 17. Current term is 18.
I20260709 13:13:37.014189 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:37.014467 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:37.012202 29373 raft_consensus.cc:2376] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13. Re-sending same reply.
I20260709 13:13:37.015926 29276 catalog_manager.cc:5697] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 7 to 8, leader changed from ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 8 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:13:37.016786 29379 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:13:37.018396 29495 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:37.018887 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:37.021755 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:37.022105 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:37.022795 29378 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:37.024216 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:37.024482 29495 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:37.026712 29419 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:37.033074 30157 raft_consensus.cc:1275] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:13:37.023813  1694 raft_consensus.cc:2764] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:13:37.040000  1694 consensus_queue.cc:1048] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:37.040854  1733 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:37.025372  1891 consensus_queue.cc:1048] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
W20260709 13:13:37.045810 29279 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37594 (request call id 138) took 19511 ms (client timeout 15000 ms). Trace:
I20260709 13:13:37.025426  1764 consensus_queue.cc:1048] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:13:37.049211 29524 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 19.
I20260709 13:13:37.038158 29419 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:37.055213 29419 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:37.015771  1683 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:37.025486  1861 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:37.035058  1757 raft_consensus.cc:2804] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:37.019593  1697 consensus_queue.cc:1048] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:13:37.047821  1891 consensus_queue.cc:1048] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:37.061102  1733 raft_consensus.cc:2749] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:37.068305  1899 raft_consensus.cc:2804] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:37.071970  1869 consensus_queue.cc:1048] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:13:37.070149  1798 consensus_queue.cc:1048] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
W20260709 13:13:37.046319 29279 rpcz_store.cc:269] 0709 13:13:17.534418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:17.534600 (+   182us) service_pool.cc:224] Handling call
0709 13:13:37.045552 (+19510952us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:35.681757 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:35.682716 (+   959us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:35.682782 (+    66us) write_op.cc:435] Acquired schema lock
0709 13:13:35.682826 (+    44us) tablet.cc:662] Decoding operations
0709 13:13:35.684602 (+  1776us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:35.685158 (+   556us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:35.730543 (+ 45385us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:13:35.822047 (+ 91504us) tablet.cc:701] Row locks acquired
0709 13:13:35.830119 (+  8072us) write_op.cc:260] PREPARE: finished
0709 13:13:35.844050 (+ 13931us) write_op.cc:270] Start()
0709 13:13:35.871101 (+ 27051us) write_op.cc:276] Timestamp: P: 1783602815838946 usec, L: 0
0709 13:13:35.874499 (+  3398us) op_driver.cc:348] REPLICATION: starting
0709 13:13:35.893667 (+ 19168us) log.cc:844] Serialized 6014 byte log entry
0709 13:13:36.061607 (+167940us) spinlock_profiling.cc:243] Waited 5.33 ms on lock 0x7b54004225a0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcf0090 00007f6a7bcfd6b8 00007f6a7bcfd2fa 00007f6a7bd81965 00007f6a7bd81e09 00007f6a7f7bc581 00007f6a7f7bbd58 00007f6a7f7c09f1 00007f6a7f7c09a9 00007f6a7f7c0939 00007f6a7f7c0901
0709 13:13:36.430368 (+368761us) op_driver.cc:464] REPLICATION: finished
0709 13:13:36.658717 (+228349us) write_op.cc:301] APPLY: starting
0709 13:13:36.658870 (+   153us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:36.722643 (+ 63773us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:36.722693 (+    50us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:36.836305 (+113612us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:36.836826 (+   521us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 13:13:36.836920 (+    94us) write_op.cc:312] APPLY: finished
0709 13:13:36.837565 (+   645us) log.cc:844] Serialized 138 byte log entry
0709 13:13:36.845437 (+  7872us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:36.845625 (+   188us) write_op.cc:454] Released schema lock
0709 13:13:36.845706 (+    81us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:36.905191 (+ 59485us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:36.905231 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9930,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":227912,"apply.run_cpu_time_us":23970,"apply.run_wall_time_us":211726,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66707,"num_ops":15,"prepare.queue_time_us":243256,"prepare.run_cpu_time_us":23991,"prepare.run_wall_time_us":417401,"raft.queue_time_us":302150,"raft.run_cpu_time_us":18228,"raft.run_wall_time_us":205490,"replication_time_us":553942,"spinlock_wait_cycles":12251392,"thread_start_us":594649,"threads_started":4,"wal-append.queue_time_us":112650}]]}
I20260709 13:13:37.087256  1278 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:37.097445 29376 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:37.071215 29380 raft_consensus.cc:2410] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
W20260709 13:13:37.103961 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 76491.7us
I20260709 13:13:37.105123 29375 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16.
I20260709 13:13:37.106191 29344 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:37.072219  1757 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:37.124099 29374 raft_consensus.cc:2368] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 13. Current term is 14.
I20260709 13:13:37.123979 29495 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:37.140697 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:37.141530 29448 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:13:37.108089  1899 raft_consensus.cc:697] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 12 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:37.141379 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:37.143633 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:37.150312 29454 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:37.143565 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:37.144183 29421 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:37.144690 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:37.151376 29453 raft_consensus.cc:2393] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 15: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:37.151798 29455 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:37.152020 29421 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:37.151279 29448 raft_consensus.cc:1275] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:13:37.146363 29495 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:37.114686  1805 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:13:37.130357  1757 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:37.163442 29421 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:37.116212  1891 consensus_queue.cc:1059] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:13:37.179332 29454 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
W20260709 13:13:37.180480  1965 log.cc:927] Time spent T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2: Append to log took a long time: real 0.113s	user 0.002s	sys 0.000s
I20260709 13:13:37.184937  1764 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:37.185529  1764 raft_consensus.cc:697] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:37.186607  1764 consensus_queue.cc:237] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:37.153312  1966 raft_consensus.cc:2804] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:37.188057  1966 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.188485  1966 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:37.168462  1805 raft_consensus.cc:697] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:37.192381  1967 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.192754  1805 consensus_queue.cc:237] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:37.192957  1967 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:37.198094 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:37.198850  1967 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:37.168362  1861 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:37.200060  1861 raft_consensus.cc:697] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 14 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:37.201089  1861 consensus_queue.cc:237] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:37.209120 29524 raft_consensus.cc:1275] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:13:37.159282  1733 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:37.211599  1733 raft_consensus.cc:697] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 14 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:37.212956  1733 consensus_queue.cc:237] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:37.218478  1278 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:37.208949 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:37.184427  1683 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:37.227898 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:37.234798 29523 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:37.190779  1899 consensus_queue.cc:237] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:37.239204 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:37.241053  1909 consensus_queue.cc:1048] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:37.251654 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:37.252733 29454 raft_consensus.cc:2393] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 11: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:37.256465 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:37.256938 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:37.257597 29453 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
I20260709 13:13:37.271107  1697 raft_consensus.cc:3055] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:37.270681  1757 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:37.275131  1278 raft_consensus.cc:2955] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Committing config change with OpId 10.8: config changed from index 5 to 8, VOTER 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
W20260709 13:13:37.288755 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 142480us
I20260709 13:13:37.290498 29495 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:37.294301  1967 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:37.294991  1967 raft_consensus.cc:697] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:37.295025 29495 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:37.296363  1967 consensus_queue.cc:237] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:37.301265  1891 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:37.301797  1891 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.302203  1891 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:37.305989 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:37.307360 29453 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 14.
I20260709 13:13:37.314152 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:37.317462  1891 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:37.271715  1697 raft_consensus.cc:740] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:37.338466  1891 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:37.328023  1900 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:37.364645 29455 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 18.
I20260709 13:13:37.369577 29523 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 14.
I20260709 13:13:37.409699 29523 raft_consensus.cc:1275] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:13:37.374421 29526 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:13:37.376978 30155 raft_consensus.cc:2955] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 12 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 5 to 8, VOTER 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:13:37.381603  1697 consensus_queue.cc:260] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:37.366714  1735 raft_consensus.cc:2749] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:13:37.390471 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 95494.2us
I20260709 13:13:37.379515  1869 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.395345 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:37.395669 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:37.395862 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:37.424350 29381 raft_consensus.cc:2376] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11. Re-sending same reply.
I20260709 13:13:37.425632 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:37.396690 29374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:13:37.427553 29374 raft_consensus.cc:606] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:37.428138 29374 raft_consensus.cc:614] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:37.427642 29419 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:37.397529 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:37.428781 29453 raft_consensus.cc:1275] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:13:37.429109 29377 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
I20260709 13:13:37.397606 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:37.398797 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:37.402324 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:37.403338 29372 raft_consensus.cc:1240] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:37.434785 29529 raft_consensus.cc:1275] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:13:37.405104 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:37.379112  1900 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:37.419751 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:37.438341 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:37.439016 29378 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:37.420222 29344 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:37.432214 29379 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
I20260709 13:13:37.440272 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:37.440657 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:37.440920 29379 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
I20260709 13:13:37.441285  1278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:52164 (request call id 67) took 5074 ms. Trace:
I20260709 13:13:37.436496 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:37.436838 29419 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:37.436205 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:37.442391 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:37.442996 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:37.444963  1790 consensus_queue.cc:1048] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:13:37.445684 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:37.446292  1683 raft_consensus.cc:2804] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:37.446964 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:37.448190 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:37.448750 29372 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 13.
I20260709 13:13:37.448832 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:37.450385  1757 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:37.451901 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:37.452167 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:37.441731  1278 rpcz_store.cc:276] 0709 13:13:32.363070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:32.365722 (+  2652us) service_pool.cc:224] Handling call
0709 13:13:32.381235 (+ 15513us) log.cc:844] Serialized 508 byte log entry
0709 13:13:32.692567 (+311332us) spinlock_profiling.cc:243] Waited 3.88 ms on lock 0x7b1800418a80. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c13c0a 00007f6a82353219 00007f6a78c9ba40 00007f6a78c964e4 00007f6a78c96455 00007f6a7bcdfb0b 00007f6a7bd64b63 00007f6a7bd8c752 00007f6a7bd849fa
0709 13:13:37.422651 (+4730084us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":118938,"raft.queue_time_us":160031,"raft.run_cpu_time_us":2815,"raft.run_wall_time_us":243001,"spinlock_wait_cycles":8913792,"thread_start_us":161504,"threads_started":1,"wal-append.queue_time_us":400649,"wal-append.run_cpu_time_us":2469,"wal-append.run_wall_time_us":1183079}
I20260709 13:13:37.459599 29380 raft_consensus.cc:1275] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:13:37.461841 29372 raft_consensus.cc:1240] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 18. Current term is 19. Ops: []
I20260709 13:13:37.462484  1982 raft_consensus.cc:2804] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:37.463143  1982 raft_consensus.cc:697] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 14 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:37.443313 29346 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:37.464299  1982 consensus_queue.cc:237] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:37.437868  1697 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:37.478113 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 175707us
I20260709 13:13:37.437999  1798 raft_consensus.cc:2804] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:37.486214 29372 raft_consensus.cc:1275] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:13:37.506527 29377 raft_consensus.cc:1275] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:13:37.436194  1901 consensus_queue.cc:1059] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:13:37.515622 29378 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
I20260709 13:13:37.436928  1733 consensus_queue.cc:1048] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:13:37.440099  1950 consensus_queue.cc:1048] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:13:37.436008  1869 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:37.519857  1683 raft_consensus.cc:697] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:13:37.520627 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 83866.3us
W20260709 13:13:37.527752 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 98836.8us
I20260709 13:13:37.484165  1798 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.537453 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:37.517320  1791 raft_consensus.cc:2749] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:37.530668  1981 log.cc:927] Time spent T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.066s	user 0.000s	sys 0.009s
I20260709 13:13:37.549198 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:37.559513 29495 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:37.533597  1798 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:37.542559  1967 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.591768 29346 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:37.592113  1278 consensus_queue.cc:1048] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:13:37.549995  1891 consensus_queue.cc:1048] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
W20260709 13:13:37.597383 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 45648.8us
I20260709 13:13:37.598340 29495 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:13:37.603246 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 58831.7us
I20260709 13:13:37.584556  1967 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:37.659054  1791 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:13:37.697592 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 105901us
W20260709 13:13:37.675038  1949 log.cc:927] Time spent T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:13:37.763279 29346 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:37.678121  1997 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:37.691414  1741 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:13:37.773767 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 116144us
I20260709 13:13:37.778374 29346 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:37.759027  1900 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:37.798314  1278 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:37.798794  1278 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:37.799319  1278 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:37.660616  1683 consensus_queue.cc:237] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:37.760033  1950 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:37.778733  1791 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:37.808339 29346 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:37.799943  1966 consensus_meta.cc:287] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.611s	user 0.014s	sys 0.000s
W20260709 13:13:37.823799 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 225519us
I20260709 13:13:37.826516 29346 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:37.833253 29346 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:37.814327  1278 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:37.836336  1909 raft_consensus.cc:2749] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:37.850641  1967 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:37.820739  1791 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:37.852068  1791 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:37.854252  1278 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:37.838814  1987 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:37.838456 29346 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:37.840562 29495 leader_election.cc:304] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:37.822697  1950 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:37.849642  1985 log.cc:927] Time spent T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:13:37.850438  1869 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:37.860947  1967 raft_consensus.cc:2749] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:37.861753  1950 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:37.861864  1967 consensus_queue.cc:1048] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:37.862988  1983 raft_consensus.cc:2804] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:37.864876 29495 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:37.819821  1900 consensus_queue.cc:1048] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:13:37.871848 29495 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:37.885681 29495 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:37.887857  1967 consensus_queue.cc:1048] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:37.863480  1983 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:37.875303  1980 log.cc:927] Time spent T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.353s	user 0.000s	sys 0.002s
I20260709 13:13:37.868013  1987 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:13:37.899292  1741 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.910192 29495 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:37.893101  1764 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:37.837157  1966 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:37.906036  1983 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:37.920315  1741 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:37.927820  1757 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:37.928647  2001 consensus_queue.cc:1048] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:13:37.931851  1972 log.cc:927] Time spent T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.321s	user 0.002s	sys 0.000s
W20260709 13:13:37.932739 30155 consensus_meta.cc:287] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent flushing consensus metadata: real 0.516s	user 0.007s	sys 0.006s
W20260709 13:13:37.933118 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:37.933595  1999 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:37.934073  1971 raft_consensus.cc:2749] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:37.935935  1741 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:37.919281  1891 consensus_queue.cc:1048] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:13:37.961582 29495 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:37.963049  1971 raft_consensus.cc:2749] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:37.965287 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:37.968243 29344 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.005s	sys 0.009s
W20260709 13:13:37.968914 29344 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.005s	sys 0.010s
I20260709 13:13:37.922919  1764 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
W20260709 13:13:37.964123  1989 log.cc:927] Time spent T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.286s	user 0.000s	sys 0.001s
W20260709 13:13:37.969638 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 516587us
I20260709 13:13:37.989746 29344 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:37.995306  1978 log.cc:927] Time spent T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.559s	user 0.007s	sys 0.000s
I20260709 13:13:37.998253  1900 consensus_queue.cc:1048] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:13:37.990571 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 116231us
I20260709 13:13:37.978055  1764 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:38.002725  1909 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:38.014417 29346 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:38.026469 29346 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:38.033782  2012 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:38.035372  1909 raft_consensus.cc:697] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:38.036809  1909 consensus_queue.cc:237] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:38.039419  1987 raft_consensus.cc:2764] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:13:38.040508  1987 consensus_queue.cc:1048] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:38.047797 29346 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:38.053372 29346 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:38.054772 29495 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:38.056809 29495 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:38.070322 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:38.070995 29448 raft_consensus.cc:1275] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:13:38.071090 29452 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:13:38.072932 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:38.075261 29450 raft_consensus.cc:2393] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 11: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:38.063464  1891 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:38.067727  1805 raft_consensus.cc:2804] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:38.063140  1790 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:38.104274 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:38.104846 29455 raft_consensus.cc:3055] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:38.110692 29455 raft_consensus.cc:740] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
W20260709 13:13:38.114127  2006 log.cc:927] Time spent T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:13:38.116375  2015 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.117051  2015 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:38.124066 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 67361.6us
I20260709 13:13:38.125345 29495 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:38.096184 29265 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 95122b0f733946aba19edf1d98467467 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:13:38.111928 29455 consensus_queue.cc:260] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:38.145941 29455 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:38.088577  1805 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:38.105433 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:13:38.142884 29265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 46988.8us
I20260709 13:13:38.076213  1971 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:13:38.151389  1798 consensus_meta.cc:287] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.568s	user 0.010s	sys 0.002s
I20260709 13:13:38.151859  1805 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:38.204175 29455 raft_consensus.cc:1275] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:13:38.204874 29455 pending_rounds.cc:85] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 6
I20260709 13:13:38.205229 29455 pending_rounds.cc:107] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:13:38.205611 29455 raft_consensus.cc:2889] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:38.206468 29452 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 14.
I20260709 13:13:38.163298  1966 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:38.213186  1861 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:13:38.215626  1971 raft_consensus.cc:697] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:38.216958  1971 consensus_queue.cc:237] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:38.157969  1900 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.219806  1900 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:38.222329  1900 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:38.192461  2015 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:38.191447  1891 raft_consensus.cc:2764] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260709 13:13:38.199553  1965 log.cc:927] Time spent T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:13:38.195355  1798 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:38.232086  1697 consensus_meta.cc:287] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.744s	user 0.014s	sys 0.000s
I20260709 13:13:38.232734 29450 raft_consensus.cc:1240] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:13:38.238009  1805 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:38.234486  1901 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:38.244760 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 119559us
I20260709 13:13:38.245779 29495 leader_election.cc:400] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 17. Current term is 18.
I20260709 13:13:38.235546  2012 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.250890  1764 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:38.280370  1791 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:38.282267  1764 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:38.282655  1791 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:38.284698  1805 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:38.285655  1764 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:38.286325  1764 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:38.250167  1901 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:38.289642  1764 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:38.292044 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:38.293601  1982 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:38.294315  1982 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:38.288800 29495 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:38.303824  1861 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:38.308928 29456 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:13:38.304332  1798 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:38.314821  1977 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:38.304781  2012 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:38.291268  1983 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:38.372290  1983 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:38.316203  1861 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:38.329591 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:38.333364  1901 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:38.340412 29495 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:38.376360  1977 raft_consensus.cc:2749] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:38.378058 29495 leader_election.cc:400] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 13. Current term is 14.
I20260709 13:13:38.378403 29495 leader_election.cc:403] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:13:38.379014  1977 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 13. Current term is 14.
I20260709 13:13:38.380460  1861 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:38.380944 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:38.381733 29524 raft_consensus.cc:2393] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 15: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
W20260709 13:13:38.334263  1997 consensus_meta.cc:287] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.546s	user 0.007s	sys 0.005s
I20260709 13:13:38.374454  2012 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:38.328001  1982 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:38.383116  1997 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:38.384366 29524 raft_consensus.cc:1240] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:38.389885 29529 raft_consensus.cc:1240] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:13:38.395249  1993 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.395977  1993 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:38.398617  2012 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.399209  1977 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.399693  2012 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:38.400085  1977 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:38.402936  2012 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:38.403097  1977 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:38.398952  1993 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:38.419831  1993 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.420614  1993 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:38.423996  1993 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:38.435799 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 201247us
W20260709 13:13:38.432672 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 139502us
I20260709 13:13:38.437036  2031 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.439389 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:38.439926 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:38.440032  2031 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:38.440644 29373 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 18.
I20260709 13:13:38.440634 29378 raft_consensus.cc:2393] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 13: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:38.441371 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:38.442070 29375 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:38.442514  2031 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:38.446998  1971 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:38.447590  2030 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:38.454975 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:38.452219 29529 raft_consensus.cc:1275] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:13:38.439380 29421 leader_election.cc:336] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.574s (SENT)
I20260709 13:13:38.462431 29375 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 15.
I20260709 13:13:38.463439 29372 raft_consensus.cc:1240] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:38.464938 29380 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:38.472275 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:38.473891 29375 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 15.
I20260709 13:13:38.478561 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:38.479439 29522 raft_consensus.cc:2393] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 15: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:38.480825 29451 raft_consensus.cc:3055] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:13:38.481714 29525 raft_consensus.cc:1240] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:38.477689 29421 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:38.483116 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:38.488006 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:38.488324 29452 raft_consensus.cc:1275] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:13:38.488809 29521 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
I20260709 13:13:38.475216 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:38.481235 29451 raft_consensus.cc:740] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:38.489434 29421 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:38.489817 29448 raft_consensus.cc:1275] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 18 index: 8. (index mismatch)
I20260709 13:13:38.490226 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:38.491735 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:38.443130  2031 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.492405 29377 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
I20260709 13:13:38.494820 29378 raft_consensus.cc:1275] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:13:38.495961 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:38.496604 29373 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11.
I20260709 13:13:38.497917 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:38.498622 29523 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11.
I20260709 13:13:38.500165  1993 raft_consensus.cc:2749] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:38.500478 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:38.479388  2030 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:38.501168 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:38.491613 29451 consensus_queue.cc:260] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:38.502105 29451 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:38.502735  2030 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:38.502977 29525 raft_consensus.cc:1275] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:13:38.505404 29525 raft_consensus.cc:1240] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:38.506450 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:38.506635 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:38.507220 29530 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 13.
I20260709 13:13:38.507309 29456 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
I20260709 13:13:38.508490 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:38.509220 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:38.509649 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:38.511930  2031 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:38.512557 29448 raft_consensus.cc:1275] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:13:38.513269 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:38.513530 29421 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:38.514278 29449 raft_consensus.cc:1275] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:13:38.514624  1982 raft_consensus.cc:2804] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:38.516426 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:38.517077 29523 raft_consensus.cc:1275] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:13:38.517307 29521 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:38.452837  1977 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:38.519121 29421 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:38.518187 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:38.522150 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:38.523073 29421 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:38.529868 29522 raft_consensus.cc:1275] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:13:38.533823 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:38.539728 29453 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
I20260709 13:13:38.544009 29421 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:38.461896  1971 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:38.546470 29380 raft_consensus.cc:1275] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:13:38.514703  2031 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:38.528527  1993 raft_consensus.cc:2804] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:38.537990  1901 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:38.567193 29421 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:38.537475  1997 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:38.568732  1997 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:38.554931  1987 consensus_queue.cc:1048] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:13:38.538196  1982 raft_consensus.cc:697] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 11 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:38.574457  1982 consensus_queue.cc:237] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:38.575735 29451 raft_consensus.cc:1275] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 13:13:38.576201 29451 pending_rounds.cc:85] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 9
I20260709 13:13:38.576426 29451 pending_rounds.cc:107] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 13:13:38.576684 29451 raft_consensus.cc:2889] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:38.581262  2031 consensus_queue.cc:1048] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:38.586135 29346 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:38.589641 29521 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
I20260709 13:13:38.593176  1966 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.593883  1966 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:38.599180 29375 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:13:38.601895 29375 raft_consensus.cc:606] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:38.603091 29375 raft_consensus.cc:614] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:38.604617 29346 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:38.606009  2012 consensus_queue.cc:1048] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:13:38.610113  1987 consensus_queue.cc:1059] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:38.600339  2014 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.567809  1993 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:38.566310  1988 raft_consensus.cc:2804] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:38.605454 29421 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:38.588158  2015 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:38.543419  1798 consensus_queue.cc:1059] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:13:38.544214  1977 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:38.623669  1966 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:38.615559  2014 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:38.602672  2031 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:38.623206  1861 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:38.631980 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:38.613855  1983 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:38.611400  1909 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.602625  1694 consensus_queue.cc:1048] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:13:38.646981 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:38.647728 29276 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35182 (request call id 72) took 3753 ms. Trace:
I20260709 13:13:38.621439  1993 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:38.647683 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:38.652714 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:38.620201  1997 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:38.655474 29452 raft_consensus.cc:1275] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:13:38.621021  1988 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:38.670493 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:38.671309 29449 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:38.639106  1901 raft_consensus.cc:2749] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:38.634255  1861 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:38.678073 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:38.638780  1983 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:38.647791  1798 raft_consensus.cc:3055] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:38.681551 29527 raft_consensus.cc:2393] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 12: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:38.647274  2031 raft_consensus.cc:697] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:38.687849 29529 raft_consensus.cc:1275] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:13:38.689507  2031 consensus_queue.cc:237] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:38.648865 29276 rpcz_store.cc:276] 0709 13:13:34.878293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:34.878462 (+   169us) service_pool.cc:224] Handling call
0709 13:13:34.996136 (+117674us) spinlock_profiling.cc:243] Waited 47.6 ms on lock 0x7b5400002490. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61b71 00007f6a78c620b2 00007f6a81bdba89 00007f6a81b73da6 00007f6a81b45088 00007f6a81c4337e 00007f6a801042a4 00007f6a80104232 00007f6a80104161 00007f6a801040dc
0709 13:13:38.631364 (+3635228us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:37.118139 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:37.119001 (+   862us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:37.119049 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:13:37.119077 (+    28us) tablet.cc:662] Decoding operations
0709 13:13:37.120354 (+  1277us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:37.120449 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:37.120491 (+    42us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:13:37.121807 (+  1316us) tablet.cc:701] Row locks acquired
0709 13:13:37.121836 (+    29us) write_op.cc:260] PREPARE: finished
0709 13:13:37.122064 (+   228us) write_op.cc:270] Start()
0709 13:13:37.122535 (+   471us) write_op.cc:276] Timestamp: P: 1783602817121997 usec, L: 0
0709 13:13:37.122573 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:13:37.219609 (+ 97036us) log.cc:844] Serialized 2855 byte log entry
0709 13:13:37.274988 (+ 55379us) spinlock_profiling.cc:243] Waited 6.08 ms on lock 0x7b54004225a0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcf0090 00007f6a7bcfd6b8 00007f6a7bcfd2fa 00007f6a7bd81965 00007f6a7bd81e09 00007f6a7f7bc581 00007f6a7f7bbd58 00007f6a7f7c09f1 00007f6a7f7c09a9 00007f6a7f7c0939 00007f6a7f7c0901
0709 13:13:37.453928 (+178940us) op_driver.cc:464] REPLICATION: finished
0709 13:13:37.747615 (+293687us) write_op.cc:301] APPLY: starting
0709 13:13:37.760288 (+ 12673us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:38.037745 (+277457us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:38.037775 (+    30us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:38.150322 (+112547us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:38.150657 (+   335us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 13:13:38.150709 (+    52us) write_op.cc:312] APPLY: finished
0709 13:13:38.151082 (+   373us) log.cc:844] Serialized 72 byte log entry
0709 13:13:38.151365 (+   283us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:38.157460 (+  6095us) write_op.cc:454] Released schema lock
0709 13:13:38.160652 (+  3192us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:38.233913 (+ 73261us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:38.233956 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":50302,"reported_tablets":8,"spinlock_wait_cycles":109464832,"child_traces":[["op",{"apply.queue_time_us":227700,"apply.run_cpu_time_us":16891,"apply.run_wall_time_us":541078,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33331,"num_ops":7,"prepare.queue_time_us":75329,"prepare.run_cpu_time_us":9644,"prepare.run_wall_time_us":163861,"replication_time_us":297302,"spinlock_wait_cycles":13981056,"thread_start_us":140136,"threads_started":2}]]}
I20260709 13:13:38.668519  1988 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:38.642479  2029 consensus_queue.cc:1048] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:13:38.684140 29346 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:38.684662  1983 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:38.680598  1861 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:38.710245  2030 consensus_queue.cc:1048] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:38.711664 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:38.715787 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:38.720678 29380 raft_consensus.cc:1240] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:13:38.653384  1909 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:38.729077 29372 raft_consensus.cc:2368] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 12. Current term is 13.
I20260709 13:13:38.724864 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:38.729876 29377 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:13:38.726172 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:38.685097  1798 raft_consensus.cc:740] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:38.731463 29376 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16.
W20260709 13:13:38.733430 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 128061us
I20260709 13:13:38.736250 29421 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:38.709419  1987 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:38.735731 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:38.692191  1900 consensus_queue.cc:1048] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:13:38.744374 29522 raft_consensus.cc:2393] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 16: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:38.756098 29377 raft_consensus.cc:1240] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:13:38.757102 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:38.757499 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:38.757968 29380 raft_consensus.cc:1275] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:13:38.758361 29381 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 15.
I20260709 13:13:38.759243 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:38.756132 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:38.760932 29372 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:38.789297 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:38.790200 29451 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
I20260709 13:13:38.792999 29529 raft_consensus.cc:1240] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:13:38.798314 29455 raft_consensus.cc:1275] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:13:38.798633 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:38.836223 29346 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:13:38.829895 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 202844us
I20260709 13:13:38.794782  1987 raft_consensus.cc:697] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:38.800379  1982 raft_consensus.cc:2749] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:38.802263  1971 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:38.857489 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 121325us
I20260709 13:13:38.858853 29421 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:38.867877 29421 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:38.873703 29372 raft_consensus.cc:2468] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
I20260709 13:13:38.878255 29421 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:38.852246  2012 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:38.874696  2038 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:38.870261  1888 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:38.853114  1997 consensus_queue.cc:1048] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:13:38.882110  1982 raft_consensus.cc:2804] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:38.892573 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:38.834259  1798 consensus_queue.cc:260] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:38.895610  2036 log.cc:927] Time spent T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.256s	user 0.002s	sys 0.000s
I20260709 13:13:38.887413  2015 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:38.887684  2012 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:38.902122  2035 log.cc:927] Time spent T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 13:13:38.894304  1900 consensus_queue.cc:1048] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:13:38.914595  1982 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:38.920820  2012 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:38.945770 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 101579us
W20260709 13:13:38.944205 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 55925.5us
I20260709 13:13:38.908775  1888 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:38.948083 29421 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:38.931522  1798 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:38.941653  1982 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:38.937717  2001 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:38.958094 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:38.959468 29448 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 18.
I20260709 13:13:38.961673 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:38.962553 29522 raft_consensus.cc:2393] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 13: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:38.963575  2056 consensus_queue.cc:1048] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:38.970022 29421 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:38.971606 29421 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:38.978437 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:38.980852 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:38.981325  2056 raft_consensus.cc:2749] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:38.982520 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:38.920775  1987 consensus_queue.cc:237] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:38.988909 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:38.989832 29528 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
I20260709 13:13:38.990985 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:38.956247  2039 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:13:38.980937  2046 log.cc:927] Time spent T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:13:38.997686 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:39.007936 29528 raft_consensus.cc:1275] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 18 index: 8. (index mismatch)
I20260709 13:13:39.010288 29528 raft_consensus.cc:1275] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:13:38.973958  1909 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:39.032725 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:38.994204  2015 raft_consensus.cc:2749] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:39.038105 29528 raft_consensus.cc:1275] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:13:39.054293 29524 raft_consensus.cc:1275] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:13:39.055554  1888 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:39.055785 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:39.063683  1997 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.064121  2039 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:39.064477  1997 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:39.064891  2039 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:39.030030  2043 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.971611  2001 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:39.079572 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:39.049171  1909 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:39.067342  2039 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:39.108151  2050 log.cc:927] Time spent T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:13:39.113018  2001 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:39.116093  1909 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:39.117298  2047 log.cc:927] Time spent T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.184s	user 0.001s	sys 0.001s
I20260709 13:13:39.118643  1909 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:39.086675  1790 raft_consensus.cc:3055] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:39.119729  1790 raft_consensus.cc:740] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:39.120817  1790 consensus_queue.cc:260] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:39.122409  1790 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:39.092759  2043 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:39.132180 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 160721us
I20260709 13:13:39.127403  2043 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:39.159049 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 108348us
I20260709 13:13:39.131402  1983 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:39.162196  1983 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:39.154273  1997 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:39.151437  2056 consensus_queue.cc:1048] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:13:39.143066  2041 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.171336  2041 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:39.173890  2041 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:39.175549  2051 consensus_queue.cc:1059] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:39.177193  2025 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:39.178247  2051 raft_consensus.cc:3055] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:39.178771  2051 raft_consensus.cc:740] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:39.177863  2025 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:39.184643  2025 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:39.143042  1861 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:39.188407  1988 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:39.188668  1982 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:39.196563  2060 consensus_queue.cc:1048] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:39.156525  2001 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.158882  1993 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:39.204098  1977 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:39.162973  1983 consensus_queue.cc:1048] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:39.229951  2001 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:39.236598  2052 log.cc:927] Time spent T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.134s	user 0.003s	sys 0.000s
I20260709 13:13:39.237640  2001 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:39.238092  2014 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:39.241544  1861 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:39.235378  1988 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:39.232904  1993 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:39.245826 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
W20260709 13:13:39.264472 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 55477.6us
I20260709 13:13:39.265654 29419 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:39.261157 29344 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:39.281661 29376 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:13:39.258266  1790 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:39.281497 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:39.288151 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:39.290900 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 143997us
I20260709 13:13:39.287899 29376 raft_consensus.cc:606] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:39.294633 29421 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:39.300036 29344 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:39.302907 29419 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:39.307986 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:39.308337 29495 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:39.308880 29521 raft_consensus.cc:2393] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 15: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:39.289675  1988 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:39.314040 29421 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:39.315335 29421 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:39.318007 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:39.321625 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:39.322219 29373 raft_consensus.cc:1275] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:13:39.332623 29495 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:39.334946 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:39.337644 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:39.340745  1967 raft_consensus.cc:2749] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:39.340888  2067 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:39.293995  1982 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:39.340634  2068 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:39.243795  2051 consensus_queue.cc:260] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:39.346335  2015 raft_consensus.cc:2804] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:39.376268 29373 raft_consensus.cc:1240] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:39.346611 29495 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:39.304801  1993 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:39.314239  1988 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.346086  2014 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:39.378114 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:39.379038 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:39.302799  2025 consensus_queue.cc:1048] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:13:39.383020 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:39.383894 29373 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
I20260709 13:13:39.309762  1790 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:39.384934  1988 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:39.384714  2012 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:39.387952  2001 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:39.388725  2001 raft_consensus.cc:697] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 15 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:39.389725  2014 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:39.390260  2014 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:39.389865  2001 consensus_queue.cc:237] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:39.361260 30155 raft_consensus.cc:2410] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:13:39.388075  2012 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:39.354820  1999 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:39.398743 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:39.400996 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 98184.8us
I20260709 13:13:39.380013 29495 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:39.402520 29419 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:39.413542 29495 leader_election.cc:400] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 12. Current term is 13.
W20260709 13:13:39.414038 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 97307.4us
I20260709 13:13:39.416824 29495 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
W20260709 13:13:39.417655 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 95775.4us
I20260709 13:13:39.419168  1697 raft_consensus.cc:2804] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:39.419741  1697 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:39.420120  1697 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:39.420940 29495 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:39.376130  2015 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:39.343422  2039 consensus_queue.cc:1048] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:13:39.387203  1790 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:39.320459  2075 consensus_queue.cc:1059] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.103s
I20260709 13:13:39.399892  1982 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:39.439960 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:39.441128 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:39.442068 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:39.443657 29373 raft_consensus.cc:1275] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:13:39.444880 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:39.411720  1967 raft_consensus.cc:2749] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:13:39.433748 29495 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:39.436335  2066 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:39.436625  2078 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:39.436900  2071 consensus_queue.cc:1048] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
W20260709 13:13:39.437633  2076 log.cc:927] Time spent T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:13:39.400645  1999 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:39.468327  1999 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:39.429554  2015 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:39.431346  1977 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:39.460995  2043 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:39.463620  2078 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:39.466071  2057 log.cc:927] Time spent T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.476s	user 0.002s	sys 0.000s
I20260709 13:13:39.422515  1694 consensus_queue.cc:1059] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:13:39.482995 29495 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:39.375104  2068 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:39.447154  1982 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.493546 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:39.475077  1805 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.498528 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:39.436784  1997 consensus_queue.cc:1048] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:13:39.434218  2041 consensus_queue.cc:1059] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:13:39.495527 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:39.514230 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:39.492487  1861 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.527513 29378 raft_consensus.cc:2393] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 15: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:39.515199  1741 raft_consensus.cc:2804] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:39.481035  1977 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:39.531581 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:39.512437 29373 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 18.
I20260709 13:13:39.501959  2078 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:39.522871 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:39.521963 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 175921us
I20260709 13:13:39.527671 29375 raft_consensus.cc:2393] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 13: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:39.515038  2071 consensus_queue.cc:1048] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:39.517664  2068 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:39.534008 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:39.518206  1982 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:39.550228 29344 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:39.550705  1694 raft_consensus.cc:3055] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:39.490484  2043 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.551844  2043 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:39.539083 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:39.543121 29421 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:39.452579  2077 consensus_queue.cc:1048] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 13:13:39.556823 29378 raft_consensus.cc:2393] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 14: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:39.557365  2077 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.561550  2077 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:39.565227  2077 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:39.565850  2077 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:13:39.566543  2077 consensus_queue.cc:1048] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:39.558460  1982 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:39.559603 29421 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:39.568867  1694 raft_consensus.cc:740] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:39.572144  2077 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:39.572820  2077 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:39.573716  2077 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:39.574229  1694 consensus_queue.cc:260] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:39.536218  2073 log.cc:927] Time spent T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.229s	user 0.002s	sys 0.000s
I20260709 13:13:39.584726 29455 raft_consensus.cc:1240] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:39.587124 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:39.588127 29454 raft_consensus.cc:2410] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:13:39.589958 29344 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:39.591120 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:39.591270 29344 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:39.591902 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:39.536490  1977 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:39.595249 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 87589.7us
I20260709 13:13:39.597113 29344 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:39.599836 29421 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:39.602629 29449 raft_consensus.cc:1240] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:39.604630 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:39.605479 29447 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:13:39.524269  1805 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:39.607250 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:39.608440 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 185562us
I20260709 13:13:39.604712 29495 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:39.614967 29495 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:39.532392  1861 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:39.615682 29344 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:39.617542 29419 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:39.594172  2029 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:39.628891 29495 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:39.637341 29447 raft_consensus.cc:1240] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:39.602847  2067 raft_consensus.cc:2749] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:39.647468 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:39.656083 29419 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:39.655011 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:39.659053 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:39.661768 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:13:39.662259 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:39.615511  2075 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:39.662444 29526 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:39.627974  1967 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:39.674522 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:39.677326 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:39.638388  1982 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:39.611773  2012 consensus_queue.cc:1048] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:13:39.693806 29524 raft_consensus.cc:1275] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:13:39.694379 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 94633.7us
I20260709 13:13:39.636260  2031 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:39.625226  1790 consensus_queue.cc:1048] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:13:39.657938  1983 consensus_queue.cc:1048] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:13:39.712622 29456 raft_consensus.cc:1275] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:13:39.688468  1798 raft_consensus.cc:2749] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:39.666158  1997 consensus_queue.cc:1059] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:13:39.737146 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:39.698002  1982 raft_consensus.cc:2749] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:39.755560 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:39.668332  2075 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:39.756392 29456 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
I20260709 13:13:39.693617  2043 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:39.768456  1861 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:39.772854 30119 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:39.776443  2091 log.cc:927] Time spent T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:13:39.776715  2082 consensus_queue.cc:1059] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.164s
I20260709 13:13:39.779639  1988 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:39.782912  2014 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:39.792693  2084 raft_consensus.cc:2749] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:39.795452 29522 raft_consensus.cc:1275] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:13:39.798535  2086 consensus_queue.cc:1048] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.099s
I20260709 13:13:39.799641  2081 consensus_queue.cc:1048] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.142s
I20260709 13:13:39.803390  2088 consensus_queue.cc:1048] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.172s
I20260709 13:13:39.758347  2080 raft_consensus.cc:2749] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:13:39.819121 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 46528.6us
I20260709 13:13:39.838645 29526 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
I20260709 13:13:39.852986 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:39.857276  2012 consensus_queue.cc:1048] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:13:39.859745 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 203716us
I20260709 13:13:39.893550 29419 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:39.860049  1741 raft_consensus.cc:697] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
W20260709 13:13:39.886811 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 258049us
I20260709 13:13:39.775286  1697 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:39.870651  2068 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:39.905552 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:39.912613 29419 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:39.877611  2051 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:39.919224 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:39.920951 29493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 92899.6us
I20260709 13:13:39.945441 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:39.948089 29495 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:39.953322 29344 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:39.917308  2038 raft_consensus.cc:2804] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:39.917999  1900 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:39.989982 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:39.995227 29451 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:39.993067 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 45082.6us
I20260709 13:13:40.039261 29495 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:40.040773 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:39.982236 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:40.061149 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:40.057050 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 56942.2us
I20260709 13:13:40.144666 29451 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 14.
W20260709 13:13:40.150012 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 226817us
I20260709 13:13:39.980692  1805 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:39.988768  1861 raft_consensus.cc:2749] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:39.991796  2030 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:39.979435  1987 consensus_queue.cc:1048] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.164s
W20260709 13:13:40.168443 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 129319us
W20260709 13:13:40.169651 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 104037us
I20260709 13:13:39.942268  1999 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:40.142462  2031 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:40.197997 29449 raft_consensus.cc:1240] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:13:40.201614 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:40.205437 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:40.218654 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:40.223806 29455 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:40.058743  1900 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:40.218325 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:40.183591  2086 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.186538  1973 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:40.180570  2038 raft_consensus.cc:697] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:40.189483  2066 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.187855  2030 raft_consensus.cc:697] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:13:40.252439  2104 log.cc:927] Time spent T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:13:40.252949  2030 consensus_queue.cc:237] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:40.228319 29522 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 14.
I20260709 13:13:40.202028  1798 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
W20260709 13:13:40.241974  2054 log.cc:927] Time spent T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.931s	user 0.004s	sys 0.000s
I20260709 13:13:40.269294 29455 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
W20260709 13:13:40.246938  2078 consensus_meta.cc:287] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.666s	user 0.006s	sys 0.005s
I20260709 13:13:40.211910  2094 raft_consensus.cc:2804] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:40.170125  1741 consensus_queue.cc:237] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:40.257314  2029 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:13:40.292706  2077 consensus_meta.cc:287] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.718s	user 0.009s	sys 0.009s
I20260709 13:13:40.214862  2031 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:40.352677 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 46835us
I20260709 13:13:40.277530  2043 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:40.315848  1697 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:40.286520  1988 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:40.281886  1987 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:40.286113  2094 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:40.294080  1977 consensus_meta.cc:287] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.681s	user 0.009s	sys 0.004s
I20260709 13:13:40.294344  1683 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:13:40.377179 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:40.275902  1798 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:40.352794  2088 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.388124  2088 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:40.379149 29374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1718) took 1662 ms. Trace:
I20260709 13:13:40.391716 29374 rpcz_store.cc:276] 0709 13:13:38.716995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:38.742421 (+ 25426us) service_pool.cc:224] Handling call
0709 13:13:38.742833 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:38.793694 (+ 50861us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:38.793734 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:38.805346 (+ 11612us) log.cc:844] Serialized 26 byte log entry
0709 13:13:38.955259 (+149913us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:38.955302 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:38.955385 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:39.740070 (+784685us) spinlock_profiling.cc:243] Waited 6.86 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:13:40.368279 (+628209us) raft_consensus.cc:1685] finished
0709 13:13:40.368307 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:40.379048 (+ 10741us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16121,"raft.queue_time_us":12483,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":1747,"spinlock_wait_cycles":15788416,"thread_start_us":97812,"threads_started":1,"wal-append.queue_time_us":147794}
I20260709 13:13:40.396085  1798 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:40.257542  2086 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:40.399768  2088 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:40.399400  2086 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:40.383689 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 212992us
I20260709 13:13:40.381704  1861 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:40.402594  1861 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:40.405834  1861 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:40.268205  2066 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:40.275695  2103 consensus_queue.cc:1048] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.100s
I20260709 13:13:40.285907  2078 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:40.380262  2015 consensus_meta.cc:287] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.908s	user 0.015s	sys 0.005s
W20260709 13:13:40.412586 29346 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.007s	sys 0.043s
W20260709 13:13:40.473861 29346 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.007s	sys 0.043s
W20260709 13:13:40.472136 29494 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.020s	sys 0.024s
W20260709 13:13:40.477454 29494 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.020s	sys 0.025s
I20260709 13:13:40.311570  2101 consensus_queue.cc:1059] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.108s
I20260709 13:13:40.376307  2094 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:40.479535 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 71145.3us
I20260709 13:13:40.366542  2077 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:40.496616 29346 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:40.500597  2109 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:40.501900  2098 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.502516  2098 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:40.504024  2097 log.cc:927] Time spent T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
W20260709 13:13:40.525177 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:40.412232  1977 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:40.532310  2100 log.cc:927] Time spent T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:13:40.359293  2029 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:40.535710 29454 raft_consensus.cc:1240] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:13:40.488487  2107 raft_consensus.cc:2749] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:40.384318  1987 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:40.411085  1683 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:40.478478  2015 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:40.529642  2030 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.554888  2070 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:40.368126  2038 consensus_queue.cc:237] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:40.556870  2111 raft_consensus.cc:3055] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:40.556308  1977 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:40.561939 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 79390.8us
I20260709 13:13:40.579041 29495 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:40.541855  1999 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:40.562711  1900 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:40.573625  2070 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:40.599345 29452 raft_consensus.cc:1240] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:40.604417 29495 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:40.578037  2111 raft_consensus.cc:740] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:40.611302  1683 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:40.612138  2118 log.cc:927] Time spent T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:13:40.611922  2111 consensus_queue.cc:260] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:40.613449  2111 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:13:40.615020  2051 consensus_meta.cc:287] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.685s	user 0.010s	sys 0.002s
I20260709 13:13:40.611419  2102 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:40.616266  2102 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:40.608842  2070 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:40.574331  2088 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:40.621986  2088 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:40.637832 29495 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:40.639693  2103 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.640287  2103 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:40.642637  2103 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:40.643204  2103 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:40.643765  2109 consensus_queue.cc:1059] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:40.644915  1697 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:40.654086  1697 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:40.654536  1697 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:40.646101 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 119862us
I20260709 13:13:40.649478  2101 consensus_queue.cc:1059] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:40.657548  2101 raft_consensus.cc:3055] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:40.658079  2101 raft_consensus.cc:740] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:40.658948  2101 consensus_queue.cc:260] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:40.660697  2101 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:40.652650 29495 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:40.662310  2082 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.672199  2082 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:40.674703  2082 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:40.651116  1977 consensus_queue.cc:1048] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:40.677291  1977 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:40.604043  1966 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:40.681682 29495 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:40.577912  2030 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:40.626204  2014 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:40.721418 29528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f"
dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:52288
I20260709 13:13:40.722334 29528 raft_consensus.cc:606] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
W20260709 13:13:40.720500 29493 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.010s	sys 0.018s
W20260709 13:13:40.725028 29493 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.011s	sys 0.018s
W20260709 13:13:40.727751 29530 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.011s	sys 0.015s
W20260709 13:13:40.728524 29530 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.012s	sys 0.016s
I20260709 13:13:40.728711  1901 raft_consensus.cc:3055] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:40.729485  1901 raft_consensus.cc:740] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
W20260709 13:13:40.735796 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:40.785961 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:40.752113 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 189552us
I20260709 13:13:40.717469  2088 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:40.941556 29493 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.27.146.190:37499, user_credentials={real_user=slave}} blocked reactor thread for 84010.1us
I20260709 13:13:40.943032 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:40.944031 29529 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 15.
I20260709 13:13:40.730563  1901 consensus_queue.cc:260] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:40.842656  2109 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:40.845880  2078 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:40.850068  1973 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:40.846307  1987 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:40.870337  2077 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:40.849066  2066 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:41.073271  2133 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:41.073993  2133 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:41.075657  2066 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:41.076882  2133 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:41.076709  2066 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:41.079080  2117 log.cc:927] Time spent T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.475s	user 0.001s	sys 0.000s
I20260709 13:13:41.079913  2066 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:40.854714  2102 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:41.104626 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 247046us
I20260709 13:13:41.105998 29344 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:41.115160 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:41.116878 29526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3686) took 1126 ms. Trace:
I20260709 13:13:41.041290  1764 raft_consensus.cc:3055] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:41.117482 29526 rpcz_store.cc:276] 0709 13:13:39.956831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.956951 (+   120us) service_pool.cc:224] Handling call
0709 13:13:39.979977 (+ 23026us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:40.139337 (+159360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.139377 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:40.154793 (+ 15416us) log.cc:844] Serialized 26 byte log entry
0709 13:13:40.457997 (+303204us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:40.458051 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.458149 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:41.083206 (+625057us) raft_consensus.cc:1685] finished
0709 13:13:41.083230 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:41.083378 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":197413,"raft.queue_time_us":242524,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":7848,"thread_start_us":228412,"threads_started":1,"wal-append.queue_time_us":338903}
I20260709 13:13:41.049809  2109 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:41.041764  2128 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:41.093348  2038 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:41.088306  1901 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:41.104689  2015 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:41.086537  2031 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:41.163412 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:41.130030  2102 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:13:41.178156 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:41.179214 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:41.134284  1764 raft_consensus.cc:740] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:41.063223  1973 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:41.142246  2120 raft_consensus.cc:2749] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:13:41.170315  2121 log.cc:927] Time spent T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.560s	user 0.002s	sys 0.000s
I20260709 13:13:41.121784  1697 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:41.149284  2140 raft_consensus.cc:2804] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:41.192034  2031 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:41.150321  2128 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:41.277592 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 448566us
I20260709 13:13:41.280052 29346 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:41.175235  2038 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:41.242925  2120 raft_consensus.cc:493] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:41.240005  2140 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:41.284811  1794 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:41.331346  2140 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:41.331710  1794 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:13:41.333777  2122 log.cc:927] Time spent T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.590s	user 0.001s	sys 0.000s
I20260709 13:13:41.334303  1794 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:41.288616  2134 log.cc:927] Time spent T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 13:13:41.290093  2143 log.cc:927] Time spent T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:13:41.291867  2030 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:41.292870  2129 log.cc:927] Time spent T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.442s	user 0.000s	sys 0.001s
I20260709 13:13:41.343669 29527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3689) took 1138 ms. Trace:
W20260709 13:13:41.344743  2099 log.cc:927] Time spent T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 1.358s	user 0.002s	sys 0.001s
I20260709 13:13:41.346491 29380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52172 (request call id 2186) took 1847 ms. Trace:
I20260709 13:13:41.346889 29380 rpcz_store.cc:276] 0709 13:13:39.499470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.499859 (+   389us) service_pool.cc:224] Handling call
0709 13:13:39.500276 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:39.502134 (+  1858us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:39.502183 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:39.502996 (+   813us) log.cc:844] Serialized 26 byte log entry
0709 13:13:39.863541 (+360545us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:39.865407 (+  1866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:39.865984 (+   577us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:41.343861 (+1477877us) spinlock_profiling.cc:243] Waited 6.2 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:13:41.346149 (+  2288us) raft_consensus.cc:1685] finished
0709 13:13:41.346173 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:41.346413 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1371,"raft.queue_time_us":2278,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":13622,"spinlock_wait_cycles":14267136,"thread_start_us":328234,"threads_started":1,"wal-append.queue_time_us":372009}
I20260709 13:13:41.296574 29523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3681) took 1491 ms. Trace:
I20260709 13:13:41.297636 29452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 1846) took 1705 ms. Trace:
W20260709 13:13:41.302807  2094 consensus_meta.cc:287] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.811s	user 0.007s	sys 0.004s
I20260709 13:13:41.302542 29278 catalog_manager.cc:5697] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 11 to 13, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 13 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:41.312249  2029 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:41.312989  2109 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:41.318122  1805 raft_consensus.cc:993] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5: : Instructing follower 183db85c071f489fbc8de63a9edd8a3a to start an election
I20260709 13:13:41.222270  2102 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:41.320611  1973 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:41.322328  1697 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:41.324203  2128 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:41.265731  2031 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:41.327791 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:41.327759  1764 consensus_queue.cc:260] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:41.329334 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:41.329900  2127 log.cc:927] Time spent T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:13:41.344170 29527 rpcz_store.cc:276] 0709 13:13:40.207855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.208098 (+   243us) service_pool.cc:224] Handling call
0709 13:13:40.232364 (+ 24266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:40.295663 (+ 63299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.295711 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:40.296289 (+   578us) log.cc:844] Serialized 26 byte log entry
0709 13:13:40.530284 (+233995us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:40.530332 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.530411 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:41.343346 (+812935us) raft_consensus.cc:1685] finished
0709 13:13:41.343369 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:41.343585 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90823,"raft.queue_time_us":135248,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":39528,"thread_start_us":154172,"threads_started":1,"wal-append.queue_time_us":335319}
I20260709 13:13:41.350800 29452 rpcz_store.cc:276] 0709 13:13:39.592500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.592823 (+   323us) service_pool.cc:224] Handling call
0709 13:13:39.593170 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:40.609832 (+1016662us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:41.297286 (+687454us) spinlock_profiling.cc:243] Waited 989 ms on lock 0x7b54001c3254. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:41.297548 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2274560256}
I20260709 13:13:41.349566 29523 rpcz_store.cc:276] 0709 13:13:39.805495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.810407 (+  4912us) service_pool.cc:224] Handling call
0709 13:13:39.810818 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:40.210641 (+399823us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.210694 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:40.233669 (+ 22975us) log.cc:844] Serialized 26 byte log entry
0709 13:13:40.297010 (+ 63341us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:40.297057 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.297168 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:41.296266 (+999098us) raft_consensus.cc:1685] finished
0709 13:13:41.296293 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:41.296497 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50896,"raft.queue_time_us":248372,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":16087,"thread_start_us":444259,"threads_started":2,"wal-append.queue_time_us":302427}
I20260709 13:13:41.366250 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:41.366954  2105 raft_consensus.cc:3055] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:41.367460  2001 raft_consensus.cc:493] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
W20260709 13:13:41.375927 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:41.376698 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 96804.2us
W20260709 13:13:41.380103 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:41.388123 29278 catalog_manager.cc:5697] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:41.284319  2144 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:41.358642  2071 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:41.383096  1790 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:41.401957 29419 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:41.388383  2077 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:13:41.449783 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 53413.3us
I20260709 13:13:41.395380  2078 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:41.452728 29452 raft_consensus.cc:1240] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:41.452991 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:41.456117 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:41.456949 29453 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:13:41.393617  2015 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:41.466398 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:41.467727 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:41.331369  2120 raft_consensus.cc:515] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:41.465382 29278 catalog_manager.cc:5697] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 13 to 14, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 14 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:41.417968  1764 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:41.475322 29523 raft_consensus.cc:2393] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 13: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
W20260709 13:13:41.481222 29421 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.562s (SENT) [suppressed 16 similar messages]
I20260709 13:13:41.482837 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:41.475477 29525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3688) took 1271 ms. Trace:
W20260709 13:13:41.475378 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 56788.4us
W20260709 13:13:41.532702 29345 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.003s	sys 0.016s
W20260709 13:13:41.533222 29345 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.003s	sys 0.016s
W20260709 13:13:41.475165 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 60280.1us
I20260709 13:13:41.535039 29346 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:41.403910  2105 raft_consensus.cc:740] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:41.403105  2106 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:41.468842  2013 raft_consensus.cc:1081] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Signalling peer 183db85c071f489fbc8de63a9edd8a3a to start an election
I20260709 13:13:41.539434 29346 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:41.498359  2148 log.cc:927] Time spent T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 13:13:41.542078 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:41.501524  2070 consensus_meta.cc:287] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.883s	user 0.011s	sys 0.003s
I20260709 13:13:41.538448 29278 catalog_manager.cc:5697] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 15 to 16, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 16 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:41.523626  2030 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:41.495172  2102 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:41.536065 29521 raft_consensus.cc:2955] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 5 to 8, VOTER 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:13:41.564571 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:41.526765 29525 rpcz_store.cc:276] 0709 13:13:40.204265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.205114 (+   849us) service_pool.cc:224] Handling call
0709 13:13:40.205647 (+   533us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:40.295055 (+ 89408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.295089 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:40.312516 (+ 17427us) log.cc:844] Serialized 26 byte log entry
0709 13:13:40.704678 (+392162us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:40.704745 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.704856 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:41.475200 (+770344us) raft_consensus.cc:1685] finished
0709 13:13:41.475226 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:41.475403 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":115157,"raft.queue_time_us":160587,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":41659,"thread_start_us":232765,"threads_started":1,"wal-append.queue_time_us":997267}
I20260709 13:13:41.444737  2001 raft_consensus.cc:515] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:41.470523  1966 raft_consensus.cc:493] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:41.571108 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:41.572299 29530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3678) took 1772 ms. Trace:
I20260709 13:13:41.496371  2124 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:41.481652  2038 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:41.373412  2094 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:41.549448  1790 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:41.474731  2064 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:41.479722  2095 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:41.464267  2144 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:41.516057  2077 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:41.572747 29530 rpcz_store.cc:276] 0709 13:13:39.799911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.800071 (+   160us) service_pool.cc:224] Handling call
0709 13:13:39.800518 (+   447us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:39.884341 (+ 83823us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:39.884581 (+   240us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:39.924935 (+ 40354us) log.cc:844] Serialized 52 byte log entry
0709 13:13:40.729110 (+804175us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:40.729160 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:40.729235 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:41.572047 (+842812us) raft_consensus.cc:1685] finished
0709 13:13:41.572072 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:41.572229 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75640,"raft.queue_time_us":258218,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":39007,"thread_start_us":623113,"threads_started":2,"wal-append.queue_time_us":1038219}
W20260709 13:13:41.660512 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 69111.4us
I20260709 13:13:41.591286 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:41.456117  2071 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:41.511842  2078 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:41.564918  2141 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:41.592518 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:41.588107 29278 catalog_manager.cc:5697] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 10 to 12, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 12 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:41.498769  2015 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:41.574389  2030 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:41.623988 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:41.578207  1983 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:13:41.590636  2101 consensus_meta.cc:287] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.926s	user 0.014s	sys 0.002s
I20260709 13:13:41.603791  1805 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:41.577732  2105 consensus_queue.cc:260] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:41.698020 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:41.583775  1966 raft_consensus.cc:515] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:41.568269  2070 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:41.595332  2038 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:41.684943 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:41.574604  2012 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:41.688021 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 206855us
W20260709 13:13:41.667167  2111 consensus_meta.cc:287] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 1.053s	user 0.011s	sys 0.007s
W20260709 13:13:41.692701 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 178792us
I20260709 13:13:41.660048  2128 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:41.695722 29346 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:41.555749  2106 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:41.660672  2102 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:41.719933 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:41.698266  1977 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:41.587885  2124 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:41.706080  2105 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:41.742031 29278 catalog_manager.cc:5697] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 10 to 12, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 12 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
W20260709 13:13:41.746258 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:41.778898 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:41.697897  1805 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:41.730252  2038 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:41.742170  2132 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:41.662014  2095 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:41.666501  2064 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:13:41.771749  2119 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.005s	sys 0.009s
I20260709 13:13:41.862411 29278 catalog_manager.cc:5697] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 9 to 10, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 10 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:41.689198  2141 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:41.860435 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:41.868176 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:41.867815 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:41.777223  2146 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:13:41.902716 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 207321us
I20260709 13:13:41.904095 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:41.916414 29523 raft_consensus.cc:2393] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 13: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:41.819216  2038 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:41.779199  2012 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:41.922822 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:41.820407  1900 raft_consensus.cc:493] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
W20260709 13:13:41.870487  2119 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.128s	user 0.006s	sys 0.009s
I20260709 13:13:41.928440  2078 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:41.928696 29346 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:41.929114  2124 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:41.813495  1967 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:41.781220  2128 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:41.939327 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:41.905767  2101 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:41.869544  2088 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:41.814709  1977 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:41.799839  2102 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:41.874866 29278 catalog_manager.cc:5697] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 11 to 12, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 12 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
W20260709 13:13:41.926406 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 151286us
I20260709 13:13:41.901502  1790 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:41.910851  1983 raft_consensus.cc:697] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:13:41.935241  2140 consensus_meta.cc:287] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.603s	user 0.008s	sys 0.006s
W20260709 13:13:41.903384  2145 log.cc:927] Time spent T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
I20260709 13:13:41.962409 29525 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:41.940632 29523 raft_consensus.cc:2393] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 15: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:41.919483  2151 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:41.936331 29346 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:41.929791  2124 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:41.947839  2088 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:41.936991  1900 raft_consensus.cc:515] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:41.929159  2078 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:41.977309  2078 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:41.979131  2070 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:41.980309  2152 log.cc:927] Time spent T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 13:13:41.982633  2098 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:41.959275  2103 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:41.985212 29524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3692) took 1266 ms. Trace:
W20260709 13:13:41.985414  2149 log.cc:927] Time spent T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.299s	user 0.000s	sys 0.002s
I20260709 13:13:41.985713 29524 rpcz_store.cc:276] 0709 13:13:40.718730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.718894 (+   164us) service_pool.cc:224] Handling call
0709 13:13:40.743248 (+ 24354us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:40.743703 (+   455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:40.743738 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:40.758312 (+ 14574us) log.cc:844] Serialized 52 byte log entry
0709 13:13:41.352379 (+594067us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:41.607853 (+255474us) log.cc:844] Serialized 14 byte log entry
0709 13:13:41.662079 (+ 54226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:41.662192 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:41.984955 (+322763us) raft_consensus.cc:1685] finished
0709 13:13:41.984980 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:41.985143 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4224,"prepare.queue_time_us":356494,"prepare.run_cpu_time_us":108,"prepare.run_wall_time_us":8822,"raft.queue_time_us":5495,"raft.run_cpu_time_us":471,"raft.run_wall_time_us":90835,"thread_start_us":647933,"threads_started":2,"wal-append.queue_time_us":697004}
I20260709 13:13:41.985245  2103 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:41.988698  2095 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:41.989441  2071 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:41.949206  2015 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:41.902035  2132 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:41.950387  2153 log.cc:927] Time spent T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 13:13:41.791747  2162 consensus_queue.cc:1059] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.140s
I20260709 13:13:41.955874 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:42.013926 29530 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 15.
I20260709 13:13:41.929734  2120 leader_election.cc:290] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:41.938107  2161 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:13:41.969405 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:41.971446  2012 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:41.971953  1983 consensus_queue.cc:237] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:41.972034  2124 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:41.973897  1805 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:41.974462  2088 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:41.998005  2013 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:41.993489  2071 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:41.976671  1900 leader_election.cc:290] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:13:41.991741 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 55555us
I20260709 13:13:42.039958 29278 catalog_manager.cc:5697] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:41.999580 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:42.000327 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:42.000730  2132 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:42.042903 29381 raft_consensus.cc:1240] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:13:42.043812 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:42.044111 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:42.044524 29374 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:42.044682 29378 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:42.001067  2103 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:42.001574  2078 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:42.001637 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:42.048712 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:41.962875  2140 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:42.006232  2030 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:42.008879  2102 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:41.918569  2146 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:42.010556  2015 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:42.011690  2060 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:42.012558 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:42.073887 29452 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:42.015977 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:42.017077 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:42.020041 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:41.962564  2094 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:42.025503 29522 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 15.
W20260709 13:13:42.029074 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 70161us
I20260709 13:13:41.988721  2106 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:42.010614  1901 consensus_meta.cc:287] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.853s	user 0.012s	sys 0.000s
I20260709 13:13:41.959470  1790 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:42.031126 29449 raft_consensus.cc:1240] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:42.031814 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:41.975764  2064 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:42.011361  2095 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:42.045140 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:42.100394 29530 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:13:41.965622  2101 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:42.043378 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:42.002297  2128 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:42.049050 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:42.024005  2144 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:42.058363 29376 raft_consensus.cc:1275] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:13:42.106595 29375 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:42.061275 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:42.042827  2013 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:42.037082  1966 leader_election.cc:290] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:42.072754 29378 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16.
I20260709 13:13:42.078181 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:42.082329 29381 raft_consensus.cc:2393] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 15: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:42.086009 29528 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 15.
I20260709 13:13:42.047313  2071 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:42.111016 29523 raft_consensus.cc:2368] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 15. Current term is 16.
I20260709 13:13:42.055186  2077 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:42.093629 29452 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16.
W20260709 13:13:42.095925 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:42.053639  1805 consensus_queue.cc:1059] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:13:42.053787  1977 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:42.109413 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:42.113853 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:42.114192 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:42.136441 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:42.136893 29376 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:42.137256 29452 raft_consensus.cc:2468] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 11.
I20260709 13:13:42.137555 29378 raft_consensus.cc:2410] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:13:42.114825 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
W20260709 13:13:42.115001  2154 log.cc:927] Time spent T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.385s	user 0.000s	sys 0.003s
I20260709 13:13:42.119684  2172 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:42.138417 30121 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:42.121186  2171 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:42.121878 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:42.122628  2157 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:42.114825 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:42.139292 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:42.127525  2141 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:42.140972 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:42.175431 29376 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 15.
I20260709 13:13:42.143648 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:42.146390  2140 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:42.112198  2095 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:42.086944  2030 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:42.188942 29344 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:42.152808 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:42.190292 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:42.191555 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:42.154086 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:42.157549 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
W20260709 13:13:42.158836 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:42.158782  2124 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:42.159675  1694 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:42.120326  2089 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:42.166476 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:42.172816 29379 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:42.173676  2110 raft_consensus.cc:2804] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:42.174001 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:42.176729 29447 raft_consensus.cc:2468] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 8.
I20260709 13:13:42.129392  2013 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:42.179257 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:42.179677 29278 catalog_manager.cc:5697] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 9 to 10, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 10 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:42.083844  2015 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:42.183147 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:42.184278 29456 raft_consensus.cc:1240] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:13:42.207890 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:42.083842  2060 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:42.207898 29376 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:42.181879  2084 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.201624  2169 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:42.203022 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:42.214113 29377 raft_consensus.cc:2368] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 15. Current term is 16.
I20260709 13:13:42.199965 29378 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:42.211485 29375 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
I20260709 13:13:42.211853 29523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37968 (request call id 3695) took 1492 ms. Trace:
I20260709 13:13:42.218679 29523 rpcz_store.cc:276] 0709 13:13:40.719563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.189240 (+1469677us) service_pool.cc:224] Handling call
0709 13:13:42.211763 (+ 22523us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:42.222015  2075 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:42.223592  2169 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:42.224129  2169 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:42.222064 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:42.227257 29377 raft_consensus.cc:2410] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:13:42.220433 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:42.232084  2128 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:42.232862  2128 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:42.233260 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:42.227119 30121 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:42.240661 29450 raft_consensus.cc:1240] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:42.242818 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:42.243479 29375 raft_consensus.cc:1240] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:13:42.243419 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:42.244463 29530 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 14.
I20260709 13:13:42.245133 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:42.245680 29419 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:42.245925 29524 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:42.174446  2172 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:42.251925  2124 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:42.252586  2124 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:42.255115 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:42.256002 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:42.256714  2128 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:42.258178 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:42.258920 29523 raft_consensus.cc:2468] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 3.
I20260709 13:13:42.261404 29419 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:42.262385  2077 raft_consensus.cc:2749] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:42.263125  2077 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:13:42.264253 29521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3668) took 2606 ms. Trace:
I20260709 13:13:42.264384  2172 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:42.264719 29521 rpcz_store.cc:276] 0709 13:13:39.658205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.662851 (+  4646us) service_pool.cc:224] Handling call
0709 13:13:39.663428 (+   577us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:39.914057 (+250629us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:39.914097 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:39.941482 (+ 27385us) log.cc:844] Serialized 534 byte log entry
0709 13:13:41.322501 (+1381019us) spinlock_profiling.cc:243] Waited 25.4 ms on lock 0x7b180033dae0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c7be07 00007f6a81ad6ab9 00007f6a78c9869b 00007f6a78c9693f 00007f6a78c98c02 00007f6a7b92020b 00007f6a7b925d23 00007f6a7b9260d1 00007f6a7bd41a0f
0709 13:13:41.535891 (+213390us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:41.661746 (+125855us) log.cc:844] Serialized 14 byte log entry
0709 13:13:41.801937 (+140191us) log.cc:844] Serialized 14 byte log entry
0709 13:13:41.802783 (+   846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:41.803206 (+   423us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:42.005934 (+202728us) spinlock_profiling.cc:243] Waited 9.9 ms on lock 0x7b4800150258. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a80cafaa1 00007f6a80ca6b37 00007f6a80ca69ca 00007f6a80d9e26f 00007f6a80d9df37 00007f6a80db255c 00007f6a80db2508 00007f6a80db2488 00007f6a80db2443 00007f6a80db16ec 00007f6a7fcdba96
0709 13:13:42.012004 (+  6070us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:13:42.162691 (+150687us) spinlock_profiling.cc:243] Waited 50.2 ms on lock 0x7b180033dae0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c99522 00007f6a78c9b7c1 00007f6a78c9b779 00007f6a78c9b709 00007f6a78c9b6d1 00007f6a78c9a9cd 000000000038f354 000000000038f199 00007f6a78c7c83a
0709 13:13:42.263956 (+101265us) raft_consensus.cc:1685] finished
0709 13:13:42.263992 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:42.264155 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65891,"prepare.queue_time_us":115360,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":61,"raft.queue_time_us":273877,"raft.run_cpu_time_us":2949,"raft.run_wall_time_us":354298,"spinlock_wait_cycles":252018432,"thread_start_us":558067,"threads_started":3,"wal-append.queue_time_us":1640259}
I20260709 13:13:42.267118 29377 raft_consensus.cc:1240] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:13:42.261224 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:42.269189 29450 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:42.266940 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:42.273048 29523 raft_consensus.cc:2393] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 17: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:42.177736  2171 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:42.276760 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:42.286152 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:42.281505  2169 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:42.287041 29452 raft_consensus.cc:2393] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 15: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:42.288167  2071 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:42.288772  2169 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:42.290601  2095 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:42.292143 29524 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:13:42.267590 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:42.293464  2146 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:42.293718 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:42.294064 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:42.294375 29521 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:13:42.187521  2157 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:42.295346 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:42.204447 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:42.296294 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:42.204885  2110 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:42.284541 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:42.285055 29523 raft_consensus.cc:2393] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 16: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:42.284546 29344 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:42.314193 29344 leader_election.cc:304] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:42.300534 29525 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 15.
I20260709 13:13:42.269331 29377 raft_consensus.cc:1240] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:42.309746 29378 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 15.
I20260709 13:13:42.316774 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:42.316887 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:42.317953 29377 raft_consensus.cc:2393] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 16: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:42.318499 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:42.319568 29378 raft_consensus.cc:2393] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 19: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:42.329011 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:42.319937 29379 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
I20260709 13:13:42.326555 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:42.326913  2171 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:42.312274 29278 catalog_manager.cc:5697] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 7 to 9, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 9 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
W20260709 13:13:42.282241  1764 consensus_meta.cc:287] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.746s	user 0.015s	sys 0.000s
I20260709 13:13:42.321591 29344 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:42.197201  2030 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:42.329811 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:42.342029 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:42.321954 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:42.332669 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:42.343389 29379 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:42.343668 29372 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
I20260709 13:13:42.334280  2105 consensus_queue.cc:1059] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:42.336830 29523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3693) took 1617 ms. Trace:
I20260709 13:13:42.338259 29521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3694) took 1619 ms. Trace:
I20260709 13:13:42.340734 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:42.340395 29278 catalog_manager.cc:5697] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 12 to 13, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 13 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:42.346598 29523 rpcz_store.cc:276] 0709 13:13:40.719055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.336001 (+1616946us) service_pool.cc:224] Handling call
0709 13:13:42.336303 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:42.336502 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:42.336529 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:42.336572 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:42.336605 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.336661 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:42.336766 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:42.331632 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:42.348362 29524 raft_consensus.cc:2410] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:13:42.314822  2110 raft_consensus.cc:3060] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:42.346575 29377 raft_consensus.cc:2468] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
W20260709 13:13:42.358256 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:42.346874 29521 rpcz_store.cc:276] 0709 13:13:40.719298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.337445 (+1618147us) service_pool.cc:224] Handling call
0709 13:13:42.337750 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:42.337938 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:42.337964 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:42.338008 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:42.338037 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.338105 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:42.338201 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:42.355216 29379 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 12.
I20260709 13:13:42.355346 29447 raft_consensus.cc:2393] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 15: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:42.310220  2128 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:42.357137 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:42.359201 29375 raft_consensus.cc:1240] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:13:42.359826 29278 catalog_manager.cc:5697] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:42.328914  2146 raft_consensus.cc:2804] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:42.362142 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:42.363922 29344 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:42.371156 29278 catalog_manager.cc:5697] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:42.330480  2169 raft_consensus.cc:2804] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:13:42.375838 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:42.377068 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:42.377744 29452 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:13:42.372601 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:42.373093 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:42.370988 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:42.380975 29376 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 13.
W20260709 13:13:42.381834 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:42.382038 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:42.382941 29456 raft_consensus.cc:2393] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 15: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:42.383385 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:42.384196 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:42.384822 29456 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 15.
I20260709 13:13:42.386021 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:42.386631  2105 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:42.208602  2089 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:42.386078 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:42.387342  2105 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:42.376327  2169 raft_consensus.cc:493] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:42.394948  2031 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:42.395572 29527 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 15.
I20260709 13:13:42.396685 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:42.398524 29278 catalog_manager.cc:5697] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 12 to 14, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 14 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:42.399147 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:42.374735  2146 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:42.238145  2084 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:42.378191  1900 raft_consensus.cc:493] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:42.418366 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:42.413379 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:42.419688 29452 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
I20260709 13:13:42.413244 29278 catalog_manager.cc:5697] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 7 to 10, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 10 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:42.381156  2144 raft_consensus.cc:2804] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:42.416889 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:42.388650  2132 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.428498 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:42.423982 29523 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
I20260709 13:13:42.425249 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:42.400429  1983 raft_consensus.cc:2804] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:42.404618  1790 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:42.433616 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:42.400382  2151 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:42.405326  2169 raft_consensus.cc:3060] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:42.448845 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:42.449200 29529 raft_consensus.cc:2393] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 13: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:42.423151  2144 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:42.437273 29455 raft_consensus.cc:1275] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
W20260709 13:13:42.431459 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:42.453825 29455 pending_rounds.cc:85] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 9
I20260709 13:13:42.439208 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:42.454164 29455 pending_rounds.cc:107] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:13:42.372097  2128 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:42.412804  2146 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:42.436812 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:13:42.454332 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:42.454578 29455 raft_consensus.cc:2889] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:42.458758 29495 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:42.453977  2111 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:42.462344  1977 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:42.462270  2111 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:42.463030  1977 raft_consensus.cc:697] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:42.463833  2079 raft_consensus.cc:2804] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:42.464547  2079 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:42.465159  2079 raft_consensus.cc:3060] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:42.464648  1977 consensus_queue.cc:237] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:42.466928 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:42.470108  2105 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:42.471642  1764 consensus_queue.cc:1059] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:42.473744  2111 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:42.474032  2015 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:42.474332  2128 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:42.477080 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:42.477824 29523 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 15.
I20260709 13:13:42.475276 29495 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:42.478801 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:42.485843 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:42.418637  2038 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:42.492740 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:42.489629 29524 raft_consensus.cc:2410] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:13:42.491082 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:42.494781 29447 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
I20260709 13:13:42.495760 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:42.493628 29495 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:42.494956  2001 leader_election.cc:290] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:42.497861 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:42.501739 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:42.457347  2144 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:42.506291 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:42.504189 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:42.514266 29450 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:42.516402 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:42.517155 29523 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
I20260709 13:13:42.515458 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:42.519095 29450 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:42.435366  1900 raft_consensus.cc:515] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:42.434788  2132 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:42.475665  2084 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:42.523044 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:42.523917 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:42.525463 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:42.500773  2098 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:42.500644  1764 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:42.527556  2030 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:42.527710  2060 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:42.528555 29448 raft_consensus.cc:2393] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 16: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:42.530144  2038 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:42.531383 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:42.540102 29456 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16.
I20260709 13:13:42.475139  2128 consensus_queue.cc:1048] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:13:42.534822 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:42.562155 29526 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
I20260709 13:13:42.562469 29524 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:42.564679 29495 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:42.536262 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:42.572252 29346 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:42.574208 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:42.521059  1966 raft_consensus.cc:2804] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:42.570217 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:42.579392 29529 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 19.
I20260709 13:13:42.582662 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:42.455384  2151 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:42.583448 29450 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:13:42.585831 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:42.562856  1697 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:42.593909 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:42.537997  2157 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:42.571022  1764 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:42.555809  2001 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:42.610567 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:42.606736 29524 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:13:42.607978 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:42.612210 29452 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:42.612643 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:42.613283 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:42.613545 29450 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:42.602018 29456 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
I20260709 13:13:42.615279 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:42.616132 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:42.617100 29456 raft_consensus.cc:2410] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:13:42.600158 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:42.618430 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:42.619997 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:42.621203 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:42.622390 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:42.615579 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:42.601155  1697 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:42.625044 29452 raft_consensus.cc:2393] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 16: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:42.624485 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:42.581089  2105 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:42.576597 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:42.583982  1966 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:42.628875 29344 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:42.626565 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:42.611020  1764 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:42.634924 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:42.635443 29456 raft_consensus.cc:2393] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 15: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:42.635892 29524 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 18.
I20260709 13:13:42.638903 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:42.640801 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:42.601490 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:42.641849 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:42.645519 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:42.646248 29524 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
I20260709 13:13:42.646831 29529 raft_consensus.cc:2393] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 16: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:42.641819 29523 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 15.
I20260709 13:13:42.575556  2098 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:42.633993  1966 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:42.640663  2105 raft_consensus.cc:697] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:42.652674 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:42.640519  2089 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:42.659771 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:42.662171  2132 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:42.665724 29529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3696) took 1945 ms. Trace:
I20260709 13:13:42.631095  2001 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:42.681421 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:42.680322  2105 consensus_queue.cc:237] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:42.703846 29524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3697) took 1983 ms. Trace:
I20260709 13:13:42.704658 29524 rpcz_store.cc:276] 0709 13:13:40.720053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.693748 (+1973695us) service_pool.cc:224] Handling call
0709 13:13:42.703143 (+  9395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:42.703425 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:42.703465 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:42.703548 (+    83us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:42.703582 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.703646 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:42.703775 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:42.706703 29524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53428 (request call id 805) took 1966 ms. Trace:
I20260709 13:13:42.708669 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:42.709115  2098 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:42.709529 29380 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:42.711172 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:42.707078 29524 rpcz_store.cc:276] 0709 13:13:40.740031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.705804 (+1965773us) service_pool.cc:224] Handling call
0709 13:13:42.706177 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:42.706369 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:42.706394 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:42.706435 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:42.706466 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.706519 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:42.706638 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:42.691227 29529 rpcz_store.cc:276] 0709 13:13:40.719813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.659219 (+1939406us) service_pool.cc:224] Handling call
0709 13:13:42.664392 (+  5173us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:42.664683 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:42.664723 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:42.664791 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:42.664835 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.665403 (+   568us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:42.665619 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:42.716909 29528 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37958 (request call id 2033) took 1972 ms (client timeout 1582 ms). Trace:
W20260709 13:13:42.720170 29528 rpcz_store.cc:269] 0709 13:13:40.738287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.050510 (+312223us) service_pool.cc:224] Handling call
0709 13:13:42.710690 (+1660180us) spinlock_profiling.cc:243] Waited 593 ms on lock 0x7b54002bb954. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:42.710820 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1362787712}
I20260709 13:13:42.722384 29528 raft_consensus.cc:1240] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:42.723155 29528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 2038) took 1981 ms. Trace:
I20260709 13:13:42.693810 29523 raft_consensus.cc:2393] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 17: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:42.723519 29528 rpcz_store.cc:276] 0709 13:13:40.741592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.721850 (+1980258us) service_pool.cc:224] Handling call
0709 13:13:42.722182 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:42.722868 (+   686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.723095 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:42.717329  2098 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:42.742914 29380 raft_consensus.cc:2410] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:13:42.764469 29529 raft_consensus.cc:1240] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:13:42.766633 29529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 2042) took 2024 ms. Trace:
I20260709 13:13:42.767055 29529 rpcz_store.cc:276] 0709 13:13:40.743070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.736026 (+1992956us) service_pool.cc:224] Handling call
0709 13:13:42.764224 (+ 28198us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:42.766239 (+  2015us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.766559 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:42.768726 29529 raft_consensus.cc:1240] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:42.769601 29529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 2044) took 1443 ms. Trace:
I20260709 13:13:42.770012 29529 rpcz_store.cc:276] 0709 13:13:41.326089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.768189 (+1442100us) service_pool.cc:224] Handling call
0709 13:13:42.768551 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:42.769296 (+   745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.769533 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:42.772728 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:42.774101 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:42.777534 29448 raft_consensus.cc:3055] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:42.777956 29448 raft_consensus.cc:740] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:42.760880  2098 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:42.780678  2098 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:42.780593 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:13:42.782581  2184 log.cc:927] Time spent T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.156s	user 0.003s	sys 0.000s
I20260709 13:13:42.783437 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:42.784430 29526 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37958 (request call id 2034) took 2045 ms (client timeout 1584 ms). Trace:
I20260709 13:13:42.784613 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:42.784837 29526 rpcz_store.cc:269] 0709 13:13:40.740369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.178849 (+438480us) service_pool.cc:224] Handling call
0709 13:13:42.784257 (+1605408us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400101dd4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:42.784357 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3037705088}
I20260709 13:13:42.785705 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:42.786334 29526 raft_consensus.cc:1240] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:13:42.786749 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:42.787055 29526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 2047) took 1417 ms. Trace:
I20260709 13:13:42.789608  2161 raft_consensus.cc:3055] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:42.790177  2161 raft_consensus.cc:740] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:13:42.793191 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:42.799844 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:42.800484  2185 log.cc:927] Time spent T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:13:42.801316 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:42.802564 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:42.803515  2111 raft_consensus.cc:3055] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:13:42.804093  2111 raft_consensus.cc:740] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:42.805642  2111 consensus_queue.cc:260] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:42.811403  1900 leader_election.cc:290] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:42.812438  2151 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:42.812863 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:42.900744 29380 raft_consensus.cc:1813] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Handling vote request from an unknown peer 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:42.901466 29380 raft_consensus.cc:2410] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:13:42.721043  2013 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:42.820587  2001 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:42.824250 29455 raft_consensus.cc:1275] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:13:42.824664 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:42.926447 29378 raft_consensus.cc:2393] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 15: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:42.826057 29372 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:13:42.927145 29372 raft_consensus.cc:606] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:42.927397 29521 raft_consensus.cc:1240] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 15 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:13:42.927569 29372 raft_consensus.cc:614] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:42.928252 29521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 2048) took 1557 ms. Trace:
I20260709 13:13:42.778836 29448 consensus_queue.cc:260] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:42.928613 29521 rpcz_store.cc:276] 0709 13:13:41.370496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.871186 (+1500690us) service_pool.cc:224] Handling call
0709 13:13:42.927100 (+ 55914us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:42.927933 (+   833us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.928169 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:42.929214 29448 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:42.835341  1983 raft_consensus.cc:697] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:42.940806  1983 consensus_queue.cc:237] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:42.840423  2168 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:13:42.840376 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 268200us
I20260709 13:13:42.944481 29346 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:42.945888 29346 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:42.841420 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 212634us
I20260709 13:13:42.947870 29451 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5"
dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:45798
I20260709 13:13:42.948635 29451 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:42.948997 29451 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:42.842024  2081 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:42.951653  1987 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:42.951860  2081 raft_consensus.cc:697] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:42.952953  2081 consensus_queue.cc:237] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:42.957841  1764 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:42.842751 29376 raft_consensus.cc:1240] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:42.960319 29376 raft_consensus.cc:1275] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:13:42.961627 29376 raft_consensus.cc:1240] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:42.962653  2146 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:42.963776  2067 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:42.964238  2067 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:42.964649  2067 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:42.947140 29346 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:42.843884 30155 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54234 (request call id 282) took 2105 ms. Trace:
I20260709 13:13:42.969106 30155 rpcz_store.cc:276] 0709 13:13:40.738840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:40.760319 (+ 21479us) service_pool.cc:224] Handling call
0709 13:13:40.958390 (+198071us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:41.242936 (+284546us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:41.263586 (+ 20650us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:41.266161 (+  2575us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:41.271554 (+  5393us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.843470 (+1571916us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b5400629dd4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:42.843568 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:42.843761 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":646509824}
I20260709 13:13:42.969805 29346 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:42.846316 29525 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37958 (request call id 2046) took 1485 ms (client timeout 1631 ms). Trace:
W20260709 13:13:42.971077 29525 rpcz_store.cc:269] 0709 13:13:41.360712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.589703 (+228991us) service_pool.cc:224] Handling call
0709 13:13:42.845817 (+1256114us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b5400102cd4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:42.846180 (+   363us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":659423488}
I20260709 13:13:42.972469 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:42.973235 29525 raft_consensus.cc:2468] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:13:42.973304 29346 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:42.974159  2025 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:42.974782  2025 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:42.850384 29379 raft_consensus.cc:1240] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:42.857898  1966 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:42.859419  2144 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:42.977698  2146 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:42.980368  2144 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:42.981369 29523 raft_consensus.cc:1240] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:42.896474  2039 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:42.982029  1764 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:42.982553  2039 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:42.862125  1741 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:42.865062  2124 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:42.868533 29530 raft_consensus.cc:1240] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 16. Current term is 17. Ops: []
W20260709 13:13:42.869302 29527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37958 (request call id 2031) took 2131 ms (client timeout 1669 ms). Trace:
I20260709 13:13:42.873912  2105 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:42.984732  2039 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:42.985252 29374 raft_consensus.cc:2393] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 18: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:42.985025  2105 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:42.902649  2080 raft_consensus.cc:3055] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:42.985965  2080 raft_consensus.cc:740] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:42.878496 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:42.986841  2080 consensus_queue.cc:260] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:42.787433 29526 rpcz_store.cc:276] 0709 13:13:41.370075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.785726 (+1415651us) service_pool.cc:224] Handling call
0709 13:13:42.786075 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:42.786787 (+   712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.787000 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:42.885787 29524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 2036) took 2144 ms. Trace:
I20260709 13:13:42.763271 29528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 2040) took 2021 ms. Trace:
I20260709 13:13:42.771445 29529 raft_consensus.cc:1240] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 18. Current term is 19. Ops: []
I20260709 13:13:42.990095 29529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 2045) took 1630 ms. Trace:
I20260709 13:13:42.989279 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:42.814466 29522 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37958 (request call id 2032) took 2076 ms (client timeout 1771 ms). Trace:
I20260709 13:13:42.904101 29421 leader_election.cc:400] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 15. Current term is 16.
I20260709 13:13:42.989481 29528 rpcz_store.cc:276] 0709 13:13:40.742070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.724240 (+1982170us) service_pool.cc:224] Handling call
0709 13:13:42.762518 (+ 38278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:42.762781 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:42.762819 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:42.762882 (+    63us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:42.762928 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.763027 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:42.763198 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:42.834131 29419 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:42.900390  2157 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:42.933825 29454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 1849) took 3297 ms. Trace:
I20260709 13:13:42.936347 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:42.938125  2161 consensus_queue.cc:260] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:42.983939  1741 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:42.991705 29522 rpcz_store.cc:269] 0709 13:13:40.738054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.411193 (+673139us) service_pool.cc:224] Handling call
0709 13:13:42.814178 (+1402985us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b540019f354. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:42.814352 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":700043136}
W20260709 13:13:43.020259 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 186212us
I20260709 13:13:43.001055 29346 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:43.021158 29419 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:42.987152 29523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 2049) took 1616 ms. Trace:
I20260709 13:13:42.977823  1966 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:42.992869 29421 leader_election.cc:403] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
W20260709 13:13:42.992915 29493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 67320.3us
I20260709 13:13:42.990861 29529 rpcz_store.cc:276] 0709 13:13:41.360197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.770908 (+1410711us) service_pool.cc:224] Handling call
0709 13:13:42.771272 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:42.989704 (+218432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.990015 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:43.030808 29530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 2035) took 2290 ms. Trace:
I20260709 13:13:43.031306 29530 rpcz_store.cc:276] 0709 13:13:40.740657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.707886 (+1967229us) service_pool.cc:224] Handling call
0709 13:13:42.708270 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:42.984085 (+275815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:43.030543 (+ 46458us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54000a3a54. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:43.030737 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":368008448}
I20260709 13:13:42.911459 29495 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:43.020714 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:43.033289 29522 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:13:43.033555 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 135683us
I20260709 13:13:43.034792 29421 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:43.021970 29523 rpcz_store.cc:276] 0709 13:13:41.370829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.896312 (+1525483us) service_pool.cc:224] Handling call
0709 13:13:42.896682 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:42.981950 (+ 85268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.986486 (+  4536us) spinlock_profiling.cc:243] Waited 84.4 ms on lock 0x7b54000b72d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:42.987061 (+   575us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":194183552}
I20260709 13:13:43.037184 29523 raft_consensus.cc:1240] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:43.038044 29523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3705) took 1486 ms. Trace:
I20260709 13:13:43.038427 29523 rpcz_store.cc:276] 0709 13:13:41.551935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.036381 (+1484446us) service_pool.cc:224] Handling call
0709 13:13:43.036872 (+   491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:43.037752 (+   880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:43.037973 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:42.991360 29526 raft_consensus.cc:2410] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:13:43.040973 29526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3707) took 1488 ms. Trace:
I20260709 13:13:43.041761 29521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 2052) took 1655 ms. Trace:
I20260709 13:13:43.041640 29419 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:43.041556 29526 rpcz_store.cc:276] 0709 13:13:41.552763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.039986 (+1487223us) service_pool.cc:224] Handling call
0709 13:13:43.040265 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:43.040480 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:43.040508 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:43.040581 (+    73us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:43.040641 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:43.040729 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:43.040883 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:43.042174 29521 rpcz_store.cc:276] 0709 13:13:41.385993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.929421 (+1543428us) service_pool.cc:224] Handling call
0709 13:13:43.041023 (+111602us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:43.041322 (+   299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:43.041349 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:43.041391 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:43.041422 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:43.041593 (+   171us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:43.041706 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:43.023773 29344 leader_election.cc:304] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:43.046073 29526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3710) took 1492 ms. Trace:
I20260709 13:13:43.024158 29381 raft_consensus.cc:1240] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:43.025251 29454 rpcz_store.cc:276] 0709 13:13:39.636430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.636902 (+   472us) service_pool.cc:224] Handling call
0709 13:13:39.643729 (+  6827us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:40.540486 (+896757us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.933513 (+2393027us) spinlock_profiling.cc:243] Waited 892 ms on lock 0x7b54000195d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:42.933730 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2050658688}
I20260709 13:13:42.989001 29524 rpcz_store.cc:276] 0709 13:13:40.740896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.720217 (+1979321us) service_pool.cc:224] Handling call
0709 13:13:42.720726 (+   509us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:42.722344 (+  1618us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:42.722391 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:42.723075 (+   684us) log.cc:844] Serialized 26 byte log entry
0709 13:13:42.884771 (+161696us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:42.884821 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.884906 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:42.884983 (+    77us) raft_consensus.cc:1685] finished
0709 13:13:42.884998 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:42.885687 (+   689us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":844,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":10199,"thread_start_us":161359,"threads_started":1,"wal-append.queue_time_us":144335}
I20260709 13:13:43.046073 29523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3706) took 1493 ms. Trace:
I20260709 13:13:43.052587 29419 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:43.053418 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 52474.7us
I20260709 13:13:43.054311 29373 raft_consensus.cc:1240] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 16. Current term is 17. Ops: [12.7-16.9]
I20260709 13:13:43.054694 29346 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:43.048636 29451 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:42.902421  2056 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:43.053138 29523 rpcz_store.cc:276] 0709 13:13:41.552398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.039266 (+1486868us) service_pool.cc:224] Handling call
0709 13:13:43.045575 (+  6309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:43.045744 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:43.045766 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:43.045798 (+    32us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:43.045824 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:43.045875 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:43.046005 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41728}
I20260709 13:13:43.057106 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:43.049109 29526 rpcz_store.cc:276] 0709 13:13:41.553703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.043371 (+1489668us) service_pool.cc:224] Handling call
0709 13:13:43.045415 (+  2044us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:43.045721 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:43.045752 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:43.045793 (+    41us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:43.045825 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:43.045907 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:43.046004 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:43.058248 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:42.984375 29527 rpcz_store.cc:269] 0709 13:13:40.737805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:41.411295 (+673490us) service_pool.cc:224] Handling call
0709 13:13:42.869023 (+1457728us) spinlock_profiling.cc:243] Waited 900 ms on lock 0x7b54002bbe54. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:42.869195 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2070513536}
I20260709 13:13:43.059082 29525 raft_consensus.cc:2393] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 14: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:42.901881  2085 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:43.061295 29346 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:43.066632 29419 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:43.070483 29521 raft_consensus.cc:1275] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:13:43.071131 29521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3711) took 1517 ms. Trace:
I20260709 13:13:42.931002  2111 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:43.071419 29521 rpcz_store.cc:276] 0709 13:13:41.554016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.043924 (+1489908us) service_pool.cc:224] Handling call
0709 13:13:43.070112 (+ 26188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:43.070908 (+   796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:43.071084 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:43.084434 29522 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:13:43.085364 29528 raft_consensus.cc:1240] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:43.085665 29451 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:43.056982  2084 raft_consensus.cc:2749] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:43.082501 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:43.090013 29529 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:43.091899 29448 raft_consensus.cc:1275] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
W20260709 13:13:43.074110 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 162799us
I20260709 13:13:42.987473  2105 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:43.019361  2162 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:43.080974 29530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3704) took 1540 ms. Trace:
I20260709 13:13:43.050418  2014 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 15. Current term is 16.
I20260709 13:13:43.042636  2039 raft_consensus.cc:2749] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:13:43.093848 29530 rpcz_store.cc:276] 0709 13:13:41.540748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.032356 (+1491608us) service_pool.cc:224] Handling call
0709 13:13:43.067641 (+ 35285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:43.080592 (+ 12951us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:43.080621 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:43.080665 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:43.080697 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:43.080759 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:43.080906 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:43.051717  2080 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:43.094941 29448 pending_rounds.cc:85] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 7
I20260709 13:13:43.133824 29448 pending_rounds.cc:107] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:13:43.134173 29448 raft_consensus.cc:2889] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:43.065380  2151 raft_consensus.cc:2749] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:43.086951  2124 raft_consensus.cc:2749] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:43.095939  2188 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:43.096238  2089 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:43.097435  2084 consensus_queue.cc:1059] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:13:43.060469  1993 raft_consensus.cc:2749] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:43.079850  2085 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:43.077446  2167 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:13:43.108523  2013 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:43.162523  2196 log.cc:927] Time spent T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:13:43.112068 29495 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:13:43.115358 29493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 86887.5us
I20260709 13:13:43.068447  2064 raft_consensus.cc:2749] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:43.124028  2038 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:43.039765  2157 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:43.125200  1900 consensus_queue.cc:1059] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:43.128363  1697 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:43.068900  2184 log.cc:927] Time spent T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:13:43.062405  2144 raft_consensus.cc:2804] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:43.064845  2086 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:13:43.081652  2169 consensus_meta.cc:287] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.604s	user 0.013s	sys 0.000s
W20260709 13:13:43.056218  2110 consensus_meta.cc:287] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent flushing consensus metadata: real 0.665s	user 0.015s	sys 0.000s
I20260709 13:13:43.066712  2056 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:43.109300  1999 raft_consensus.cc:3055] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:13:43.195567 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 129006us
I20260709 13:13:43.268595 29419 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:43.206452 29528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 2058) took 1740 ms. Trace:
I20260709 13:13:43.271857 29528 rpcz_store.cc:276] 0709 13:13:41.465666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.993190 (+1527524us) service_pool.cc:224] Handling call
0709 13:13:43.085153 (+ 91963us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:43.085782 (+   629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:43.206104 (+120322us) spinlock_profiling.cc:243] Waited 27.8 ms on lock 0x7b540039ce50. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd858ad 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:43.206350 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":63944960}
W20260709 13:13:43.216553 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 104550us
W20260709 13:13:43.222304 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 125330us
I20260709 13:13:43.248900  2098 raft_consensus.cc:2804] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:43.242444 29521 raft_consensus.cc:1275] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:13:43.286253 29521 pending_rounds.cc:85] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 7
I20260709 13:13:43.286583 29521 pending_rounds.cc:107] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:13:43.286850 29521 raft_consensus.cc:2889] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:43.164479  2089 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:43.260279 29375 raft_consensus.cc:1240] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:43.229789  2014 raft_consensus.cc:3055] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:13:43.276239 29421 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:43.294579 29421 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:43.223316 29373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1738) took 1181 ms. Trace:
I20260709 13:13:43.277860 29419 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:43.280154 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.170943  2188 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:43.302985 29421 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:13:43.281307 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.274350 29495 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:43.249063  2144 raft_consensus.cc:493] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:43.288576 29344 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:43.295706 29373 rpcz_store.cc:276] 0709 13:13:42.041860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.045476 (+  3616us) service_pool.cc:224] Handling call
0709 13:13:42.045773 (+   297us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:13:43.061994 (+1016221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:43.222828 (+160834us) spinlock_profiling.cc:243] Waited 994 ms on lock 0x7b54001ee954. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:43.223218 (+   390us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2286907264}
I20260709 13:13:43.298185 29419 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:43.309078 29495 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:43.318493 29495 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:43.322561 29495 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:43.267777  1999 raft_consensus.cc:740] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:43.288405  2084 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:43.307348  2093 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:13:43.336226 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.337318 29524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3712) took 1783 ms. Trace:
I20260709 13:13:43.337757 29524 rpcz_store.cc:276] 0709 13:13:41.554309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.051896 (+1497587us) service_pool.cc:224] Handling call
0709 13:13:43.052328 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:43.052609 (+   281us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:13:43.247643 (+195034us) log.cc:844] Serialized 14 byte log entry
0709 13:13:43.336726 (+ 89083us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:43.336829 (+   103us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:43.336908 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:43.337042 (+   134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:43.337252 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":275717,"thread_start_us":240326,"threads_started":2}
I20260709 13:13:43.308540  2086 raft_consensus.cc:2749] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:13:43.326485 29495 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:43.344142 29495 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:43.309048  2038 raft_consensus.cc:2749] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:43.304317  2089 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:43.335139 29377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52172 (request call id 2206) took 1143 ms. Trace:
I20260709 13:13:43.332752 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:43.266247  2169 raft_consensus.cc:515] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:43.291967  2098 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:43.319754  1987 raft_consensus.cc:2749] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:13:43.341645 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 43553.2us
I20260709 13:13:43.367653 29419 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:43.301180  2014 raft_consensus.cc:740] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:43.269248  2110 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:43.321015  2144 raft_consensus.cc:3060] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:43.332295  1993 raft_consensus.cc:2804] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:43.327834  1967 raft_consensus.cc:2804] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:43.330590  1697 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:43.304051  1900 consensus_queue.cc:1048] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:13:43.351168 29377 rpcz_store.cc:276] 0709 13:13:42.191992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.389505 (+197513us) service_pool.cc:224] Handling call
0709 13:13:42.390499 (+   994us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:42.413866 (+ 23367us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:13:42.431625 (+ 17759us) log.cc:844] Serialized 14 byte log entry
0709 13:13:42.781838 (+350213us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:13:42.829494 (+ 47656us) spinlock_profiling.cc:243] Waited 4.05 ms on lock 0x7b18003624a0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c13c0a 00007f6a82353219 00007f6a7fc5a58f 00007f6a78c99571 00007f6a78c9b7c1 00007f6a78c9b779 00007f6a78c9b709 00007f6a78c9b6d1 00007f6a78c9a9cd
0709 13:13:42.838712 (+  9218us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:42.839512 (+   800us) log.cc:844] Serialized 52 byte log entry
0709 13:13:42.839709 (+   197us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:42.839748 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:42.839857 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:43.334797 (+494940us) raft_consensus.cc:1685] finished
0709 13:13:43.334834 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:43.335065 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":291566,"prepare.queue_time_us":20465,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":45,"raft.queue_time_us":289578,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":8630,"spinlock_wait_cycles":12590592,"thread_start_us":96655,"threads_started":1,"wal-append.queue_time_us":173802}
I20260709 13:13:43.333024  1764 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:43.333166  1977 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:43.345934  1683 raft_consensus.cc:2804] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:43.349270  2039 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:43.372844  1741 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:43.348109  2093 raft_consensus.cc:697] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 15 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:43.399200 28234 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:13:43.367967  2098 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:13:43.403659 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.399893  1967 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:43.411651 29529 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 18.
I20260709 13:13:43.420348  1764 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:13:43.423029 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.440779 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:43.442703 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:43.398342 29419 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:43.444027 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 45795.4us
I20260709 13:13:43.445027 29419 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:43.362775  1805 consensus_queue.cc:1048] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:13:43.427384  2105 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:43.393141  1993 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting leader election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:43.432977 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:43.327678 29421 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:13:43.474871 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 147275us
I20260709 13:13:43.476051 29421 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:43.433630 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:43.478291 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:43.434775 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:43.479467 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:43.435850 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:43.481163  2084 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:13:43.409091  1697 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:43.482012 28234 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:13:43.449224 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 105172us
I20260709 13:13:43.482820 29495 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:43.481973  1697 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:43.483318 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:43.484272 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:43.485687 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:43.486512  2200 log.cc:927] Time spent T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:13:43.486510 29381 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 15.
I20260709 13:13:43.487703  2111 raft_consensus.cc:2804] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:43.487895 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:43.488176  2111 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:43.488718 29381 raft_consensus.cc:2368] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 17. Current term is 18.
I20260709 13:13:43.424892  2039 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:43.479655  2086 raft_consensus.cc:2804] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:43.489159  2039 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:43.395889  2038 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:43.467095 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:43.496340  2203 log.cc:927] Time spent T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:13:43.496846 29421 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:43.497782  2084 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:43.497896 29452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2907) took 1063 ms. Trace:
I20260709 13:13:43.498402 29452 rpcz_store.cc:276] 0709 13:13:42.436070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.898876 (+462806us) service_pool.cc:224] Handling call
0709 13:13:42.899175 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:42.899348 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:42.899363 (+    15us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:42.899881 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 13:13:43.238163 (+338282us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:43.238230 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:43.238355 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:43.497656 (+259301us) raft_consensus.cc:1685] finished
0709 13:13:43.497682 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:43.497828 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":181647,"threads_started":1,"wal-append.queue_time_us":422109}
I20260709 13:13:43.503516  1697 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:43.435437 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:43.488638  2111 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:43.421763  2085 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:43.461793 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:43.489957  2201 log.cc:927] Time spent T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:13:43.490206 29495 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:43.508589 29495 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:43.489534  2086 raft_consensus.cc:697] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 12 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:43.512804  2086 consensus_queue.cc:237] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:43.513501  2039 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:43.504264  2207 log.cc:927] Time spent T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:13:43.519769  2157 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:43.522761  2039 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:43.524212  2111 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:43.499136 29421 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:43.531405  2110 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 12 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:43.533651  2085 raft_consensus.cc:2804] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:43.534107  2085 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting leader election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:43.534085  2084 consensus_queue.cc:1059] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:43.534787  2085 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:43.535246  2084 consensus_queue.cc:1059] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:13:43.536337  2211 log.cc:927] Time spent T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:13:43.537050  2084 raft_consensus.cc:3055] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:43.537464  2084 raft_consensus.cc:740] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:43.538468  2084 consensus_queue.cc:260] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:43.539716  2038 raft_consensus.cc:3055] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:43.540135  2038 raft_consensus.cc:740] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:43.540944  2038 consensus_queue.cc:260] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:43.542152  2038 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:43.543875  2084 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:43.544592  2169 leader_election.cc:290] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 election: Requested vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:43.545390  2039 consensus_queue.cc:1059] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:43.431100  1683 raft_consensus.cc:697] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:43.441820  1694 raft_consensus.cc:2764] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:13:43.432178  1977 raft_consensus.cc:697] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:43.444608  1967 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:43.574051  2093 consensus_queue.cc:237] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:43.549444  2205 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:43.580101  2205 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:43.580693  2205 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:43.581627  2085 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:43.583638  2056 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:43.472190 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:43.446492 29346 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:43.445642  1764 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:43.470639  2060 raft_consensus.cc:2764] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:13:43.478647  2105 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:43.610589 29448 raft_consensus.cc:1240] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 13. Current term is 14. Ops: []
W20260709 13:13:43.560947  2168 consensus_meta.cc:287] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.617s	user 0.007s	sys 0.005s
I20260709 13:13:43.598764 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:43.601123 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:43.549181  1993 raft_consensus.cc:3060] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:43.460754  2101 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:43.489089  2188 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:43.636538  2105 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:43.584901  2199 log.cc:927] Time spent T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b: Append to log took a long time: real 0.238s	user 0.002s	sys 0.000s
I20260709 13:13:43.636312 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:43.648074 29452 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:13:43.641850 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:43.652920 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:43.643277  1697 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:43.643780 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:43.646942  2101 consensus_queue.cc:1048] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:13:43.655983 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:43.661764 29451 raft_consensus.cc:2393] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 16: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:43.661765 29456 raft_consensus.cc:1275] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:13:43.421216  2014 consensus_queue.cc:260] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:43.664090 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 217693us
I20260709 13:13:43.665087  2085 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:43.665289  2030 raft_consensus.cc:2749] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:43.665948  1683 consensus_queue.cc:237] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:43.657087 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:43.667421 29449 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:43.664218  2014 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:43.654323 29455 raft_consensus.cc:2410] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:13:43.675122 29421 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:43.677026 29450 raft_consensus.cc:1240] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:13:43.678997 29421 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:43.687822 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:13:43.687863 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:43.680428  2085 raft_consensus.cc:2749] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:43.692633 29456 raft_consensus.cc:3055] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:43.698060 29456 raft_consensus.cc:740] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:43.698930 29456 consensus_queue.cc:260] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:43.700134 29456 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:43.695823 29421 leader_election.cc:400] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 17. Current term is 18.
I20260709 13:13:43.697371 29375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52172 (request call id 2210) took 1504 ms. Trace:
I20260709 13:13:43.697429  2085 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:43.701913 29530 raft_consensus.cc:1275] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:13:43.704797 29529 raft_consensus.cc:1240] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:43.710245 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:43.707484 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:43.707840 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:43.713119 29377 raft_consensus.cc:3055] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:43.713558 29377 raft_consensus.cc:740] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:43.708910 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:43.716359 29379 raft_consensus.cc:2468] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 7.
I20260709 13:13:43.717607 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:43.704154 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.643882  2214 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:43.672219  2168 raft_consensus.cc:2749] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:43.726125 29523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3715) took 1549 ms. Trace:
I20260709 13:13:43.714612 29377 consensus_queue.cc:260] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:43.728500 29377 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:43.719082 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:43.706501 29375 rpcz_store.cc:276] 0709 13:13:42.193221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.872712 (+679491us) service_pool.cc:224] Handling call
0709 13:13:42.883591 (+ 10879us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:43.292630 (+409039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:43.377383 (+ 84753us) spinlock_profiling.cc:243] Waited 376 ms on lock 0x7b54003c41d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:43.697164 (+319781us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b54003c41d0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd858ad 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:43.697307 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":889427072}
I20260709 13:13:43.700986 29421 leader_election.cc:403] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:43.730589 29421 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:43.729863 29449 raft_consensus.cc:2410] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:13:43.735877 29421 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:43.705200  2067 consensus_meta.cc:287] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.717s	user 0.012s	sys 0.004s
I20260709 13:13:43.722522 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:43.727478 29452 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 18.
I20260709 13:13:43.738042 29346 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:43.700899 29344 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:43.745573 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.731959 29523 rpcz_store.cc:276] 0709 13:13:42.175924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.072127 (+896203us) service_pool.cc:224] Handling call
0709 13:13:43.072373 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:43.072714 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:13:43.259027 (+186313us) log.cc:844] Serialized 14 byte log entry
0709 13:13:43.723703 (+464676us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:43.723770 (+    67us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:43.723818 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:43.723888 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:43.725696 (+  1808us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22169,"prepare.queue_time_us":291046,"prepare.run_cpu_time_us":2950,"prepare.run_wall_time_us":24874,"raft.queue_time_us":923,"thread_start_us":564051,"threads_started":2}
I20260709 13:13:43.743093 29381 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:43.712499  2085 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:43.749141 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 48313us
I20260709 13:13:43.725786  2214 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:43.743649  2067 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:43.743754  2038 raft_consensus.cc:2749] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 17. Current term is 18.
W20260709 13:13:43.760696  2198 log.cc:927] Time spent T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.459s	user 0.000s	sys 0.005s
W20260709 13:13:43.762409 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.764706  2205 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:43.765643 29456 raft_consensus.cc:1275] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:13:43.767467  2197 log.cc:927] Time spent T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.506s	user 0.001s	sys 0.001s
I20260709 13:13:43.768034  2215 raft_consensus.cc:2804] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:43.768564  1999 consensus_queue.cc:260] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:43.836860 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:13:43.837520 29522 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.006s	sys 0.018s
I20260709 13:13:43.776539  2060 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:13:43.779628 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:43.782656 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 44703.2us
W20260709 13:13:43.787948 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 277472us
I20260709 13:13:43.800693 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:13:43.806871 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.786710  2168 raft_consensus.cc:2749] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:43.837743 29452 raft_consensus.cc:3060] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:43.772535 29377 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 15.
I20260709 13:13:43.781709  2085 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:13:43.886641 29522 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.009s	sys 0.020s
I20260709 13:13:43.887099 29346 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:43.888437 29495 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:43.871389 29379 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:43.702698  1977 consensus_queue.cc:237] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:43.895159 29419 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:43.900151 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:43.900908 29377 raft_consensus.cc:1240] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:13:43.892535  1999 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:43.920302 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:43.921000 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.921371 29455 raft_consensus.cc:1240] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 12 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:43.908370 29346 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:43.909796 29419 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:13:43.866995 29526 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.000s	sys 0.025s
I20260709 13:13:43.928215 29454 raft_consensus.cc:2393] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 12: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
W20260709 13:13:43.926782 29526 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.000s	sys 0.026s
I20260709 13:13:43.829541  2214 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:43.930298 29419 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:43.893872  2079 consensus_meta.cc:287] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent flushing consensus metadata: real 1.394s	user 0.017s	sys 0.000s
W20260709 13:13:43.918939 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.931660 29419 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:43.936981 29495 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:13:43.937610 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:43.938004 29419 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:43.932271 29525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3720) took 1748 ms. Trace:
I20260709 13:13:43.948724 29381 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
I20260709 13:13:43.908615  1694 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:43.949713 29375 raft_consensus.cc:1240] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:43.954849 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:43.954391 29527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3722) took 1770 ms. Trace:
I20260709 13:13:43.924832  1805 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:43.941015 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:43.887461  2215 raft_consensus.cc:697] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:43.830265  1967 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:43.907235  2086 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:43.944981 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:43.940280 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:43.947011 29346 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:43.920351  2124 consensus_queue.cc:1048] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:13:43.933003 29452 raft_consensus.cc:2468] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 12.
I20260709 13:13:43.983880  2161 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:43.984561  2205 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:43.981331  2093 raft_consensus.cc:2749] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:43.944347  2079 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:43.986198  2168 consensus_queue.cc:1048] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:43.986891  2093 raft_consensus.cc:2804] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:43.987684  2093 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:43.988531  2093 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:43.991382  1987 consensus_queue.cc:1048] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:43.992949 30153 raft_consensus.cc:1240] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9. Ops: []
W20260709 13:13:43.954121 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 218326us
I20260709 13:13:43.960426 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:43.996475 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:43.965631  2217 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:43.956396  2139 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:43.999163 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:44.000459 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:44.001940 29455 raft_consensus.cc:1275] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:13:44.006229 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:43.960412  1741 raft_consensus.cc:2804] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:44.009553 29421 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:44.007887 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:44.007961 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:44.012823 29528 raft_consensus.cc:2393] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 15: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:43.985323  2205 raft_consensus.cc:2804] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:13:44.015479 29453 raft_consensus.cc:1240] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 11. Current term is 12. Ops: []
W20260709 13:13:44.016222 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.017514 29453 raft_consensus.cc:1240] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 16. Current term is 17. Ops: []
W20260709 13:13:44.023420 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.029035 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:44.031354 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:43.837893  2144 raft_consensus.cc:515] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:43.963129 29448 raft_consensus.cc:2393] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 14: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:43.938290  2056 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:44.036978  2056 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:44.037526  2056 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:44.038102  2162 consensus_queue.cc:1059] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:43.949074 29525 rpcz_store.cc:276] 0709 13:13:42.183384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.066646 (+883262us) service_pool.cc:224] Handling call
0709 13:13:43.105919 (+ 39273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:43.106170 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:13:43.344186 (+238016us) log.cc:844] Serialized 14 byte log entry
0709 13:13:43.931746 (+587560us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:43.931805 (+    59us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:43.931855 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:43.931926 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:43.932204 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58403,"prepare.queue_time_us":313373,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":39142,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":11497,"thread_start_us":663399,"threads_started":3,"wal-append.queue_time_us":122923}
I20260709 13:13:44.040071 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:44.041350 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:44.042412 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:44.044963  1967 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:44.045732 29523 raft_consensus.cc:1240] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 9. Current term is 10. Ops: []
W20260709 13:13:44.047480 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.028422  2205 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:44.047847  2144 leader_election.cc:290] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Requested vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:44.048084  2205 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:44.048740 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:44.049360 29525 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:44.053473  2067 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:44.053726 29456 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
I20260709 13:13:44.054406  2111 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:43.988469  2079 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:43.935866  2060 raft_consensus.cc:2749] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:44.061357 30153 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54234 (request call id 292) took 1251 ms. Trace:
I20260709 13:13:44.061838 30153 rpcz_store.cc:276] 0709 13:13:42.809862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:42.810113 (+   251us) service_pool.cc:224] Handling call
0709 13:13:42.811069 (+   956us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:43.993463 (+1182394us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:44.061060 (+ 67597us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54006a0c54. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:44.061259 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2717473536}
I20260709 13:13:44.062378  2086 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:44.009791  1966 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.064234  1966 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:44.066394  1966 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:43.936841  2039 consensus_queue.cc:1243] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer 429e58eb058349e3bf72b5a870c8f6e5 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:13:43.966763 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:44.072163 29454 raft_consensus.cc:2393] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 16: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:43.938684 29495 leader_election.cc:304] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:44.072911  2123 consensus_queue.cc:1059] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:13:44.073935  1741 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:44.074227  2123 raft_consensus.cc:3055] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:44.074468  1741 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:44.074726  2123 raft_consensus.cc:740] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:13:43.969901 30157 raft_consensus.cc:1240] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 12 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 11. Current term is 12. Ops: []
I20260709 13:13:44.076251  2085 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:43.979835 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.078748  2085 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:44.078936  2098 consensus_meta.cc:287] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.618s	user 0.006s	sys 0.007s
I20260709 13:13:44.079532 29456 raft_consensus.cc:1240] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:13:44.079421  2098 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:44.080262  2151 raft_consensus.cc:3055] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:44.080863  2151 raft_consensus.cc:740] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:44.014420 29344 leader_election.cc:304] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:44.033726 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:44.035811  2215 consensus_queue.cc:237] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:44.085995 29377 raft_consensus.cc:1240] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:13:44.087389 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:44.088166 29377 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:44.089227 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:44.090456 29381 raft_consensus.cc:1240] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 6. Current term is 7. Ops: []
W20260709 13:13:44.084892 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 146283us
I20260709 13:13:44.094173 29495 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:43.956152 29527 rpcz_store.cc:276] 0709 13:13:42.184069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.067687 (+883618us) service_pool.cc:224] Handling call
0709 13:13:43.073563 (+  5876us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:43.073840 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:13:43.296586 (+222746us) log.cc:844] Serialized 14 byte log entry
0709 13:13:43.953834 (+657248us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:43.953921 (+    87us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:43.953986 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:43.954123 (+   137us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:43.954300 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78185,"prepare.queue_time_us":299811,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":96380,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":121,"thread_start_us":788961,"threads_started":3,"wal-append.queue_time_us":348990}
I20260709 13:13:44.090538 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:44.069842 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:44.098378 29452 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:44.099431 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:44.099764 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:44.104897 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:44.107374 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:44.107717 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:44.106096 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:44.111804 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 97577.2us
W20260709 13:13:44.113914 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.118593 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:44.118626 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:44.122546 29379 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 16.
I20260709 13:13:44.126914 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:44.129264 29495 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:44.131407 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:44.119226 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:13:44.132345 29380 raft_consensus.cc:2376] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19. Re-sending same reply.
I20260709 13:13:44.135607 29495 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:44.082093  1967 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.137326 29421 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:44.140779 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:13:44.103698  2089 consensus_meta.cc:287] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.738s	user 0.013s	sys 0.000s
I20260709 13:13:44.145664 29525 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 16.
I20260709 13:13:44.138614 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:44.149190 29451 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
I20260709 13:13:44.142294 29495 leader_election.cc:304] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:44.149711 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:44.099607  2001 raft_consensus.cc:2749] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:44.152415 29526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3730) took 1733 ms. Trace:
I20260709 13:13:44.153240 29344 leader_election.cc:304] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:44.154119 29523 raft_consensus.cc:1240] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:44.152894 29526 rpcz_store.cc:276] 0709 13:13:42.419193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.084902 (+665709us) service_pool.cc:224] Handling call
0709 13:13:43.092591 (+  7689us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:43.092825 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:13:43.929122 (+836297us) log.cc:844] Serialized 14 byte log entry
0709 13:13:44.152041 (+222919us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:44.152103 (+    62us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:44.152162 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:44.152236 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:44.152353 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74161,"prepare.queue_time_us":311499,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"thread_start_us":984140,"threads_started":2}
W20260709 13:13:44.154983 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.110860  2067 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:44.142174  2187 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:44.152757  2081 consensus_queue.cc:1059] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:13:44.148169 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:44.117838  2109 consensus_queue.cc:1059] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
W20260709 13:13:44.165091 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.147042  2222 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:44.141680  1697 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:44.140651  2085 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.140301  1805 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:44.169072  2030 raft_consensus.cc:2749] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:13:44.084906  1764 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:44.203770  1764 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:44.204550 29524 raft_consensus.cc:1240] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:44.206401  2085 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:44.209172  2085 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:44.164047  2224 raft_consensus.cc:2804] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:44.209743  2224 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Starting leader election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:44.210126  2224 raft_consensus.cc:3060] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:44.170097  2098 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:44.150902  2123 consensus_queue.cc:260] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:44.151062  2089 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:44.221414 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:44.223026  2089 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:44.223289 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:44.225025 29374 raft_consensus.cc:1275] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:13:44.227160 29374 raft_consensus.cc:1275] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:13:44.231000  2218 log.cc:927] Time spent T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.196s	user 0.001s	sys 0.001s
W20260709 13:13:44.233697  2105 consensus_meta.cc:287] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.588s	user 0.012s	sys 0.001s
I20260709 13:13:44.234273  2105 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:44.235606 29521 raft_consensus.cc:1240] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:13:44.237514  2157 raft_consensus.cc:3055] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:44.237731  2105 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:44.165954 29421 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:44.091810  2111 consensus_queue.cc:1059] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:13:44.173635 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:44.119062  2132 raft_consensus.cc:2749] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:13:44.189491 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.171551  1888 consensus_queue.cc:1059] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:13:44.172024  2151 consensus_queue.cc:260] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:44.192775  1993 consensus_meta.cc:287] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.512s	user 0.004s	sys 0.007s
I20260709 13:13:44.191135 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:44.194877  2051 consensus_queue.cc:1059] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:13:44.239120 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 73276.4us
I20260709 13:13:44.238022  2157 raft_consensus.cc:740] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
W20260709 13:13:44.248518 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 310585us
I20260709 13:13:44.274211 29419 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:44.147899  1967 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:44.252856 29525 raft_consensus.cc:1240] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:44.199018  2214 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:44.263036 29375 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:44.250277  2014 raft_consensus.cc:2804] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:44.265501  2051 raft_consensus.cc:3055] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:44.284731  2051 raft_consensus.cc:740] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:13:44.285696  1683 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.002s	sys 0.024s
W20260709 13:13:44.286334  1683 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.002s	sys 0.024s
I20260709 13:13:44.285777  2051 consensus_queue.cc:260] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:44.265906  1993 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:44.267196 29522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3737) took 1309 ms. Trace:
I20260709 13:13:44.269191  2147 raft_consensus.cc:3055] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:13:44.269811 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 127628us
I20260709 13:13:44.287732 29522 rpcz_store.cc:276] 0709 13:13:42.957764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.209361 (+251597us) service_pool.cc:224] Handling call
0709 13:13:43.210048 (+   687us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:43.210343 (+   295us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:13:43.893401 (+683058us) log.cc:844] Serialized 14 byte log entry
0709 13:13:44.149563 (+256162us) log.cc:844] Serialized 14 byte log entry
0709 13:13:44.224703 (+ 75140us) spinlock_profiling.cc:243] Waited 5.65 ms on lock 0x7b18003439c0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c672a6 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c993f3 00007f6a78c9b7c1
0709 13:13:44.225250 (+   547us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b18003439c0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c993f3 00007f6a78c9b7c1 00007f6a78c9b779 00007f6a78c9b709 00007f6a78c9b6d1 00007f6a78c9a9cd 000000000038f354 000000000038f199 00007f6a78c7c83a
0709 13:13:44.266585 (+ 41335us) spinlock_profiling.cc:243] Waited 1.64 ms on lock 0x7b18003439c0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c13c0a 00007f6a82353219 00007f6a78c9ba40 00007f6a78c964e4 00007f6a78c96455 00007f6a7bd7e060 00007f6a7bd90716 00007f6a7bda1287 00007f6a7bda1208
0709 13:13:44.266787 (+   202us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:44.266849 (+    62us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:44.266899 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:44.266976 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:44.267127 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":157797,"prepare.queue_time_us":212534,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":73,"raft.queue_time_us":123154,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":6042,"spinlock_wait_cycles":40641024,"thread_start_us":873872,"threads_started":2}
I20260709 13:13:44.269992  1694 raft_consensus.cc:2749] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:44.272768 29421 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:44.175700  2067 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:44.272807  2222 raft_consensus.cc:3055] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:13:44.292748 29447 raft_consensus.cc:1240] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 9. Current term is 10. Ops: []
W20260709 13:13:44.293159 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.293817 29522 raft_consensus.cc:1275] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:13:44.287317  2051 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:44.287709  2085 raft_consensus.cc:2749] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:13:44.300765  2222 raft_consensus.cc:740] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:44.301589  2214 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:44.301301  2086 consensus_queue.cc:1059] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:13:44.302106 29525 raft_consensus.cc:1240] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 19. Current term is 20. Ops: []
I20260709 13:13:44.294705 29495 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:44.288476  2111 raft_consensus.cc:3055] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:44.291913  2147 raft_consensus.cc:740] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:13:44.297657  2060 raft_consensus.cc:2804] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:44.297451  2151 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:44.326972 29495 leader_election.cc:304] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:44.293234  2084 consensus_queue.cc:1059] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:13:44.287640  2157 consensus_queue.cc:260] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:44.316885  2111 raft_consensus.cc:740] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:44.369087 29495 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:44.407044 29527 raft_consensus.cc:1240] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:44.332681  2214 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:13:44.421362 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 215755us
I20260709 13:13:44.426129 29525 raft_consensus.cc:1240] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:44.427855 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:44.428719 29377 raft_consensus.cc:2468] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 12.
I20260709 13:13:44.337664  2060 raft_consensus.cc:697] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 14 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:44.380066 29495 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:44.433604 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.347358  2105 raft_consensus.cc:2749] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:44.382561  1999 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:44.419034  2157 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:13:44.455920  2225 log.cc:927] Time spent T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 13:13:44.368870  1694 consensus_queue.cc:1048] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.095s
I20260709 13:13:44.466264  2060 consensus_queue.cc:237] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:13:44.436861 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 56928.7us
I20260709 13:13:44.452942 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:44.453814 29372 raft_consensus.cc:1240] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:13:44.474908 29495 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:44.477026 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.479086 29379 raft_consensus.cc:1275] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:13:44.372862  1966 consensus_queue.cc:1059] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.119s
W20260709 13:13:44.504220 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 209855us
I20260709 13:13:44.435683  2038 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:44.505420 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:44.450152  2214 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:44.438974  2204 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:44.511196 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:44.432144  2110 consensus_queue.cc:1059] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
W20260709 13:13:44.508361  2093 consensus_meta.cc:287] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.519s	user 0.012s	sys 0.000s
W20260709 13:13:44.515139  2161 consensus_meta.cc:287] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.531s	user 0.009s	sys 0.007s
W20260709 13:13:44.537945 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 63158.7us
I20260709 13:13:44.539085 29495 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:13:44.536899 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 343342us
I20260709 13:13:44.481314  2205 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:44.545578 29452 raft_consensus.cc:1275] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:13:44.547636 29376 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
I20260709 13:13:44.434438  2147 consensus_queue.cc:260] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:13:44.549180 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.555684 29456 raft_consensus.cc:1275] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:13:44.540151  2056 consensus_meta.cc:287] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.502s	user 0.013s	sys 0.000s
I20260709 13:13:44.524394  2214 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:44.558341 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:44.563174 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:44.563576 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:44.563652 29346 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:44.559229 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:44.569140 29372 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 15.
I20260709 13:13:44.569552 29448 raft_consensus.cc:2368] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 15. Current term is 16.
I20260709 13:13:44.528800  2202 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:44.568639 29419 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:44.571766 29455 raft_consensus.cc:1240] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 9. Current term is 10. Ops: []
W20260709 13:13:44.573220 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 138743us
I20260709 13:13:44.424620  2222 consensus_queue.cc:260] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:44.572664 29419 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:44.536972  1993 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:44.511798  2224 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:44.548264  1966 raft_consensus.cc:3055] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:44.579550 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:44.546847  2001 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:13:44.546317  1694 raft_consensus.cc:2749] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:13:44.583180 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.550382  1987 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.588374 29375 raft_consensus.cc:2393] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 15: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:44.545646  2014 raft_consensus.cc:697] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 15 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:44.510176  2111 consensus_queue.cc:260] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:44.561936  1967 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:44.529059  2038 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:44.574218  2214 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:44.596109 29346 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:44.543920  2093 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:44.598083 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:44.542608  1741 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:44.618536 29495 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:44.618818 29530 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 12.
I20260709 13:13:44.538192  2204 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:44.571877  2056 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:44.605238 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:44.625981 29448 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 15.
I20260709 13:13:44.601963 29346 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:44.585289  1966 raft_consensus.cc:740] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:44.628290  1966 consensus_queue.cc:260] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:44.630132  1966 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:44.590600  2080 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.597239  2168 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:44.633970 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:44.640061 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 65366.3us
I20260709 13:13:44.640816 30121 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:44.640813 29495 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:44.642354 29346 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:44.596879  2001 raft_consensus.cc:697] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:44.619181  2139 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:44.647542 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:44.642369 29495 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:44.570878  2202 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:44.638227 29456 raft_consensus.cc:3060] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:44.652343 29495 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:44.595619  1987 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:44.635005  2222 raft_consensus.cc:3060] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:44.633139  2067 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:44.632939  2248 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:44.637888  1694 raft_consensus.cc:2749] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:44.665376 29495 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:44.648838  2215 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:44.680311 29495 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:44.677793 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:44.684387 29448 raft_consensus.cc:2393] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 20: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:44.646602  2124 raft_consensus.cc:2749] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:44.651201  2233 log.cc:927] Time spent T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
W20260709 13:13:44.672019 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 99434.8us
I20260709 13:13:44.658670  2217 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:44.690418 29495 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:44.698212 29419 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:44.699123 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:13:44.664155  2253 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:44.661710  1697 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:13:44.700448 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:44.701329 29448 raft_consensus.cc:2393] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 16: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:44.701980 29495 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:44.702296 29456 raft_consensus.cc:2468] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 9.
I20260709 13:13:44.644582  2080 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:44.703763 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 63032.5us
I20260709 13:13:44.656068  2243 raft_consensus.cc:2749] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:44.710340 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:13:44.705086  1999 raft_consensus.cc:2749] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:13:44.716307  2240 log.cc:927] Time spent T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:13:44.688970  1764 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:44.657054  1683 consensus_queue.cc:1048] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:13:44.663647  2098 consensus_queue.cc:1048] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:13:44.740396 30153 raft_consensus.cc:1240] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:44.740664  2224 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:13:44.744304  2245 log.cc:927] Time spent T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:13:44.743608  2001 consensus_queue.cc:237] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:44.752801  1741 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:44.756716  2259 raft_consensus.cc:2804] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:44.757716  2259 raft_consensus.cc:697] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 12 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:13:44.763440  2056 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:44.766170  2080 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:44.767603  2038 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:44.768402  1993 raft_consensus.cc:2749] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:44.700757  2014 consensus_queue.cc:237] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:44.774143  2249 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.774750  2249 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:44.776810  2204 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:44.779104 29525 raft_consensus.cc:1275] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:13:44.781697 29453 raft_consensus.cc:1240] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:13:44.784404  2205 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:44.785540 29524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3745) took 1085 ms. Trace:
I20260709 13:13:44.706446  2253 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:44.786087 29524 rpcz_store.cc:276] 0709 13:13:43.700281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.704980 (+  4699us) service_pool.cc:224] Handling call
0709 13:13:43.705259 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:44.205042 (+499783us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:44.785214 (+580172us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b54002323d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:44.785459 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1147732864}
I20260709 13:13:44.693914  2226 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:44.790076 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:44.790920 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 241696us
W20260709 13:13:44.725818  2237 log.cc:927] Time spent T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.206s	user 0.000s	sys 0.002s
I20260709 13:13:44.756979 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:13:44.794185 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 98532.7us
I20260709 13:13:44.794477 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:44.805812 29419 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:44.794201 29526 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
I20260709 13:13:44.806730 29448 raft_consensus.cc:2393] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 15: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
W20260709 13:13:44.795233 30119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.800621  2038 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:44.816627 29528 raft_consensus.cc:2468] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:13:44.726223  1967 raft_consensus.cc:2749] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:44.700470  2101 consensus_queue.cc:1059] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.096s
I20260709 13:13:44.818310 29419 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:44.857916 29419 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:44.837168 29344 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:44.759388  2259 consensus_queue.cc:237] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:13:44.889658 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 52587.2us
W20260709 13:13:44.988483 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 130694us
I20260709 13:13:45.011559 29454 raft_consensus.cc:1240] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9. Ops: []
I20260709 13:13:45.017675 30121 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:45.020056 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:44.871745  2255 log.cc:927] Time spent T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.071s	user 0.002s	sys 0.000s
I20260709 13:13:45.023458 29456 raft_consensus.cc:1240] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:44.843755  2205 raft_consensus.cc:2749] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:45.044502 29451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45796 (request call id 1901) took 1100 ms. Trace:
I20260709 13:13:45.049337 29451 rpcz_store.cc:276] 0709 13:13:43.910498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.912309 (+  1811us) service_pool.cc:224] Handling call
0709 13:13:45.010201 (+1097892us) spinlock_profiling.cc:243] Waited 80.8 ms on lock 0x7b54002922d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:45.010363 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":185899776}
W20260709 13:13:44.989257  2051 consensus_meta.cc:287] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.675s	user 0.013s	sys 0.002s
I20260709 13:13:44.907330  2067 raft_consensus.cc:2804] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:13:45.046394 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:44.916880  2101 raft_consensus.cc:3055] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:13:45.047776 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 405480us
I20260709 13:13:45.057053 29522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3760) took 1039 ms. Trace:
I20260709 13:13:44.924958  2093 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:44.937108  2038 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:44.828734  2080 consensus_queue.cc:1059] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.219s
W20260709 13:13:45.061697 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 359783us
I20260709 13:13:44.935356  2202 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:45.062650 29522 rpcz_store.cc:276] 0709 13:13:44.017598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:44.299894 (+282296us) service_pool.cc:224] Handling call
0709 13:13:44.302983 (+  3089us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:44.303876 (+   893us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:44.303922 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:44.392567 (+ 88645us) log.cc:844] Serialized 52 byte log entry
0709 13:13:44.513145 (+120578us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:44.513191 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:44.513270 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:45.056688 (+543418us) raft_consensus.cc:1685] finished
0709 13:13:45.056723 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:45.056959 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10268,"raft.queue_time_us":5397,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":9132,"thread_start_us":59369,"threads_started":1,"wal-append.queue_time_us":278319}
I20260709 13:13:45.063926 29346 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:45.023032 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:45.008986  2056 raft_consensus.cc:2749] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:45.072021 29453 raft_consensus.cc:1240] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 14 LEADER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:44.856173  2030 consensus_queue.cc:1059] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.204s
I20260709 13:13:45.051210  2079 raft_consensus.cc:2804] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:44.897280  2253 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:44.855571  2241 consensus_queue.cc:1048] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.222s
I20260709 13:13:45.025410  2084 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.063771  2067 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:44.793277  2249 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:45.066874 29495 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:44.897610  2168 consensus_queue.cc:1048] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.169s
I20260709 13:13:44.896703  2161 consensus_queue.cc:1059] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.170s
I20260709 13:13:45.023540  2157 consensus_queue.cc:1059] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:13:44.923666  2243 consensus_queue.cc:1059] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.213s
I20260709 13:13:45.074596 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:45.062397  2101 raft_consensus.cc:740] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:45.062873 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:13:45.108594 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:45.109666 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:45.111207 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:45.113005 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:45.118386 29524 raft_consensus.cc:2393] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 15: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:45.079581  2038 raft_consensus.cc:697] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 16 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:45.096210  2226 raft_consensus.cc:2804] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:45.120105  2226 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.120586  2226 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:45.128202  2101 consensus_queue.cc:260] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:45.129859  2101 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:45.132062 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:45.134541 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:45.137959 29376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 1786) took 1051 ms. Trace:
I20260709 13:13:45.095355  2253 consensus_queue.cc:1059] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:13:45.138842 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:45.139889 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.144203 29374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52172 (request call id 2247) took 1053 ms. Trace:
I20260709 13:13:45.151518 29374 rpcz_store.cc:276] 0709 13:13:44.091028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:44.229896 (+138868us) service_pool.cc:224] Handling call
0709 13:13:44.230194 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:44.319820 (+ 89626us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:44.319872 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:44.319941 (+    69us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:44.320005 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:45.143854 (+823849us) spinlock_profiling.cc:243] Waited 89.2 ms on lock 0x7b54001905d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:45.143920 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:45.144116 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205238144}
I20260709 13:13:45.155045 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:45.156237 29526 raft_consensus.cc:2393] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 16: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:45.157852 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:45.158780 29521 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 15.
I20260709 13:13:45.088202  2067 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:45.164378 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:45.166137 29525 raft_consensus.cc:2393] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 10: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:45.163166 29522 raft_consensus.cc:2393] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 20: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:13:45.168615 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.138693 29376 rpcz_store.cc:276] 0709 13:13:44.086792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:44.087865 (+  1073us) service_pool.cc:224] Handling call
0709 13:13:45.137609 (+1049744us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x7b54000d8ed4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:45.137813 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1023606528}
I20260709 13:13:45.184013 29419 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:45.145624  2151 consensus_meta.cc:287] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.808s	user 0.014s	sys 0.001s
I20260709 13:13:45.101650  2079 raft_consensus.cc:697] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:13:45.190794  2205 raft_consensus.cc:2804] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:45.193529  2205 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:45.194106  2205 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:45.162148  2157 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.183111  1983 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:13:45.098356  2084 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:13:45.203068 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 133834us
I20260709 13:13:45.186673  1967 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.187750  2060 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.113734  2187 consensus_queue.cc:1048] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.087s
I20260709 13:13:45.189896  2265 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.210667  2144 consensus_queue.cc:1048] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:13:45.209673  2157 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:45.255475 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:45.236671  2161 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:45.218327  1967 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:45.221735  2060 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:45.263513 29525 raft_consensus.cc:1240] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 14. Current term is 15. Ops: []
W20260709 13:13:45.275784  2267 log.cc:927] Time spent T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:13:45.285290  1967 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:45.223583  2265 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:45.289450  2265 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:45.292011  2222 consensus_meta.cc:287] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.621s	user 0.014s	sys 0.000s
I20260709 13:13:45.295951 29525 raft_consensus.cc:1240] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 13. Current term is 14. Ops: []
W20260709 13:13:45.256456 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 186621us
I20260709 13:13:45.223171  2038 consensus_queue.cc:237] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:45.320766 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 62176.6us
W20260709 13:13:45.322445  2266 log.cc:927] Time spent T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:13:45.323956 29450 raft_consensus.cc:1240] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:45.331084 29495 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:45.318325  2139 consensus_meta.cc:287] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.659s	user 0.013s	sys 0.001s
W20260709 13:13:45.306463  1966 consensus_meta.cc:287] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.676s	user 0.013s	sys 0.004s
I20260709 13:13:45.265954  2161 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:45.335021 29527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3752) took 1632 ms. Trace:
I20260709 13:13:45.338908 29527 rpcz_store.cc:276] 0709 13:13:43.702135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:44.114014 (+411879us) service_pool.cc:224] Handling call
0709 13:13:44.120804 (+  6790us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:44.407675 (+286871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:45.334789 (+927114us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b54000cb7d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:45.334949 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":657737984}
I20260709 13:13:45.327702  2086 consensus_queue.cc:1059] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:13:45.338339 29346 leader_election.cc:400] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 15. Current term is 16.
I20260709 13:13:45.349396 29346 leader_election.cc:403] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:13:45.333827  2056 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.335484  2014 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.337000  2222 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:45.337965  2139 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:45.259153  2079 consensus_queue.cc:237] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:45.338196  2080 consensus_queue.cc:1048] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.019s
W20260709 13:13:45.359920  2214 consensus_meta.cc:287] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.735s	user 0.011s	sys 0.003s
I20260709 13:13:45.352272  2132 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 15. Current term is 16.
I20260709 13:13:45.357339  2222 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.374418  2226 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:45.375929 29495 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:45.377141  2226 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:45.350756  2202 consensus_queue.cc:1059] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:13:45.377338 29495 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:45.377609  2139 consensus_queue.cc:1059] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 18.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:45.374517  2222 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:45.378386  2098 raft_consensus.cc:2749] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:45.379159  2098 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:45.379963  2098 consensus_queue.cc:1048] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:45.374418  2067 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:45.384364 29456 raft_consensus.cc:1240] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:45.386543 29451 raft_consensus.cc:1275] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:13:45.387235 29451 pending_rounds.cc:85] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 8
I20260709 13:13:45.387601 29451 pending_rounds.cc:107] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:13:45.387923 29451 raft_consensus.cc:2889] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:45.354521  2141 consensus_queue.cc:1059] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:13:45.392222 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:45.393617 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:45.371209  2272 consensus_queue.cc:1059] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:13:45.390563  1764 consensus_queue.cc:1048] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:13:45.395965  2259 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:45.398347  2067 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:45.398797  2249 raft_consensus.cc:3055] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:45.409750  2249 raft_consensus.cc:740] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:45.397385  2259 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:45.410724  2249 consensus_queue.cc:260] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:45.411913  2249 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:13:45.399001 30121 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.399756  2157 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:45.416436  2084 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:45.401145  2161 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:45.405131  2123 raft_consensus.cc:3060] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:45.379256  2214 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:45.406095 29530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37958 (request call id 2086) took 1473 ms. Trace:
I20260709 13:13:45.419903  2214 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:45.420142 29530 rpcz_store.cc:276] 0709 13:13:43.933150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:44.100102 (+166952us) service_pool.cc:224] Handling call
0709 13:13:45.405883 (+1305781us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54000a4954. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:45.406027 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":394861184}
I20260709 13:13:45.421006  2067 raft_consensus.cc:3055] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:45.406927 29523 raft_consensus.cc:1275] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:13:45.421422  2067 raft_consensus.cc:740] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:45.421662 29450 raft_consensus.cc:1240] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:45.358647  2056 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:45.422505  2067 consensus_queue.cc:260] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:45.424013 30119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.408702  2060 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:45.427016  2056 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:45.358349  2014 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:45.431613  2014 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:45.408921  2279 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.439815 29451 raft_consensus.cc:1240] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 19. Current term is 20. Ops: []
I20260709 13:13:45.417057  2111 raft_consensus.cc:3060] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:45.438184  2081 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.439474 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:45.443840 29454 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
I20260709 13:13:45.440191  2205 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:45.440675 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:45.433957  2234 log.cc:927] Time spent T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 1.021s	user 0.004s	sys 0.016s
I20260709 13:13:45.445044 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:45.445981 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:45.449018 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:45.450446 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:45.451272 29373 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
I20260709 13:13:45.452010 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:45.452270 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:45.452625 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:45.454154 29373 raft_consensus.cc:1275] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:13:45.454864 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:45.455699 29379 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 15.
I20260709 13:13:45.456840 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:45.466425 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:45.466717 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:45.467208 29374 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 15.
I20260709 13:13:45.471735 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:45.472674 29454 raft_consensus.cc:1275] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:13:45.434352  2259 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:45.472474 29450 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
W20260709 13:13:45.482790 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 103877us
I20260709 13:13:45.484110 29529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3751) took 1782 ms. Trace:
I20260709 13:13:45.484295 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:45.485716 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:45.484640 29529 rpcz_store.cc:276] 0709 13:13:43.701892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.921454 (+219562us) service_pool.cc:224] Handling call
0709 13:13:43.921764 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:43.922160 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:43.922193 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:43.922756 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 13:13:44.180384 (+257628us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:44.180453 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:44.180538 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:45.423462 (+1242924us) spinlock_profiling.cc:243] Waited 8.41 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:13:45.475966 (+ 52504us) raft_consensus.cc:1685] finished
0709 13:13:45.475995 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:45.484030 (+  8035us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3585,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":8315,"spinlock_wait_cycles":19346816,"thread_start_us":257014,"threads_started":1,"wal-append.queue_time_us":404147}
I20260709 13:13:45.492424 29449 raft_consensus.cc:1240] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:45.493077 29372 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16.
I20260709 13:13:45.494938 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:45.499588 29375 raft_consensus.cc:2393] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 16: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:45.485183 29495 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:45.503615  2168 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:45.504503  2282 raft_consensus.cc:2749] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:45.504299  2168 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:45.505632 29495 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:45.509025 29495 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:45.465871  2169 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
W20260709 13:13:45.501878  2110 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.938s	user 0.007s	sys 0.018s
W20260709 13:13:45.519942  2110 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.959s	user 0.007s	sys 0.018s
I20260709 13:13:45.520630  2030 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.519867 29495 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:45.521461  2030 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:45.522778 29495 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:45.526072 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:45.525745 29495 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:45.550477  1966 raft_consensus.cc:2804] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:45.550921  1966 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.551275  1966 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:45.556067 29495 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:45.557199  1967 raft_consensus.cc:2804] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:45.557659  1967 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.558059  1967 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:45.573583  2226 consensus_queue.cc:1048] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:45.578363 29495 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:45.579931  2187 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:13:45.581717 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.447333  2279 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:45.586273 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:45.507768  2282 raft_consensus.cc:2749] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:45.581784 29495 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:45.587211 29451 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:45.589870 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.591190 29448 raft_consensus.cc:1240] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:13:45.471482  2081 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:45.597780 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:45.519320  2101 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:45.605768 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:45.606494 29448 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 15.
I20260709 13:13:45.607194 29456 raft_consensus.cc:1275] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:13:45.607384 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:45.609014 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:45.609828 29456 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 15.
W20260709 13:13:45.610091 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.610746 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:45.611531 29456 raft_consensus.cc:2393] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 14: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
W20260709 13:13:45.611404 29419 leader_election.cc:336] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 2.098s (SENT)
I20260709 13:13:45.540230  2214 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:45.539980  2039 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:45.618954 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:45.620307 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:45.626721 29380 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:45.548177  2098 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:13:45.623843 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:45.628336 29448 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:45.629016 29456 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
I20260709 13:13:45.636386 29447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 523) took 2179 ms. Trace:
I20260709 13:13:45.636790 29447 rpcz_store.cc:276] 0709 13:13:43.457281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:43.457412 (+   131us) service_pool.cc:224] Handling call
0709 13:13:43.479286 (+ 21874us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:44.303125 (+823839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:45.636084 (+1332959us) spinlock_profiling.cc:243] Waited 813 ms on lock 0x7b54000d6e54. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:45.636317 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1870255360}
I20260709 13:13:45.596382  2051 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.649866 29451 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 14.
W20260709 13:13:45.650710 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.651841 29378 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
I20260709 13:13:45.605181  2187 raft_consensus.cc:2804] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:45.612493  1683 raft_consensus.cc:3055] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:45.603179  2101 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:45.619419  2060 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:45.548939  2169 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:45.668941 29448 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 15.
I20260709 13:13:45.661803  2051 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:45.635795  2243 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:45.662155  1683 raft_consensus.cc:740] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:45.672876  2101 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:45.683563 29376 raft_consensus.cc:3060] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:45.641844  2039 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:45.642616  2157 consensus_queue.cc:1048] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:13:45.672637  2187 raft_consensus.cc:697] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:45.680401  2284 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.679262  2161 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.664393  2214 consensus_queue.cc:1048] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:13:45.675982  2001 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:45.662166  1967 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:45.691524  2238 log.cc:927] Time spent T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 1.131s	user 0.003s	sys 0.012s
I20260709 13:13:45.678283 29380 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 15.
I20260709 13:13:45.677055  2060 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:45.678793  2222 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:45.692349  2030 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:45.722299  2274 log.cc:927] Time spent T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.227s	user 0.000s	sys 0.002s
I20260709 13:13:45.720592  1966 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:45.708405  2161 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:45.683207  2243 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:45.739677  2279 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:45.740298  2060 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:45.741109  2169 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:45.754205  2187 consensus_queue.cc:237] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:45.746254  2039 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:45.756486  2243 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:45.722020  2202 raft_consensus.cc:493] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.757611  2202 raft_consensus.cc:515] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:45.759825  2051 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:45.760217  2264 raft_consensus.cc:3055] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:45.760811  2264 raft_consensus.cc:740] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:13:45.762104  2264 consensus_queue.cc:260] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:45.735484  1683 consensus_queue.cc:260] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:45.768100  2281 log.cc:927] Time spent T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.261s	user 0.001s	sys 0.002s
I20260709 13:13:45.731804  2205 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:45.750355  2081 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:45.728473  2282 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.752486  1967 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:45.753577  2222 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:45.712258  2001 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:45.783283  1987 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:45.706427  2284 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:45.816038  2264 raft_consensus.cc:3060] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:45.817481  2161 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:45.832109  1683 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:45.821751  2241 raft_consensus.cc:3055] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:45.824131  2215 raft_consensus.cc:3055] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:45.825870  2229 raft_consensus.cc:3055] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:45.859223  2147 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:45.863030  2168 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:45.841470  2162 raft_consensus.cc:3055] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:45.824385  2282 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:45.844084  2241 raft_consensus.cc:740] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:45.848351  2215 raft_consensus.cc:740] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:45.850207  2229 raft_consensus.cc:740] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:45.867007  2162 raft_consensus.cc:740] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:45.881915  2229 consensus_queue.cc:260] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:45.883129  2229 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:45.886442  2241 consensus_queue.cc:260] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:45.891386  2284 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:45.935840 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:45.937180 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:45.940511 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.950501 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:45.952327 29381 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:13:45.956931 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:45.818470 29528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37968 (request call id 3766) took 1194 ms. Trace:
I20260709 13:13:45.960165 29528 rpcz_store.cc:276] 0709 13:13:44.624592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:44.624866 (+   274us) service_pool.cc:224] Handling call
0709 13:13:45.778239 (+1153373us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b540020a154. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:45.818403 (+ 40164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":381546752}
I20260709 13:13:45.965098 29450 raft_consensus.cc:1275] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:13:45.966522 29524 raft_consensus.cc:2468] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
W20260709 13:13:45.968809 30119 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:45.976043  1983 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.006s	sys 0.034s
I20260709 13:13:45.976229  1966 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:45.980854  2089 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.982496  2089 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:45.988848  2215 consensus_queue.cc:260] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:45.891863  2241 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:45.990082  2162 consensus_queue.cc:260] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:45.996685  1966 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:45.997376  1967 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:45.996199  2098 raft_consensus.cc:493] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:46.025641 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:46.031749 29374 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:46.026680  1987 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:46.035604  1987 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:46.027408  1966 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:46.028669  2089 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:46.028525  2098 raft_consensus.cc:515] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:46.055040 29495 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:46.057577  1764 raft_consensus.cc:2804] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:46.058166  2098 leader_election.cc:290] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:46.029541  2162 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:46.029987  1967 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:46.026208  2001 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:46.061520 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:46.009366  2265 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:46.034346  2101 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:46.041162 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.028853  2222 raft_consensus.cc:493] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:46.046079 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:46.049646 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:46.050257 29456 raft_consensus.cc:1240] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:46.051348 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:46.052047 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:46.051162 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:46.051151 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:46.074862 29529 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 12.
I20260709 13:13:46.028584  2111 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.054884  1966 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:46.058336  1764 raft_consensus.cc:697] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:46.059814 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
W20260709 13:13:46.071215 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.070147  2265 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:46.083792  2168 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.084794  2168 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:46.087839 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.088433  2222 raft_consensus.cc:515] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:46.090440  2140 raft_consensus.cc:3055] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:13:46.090963  2140 raft_consensus.cc:740] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:13:46.091956 29452 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45796 (request call id 1922) took 1536 ms (client timeout 1531 ms). Trace:
I20260709 13:13:46.087945  2111 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:13:46.092574 29452 rpcz_store.cc:269] 0709 13:13:44.555658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:46.045453 (+1489795us) service_pool.cc:224] Handling call
0709 13:13:46.091849 (+ 46396us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:46.098922  2111 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:46.100170 29526 raft_consensus.cc:1275] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:13:46.103434  2256 raft_consensus.cc:3055] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:46.103965  2256 raft_consensus.cc:740] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:13:46.105580  2256 consensus_queue.cc:260] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:46.107088  2256 raft_consensus.cc:3060] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:46.108127  2236 raft_consensus.cc:3055] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:46.108682 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:46.110690  2202 leader_election.cc:290] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:46.108701  2236 raft_consensus.cc:740] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:46.117573 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:46.118594 29456 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 19.
I20260709 13:13:46.120293  1987 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:46.114173 30119 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:46.124342 30119 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:13:46.117146  2236 consensus_queue.cc:260] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:46.126089  2236 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:46.129514  2222 leader_election.cc:290] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:46.129899  1888 raft_consensus.cc:2804] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:46.130455  1888 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:46.130941  1888 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:46.131095  2168 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:46.132156 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:46.093918  2140 consensus_queue.cc:260] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:46.133689  2140 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:46.136052  2110 raft_consensus.cc:2749] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:46.136812 29372 raft_consensus.cc:1240] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:46.128065 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:46.149371 29455 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.007s	sys 0.002s
W20260709 13:13:46.149964 29455 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.007s	sys 0.002s
I20260709 13:13:46.154873 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:46.155958 29452 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:46.155874 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:46.157051 29372 raft_consensus.cc:2468] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 4.
W20260709 13:13:46.149468  2283 log.cc:927] Time spent T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.652s	user 0.005s	sys 0.000s
I20260709 13:13:46.155073 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:46.164137  2101 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:46.149844 29529 raft_consensus.cc:2468] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 3.
I20260709 13:13:46.113456  1967 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:46.168269  1764 consensus_queue.cc:237] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:46.171522 30119 leader_election.cc:304] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:13:46.172729  2250 raft_consensus.cc:2804] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:13:46.173158  2250 raft_consensus.cc:493] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:46.173491  2250 raft_consensus.cc:3060] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:46.186772 29376 raft_consensus.cc:2468] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 8.
I20260709 13:13:46.190418 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:46.191267 29378 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:13:46.194921 30120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.201301  2067 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:13:46.210973 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.218156 29451 raft_consensus.cc:1275] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:13:46.222431 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.225596 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:46.230803 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:46.244474  2282 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:46.247421  2038 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:46.248306  2080 raft_consensus.cc:3055] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:13:46.248864  2080 raft_consensus.cc:740] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:46.250155  2080 consensus_queue.cc:260] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:46.255132 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:46.268949 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:46.277253 29452 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16.
W20260709 13:13:46.213521 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 46445.4us
I20260709 13:13:46.280622 29448 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:46.281759 29456 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:46.286083  2265 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:46.287586 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:46.297894 29378 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16.
I20260709 13:13:46.274185 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:46.293045 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:46.294502 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:46.309176 29373 consensus_meta.cc:287] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.694s	user 0.014s	sys 0.011s
I20260709 13:13:46.309808 29373 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:46.314946 29377 raft_consensus.cc:1240] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:46.248322  2038 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:46.267912  1967 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.316615  1967 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:46.318363  2038 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:46.311163 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:46.325882 29374 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16.
I20260709 13:13:46.326709 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:46.295181  2080 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:46.319202 29525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 2108) took 1046 ms. Trace:
I20260709 13:13:46.319768 29450 raft_consensus.cc:2468] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
W20260709 13:13:46.319628  2079 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.015s	sys 0.023s
I20260709 13:13:46.331113 29376 raft_consensus.cc:2393] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 7: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
W20260709 13:13:46.331421 30120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:46.334897 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.319262  1967 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:46.340026 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.332791 29525 rpcz_store.cc:276] 0709 13:13:45.247359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:45.316953 (+ 69594us) service_pool.cc:224] Handling call
0709 13:13:45.818878 (+501925us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:45.819297 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:45.819333 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:45.819380 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:45.819413 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:45.819480 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:46.257335 (+437855us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b540020a150. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd858ad 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:46.293592 (+ 36257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1153509632}
I20260709 13:13:46.354578 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:46.359935 29522 raft_consensus.cc:1240] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:46.360885 29373 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:13:46.331156 29421 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:46.334826  2079 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.016s	sys 0.023s
I20260709 13:13:46.386161 29448 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16.
I20260709 13:13:46.366672 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
W20260709 13:13:46.427969 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.429526  2039 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:13:46.435657 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:46.429023 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 90040.4us
W20260709 13:13:46.429095 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 168389us
W20260709 13:13:46.444360 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:46.446769 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:46.447160 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.448225 29380 raft_consensus.cc:1275] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:13:46.429147 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:46.455305 29523 raft_consensus.cc:1240] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 14. Current term is 15. Ops: []
W20260709 13:13:46.458388  2147 consensus_meta.cc:287] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent flushing consensus metadata: real 0.598s	user 0.014s	sys 0.014s
W20260709 13:13:46.467944  2264 consensus_meta.cc:287] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent flushing consensus metadata: real 0.627s	user 0.007s	sys 0.014s
I20260709 13:13:46.469805 29525 raft_consensus.cc:1275] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:13:46.451068 30155 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54224 (request call id 188) took 1441 ms (client timeout 1653 ms). Trace:
W20260709 13:13:46.482409 29381 consensus_meta.cc:287] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.526s	user 0.009s	sys 0.003s
W20260709 13:13:46.474161 30155 rpcz_store.cc:269] 0709 13:13:45.009780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:45.022562 (+ 12782us) service_pool.cc:224] Handling call
0709 13:13:46.450586 (+1428024us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54006a0c54. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:46.450805 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3131960704}
I20260709 13:13:46.482932 29381 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16.
I20260709 13:13:46.481536 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:46.492852 29522 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:46.505790 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:46.521346 29379 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 15.
I20260709 13:13:46.493607  2039 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.525418 29449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2939) took 1137 ms. Trace:
I20260709 13:13:46.526268 29449 rpcz_store.cc:276] 0709 13:13:45.384316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:45.384475 (+   159us) service_pool.cc:224] Handling call
0709 13:13:45.384977 (+   502us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:45.493038 (+108061us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:46.520708 (+1027670us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54000cf3d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:46.521198 (+   490us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":246280960}
I20260709 13:13:46.509855  1888 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:46.530105 29525 raft_consensus.cc:2410] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:13:46.533003 30121 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:46.531116 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:46.537465  2067 consensus_queue.cc:1048] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:13:46.537456 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 276274us
I20260709 13:13:46.518332  2038 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.511039  2250 raft_consensus.cc:515] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:46.544044 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:46.547050 30156 raft_consensus.cc:1813] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 13 FOLLOWER]: Handling vote request from an unknown peer 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:46.548985 30156 raft_consensus.cc:2393] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 13: Already voted for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in this term.
I20260709 13:13:46.548897 29276 catalog_manager.cc:5697] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 2 to 6, leader changed from ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 6 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:13:46.550016 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:46.550951 29526 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
W20260709 13:13:46.552445 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.550843 29276 catalog_manager.cc:5697] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: config changed from index 8 to 10, VOTER 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) evicted. New cstate: current_term: 13 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:46.556564 29528 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:13:46.559620 29455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 2954) took 1016 ms. Trace:
I20260709 13:13:46.560910 29421 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:46.560032 29455 rpcz_store.cc:276] 0709 13:13:45.542846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:45.543037 (+   191us) service_pool.cc:224] Handling call
0709 13:13:45.543442 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:45.619077 (+ 75635us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:45.619126 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:45.619687 (+   561us) log.cc:844] Serialized 26 byte log entry
0709 13:13:46.150710 (+531023us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:46.150808 (+    98us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:46.559053 (+408245us) spinlock_profiling.cc:243] Waited 75 ms on lock 0x7b54000c21d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:46.559102 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:46.559148 (+    46us) raft_consensus.cc:1685] finished
0709 13:13:46.559165 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:46.559485 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6229,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":18989,"spinlock_wait_cycles":172516224,"thread_start_us":530412,"threads_started":1,"wal-append.queue_time_us":600729}
I20260709 13:13:46.554953 30157 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
I20260709 13:13:46.570636  2123 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:46.571713 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.576088 29456 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16.
I20260709 13:13:46.574627 29495 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:46.578562 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:46.580619 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:46.571342  2229 consensus_meta.cc:287] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.688s	user 0.005s	sys 0.016s
I20260709 13:13:46.571269  2123 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:46.571638  2038 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:46.587922 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 58358.5us
I20260709 13:13:46.587920 29421 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:46.534325  2039 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:46.575446 29346 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:46.579123  2236 raft_consensus.cc:2749] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:13:46.594910  2248 raft_consensus.cc:2804] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:46.595227  1888 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 13 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:46.573997  2310 raft_consensus.cc:2749] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:13:46.596792 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.569219  2215 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:46.595440 29528 raft_consensus.cc:1240] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:13:46.595688  2248 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:46.606340  2162 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:46.602114  2248 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:46.611006 29379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 1808) took 1157 ms. Trace:
W20260709 13:13:46.616019  2314 log.cc:927] Time spent T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:13:46.605494  1888 consensus_queue.cc:1059] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:13:46.617689  2310 raft_consensus.cc:3055] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:13:46.618182  2310 raft_consensus.cc:740] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:13:46.618990  2038 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:46.619415  2310 consensus_queue.cc:260] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:46.625572  2039 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:46.625770 29419 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:46.615833 29379 rpcz_store.cc:276] 0709 13:13:45.453971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:45.456538 (+  2567us) service_pool.cc:224] Handling call
0709 13:13:46.608826 (+1152288us) spinlock_profiling.cc:243] Waited 968 ms on lock 0x7b54003bb854. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:46.610870 (+  2044us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2225403136}
W20260709 13:13:46.641764 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 66515.9us
I20260709 13:13:46.644537 29522 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 14.
W20260709 13:13:46.646528 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.649230 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:46.643962  2039 raft_consensus.cc:2764] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:13:46.653824 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:46.653934 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:46.655457 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:46.656482 29451 raft_consensus.cc:2410] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:13:46.656966 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:46.657645 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 90140.2us
I20260709 13:13:46.660094 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:46.661434  2250 leader_election.cc:290] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 5 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:46.666944  2123 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:46.678138 29344 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:46.679179 29276 catalog_manager.cc:5697] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: config changed from index 5 to 8, term changed from 10 to 12, VOTER 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) evicted. New cstate: current_term: 12 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
W20260709 13:13:46.682466  2313 log.cc:927] Time spent T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:13:46.684155  1683 raft_consensus.cc:2804] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:46.684664 29455 raft_consensus.cc:2393] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 16: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:46.686295  1805 consensus_queue.cc:1048] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:46.684665  1683 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:46.687925  1683 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:46.696363 29456 raft_consensus.cc:2393] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 8: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
W20260709 13:13:46.699435  2140 consensus_meta.cc:287] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.565s	user 0.008s	sys 0.005s
I20260709 13:13:46.703722 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:46.704011 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:46.703554  2312 consensus_queue.cc:1048] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:46.704275  2310 raft_consensus.cc:3060] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:13:46.705379 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:46.708030 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:13:46.711443 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 57794.9us
I20260709 13:13:46.709625 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:46.711941 29377 raft_consensus.cc:3060] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:46.713572 30154 raft_consensus.cc:1240] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 13 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:46.712399 29522 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:46.720775 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 167283us
I20260709 13:13:46.734166 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:46.741482 30157 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54224 (request call id 185) took 2043 ms (client timeout 2133 ms). Trace:
I20260709 13:13:46.739301  1966 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:13:46.748762 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 67183us
I20260709 13:13:46.753322 30155 raft_consensus.cc:1275] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 14 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:13:46.752301 29421 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:46.747401 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:46.743712 30157 rpcz_store.cc:269] 0709 13:13:44.698500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:44.698686 (+   186us) service_pool.cc:224] Handling call
0709 13:13:46.733781 (+2035095us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b540070b554. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:46.741341 (+  7560us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4045943040}
I20260709 13:13:46.727463 30156 raft_consensus.cc:2468] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:13:46.747861  1966 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:46.763798 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:46.765849 29344 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:46.766156 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:46.767035 29528 raft_consensus.cc:3060] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:13:46.742348  2250 consensus_queue.cc:1048] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:13:46.769531  2039 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:46.758798  2282 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:46.795979  2282 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:46.780961 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:46.781780 29523 raft_consensus.cc:1240] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 19. Current term is 20. Ops: []
I20260709 13:13:46.781571  1683 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:46.800331  1683 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:46.783877 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 44218.3us
I20260709 13:13:46.784368  2080 consensus_queue.cc:1048] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:46.784822 29524 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:13:46.765823  2265 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:46.801971  2265 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:46.803021 29421 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:46.803767  2039 consensus_queue.cc:1048] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:46.804927  2229 raft_consensus.cc:2749] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:46.805048  2265 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:46.789371 29344 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:46.783210 29346 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:46.807425 29421 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:46.809237  2229 raft_consensus.cc:2749] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:13:46.810328  1683 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:46.810806  1683 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:46.811232  1683 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:46.776896 29380 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 14.
I20260709 13:13:46.812446 29421 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:46.812845  2140 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.813328 30121 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:46.813668  2140 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:46.814790  2123 raft_consensus.cc:2804] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:46.814401 29421 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:46.808275 29344 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:46.768952  1966 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:13:46.815711 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 45230.1us
I20260709 13:13:46.825991 29522 raft_consensus.cc:2468] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 13.
I20260709 13:13:46.827224 29526 raft_consensus.cc:1240] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 12. Current term is 13. Ops: []
W20260709 13:13:46.833473 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.819931  2038 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:46.815219  2123 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:46.855331  2001 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.887610  2001 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:46.890188  2001 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:46.870144  2039 raft_consensus.cc:2749] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:13:46.853698  2080 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:46.855670  2038 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:13:46.885905 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 71614.4us
W20260709 13:13:46.886705 29493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 64594.6us
I20260709 13:13:46.856374  2265 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:46.855031  2101 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:46.852692  2318 raft_consensus.cc:2804] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:46.861406  2123 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:46.901810 29377 raft_consensus.cc:2468] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 5.
I20260709 13:13:46.901233 30119 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:46.905949 29528 raft_consensus.cc:2468] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 5.
I20260709 13:13:46.869823  2242 raft_consensus.cc:2804] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:46.913270 30121 leader_election.cc:304] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:13:46.914875  1888 raft_consensus.cc:2804] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:46.917699  1888 raft_consensus.cc:697] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:13:46.917593  2101 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:46.918900  1888 consensus_queue.cc:237] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:46.902457  2038 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:46.901021  2080 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:46.915197  2310 raft_consensus.cc:2804] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:13:46.952020 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.915927  2242 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:46.923223  2318 raft_consensus.cc:697] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:13:46.961710 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 81438.5us
I20260709 13:13:46.926296  2080 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:46.908272  2265 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:46.965862  2310 raft_consensus.cc:697] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 13 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:13:46.962051  2242 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:46.975997  2310 consensus_queue.cc:237] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:46.984913  2101 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:46.985808  2101 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:46.986349  2101 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:46.987334  2282 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:46.988117  2318 consensus_queue.cc:237] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:46.993724 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 77423.1us
W20260709 13:13:47.016462 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:46.992403  2039 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:47.022743  2215 raft_consensus.cc:493] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.024689 29344 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:47.033937 29421 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:47.052687 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 83391.5us
I20260709 13:13:47.054143  2162 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:47.033593  2039 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:47.075347  2067 raft_consensus.cc:2749] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:47.049173  2248 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:47.052021  2215 raft_consensus.cc:515] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:47.098906 29344 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:13:47.109869 29495 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:47.111896  2335 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.089339  2265 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:47.111687  2328 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:47.098313  2144 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:47.143675  2001 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.144317  2001 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:47.144553  2336 raft_consensus.cc:2804] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:13:47.142701 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 51966.9us
I20260709 13:13:47.144470  2337 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.111841  2329 consensus_queue.cc:1059] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:13:47.170189 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.117548  2236 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:47.115483  2162 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:47.139829  2144 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:47.174635 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 66210.3us
I20260709 13:13:47.187546 29528 raft_consensus.cc:1240] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 12. Current term is 13. Ops: []
W20260709 13:13:47.224622 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.174062  2001 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:47.136971  2335 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:47.257038  2144 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:47.137585  2067 raft_consensus.cc:2764] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:13:47.201292 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:13:47.192555 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 91834.4us
I20260709 13:13:47.263302 29346 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:47.263726 29495 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:47.136817  2331 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:13:47.317025 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 53457.1us
I20260709 13:13:47.319594 29495 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:47.259397  2067 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.198454  2336 raft_consensus.cc:697] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:47.183622  2101 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:47.323277 29344 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:47.142752  2265 consensus_queue.cc:1048] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.174s
I20260709 13:13:47.218492  1683 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:47.344197  2336 consensus_queue.cc:237] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:47.345563  1683 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:47.346374  1683 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:47.346737  1683 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.349293  1683 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:13:47.338253 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 75041.3us
I20260709 13:13:47.152680  2337 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:47.338956  2318 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.317246  2325 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:47.325664  2340 raft_consensus.cc:2804] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:47.353344 29346 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:47.264937  2335 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:47.200069  2328 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:47.339308  2248 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:47.375648  2318 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:47.377547  2328 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:47.378119  2339 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:13:47.378895  2335 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:47.380193  2039 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:47.381748  2337 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:47.332724  2236 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:47.381955  2123 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:47.352010  1805 raft_consensus.cc:2749] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:47.365424  2265 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:47.401373 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 388797us
W20260709 13:13:47.403159 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.367692  2340 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.331409  2067 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:47.409639 29495 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:47.374058  2215 leader_election.cc:290] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:47.325758  2331 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:47.423318 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 70068.7us
I20260709 13:13:47.372409  2038 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:47.403450  2229 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:47.412209  2248 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:47.459275  2039 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:13:47.495947 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 106040us
I20260709 13:13:47.368840  2325 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:47.499598 29346 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:47.480509  2340 raft_consensus.cc:3060] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:47.504812 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 98414.6us
I20260709 13:13:47.481321  2265 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:47.562610  2265 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:47.513566  2229 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:47.568882  2229 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:47.514914  2339 consensus_queue.cc:1048] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:13:47.570380 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:47.571698  2039 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:47.567992  1966 consensus_meta.cc:287] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.713s	user 0.015s	sys 0.001s
I20260709 13:13:47.572930  1966 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:47.574420  2039 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:47.498574  2355 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:47.580608  2340 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:47.483470  2347 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:47.582020  2347 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:47.584357  2347 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:47.584789  1966 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:47.586092  2038 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:47.589007  2325 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:47.592799  2236 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:47.594743  2318 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:47.595849  2162 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:47.597960  1805 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:47.598618  1805 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:47.505497 29421 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:13:47.520123  2324 log.cc:927] Time spent T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.194s	user 0.000s	sys 0.000s
I20260709 13:13:47.520813 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:47.522663  2331 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:47.523319 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:47.523990 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:47.500845  2001 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:47.528291 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:47.608925 29456 raft_consensus.cc:2393] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 12: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:47.532183  2140 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:13:47.533805  2348 log.cc:927] Time spent T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.157s	user 0.003s	sys 0.000s
I20260709 13:13:47.536607  2144 raft_consensus.cc:3055] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:47.549073  2123 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 15 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:47.483068  2352 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:47.551630  2282 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.641645 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:47.513787  2327 raft_consensus.cc:2804] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:47.558501  2356 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.509029  2248 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:47.498014  2335 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:47.600914 29455 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 18.
I20260709 13:13:47.617208  2340 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:47.674571 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:47.626868 29453 raft_consensus.cc:2393] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 19: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:47.557431  2067 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:47.641419  2318 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.648700 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:47.632208  2001 raft_consensus.cc:697] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:47.655895 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:13:47.629868  2080 consensus_meta.cc:287] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.658s	user 0.011s	sys 0.003s
I20260709 13:13:47.658295 30155 raft_consensus.cc:1240] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 15 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:13:47.617188  2215 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.659379 29449 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
I20260709 13:13:47.659771 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:47.700695 30157 raft_consensus.cc:2468] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 7.
I20260709 13:13:47.661226 29528 raft_consensus.cc:1240] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 13:13:47.613543  2310 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.023s	sys 0.005s
I20260709 13:13:47.599057  2328 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.626883  2355 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:47.675349 29380 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:47.627873  2325 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
W20260709 13:13:47.656296  1888 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.006s	sys 0.013s
I20260709 13:13:47.680787 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:47.719898 29452 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 15.
I20260709 13:13:47.678473 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:47.721055 29524 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:47.631057  2144 raft_consensus.cc:740] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:47.641721  2347 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.683635 29526 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 14.
I20260709 13:13:47.643270 29529 raft_consensus.cc:2468] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 6.
I20260709 13:13:47.656795  2282 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:47.691519 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 192019us
I20260709 13:13:47.681768 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:47.721632 29344 leader_election.cc:304] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:13:47.695648 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:47.710889 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:47.672523  2327 raft_consensus.cc:697] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
W20260709 13:13:47.707226 29419 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.590s (SENT) [suppressed 25 similar messages]
I20260709 13:13:47.704965  2140 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:47.705505  2310 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.024s	sys 0.005s
I20260709 13:13:47.631846  2236 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:47.728276 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:47.761752 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 269700us
I20260709 13:13:47.762266 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:47.705296 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
W20260709 13:13:47.695264 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.763417 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:47.722136  1888 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.006s	sys 0.014s
W20260709 13:13:47.725301  2242 consensus_meta.cc:287] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.735s	user 0.015s	sys 0.000s
I20260709 13:13:47.768559 29525 raft_consensus.cc:2393] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 15: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:47.770656 29521 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 20.
I20260709 13:13:47.769562 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:47.726033  2147 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:47.695705  2318 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:47.772884 29452 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:47.773736 29453 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 15.
W20260709 13:13:47.771770 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 50286.4us
I20260709 13:13:47.705868  2080 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:47.712394  2215 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:47.672302  2356 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:47.779793 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:47.784850  2144 consensus_queue.cc:260] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:47.786789  2346 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:47.721967  2355 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:47.788291  2362 raft_consensus.cc:2804] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:47.788957  2362 raft_consensus.cc:697] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 8 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:47.790103  2362 consensus_queue.cc:237] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:47.792013  2038 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:47.726892  2325 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:47.792943  2038 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:47.794911  2325 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:47.795472  2282 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:47.796029  2147 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:47.796970  2248 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:47.798399  2147 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:47.770643  2140 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:47.670482  2352 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:47.801421  2352 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:47.802775  2335 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:47.803517  2001 consensus_queue.cc:237] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:47.780054  2242 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:47.718904  2328 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:47.808281  2215 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:47.808945  2328 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:47.776050  2330 raft_consensus.cc:2804] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:47.810539  2327 consensus_queue.cc:237] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:47.787628 29454 raft_consensus.cc:1275] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:13:47.813203 29380 raft_consensus.cc:2468] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 15.
I20260709 13:13:47.814579 30121 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:13:47.761083  2101 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.816540 29524 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
I20260709 13:13:47.821977 29449 raft_consensus.cc:1240] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:47.826349 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:47.787326  2346 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.827111 29525 raft_consensus.cc:2393] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 15: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:47.780262  2236 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:47.832095  2318 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:47.832252  2356 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:47.828671  2147 raft_consensus.cc:2804] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:13:47.835147 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 127944us
I20260709 13:13:47.835842 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:47.838789 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:47.839852 29449 raft_consensus.cc:1275] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:13:47.843133 29451 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16.
I20260709 13:13:47.843320 29450 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
I20260709 13:13:47.812736  2330 raft_consensus.cc:493] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.840517  2329 consensus_queue.cc:1059] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:13:47.848867  2330 raft_consensus.cc:3060] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:47.777911  2347 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:47.834029  2346 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:47.850800 29346 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:47.828624  2328 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:47.845983  2236 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:47.834770  2335 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:47.851801  2147 raft_consensus.cc:697] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 15 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:13:47.834221  2101 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:47.885560 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:47.855851  2356 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:47.860592  2038 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:47.887171 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:47.872907  2334 raft_consensus.cc:2749] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:47.898551 29450 raft_consensus.cc:2468] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 6.
I20260709 13:13:47.899245 29346 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:47.901677  2080 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:47.872308  2067 consensus_queue.cc:1059] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
W20260709 13:13:47.903910  1683 consensus_meta.cc:287] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.554s	user 0.014s	sys 0.000s
I20260709 13:13:47.898566  2356 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:47.906615  2101 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:47.924167 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:47.925215  1683 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:47.929279  1683 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:47.916693 29344 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:47.932788 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:47.933730 29381 raft_consensus.cc:2393] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 16: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:47.934623 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:47.932305  2264 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.937155 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:47.937641 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:47.938608 29373 raft_consensus.cc:2410] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
W20260709 13:13:47.939801  2369 log.cc:927] Time spent T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:13:47.939996  2363 log.cc:927] Time spent T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:13:47.936045 29344 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:47.942529 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:47.888707  2328 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:47.952855 29378 raft_consensus.cc:1240] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:47.955255 29380 raft_consensus.cc:1240] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:47.915578  2038 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:47.930999  2318 raft_consensus.cc:2749] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:13:47.954210 29344 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:47.936477  2372 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:47.970947 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:47.911175  2335 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:47.977727 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:47.981009 29380 raft_consensus.cc:1240] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:47.983646  1805 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:47.987818  2147 consensus_queue.cc:237] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:47.930778  2352 consensus_queue.cc:1059] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:13:47.954013  2067 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:13:47.969255  2038 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:47.995637 29451 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:47.989439 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:47.937578  2264 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:48.005594  2264 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:47.975188  2334 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:48.014734  2334 raft_consensus.cc:697] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:48.014715  2123 consensus_queue.cc:1059] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:48.016661  2310 raft_consensus.cc:3055] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:48.016404  2334 consensus_queue.cc:237] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:48.017086  2310 raft_consensus.cc:740] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:13:48.017570  2038 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:48.018137  2310 consensus_queue.cc:260] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:48.019836  2310 raft_consensus.cc:3060] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:48.024487  2162 raft_consensus.cc:3055] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:48.024987  2162 raft_consensus.cc:740] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:48.025234 30156 raft_consensus.cc:1240] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 13 LEADER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:48.025856  2162 consensus_queue.cc:260] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:48.001725  2371 log.cc:927] Time spent T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:13:48.002763  2356 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:47.975975  2372 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:47.992753  2067 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:47.999483 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:48.041507 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 47908.8us
I20260709 13:13:48.048477 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:48.049175 29380 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
I20260709 13:13:48.015007  2347 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:48.046144  2067 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:48.042694  2372 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:48.065482 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:48.066399 29380 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
W20260709 13:13:48.056437  2380 log.cc:927] Time spent T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:13:48.069584 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:48.078073 29278 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37608 (request call id 156) took 22292 ms (client timeout 15000 ms). Trace:
I20260709 13:13:48.078450  2328 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:48.085039 29381 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 17.
I20260709 13:13:48.092711 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:48.093698 29380 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 19.
I20260709 13:13:48.090143  2162 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:48.098548 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:48.099815 29381 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 13.
I20260709 13:13:48.105487 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:48.110189 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:48.137964  2346 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:48.149910  2382 log.cc:927] Time spent T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:13:48.080070 29278 rpcz_store.cc:269] 0709 13:13:25.785422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:25.785802 (+   380us) service_pool.cc:224] Handling call
0709 13:13:48.077774 (+22291972us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:42.762854 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:42.816785 (+ 53931us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:42.816850 (+    65us) write_op.cc:435] Acquired schema lock
0709 13:13:42.816882 (+    32us) tablet.cc:662] Decoding operations
0709 13:13:42.818922 (+  2040us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:42.819032 (+   110us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:42.819062 (+    30us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:13:42.964683 (+145621us) tablet.cc:701] Row locks acquired
0709 13:13:42.964718 (+    35us) write_op.cc:260] PREPARE: finished
0709 13:13:42.964903 (+   185us) write_op.cc:270] Start()
0709 13:13:42.965066 (+   163us) write_op.cc:276] Timestamp: P: 1783602822964847 usec, L: 0
0709 13:13:42.965122 (+    56us) op_driver.cc:348] REPLICATION: starting
0709 13:13:42.966090 (+   968us) log.cc:844] Serialized 6405 byte log entry
0709 13:13:44.270084 (+1303994us) op_driver.cc:464] REPLICATION: finished
0709 13:13:44.659832 (+389748us) write_op.cc:301] APPLY: starting
0709 13:13:44.661883 (+  2051us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:45.307031 (+645148us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:45.323644 (+ 16613us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:45.775241 (+451597us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:45.835869 (+ 60628us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 13:13:45.835948 (+    79us) write_op.cc:312] APPLY: finished
0709 13:13:45.836566 (+   618us) log.cc:844] Serialized 147 byte log entry
0709 13:13:45.887859 (+ 51293us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:45.888126 (+   267us) write_op.cc:454] Released schema lock
0709 13:13:45.888247 (+   121us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:45.888839 (+   592us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:45.888892 (+    53us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":100869,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":366157,"apply.run_cpu_time_us":62773,"apply.run_wall_time_us":1239293,"cfile_cache_hit":66,"cfile_cache_hit_bytes":70879,"num_ops":16,"prepare.queue_time_us":202171,"prepare.run_cpu_time_us":35618,"prepare.run_wall_time_us":496986,"raft.queue_time_us":614632,"raft.run_cpu_time_us":43747,"raft.run_wall_time_us":225390,"replication_time_us":1304764,"thread_start_us":1095166,"threads_started":5,"wal-append.queue_time_us":396836,"wal-append.run_cpu_time_us":31093,"wal-append.run_wall_time_us":2842556}]]}
I20260709 13:13:48.166697  2067 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:48.177871  2331 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:48.177881  2067 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:48.178622  2331 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:48.181141  2331 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:48.181514  2144 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:48.181715 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:48.182578 29451 raft_consensus.cc:2468] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 10.
I20260709 13:13:48.183710 29522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3798) took 1059 ms. Trace:
I20260709 13:13:48.184089 29522 rpcz_store.cc:276] 0709 13:13:47.124470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:47.124698 (+   228us) service_pool.cc:224] Handling call
0709 13:13:47.156351 (+ 31653us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:47.589900 (+433549us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:13:47.590341 (+   441us) log.cc:844] Serialized 14 byte log entry
0709 13:13:47.769387 (+179046us) log.cc:844] Serialized 14 byte log entry
0709 13:13:48.182452 (+413065us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:48.182516 (+    64us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:48.182604 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:48.183422 (+   818us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b540006efd4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:48.183479 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:48.183631 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":434349,"prepare.queue_time_us":2000,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":80,"raft.queue_time_us":429208,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":152,"spinlock_wait_cycles":996325760,"thread_start_us":155317,"threads_started":1,"wal-append.queue_time_us":243917}
I20260709 13:13:48.168046  2372 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:48.168883 30121 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:13:48.170665  2346 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:48.188206 30121 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:13:48.192538 30156 raft_consensus.cc:1240] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 15 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 14. Current term is 15. Ops: [14.11-14.11]
W20260709 13:13:48.192898 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 410185us
I20260709 13:13:48.194465  1888 raft_consensus.cc:2804] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:48.196503  1888 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:48.196909 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:48.197230 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:48.197679 29376 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
I20260709 13:13:48.198475 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:48.199182 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:48.199852 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:48.199911 29523 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 14.
I20260709 13:13:48.200512 29526 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
I20260709 13:13:48.201261 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:48.202657  2342 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.196921  1888 raft_consensus.cc:3060] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:48.203224  2342 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:48.204330 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:48.203675 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:48.204921 29524 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:48.205365 29527 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:13:48.206120 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:48.206528 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:48.207050  1967 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:48.207881 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:48.192452  2335 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:48.208849 29376 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:48.209420  2335 consensus_queue.cc:1059] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:13:48.210172  2335 consensus_queue.cc:1243] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer ca041dab9b2f44409ed7bf4c6cf66ab2 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:13:48.207633  1967 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:48.223841 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:48.224619 29527 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:48.227128 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:48.229525 29523 raft_consensus.cc:1275] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:13:48.233211 29495 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:48.234656 29495 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
W20260709 13:13:48.235749 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:48.236467  2336 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:48.237279  2326 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:48.237869  2326 raft_consensus.cc:697] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:48.238060  2330 raft_consensus.cc:515] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:48.240886  1967 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:48.241405 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:48.242234 29381 raft_consensus.cc:2393] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 15: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:48.242148 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:48.242973 29372 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
I20260709 13:13:48.243230 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:48.243930 29381 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 17.
I20260709 13:13:48.244113 29377 raft_consensus.cc:1240] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 10. Current term is 11. Ops: []
I20260709 13:13:48.243991 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:48.244839 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:48.245407 29377 raft_consensus.cc:1240] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:48.246493 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:48.247057 29380 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:48.247390  2123 consensus_queue.cc:1048] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:13:48.247936  2346 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.248468  2346 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:48.245436 29381 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 16.
I20260709 13:13:48.251912 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:48.255131 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:13:48.253463  2346 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:48.255897 30153 raft_consensus.cc:3060] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:48.257385  2330 leader_election.cc:290] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Requested vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:48.194684  2147 raft_consensus.cc:2804] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:13:48.271433 29524 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:13:48.270080 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:48.278358 29380 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 15.
I20260709 13:13:48.276944 29376 raft_consensus.cc:2468] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 13.
W20260709 13:13:48.279325 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 44775.8us
I20260709 13:13:48.268005  2147 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:48.238874  2326 consensus_queue.cc:237] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:48.281723 29374 raft_consensus.cc:2468] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 9.
I20260709 13:13:48.282053 29529 raft_consensus.cc:1275] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:13:48.280704 29525 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:13:48.287216 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:48.286229 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:48.289470 29381 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
I20260709 13:13:48.290211 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:48.295583 29376 raft_consensus.cc:1275] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:13:48.295300 29495 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:48.285007  2147 raft_consensus.cc:3060] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:48.299316 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:48.303231 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:48.304487 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:48.308432  2386 log.cc:927] Time spent T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 13:13:48.314085  2342 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:48.314499 29344 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:48.311200 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:48.304414  2265 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:48.315975 29522 raft_consensus.cc:3060] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:13:48.317312 29523 raft_consensus.cc:2393] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 20: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:48.319577 29344 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:48.316311  2328 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:48.320539  2328 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:48.320886  2328 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:48.320847 29344 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:48.322090 29527 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:13:48.323606 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:48.324929 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:48.325960 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:48.326617 29524 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:48.330521 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:48.331125 29376 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 17.
I20260709 13:13:48.335227  2372 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:48.335044 30153 raft_consensus.cc:2468] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:13:48.336308  2140 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:48.337952  2242 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:48.326745  2354 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:48.340013  2354 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:48.340432  2354 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:48.342417  2328 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:48.347688  2236 raft_consensus.cc:3055] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:48.348479  2236 raft_consensus.cc:740] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:48.329936 29344 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:48.353778 29344 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:48.350121  2328 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:48.356114 29524 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 21.
I20260709 13:13:48.356441 29520 tablet_service.cc:1558] Processing DeleteTablet for tablet 829dc08ee0ca4212a3b2c870b0ea1b35 with delete_type TABLET_DATA_TOMBSTONED (TS 71aa3578fd924765ab9ac0729c8d1483 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:37954
I20260709 13:13:48.361425  2140 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.362038  2242 raft_consensus.cc:2804] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:48.325024  2067 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:48.362854  2242 raft_consensus.cc:697] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:48.363149  2067 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:48.363669  2067 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:48.364434  2242 consensus_queue.cc:237] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:48.362085  2140 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:48.376528  2390 log.cc:927] Time spent T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.256s	user 0.004s	sys 0.001s
I20260709 13:13:48.349840  2236 consensus_queue.cc:260] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:48.385892  2236 raft_consensus.cc:3060] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:48.389758 29276 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35182 (request call id 73) took 8656 ms. Trace:
I20260709 13:13:48.397951  2355 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:48.401988  2147 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:48.403481 30156 raft_consensus.cc:1240] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 6. Current term is 7. Ops: []
I20260709 13:13:48.404163 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:48.405014 29376 raft_consensus.cc:2393] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 16: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:13:48.406328 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 52660.6us
I20260709 13:13:48.408238  2325 consensus_queue.cc:1059] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:48.409389 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:48.409667  2325 raft_consensus.cc:3055] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:13:48.409690 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:48.410411 29373 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
I20260709 13:13:48.410804 29378 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
I20260709 13:13:48.375056  2140 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:48.417445 29522 raft_consensus.cc:2468] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 8.
I20260709 13:13:48.419332 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:48.415944 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 92893.4us
I20260709 13:13:48.431237 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:48.434953 29344 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:48.436342 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:48.437543 29373 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 19.
I20260709 13:13:48.439740 29525 raft_consensus.cc:1240] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:48.449173 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:48.415988  2355 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:48.410156  2325 raft_consensus.cc:740] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:48.461248 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:48.462783 29374 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
I20260709 13:13:48.456015 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:48.390254 29276 rpcz_store.cc:276] 0709 13:13:39.733665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:39.740937 (+  7272us) service_pool.cc:224] Handling call
0709 13:13:48.389642 (+8648705us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:47.014451 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:47.211846 (+197395us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:47.217884 (+  6038us) write_op.cc:435] Acquired schema lock
0709 13:13:47.249986 (+ 32102us) tablet.cc:662] Decoding operations
0709 13:13:47.483278 (+233292us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:47.501300 (+ 18022us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:47.504863 (+  3563us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:13:47.517744 (+ 12881us) tablet.cc:701] Row locks acquired
0709 13:13:47.517789 (+    45us) write_op.cc:260] PREPARE: finished
0709 13:13:47.517995 (+   206us) write_op.cc:270] Start()
0709 13:13:47.518174 (+   179us) write_op.cc:276] Timestamp: P: 1783602827517912 usec, L: 0
0709 13:13:47.518207 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:13:47.519065 (+   858us) log.cc:844] Serialized 1310 byte log entry
0709 13:13:47.940505 (+421440us) op_driver.cc:464] REPLICATION: finished
0709 13:13:48.114605 (+174100us) write_op.cc:301] APPLY: starting
0709 13:13:48.114759 (+   154us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:48.184740 (+ 69981us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:48.184867 (+   127us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:48.192786 (+  7919us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:48.193075 (+   289us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:13:48.193149 (+    74us) write_op.cc:312] APPLY: finished
0709 13:13:48.220497 (+ 27348us) log.cc:844] Serialized 40 byte log entry
0709 13:13:48.276741 (+ 56244us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:48.284181 (+  7440us) write_op.cc:454] Released schema lock
0709 13:13:48.291477 (+  7296us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:48.316715 (+ 25238us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:48.321880 (+  5165us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":447998,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":173687,"apply.run_cpu_time_us":7898,"apply.run_wall_time_us":185885,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16643,"num_ops":3,"prepare.queue_time_us":271212,"prepare.run_cpu_time_us":25919,"prepare.run_wall_time_us":707285,"raft.queue_time_us":100238,"raft.run_cpu_time_us":14739,"raft.run_wall_time_us":194273,"replication_time_us":415033,"spinlock_wait_cycles":6912,"thread_start_us":576068,"threads_started":4,"wal-append.queue_time_us":202931}]]}
I20260709 13:13:48.457100 29344 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:48.470683 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:48.472294  2335 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.472908  2335 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:48.480032  2395 tablet_replica.cc:333] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:13:48.480417 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:48.481359 29529 raft_consensus.cc:2393] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 14: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:48.481779  2395 raft_consensus.cc:2243] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:48.483074  2395 raft_consensus.cc:2272] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:48.483209 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:48.484097 29529 raft_consensus.cc:2393] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 13: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:48.419299  2346 consensus_queue.cc:1048] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:13:48.485080  2147 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 7 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:48.487180 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:48.487090  2325 consensus_queue.cc:260] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:48.488629  2325 raft_consensus.cc:3060] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:48.453277  2372 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:48.500186 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:48.505470 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:48.506222 29526 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:48.504607 29344 leader_election.cc:304] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:48.513504 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:48.469313  2355 raft_consensus.cc:697] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:48.518187 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:48.520237 29375 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 16.
I20260709 13:13:48.526952 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:48.528484 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:48.499192  2162 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:13:48.525513 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:48.533085 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:48.534021 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:48.534752 29451 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:13:48.541215 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:48.557443 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:48.558475 29452 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:48.532524  2351 raft_consensus.cc:2804] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:48.560276 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:48.561022 29523 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:48.511935  2372 raft_consensus.cc:697] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:48.558023 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:48.566722 29529 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:48.576325 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:48.577468 29380 raft_consensus.cc:2393] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 15: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:48.584775 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:48.600116 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:48.601059 29373 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
I20260709 13:13:48.603916 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:48.599339 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:48.606546 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:48.607892 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:48.604961 29450 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:13:48.610792 29374 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
I20260709 13:13:48.616158 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:48.617055 29377 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:48.618273 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:48.620752 29378 raft_consensus.cc:1275] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:13:48.622927 29522 raft_consensus.cc:1240] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:48.619377 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:48.625878 29381 raft_consensus.cc:1275] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:13:48.627456 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:48.628968 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:48.629468  2372 consensus_queue.cc:237] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:48.634835 29372 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:13:48.635705 29372 raft_consensus.cc:606] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:48.636101 29372 raft_consensus.cc:614] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:48.637641  2355 consensus_queue.cc:237] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:48.639143 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:48.640422  2395 ts_tablet_manager.cc:1916] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:13:48.644847 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:48.645612 29376 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:48.637979 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:48.537528  1888 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:48.582377  2162 raft_consensus.cc:697] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:48.651970 29523 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:13:48.653146 29373 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16.
I20260709 13:13:48.600380  2140 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.656301 29452 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
I20260709 13:13:48.656864 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:48.662350 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:48.662731 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:48.663123 29450 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 20.
I20260709 13:13:48.663255 29528 raft_consensus.cc:1240] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:48.663431 29523 raft_consensus.cc:2393] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 15: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:48.664237 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:48.665086 29524 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 17.
I20260709 13:13:48.606257  2351 raft_consensus.cc:697] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:48.671523 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:48.679066 29372 raft_consensus.cc:1275] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:13:48.652644  2362 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.680995 29421 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:48.684795 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:48.722597 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:48.723663 29523 raft_consensus.cc:2393] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 13: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:48.719240  2330 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.724828  2356 raft_consensus.cc:3060] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:48.725809  2338 consensus_queue.cc:1048] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:48.683967  2354 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:48.729533  2354 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:48.686051 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:48.732111 29530 raft_consensus.cc:2410] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:13:48.733045 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:48.733808 29530 raft_consensus.cc:2368] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 14. Current term is 15.
I20260709 13:13:48.734025 29454 raft_consensus.cc:2410] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:13:48.686233 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:48.710848  2362 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:48.742957 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:48.694478 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:48.744588 29450 raft_consensus.cc:2393] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 13: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:48.695425 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:48.745056  2162 consensus_queue.cc:237] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:48.670849  2140 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:48.694389  2144 consensus_meta.cc:287] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.512s	user 0.011s	sys 0.004s
W20260709 13:13:48.720157 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:48.724821  2330 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:48.745597 29452 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:13:48.697127 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:48.753539 29528 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 15.
I20260709 13:13:48.756072 29379 raft_consensus.cc:1275] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:13:48.758057 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:48.734632 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:48.724669 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:48.768254 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:48.769199 29447 raft_consensus.cc:2393] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 15: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
W20260709 13:13:48.804000 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 187557us
I20260709 13:13:48.806857 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:48.814626 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:48.815366 29380 raft_consensus.cc:3060] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:13:48.829838 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:48.831182 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:48.831374 29522 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:13:48.836123 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:48.854137 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:48.860105 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:48.861172 29447 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:13:48.867543 29380 raft_consensus.cc:2468] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 11.
W20260709 13:13:48.857723 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 259387us
I20260709 13:13:48.837397  1888 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 11 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:48.871897 29344 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:48.874147 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:48.878517 29529 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:13:48.879226 29524 raft_consensus.cc:1240] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:48.875046 29447 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
I20260709 13:13:48.891965 29522 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:13:48.851999  2236 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.897692 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:48.851857  2351 consensus_queue.cc:237] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:48.896931  2140 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:48.906347 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:48.908002 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:48.997112 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:48.997895 29523 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 17.
I20260709 13:13:48.912681 29452 raft_consensus.cc:1240] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:48.912479 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:48.933154 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:48.998780 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:49.000083 29450 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 15.
I20260709 13:13:48.934441 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:48.935425 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:48.936017 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:49.001303 29451 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:48.937836 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:48.941866 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:49.003391 29380 raft_consensus.cc:2410] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:13:48.944118 29374 raft_consensus.cc:1275] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:13:48.948101 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:48.950071 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:48.949946 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:48.950471 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:49.005765 29373 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:49.005937 29522 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 15.
I20260709 13:13:48.951594 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:48.961104 29379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 894) took 1263 ms. Trace:
I20260709 13:13:49.008634 29379 rpcz_store.cc:276] 0709 13:13:47.697253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:47.697494 (+   241us) service_pool.cc:224] Handling call
0709 13:13:47.715619 (+ 18125us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:48.756952 (+1041333us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:48.960778 (+203826us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54001d4054. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:48.960991 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2391483776}
I20260709 13:13:48.963404 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:48.970299  2335 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:49.007447 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:48.970516  2395 ts_tablet_manager.cc:1929] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.9
I20260709 13:13:48.975680 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:48.984571  2330 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:48.990182 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:49.015410 29376 raft_consensus.cc:2393] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 20: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
W20260709 13:13:49.016106 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 346388us
I20260709 13:13:49.016363 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:49.018297 29452 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16.
I20260709 13:13:49.018442 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:49.019821 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:49.020833 29454 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 15.
W20260709 13:13:49.028988 29526 consensus_meta.cc:287] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.518s	user 0.013s	sys 0.002s
I20260709 13:13:49.021255 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:49.029388 29526 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 16.
I20260709 13:13:49.022419 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:49.030107 29525 raft_consensus.cc:2468] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 7.
I20260709 13:13:49.033079 29528 raft_consensus.cc:1275] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:13:48.918450  2354 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:49.032580 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:49.034245 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:49.034355 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:49.034492 29376 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
I20260709 13:13:48.895867  2362 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:49.024454 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:49.035420 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:49.028152 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:49.036203 29376 raft_consensus.cc:2393] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 11: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:49.036598 29452 raft_consensus.cc:2393] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 16: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:49.034672 29454 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:13:49.034974 29530 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
I20260709 13:13:49.040820 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:49.041460 29450 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:49.043246 29377 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:13:49.043954 29377 raft_consensus.cc:606] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:49.044309 29377 raft_consensus.cc:614] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:13:49.032177  2408 log.cc:927] Time spent T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:13:48.954967 29277 catalog_manager.cc:5697] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 12 to 15, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 15 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:49.045766 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:49.046751 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:49.048241 29376 raft_consensus.cc:2393] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 16: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:49.048990 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:49.050068 29379 raft_consensus.cc:2393] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 16: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:49.038328  2395 log.cc:1199] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 71aa3578fd924765ab9ac0729c8d1483: Deleting WAL directory at /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/ts-2-root/wals/829dc08ee0ca4212a3b2c870b0ea1b35
I20260709 13:13:49.031775  2310 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:48.918869  2236 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:49.052413 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:49.059214 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:49.061336  2413 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.062064  2413 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:49.062580 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:49.063418 29453 raft_consensus.cc:2393] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 16: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:49.063809 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:49.064391 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:49.065701 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:49.061169  2362 consensus_queue.cc:1059] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:49.066267 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:49.071033 29447 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 19.
I20260709 13:13:49.070750 30121 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:13:49.072161 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:49.064478 29449 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 14.
I20260709 13:13:49.067121 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:49.055414 29277 catalog_manager.cc:5697] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 9 to 10, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 10 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:49.069741 29379 raft_consensus.cc:1240] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 14. Current term is 15. Ops: []
W20260709 13:13:49.052405  2067 consensus_meta.cc:287] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.688s	user 0.011s	sys 0.007s
W20260709 13:13:49.076316 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 204506us
I20260709 13:13:49.072866 29447 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:13:49.052148  2354 raft_consensus.cc:697] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:49.116748 29374 raft_consensus.cc:1275] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:13:49.117467 29455 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 10.
I20260709 13:13:49.120875 29380 raft_consensus.cc:1240] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:49.122416 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:49.039260  2335 consensus_queue.cc:1059] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:13:49.126493 29449 raft_consensus.cc:2410] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 16 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:13:49.124286 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:49.112792  2409 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.132267 29375 raft_consensus.cc:1275] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:13:49.136907 29447 raft_consensus.cc:1275] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:13:49.139607 29379 raft_consensus.cc:1275] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:13:49.128724 29452 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 15.
I20260709 13:13:49.127861 29277 catalog_manager.cc:5697] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 11 to 13, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 13 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:49.130779 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:49.143240 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:49.144207 29449 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:49.116091  1888 raft_consensus.cc:2804] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:49.129837 29344 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:49.066949  2310 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:49.151749 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:49.113162  2123 consensus_queue.cc:1048] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:13:49.154445 29344 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:49.114133  2067 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:49.156894 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:49.157236 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 126154us
I20260709 13:13:49.169039 29452 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 14.
I20260709 13:13:49.160765 29346 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:49.164871 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:49.170948 29523 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:13:49.145222  2140 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.173429 29346 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:49.174149 29277 catalog_manager.cc:5697] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 12 to 15, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 15 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:49.176222 29495 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:49.180691 29523 raft_consensus.cc:1275] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:13:49.181305 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:49.141222  2409 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:49.182017 29521 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:13:49.183187 29453 raft_consensus.cc:1275] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:13:49.183935 29346 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:49.194990 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:49.197582 30153 raft_consensus.cc:1275] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:13:49.153276  1888 raft_consensus.cc:697] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:13:49.203006 29378 raft_consensus.cc:2393] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 14: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:49.202766 29344 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:49.166934  2330 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:49.203933 29344 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:49.168308  2417 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:49.214170 29528 raft_consensus.cc:1275] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:13:49.207566 29277 catalog_manager.cc:5697] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:49.217274 29277 catalog_manager.cc:5697] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
W20260709 13:13:49.220064  2411 log.cc:927] Time spent T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:13:49.198638  2337 raft_consensus.cc:2804] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:13:49.220909  2337 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:49.221283  2337 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:49.218703 29277 catalog_manager.cc:5697] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 9 to 13, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 13 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:49.229645 29454 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:13:49.228003 29277 catalog_manager.cc:5697] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 10 to 13, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 13 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:49.232060  2412 log.cc:927] Time spent T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:13:49.233872 29454 raft_consensus.cc:1275] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:13:49.235056 29454 raft_consensus.cc:3055] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:49.235383 29454 raft_consensus.cc:740] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:49.236315 29454 consensus_queue.cc:260] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:49.239357 29277 catalog_manager.cc:5697] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 13 to 14, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 14 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:49.241364 29277 catalog_manager.cc:5697] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 12 to 14, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 14 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:49.244172 29277 catalog_manager.cc:5697] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:49.246089 29277 catalog_manager.cc:5697] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 9 to 12, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 12 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
W20260709 13:13:49.248941  2414 log.cc:927] Time spent T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.102s	user 0.000s	sys 0.002s
I20260709 13:13:49.189726  2334 raft_consensus.cc:2804] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:49.251857  2334 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:49.252445  2334 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:49.254694 29277 catalog_manager.cc:5697] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:49.256374 29277 catalog_manager.cc:5697] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:49.260543 29277 catalog_manager.cc:5697] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 12 to 13, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 13 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:49.175689  2162 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:13:49.211673 29452 raft_consensus.cc:1275] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:13:49.212059 29495 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:49.264585 30119 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a
W20260709 13:13:49.265615 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 60299.6us
I20260709 13:13:49.267832  2342 raft_consensus.cc:2749] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:49.269100 29277 catalog_manager.cc:5697] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:49.266853 29495 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:49.287644 29451 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 20.
I20260709 13:13:49.273577 29277 catalog_manager.cc:5697] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 8 to 10, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 10 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:49.284019 29495 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:49.299109 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 260613us
I20260709 13:13:49.293358 29495 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:49.228061  2418 log.cc:927] Time spent T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:13:49.310132 29495 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:49.272541  2403 raft_consensus.cc:2804] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:49.187645  2140 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:49.318086 29421 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:49.312677 29454 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:49.299315  2342 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:49.298169  2144 raft_consensus.cc:2804] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:13:49.312242  2325 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:49.308080  2346 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:49.202243  2354 consensus_queue.cc:237] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:49.400110 29454 raft_consensus.cc:1275] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:13:49.397456 29449 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:13:49.351164  2328 raft_consensus.cc:2804] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:49.321374  2265 raft_consensus.cc:2804] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:13:49.376960  2356 consensus_meta.cc:287] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.652s	user 0.015s	sys 0.000s
I20260709 13:13:49.368738  2342 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.356086  2413 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:49.374147  2144 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.422228 29277 catalog_manager.cc:5697] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:49.388605  2346 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:49.405783  2328 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.415271  2265 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:49.445261 29263 catalog_manager.cc:5028] TS 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): tablet 829dc08ee0ca4212a3b2c870b0ea1b35 (table test-workload [id=364c32d53f7748a2857a4a9acd17c671]) successfully deleted
I20260709 13:13:49.426079  2342 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:13:49.462508 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:49.422497  2356 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:49.468607 29450 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 21.
W20260709 13:13:49.399735 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 195890us
I20260709 13:13:49.379611  2325 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.431177  2144 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:49.414237  2236 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:49.400952 29454 pending_rounds.cc:85] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 8
I20260709 13:13:49.442116 29277 catalog_manager.cc:5697] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 12 to 14, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 14 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:49.483670 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 299795us
I20260709 13:13:49.436401  2413 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:49.501329 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:49.505542 29346 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:13:49.528388 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 47959.3us
I20260709 13:13:49.538235 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:49.541164 29381 raft_consensus.cc:2468] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 8.
I20260709 13:13:49.442663  2420 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:49.467520  2335 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:49.465580  2328 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:49.434208  2346 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:49.464241  2347 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.537107  2417 raft_consensus.cc:697] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:13:49.547948 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 44827.9us
I20260709 13:13:49.494200 29454 pending_rounds.cc:107] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:13:49.577932 29454 raft_consensus.cc:2889] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:49.404814  1888 consensus_queue.cc:237] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:49.489768  2325 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:49.464531  2265 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:49.575804 29346 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:49.548023  2409 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:13:49.576460 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 218062us
I20260709 13:13:49.571925  2067 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:49.571877  2335 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:49.601362 29421 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:49.636436 29419 leader_election.cc:400] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 14. Current term is 15.
I20260709 13:13:49.636857 29419 leader_election.cc:403] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:13:49.638429 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 328381us
I20260709 13:13:49.639474 29421 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:13:49.644590 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 68882.9us
I20260709 13:13:49.645438  2403 raft_consensus.cc:697] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:13:49.645648 29346 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:49.646891 29346 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:49.646540  2403 consensus_queue.cc:237] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:49.653577 29421 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:49.670323  2351 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:13:49.672077 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 94035.4us
W20260709 13:13:49.672989 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:49.674809  2351 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:49.677261 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:49.679441 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:49.680387 29521 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:49.547343  2350 consensus_queue.cc:1048] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:13:49.586798  2310 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:49.570072  2413 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:49.677006  2335 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:49.636996  2409 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:49.721774 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 74871.7us
W20260709 13:13:49.722611 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 69209.6us
W20260709 13:13:49.723125 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 46805.7us
I20260709 13:13:49.684206  2351 raft_consensus.cc:2749] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:49.579452  2347 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:49.730113 29346 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:49.704231  2355 raft_consensus.cc:2804] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:49.731065 29421 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:49.573817  2420 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:49.719722  2429 consensus_queue.cc:1059] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:13:49.715359  2067 consensus_queue.cc:1048] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:13:49.683712  2428 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:49.723554  2407 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
W20260709 13:13:49.763326 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 181997us
I20260709 13:13:49.764283 29419 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:49.766925 29346 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:49.769155 29419 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:49.745105  2355 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.779292 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:49.779685 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:49.779954 29450 raft_consensus.cc:3060] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:49.780740 29447 raft_consensus.cc:1275] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:13:49.781164 29447 pending_rounds.cc:85] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 10
I20260709 13:13:49.739099  2436 raft_consensus.cc:2749] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:49.781463 29447 pending_rounds.cc:107] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:13:49.784137 29447 raft_consensus.cc:2889] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:49.774634 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:49.754329  2140 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:49.736665  2409 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:49.777938  2407 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:49.820391  2452 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.821489  2447 raft_consensus.cc:2804] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:13:49.822775  2430 log.cc:927] Time spent T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:13:49.828903  2422 raft_consensus.cc:3055] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:49.829661  2426 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:13:49.833941  2423 log.cc:927] Time spent T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.264s	user 0.000s	sys 0.003s
I20260709 13:13:49.780874  2355 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:49.838162  2372 raft_consensus.cc:2749] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:49.775873  2236 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:49.779402  2362 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 14. Current term is 15.
I20260709 13:13:49.840860  2436 consensus_queue.cc:1059] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:13:49.841504  2424 log.cc:927] Time spent T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.160s	user 0.002s	sys 0.000s
I20260709 13:13:49.782313  2429 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:49.856873  2407 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:49.768262  2417 consensus_queue.cc:237] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:49.778391  2428 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:49.858420  2310 raft_consensus.cc:493] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.866103  2325 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:49.877354 29521 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 14.
I20260709 13:13:49.913352 29450 raft_consensus.cc:2468] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 11.
I20260709 13:13:49.897294  2236 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.875794  2447 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:49.881920  2452 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:13:49.946548  2330 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.010s	sys 0.009s
W20260709 13:13:49.949767 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 206928us
I20260709 13:13:49.962721  2434 consensus_queue.cc:1048] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:13:49.970444  2346 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:50.007741  2434 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.009188  2346 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:49.880632  2422 raft_consensus.cc:740] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:49.941465  2162 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:13:49.967573  2432 consensus_queue.cc:1059] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
W20260709 13:13:49.971416  2337 consensus_meta.cc:287] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.750s	user 0.014s	sys 0.000s
I20260709 13:13:50.011392  2422 consensus_queue.cc:260] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:49.880335  2426 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:50.012296  2337 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:50.012856  2426 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:13:50.014146  2441 log.cc:927] Time spent T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:13:50.014927  2337 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:49.971789  2310 raft_consensus.cc:515] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:50.017668  2420 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:50.018265  2310 leader_election.cc:290] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:50.018339  2420 consensus_queue.cc:1059] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:50.020203  2420 raft_consensus.cc:3055] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:50.019325 29526 raft_consensus.cc:1240] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:13:50.020604  2420 raft_consensus.cc:740] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:50.021456  2420 consensus_queue.cc:260] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:50.022771  2420 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:49.970762  2347 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:49.959134 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 192116us
I20260709 13:13:50.008378  2434 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:50.012802  2442 log.cc:927] Time spent T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.052s	user 0.004s	sys 0.000s
I20260709 13:13:49.976819  2453 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.961501  2428 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:49.999534 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:49.974635  2328 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:50.044801  2453 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:50.045390 29521 raft_consensus.cc:2468] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 13.
W20260709 13:13:50.046504  2431 log.cc:927] Time spent T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.332s	user 0.003s	sys 0.000s
I20260709 13:13:50.046644 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:50.047134  2328 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:49.999590  2356 raft_consensus.cc:3055] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:13:50.026790 29530 raft_consensus.cc:1275] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:13:50.027760 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:50.028891 30121 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
W20260709 13:13:49.976414  2342 consensus_meta.cc:287] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.527s	user 0.008s	sys 0.002s
I20260709 13:13:50.032761 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:49.975819  2362 raft_consensus.cc:2749] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:13:49.972386  2421 log.cc:927] Time spent T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.428s	user 0.002s	sys 0.000s
I20260709 13:13:50.005511 29421 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:49.996594  2330 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.010s	sys 0.009s
W20260709 13:13:50.084740 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 79315us
I20260709 13:13:50.085040  2330 raft_consensus.cc:697] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:50.085736 29421 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:50.086123  2330 consensus_queue.cc:237] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:50.086820  2439 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:50.087291  2439 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:50.087715  2439 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:50.088517 30119 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:13:50.089304  2428 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:50.089850  2338 raft_consensus.cc:2804] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:50.089857  2428 raft_consensus.cc:697] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 15 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:50.090286  2338 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.090703  2338 raft_consensus.cc:3060] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:50.068434 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:50.091188  2428 consensus_queue.cc:237] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:50.077934 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 49174.2us
I20260709 13:13:50.076613 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:49.977008  2436 consensus_queue.cc:1048] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.091s
I20260709 13:13:49.985280  2236 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:50.089335 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:50.098017 29421 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:50.098501  2434 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:49.966925  2265 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:50.099850  2448 raft_consensus.cc:2804] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:13:50.100471  2448 raft_consensus.cc:697] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 13 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:50.101723  2265 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:50.101425  2448 consensus_queue.cc:237] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:50.103091 29421 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:50.042758 29344 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:50.079931 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:50.042686 29346 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:50.083612  2435 raft_consensus.cc:2804] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:13:50.076277  2356 raft_consensus.cc:740] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
W20260709 13:13:50.080238 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:50.047330 29521 raft_consensus.cc:2468] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 8.
I20260709 13:13:50.109725 29525 raft_consensus.cc:1275] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:13:50.107968 29530 raft_consensus.cc:2368] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 15. Current term is 16.
I20260709 13:13:50.042126  2337 raft_consensus.cc:3055] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:50.112107 30119 leader_election.cc:304] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:13:50.117024 29421 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:13:50.120767  2365 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.000s	sys 0.029s
W20260709 13:13:50.121698  2365 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.000s	sys 0.029s
I20260709 13:13:50.130239  2428 raft_consensus.cc:2804] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:13:50.129773 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 461269us
I20260709 13:13:50.130734  2428 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.131145  2428 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:50.133056 29495 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:50.136587  2265 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:50.137110  2265 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:50.137540  2265 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:49.982188  2325 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:49.985314  2429 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:50.047293  2453 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:49.986191  2413 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:49.998556  2452 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:49.984755  2409 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:49.967263  2451 raft_consensus.cc:2749] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:49.987787  2447 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:13:50.157070 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 323809us
I20260709 13:13:50.147799 29495 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:50.161855 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 119251us
W20260709 13:13:50.163059 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 120388us
I20260709 13:13:50.107810  2435 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.172551 29346 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:50.177011 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:50.186190  2427 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:50.186408  2455 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:50.186910  2427 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.187366  2427 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:50.190279  2456 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:50.191984  2356 consensus_queue.cc:260] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:50.194346  2356 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:50.194555 29344 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:50.198127 29346 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:50.199879 29346 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:50.117086  2337 raft_consensus.cc:740] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:50.199940  2457 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:50.200426  2140 consensus_queue.cc:1059] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:13:50.200858  2457 raft_consensus.cc:697] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:50.201252  2337 consensus_queue.cc:260] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:50.201907  2457 consensus_queue.cc:237] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:50.202507  2337 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:49.987949  2144 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:50.179461 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 67440.8us
I20260709 13:13:50.081558  2342 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:50.205120 29344 leader_election.cc:400] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 15. Current term is 16.
I20260709 13:13:50.225847 29344 leader_election.cc:403] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
W20260709 13:13:50.214385 29419 leader_election.cc:336] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.590s (SENT)
I20260709 13:13:50.228830 29419 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:50.229288 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 48396.6us
I20260709 13:13:50.187175  2455 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.241680  2455 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:50.182467  2452 raft_consensus.cc:2804] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:13:50.231830 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 112065us
I20260709 13:13:50.204298  2325 consensus_queue.cc:1048] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:13:50.203750  2067 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:50.157058  2362 consensus_queue.cc:1048] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:13:50.232574 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:50.270987 29530 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:50.182235  2435 raft_consensus.cc:3060] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:50.254990 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
W20260709 13:13:50.256999 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 57182.4us
I20260709 13:13:50.275393 29346 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:50.270830 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 56493.7us
I20260709 13:13:50.250538 29421 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:50.209753  2346 raft_consensus.cc:3055] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:13:50.203477  2140 consensus_queue.cc:1048] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.074s
W20260709 13:13:50.304324 29419 leader_election.cc:336] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.593s (SENT)
W20260709 13:13:50.299104 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:50.205700  2458 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:13:50.322897 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 47603.6us
I20260709 13:13:50.253471  2452 raft_consensus.cc:493] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.254628  2067 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:50.273593  2335 consensus_meta.cc:287] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.538s	user 0.011s	sys 0.002s
I20260709 13:13:50.342919 29528 raft_consensus.cc:1275] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:13:50.253865  2328 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:50.304071  2144 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:50.270172  2429 raft_consensus.cc:2749] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:50.358497  2236 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:50.277132  2409 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:50.368009 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:13:50.374755 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 47847.8us
W20260709 13:13:50.304800  2334 consensus_meta.cc:287] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 1.052s	user 0.005s	sys 0.011s
I20260709 13:13:50.312752  2450 raft_consensus.cc:2749] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:50.324146  2456 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.382179 29525 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:50.298573  2459 raft_consensus.cc:2764] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
W20260709 13:13:50.384617 29419 leader_election.cc:336] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.734s (SENT)
I20260709 13:13:50.324144  2346 raft_consensus.cc:740] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:50.375698  2067 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:13:50.386773 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 136444us
W20260709 13:13:50.390664 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 282661us
W20260709 13:13:50.392558 29419 leader_election.cc:336] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.770s (SENT)
W20260709 13:13:50.382570 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 127826us
I20260709 13:13:50.361943  2452 raft_consensus.cc:3060] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:50.401543 29421 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:50.403192 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:50.403795 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:50.404430 29525 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:13:50.405086 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:50.405346 29419 leader_election.cc:336] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.791s (SENT)
I20260709 13:13:50.405779 29450 raft_consensus.cc:2468] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 12.
I20260709 13:13:50.384732  2409 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.410316 29495 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:50.388659  2334 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:50.511626 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 101398us
I20260709 13:13:50.437088  2444 consensus_queue.cc:1048] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:50.517037  2466 consensus_queue.cc:1059] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:50.518253  2466 raft_consensus.cc:3055] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:50.518743  2466 raft_consensus.cc:740] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:50.519093  2432 raft_consensus.cc:2804] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:50.519608  2432 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.520007  2432 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:50.437523  2433 consensus_queue.cc:1048] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:13:50.437187  2425 consensus_queue.cc:1048] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:13:50.439379 29376 raft_consensus.cc:1275] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:13:50.441810  2422 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:50.443956 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:50.444336  2342 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:50.386675  2242 consensus_queue.cc:1048] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:13:50.445022  1888 consensus_queue.cc:1048] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:13:50.448032 29441 tablet_service.cc:1558] Processing DeleteTablet for tablet 95122b0f733946aba19edf1d98467467 with delete_type TABLET_DATA_TOMBSTONED (TS 183db85c071f489fbc8de63a9edd8a3a not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:35524
I20260709 13:13:50.446877  2338 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:50.449815 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:50.454833 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:50.458448 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:50.459028 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:50.459335 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:50.463426 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:50.547904 29456 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:50.463917 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:50.464636 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:50.469180  2446 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:50.385130  2468 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:50.469313  2452 raft_consensus.cc:515] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:50.498021  2236 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:50.486905 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:50.491405  2350 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.497486 29523 raft_consensus.cc:1240] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:50.518280  2334 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:50.502055 29526 raft_consensus.cc:1275] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:13:50.398048  2456 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:50.384603  2445 consensus_queue.cc:1048] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.121s
I20260709 13:13:50.359757  2355 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:50.587786  2456 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:50.589011  2355 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:50.381834  2335 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:50.589026 30156 raft_consensus.cc:2368] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 13. Current term is 14.
I20260709 13:13:50.589864  2338 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 14 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:50.514923 29530 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:13:50.516966 29495 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:50.549274 29448 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:13:50.591888 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 75016.8us
I20260709 13:13:50.593225 29495 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:50.594439 29495 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:50.595366  2342 raft_consensus.cc:2804] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:50.595854  2342 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.596223  2342 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:50.552240  2265 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:50.598763  2450 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:50.479820 29372 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95122b0f733946aba19edf1d98467467"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:13:50.599800 29372 raft_consensus.cc:606] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:50.599403  2450 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:50.600090  2265 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:50.600901  2265 raft_consensus.cc:2749] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:50.601075  2483 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:50.601563  2483 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:50.601897  2450 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:50.552953  2448 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:50.603372 29447 raft_consensus.cc:2410] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 17 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:13:50.565260  2446 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:50.532112  2365 consensus_queue.cc:1048] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:13:50.605501 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:50.606025 29456 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:13:50.606129 29452 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:50.606760  2446 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:50.565002 30155 raft_consensus.cc:1240] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 8. Current term is 9. Ops: []
W20260709 13:13:50.609555  2467 log.cc:927] Time spent T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.200s	user 0.002s	sys 0.000s
I20260709 13:13:50.575546  2346 consensus_queue.cc:260] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:50.610704  2346 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:50.613610 29346 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:50.545253 29454 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:13:50.564996  2466 consensus_queue.cc:260] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:50.615372 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:50.615609  2450 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:50.615919  2466 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:13:50.567283 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 166471us
I20260709 13:13:50.527232  2409 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:50.619767 29450 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:50.620086 29421 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:50.620980 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:50.621470 29421 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:50.622658 29421 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:50.569825  2452 leader_election.cc:290] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:50.623395  2451 raft_consensus.cc:2804] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:50.498021 29344 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:50.623862  2451 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:50.624226 29421 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:50.624609  2468 raft_consensus.cc:2804] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:50.624830 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:50.582865  2427 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:50.626363  2236 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:50.626554 29447 raft_consensus.cc:1275] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:13:50.626853  2236 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:50.627341  2236 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:50.627632  2428 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:50.628670 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 130734us
W20260709 13:13:50.567157  2426 consensus_meta.cc:287] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.554s	user 0.013s	sys 0.001s
I20260709 13:13:50.630327 29344 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:50.630393  2426 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:50.600190 29372 raft_consensus.cc:614] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:50.552099 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:50.632692 29449 raft_consensus.cc:2368] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 15. Current term is 16.
I20260709 13:13:50.632856  2426 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:50.633515  2426 raft_consensus.cc:2804] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:50.633848  2426 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:50.634203  2426 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:50.634096 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:50.634683 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:50.625057  2468 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.635290  2468 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:50.601935  2483 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:50.636824 29449 raft_consensus.cc:1275] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:13:50.565287 29455 raft_consensus.cc:2368] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 15. Current term is 16.
I20260709 13:13:50.641714 29523 raft_consensus.cc:1275] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:13:50.635293 29530 raft_consensus.cc:3060] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:50.584889  2350 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:50.624294  2451 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:50.645337  2350 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:50.629794  2335 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:50.634821 29526 raft_consensus.cc:3060] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:50.584371  2439 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:50.681502 29455 raft_consensus.cc:1275] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:13:50.683475  2439 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:50.684043  2355 raft_consensus.cc:2804] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:13:50.684419 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:50.684659  2355 raft_consensus.cc:697] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:50.685636  2355 consensus_queue.cc:237] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:50.648064 29421 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:50.686965  2445 consensus_queue.cc:1048] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:13:50.652238 29449 raft_consensus.cc:1275] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:13:50.628026  2427 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:50.607129 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:50.683180  2484 consensus_queue.cc:1048] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:50.687740  2351 raft_consensus.cc:2804] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:50.688274  2334 consensus_queue.cc:1059] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:50.702428 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:50.595235 29495 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:50.650326 29454 raft_consensus.cc:2393] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 18: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
W20260709 13:13:50.694242 29419 leader_election.cc:336] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 2.135s (SENT)
I20260709 13:13:50.648137 29525 raft_consensus.cc:1240] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 16. Current term is 17. Ops: []
W20260709 13:13:50.703686 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 108519us
I20260709 13:13:50.704896 29495 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:50.703140 29523 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:13:50.709954 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:50.709981 29448 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:13:50.728936 29450 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 14.
I20260709 13:13:50.730291 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:50.736387 29419 leader_election.cc:400] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Vote denied by peer ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671) with higher term. Message: Invalid argument: T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 13. Current term is 14.
I20260709 13:13:50.740469 29419 leader_election.cc:403] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:50.697458  2448 raft_consensus.cc:2804] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:50.739873 29495 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:50.746817 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:50.742575 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 50233.2us
W20260709 13:13:50.753175 29419 leader_election.cc:336] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 2.152s (SENT)
I20260709 13:13:50.700050  2417 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:50.762010 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:50.764462 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:50.683933  2236 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:50.575161  2455 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:50.723102  2265 raft_consensus.cc:2804] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:50.731915  2459 raft_consensus.cc:2764] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:13:50.748754  2453 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.758987  2351 raft_consensus.cc:697] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:50.763595  2362 raft_consensus.cc:3060] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:13:50.809100 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:50.773568  2264 consensus_queue.cc:1048] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:13:50.784617  2325 consensus_queue.cc:1048] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:13:50.738855  2428 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:50.792800 29530 raft_consensus.cc:2468] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 9.
I20260709 13:13:50.792968 29526 raft_consensus.cc:2468] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 14.
I20260709 13:13:50.701754  2335 consensus_queue.cc:1048] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:13:50.742638  2328 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 15. Current term is 16.
I20260709 13:13:50.806526 29344 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:50.810004 29521 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:13:50.812598 29452 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
W20260709 13:13:50.812342  2447 consensus_meta.cc:287] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.611s	user 0.011s	sys 0.012s
I20260709 13:13:50.827255 29527 raft_consensus.cc:1240] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:13:50.773605  2265 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:50.814386 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:50.805778  2448 raft_consensus.cc:697] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 16 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:50.843235 29451 raft_consensus.cc:1275] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:13:50.843701 29451 pending_rounds.cc:85] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 8
I20260709 13:13:50.843923 29451 pending_rounds.cc:107] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:13:50.844146 29451 raft_consensus.cc:2889] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:50.836794 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 221872us
I20260709 13:13:50.759548  2446 consensus_queue.cc:1059] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:13:50.773257  2417 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:50.883249 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 133307us
I20260709 13:13:50.886832 29495 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:50.889597 29495 leader_election.cc:304] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:50.894240 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:50.894302 29495 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:50.844370  2265 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:50.868279  2427 raft_consensus.cc:2804] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:50.825197  2453 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:50.897974 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:50.903028 30119 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:13:50.906297 29453 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:50.907976 30119 leader_election.cc:304] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:50.839934  2067 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:50.841687  2475 consensus_queue.cc:1048] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.163s
I20260709 13:13:50.884554  2472 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:13:50.930181 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 53343.5us
I20260709 13:13:50.936827 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:50.937641 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:50.939159 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:50.939935 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:50.960361 29380 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 15.
I20260709 13:13:50.940032 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:50.941164 29377 raft_consensus.cc:1240] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 15. Current term is 16. Ops: [15.9-15.9]
W20260709 13:13:50.961050 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:50.941582 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:50.944761 29419 leader_election.cc:336] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.785s (SENT)
I20260709 13:13:50.962747 29419 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:50.946484 29521 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 20.
I20260709 13:13:50.846249  2447 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:50.954452 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:50.905431  2427 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.897071  2497 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:13:50.909646  2338 raft_consensus.cc:2804] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:13:50.967761 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:50.923265  2452 raft_consensus.cc:2804] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:50.979938 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:13:50.967607  2435 consensus_meta.cc:287] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent flushing consensus metadata: real 0.643s	user 0.011s	sys 0.006s
I20260709 13:13:51.018436 29379 raft_consensus.cc:1275] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:13:51.021077 29522 raft_consensus.cc:1240] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:51.021478 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:51.021908 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:51.025069  2432 consensus_meta.cc:287] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.504s	user 0.011s	sys 0.008s
I20260709 13:13:50.970844  2427 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:51.035636 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:50.971436 29344 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:50.974052  2466 raft_consensus.cc:2804] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:50.972693  2436 raft_consensus.cc:2749] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:50.970813  2337 raft_consensus.cc:2749] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:50.967833  2472 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:51.044227  2493 tablet_replica.cc:333] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:13:51.044148 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:51.128021 29374 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:51.045894 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:51.037264  2452 raft_consensus.cc:697] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:13:50.976719  2481 raft_consensus.cc:2764] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 13:13:51.028772 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 134590us
I20260709 13:13:51.050529 29521 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
W20260709 13:13:51.058842 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:51.131212 29495 leader_election.cc:304] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:51.102092 29346 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:50.968971  2445 consensus_queue.cc:1059] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:13:50.904467  2351 consensus_queue.cc:237] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:51.111862 29375 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 16.
W20260709 13:13:51.139103  2496 log.cc:927] Time spent T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
W20260709 13:13:51.118551 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:51.153196  2447 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:51.155905  2426 consensus_meta.cc:287] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.521s	user 0.009s	sys 0.004s
I20260709 13:13:51.113211  2466 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:51.157135  2466 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:51.097419  2435 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:51.161530  2435 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:51.162703  2346 consensus_meta.cc:287] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.551s	user 0.011s	sys 0.002s
I20260709 13:13:51.164024 30153 raft_consensus.cc:2393] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 9: Already voted for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in this term.
I20260709 13:13:51.166487 30153 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54212 (request call id 194) took 1149 ms. Trace:
I20260709 13:13:51.112870  2459 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:51.168244  2459 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:51.166989 30153 rpcz_store.cc:276] 0709 13:13:50.016935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.051998 (+ 35063us) service_pool.cc:224] Handling call
0709 13:13:51.166126 (+1114128us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540029bb54. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:51.166388 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2454256896}
I20260709 13:13:51.170784  2502 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.172183 30154 raft_consensus.cc:1240] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:13:51.034614  2497 raft_consensus.cc:697] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:51.040025 29376 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:51.124404 29379 raft_consensus.cc:1275] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:13:50.977418  2483 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:51.038125  2338 raft_consensus.cc:697] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 14 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:13:51.129022 29377 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:51.156544  2426 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:51.019174  2448 consensus_queue.cc:237] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:51.186213 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 55142.7us
I20260709 13:13:51.192216 29495 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:51.131139  2455 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:51.203924 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 232566us
W20260709 13:13:51.204550 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 102578us
I20260709 13:13:51.170855  2459 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:51.206046 29495 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
W20260709 13:13:51.187271  2342 consensus_meta.cc:287] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.590s	user 0.004s	sys 0.007s
I20260709 13:13:51.107686  2432 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:51.193660  2409 consensus_meta.cc:287] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.574s	user 0.006s	sys 0.006s
I20260709 13:13:51.220759 29346 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:51.229126 29495 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:51.189384  2475 raft_consensus.cc:2749] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:13:51.239292 29374 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 18.
I20260709 13:13:51.217422  2433 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:13:51.217160  2347 raft_consensus.cc:2804] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:51.253062 29377 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 17.
I20260709 13:13:51.171706  2502 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:51.224921  2337 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:51.259310 29376 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 16.
I20260709 13:13:51.259338 29525 raft_consensus.cc:2393] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 15: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:51.226645  2459 raft_consensus.cc:2764] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:13:51.203394  2501 consensus_queue.cc:1048] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:13:51.269170  2453 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:51.256582  2452 consensus_queue.cc:237] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:51.283475  2511 consensus_queue.cc:1048] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.003s
W20260709 13:13:51.285076  2506 log.cc:927] Time spent T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 13:13:51.277441  2468 consensus_meta.cc:287] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.639s	user 0.018s	sys 0.000s
I20260709 13:13:51.294287  2468 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:51.294775  2236 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:51.260093  2347 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:51.295915  2347 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:51.296744  2468 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:51.297580 29449 raft_consensus.cc:2393] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 15: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:51.241075  2409 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:51.308487 29381 raft_consensus.cc:2393] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 17: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:51.309744  2409 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:51.276902  2490 log.cc:927] Time spent T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b: Append to log took a long time: real 0.352s	user 0.003s	sys 0.000s
I20260709 13:13:51.355319 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:13:51.391940 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 149962us
I20260709 13:13:51.392338 29377 raft_consensus.cc:3060] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:51.239804  2481 consensus_queue.cc:1048] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:13:51.310648  2351 consensus_queue.cc:1048] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:13:51.365640 29528 raft_consensus.cc:1275] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:13:51.361675 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 99651us
I20260709 13:13:51.235352  2342 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:51.265347  2475 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:13:51.267266  2445 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:51.376878 29453 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 20.
W20260709 13:13:51.379211 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:51.414798 29346 leader_election.cc:400] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 15. Current term is 16.
I20260709 13:13:51.415143 29346 leader_election.cc:403] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:13:51.310740  2362 raft_consensus.cc:2749] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671) with higher term. Message: Invalid argument: T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 13. Current term is 14.
W20260709 13:13:51.398648 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:51.409436  2483 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:51.242933  2497 consensus_queue.cc:237] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:51.423251 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 192425us
W20260709 13:13:51.394357  2477 log.cc:927] Time spent T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.125s	user 0.001s	sys 0.005s
I20260709 13:13:51.427083 29495 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:51.427433 29377 raft_consensus.cc:2468] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 9.
I20260709 13:13:51.428928 29529 raft_consensus.cc:2368] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 15. Current term is 16.
I20260709 13:13:51.391387  2455 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.432446 29344 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:51.414623  2433 raft_consensus.cc:697] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:51.431137 30121 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:13:51.274487  2338 consensus_queue.cc:237] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:51.453228 29495 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:13:51.457000  2508 log.cc:927] Time spent T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
W20260709 13:13:51.458791  2503 log.cc:927] Time spent T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
W20260709 13:13:51.460055  2505 log.cc:927] Time spent T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 13:13:51.462639  2433 consensus_queue.cc:237] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:51.465102  2242 raft_consensus.cc:3055] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:51.465791  2242 raft_consensus.cc:740] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:51.468828  2444 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 15. Current term is 16.
I20260709 13:13:51.469727  2444 consensus_queue.cc:1048] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:13:51.470865  2459 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:51.471451  2459 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:51.471971  2459 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:51.478106  2355 raft_consensus.cc:3055] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:51.478811  2355 raft_consensus.cc:740] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:51.477931  2242 consensus_queue.cc:260] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:51.479764  2355 consensus_queue.cc:260] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:51.480924  2472 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:13:51.482129 29419 leader_election.cc:336] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 2.178s (SENT)
I20260709 13:13:51.482674 29419 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:51.486171  2451 consensus_meta.cc:287] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.842s	user 0.000s	sys 0.014s
I20260709 13:13:51.486668  2451 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:51.487946  2513 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:51.480147  2242 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:13:51.490935 29419 leader_election.cc:336] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 2.184s (SENT)
I20260709 13:13:51.491379 29419 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:51.491482 29448 raft_consensus.cc:2468] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 14.
W20260709 13:13:51.497658 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 50276.7us
I20260709 13:13:51.438700 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:51.443975  2435 raft_consensus.cc:2804] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:51.501021 29495 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:51.521198 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:51.439245  2455 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:51.528551  2335 raft_consensus.cc:2749] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:13:51.536888  2265 consensus_meta.cc:287] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.617s	user 0.008s	sys 0.003s
W20260709 13:13:51.544987 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 45293us
I20260709 13:13:51.545859  2434 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:13:51.496819  2472 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:51.595655 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 165946us
I20260709 13:13:51.500185  2325 raft_consensus.cc:2749] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:51.605329 29495 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:51.619268 29346 leader_election.cc:400] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 15. Current term is 16.
W20260709 13:13:51.619138 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 80815.2us
W20260709 13:13:51.622963 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 192187us
I20260709 13:13:51.625734  2513 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.626557  2513 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:51.597071  2503 log.cc:927] Time spent T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:13:51.631980  2502 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:51.633982 30153 raft_consensus.cc:1240] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 LEADER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:13:51.638962  2459 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:51.616484  2432 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:51.635901  2513 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:51.643709  2455 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:51.645535  2459 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:51.652334 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 47174.9us
W20260709 13:13:51.646590  2500 log.cc:927] Time spent T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.602s	user 0.000s	sys 0.005s
I20260709 13:13:51.646888  2513 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:51.532792  2426 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:51.653839 29495 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:51.573539  2435 raft_consensus.cc:697] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
W20260709 13:13:51.636513  2504 log.cc:927] Time spent T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.289s	user 0.000s	sys 0.001s
W20260709 13:13:51.699024 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 45273.7us
W20260709 13:13:51.708204 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:51.710644 29453 raft_consensus.cc:1275] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:13:51.712919 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:51.713654 29453 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:51.708231 29421 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:51.719623 29450 raft_consensus.cc:1275] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:13:51.694410  2511 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:13:51.617697  2265 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:51.733392 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:51.733881 29376 raft_consensus.cc:1240] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:13:51.734122 29374 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:51.735268 29453 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:13:51.701642  2432 raft_consensus.cc:2749] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:51.743432 29374 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 18.
I20260709 13:13:51.748800 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:51.749801 29378 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:13:51.698385  2513 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:51.766453  2513 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:51.738467  2515 consensus_queue.cc:1048] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:13:51.769202 29452 raft_consensus.cc:1275] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:13:51.770334 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:51.771119 29452 raft_consensus.cc:2393] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 16: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:51.771327 29451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 3018) took 1319 ms. Trace:
I20260709 13:13:51.771808  2342 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:51.771778 29451 rpcz_store.cc:276] 0709 13:13:50.451610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.451729 (+   119us) service_pool.cc:224] Handling call
0709 13:13:50.452093 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:50.844594 (+392501us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:51.771092 (+926498us) spinlock_profiling.cc:243] Waited 391 ms on lock 0x7b5400262354. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:51.771264 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":898614656}
I20260709 13:13:51.773353 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:51.774817 29447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 3035) took 1243 ms. Trace:
I20260709 13:13:51.775295 29447 rpcz_store.cc:276] 0709 13:13:50.531434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.692911 (+161477us) service_pool.cc:224] Handling call
0709 13:13:50.693227 (+   316us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:50.693609 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:50.693637 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:50.702729 (+  9092us) log.cc:844] Serialized 52 byte log entry
0709 13:13:50.884077 (+181348us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:50.884146 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:50.884261 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:51.645887 (+761626us) spinlock_profiling.cc:243] Waited 53 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:13:51.774465 (+128578us) raft_consensus.cc:1685] finished
0709 13:13:51.774493 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:51.774746 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6601,"raft.queue_time_us":494,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":10758,"spinlock_wait_cycles":121940864,"thread_start_us":117794,"threads_started":1,"wal-append.queue_time_us":170067}
I20260709 13:13:51.776842 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:51.777493 29454 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16.
I20260709 13:13:51.777881 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:51.778486 29375 raft_consensus.cc:2376] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16. Re-sending same reply.
I20260709 13:13:51.778702 29454 raft_consensus.cc:1275] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:13:51.779554 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:51.779868 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:51.780779 29373 raft_consensus.cc:2393] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 16: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:51.781698 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:51.782596 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:51.784299 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:51.695325  2512 consensus_queue.cc:1048] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 13:13:51.741731 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:51.755645 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:51.791011 29377 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:51.756595 29455 raft_consensus.cc:2393] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 17: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:51.756916 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:51.792183 29449 raft_consensus.cc:2468] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:13:51.793109 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:51.758659  2265 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:51.759285 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:51.726322  2502 consensus_queue.cc:1048] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:13:51.760484 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:51.800935 29379 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:51.762300 30154 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54224 (request call id 197) took 1276 ms. Trace:
I20260709 13:13:51.715602  2325 consensus_queue.cc:1048] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:13:51.756853  2524 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:51.801892 30154 rpcz_store.cc:276] 0709 13:13:50.485560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.500611 (+ 15051us) service_pool.cc:224] Handling call
0709 13:13:51.171934 (+671323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:51.172606 (+   672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:51.762028 (+589422us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b540029bb50. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd858ad 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:51.762207 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1543105408}
I20260709 13:13:51.777493 29447 raft_consensus.cc:1240] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:51.786262 29454 raft_consensus.cc:1240] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:13:51.809962 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:51.811177 29524 raft_consensus.cc:2393] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 14: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:51.779238 29346 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:51.739527 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:51.877508 29453 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:51.775034 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:51.740073 29421 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:51.726109  2426 raft_consensus.cc:2804] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:51.698534  2409 consensus_queue.cc:1059] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:13:51.794198 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:51.799805 29380 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:13:51.881031 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 141040us
I20260709 13:13:51.891125 29421 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:51.884212 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:51.883965 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:13:51.907714 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 128562us
I20260709 13:13:51.909161 29346 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:51.807783  2427 consensus_meta.cc:287] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.678s	user 0.012s	sys 0.000s
I20260709 13:13:51.919804 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:51.925791 29524 raft_consensus.cc:2393] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 16: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:51.887590  2455 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:51.918732  2362 consensus_queue.cc:1048] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:13:51.918943  2472 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:51.884789  2426 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:51.763298  2435 consensus_queue.cc:237] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:51.755115  2335 consensus_queue.cc:1048] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:13:51.964010 29379 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 15.
I20260709 13:13:51.923575  2443 raft_consensus.cc:2804] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:51.939476 29375 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
I20260709 13:13:51.940486 29421 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:51.941877 29377 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 20.
W20260709 13:13:51.943542 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:51.943959 29373 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 15.
I20260709 13:13:51.932772 29495 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:51.919076  2236 consensus_queue.cc:1048] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:13:51.952307 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:51.911890  2409 consensus_queue.cc:1243] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer ca041dab9b2f44409ed7bf4c6cf66ab2 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:13:51.960952 29346 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:13:52.004928 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 64566.1us
I20260709 13:13:52.006039 29421 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:52.008828 29346 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:52.012313 29421 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:52.003697  2443 raft_consensus.cc:697] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:51.984771  2472 raft_consensus.cc:697] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 16 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:51.919658  2433 raft_consensus.cc:2749] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:13:51.965389 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:52.027998 29523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3898) took 1305 ms. Trace:
I20260709 13:13:51.927048 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:51.908618  2524 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:51.930372  2427 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:51.968849 29380 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 15.
I20260709 13:13:51.970041  2354 raft_consensus.cc:3055] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:51.976055 29528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3908) took 1015 ms. Trace:
I20260709 13:13:52.036402 29528 rpcz_store.cc:276] 0709 13:13:50.960742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:51.414827 (+454085us) service_pool.cc:224] Handling call
0709 13:13:51.415234 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:51.431437 (+ 16203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:51.431462 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:51.437599 (+  6137us) log.cc:844] Serialized 26 byte log entry
0709 13:13:51.720393 (+282794us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:51.720471 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:51.720540 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:51.975618 (+255078us) raft_consensus.cc:1685] finished
0709 13:13:51.975653 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:51.975947 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2358,"raft.queue_time_us":16887,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":7078,"thread_start_us":187363,"threads_started":1,"wal-append.queue_time_us":477839}
I20260709 13:13:52.038851 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:51.976275  2513 consensus_queue.cc:1048] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:51.959067  2426 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:52.002555 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:51.959381  2514 consensus_queue.cc:1048] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:13:52.021261 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:52.021570 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:52.021613 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:52.022498 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:13:51.988462 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 55795.4us
I20260709 13:13:52.054163 29377 raft_consensus.cc:2393] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 18: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:52.010008  2502 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:51.960987 29453 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:13:52.028748  2335 raft_consensus.cc:2804] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:52.014482  2457 consensus_queue.cc:1048] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:13:52.081956 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:52.012168  2351 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:52.011973  2468 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:52.033257 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:52.085773 29526 raft_consensus.cc:2368] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 13. Current term is 14.
I20260709 13:13:52.036262  2354 raft_consensus.cc:740] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:52.092789  2354 consensus_queue.cc:260] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:52.094813  2354 raft_consensus.cc:3060] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:52.037262  2356 consensus_queue.cc:1059] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:13:52.102029 29372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 917) took 1417 ms. Trace:
I20260709 13:13:52.068478  2325 consensus_queue.cc:1059] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:13:52.104739  2325 raft_consensus.cc:3055] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:52.105280  2325 raft_consensus.cc:740] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:52.107605  2472 consensus_queue.cc:237] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:52.109818 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:52.071738  2517 consensus_queue.cc:1059] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:13:52.112747  2517 raft_consensus.cc:3055] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:52.113499  2517 raft_consensus.cc:740] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:52.043181 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:52.116195 29380 raft_consensus.cc:2393] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 15: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:52.020545  2409 raft_consensus.cc:2804] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:13:52.048868  2524 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:52.119796  2409 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:52.120425  2409 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:52.120597  2417 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:52.123799  2475 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.124706  2481 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:52.125228  2481 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:52.126475  2342 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.051095  2427 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:52.051453 29378 raft_consensus.cc:606] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:52.127786 29378 raft_consensus.cc:614] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:52.017732  2450 consensus_queue.cc:1048] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:13:52.054857 29521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3906) took 1256 ms. Trace:
I20260709 13:13:52.057343 29344 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:52.057768 29495 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:13:52.131234 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 74029.8us
W20260709 13:13:52.131289 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 73606.5us
I20260709 13:13:52.131810 29525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37968 (request call id 3904) took 1367 ms. Trace:
I20260709 13:13:52.132256 29495 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:52.134780  2515 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:13:52.135277  2497 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:52.071369  2432 consensus_queue.cc:1048] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:13:52.136363  2523 raft_consensus.cc:2804] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:13:52.136879  2523 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:52.137367  2523 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:13:52.138640 29529 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37968 (request call id 3890) took 1446 ms (client timeout 1677 ms). Trace:
W20260709 13:13:52.139061 29529 rpcz_store.cc:269] 0709 13:13:50.692402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.695217 (+  2815us) service_pool.cc:224] Handling call
0709 13:13:52.138434 (+1443217us) spinlock_profiling.cc:243] Waited 688 ms on lock 0x7b54000b72d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:52.138579 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1582962432}
I20260709 13:13:52.139823  2351 raft_consensus.cc:697] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:52.140902 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:52.140872  2351 consensus_queue.cc:237] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:52.129468 29521 rpcz_store.cc:276] 0709 13:13:50.798571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:51.203898 (+405327us) service_pool.cc:224] Handling call
0709 13:13:51.232335 (+ 28437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:51.232600 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:13:51.247859 (+ 15259us) log.cc:844] Serialized 14 byte log entry
0709 13:13:52.054400 (+806541us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b18003c6940. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a7b92e4bc 00007f6a78c7c48b 00007f6a81ad6ab9 00007f6a78c9869b 00007f6a78c9693f 00007f6a78c96455 00007f6a7bd7e060 00007f6a7bd90716 00007f6a7bda1287
0709 13:13:52.054520 (+   120us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:52.054572 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:52.054621 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:52.054687 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:52.054797 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":39907,"prepare.run_wall_time_us":29343,"raft.queue_time_us":34246,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":41091,"spinlock_wait_cycles":88380032,"thread_start_us":110938,"threads_started":1}
I20260709 13:13:52.143157 29381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52172 (request call id 2313) took 1206 ms. Trace:
I20260709 13:13:52.143713 29381 rpcz_store.cc:276] 0709 13:13:50.936597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.939757 (+  3160us) service_pool.cc:224] Handling call
0709 13:13:52.142896 (+1203139us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x7b54003dbb54. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:52.143077 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":798574592}
I20260709 13:13:52.145768 29381 raft_consensus.cc:1240] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:13:52.146857  2140 consensus_queue.cc:1048] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:52.147912 29344 leader_election.cc:400] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 15. Current term is 16.
I20260709 13:13:52.136408 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:52.149998 29527 raft_consensus.cc:2393] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 16: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:52.045382 29454 raft_consensus.cc:2468] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 6.
I20260709 13:13:52.150955 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:52.151257 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:52.153015 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:52.154522 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:52.132169 29525 rpcz_store.cc:276] 0709 13:13:50.764417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.813982 (+ 49565us) service_pool.cc:224] Handling call
0709 13:13:52.131454 (+1317472us) spinlock_profiling.cc:243] Waited 418 ms on lock 0x7b54000cb2d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:52.131711 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":960961792}
I20260709 13:13:52.050540 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:52.028213  2455 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:52.087139 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:52.077877 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:52.160527 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:52.102540 29372 rpcz_store.cc:276] 0709 13:13:50.684679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.690762 (+  6083us) service_pool.cc:224] Handling call
0709 13:13:50.709217 (+ 18455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:50.760020 (+ 50803us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:50.760056 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:50.768148 (+  8092us) log.cc:844] Serialized 26 byte log entry
0709 13:13:51.636008 (+867860us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b180031ec40. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c7be07 00007f6a81ad6ab9 00007f6a78c9869b 00007f6a78c9693f 00007f6a78c98c02 00007f6a7b92020b 00007f6a7b925d23 00007f6a7b9260d1 00007f6a7bd41a0f
0709 13:13:51.924107 (+288099us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:51.924153 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:51.924238 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:52.101604 (+177366us) raft_consensus.cc:1685] finished
0709 13:13:52.101632 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:52.101947 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50053,"raft.queue_time_us":50537,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":9277,"spinlock_wait_cycles":49367808,"thread_start_us":287751,"threads_started":1,"wal-append.queue_time_us":1235784}
I20260709 13:13:52.143195 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:52.162693 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:52.124418  2475 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:52.126981  2342 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:52.134575 29495 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:52.028472 29523 rpcz_store.cc:276] 0709 13:13:50.722330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.730946 (+  8616us) service_pool.cc:224] Handling call
0709 13:13:50.731245 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:50.771037 (+ 39792us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:50.771088 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:50.771151 (+    63us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:50.771198 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:52.027749 (+1256551us) spinlock_profiling.cc:243] Waited 39.5 ms on lock 0x7b540006efd4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:52.027798 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:52.027940 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90831104}
I20260709 13:13:52.031030 29524 raft_consensus.cc:2393] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 16: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:52.080616 29377 raft_consensus.cc:1240] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 19. Current term is 20. Ops: [18.11-19.12]
I20260709 13:13:52.174837 29495 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:52.112695 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:52.178552 29449 raft_consensus.cc:2393] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 18: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:52.114526  2517 consensus_queue.cc:260] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:52.031364 29421 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:52.170701 29374 raft_consensus.cc:2393] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 16: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:52.172767 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:52.185478 29452 raft_consensus.cc:2393] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 15: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:52.169135 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:52.178725 29344 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:52.186299 29453 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:52.186215 29495 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:52.179970 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:52.188230 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:52.180150 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:52.180264 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:52.064414  2502 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:52.191890 29524 raft_consensus.cc:2393] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 16: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:52.044209 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:52.193432 29521 raft_consensus.cc:2393] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 17: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:52.105764  2451 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:52.200574 29528 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 15.
I20260709 13:13:52.203081 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:52.202961 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:52.204694 29525 raft_consensus.cc:2393] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 7: Already voted for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in this term.
I20260709 13:13:52.137321  2144 consensus_queue.cc:1059] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:13:52.210259 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:52.169914  2433 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.127411  2481 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:52.106824  2325 consensus_queue.cc:260] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:52.327407 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 148759us
I20260709 13:13:52.211654 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:13:52.342211 29456 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45798 (request call id 3036) took 1714 ms (client timeout 1947 ms). Trace:
I20260709 13:13:52.352725 29452 raft_consensus.cc:1275] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:13:52.368952 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:52.375824 29525 raft_consensus.cc:2468] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
I20260709 13:13:52.376456 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:52.377209 29522 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:52.377532 29453 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
I20260709 13:13:52.377990 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:52.303169 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:52.378500 29449 raft_consensus.cc:1240] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:52.212827 29528 raft_consensus.cc:2393] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 11: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
W20260709 13:13:52.371860 29456 rpcz_store.cc:269] 0709 13:13:50.588476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.606854 (+ 18378us) service_pool.cc:224] Handling call
0709 13:13:52.302456 (+1695602us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54000cf3d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:52.302674 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3090347264}
I20260709 13:13:52.216183 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:52.382956 29526 raft_consensus.cc:2393] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 15: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:52.360910 29495 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:52.399296 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:52.406056 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:52.407485 29524 raft_consensus.cc:2393] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 16: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:13:52.409286 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 382816us
I20260709 13:13:52.406167 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:52.411505 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:52.413185 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 52288.7us
I20260709 13:13:52.410652 29421 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:52.414471 29495 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:52.415824 29526 raft_consensus.cc:2368] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 13. Current term is 14.
W20260709 13:13:52.417076 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 284892us
W20260709 13:13:52.295956  2347 consensus_meta.cc:287] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 1.000s	user 0.009s	sys 0.005s
I20260709 13:13:52.181308  2265 raft_consensus.cc:2804] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:13:52.420806 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:52.424606 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:52.199110  2432 raft_consensus.cc:2804] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:52.425742 29526 raft_consensus.cc:2393] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 15: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:13:52.425689 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 54747.9us
I20260709 13:13:52.192584  2468 raft_consensus.cc:697] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 18 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:52.435389 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:52.435992 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:52.422230 29421 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:52.357102  2342 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:52.201999  2502 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:52.200112  2515 raft_consensus.cc:2749] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:13:52.430209 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:52.430548 29344 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:52.426191 29447 raft_consensus.cc:1240] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:52.467274 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:52.455367 29421 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:52.426964 29495 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:52.440202 29346 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:52.446226  2446 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:52.419274  2362 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:52.449508 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:52.455129 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:52.405310  2445 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:52.426900  2448 raft_consensus.cc:2804] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:52.462615 29522 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
W20260709 13:13:52.458843 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:52.463660 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:52.509375 29528 raft_consensus.cc:2393] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 18: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:52.511111 29528 raft_consensus.cc:1275] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:13:52.474339  2140 raft_consensus.cc:2804] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:52.476092  2516 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:52.521747  2140 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:52.476325  2067 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:52.522303  2140 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:52.480475 29452 raft_consensus.cc:1240] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 19. Current term is 20. Ops: []
W20260709 13:13:52.481484 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 57585.4us
I20260709 13:13:52.484519 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:52.524729 29521 raft_consensus.cc:2410] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:13:52.485972 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:13:52.460232 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:52.426741  2497 raft_consensus.cc:2804] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:13:52.489799 29451 raft_consensus.cc:2393] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 15: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:52.436856  2325 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:52.427609  2455 raft_consensus.cc:697] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 17 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
W20260709 13:13:52.406265  2466 consensus_meta.cc:287] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 1.224s	user 0.015s	sys 0.001s
I20260709 13:13:52.513507 29522 raft_consensus.cc:1275] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:13:52.542228 29373 raft_consensus.cc:1240] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:52.435312  2427 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.381889  2523 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:52.517766 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:52.476779  2544 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:52.469748  2342 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:52.418931  2335 raft_consensus.cc:697] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 16 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:52.454643  2450 raft_consensus.cc:493] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:52.456456  2524 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:52.413115  2433 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:52.469444  2432 raft_consensus.cc:697] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 15 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:52.521185 29419 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:52.507334  2515 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:52.437053  2347 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:52.245591  2443 consensus_queue.cc:237] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:52.542706 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 102640us
W20260709 13:13:52.575614 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 54569.9us
W20260709 13:13:52.549158 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 118730us
W20260709 13:13:52.544374 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 89103.6us
I20260709 13:13:52.531621  2497 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:52.533903  2435 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:52.577986 29419 leader_election.cc:400] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 13. Current term is 14.
I20260709 13:13:52.591549 29419 leader_election.cc:403] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:13:52.583166 29344 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:52.595942 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 61902.7us
I20260709 13:13:52.520537  2446 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:52.588677 29377 raft_consensus.cc:1240] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:13:52.579555 29346 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:52.601830 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:52.584719  2356 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:13:52.590092  2497 raft_consensus.cc:3060] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:52.580561  2515 raft_consensus.cc:697] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:52.545377  2466 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:52.548810  2427 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:52.603329  2351 raft_consensus.cc:2804] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:52.574424  2524 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:52.662591 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:52.583068  2450 raft_consensus.cc:515] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:52.607889  2457 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:52.582780  2543 consensus_queue.cc:1059] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 13:13:52.611544  2342 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:52.611557  2445 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:52.637368  2552 raft_consensus.cc:2804] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:13:52.670308  2434 consensus_meta.cc:287] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 1.026s	user 0.015s	sys 0.000s
I20260709 13:13:52.617014  2475 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:52.636469  2549 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:52.688982 29448 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36436 (request call id 556) took 1966 ms (client timeout 1549 ms). Trace:
I20260709 13:13:52.559381  2468 consensus_queue.cc:237] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:52.560061  2544 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:52.600061  2435 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:52.716359 29524 raft_consensus.cc:1240] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 13. Current term is 14. Ops: []
W20260709 13:13:52.718292 29448 rpcz_store.cc:269] 0709 13:13:50.722667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.761326 (+ 38659us) service_pool.cc:224] Handling call
0709 13:13:52.688739 (+1927413us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b540001a9d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:52.688888 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1543500160}
I20260709 13:13:52.689911  2448 raft_consensus.cc:697] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 15 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:52.744729 29448 raft_consensus.cc:1240] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:13:52.637637  2455 consensus_queue.cc:237] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:52.724956  2552 raft_consensus.cc:697] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 15 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:52.721876  2434 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:52.652040  2335 consensus_queue.cc:237] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:52.704288  2342 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:13:52.789706 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:52.685921  2432 consensus_queue.cc:237] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:52.806828 29495 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:52.810431 29526 raft_consensus.cc:2468] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
W20260709 13:13:52.785046 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 207600us
I20260709 13:13:52.755975  2362 raft_consensus.cc:697] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 18 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:52.715293  2445 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:52.813407 29419 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:52.816115 29495 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:52.852454 29495 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:52.785003  2545 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:52.776032  2560 raft_consensus.cc:2749] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:52.910643  2475 raft_consensus.cc:493] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:52.911664  2475 raft_consensus.cc:515] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:52.914791  2475 leader_election.cc:290] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:52.797154  2523 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:52.916445 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 103166us
I20260709 13:13:52.917593 29419 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:52.921730 29419 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:52.853904 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:52.923302  2562 raft_consensus.cc:2749] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:52.924386  2562 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:52.925240  2562 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:52.925868  2562 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:52.773474  2546 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:52.929054  2546 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:52.932152  2362 consensus_queue.cc:237] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:52.933765  2475 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:52.932955 29419 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:52.934434 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 279297us
I20260709 13:13:52.733748  2549 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:52.949525 29419 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:52.945428 29528 raft_consensus.cc:1275] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:13:52.787573  2543 raft_consensus.cc:2749] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 13. Current term is 14.
I20260709 13:13:52.965843 29419 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:13:52.965730 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 428341us
I20260709 13:13:52.757400  2559 consensus_queue.cc:1059] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.101s
I20260709 13:13:52.935211  2433 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:52.951467  2547 log.cc:927] Time spent T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.248s	user 0.001s	sys 0.001s
W20260709 13:13:52.983114  2556 log.cc:927] Time spent T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2: Append to log took a long time: real 0.179s	user 0.000s	sys 0.005s
W20260709 13:13:52.983724  2539 log.cc:927] Time spent T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2: Append to log took a long time: real 0.375s	user 0.000s	sys 0.006s
W20260709 13:13:52.982869  2554 log.cc:927] Time spent T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.064s	user 0.003s	sys 0.003s
I20260709 13:13:53.043061 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:52.927333  2140 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:53.046239 29528 raft_consensus.cc:1275] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:13:52.982318  2427 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:52.987404  2561 log.cc:927] Time spent T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.066s	user 0.005s	sys 0.002s
I20260709 13:13:53.051016 29528 raft_consensus.cc:1275] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:13:52.775126  2515 consensus_queue.cc:237] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:53.027621  2543 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:53.053443  2555 log.cc:927] Time spent T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:13:53.021018  2558 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:52.969226  2475 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:53.078485 29378 raft_consensus.cc:2393] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 14: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:53.058650  2562 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:53.061851 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 209526us
I20260709 13:13:52.934772  2545 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:53.035414  2546 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:53.073292 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:53.075285 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:53.054352  2351 raft_consensus.cc:697] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:13:53.088908 29494 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.003s	sys 0.022s
I20260709 13:13:52.966327  2448 consensus_queue.cc:237] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:53.091987 29495 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:53.065516  2446 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:53.095963 29421 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.001s	sys 0.025s
W20260709 13:13:53.101194 29421 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.001s	sys 0.025s
I20260709 13:13:53.077127  2067 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.066222  2466 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:53.070631  2565 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:13:53.084429  2433 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
W20260709 13:13:53.098291  2265 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.008s	sys 0.008s
W20260709 13:13:53.081483  2236 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.004s	sys 0.008s
I20260709 13:13:53.077659  2559 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:13:53.087811  2558 raft_consensus.cc:3060] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:13:53.098712  2546 raft_consensus.cc:3055] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:13:53.110034 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 144289us
W20260709 13:13:53.096163 29494 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.004s	sys 0.023s
W20260709 13:13:53.117949 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:53.129423 29419 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:53.118194  2356 raft_consensus.cc:697] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 20 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:53.127297  2432 raft_consensus.cc:493] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.140576  2356 consensus_queue.cc:237] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:53.142033  2566 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:53.142727  2566 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:53.130643  2564 raft_consensus.cc:2804] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:53.127122  2546 raft_consensus.cc:740] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:53.143688  2564 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:53.144215  2564 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:53.144701  2475 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:53.144438  2546 consensus_queue.cc:260] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:53.145088  2566 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:53.145253  2569 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:13:53.145864  2546 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:53.146034  2568 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:53.146473  2566 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.146612  2568 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:53.140674  2432 raft_consensus.cc:515] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:53.149277  2568 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:53.150401  2432 leader_election.cc:290] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:53.123844  2544 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:53.121063  2236 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.005s	sys 0.008s
I20260709 13:13:53.157086  2545 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:53.037848  2552 consensus_queue.cc:237] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:53.160360  2564 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:53.162904  2564 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:53.120802  2265 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.009s	sys 0.008s
I20260709 13:13:53.140103  2435 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:53.186569 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
W20260709 13:13:53.192483 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 63189.8us
I20260709 13:13:53.196254 29419 leader_election.cc:400] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 13. Current term is 14.
I20260709 13:13:53.122606  2562 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:53.203275 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:53.146996  2566 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:53.128163  2560 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.228996 29380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1874) took 1206 ms. Trace:
I20260709 13:13:53.114823  2067 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:53.250782 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 158865us
I20260709 13:13:53.197292  2564 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:53.150537  2549 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:53.238168 29380 rpcz_store.cc:276] 0709 13:13:52.022529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.117005 (+ 94476us) service_pool.cc:224] Handling call
0709 13:13:52.117595 (+   590us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:52.118138 (+   543us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:52.118181 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:52.119056 (+   875us) log.cc:844] Serialized 52 byte log entry
0709 13:13:52.597527 (+478471us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:52.622525 (+ 24998us) log.cc:844] Serialized 14 byte log entry
0709 13:13:53.085149 (+462624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:53.085262 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:53.228608 (+143346us) raft_consensus.cc:1685] finished
0709 13:13:53.228644 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:53.228884 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75142,"prepare.queue_time_us":39126,"prepare.run_cpu_time_us":5068,"prepare.run_wall_time_us":16931,"raft.queue_time_us":123340,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":15836,"thread_start_us":861200,"threads_started":2,"wal-append.queue_time_us":684545}
I20260709 13:13:53.192366  2265 raft_consensus.cc:697] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:53.196010  2569 raft_consensus.cc:2749] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:13:53.124163  2574 consensus_queue.cc:1048] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.132s
I20260709 13:13:53.241245 29419 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:53.197530  2342 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:53.280522  2564 raft_consensus.cc:2749] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:53.284406  2585 consensus_queue.cc:1048] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:13:53.256588  2502 consensus_meta.cc:287] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.784s	user 0.014s	sys 0.000s
I20260709 13:13:53.120416  2351 consensus_queue.cc:237] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:53.123682  2433 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:53.276679 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:53.168650  2565 consensus_queue.cc:1059] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.104s
I20260709 13:13:53.204113  2427 consensus_queue.cc:1048] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:13:53.268226 29495 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:53.294835 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:53.203632  2523 consensus_queue.cc:1048] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 13:13:53.301330 29376 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 15.
I20260709 13:13:53.229127  2562 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:53.262264  2475 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.309708 29380 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:53.253175  2545 consensus_queue.cc:1048] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:13:53.310261 29522 raft_consensus.cc:1240] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 LEADER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:53.330377 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:53.300158  2457 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.004s	sys 0.042s
I20260709 13:13:53.324486 29380 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 15.
I20260709 13:13:53.342078 29376 raft_consensus.cc:1240] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 14. Current term is 15. Ops: []
W20260709 13:13:53.335014  2457 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.004s	sys 0.043s
I20260709 13:13:53.254736  2560 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:53.329396  2356 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.329553  2140 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:53.349988  2577 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:53.350556  2582 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:53.351174  2562 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:53.351024  2581 consensus_queue.cc:1059] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:13:53.354679  2566 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:53.348395  2457 raft_consensus.cc:697] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:53.336573  2475 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:53.356187  2265 consensus_queue.cc:237] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:53.345091  2459 raft_consensus.cc:3055] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:13:53.358788  2354 consensus_meta.cc:287] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 1.263s	user 0.017s	sys 0.000s
W20260709 13:13:53.360248 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 92145.3us
I20260709 13:13:53.360808  2565 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:53.298748  2502 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:53.369918 29447 raft_consensus.cc:1240] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 18 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:53.374032  2577 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:53.374877  2582 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:53.378597  2575 log.cc:927] Time spent T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:13:53.379671  2581 raft_consensus.cc:3055] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:13:53.386348 29451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2008) took 1458 ms. Trace:
I20260709 13:13:53.387091  2513 raft_consensus.cc:3055] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:53.386430  2356 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:53.350042  2426 consensus_meta.cc:287] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 1.234s	user 0.010s	sys 0.007s
W20260709 13:13:53.387478  2325 consensus_meta.cc:287] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.849s	user 0.008s	sys 0.004s
I20260709 13:13:53.401628 29374 raft_consensus.cc:1275] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:13:53.419608 29374 pending_rounds.cc:85] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5: Aborting all ops after (but not including) 7
I20260709 13:13:53.419934 29374 pending_rounds.cc:107] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:13:53.420249 29374 raft_consensus.cc:2889] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:53.394671  2459 raft_consensus.cc:740] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:53.407601 29451 rpcz_store.cc:276] 0709 13:13:51.927927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.538845 (+610918us) service_pool.cc:224] Handling call
0709 13:13:52.539311 (+   466us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:52.685974 (+146663us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:13:52.948690 (+262716us) log.cc:844] Serialized 14 byte log entry
0709 13:13:53.123143 (+174453us) log.cc:844] Serialized 14 byte log entry
0709 13:13:53.194781 (+ 71638us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:53.206748 (+ 11967us) log.cc:844] Serialized 26 byte log entry
0709 13:13:53.232860 (+ 26112us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:53.232937 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:53.233045 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:53.386068 (+153023us) raft_consensus.cc:1685] finished
0709 13:13:53.386095 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:53.386268 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82561,"prepare.queue_time_us":418284,"prepare.run_cpu_time_us":115,"prepare.run_wall_time_us":3862,"raft.queue_time_us":333924,"raft.run_cpu_time_us":600,"raft.run_wall_time_us":31357,"thread_start_us":450464,"threads_started":3,"wal-append.queue_time_us":284137}
I20260709 13:13:53.424732 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:53.418852  2426 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:53.426152 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:53.407045  2581 raft_consensus.cc:740] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
W20260709 13:13:53.406631  2409 consensus_meta.cc:287] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 1.286s	user 0.015s	sys 0.003s
I20260709 13:13:53.475808  2451 raft_consensus.cc:3055] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:53.429478  2475 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:53.421149 29525 raft_consensus.cc:2393] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 17: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:53.426952  2426 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:53.433621  2543 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:53.416921  2515 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.456230 29451 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16.
I20260709 13:13:53.431816  2067 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:53.414888  2513 raft_consensus.cc:740] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:53.488793 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:53.422384  2569 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:53.489461 29451 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:53.489315  2515 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:53.489743  2569 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:53.410897  2546 consensus_queue.cc:1059] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:13:53.443739  2466 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:53.448328 29527 raft_consensus.cc:2410] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:13:53.492522  2515 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:53.494117 29527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37958 (request call id 2156) took 1682 ms (client timeout 2184 ms). Trace:
W20260709 13:13:53.494555 29527 rpcz_store.cc:269] 0709 13:13:51.812113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.411198 (+599085us) service_pool.cc:224] Handling call
0709 13:13:53.493873 (+1082675us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54000fa5d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:53.494045 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2380717824}
I20260709 13:13:53.492560  2466 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:53.496822  2425 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.497381  2425 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:53.460417 29530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:34382 (request call id 1) took 2409 ms. Trace:
I20260709 13:13:53.498304 29530 rpcz_store.cc:276] 0709 13:13:51.100682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:51.641574 (+540892us) service_pool.cc:224] Handling call
0709 13:13:53.459880 (+1818306us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54000fafd4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8c735 00007f6a80d4cd29 00007f6a7a2cb1d4 00007f6a7a2cb162 00007f6a7a2cb091 00007f6a7a2cb00c 00007f6a7a2ca2c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:53.460221 (+   341us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2407663872}
W20260709 13:13:53.500443 29327 auto_rebalancer.cc:629] Failed to schedule move for tablet f06f688759cd438a95541a7639513cec: Illegal state: Replica 71aa3578fd924765ab9ac0729c8d1483 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:53.489473  2513 consensus_queue.cc:260] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:53.501029  2445 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:53.501228  2513 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:13:53.503041 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:53.499287  2497 consensus_meta.cc:287] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.855s	user 0.014s	sys 0.000s
I20260709 13:13:53.504647 29449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 3057) took 1712 ms. Trace:
I20260709 13:13:53.505062 29449 rpcz_store.cc:276] 0709 13:13:51.792476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.242630 (+450154us) service_pool.cc:224] Handling call
0709 13:13:52.378302 (+135672us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:52.405295 (+ 26993us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:53.504398 (+1099103us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b5400019ad0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd858ad 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:53.504580 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":310418816}
I20260709 13:13:53.505621  2569 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:53.507602 29451 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
I20260709 13:13:53.507962  2342 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.508747 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:53.508587  2342 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:53.506493 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:53.470701 29376 raft_consensus.cc:1275] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:13:53.471130 29380 raft_consensus.cc:1240] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:13:53.422180  2588 consensus_queue.cc:1059] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:13:53.428272  2578 raft_consensus.cc:493] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:53.432384 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:53.514489 29495 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:53.516304 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:53.448570  2433 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:53.435534  2560 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:53.439700  2356 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:53.446965  2577 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:53.453471  2502 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:53.442267  2582 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:53.477001  2409 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:53.406145 29455 raft_consensus.cc:1240] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 17 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:53.484324  2451 raft_consensus.cc:740] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:53.504329  2497 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:53.468470  2558 raft_consensus.cc:2749] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:13:53.511000 29376 raft_consensus.cc:1240] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:53.509785  2425 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:53.497898  2466 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:53.427747 29456 raft_consensus.cc:1240] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:13:53.518894 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:53.519573 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:53.539280 29527 raft_consensus.cc:2393] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 17: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:53.539314 29448 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 21.
I20260709 13:13:53.540409 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:53.540753 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:53.541504 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:53.541615 29448 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:13:53.542744 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:53.544724 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:53.524196  2578 raft_consensus.cc:515] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:53.528106 29495 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:53.506531 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:53.534333 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:53.537259  2409 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:53.547147 29527 raft_consensus.cc:2468] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 5.
I20260709 13:13:53.547905 29449 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 20.
I20260709 13:13:53.548079 29451 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:53.550408 29452 raft_consensus.cc:1240] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 15 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:53.543380 29448 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 15.
I20260709 13:13:53.550570 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:53.551600 29449 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:53.552475 29495 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:53.531936  2569 raft_consensus.cc:2804] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:53.557518 29495 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:53.561546 29495 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:53.511672  2457 consensus_queue.cc:237] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:53.561457  2569 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:53.556658  2502 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:53.561070  2588 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:13:53.568629  2588 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:53.569422 29523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3917) took 1507 ms. Trace:
I20260709 13:13:53.569844 29523 rpcz_store.cc:276] 0709 13:13:52.062219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.822846 (+760627us) service_pool.cc:224] Handling call
0709 13:13:52.823324 (+   478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:52.930352 (+107028us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:13:52.930758 (+   406us) log.cc:844] Serialized 14 byte log entry
0709 13:13:53.099904 (+169146us) log.cc:844] Serialized 14 byte log entry
0709 13:13:53.100594 (+   690us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:53.100662 (+    68us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:13:53.100726 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:53.569141 (+468415us) spinlock_profiling.cc:243] Waited 82.3 ms on lock 0x7b5400232dd4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:53.569204 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:53.569355 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21252,"prepare.queue_time_us":926,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":6486,"raft.queue_time_us":73038,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":7752,"spinlock_wait_cycles":189230848,"thread_start_us":168476,"threads_started":1,"wal-append.queue_time_us":210937}
I20260709 13:13:53.572072 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:53.563896  2265 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:53.563844  2325 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:13:53.565076  2569 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:53.575537 29495 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.688s (SENT) [suppressed 33 similar messages]
W20260709 13:13:53.618067 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:53.629747 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:53.630415 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:53.569042  2588 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:13:53.657444 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 81963.6us
I20260709 13:13:53.573523  2502 raft_consensus.cc:697] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:53.575911  2325 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:53.670452  2325 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:53.579703  2265 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:53.654791  2546 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.659529  2586 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.565274  2451 consensus_queue.cc:260] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:53.710219 29451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 3064) took 1277 ms. Trace:
I20260709 13:13:53.698841 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:53.705561 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:53.710876 29451 rpcz_store.cc:276] 0709 13:13:52.433070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.564146 (+1131076us) service_pool.cc:224] Handling call
0709 13:13:53.573907 (+  9761us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:53.574143 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:13:53.653829 (+ 79686us) log.cc:844] Serialized 14 byte log entry
0709 13:13:53.709137 (+ 55308us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:53.709214 (+    77us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:53.709847 (+   633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:53.709960 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:53.710141 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":85786,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":58,"thread_start_us":54784,"threads_started":1}
I20260709 13:13:53.695026  2265 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:53.719369 29379 raft_consensus.cc:1240] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:13:53.720824 29378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52172 (request call id 2340) took 1067 ms. Trace:
I20260709 13:13:53.721421 29378 rpcz_store.cc:276] 0709 13:13:52.653571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.469322 (+815751us) service_pool.cc:224] Handling call
0709 13:13:53.469882 (+   560us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:53.470177 (+   295us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:13:53.548847 (+ 78670us) log.cc:844] Serialized 14 byte log entry
0709 13:13:53.720394 (+171547us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:53.720449 (+    55us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:13:53.720494 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:53.720615 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:53.720753 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":159186,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":50,"raft.queue_time_us":96,"thread_start_us":236154,"threads_started":2}
I20260709 13:13:53.709723  2578 leader_election.cc:290] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:53.729773 29451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 3068) took 1295 ms. Trace:
I20260709 13:13:53.730722 29451 rpcz_store.cc:276] 0709 13:13:52.434546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.718854 (+1284308us) service_pool.cc:224] Handling call
0709 13:13:53.729175 (+ 10321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:53.729359 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:53.729388 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:53.729444 (+    56us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:53.729487 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:53.729545 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:53.729713 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:53.720825  2451 raft_consensus.cc:3060] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:53.731186 29378 raft_consensus.cc:1275] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:13:53.727003  2355 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:53.714334  2586 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:53.707355  2546 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:53.744635 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:53.758812  2325 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:53.787688 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:53.778388  2602 log.cc:927] Time spent T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:13:53.750474  2502 consensus_queue.cc:237] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:53.767864  2537 consensus_queue.cc:1048] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:13:53.777871  2517 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:53.777027  2573 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:53.829083  2599 log.cc:927] Time spent T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.261s	user 0.000s	sys 0.002s
I20260709 13:13:53.785419  2586 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:53.828567  2603 log.cc:927] Time spent T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.126s	user 0.000s	sys 0.002s
W20260709 13:13:53.860589 29526 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37968 (request call id 3919) took 1798 ms (client timeout 2311 ms). Trace:
I20260709 13:13:53.861438 29373 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1879) took 1798 ms. Trace:
W20260709 13:13:53.862707 29525 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37958 (request call id 2188) took 1939 ms (client timeout 2236 ms). Trace:
W20260709 13:13:53.863135 29525 rpcz_store.cc:269] 0709 13:13:51.922883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.424372 (+501489us) service_pool.cc:224] Handling call
0709 13:13:53.862459 (+1438087us) spinlock_profiling.cc:243] Waited 940 ms on lock 0x7b5400102cd4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:53.862641 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2162818944}
I20260709 13:13:53.830674  2524 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:53.837953  2448 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.862187 29373 rpcz_store.cc:276] 0709 13:13:52.063397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.158409 (+ 95012us) service_pool.cc:224] Handling call
0709 13:13:52.158815 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:52.542700 (+383885us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:53.861079 (+1318379us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b54003908d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:53.861353 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":881311616}
W20260709 13:13:53.861132 29526 rpcz_store.cc:269] 0709 13:13:52.062581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.435640 (+373059us) service_pool.cc:224] Handling call
0709 13:13:53.860351 (+1424711us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b540020a154. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:53.860516 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":858841856}
I20260709 13:13:53.844591  2466 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.875234 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:53.878216 29525 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:13:53.879525 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:53.881371 29526 raft_consensus.cc:2393] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 11: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
W20260709 13:13:53.885710  2612 log.cc:927] Time spent T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:13:53.876742  2466 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:53.888309  2611 log.cc:927] Time spent T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:13:53.888902  2466 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:53.890260  2606 log.cc:927] Time spent T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
W20260709 13:13:53.890717  2548 log.cc:927] Time spent T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 1.343s	user 0.000s	sys 0.017s
I20260709 13:13:53.892427 29450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2005) took 2090 ms. Trace:
I20260709 13:13:53.892789  2475 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.893388  2325 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:53.873267  2448 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:53.893548  2475 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:53.895117  2607 log.cc:927] Time spent T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:13:53.896036  2448 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:53.900122 29528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3927) took 1750 ms. Trace:
I20260709 13:13:53.892867 29450 rpcz_store.cc:276] 0709 13:13:51.801935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.531908 (+729973us) service_pool.cc:224] Handling call
0709 13:13:52.545032 (+ 13124us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:52.700777 (+155745us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:13:53.509314 (+808537us) spinlock_profiling.cc:243] Waited 3.88 ms on lock 0x7b1800327d60. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c7be07 00007f6a81ad6ab9 00007f6a78c9869b 00007f6a78c9693f 00007f6a78c96455 00007f6a7f77e3c7 00007f6a7bd909a7 00007f6a7bda00bf 00007f6a7bda0038
0709 13:13:53.529334 (+ 20020us) log.cc:844] Serialized 14 byte log entry
0709 13:13:53.561556 (+ 32222us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:53.566431 (+  4875us) log.cc:844] Serialized 26 byte log entry
0709 13:13:53.566653 (+   222us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:53.566691 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:53.566746 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:53.892013 (+325267us) raft_consensus.cc:1685] finished
0709 13:13:53.892164 (+   151us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:53.892352 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40018,"prepare.queue_time_us":405767,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":193367,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":11980,"spinlock_wait_cycles":8917248,"thread_start_us":175242,"threads_started":3,"wal-append.queue_time_us":131385}
I20260709 13:13:53.904137 29528 rpcz_store.cc:276] 0709 13:13:52.150048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.061081 (+911033us) service_pool.cc:224] Handling call
0709 13:13:53.070731 (+  9650us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:53.099459 (+ 28728us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:53.099526 (+    67us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:53.099575 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:53.099610 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:53.899844 (+800234us) spinlock_profiling.cc:243] Waited 28.5 ms on lock 0x7b54003589d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:53.899897 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:53.900056 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":65504128}
I20260709 13:13:53.905678 29450 raft_consensus.cc:1240] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:13:53.907044 29450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 3070) took 1468 ms. Trace:
I20260709 13:13:53.907727 29450 rpcz_store.cc:276] 0709 13:13:52.438395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.904883 (+1466488us) service_pool.cc:224] Handling call
0709 13:13:53.905353 (+   470us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:53.906540 (+  1187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:53.906942 (+   402us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:53.910245 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:53.911629 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:53.915138 29381 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1878) took 1873 ms. Trace:
I20260709 13:13:53.851820  2573 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:53.917948 29381 rpcz_store.cc:276] 0709 13:13:52.041268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.146875 (+105607us) service_pool.cc:224] Handling call
0709 13:13:52.147252 (+   377us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:13:52.200645 (+ 53393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:52.200680 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:13:52.223101 (+ 22421us) log.cc:844] Serialized 52 byte log entry
0709 13:13:52.423571 (+200470us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:52.614695 (+191124us) log.cc:844] Serialized 14 byte log entry
0709 13:13:52.692905 (+ 78210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:52.693014 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:53.889924 (+1196910us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:13:53.914576 (+ 24652us) raft_consensus.cc:1685] finished
0709 13:13:53.914716 (+   140us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:53.915053 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":157239,"prepare.queue_time_us":98328,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":165468,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":75333,"spinlock_wait_cycles":24790656,"thread_start_us":137836,"threads_started":2,"wal-append.queue_time_us":131600}
I20260709 13:13:53.926966 29448 raft_consensus.cc:1275] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 20 index: 9. (index mismatch)
I20260709 13:13:53.927778 29448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 3072) took 1436 ms. Trace:
I20260709 13:13:53.931834 29448 rpcz_store.cc:276] 0709 13:13:52.491414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.917686 (+1426272us) service_pool.cc:224] Handling call
0709 13:13:53.926593 (+  8907us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:53.927485 (+   892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:53.927729 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:13:53.934429 29454 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45796 (request call id 2014) took 1885 ms (client timeout 1952 ms). Trace:
W20260709 13:13:53.934963 29454 rpcz_store.cc:269] 0709 13:13:52.049206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.152672 (+103466us) service_pool.cc:224] Handling call
0709 13:13:53.934175 (+1781503us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54000d7354. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:53.934361 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3041733376}
W20260709 13:13:53.938336 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:53.938524 29454 raft_consensus.cc:1275] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:13:53.921636  2513 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:53.940550  2356 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:53.942124  2546 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:53.946239  2475 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:53.943909  2513 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:53.994263 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 70610.7us
I20260709 13:13:53.998291  2569 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:53.967815  2356 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:53.999013 29455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2002) took 2198 ms. Trace:
W20260709 13:13:53.999679 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.003985 29455 rpcz_store.cc:276] 0709 13:13:51.801077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.444697 (+643620us) service_pool.cc:224] Handling call
0709 13:13:52.445140 (+   443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:53.529830 (+1084690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:53.998706 (+468876us) spinlock_profiling.cc:243] Waited 961 ms on lock 0x7b54001c1e54. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:53.998931 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2209644928}
I20260709 13:13:54.007441 29455 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:54.008074 29523 raft_consensus.cc:2393] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 17: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:13:54.023310 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 87616.5us
W20260709 13:13:54.025241 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.026407 29495 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:54.031044 29495 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:54.012395  2448 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.052644 29495 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:54.018297  2558 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:54.064807  2565 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:54.061828  2475 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:54.064755  2546 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:54.069576  2493 raft_consensus.cc:2243] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:54.066401  2515 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:54.076972  2573 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:54.072320  2558 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:54.067485  2448 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:54.078620  2565 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:54.079298  2546 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:54.096060  2616 log.cc:927] Time spent T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:13:54.098030  2582 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:54.098443  2493 raft_consensus.cc:2272] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:54.099223 29372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 928) took 1683 ms. Trace:
I20260709 13:13:54.110543 29372 rpcz_store.cc:276] 0709 13:13:52.415582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.564841 (+149259us) service_pool.cc:224] Handling call
0709 13:13:52.588027 (+ 23186us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:52.713357 (+125330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:52.713405 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:52.713468 (+    63us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:52.713526 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.098845 (+1385319us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b5400081954. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:54.098913 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:54.099142 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":287595264}
I20260709 13:13:54.104872 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:54.112989 29449 raft_consensus.cc:3060] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:13:54.108953 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.091890  2515 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.118554 29377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1880) took 2054 ms. Trace:
I20260709 13:13:54.120997 29522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3915) took 2059 ms. Trace:
I20260709 13:13:54.123677 29522 rpcz_store.cc:276] 0709 13:13:52.061905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.566245 (+504340us) service_pool.cc:224] Handling call
0709 13:13:52.594050 (+ 27805us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:53.330932 (+736882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.120611 (+789679us) spinlock_profiling.cc:243] Waited 716 ms on lock 0x7b54001018d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:54.120914 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1646590720}
I20260709 13:13:54.126471 29455 raft_consensus.cc:1275] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:13:54.128715 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:54.122510 29377 rpcz_store.cc:276] 0709 13:13:52.063688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.176366 (+112678us) service_pool.cc:224] Handling call
0709 13:13:52.203699 (+ 27333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:52.602967 (+399268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.117994 (+1515027us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b54001ef0d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:54.118442 (+   448us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":884531072}
W20260709 13:13:54.131174 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.137154 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:54.139390 29455 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:54.107038  2265 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:54.109666  2565 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:54.107432  2481 consensus_queue.cc:1048] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:13:54.109396  2546 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:54.084708  2475 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:54.155766 29455 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 21.
I20260709 13:13:54.156390 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:54.159624 29451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 3069) took 1721 ms. Trace:
I20260709 13:13:54.160045 29451 rpcz_store.cc:276] 0709 13:13:52.438105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.732683 (+1294578us) service_pool.cc:224] Handling call
0709 13:13:53.774110 (+ 41427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:53.792337 (+ 18227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:53.792370 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:53.843936 (+ 51566us) log.cc:844] Serialized 26 byte log entry
0709 13:13:54.014509 (+170573us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:54.014577 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.014684 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:54.159344 (+144660us) raft_consensus.cc:1685] finished
0709 13:13:54.159368 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:54.159553 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3276,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":2641,"thread_start_us":141810,"threads_started":1,"wal-append.queue_time_us":238974}
I20260709 13:13:54.161825 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:54.162488 29451 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16.
I20260709 13:13:54.164000 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:54.164577 29451 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16.
I20260709 13:13:54.165823 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:54.132273  2515 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:54.169833  2265 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:54.125365  2582 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:54.177309 29451 raft_consensus.cc:2410] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:13:54.178601 29522 raft_consensus.cc:2393] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 14: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:54.180437 29447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2003) took 2379 ms. Trace:
I20260709 13:13:54.180747 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:54.180840 29447 rpcz_store.cc:276] 0709 13:13:51.801365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.475572 (+674207us) service_pool.cc:224] Handling call
0709 13:13:52.475947 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:53.403025 (+927078us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.180182 (+777157us) spinlock_profiling.cc:243] Waited 894 ms on lock 0x7b54000cf8d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:54.180371 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2055295872}
I20260709 13:13:54.181710 29522 raft_consensus.cc:2393] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 16: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:54.182622 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:54.182734 29447 raft_consensus.cc:1275] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:13:54.185163  2475 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:54.178448 29374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 926) took 1801 ms. Trace:
I20260709 13:13:54.187021 29374 rpcz_store.cc:276] 0709 13:13:52.377082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.377272 (+   190us) service_pool.cc:224] Handling call
0709 13:13:52.377615 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:53.420887 (+1043272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.178170 (+757283us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54003705d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:54.178378 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2353655680}
I20260709 13:13:54.157483 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:54.189502 29447 raft_consensus.cc:1240] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:13:54.190469 29375 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
I20260709 13:13:54.183283 29522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37968 (request call id 3936) took 1016 ms. Trace:
I20260709 13:13:54.194273 29522 rpcz_store.cc:276] 0709 13:13:53.167327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:54.182348 (+1015021us) service_pool.cc:224] Handling call
0709 13:13:54.183225 (+   877us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:54.148437  2513 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:54.195727 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 192288us
I20260709 13:13:54.191728  2569 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:54.201246 29453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 3067) took 1767 ms. Trace:
I20260709 13:13:54.201391 29521 raft_consensus.cc:1240] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 15 LEADER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:54.201700 29527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37968 (request call id 3938) took 1032 ms. Trace:
I20260709 13:13:54.213924 29527 rpcz_store.cc:276] 0709 13:13:53.169716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.541287 (+371571us) service_pool.cc:224] Handling call
0709 13:13:54.201479 (+660192us) spinlock_profiling.cc:243] Waited 5.01 ms on lock 0x7b54000b77d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:54.201620 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11520768}
I20260709 13:13:54.191252  2350 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.204577 29447 raft_consensus.cc:1240] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 20 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 19. Current term is 20. Ops: []
W20260709 13:13:54.206357 29529 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37958 (request call id 2162) took 2392 ms (client timeout 1921 ms). Trace:
W20260709 13:13:54.208652 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.211906 29524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 2164) took 2397 ms. Trace:
W20260709 13:13:54.217319 29529 rpcz_store.cc:269] 0709 13:13:51.813940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.160505 (+346565us) service_pool.cc:224] Handling call
0709 13:13:54.200985 (+2040480us) spinlock_profiling.cc:243] Waited 933 ms on lock 0x7b5400133154. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:54.206246 (+  5261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2146828032}
I20260709 13:13:54.217593 29524 rpcz_store.cc:276] 0709 13:13:51.814566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.513407 (+698841us) service_pool.cc:224] Handling call
0709 13:13:52.513761 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:52.740610 (+226849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.211643 (+1471033us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b54000fafd4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:54.211839 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":465227008}
I20260709 13:13:54.212294 29453 rpcz_store.cc:276] 0709 13:13:52.434232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.570279 (+1136047us) service_pool.cc:224] Handling call
0709 13:13:53.570574 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:53.573844 (+  3270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:53.573876 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:53.576133 (+  2257us) log.cc:844] Serialized 26 byte log entry
0709 13:13:53.872140 (+296007us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:53.872192 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:53.872272 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:54.201025 (+328753us) raft_consensus.cc:1685] finished
0709 13:13:54.201047 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:54.201180 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":99,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":2418,"thread_start_us":199044,"threads_started":1,"wal-append.queue_time_us":315948}
I20260709 13:13:54.221016 29524 raft_consensus.cc:1275] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:13:54.222087 29524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53428 (request call id 860) took 2028 ms. Trace:
I20260709 13:13:54.222528 29524 rpcz_store.cc:276] 0709 13:13:52.193738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:54.220168 (+2026430us) service_pool.cc:224] Handling call
0709 13:13:54.220549 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:54.221416 (+   867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.221660 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:54.216131 29527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53428 (request call id 858) took 2037 ms. Trace:
W20260709 13:13:54.223721 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 160595us
I20260709 13:13:54.224347 29527 rpcz_store.cc:276] 0709 13:13:52.178624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:54.215023 (+2036399us) service_pool.cc:224] Handling call
0709 13:13:54.215442 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:54.215709 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:54.215748 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:54.215809 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:54.215854 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.215926 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:54.216060 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:54.234443 29449 raft_consensus.cc:2468] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 8.
I20260709 13:13:54.236635 29377 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:13:54.240080 29377 raft_consensus.cc:606] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:13:54.240587 29377 raft_consensus.cc:614] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:13:54.237543 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:54.242075 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.242775 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:54.238502 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:54.244699 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:54.248381 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:54.263336 29524 raft_consensus.cc:1240] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:13:54.270138 29524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 2190) took 1666 ms. Trace:
I20260709 13:13:54.275013 29524 rpcz_store.cc:276] 0709 13:13:52.603941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:54.262578 (+1658637us) service_pool.cc:224] Handling call
0709 13:13:54.262974 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:54.269653 (+  6679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.270052 (+   399us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:54.249732 29495 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:54.290954 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:54.293598 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:54.295446 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:54.296409 29373 raft_consensus.cc:2468] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
I20260709 13:13:54.297719 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:54.301522 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 51879.7us
I20260709 13:13:54.301743 29529 raft_consensus.cc:1275] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:13:54.300922 29453 raft_consensus.cc:1275] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:13:54.302647 29529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53428 (request call id 859) took 2120 ms. Trace:
I20260709 13:13:54.306517 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:54.308362 29447 raft_consensus.cc:1240] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:13:54.303242 29529 rpcz_store.cc:276] 0709 13:13:52.182095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:54.218488 (+2036393us) service_pool.cc:224] Handling call
0709 13:13:54.301333 (+ 82845us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:54.302313 (+   980us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.302571 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:54.308327 29377 raft_consensus.cc:1240] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:54.309581 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:54.312379 29376 raft_consensus.cc:1240] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 19. Current term is 20. Ops: [18.11-19.12]
I20260709 13:13:54.302276 29495 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:54.354300 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:54.205763  2577 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:54.360965 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:54.320124 29450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 3071) took 1848 ms. Trace:
I20260709 13:13:54.363348 29381 raft_consensus.cc:1240] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:54.364421 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:54.365625 29373 raft_consensus.cc:2468] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 5.
I20260709 13:13:54.358862 29377 raft_consensus.cc:1275] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:13:54.365658 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:54.210098  2574 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.348251 29522 raft_consensus.cc:1240] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:13:54.357705 29449 raft_consensus.cc:1275] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:13:54.371906 29449 pending_rounds.cc:85] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 8
I20260709 13:13:54.372443 29449 pending_rounds.cc:107] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:13:54.235172  2451 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:54.374864 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:54.378376 29453 raft_consensus.cc:2376] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 14. Re-sending same reply.
I20260709 13:13:54.386701 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:54.387118 29529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53428 (request call id 861) took 1422 ms. Trace:
I20260709 13:13:54.387697 29529 rpcz_store.cc:276] 0709 13:13:52.965195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:54.381285 (+1416090us) service_pool.cc:224] Handling call
0709 13:13:54.386345 (+  5060us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:54.386633 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:54.386673 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:54.386738 (+    65us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:54.386787 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.386866 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:54.387057 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:54.389086  2497 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:54.390043 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:54.392168 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:54.319859  2417 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.400259  2417 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:54.402626  2417 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:54.400641 29452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2004) took 2599 ms. Trace:
I20260709 13:13:54.403614 29452 rpcz_store.cc:276] 0709 13:13:51.801663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.530749 (+729086us) service_pool.cc:224] Handling call
0709 13:13:52.547881 (+ 17132us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:53.550857 (+1002976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.400350 (+849493us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54001c2354. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:54.400577 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2305090816}
I20260709 13:13:54.404801 29380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52172 (request call id 2339) took 1751 ms. Trace:
I20260709 13:13:54.405068 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:54.405211 29380 rpcz_store.cc:276] 0709 13:13:52.653276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.356554 (+703278us) service_pool.cc:224] Handling call
0709 13:13:53.470879 (+114325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:53.510261 (+ 39382us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.404597 (+894336us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54000d98d0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd858ad 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:54.404735 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":262087552}
I20260709 13:13:54.407002 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:54.407611 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:54.408738 29530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53428 (request call id 862) took 1218 ms. Trace:
I20260709 13:13:54.409174 29530 rpcz_store.cc:276] 0709 13:13:53.190016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:54.407262 (+1217246us) service_pool.cc:224] Handling call
0709 13:13:54.408655 (+  1393us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:54.410866 29530 raft_consensus.cc:1275] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:13:54.411303 29530 pending_rounds.cc:85] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 9
I20260709 13:13:54.304865  2356 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:54.433303 29530 pending_rounds.cc:107] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:13:54.433753 29530 raft_consensus.cc:2889] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:54.434782 29530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3932) took 1268 ms. Trace:
I20260709 13:13:54.435703 29377 raft_consensus.cc:3055] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:54.436411 29377 raft_consensus.cc:740] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:54.435220 29530 rpcz_store.cc:276] 0709 13:13:53.166204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:54.410004 (+1243800us) service_pool.cc:224] Handling call
0709 13:13:54.410397 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:54.434384 (+ 23987us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.434701 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:54.438398 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:54.438984 29530 raft_consensus.cc:1240] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:54.439680 29530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3934) took 1272 ms. Trace:
I20260709 13:13:54.440088 29530 rpcz_store.cc:276] 0709 13:13:53.166824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:54.438509 (+1271685us) service_pool.cc:224] Handling call
0709 13:13:54.438816 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:54.439340 (+   524us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.439593 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:54.421051 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:54.383028  2569 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:13:54.422538  2417 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.413185  2451 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:54.429075 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:54.429462 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:54.431082 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 211777us
I20260709 13:13:54.373180 29449 raft_consensus.cc:2889] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:54.395268  2450 leader_election.cc:290] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:54.445838 29522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53428 (request call id 857) took 2273 ms. Trace:
I20260709 13:13:54.504597 29522 rpcz_store.cc:276] 0709 13:13:52.172232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:54.207744 (+2035512us) service_pool.cc:224] Handling call
0709 13:13:54.347822 (+140078us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:54.370152 (+ 22330us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.445743 (+ 75591us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:54.502981 29454 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 20.
I20260709 13:13:54.507746 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:54.363384 29450 rpcz_store.cc:276] 0709 13:13:52.471694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.909085 (+1437391us) service_pool.cc:224] Handling call
0709 13:13:53.909541 (+   456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:53.910150 (+   609us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:13:53.928988 (+ 18838us) log.cc:844] Serialized 14 byte log entry
0709 13:13:54.319414 (+390426us) log.cc:844] Serialized 14 byte log entry
0709 13:13:54.319673 (+   259us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:54.319752 (+    79us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:54.319807 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.319879 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:54.320043 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43469,"prepare.queue_time_us":63319,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":74,"raft.queue_time_us":74816,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"thread_start_us":345932,"threads_started":2,"wal-append.queue_time_us":270738}
I20260709 13:13:54.492228 29376 raft_consensus.cc:1275] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:13:54.423764 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:54.240187  2350 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:54.496068 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:54.292290  2513 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.301064  2475 consensus_queue.cc:1048] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.121s
I20260709 13:13:54.484464 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:54.300882  2434 consensus_queue.cc:1059] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.127s
I20260709 13:13:54.430691  2576 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:54.514485 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:54.545428 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:54.546325 29449 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:13:54.514761 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:54.509719 29377 consensus_queue.cc:260] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:54.548650 29377 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:54.534508 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:54.553305 29378 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 20.
I20260709 13:13:54.535032 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:54.535627 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:54.373154  2577 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:54.511710 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:54.539916 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:54.558139 29380 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 16.
I20260709 13:13:54.504436  2356 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:54.559615  2356 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:54.561816  2356 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:54.540323 29522 raft_consensus.cc:1240] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:54.563395 29522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3942) took 1392 ms. Trace:
I20260709 13:13:54.509020  2417 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:54.563781 29522 rpcz_store.cc:276] 0709 13:13:53.170804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:54.513418 (+1342614us) service_pool.cc:224] Handling call
0709 13:13:54.540140 (+ 26722us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:54.563068 (+ 22928us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.563334 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:54.565536 29522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53428 (request call id 863) took 1372 ms. Trace:
I20260709 13:13:54.565656  2417 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:54.509858  2569 raft_consensus.cc:697] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:54.565894 29522 rpcz_store.cc:276] 0709 13:13:53.193636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:54.564611 (+1370975us) service_pool.cc:224] Handling call
0709 13:13:54.564990 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:54.565208 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:54.565232 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:54.565281 (+    49us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:54.565318 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.565374 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:54.565479 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:54.567840 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:54.568106 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:54.568969 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:54.582041 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:54.558084 29450 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 18.
I20260709 13:13:54.583520 29377 raft_consensus.cc:1275] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:13:54.579417 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:54.567117  2569 consensus_queue.cc:237] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:54.587726 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.596524 29456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 1998) took 2777 ms. Trace:
I20260709 13:13:54.597137 29456 rpcz_store.cc:276] 0709 13:13:51.796619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.428982 (+632363us) service_pool.cc:224] Handling call
0709 13:13:52.466754 (+ 37772us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:53.538591 (+1071837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.573988 (+1035397us) spinlock_profiling.cc:243] Waited 961 ms on lock 0x7b5400127d54. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:54.574301 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2209364736}
I20260709 13:13:54.598519 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:54.599460 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:54.592126 29373 raft_consensus.cc:1240] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 12. Current term is 13. Ops: []
I20260709 13:13:54.598412 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:54.602130 29372 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:54.603195 29377 raft_consensus.cc:2393] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 12: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
W20260709 13:13:54.600345 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.600602 29452 raft_consensus.cc:1275] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:13:54.588511 29522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 2195) took 1170 ms. Trace:
I20260709 13:13:54.495230  2574 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:54.615056 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:54.609843 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:54.617738 29377 raft_consensus.cc:1275] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:13:54.612038 29346 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:54.618090 29376 raft_consensus.cc:1275] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:13:54.607208 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:54.592603  2347 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:54.619794 29453 raft_consensus.cc:1275] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:13:54.684437 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 72483.7us
I20260709 13:13:54.606220 29522 rpcz_store.cc:276] 0709 13:13:53.418372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:54.567085 (+1148713us) service_pool.cc:224] Handling call
0709 13:13:54.567461 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:54.588029 (+ 20568us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:54.588069 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:54.588128 (+    59us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:13:54.588199 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.588291 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:54.588436 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:13:54.626514 29450 raft_consensus.cc:1275] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 13:13:54.628451  2517 consensus_meta.cc:287] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.777s	user 0.015s	sys 0.000s
W20260709 13:13:54.630239  2622 log.cc:927] Time spent T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
W20260709 13:13:54.630970  2619 log.cc:927] Time spent T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.331s	user 0.000s	sys 0.001s
I20260709 13:13:54.630488  2565 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:54.650401  2493 ts_tablet_manager.cc:1916] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:13:54.651990 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.654718 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:54.764293 29452 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:13:54.571334  2434 consensus_queue.cc:1243] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer 183db85c071f489fbc8de63a9edd8a3a log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:13:54.666242 30154 raft_consensus.cc:1240] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:13:54.767611 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:54.667325 29449 raft_consensus.cc:2468] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
W20260709 13:13:54.616472  2588 consensus_meta.cc:287] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.942s	user 0.011s	sys 0.005s
I20260709 13:13:54.671314 29380 raft_consensus.cc:1240] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:54.653494  2537 consensus_queue.cc:1048] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 13:13:54.556886  2576 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:54.805544  2632 consensus_queue.cc:1048] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:54.784327  2434 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.815264 29448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 3073) took 2308 ms. Trace:
I20260709 13:13:54.787701  2628 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.758934 29379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1872) took 2724 ms. Trace:
I20260709 13:13:54.821187 29379 rpcz_store.cc:276] 0709 13:13:52.021924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.083419 (+ 61495us) service_pool.cc:224] Handling call
0709 13:13:52.083952 (+   533us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:53.719988 (+1636036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.746076 (+1026088us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b54003c50d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:54.746350 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3760338816}
I20260709 13:13:54.747345 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:54.593356  2450 consensus_queue.cc:1048] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 13:13:54.673310 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:54.536646  2513 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:54.773154 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:54.747893  2578 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.774190  2351 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.774646  2588 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:54.685463  2342 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:54.864121 29524 raft_consensus.cc:1240] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 21. Current term is 22. Ops: []
I20260709 13:13:54.741868  2355 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:54.815861 29448 rpcz_store.cc:276] 0709 13:13:52.507603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.932731 (+1425128us) service_pool.cc:224] Handling call
0709 13:13:53.952475 (+ 19744us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:53.953391 (+   916us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:53.953439 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:53.954130 (+   691us) log.cc:844] Serialized 26 byte log entry
0709 13:13:54.153022 (+198892us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:54.153084 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.153166 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:54.814956 (+661790us) raft_consensus.cc:1685] finished
0709 13:13:54.814989 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:54.815179 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":108,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":6142,"thread_start_us":170241,"threads_started":1,"wal-append.queue_time_us":391403}
I20260709 13:13:54.785162  2625 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
W20260709 13:13:54.748993 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 446588us
I20260709 13:13:54.749214 29372 raft_consensus.cc:2410] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:13:54.858821  2578 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:54.862309 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:54.876624 29522 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:54.878264 29381 raft_consensus.cc:1275] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:13:54.860450  2472 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.505s	user 0.025s	sys 0.017s
I20260709 13:13:54.874249 29495 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:54.859843  2634 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:54.882179  2472 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.531s	user 0.025s	sys 0.017s
W20260709 13:13:54.903439 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 206387us
I20260709 13:13:54.833207  2434 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:54.903990 29495 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:54.897174  2342 raft_consensus.cc:2804] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:13:54.914517 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.915912 29419 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:54.887702  2451 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:54.854209  2628 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:54.863340  2351 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:54.905689  2627 consensus_queue.cc:1059] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.067s
I20260709 13:13:54.949905  2472 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.964856  2472 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:54.967046  2472 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:55.001303 29522 raft_consensus.cc:2468] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 14.
W20260709 13:13:55.002121 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 329648us
I20260709 13:13:55.002588 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:13:54.988507 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 48171us
I20260709 13:13:54.940100  2342 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:55.025895 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:54.907644  2517 consensus_queue.cc:1048] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.125s
I20260709 13:13:55.033799  2417 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.034468  2417 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:55.034821  2325 raft_consensus.cc:3055] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:55.034642  2459 consensus_queue.cc:260] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:55.036330  2459 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:55.036870  2417 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:55.037139  2582 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:55.035302  2325 raft_consensus.cc:740] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:55.039894  2325 consensus_queue.cc:260] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:55.040719  2630 log.cc:927] Time spent T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 13:13:55.040987  2325 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:55.042868  2633 log.cc:927] Time spent T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:13:55.008008 29522 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:13:54.957124  2515 consensus_meta.cc:287] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.789s	user 0.011s	sys 0.012s
I20260709 13:13:54.958712  2588 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:54.957863  2574 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:54.969139  2577 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:54.882030  2625 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:54.999879  2466 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:54.947867  2350 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:55.085687 29521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3914) took 3023 ms. Trace:
I20260709 13:13:55.087034  2558 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:55.096552  2448 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:55.098716 29523 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37958 (request call id 2198) took 1677 ms (client timeout 1792 ms). Trace:
I20260709 13:13:55.099531 29524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3930) took 2472 ms. Trace:
W20260709 13:13:55.150779 29523 rpcz_store.cc:269] 0709 13:13:53.421681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.728836 (+307155us) service_pool.cc:224] Handling call
0709 13:13:55.098424 (+1369588us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b54003ab1d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:55.098630 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":582057728}
I20260709 13:13:55.150952 29524 rpcz_store.cc:276] 0709 13:13:52.627325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:54.276918 (+1649593us) service_pool.cc:224] Handling call
0709 13:13:54.277427 (+   509us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:54.868526 (+591099us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:55.095437 (+226911us) spinlock_profiling.cc:243] Waited 586 ms on lock 0x7b5400357fd4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:55.099444 (+  4007us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1348522368}
I20260709 13:13:55.153057 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:55.058712 29344 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:55.154547 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 95920.9us
I20260709 13:13:55.103791 29530 raft_consensus.cc:1240] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 16. Current term is 17. Ops: []
W20260709 13:13:55.106652 29375 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 1867) took 3086 ms (client timeout 1688 ms). Trace:
I20260709 13:13:54.939850  2537 consensus_queue.cc:1048] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.088s
I20260709 13:13:54.903698  2634 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:55.114462 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 348136us
I20260709 13:13:55.166482 29530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3941) took 1996 ms. Trace:
I20260709 13:13:55.159612 29344 leader_election.cc:304] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:55.166955 29530 rpcz_store.cc:276] 0709 13:13:53.170542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:54.440946 (+1270404us) service_pool.cc:224] Handling call
0709 13:13:55.103538 (+662592us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:55.156272 (+ 52734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:55.166252 (+  9980us) spinlock_profiling.cc:243] Waited 662 ms on lock 0x7b54003ab1d0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd858ad 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:55.166396 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1522921344}
I20260709 13:13:55.168154 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:55.168553 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:55.169823 29527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3929) took 2543 ms. Trace:
I20260709 13:13:55.169986 29528 raft_consensus.cc:1240] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:55.170506 29525 raft_consensus.cc:2410] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
W20260709 13:13:55.171826 29525 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37958 (request call id 2193) took 1754 ms (client timeout 2132 ms). Trace:
I20260709 13:13:55.136138  2481 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:13:55.172201 29525 rpcz_store.cc:269] 0709 13:13:53.417743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:53.911348 (+493605us) service_pool.cc:224] Handling call
0709 13:13:55.171639 (+1260291us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54002bb954. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:55.171771 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2893523712}
I20260709 13:13:55.172855  2481 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:55.170250 29527 rpcz_store.cc:276] 0709 13:13:52.626901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:54.261368 (+1634467us) service_pool.cc:224] Handling call
0709 13:13:54.261929 (+   561us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:54.298524 (+ 36595us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:54.298562 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:54.339127 (+ 40565us) log.cc:844] Serialized 26 byte log entry
0709 13:13:54.961543 (+622416us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:54.961611 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:54.961754 (+   143us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:55.169618 (+207864us) raft_consensus.cc:1685] finished
0709 13:13:55.169639 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:55.169763 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33960,"raft.queue_time_us":36907,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":34621,"thread_start_us":465394,"threads_started":1,"wal-append.queue_time_us":793626}
I20260709 13:13:55.175876  2574 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:55.176465  2574 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:55.176941  2574 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:55.113878  2565 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:55.189308 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:55.028618  2342 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:55.005741  2635 raft_consensus.cc:2749] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:55.142709 29521 rpcz_store.cc:276] 0709 13:13:52.061751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.560540 (+498789us) service_pool.cc:224] Handling call
0709 13:13:54.201161 (+1640621us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:54.212552 (+ 11391us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:55.085411 (+872859us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b5400133150. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd858ad 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:55.085587 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3709543296}
I20260709 13:13:55.195672 29346 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:55.201751 29521 raft_consensus.cc:1275] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:13:55.156754 29375 rpcz_store.cc:269] 0709 13:13:52.020514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.021251 (+   737us) service_pool.cc:224] Handling call
0709 13:13:55.106347 (+3085096us) spinlock_profiling.cc:243] Waited 2.11 s on lock 0x7b54003bbd54. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:55.106506 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4848316672}
I20260709 13:13:55.003784  2265 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:13:55.006263  2623 consensus_queue.cc:1048] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.119s
I20260709 13:13:55.213824 29522 raft_consensus.cc:2468] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
I20260709 13:13:55.214659 29530 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:13:55.120343  2515 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:55.136974  2627 consensus_queue.cc:1243] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer 183db85c071f489fbc8de63a9edd8a3a log is divergent from this leader: its last log entry 18.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:13:55.191107  2558 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:55.192252  2582 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.207070  2417 consensus_queue.cc:1048] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:55.208370 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:55.209400 29344 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:55.203408 29521 raft_consensus.cc:1240] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 LEADER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 20. Current term is 21. Ops: []
I20260709 13:13:55.195340 29421 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:55.220619 29346 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:55.222473 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 218312us
I20260709 13:13:55.187371  2576 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:55.198292  2448 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:55.241074 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 46140.9us
I20260709 13:13:55.241850 29521 raft_consensus.cc:1275] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:13:55.313333  2522 raft_consensus.cc:2804] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:55.296393  2624 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:55.225270  2513 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:55.212592  2144 consensus_queue.cc:1059] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 13:13:55.312410  2351 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:55.245170  2558 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:55.239830  2242 raft_consensus.cc:2749] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:13:55.293788  2577 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.246359  2582 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:55.215834  2647 consensus_queue.cc:1048] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 13:13:55.304828  2434 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:55.302614 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:55.291756 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:55.304386  2646 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:13:55.321918 29421 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:55.285356 29529 raft_consensus.cc:1240] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:55.284035  2635 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:55.296835 29523 raft_consensus.cc:1275] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:13:55.018652  2581 consensus_queue.cc:260] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:55.322901 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:55.322824 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
W20260709 13:13:55.313417  2648 log.cc:927] Time spent T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
W20260709 13:13:55.320753 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 195770us
I20260709 13:13:55.215900  2355 consensus_queue.cc:1059] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 13:13:55.216071  2450 raft_consensus.cc:2804] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:13:55.333613 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 429688us
W20260709 13:13:55.411479 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:55.336874 29521 pending_rounds.cc:85] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 8
W20260709 13:13:55.326043  2546 consensus_meta.cc:287] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 1.143s	user 0.011s	sys 0.005s
I20260709 13:13:55.320844  2628 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:55.393244 29526 raft_consensus.cc:1240] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 LEADER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:55.428160 29495 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:55.393748 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
W20260709 13:13:55.410032 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 192770us
W20260709 13:13:55.308060 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 297984us
I20260709 13:13:55.421182 29521 pending_rounds.cc:107] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:13:55.430249 29521 raft_consensus.cc:2889] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:55.421795 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:55.411962 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 90165.6us
I20260709 13:13:55.425822 29523 pending_rounds.cc:85] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 8
I20260709 13:13:55.432363 29523 pending_rounds.cc:107] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 16.9
W20260709 13:13:55.431476 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:55.432641 29523 raft_consensus.cc:2889] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:55.333694  2448 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:55.432176 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 202865us
I20260709 13:13:55.398770  2522 raft_consensus.cc:697] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:55.344553  2537 consensus_queue.cc:1059] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 13:13:55.441524 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:55.447609 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:55.408689  2513 raft_consensus.cc:3055] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:55.410152  2646 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:55.448361 29454 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:55.449855 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:55.436636  2651 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.503171 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:55.524820 29448 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:55.345623  2624 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:55.498544 30119 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:55.495186 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 64991.8us
I20260709 13:13:55.512720  2474 raft_consensus.cc:3055] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:13:55.531472  2474 raft_consensus.cc:740] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:13:55.428880  2450 raft_consensus.cc:493] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:13:55.438233  2434 raft_consensus.cc:2804] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:13:55.400270  2577 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:55.345108  2653 consensus_queue.cc:1048] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.100s
I20260709 13:13:55.514521 29455 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:13:55.511073 29346 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:55.518005 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:55.511729 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 81093.8us
I20260709 13:13:55.522714 29378 raft_consensus.cc:1240] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:13:55.424197  2451 raft_consensus.cc:2804] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:13:55.427750  2546 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:55.526122 29374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 938) took 1313 ms. Trace:
I20260709 13:13:55.493302  2581 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:55.451133  2628 consensus_queue.cc:1059] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 13:13:55.534565 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:55.514896  2515 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:55.516279  2513 raft_consensus.cc:740] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:13:55.540319 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 84597.3us
I20260709 13:13:55.536087  2338 raft_consensus.cc:2749] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:55.564544 29454 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
W20260709 13:13:55.539929 29495 connection.cc:256] RPC call timeout handler was delayed by -1.1996653849998893s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18230000000000002s for a response
I20260709 13:13:55.494711  2502 consensus_queue.cc:1059] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
W20260709 13:13:55.535938  2645 log.cc:927] Time spent T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
W20260709 13:13:55.576006 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 65054.8us
I20260709 13:13:55.574338  2356 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:55.519897  2646 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:55.613489 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:55.576128 29344 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:55.586598 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:55.588769 29447 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 15.
I20260709 13:13:55.495878  2662 consensus_queue.cc:1059] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.070s
W20260709 13:13:55.623195 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:55.623721  2497 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.598104 29448 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
I20260709 13:13:55.601603 29524 raft_consensus.cc:1240] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:13:55.603588 29346 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:55.575017 29374 rpcz_store.cc:276] 0709 13:13:54.212598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:54.213100 (+   502us) service_pool.cc:224] Handling call
0709 13:13:54.213505 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:54.683964 (+470459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:54.683997 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:54.741718 (+ 57721us) log.cc:844] Serialized 26 byte log entry
0709 13:13:54.964293 (+222575us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:54.964354 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:55.123564 (+159210us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b54003c4bd4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:55.123636 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:55.521714 (+398078us) raft_consensus.cc:1685] finished
0709 13:13:55.521746 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:55.526019 (+  4273us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6537,"raft.queue_time_us":8083,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":72672,"spinlock_wait_cycles":1062523648,"thread_start_us":179274,"threads_started":1,"wal-append.queue_time_us":341231}
I20260709 13:13:55.579000  2450 raft_consensus.cc:3060] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:55.573418  2434 raft_consensus.cc:697] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:55.610358 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:55.580916  2347 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:13:55.575102  2655 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:55.583294 29455 raft_consensus.cc:1275] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:13:55.616600 29454 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
I20260709 13:13:55.617616 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:13:55.584933  2456 consensus_queue.cc:1048] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:13:55.618906 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:55.619542  2546 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:55.553900  2351 consensus_queue.cc:1059] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:13:55.620664  2356 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:55.581249  2659 consensus_queue.cc:1059] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
W20260709 13:13:55.633426 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 139053us
I20260709 13:13:55.709792 29419 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:55.527993  2651 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:55.644479 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:55.610262  2628 consensus_queue.cc:1243] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer 183db85c071f489fbc8de63a9edd8a3a log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:13:55.692642  2558 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:55.584240  2666 consensus_queue.cc:1059] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:13:55.643582  2475 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.717844 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:55.737195 29525 raft_consensus.cc:2393] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 16: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:55.738165 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:55.639470  2325 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:55.642272  2502 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:55.774534  2659 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:55.830435  2355 raft_consensus.cc:3055] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:55.829787  2672 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:55.830642  2668 log.cc:927] Time spent T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
W20260709 13:13:55.776427 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 141602us
I20260709 13:13:55.780524  2558 raft_consensus.cc:2749] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:55.828331  2624 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:55.732609  2635 consensus_queue.cc:1059] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.070s
W20260709 13:13:55.831756  2660 log.cc:927] Time spent T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
I20260709 13:13:55.730434  2451 raft_consensus.cc:697] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 15 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:55.839352  2634 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:55.700399  2513 consensus_queue.cc:260] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:55.694180  2655 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:55.955307  2655 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:55.915089  2502 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:55.957604 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:55.958906  2502 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:55.958973 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:55.765413 29525 raft_consensus.cc:2393] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 15: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:55.931129  2448 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:55.581548  2522 consensus_queue.cc:237] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:55.609858  2474 consensus_queue.cc:260] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:55.831666 29526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3928) took 3677 ms. Trace:
W20260709 13:13:55.838191  2654 log.cc:927] Time spent T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.488s	user 0.002s	sys 0.000s
I20260709 13:13:55.787935 29495 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
W20260709 13:13:55.806429 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 230375us
I20260709 13:13:55.701433  2144 raft_consensus.cc:2804] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:13:55.774973  2475 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:55.775185  2325 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:55.933043 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 329569us
I20260709 13:13:55.933387  2577 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:55.935647 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:55.814131  2350 raft_consensus.cc:3055] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:13:55.986313 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:55.991396 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:55.897629  2517 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:55.950959  2565 raft_consensus.cc:3055] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:55.951577  2451 consensus_queue.cc:237] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:55.952956  2513 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:55.961433 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:55.785607  2434 consensus_queue.cc:237] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:55.966728 29527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3947) took 1369 ms. Trace:
W20260709 13:13:56.020116 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:56.026116 29527 rpcz_store.cc:276] 0709 13:13:54.596814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.174705 (+577891us) service_pool.cc:224] Handling call
0709 13:13:55.175061 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:55.181903 (+  6842us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:55.181955 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:55.182618 (+   663us) log.cc:844] Serialized 26 byte log entry
0709 13:13:55.426191 (+243573us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:13:55.426222 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:55.426279 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:55.959886 (+533607us) raft_consensus.cc:1685] finished
0709 13:13:55.959911 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:55.966625 (+  6714us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8385,"raft.queue_time_us":11448,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":15509,"thread_start_us":202189,"threads_started":1,"wal-append.queue_time_us":309026}
I20260709 13:13:56.028616 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:55.968250 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:55.643115  2497 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:55.907327  2355 raft_consensus.cc:740] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:56.033602  2355 consensus_queue.cc:260] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:55.976038 29526 rpcz_store.cc:276] 0709 13:13:52.154219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:54.186380 (+2032161us) service_pool.cc:224] Handling call
0709 13:13:54.186744 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:55.433601 (+1246857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:55.831355 (+397754us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b5400102cd4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:55.831598 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2774067072}
I20260709 13:13:56.034970  2355 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:55.974247 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:56.035212 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:55.941679  2678 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:56.036597 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:56.037372 29526 raft_consensus.cc:2393] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 12: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:56.037086  2678 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:56.038296 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:55.976590 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:56.041198 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:56.042361 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:55.984287 29346 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:55.990366 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 202550us
I20260709 13:13:56.044135 29378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52172 (request call id 2345) took 1489 ms. Trace:
W20260709 13:13:56.044497  2574 consensus_meta.cc:287] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.867s	user 0.009s	sys 0.006s
I20260709 13:13:56.000026  2691 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:56.045204  2691 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:56.044999  2574 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:56.045696  2691 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:56.046005 29530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37968 (request call id 3956) took 1020 ms. Trace:
W20260709 13:13:55.979667  2604 sasl_common.cc:323] Time spent creating new SASL kudu client: real 0.257s	user 0.001s	sys 0.001s
I20260709 13:13:56.030244 29527 raft_consensus.cc:2393] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 17: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:56.043380 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:56.029726 29521 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 17.
I20260709 13:13:56.044773 29495 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:56.048568 29525 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 15.
I20260709 13:13:56.032320 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:56.034101  2515 raft_consensus.cc:3055] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:55.947005  2576 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
W20260709 13:13:56.021401 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 83705.3us
I20260709 13:13:55.989821  2350 raft_consensus.cc:740] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:56.046473 29530 rpcz_store.cc:276] 0709 13:13:55.025493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.167978 (+142485us) service_pool.cc:224] Handling call
0709 13:13:56.045793 (+877815us) spinlock_profiling.cc:243] Waited 45.1 ms on lock 0x7b54000b72d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:56.045927 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103647104}
I20260709 13:13:56.058950 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:56.050765 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 66585.4us
I20260709 13:13:55.985790  2456 consensus_queue.cc:1059] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:13:56.068571 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:55.985752  2623 consensus_queue.cc:1059] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:13:56.044624 29378 rpcz_store.cc:276] 0709 13:13:54.554968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:54.555182 (+   214us) service_pool.cc:224] Handling call
0709 13:13:55.522078 (+966896us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:55.561263 (+ 39185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:56.043916 (+482653us) spinlock_profiling.cc:243] Waited 952 ms on lock 0x7b54003c4bd0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd858ad 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:56.044065 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2189359488}
I20260709 13:13:55.947132  2672 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:55.991854  2144 raft_consensus.cc:697] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:56.049612 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:56.087692 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:56.060585 29346 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:55.985519  2675 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:56.062077 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:56.064133 29344 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:56.048580 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:56.051998  2674 log.cc:927] Time spent T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:13:56.069555 29521 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:13:56.017601  2565 raft_consensus.cc:740] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:56.054286 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:55.996655  2351 consensus_queue.cc:1048] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:13:56.053454  2515 raft_consensus.cc:740] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:56.004534  2662 consensus_queue.cc:1048] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:13:56.056644  2573 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:56.052891  2466 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:56.060868  2546 consensus_queue.cc:1059] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:13:56.096099 29525 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:13:56.060271  2634 raft_consensus.cc:2749] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:13:56.095427 29526 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
W20260709 13:13:56.104290 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 43800.6us
I20260709 13:13:56.082831  2456 consensus_queue.cc:1243] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer 71aa3578fd924765ab9ac0729c8d1483 log is divergent from this leader: its last log entry 21.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:13:56.061379  2576 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:56.016049  2517 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:56.130544 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 66609.6us
I20260709 13:13:56.077998  2265 consensus_queue.cc:1059] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:13:56.137517 29346 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:56.070698  2502 consensus_queue.cc:1048] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:13:56.182565 29526 raft_consensus.cc:1275] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:13:56.087632  2450 raft_consensus.cc:515] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:56.193140  2456 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:56.104883  2675 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:56.197628  2675 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:56.199927 29521 raft_consensus.cc:1240] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:13:56.140436  2481 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:56.195262  2450 leader_election.cc:290] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Requested vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:56.210604  2672 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:56.219898  2691 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:56.222572  2691 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:56.231089  2342 consensus_meta.cc:287] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 1.013s	user 0.011s	sys 0.004s
I20260709 13:13:56.143445  2689 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:56.131986  2466 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:56.145155  2576 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:56.145641 29522 raft_consensus.cc:2468] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 9.
W20260709 13:13:56.146098 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:56.111837  2686 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:56.139320  2475 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:56.115988  2678 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:56.139043  2144 consensus_queue.cc:237] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:56.189409  2646 consensus_meta.cc:287] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.567s	user 0.012s	sys 0.005s
I20260709 13:13:56.175966  2680 raft_consensus.cc:2804] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:13:56.192250  2683 log.cc:927] Time spent T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:13:56.126575  2356 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:56.233806  2351 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.233915  2565 consensus_queue.cc:260] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:56.236090  2515 consensus_queue.cc:260] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:56.237102  2657 log.cc:927] Time spent T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.712s	user 0.002s	sys 0.000s
I20260709 13:13:56.240118  2634 consensus_queue.cc:1059] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:56.243927 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:56.244513  2644 raft_consensus.cc:3055] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:13:56.141391  2681 log.cc:927] Time spent T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:13:56.141412  2574 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:56.251113  2672 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:13:56.266873  2661 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.007s	sys 0.004s
I20260709 13:13:56.268013  2680 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:56.347693  2661 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.008s	sys 0.004s
I20260709 13:13:56.316129  2644 raft_consensus.cc:740] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:56.270841  2646 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:56.370537  2644 consensus_queue.cc:260] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:56.351181  2672 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:56.371889  2644 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:13:56.360692  2664 log.cc:927] Time spent T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.775s	user 0.002s	sys 0.000s
I20260709 13:13:56.262210  2686 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:56.352635  2680 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:56.377982  2686 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:56.378187  2659 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:56.380625  2646 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:56.381932  2651 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:56.375918  2672 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:56.192349 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 54967.8us
W20260709 13:13:56.433900 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:56.434615 29346 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:13:56.437077 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 180438us
I20260709 13:13:56.447793 29346 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:56.458346 29344 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:56.460675 29344 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:56.462153 29344 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:56.464946 29327 auto_rebalancer.cc:629] Failed to schedule move for tablet 843654f7a60942bd9feee060ac9d2dfe: Illegal state: Replica 429e58eb058349e3bf72b5a870c8f6e5 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
W20260709 13:13:56.465741 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:56.466394 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:56.241747 29526 raft_consensus.cc:1275] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 13:13:56.468045 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 357313us
I20260709 13:13:56.470757 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:56.472857 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:56.474051 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:56.476033 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:56.486801 29453 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:13:56.488552 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:56.491317 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:56.492702 29452 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 15.
I20260709 13:13:56.307508  2351 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:56.256340  2342 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:56.508096  2450 raft_consensus.cc:2749] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:56.509745  2450 raft_consensus.cc:2804] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:13:56.249233 29530 raft_consensus.cc:1240] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:56.510737  2450 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.520340 29528 raft_consensus.cc:1240] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:13:56.520618  2513 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:56.360497  2517 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:56.521369  2513 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.521979  2513 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:56.523433  2573 raft_consensus.cc:2804] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:56.524101  2573 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.524570  2573 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:56.529234  2574 consensus_queue.cc:1048] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:56.524430  2522 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:56.531409  2522 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.532058  2522 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:13:56.534081  2581 consensus_meta.cc:287] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.950s	user 0.010s	sys 0.006s
I20260709 13:13:56.484130 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:56.482751 29451 raft_consensus.cc:1275] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 21 index: 9. (index mismatch)
W20260709 13:13:56.257688 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 173039us
I20260709 13:13:56.509933  2497 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:56.476903 29346 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:56.511358  2450 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:56.544013 29450 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:56.548749  2689 raft_consensus.cc:2804] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:56.553364  2659 consensus_queue.cc:1048] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:56.557965  2672 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:56.551782  2689 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.540202  2649 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.563475  2646 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:56.572291  2649 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:56.572531  2646 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:56.556687  2661 consensus_queue.cc:1048] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
W20260709 13:13:56.575822 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:56.576143 29527 raft_consensus.cc:1275] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:13:56.576576  2646 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:56.576954  2689 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:56.568648 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
W20260709 13:13:56.579771 29327 auto_rebalancer.cc:629] Failed to schedule move for tablet ab0baf9ea21a4fe78401601893e7ff66: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:13:56.589110 29529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3931) took 3423 ms. Trace:
I20260709 13:13:56.589809 29529 rpcz_store.cc:276] 0709 13:13:53.165890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:54.389022 (+1223132us) service_pool.cc:224] Handling call
0709 13:13:54.389489 (+   467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:55.409297 (+1019808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:56.588327 (+1179030us) spinlock_profiling.cc:243] Waited 896 ms on lock 0x7b540019ee54. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:56.588855 (+   528us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2059811584}
W20260709 13:13:56.595932 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:56.600782  2347 raft_consensus.cc:3055] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:13:56.601461  2347 raft_consensus.cc:740] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:56.605362  2342 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:56.606381  2558 raft_consensus.cc:3055] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:13:56.615657 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 139028us
W20260709 13:13:56.621083 29327 auto_rebalancer.cc:629] Failed to schedule move for tablet 66ee3283bb6d4ef28061d053b1bde164: Illegal state: Replica 429e58eb058349e3bf72b5a870c8f6e5 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 21 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:13:56.622339 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:56.617746  2558 raft_consensus.cc:740] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:56.628455 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
W20260709 13:13:56.629241 29419 leader_election.cc:336] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.921s (SENT)
I20260709 13:13:56.629930 29419 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:56.629088  2558 consensus_queue.cc:260] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:56.631733  2686 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:56.583335  2672 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:56.605131  2347 consensus_queue.cc:260] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:56.646143  2565 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:56.646515  2647 raft_consensus.cc:3055] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:13:56.647148  2647 raft_consensus.cc:740] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:56.646734  2625 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:56.665457 29529 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:13:56.669085 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:13:56.670449  2680 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:56.673645  2680 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:56.675737  2650 log.cc:927] Time spent T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 1.241s	user 0.002s	sys 0.003s
I20260709 13:13:56.679526 29376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 945) took 1765 ms. Trace:
I20260709 13:13:56.681185  2351 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:56.680155 29376 rpcz_store.cc:276] 0709 13:13:54.914071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:54.919621 (+  5550us) service_pool.cc:224] Handling call
0709 13:13:54.920133 (+   512us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:54.940838 (+ 20705us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:54.940874 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:54.941518 (+   644us) log.cc:844] Serialized 26 byte log entry
0709 13:13:55.223808 (+282290us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:13:55.223852 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:55.223928 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:56.658152 (+1434224us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:13:56.678773 (+ 20621us) raft_consensus.cc:1685] finished
0709 13:13:56.678816 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:56.679243 (+   427us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32091,"raft.queue_time_us":30381,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":37160,"spinlock_wait_cycles":340398464,"thread_start_us":281838,"threads_started":1,"wal-append.queue_time_us":453934}
I20260709 13:13:56.686183  2672 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:56.687132  2456 consensus_queue.cc:1059] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:13:56.688750  2351 raft_consensus.cc:3055] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:56.689226  2351 raft_consensus.cc:740] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:56.663911  2558 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:56.704416 30122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:56.706640 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 49093.7us
W20260709 13:13:56.700441 29456 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.011s	sys 0.003s
W20260709 13:13:56.717528 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:56.690740  2351 consensus_queue.cc:260] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:56.722023  2347 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:13:56.722929 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
W20260709 13:13:56.726712 29456 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.012s	sys 0.003s
I20260709 13:13:56.727819  2634 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:13:56.718746 29493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 74068.9us
I20260709 13:13:56.732091 29344 leader_election.cc:304] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:13:56.740938 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:56.764600  2634 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:56.740366  2450 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:56.773205  2634 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:56.783787 29522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37958 (request call id 2209) took 1150 ms. Trace:
W20260709 13:13:56.787160 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 75897.2us
I20260709 13:13:56.784296 29522 rpcz_store.cc:276] 0709 13:13:55.627168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.973883 (+346715us) service_pool.cc:224] Handling call
0709 13:13:56.762299 (+788416us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54002319d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:56.777258 (+ 14959us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":252525312}
I20260709 13:13:56.785280 29456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 571) took 1061 ms. Trace:
W20260709 13:13:56.790669  2653 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.009s	sys 0.017s
I20260709 13:13:56.789230 29456 rpcz_store.cc:276] 0709 13:13:55.720641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.720836 (+   195us) service_pool.cc:224] Handling call
0709 13:13:55.768953 (+ 48117us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:55.980094 (+211141us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:13:55.980167 (+    73us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:55.980860 (+   693us) log.cc:844] Serialized 26 byte log entry
0709 13:13:56.753054 (+772194us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:56.761272 (+  8218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:56.768474 (+  7202us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:56.771342 (+  2868us) raft_consensus.cc:1685] finished
0709 13:13:56.771353 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:56.782316 (+ 10963us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10915,"raft.queue_time_us":204103,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":6805,"thread_start_us":950619,"threads_started":2,"wal-append.queue_time_us":628886}
I20260709 13:13:56.810369  2702 raft_consensus.cc:3055] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:56.811048  2702 raft_consensus.cc:740] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
W20260709 13:13:56.802717  2653 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.010s	sys 0.018s
I20260709 13:13:56.791785  2689 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:56.806137  2351 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:56.805383  2522 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:56.831725 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:56.834682  2450 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:56.836023 29524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3945) took 2239 ms. Trace:
W20260709 13:13:56.833739  2713 log.cc:927] Time spent T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:13:56.831753 29344 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:56.845657 29450 raft_consensus.cc:2410] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:13:56.846873 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:13:56.842917 29524 rpcz_store.cc:276] 0709 13:13:54.596220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.169324 (+573104us) service_pool.cc:224] Handling call
0709 13:13:55.169679 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:55.625247 (+455568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:56.824874 (+1199627us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b54003039d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:56.835734 (+ 10860us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":992683264}
I20260709 13:13:56.855513  2578 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:13:56.859130 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:56.863833  2582 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:56.843170  2144 raft_consensus.cc:2749] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:13:56.868520 29448 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:56.846716  2456 raft_consensus.cc:2804] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:56.871136  2242 raft_consensus.cc:3055] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:56.877576 29527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 2210) took 1250 ms. Trace:
I20260709 13:13:56.857247  2649 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:56.880548 29527 rpcz_store.cc:276] 0709 13:13:55.627459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:56.112092 (+484633us) service_pool.cc:224] Handling call
0709 13:13:56.112451 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:56.576650 (+464199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:56.871823 (+295173us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b54000b7cd4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:56.877472 (+  5649us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1064350592}
I20260709 13:13:56.880388  2242 raft_consensus.cc:740] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:56.872452  2456 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:56.907572 29453 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16.
I20260709 13:13:56.909648  2573 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:56.888676  2466 consensus_meta.cc:287] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.565s	user 0.012s	sys 0.006s
I20260709 13:13:56.942638  2466 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:56.912614  2689 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:56.913038  2702 consensus_queue.cc:260] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:56.932771 29528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3946) took 2336 ms. Trace:
I20260709 13:13:56.934338  2450 consensus_queue.cc:1059] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:13:56.937150  2515 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:56.938076 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:56.939411  2647 consensus_queue.cc:260] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 20.9, Last appended by leader: 9, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:56.940353 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:56.960744  2573 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:56.956161 29528 rpcz_store.cc:276] 0709 13:13:54.596525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.171327 (+574802us) service_pool.cc:224] Handling call
0709 13:13:55.171670 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:56.521163 (+1349493us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:56.932411 (+411248us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b5400303ed4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:56.932696 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3099773696}
I20260709 13:13:56.974442 29450 raft_consensus.cc:1240] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 18 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:56.976727  2242 consensus_queue.cc:260] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:56.918097  2456 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:56.978015 29447 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45796 (request call id 2050) took 1444 ms (client timeout 1794 ms). Trace:
W20260709 13:13:56.985052  2717 log.cc:927] Time spent T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 13:13:56.986058 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:56.986753  2644 consensus_queue.cc:1059] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.142s
I20260709 13:13:56.987131 29529 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:56.988037  2647 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:56.988245  2644 raft_consensus.cc:3055] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:13:56.988850  2644 raft_consensus.cc:740] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:56.994333  2702 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:56.981972 29447 rpcz_store.cc:269] 0709 13:13:55.533986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.534174 (+   188us) service_pool.cc:224] Handling call
0709 13:13:56.977608 (+1443434us) spinlock_profiling.cc:243] Waited 3.98 ms on lock 0x7b5400290ed4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:56.977786 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9152384}
W20260709 13:13:56.999719 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:56.986977  2242 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:57.004848 29526 raft_consensus.cc:1240] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:56.990623  2644 consensus_queue.cc:260] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:57.039518 29530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 2202) took 1414 ms. Trace:
I20260709 13:13:57.039824  2466 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:57.040036 29530 rpcz_store.cc:276] 0709 13:13:55.625191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:56.095283 (+470092us) service_pool.cc:224] Handling call
0709 13:13:56.095657 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:56.511135 (+415478us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:57.039006 (+527871us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b54003043d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:57.039295 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":352627968}
I20260709 13:13:57.041847 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:57.044350 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:57.006994  2689 raft_consensus.cc:3055] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:57.047930 29523 raft_consensus.cc:1275] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:13:57.020569  2522 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:57.090200 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:57.091238 29523 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 3962) took 1103 ms. Trace:
I20260709 13:13:57.091881 29451 raft_consensus.cc:2410] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:13:57.053753 29378 raft_consensus.cc:1240] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:13:57.054381  2325 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:57.037964  2474 raft_consensus.cc:3060] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:13:56.978609  2493 ts_tablet_manager.cc:1929] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.7
I20260709 13:13:57.067523 30156 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54234 (request call id 320) took 1467 ms. Trace:
I20260709 13:13:57.069696 29525 raft_consensus.cc:3055] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:13:57.072137  2350 consensus_queue.cc:260] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:57.078485 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:57.080947 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.082896 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:13:57.083715  2535 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.181s	user 0.010s	sys 0.018s
W20260709 13:13:57.086104  2676 log.cc:927] Time spent T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 1.255s	user 0.000s	sys 0.004s
I20260709 13:13:57.087901  2659 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.088587 29528 raft_consensus.cc:1240] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:57.048827  2689 raft_consensus.cc:740] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:57.074980 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:57.091746 29523 rpcz_store.cc:276] 0709 13:13:55.988042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:56.474285 (+486243us) service_pool.cc:224] Handling call
0709 13:13:57.043596 (+569311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:57.048914 (+  5318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:57.090924 (+ 42010us) spinlock_profiling.cc:243] Waited 568 ms on lock 0x7b54003043d0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd858ad 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:57.091164 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1307535104}
I20260709 13:13:57.100380 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:57.100692  2644 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:57.100399 29454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36436 (request call id 573) took 1376 ms. Trace:
I20260709 13:13:57.102234 29525 raft_consensus.cc:740] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
W20260709 13:13:57.104552 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.101713 30156 rpcz_store.cc:276] 0709 13:13:55.599737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.599890 (+   153us) service_pool.cc:224] Handling call
0709 13:13:55.617862 (+ 17972us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:55.635852 (+ 17990us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:55.635903 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:13:55.635964 (+    61us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:55.636022 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:57.066850 (+1430828us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b5400510254. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:57.066941 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:57.067216 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40716160}
W20260709 13:13:57.111754 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.022995  2513 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:57.112831  2573 consensus_queue.cc:1059] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:13:57.122184 29530 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:13:57.115020  2535 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.283s	user 0.010s	sys 0.019s
W20260709 13:13:57.129455 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.129479  2659 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:57.135711 29526 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:57.136734 29521 raft_consensus.cc:1275] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:13:57.137055  2659 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:57.138223 29521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 2222) took 1359 ms. Trace:
I20260709 13:13:57.138648 29521 rpcz_store.cc:276] 0709 13:13:55.778389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:56.202919 (+424530us) service_pool.cc:224] Handling call
0709 13:13:56.203347 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:57.137183 (+933836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:57.137898 (+   715us) spinlock_profiling.cc:243] Waited 933 ms on lock 0x7b54000faad4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:57.138158 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2144813952}
I20260709 13:13:57.117900  2493 log.cc:1199] T 95122b0f733946aba19edf1d98467467 P 183db85c071f489fbc8de63a9edd8a3a: Deleting WAL directory at /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/ts-1-root/wals/95122b0f733946aba19edf1d98467467
I20260709 13:13:57.115547 29454 rpcz_store.cc:276] 0709 13:13:55.723572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.724226 (+   654us) service_pool.cc:224] Handling call
0709 13:13:55.724704 (+   478us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:56.111727 (+387023us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:56.111762 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:56.112311 (+   549us) log.cc:844] Serialized 26 byte log entry
0709 13:13:56.846485 (+734174us) spinlock_profiling.cc:243] Waited 9.08 ms on lock 0x7b1800045400. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c7be07 00007f6a81ad6ab9 00007f6a78c9869b 00007f6a78c9693f 00007f6a78c98c02 00007f6a7b92020b 00007f6a7b925d23 00007f6a7b9260d1 00007f6a7bd41a0f
0709 13:13:56.981103 (+134618us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:13:56.981173 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:57.060664 (+ 79491us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b54002530d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:57.060741 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:57.082630 (+ 21889us) spinlock_profiling.cc:243] Waited 3.11 ms on lock 0x7b540026b9a0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bcfbdbe 00007f6a7bd06930 00007f6a7bd068d8 00007f6a7bd06858 00007f6a7bd06813 00007f6a7bd05a9c 00007f6a81bf1626 00007f6a81bebdd8 00007f6a7bd427cb 00007f6a7bd452c0
0709 13:13:57.095662 (+ 13032us) raft_consensus.cc:1685] finished
0709 13:13:57.095686 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:57.100136 (+  4450us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":212,"raft.queue_time_us":647,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":7398,"spinlock_wait_cycles":916442112,"thread_start_us":71339,"threads_started":1,"wal-append.queue_time_us":854865}
I20260709 13:13:57.145021  2623 consensus_queue.cc:1059] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:13:57.143661 29419 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:57.147579 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:57.127943  2350 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:57.166446 29524 raft_consensus.cc:1240] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:57.159045  2643 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:57.171810  2448 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:57.172400  2448 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:57.171998  2643 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:57.172885  2448 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:57.172582 29449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2048) took 1657 ms. Trace:
I20260709 13:13:57.174834  2643 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:57.176222  2653 raft_consensus.cc:3055] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:13:57.176455 29525 consensus_queue.cc:260] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:57.185748 29529 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:13:57.178287 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:57.160249  2574 raft_consensus.cc:3055] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:57.171041  2493 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35524 (request call id 0) took 6811 ms. Trace:
I20260709 13:13:57.189711 29525 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:57.191138 29528 raft_consensus.cc:1240] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 16. Current term is 17. Ops: []
W20260709 13:13:57.191385 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.187187 29453 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:13:57.168565  2513 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:57.184204  2653 raft_consensus.cc:740] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:13:57.195338  2689 consensus_queue.cc:260] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:57.192199  2493 rpcz_store.cc:276] 0709 13:13:50.384217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:50.447669 (+ 63452us) service_pool.cc:224] Handling call
0709 13:13:51.018975 (+571306us) ts_tablet_manager.cc:1151] Deleting tablet 95122b0f733946aba19edf1d98467467
0709 13:13:51.021492 (+  2517us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:13:56.082976 (+5061484us) tablet_metadata.cc:665] Metadata flushed
0709 13:13:56.825382 (+742406us) tablet_metadata.cc:665] Metadata flushed
0709 13:13:57.170910 (+345528us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2775587,"tablet-delete.queue_time_us":360598,"thread_start_us":269072,"threads_started":1}
I20260709 13:13:57.203022 29522 raft_consensus.cc:1275] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:13:57.204908 29265 catalog_manager.cc:5028] TS 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): tablet 95122b0f733946aba19edf1d98467467 (table test-workload [id=364c32d53f7748a2857a4a9acd17c671]) successfully deleted
I20260709 13:13:57.174507 29449 rpcz_store.cc:276] 0709 13:13:55.515379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.515563 (+   184us) service_pool.cc:224] Handling call
0709 13:13:55.515951 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:13:55.520623 (+  4672us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:13:55.520675 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:13:55.521333 (+   658us) log.cc:844] Serialized 26 byte log entry
0709 13:13:55.722928 (+201595us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:13:55.722979 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:55.723056 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:13:57.084986 (+1361930us) spinlock_profiling.cc:243] Waited 9.91 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:13:57.172081 (+ 87095us) raft_consensus.cc:1685] finished
0709 13:13:57.172110 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:13:57.172398 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5910,"raft.queue_time_us":7997,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":7643,"spinlock_wait_cycles":22797568,"thread_start_us":191548,"threads_started":1,"wal-append.queue_time_us":257345}
I20260709 13:13:57.188344  2574 raft_consensus.cc:740] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:57.224888  2582 consensus_queue.cc:1059] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:13:57.226778 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.227079  2582 raft_consensus.cc:3055] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:13:57.208844  2573 consensus_queue.cc:1059] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:13:57.279771 29526 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 18.
I20260709 13:13:57.242077  2582 raft_consensus.cc:740] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:57.288695 29530 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:13:57.294524  2582 consensus_queue.cc:260] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:57.296368  2582 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:13:57.296617  2513 consensus_queue.cc:1059] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:13:57.297824  2513 raft_consensus.cc:3055] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:13:57.298187  2513 raft_consensus.cc:740] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:57.289273  2689 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:57.301074 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:57.302161  2522 consensus_queue.cc:1048] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:13:57.307121 29525 raft_consensus.cc:1275] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:13:57.317544  2586 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 13:13:57.308591  2456 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:57.318645  2448 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:57.319296  2653 consensus_queue.cc:260] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:57.321027  2456 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:57.319782  2726 log.cc:927] Time spent T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
W20260709 13:13:57.322150  2725 log.cc:927] Time spent T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:13:57.302151  2646 raft_consensus.cc:3055] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:13:57.322860 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.322570  2574 consensus_queue.cc:260] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:57.327813 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.328347  2574 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:57.328575 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:57.328992 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.317576 29525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 2213) took 1687 ms. Trace:
I20260709 13:13:57.332334 29525 rpcz_store.cc:276] 0709 13:13:55.630381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:56.134695 (+504314us) service_pool.cc:224] Handling call
0709 13:13:56.135170 (+   475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:13:57.069418 (+934248us) spinlock_profiling.cc:243] Waited 99.6 ms on lock 0x7b540010ff20. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bcfddc0 00007f6a7bd881c0 00007f6a7bd89231 00007f6a7bd85d8f 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c
0709 13:13:57.316395 (+246977us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:13:57.317500 (+  1105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":229009152}
W20260709 13:13:57.336917 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.299192  2513 consensus_queue.cc:260] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:57.323346  2653 raft_consensus.cc:3060] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:13:57.332146  2646 raft_consensus.cc:740] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:57.343659 29344 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:57.351482 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.342543 29276 catalog_manager.cc:5697] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:57.358697 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:57.356833  2573 raft_consensus.cc:2804] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:57.362627  2666 consensus_queue.cc:1048] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:13:57.366143  2558 consensus_queue.cc:1048] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:13:57.362650  2573 raft_consensus.cc:697] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:57.385818 29344 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:57.388099 30153 raft_consensus.cc:2410] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:13:57.387425 29421 leader_election.cc:336] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.639s (SENT)
I20260709 13:13:57.390429 29344 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:57.397271 29421 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:57.393585  2716 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.379832  2456 consensus_queue.cc:1048] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:13:57.394055  2242 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:57.396157  2448 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:57.398090  2513 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:57.403586  2347 raft_consensus.cc:2804] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:13:57.411185 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:57.417088 29447 raft_consensus.cc:1240] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:57.419633 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:57.420204 29529 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:57.421067 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.421559 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:57.419975 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:57.415162  2558 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.426129  2558 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:57.419118  2450 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.419410  2347 raft_consensus.cc:697] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:57.406930  2716 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:57.427193  2450 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:57.428879  2347 consensus_queue.cc:237] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:57.414927  2242 raft_consensus.cc:697] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:57.430424  2450 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:57.402107  2573 consensus_queue.cc:237] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:57.432392  2242 consensus_queue.cc:237] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:57.433266 30153 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54234 (request call id 319) took 1841 ms (client timeout 1551 ms). Trace:
W20260709 13:13:57.433904 30153 rpcz_store.cc:269] 0709 13:13:55.591862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:55.595661 (+  3799us) service_pool.cc:224] Handling call
0709 13:13:57.432966 (+1837305us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b54005d02d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:13:57.433173 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3880458624}
I20260709 13:13:57.439769 29521 raft_consensus.cc:2410] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:13:57.439888 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:57.445283 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:57.452080 29527 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:57.455717 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:57.456717 29522 raft_consensus.cc:2410] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:13:57.457858  2558 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:57.424108  2644 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:13:57.410312  2646 consensus_queue.cc:260] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:57.441968  2659 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:57.474006 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 91151.8us
W20260709 13:13:57.494769 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.495734 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:57.504742 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.496371 29449 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
W20260709 13:13:57.506546 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:57.506810 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.508674  2716 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:57.510468 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:57.520813 30121 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:57.522042 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 54656.2us
I20260709 13:13:57.524670  2623 raft_consensus.cc:2749] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:13:57.491979  2144 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.526147  2144 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:57.527426  2646 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:57.528636  2144 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:57.529758 29276 catalog_manager.cc:5697] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 12 to 13, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132). New cstate: current_term: 13 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:57.531651 29276 catalog_manager.cc:5697] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 11 to 14, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132). New cstate: current_term: 14 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:57.535938  2558 consensus_queue.cc:1048] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:13:57.533412 29276 catalog_manager.cc:5697] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:57.537740 29276 catalog_manager.cc:5697] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 8 to 9, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132). New cstate: current_term: 9 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:57.541103 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:57.541591 29529 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:13:57.542166 29451 raft_consensus.cc:2468] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 8.
I20260709 13:13:57.544106 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:57.549031 30121 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:57.547837 29447 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:13:57.540215  2558 consensus_queue.cc:1048] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:13:57.557904 29527 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 18.
I20260709 13:13:57.506711  2644 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:13:57.563230 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.563336 29344 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:57.571872 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:57.499784  2659 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:57.574059 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.576668  2351 raft_consensus.cc:2804] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:57.577316  2351 raft_consensus.cc:697] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:57.578341  2351 consensus_queue.cc:237] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:57.585224 29521 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:13:57.558215  2716 raft_consensus.cc:2804] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:13:57.589800  2647 consensus_meta.cc:287] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.601s	user 0.009s	sys 0.003s
I20260709 13:13:57.590817  2716 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:57.591430  2716 raft_consensus.cc:3060] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:57.594885 29449 raft_consensus.cc:1240] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:13:57.595862 29454 raft_consensus.cc:1240] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:57.597783 29448 raft_consensus.cc:1240] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:13:57.598384 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:57.594874 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:57.599974 29451 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:13:57.601554  2659 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:57.579977 29344 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:57.596169 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:57.611604 29276 catalog_manager.cc:5697] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:57.621794 29276 catalog_manager.cc:5697] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:13:57.635848 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 70664.2us
I20260709 13:13:57.639219 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:57.636518 29344 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:57.637708  2582 consensus_queue.cc:1048] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:13:57.645576 29449 raft_consensus.cc:1240] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 20. Current term is 21. Ops: [20.9-20.9]
I20260709 13:13:57.634305  2647 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:57.652011  2647 raft_consensus.cc:697] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:13:57.655970 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.574191  2644 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:57.662242 29276 catalog_manager.cc:5697] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 6 to 7, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132). New cstate: current_term: 7 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:13:57.665320  2558 consensus_queue.cc:1059] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:57.666870  2558 consensus_queue.cc:1243] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer 429e58eb058349e3bf72b5a870c8f6e5 log is divergent from this leader: its last log entry 17.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:13:57.660705  2347 raft_consensus.cc:2804] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:57.667810  2347 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.668300  2347 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:57.674587  2647 consensus_queue.cc:237] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:57.681682 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:57.685003  2558 raft_consensus.cc:3055] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:57.685698  2558 raft_consensus.cc:740] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:57.687798  2558 consensus_queue.cc:260] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:57.691677  2558 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:57.688946 29449 raft_consensus.cc:1240] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 16. Current term is 17. Ops: []
W20260709 13:13:57.689055 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.698518  2644 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:57.699326  2522 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.700006  2522 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:57.700901 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:57.699337 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.695637  2716 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:13:57.719125 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.722687 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:57.725260 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:57.725888 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:57.726470 29449 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:13:57.730701 29447 raft_consensus.cc:2410] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:13:57.730553 30154 raft_consensus.cc:1240] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:13:57.738545  2522 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:57.742410  2702 consensus_queue.cc:1059] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:13:57.743304  2702 consensus_queue.cc:1243] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer ca041dab9b2f44409ed7bf4c6cf66ab2 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:13:57.744230  2434 raft_consensus.cc:3055] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:13:57.744616  2434 raft_consensus.cc:740] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:57.745937  2434 consensus_queue.cc:260] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:57.747776  2434 raft_consensus.cc:3060] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:57.748281 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:57.751619 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:57.751909 29447 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:13:57.752607 29380 raft_consensus.cc:2393] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 13: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:57.752699 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:57.753795  2716 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:57.754729 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:57.754925 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:57.751955 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:57.751260 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:13:57.742444 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.749044 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:57.749871 29375 raft_consensus.cc:1217] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Deduplicated request from leader. Original: 14.8->[16.9-16.9]   Dedup: 16.9->[]
I20260709 13:13:57.760497 29375 raft_consensus.cc:1240] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:13:57.766314 29372 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 15.
W20260709 13:13:57.768968 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.778111 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:57.781687 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:57.779711 29522 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:13:57.784194 29449 raft_consensus.cc:2410] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 21 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:13:57.786440 29379 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 22.
I20260709 13:13:57.789296 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:57.775163  2350 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:57.798219 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:57.796241 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:57.799715 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.799784 29379 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 15.
I20260709 13:13:57.788205  2689 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.803673 29344 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:57.806546 29495 leader_election.cc:336] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.688s (SENT)
I20260709 13:13:57.806540 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:57.808585 29495 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:13:57.809408  2689 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:57.814495 29376 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
I20260709 13:13:57.816286  2689 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:57.817018 29372 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 18.
I20260709 13:13:57.820204 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:57.821269 29453 raft_consensus.cc:3060] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:13:57.825148  2689 raft_consensus.cc:2804] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:57.825683  2689 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:57.826094  2689 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:57.831703 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:57.831427  2350 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:57.836344  2350 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:57.839831 29380 raft_consensus.cc:2410] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
W20260709 13:13:57.842612 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:57.843830 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.842350 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:57.844882 29529 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
I20260709 13:13:57.846302 29521 raft_consensus.cc:2410] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ca041dab9b2f44409ed7bf4c6cf66ab2 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:13:57.848245 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:57.851624 29379 raft_consensus.cc:1240] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:57.852188 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:57.852649 29373 raft_consensus.cc:1240] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 20. Current term is 21. Ops: [18.10-20.11]
I20260709 13:13:57.852698 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:57.853847 29380 raft_consensus.cc:2410] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:13:57.853063 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:57.854629 29372 raft_consensus.cc:2393] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 16: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
W20260709 13:13:57.856628 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.844419  2347 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:57.864939 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:57.865607 29374 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:13:57.868723 29344 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:57.852941 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:57.871300  2515 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:13:57.875419 29381 raft_consensus.cc:2410] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:13:57.890726 29378 raft_consensus.cc:2393] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 17: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:57.880056  2659 raft_consensus.cc:2804] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:57.902566  2659 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:57.903148 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.903106  2659 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:57.914546 29451 raft_consensus.cc:1275] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 13:13:57.915562 29451 pending_rounds.cc:85] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 10
I20260709 13:13:57.916105 29451 pending_rounds.cc:107] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:13:57.916527 29451 raft_consensus.cc:2889] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:57.923990 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:57.928639 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:57.929085  2347 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:57.929572 29378 raft_consensus.cc:2368] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 19. Current term is 20.
I20260709 13:13:57.930015 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:57.929405 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:57.932762 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:57.933578 29376 raft_consensus.cc:2410] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:13:57.928964 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:57.913304  2659 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:57.937551 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:57.938350 29376 raft_consensus.cc:2368] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 16. Current term is 17.
W20260709 13:13:57.940531  2739 log.cc:927] Time spent T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 13:13:57.942687  2522 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:57.943284  2522 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:57.944859 29521 raft_consensus.cc:1275] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:13:57.945542  2522 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:57.945672 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:57.946244 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:57.950260 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 150010us
I20260709 13:13:57.960390 29522 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:57.956105  2456 consensus_queue.cc:1048] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:13:57.958504  2741 log.cc:927] Time spent T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.082s	user 0.003s	sys 0.000s
I20260709 13:13:57.970391 29453 raft_consensus.cc:2468] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 9.
W20260709 13:13:57.972167 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 52301us
W20260709 13:13:57.974993 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.974874 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:57.976830 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:57.979318 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:57.979228 29521 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:13:57.958014  2689 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:57.986609 29344 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:57.989697 29381 raft_consensus.cc:1275] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:13:57.999652 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:58.001578 29376 raft_consensus.cc:1275] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:13:58.002526 29523 raft_consensus.cc:1275] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:13:58.006304 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:58.006937 29521 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:13:58.000878  2513 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:57.996655  2659 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:58.006217  2702 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.012393  2702 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:58.014452 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:58.016944 29378 raft_consensus.cc:2393] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 21: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:58.016839 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:58.017064 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:58.017828 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:58.018327 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:58.026767 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:58.014816 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:58.028226 29373 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 17.
I20260709 13:13:58.027025 29379 raft_consensus.cc:2368] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 17. Current term is 18.
I20260709 13:13:58.030136 29378 raft_consensus.cc:2368] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 16. Current term is 17.
I20260709 13:13:58.030797 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:58.031138 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:58.029574 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:58.014039 29377 raft_consensus.cc:1275] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:13:58.015910 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:58.032666 29373 raft_consensus.cc:2410] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:13:58.033222 29372 raft_consensus.cc:2393] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 15: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:58.032044 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:58.032255 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:58.035616 29379 raft_consensus.cc:2393] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 17: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:58.016009 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:58.036588 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:58.017968 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:58.034117 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:58.034807 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:58.043933 29495 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:58.055857 29379 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 15.
I20260709 13:13:58.015710 29380 raft_consensus.cc:1240] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 15. Current term is 16. Ops: []
W20260709 13:13:58.056871 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:58.036813 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:58.033754 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:58.061117 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:58.016065 29376 raft_consensus.cc:1240] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 16. Current term is 17. Ops: []
I20260709 13:13:58.060632 29377 raft_consensus.cc:2410] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:13:58.062366 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:58.062963 29376 raft_consensus.cc:2368] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 19. Current term is 20.
I20260709 13:13:58.032061 29378 raft_consensus.cc:2393] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 22: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:13:58.064261  2747 log.cc:927] Time spent T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:13:58.010972  2513 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.066475 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:58.067452 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:58.067942 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:58.069460 29522 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:13:58.015448  2702 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:58.076419 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:58.073249 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:58.077355 29374 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 17.
I20260709 13:13:58.066344  2515 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:58.079718  2515 raft_consensus.cc:697] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:13:58.080718  2515 consensus_queue.cc:237] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:58.082113 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:58.084481 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:58.087610 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:58.088337 29378 raft_consensus.cc:2393] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 14: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:58.077934 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:58.067335  2513 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:58.094192 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:58.095247 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:13:58.096169 29372 raft_consensus.cc:2410] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:13:58.097179 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:58.084473  2582 consensus_queue.cc:1048] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:13:58.093214  2558 consensus_queue.cc:1048] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:13:58.099866  2689 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:58.103636 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:58.107625 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 126365us
I20260709 13:13:58.112211 30121 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:58.113691  2693 raft_consensus.cc:2804] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:13:58.114283  2693 raft_consensus.cc:697] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:13:58.097865 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:58.116405 29372 raft_consensus.cc:1275] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:13:58.123181  2693 consensus_queue.cc:237] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:13:58.124941 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:58.125875 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:58.126492 29523 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:58.132757 29528 raft_consensus.cc:1275] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:13:58.134057 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:58.140704 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:58.142035 29377 raft_consensus.cc:2410] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 21 because replica has last-logged OpId of term: 20 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 8.
I20260709 13:13:58.139302 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:58.143642 29378 raft_consensus.cc:2410] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:13:58.146378 29380 raft_consensus.cc:1240] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 17. Current term is 18. Ops: [17.10-17.10]
W20260709 13:13:58.148685 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:58.144997 29344 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:58.150648 29521 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 14.
I20260709 13:13:58.157124 29529 raft_consensus.cc:1275] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:13:58.158650 29530 raft_consensus.cc:1275] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:13:58.152388  2659 consensus_queue.cc:1048] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:13:58.162904  2347 raft_consensus.cc:2804] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:58.164328 29374 raft_consensus.cc:1240] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:13:58.171949  2347 raft_consensus.cc:697] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:58.173678  2347 consensus_queue.cc:237] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:58.175247 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:58.178684 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:58.179565 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:58.180423 29449 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:13:58.164095  2646 consensus_queue.cc:1048] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:58.164844 29346 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:58.145689  2689 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.187767 29495 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:58.195941 29454 raft_consensus.cc:1275] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
W20260709 13:13:58.204082 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 50102.5us
I20260709 13:13:58.202409 29454 pending_rounds.cc:85] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 8
I20260709 13:13:58.207579 29454 pending_rounds.cc:107] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:13:58.207921 29454 raft_consensus.cc:2889] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:58.208177 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 62183.6us
I20260709 13:13:58.210889 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:58.213251 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:58.214358 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:58.214993 29451 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:13:58.225064 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:58.224893 29449 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 20.
W20260709 13:13:58.226708 29277 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37586 (request call id 138) took 22058 ms (client timeout 15000 ms). Trace:
I20260709 13:13:58.206866  2689 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:58.205578  2144 raft_consensus.cc:2749] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:13:58.230641  2689 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:58.239893  2558 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.242920 29447 raft_consensus.cc:1275] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:13:58.244462 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:58.240526  2558 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:58.250088  2586 consensus_queue.cc:1048] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:13:58.251389  2558 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:58.255432 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:58.265120 29450 raft_consensus.cc:2410] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
W20260709 13:13:58.266388 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 116920us
I20260709 13:13:58.251696  2586 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.268937 29346 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:58.262847 29344 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:58.268400  2522 consensus_queue.cc:1048] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
W20260709 13:13:58.272153 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:58.274670 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:58.275050  2659 consensus_queue.cc:1059] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:13:58.275431 29529 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:13:58.268250  2586 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:58.277806 29495 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:58.283987 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:58.284950 29449 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 17
W20260709 13:13:58.227226 29277 rpcz_store.cc:269] 0709 13:13:36.168298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.168667 (+   369us) service_pool.cc:224] Handling call
0709 13:13:36.210358 (+ 41691us) spinlock_profiling.cc:243] Waited 7.24 ms on lock 0x7b5400422054. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcf0090 00007f6a7bd8ef3a 00007f6a81b451cc 00007f6a81c4337e 00007f6a801042a4 00007f6a80104232 00007f6a80104161 00007f6a801040dc 00007f6a80103392 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:13:58.226413 (+22016055us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:49.985736 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:49.986367 (+   631us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:49.986404 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:13:49.986426 (+    22us) tablet.cc:662] Decoding operations
0709 13:13:50.308081 (+321655us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:50.308182 (+   101us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:50.308226 (+    44us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:13:50.310466 (+  2240us) tablet.cc:701] Row locks acquired
0709 13:13:50.310500 (+    34us) write_op.cc:260] PREPARE: finished
0709 13:13:50.310745 (+   245us) write_op.cc:270] Start()
0709 13:13:50.311024 (+   279us) write_op.cc:276] Timestamp: P: 1783602830310661 usec, L: 0
0709 13:13:50.311055 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:13:50.491733 (+180678us) log.cc:844] Serialized 7583 byte log entry
0709 13:13:51.917656 (+1425923us) op_driver.cc:464] REPLICATION: finished
0709 13:13:52.325209 (+407553us) write_op.cc:301] APPLY: starting
0709 13:13:52.342943 (+ 17734us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:53.492881 (+1149938us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b18002e9540. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a7bac50ec 00007f6a7babc7ec 00007f6a7f7dcf13 00007f6a7f7dd532 00007f6a7f824b93 00007f6a7f6d1de3 00007f6a7f6d16ab 00007f6a7f6d2e77 00007f6a7f7d1e34
0709 13:13:53.898212 (+405331us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:53.898241 (+    29us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:55.828312 (+1930071us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:55.828687 (+   375us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 13:13:55.828765 (+    78us) write_op.cc:312] APPLY: finished
0709 13:13:55.829265 (+   500us) log.cc:844] Serialized 172 byte log entry
0709 13:13:56.888801 (+1059536us) spinlock_profiling.cc:243] Waited 73.5 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a78c7c0ac 00007f6a81ad6ab9 00007f6a78c9869b 00007f6a78c9693f 00007f6a78c98c02 00007f6a7b92020b
0709 13:13:57.143121 (+254320us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:57.200585 (+ 57464us) write_op.cc:454] Released schema lock
0709 13:13:57.250201 (+ 49616us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:57.313270 (+ 63069us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:57.313334 (+    64us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5404,"reported_tablets":54,"spinlock_wait_cycles":16653184,"child_traces":[["op",{"apply.queue_time_us":273722,"apply.run_cpu_time_us":83810,"apply.run_wall_time_us":5045812,"cfile_cache_hit":78,"cfile_cache_hit_bytes":83395,"num_ops":19,"prepare.queue_time_us":148850,"prepare.run_cpu_time_us":35448,"prepare.run_wall_time_us":734535,"raft.queue_time_us":324939,"raft.run_cpu_time_us":29823,"raft.run_wall_time_us":334765,"replication_time_us":1496543,"spinlock_wait_cycles":192118400,"thread_start_us":1903310,"threads_started":6,"wal-append.queue_time_us":1682517,"wal-append.run_cpu_time_us":29952,"wal-append.run_wall_time_us":1746393}]]}
I20260709 13:13:58.295349 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:58.296170 29447 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:13:58.297112 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:58.277732  2586 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:58.314373 29451 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 18.
I20260709 13:13:58.291800  2522 raft_consensus.cc:2804] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:13:58.313736 29344 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:58.325611 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:58.326515 29448 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:13:58.306052  2647 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:58.330698  2513 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:58.332192 29379 raft_consensus.cc:1240] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 16. Current term is 18. Ops: []
I20260709 13:13:58.333293  2513 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:58.339617 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:58.313561  2515 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:58.340394  2515 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:58.340472 29529 raft_consensus.cc:1275] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:13:58.340906  2515 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:58.341181 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:58.341765 29526 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:58.342504  2456 consensus_queue.cc:1048] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:13:58.343679 29453 raft_consensus.cc:3055] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:13:58.349125 29453 raft_consensus.cc:740] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:58.350066 29453 consensus_queue.cc:260] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:58.351083 29453 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:58.344357 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:58.352427 29454 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:13:58.345139 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:58.353837 29456 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:58.345827 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:58.354734 29452 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:13:58.347057 29455 raft_consensus.cc:1275] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 13:13:58.356721 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 87845.4us
I20260709 13:13:58.357739 29526 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 18.
W20260709 13:13:58.359578 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:58.372099 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:58.373214 29452 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:13:58.376561 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:58.384757 29523 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 18.
I20260709 13:13:58.386368 29449 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:13:58.407768 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:58.375388 29344 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:58.327894  2659 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:58.324803  2144 consensus_queue.cc:1048] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:13:58.411394 29346 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:13:58.412053 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:58.415395 29447 raft_consensus.cc:3055] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:58.417953 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:58.418912 29450 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:13:58.421931  2659 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.422165 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:58.410122  2702 raft_consensus.cc:2764] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election decision vote started in defunct term 17: won
I20260709 13:13:58.422587  2513 consensus_queue.cc:1059] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:13:58.431874  2513 raft_consensus.cc:3055] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:58.432416  2513 raft_consensus.cc:740] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:58.418565 29447 raft_consensus.cc:740] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:58.433125  2351 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:58.433905  2351 raft_consensus.cc:697] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:58.433385 29447 consensus_queue.cc:260] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:58.435151 29447 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:13:58.423987  2750 log.cc:927] Time spent T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:13:58.439904 29346 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:58.442839  2350 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:13:58.415825 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 86125.6us
I20260709 13:13:58.422559  2659 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:58.454468 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:58.456851 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:58.451895  2350 raft_consensus.cc:2804] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:58.456247  2558 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:58.465021  2350 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.490989 29453 raft_consensus.cc:1275] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:13:58.435545  2513 consensus_queue.cc:260] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:58.548892 29453 pending_rounds.cc:85] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 8
I20260709 13:13:58.549211 29453 pending_rounds.cc:107] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:13:58.549606 29453 raft_consensus.cc:2889] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:58.550104 29419 leader_election.cc:336] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.515s (SENT)
W20260709 13:13:58.527848 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:58.435344  2351 consensus_queue.cc:237] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:58.539327  2689 raft_consensus.cc:3055] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:13:58.514038 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:58.552455 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:58.558234 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:58.559284 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:58.564453 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:58.568795 29452 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 18.
W20260709 13:13:58.579536 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:58.555194  2350 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:58.547667  2522 raft_consensus.cc:697] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:58.559523  2689 raft_consensus.cc:740] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:58.525512  2558 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:58.585894 29421 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.716s (SENT) [suppressed 56 similar messages]
W20260709 13:13:58.594753 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:58.600467 29447 raft_consensus.cc:1275] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 13:13:58.601397 29447 pending_rounds.cc:85] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 7
I20260709 13:13:58.601817 29447 pending_rounds.cc:107] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 13:13:58.602289 29447 raft_consensus.cc:2889] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:13:58.603431 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 134317us
I20260709 13:13:58.605957 29495 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:58.610340 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:58.614987 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:58.616226 29456 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 14.
W20260709 13:13:58.618562 29421 leader_election.cc:336] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.750s (SENT)
W20260709 13:13:58.619571 29421 leader_election.cc:336] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.515s (SENT)
I20260709 13:13:58.620064 29421 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:58.625272 29346 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:58.624722 29493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 70981us
I20260709 13:13:58.632642  2764 raft_consensus.cc:2749] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:13:58.649549  2558 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:58.616081  2689 consensus_queue.cc:260] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:58.665336  2689 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:58.643461  2522 consensus_queue.cc:237] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:58.669422  2515 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:58.665848  2659 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:58.675420  2659 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:58.633905  2647 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.677801  2647 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:58.679827 29528 raft_consensus.cc:1240] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:58.681388  2647 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:58.681521  2574 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.696741 29454 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:13:58.682178  2574 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:58.700513  2558 raft_consensus.cc:2749] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:58.703152 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:58.715137 29522 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:58.700146  2515 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:58.719558 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:58.720337 29530 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
W20260709 13:13:58.721526 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 96348.3us
I20260709 13:13:58.722501 29346 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:58.725273  2574 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:58.725869  2659 raft_consensus.cc:2749] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:13:58.726404 29419 leader_election.cc:336] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.750s (SENT)
I20260709 13:13:58.727023 29419 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:58.727423 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:58.728982 29346 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:58.738279  2689 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:13:58.747187 29344 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:58.766023 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 160157us
W20260709 13:13:58.786230 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 166740us
I20260709 13:13:58.785806 29344 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:58.748689  2515 raft_consensus.cc:2764] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
W20260709 13:13:58.796504 29421 leader_election.cc:336] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.548s (SENT)
I20260709 13:13:58.797252 29421 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:58.781495  2659 raft_consensus.cc:2804] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:13:58.807394 29522 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:13:58.807654 29523 raft_consensus.cc:1275] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:13:58.763696  2689 consensus_queue.cc:1048] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:13:58.797341  2765 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:58.812704 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:58.785192  2456 consensus_queue.cc:1059] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
W20260709 13:13:58.817129 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:58.818331 29495 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:58.819298 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 92931.1us
W20260709 13:13:58.824209 29419 leader_election.cc:336] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.812s (SENT)
W20260709 13:13:58.836516 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 52497.2us
I20260709 13:13:58.838141 29346 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:58.847142 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:58.849956 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:58.812842  2643 raft_consensus.cc:493] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.857456 29455 raft_consensus.cc:1275] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:13:58.880884  2659 raft_consensus.cc:697] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:58.883903  2659 consensus_queue.cc:237] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:58.848315  2689 raft_consensus.cc:2804] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:13:58.903318 29419 leader_election.cc:336] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.906s (SENT)
W20260709 13:13:58.906090 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 57541.3us
W20260709 13:13:58.908857 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 93639.4us
I20260709 13:13:58.877940  2768 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.824543  2765 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:58.933334 29419 leader_election.cc:336] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.919s (SENT)
I20260709 13:13:58.933890 29419 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:58.936602  2775 raft_consensus.cc:2804] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:13:58.937135  2775 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:58.937546  2775 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:13:58.942124  2513 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:58.876313  2643 raft_consensus.cc:515] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:13:58.950398 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 153943us
W20260709 13:13:58.951267 29421 leader_election.cc:336] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.792s (SENT)
I20260709 13:13:58.951731 29421 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:58.903796  2689 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.945791 29495 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:58.994999 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 156917us
W20260709 13:13:58.994939 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 63060.9us
W20260709 13:13:58.999691 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 213791us
I20260709 13:13:58.990412  2558 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:58.989699  2689 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:59.000746  2647 raft_consensus.cc:3055] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:13:59.017215  2647 raft_consensus.cc:740] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:59.018404  2647 consensus_queue.cc:260] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:58.932461  2768 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:59.019625 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 89860.5us
I20260709 13:13:59.020967  2782 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:13:59.021971  2768 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:58.997669  2702 raft_consensus.cc:2764] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader election decision vote started in defunct term 16: won
I20260709 13:13:58.932757  2770 consensus_queue.cc:1048] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.093s
I20260709 13:13:59.004047  2776 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:59.033702 29495 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:13:59.035127 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.035701  2764 consensus_queue.cc:1048] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:13:59.036340 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:59.034416 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 100953us
I20260709 13:13:59.036962 29346 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:59.004498  2780 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:13:58.965111  2767 consensus_queue.cc:1048] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.082s
W20260709 13:13:59.041332 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.040001  2434 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:13:59.044091  2434 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:59.044564  2434 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:59.044895  2643 leader_election.cc:290] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:59.054193 29276 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35182 (request call id 74) took 7002 ms. Trace:
I20260709 13:13:59.066668  2765 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:59.067804 29495 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:59.069132  2586 raft_consensus.cc:2804] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:13:59.069286 29495 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:59.069643  2586 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:59.070187  2586 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:13:59.070745 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:59.071412 29372 raft_consensus.cc:2468] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 6.
W20260709 13:13:59.038808 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 87556.3us
W20260709 13:13:59.058951 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:59.072461 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.056432  2350 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:59.082340 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.032829  2768 raft_consensus.cc:2749] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:13:59.083024 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 74984.2us
I20260709 13:13:59.084307 30121 leader_election.cc:304] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
W20260709 13:13:59.085108 29421 leader_election.cc:336] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.653s (SENT)
W20260709 13:13:59.088258 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 51379.8us
W20260709 13:13:59.098438 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.106954 29344 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:59.090376 29346 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:59.085479 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:59.112646 29421 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:59.058642  2767 consensus_queue.cc:1243] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Peer 71aa3578fd924765ab9ac0729c8d1483 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:13:59.120250 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.072731  2647 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:59.112192 29528 raft_consensus.cc:2468] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 5.
I20260709 13:13:59.131254 29346 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:59.132665  2788 raft_consensus.cc:2749] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:13:59.133527  2788 raft_consensus.cc:2749] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:13:59.134291 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.135222 29346 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:59.137419  2680 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:59.137940  2680 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:59.138365  2680 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:59.138515 29346 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:59.139676  2788 raft_consensus.cc:2804] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:13:59.139540  2646 consensus_queue.cc:1048] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:13:59.140101  2788 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:59.140502  2788 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:59.082371  2780 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:59.152406 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 219090us
I20260709 13:13:59.148001 29495 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:59.084208  2765 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:13:59.164181 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 78772.9us
I20260709 13:13:59.175298 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:59.117564  2790 raft_consensus.cc:2804] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:13:59.168839 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.064427 29276 rpcz_store.cc:276] 0709 13:13:52.051660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:52.052069 (+   409us) service_pool.cc:224] Handling call
0709 13:13:59.054084 (+7002015us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:57.886796 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:57.910573 (+ 23777us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:57.910629 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:13:57.910664 (+    35us) tablet.cc:662] Decoding operations
0709 13:13:57.911788 (+  1124us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:57.911895 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:57.911933 (+    38us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:13:57.913167 (+  1234us) tablet.cc:701] Row locks acquired
0709 13:13:57.913248 (+    81us) write_op.cc:260] PREPARE: finished
0709 13:13:57.913458 (+   210us) write_op.cc:270] Start()
0709 13:13:57.978000 (+ 64542us) write_op.cc:276] Timestamp: P: 1783602837913381 usec, L: 0
0709 13:13:57.982743 (+  4743us) op_driver.cc:348] REPLICATION: starting
0709 13:13:58.063789 (+ 81046us) log.cc:844] Serialized 3242 byte log entry
0709 13:13:58.117432 (+ 53643us) op_driver.cc:464] REPLICATION: finished
0709 13:13:58.253949 (+136517us) write_op.cc:301] APPLY: starting
0709 13:13:58.254065 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:58.443837 (+189772us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:58.444037 (+   200us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:58.545244 (+101207us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:58.545578 (+   334us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:13:58.545644 (+    66us) write_op.cc:312] APPLY: finished
0709 13:13:58.546061 (+   417us) log.cc:844] Serialized 81 byte log entry
0709 13:13:58.567998 (+ 21937us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:58.579088 (+ 11090us) write_op.cc:454] Released schema lock
0709 13:13:58.580421 (+  1333us) write_op.cc:341] FINISH: Updating metrics
0709 13:13:58.605893 (+ 25472us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:58.608738 (+  2845us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":222855,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":136203,"apply.run_cpu_time_us":17468,"apply.run_wall_time_us":342466,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37503,"num_ops":8,"prepare.queue_time_us":138335,"prepare.run_cpu_time_us":7778,"prepare.run_wall_time_us":201932,"replication_time_us":134478,"thread_start_us":142817,"threads_started":2}]]}
I20260709 13:13:59.160353  2796 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:13:59.180015 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 106000us
W20260709 13:13:59.189637 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:59.190099 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:59.190582 29421 leader_election.cc:336] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.812s (SENT)
I20260709 13:13:59.169967  2558 raft_consensus.cc:2749] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:13:59.191133 29421 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:59.196341 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:59.173651  2769 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:13:59.194916 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 76290.1us
I20260709 13:13:59.177491  2643 raft_consensus.cc:2804] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:13:59.204306 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.206264 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:59.193562 29419 leader_election.cc:336] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.952s (SENT)
I20260709 13:13:59.211045 29419 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:59.214411 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:59.165300  2793 consensus_queue.cc:1048] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 13:13:59.202039  2769 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:13:59.200874  2790 raft_consensus.cc:697] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:59.170531  2780 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:59.255689 29527 raft_consensus.cc:1240] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:59.234059 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:59.190290  2646 consensus_queue.cc:1048] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:13:59.206013  2643 raft_consensus.cc:493] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:59.241389 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:59.233366 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:59.248013  2781 consensus_queue.cc:1048] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:13:59.247732  2689 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:59.247732  2801 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:13:59.214092  2768 raft_consensus.cc:2749] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:13:59.251585  2784 consensus_queue.cc:1048] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 13:13:59.209439  2796 raft_consensus.cc:697] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:59.296530  2796 consensus_queue.cc:237] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:59.298229  2689 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:59.232219 29421 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:59.253338 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:13:59.299935 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 67815.5us
I20260709 13:13:59.300678  2558 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:13:59.301191  2558 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:13:59.257402 29380 raft_consensus.cc:2393] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 22: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:59.301596 29421 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:59.301631  2558 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:59.302929  2776 consensus_queue.cc:1048] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:59.252645  2769 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:59.304757 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:59.271004 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:59.307734 29378 raft_consensus.cc:2393] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 17: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:59.308601  2434 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:59.309545  2772 log.cc:927] Time spent T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.293s	user 0.004s	sys 0.000s
I20260709 13:13:59.311796 29521 raft_consensus.cc:1240] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 15. Current term is 16. Ops: []
W20260709 13:13:59.313375  2805 log.cc:927] Time spent T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:13:59.314585  2790 consensus_queue.cc:237] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:59.317656 29522 raft_consensus.cc:1240] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:59.319171 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:59.320011 29521 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 17.
I20260709 13:13:59.274101  2788 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:59.276105  2773 log.cc:927] Time spent T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:13:59.277537  2350 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:59.278855  2775 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:59.284987 29379 raft_consensus.cc:2393] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 16: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:13:59.282399  2643 raft_consensus.cc:3060] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:13:59.331852 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 144846us
W20260709 13:13:59.296552  2799 log.cc:927] Time spent T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:13:59.337332 29419 leader_election.cc:336] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.999s (SENT)
I20260709 13:13:59.338630 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:59.339293 29419 leader_election.cc:336] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 2.098s (SENT)
I20260709 13:13:59.340219 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:59.340233 29419 leader_election.cc:336] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 2.122s (SENT)
I20260709 13:13:59.342240 29529 raft_consensus.cc:1240] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 15. Current term is 16. Ops: []
I20260709 13:13:59.304811  2776 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:13:59.353847  2791 log.cc:927] Time spent T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:13:59.362475  2780 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:59.368917  2795 log.cc:927] Time spent T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.345s	user 0.000s	sys 0.002s
I20260709 13:13:59.370637  2764 consensus_queue.cc:1059] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:13:59.372028  2764 raft_consensus.cc:3055] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:13:59.372447  2764 raft_consensus.cc:740] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:13:59.373379  2764 consensus_queue.cc:260] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:59.374701  2764 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:59.380266 29521 raft_consensus.cc:2393] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 22: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:59.380985 29523 raft_consensus.cc:2393] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 15: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:13:59.382978 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.385540 29448 raft_consensus.cc:3055] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:13:59.385927 29448 raft_consensus.cc:740] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:59.389248 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:59.390158 29454 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:13:59.392946 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.335602  2434 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:59.408041 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:59.409655 29521 raft_consensus.cc:2393] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 17: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:59.405726 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:59.417105 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:59.417801 29450 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:59.417917 29522 raft_consensus.cc:1275] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:13:59.419207 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:59.419857 29530 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:59.421732 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:59.422343 29456 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
W20260709 13:13:59.422719 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.423621 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:59.424227 29447 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 21.
W20260709 13:13:59.424842 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 123339us
I20260709 13:13:59.426652 29524 raft_consensus.cc:1240] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 14. Current term is 15. Ops: []
W20260709 13:13:59.428900 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.429649 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:59.430296 29522 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:59.421514 29448 consensus_queue.cc:260] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:59.434931 29454 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:13:59.435967 29521 raft_consensus.cc:1275] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:13:59.427989  2780 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:59.451203 29448 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:59.452956 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:59.453866 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.457079  2586 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:59.460311 29527 raft_consensus.cc:1275] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:13:59.467165 29450 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 18.
W20260709 13:13:59.470715 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.470860 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:59.483839 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.487243 29530 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:13:59.489303 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:59.491686 29453 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:59.493251 29525 raft_consensus.cc:1240] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:13:59.493621 29421 leader_election.cc:400] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 19. Current term is 20.
I20260709 13:13:59.494099 29421 leader_election.cc:403] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:59.445416  2776 consensus_queue.cc:1059] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:13:59.500005 29344 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:13:59.510269 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:59.513832 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:59.514775 29530 raft_consensus.cc:2393] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 15: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:59.515985 29527 raft_consensus.cc:2368] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 16. Current term is 17.
I20260709 13:13:59.517321 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:59.518009 29451 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 18
W20260709 13:13:59.519788 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.521219 29449 raft_consensus.cc:1275] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:13:59.494092  2434 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:59.532150  2434 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:59.534349  2586 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:59.534768  2434 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:13:59.536168 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
W20260709 13:13:59.544461 29419 leader_election.cc:336] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.706s (SENT)
W20260709 13:13:59.545357 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.548326 29419 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:59.552183  2809 log.cc:927] Time spent T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 13:13:59.506131  2350 consensus_queue.cc:1048] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.050s
W20260709 13:13:59.557742 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.459771  2780 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:59.562916 29451 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 18.
I20260709 13:13:59.572657 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:59.574383 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:59.578949 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:59.521195 29421 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:59.564622  2818 raft_consensus.cc:2749] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 19. Current term is 20.
I20260709 13:13:59.572263 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:59.583482 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.566277 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:13:59.567363 29453 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:13:59.567570 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:59.571316 29448 raft_consensus.cc:1275] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:13:59.585237 29448 pending_rounds.cc:85] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 9
I20260709 13:13:59.585454 29530 raft_consensus.cc:2368] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 16. Current term is 17.
I20260709 13:13:59.585543 29448 pending_rounds.cc:107] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:13:59.585879 29448 raft_consensus.cc:2889] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:59.530582 29522 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 18.
I20260709 13:13:59.586405 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:59.474171  2680 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:59.587734 29530 raft_consensus.cc:2368] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 16. Current term is 17.
I20260709 13:13:59.594944 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:59.595724 29451 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:13:59.596369 29530 raft_consensus.cc:1217] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Deduplicated request from leader. Original: 14.8->[16.9-16.9]   Dedup: 16.9->[]
I20260709 13:13:59.596946 29530 raft_consensus.cc:1240] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:13:59.493938  2522 consensus_queue.cc:1059] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.078s
W20260709 13:13:59.573530  2513 consensus_meta.cc:287] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.618s	user 0.016s	sys 0.001s
W20260709 13:13:59.599949 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 78877.6us
I20260709 13:13:59.516959  2574 raft_consensus.cc:2804] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:59.602597 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:59.605587 29421 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:59.605723 29448 raft_consensus.cc:1275] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:13:59.484002  2786 consensus_queue.cc:1048] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.106s
I20260709 13:13:59.614472 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:59.615264 29524 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:13:59.609090 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:59.618804 29451 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
W20260709 13:13:59.619621 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.622687 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:59.623831 29448 raft_consensus.cc:1275] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:13:59.599915  2775 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:13:59.630731  2796 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:13:59.631163  2574 raft_consensus.cc:697] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:13:59.631484 29327 auto_rebalancer.cc:629] Failed to schedule move for tablet f645a08329404baabcc745299ee2efd3: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:13:59.633904 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.570835  2558 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:59.631011  2818 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:13:59.623271  2768 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:13:59.623436  2788 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:59.678319 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:59.679225 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.679411 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:59.681456 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:59.682272 29523 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11.
I20260709 13:13:59.684458 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:59.652729  2782 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
W20260709 13:13:59.685848 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 141466us
I20260709 13:13:59.646387  2796 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:59.697908 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:13:59.719285 29419 leader_election.cc:336] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.716s (SENT)
I20260709 13:13:59.727623 29523 raft_consensus.cc:2393] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 18: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:59.738687 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:59.739845 29527 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 17.
W20260709 13:13:59.745126 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.676566  2643 raft_consensus.cc:515] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:13:59.748139 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:59.751482 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:59.752678 29527 raft_consensus.cc:2393] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 15: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:59.752218 29523 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
I20260709 13:13:59.770828 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:59.772209 29527 raft_consensus.cc:2393] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 22: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:59.697032  2782 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:13:59.779590 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 174079us
I20260709 13:13:59.781075 29421 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:59.701838  2574 consensus_queue.cc:237] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:59.785658 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:59.788383 29346 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:59.789296  2558 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:59.790743  2823 log.cc:927] Time spent T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:13:59.774472  2769 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:13:59.784315  2780 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:59.830730 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:59.790045  2680 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:59.840150  2796 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:13:59.841964 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 61027.5us
I20260709 13:13:59.847813 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:59.848513 29421 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:13:59.857086 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:59.833725  2790 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:13:59.858915 29529 raft_consensus.cc:1240] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:13:59.859310 29346 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:59.862756 29421 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:13:59.858785  2647 consensus_meta.cc:287] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.710s	user 0.010s	sys 0.006s
W20260709 13:13:59.872946 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.874028 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:59.875684 29523 raft_consensus.cc:2393] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 17: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:59.859972  2776 raft_consensus.cc:2749] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:13:59.876766 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.860437  2790 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:59.872502  2558 raft_consensus.cc:2749] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:13:59.882218 29346 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:13:59.883179 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:59.886145 29523 raft_consensus.cc:2393] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 15: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:13:59.869081  2350 consensus_queue.cc:1048] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
W20260709 13:13:59.896243 29419 leader_election.cc:336] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.765s (SENT)
I20260709 13:13:59.900719 29421 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:13:59.902626 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 156115us
I20260709 13:13:59.880692  2522 raft_consensus.cc:2804] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:13:59.884230  2824 log.cc:927] Time spent T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:13:59.881870  2790 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:13:59.910617 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.910313 29524 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 16.
I20260709 13:13:59.912070 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:13:59.883219  2842 raft_consensus.cc:2749] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:59.926944 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:59.946928 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:59.896149  2647 consensus_queue.cc:1048] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:13:59.948807 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:13:59.884106  2764 consensus_queue.cc:1048] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:13:59.919204  2558 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:13:59.955428 29419 leader_election.cc:336] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 2.405s (SENT)
I20260709 13:13:59.957357 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:59.916630  2643 leader_election.cc:290] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 7 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:59.960500 29524 raft_consensus.cc:3060] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:13:59.961563 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:13:59.962329 29449 raft_consensus.cc:2368] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 17. Current term is 18.
I20260709 13:13:59.958392 29450 raft_consensus.cc:2393] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 17: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
W20260709 13:13:59.963750 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 63568.6us
I20260709 13:13:59.921319  2787 raft_consensus.cc:2804] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:13:59.965360 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:13:59.957296 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 49824us
W20260709 13:13:59.971634 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:13:59.954353  2827 log.cc:927] Time spent T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:13:59.982218 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:59.983250 29448 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 14.
I20260709 13:13:59.974134 29524 raft_consensus.cc:2468] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 7.
I20260709 13:13:59.980216 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:59.985240 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:59.985509 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:13:59.977270  2840 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:13:59.987203  2829 log.cc:927] Time spent T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:13:59.987406 29454 raft_consensus.cc:1275] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:13:59.987818 30119 leader_election.cc:304] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
W20260709 13:13:59.988276  2825 log.cc:927] Time spent T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:13:59.987138 29421 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:13:59.918633  2779 consensus_queue.cc:1048] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:13:59.952301  2782 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:13:59.996888  2843 raft_consensus.cc:2804] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:13:59.997859  2843 raft_consensus.cc:697] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
W20260709 13:13:59.999142  2826 log.cc:927] Time spent T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:14:00.002521 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:00.003139 29447 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:13:59.976007  2434 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:00.011490 29451 raft_consensus.cc:1240] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:00.011833 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:00.016194 29454 raft_consensus.cc:2393] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 16: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:13:59.993602  2522 raft_consensus.cc:697] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:00.022843 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:00.018133  2769 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:00.023731 29454 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:00.015671  2434 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:00.054715  2434 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:00.054769  2513 raft_consensus.cc:3055] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:00.060434  2513 raft_consensus.cc:740] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:00.061689  2513 consensus_queue.cc:260] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:00.047000  2779 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.047358  2793 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.001782  2787 raft_consensus.cc:697] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:14:00.066413  2832 log.cc:927] Time spent T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
I20260709 13:14:00.067447 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:00.068320 29456 raft_consensus.cc:2393] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 17: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:00.065317  2793 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:00.071079  2793 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:00.066265  2787 consensus_queue.cc:237] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:00.064913  2779 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:00.082927  2779 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:00.063468  2513 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:00.075376  2801 raft_consensus.cc:3055] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:14:00.084075  2801 raft_consensus.cc:740] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:13:59.999372  2843 consensus_queue.cc:237] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:00.094226 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:14:00.095692 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:00.096361 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.098961 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:00.099804 29372 raft_consensus.cc:1240] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 17. Current term is 18. Ops: []
I20260709 13:14:00.099860 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:14:00.100090 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 114382us
I20260709 13:14:00.103945  2842 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:14:00.104121 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 84412.5us
I20260709 13:14:00.109525 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:00.113866 29456 raft_consensus.cc:1275] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:14:00.114115  2522 consensus_queue.cc:237] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:00.117411  2836 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:00.118268  2836 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:00.103355  2840 consensus_queue.cc:1048] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:14:00.119120  2790 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:00.236234 29453 raft_consensus.cc:1240] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 17. Current term is 18. Ops: []
I20260709 13:14:00.175375 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:00.240386 29374 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 20.
I20260709 13:14:00.163220 29447 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 18.
W20260709 13:14:00.164559 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.260666 29528 raft_consensus.cc:1275] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:14:00.261780 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:00.262413 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:00.176105 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:00.229996  2787 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.263628 29372 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16.
I20260709 13:14:00.263680  2787 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:00.176301 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.236541 29456 raft_consensus.cc:1240] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 20. Current term is 21. Ops: []
I20260709 13:14:00.129297  2769 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.268183  2769 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:00.164300  2837 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:00.243870 29450 raft_consensus.cc:1240] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 17. Current term is 18. Ops: []
I20260709 13:14:00.270609  2837 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:00.271947 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:00.228619 29452 raft_consensus.cc:1240] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:14:00.276539  2837 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:00.278158  2836 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:00.279014  2801 consensus_queue.cc:260] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:00.283950 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:00.285256 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:00.285840 29377 raft_consensus.cc:2376] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 22. Re-sending same reply.
I20260709 13:14:00.285992 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:00.286860 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:00.292795 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:00.294339 29526 raft_consensus.cc:3055] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:14:00.294919 29526 raft_consensus.cc:740] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:00.244706 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:14:00.128620 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.141283 29521 pending_rounds.cc:85] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 7
I20260709 13:14:00.296571 29521 pending_rounds.cc:107] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:14:00.296967 29521 raft_consensus.cc:2889] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:00.251936 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:00.253413 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:14:00.120174 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 133153us
I20260709 13:14:00.164739  2351 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.176157 29373 raft_consensus.cc:1240] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 17. Current term is 18. Ops: []
I20260709 13:14:00.262451 29376 raft_consensus.cc:3060] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:14:00.266043  2787 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:00.174962 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:14:00.296627 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:00.306500 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:00.307266 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.075670 29454 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
I20260709 13:14:00.263628 29447 raft_consensus.cc:1240] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 16. Current term is 17. Ops: []
I20260709 13:14:00.250592 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:00.301071 29375 raft_consensus.cc:2368] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 21. Current term is 22.
I20260709 13:14:00.287307 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:14:00.336021 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.310303 29421 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:00.347950 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:00.312810 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:00.309150 29372 raft_consensus.cc:2376] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 15. Re-sending same reply.
I20260709 13:14:00.351135 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:00.309775 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:00.303305 29526 consensus_queue.cc:260] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:00.309017  2769 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:00.357237  2836 raft_consensus.cc:2749] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:14:00.357909 29375 raft_consensus.cc:1240] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 21. Current term is 22. Ops: []
I20260709 13:14:00.358174 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:14:00.358729 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 48550.8us
I20260709 13:14:00.359557 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:00.360412  2836 consensus_queue.cc:1048] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:00.362545 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:00.363354 29421 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:00.363379 29529 raft_consensus.cc:2393] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 14: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:00.369699 29373 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:00.369926 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:00.374174 29376 raft_consensus.cc:2468] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 7.
W20260709 13:14:00.381433 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 78533.4us
I20260709 13:14:00.294003  2646 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.386973 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:00.388681 29376 raft_consensus.cc:2410] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
W20260709 13:14:00.339810  2835 sasl_common.cc:323] Time spent creating new SASL kudu client: real 0.296s	user 0.001s	sys 0.001s
I20260709 13:14:00.391847  2144 consensus_queue.cc:1059] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:00.393043  2837 raft_consensus.cc:3055] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:00.393437  2837 raft_consensus.cc:740] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:00.394562  2837 consensus_queue.cc:260] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:00.395931  2840 consensus_queue.cc:1048] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:14:00.378628  2513 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.398226  2522 consensus_queue.cc:1059] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:14:00.400050  2788 raft_consensus.cc:3055] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:14:00.404032  2788 raft_consensus.cc:740] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:00.404852  2836 raft_consensus.cc:2749] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:00.405118  2788 consensus_queue.cc:260] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:00.406577  2788 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:00.406924 29421 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:00.410115 29421 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:00.411616 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.398382  2513 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:00.415221 29526 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:00.370905  2801 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:00.423837 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:00.399458  2790 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 22 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:00.440009 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:00.443241 29372 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 18.
I20260709 13:14:00.445015 29421 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:00.423811  2513 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:00.309861  2351 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:00.455147 29376 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16.
I20260709 13:14:00.420918  2840 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:00.460170 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:00.461022 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:00.422480  2836 raft_consensus.cc:2749] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:14:00.462404 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.473753 29421 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:00.474769 29376 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 15.
I20260709 13:14:00.476631 29346 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:00.435871  2851 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.480885 29526 raft_consensus.cc:1275] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 13:14:00.481271 29379 raft_consensus.cc:2376] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14. Re-sending same reply.
I20260709 13:14:00.455761  2837 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:00.482577 29526 pending_rounds.cc:85] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 11
W20260709 13:14:00.484387 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.415551  2646 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:00.485061 29373 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:14:00.486065 29526 pending_rounds.cc:107] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:14:00.490253  2558 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:00.483366  2689 consensus_queue.cc:1048] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:14:00.494679  2351 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:00.475790  2790 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.495662 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:00.526149 29376 raft_consensus.cc:1275] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:14:00.531668 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:00.501781 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:00.503072 29530 raft_consensus.cc:1275] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:14:00.503460 29527 raft_consensus.cc:1275] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:14:00.507264 29526 raft_consensus.cc:2889] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:14:00.504527 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 126767us
I20260709 13:14:00.505940 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:00.505343 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:00.517230 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:00.528816 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:14:00.501087 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.532060 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:00.537586 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:00.539542 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:00.544997 29530 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 18.
W20260709 13:14:00.545876 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.533898 29380 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 15.
I20260709 13:14:00.480561  2780 raft_consensus.cc:2749] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:14:00.556991 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.518390  2513 raft_consensus.cc:2764] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:14:00.537506 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:00.562615 29523 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:14:00.545619 29524 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 22.
I20260709 13:14:00.547346 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:00.547528 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:00.565941 29380 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 21.
I20260709 13:14:00.550117 29374 raft_consensus.cc:1240] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 15. Current term is 16. Ops: []
I20260709 13:14:00.503719  2834 consensus_queue.cc:1048] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 13:14:00.536829  2785 consensus_queue.cc:1048] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:14:00.559194 29421 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:00.590245 29421 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:00.560571 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:00.591325  2840 raft_consensus.cc:2764] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:14:00.538695  2790 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:00.592460  2840 raft_consensus.cc:2749] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:00.516207  2851 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:00.569875  2646 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:00.568943 29381 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
W20260709 13:14:00.571782 29495 connection.cc:256] RPC call timeout handler was delayed by -3.0325844330000109s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15960000000000002s for a response
W20260709 13:14:00.599126 29495 connection.cc:256] RPC call timeout handler was delayed by -3.0028970449998269s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3346s for a response
W20260709 13:14:00.599704 29495 connection.cc:256] RPC call timeout handler was delayed by -2.8993844330000229s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1744s for a response
W20260709 13:14:00.600307 29495 connection.cc:256] RPC call timeout handler was delayed by -2.85438443299995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1794s for a response
W20260709 13:14:00.600797 29495 connection.cc:256] RPC call timeout handler was delayed by -2.8102844330001062s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18430000000000002s for a response
W20260709 13:14:00.601269 29495 connection.cc:256] RPC call timeout handler was delayed by -2.7139844329999505s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.195s for a response
W20260709 13:14:00.601759 29495 connection.cc:256] RPC call timeout handler was delayed by -2.5708970449998105s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.38260000000000005s for a response
W20260709 13:14:00.602268 29495 connection.cc:256] RPC call timeout handler was delayed by -2.5681844330001695s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21120000000000003s for a response
I20260709 13:14:00.597249 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:00.603425 29526 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:14:00.586297  2836 consensus_queue.cc:1048] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:00.534503 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:00.606110 29376 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:00.605630  2790 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:00.594967 29421 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:00.609474  2836 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:14:00.609895  2836 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.610244  2836 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:00.610397  2851 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:00.604509 29495 connection.cc:256] RPC call timeout handler was delayed by -2.4565844329999891s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22360000000000002s for a response
I20260709 13:14:00.586303 29419 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:00.613543 29419 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:00.614969 29419 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:00.615653 29495 connection.cc:256] RPC call timeout handler was delayed by -2.4529844329999833s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22400000000000003s for a response
W20260709 13:14:00.616281 29495 connection.cc:256] RPC call timeout handler was delayed by -1.9507844330000808s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2798s for a response
W20260709 13:14:00.616628 29495 connection.cc:256] RPC call timeout handler was delayed by -1.9327596519999588s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16810000000000003s for a response
W20260709 13:14:00.616915 29495 connection.cc:256] RPC call timeout handler was delayed by -1.8904844329999833s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28650000000000003s for a response
W20260709 13:14:00.617328 29495 connection.cc:256] RPC call timeout handler was delayed by -1.8220596520000072s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1804s for a response
W20260709 13:14:00.617774 29495 connection.cc:256] RPC call timeout handler was delayed by -1.7680596519999199s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1864s for a response
W20260709 13:14:00.618196 29495 connection.cc:256] RPC call timeout handler was delayed by -1.6798844330000975s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30990000000000006s for a response
W20260709 13:14:00.618625 29495 connection.cc:256] RPC call timeout handler was delayed by -1.6654844330000742s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31150000000000005s for a response
W20260709 13:14:00.619048 29495 connection.cc:256] RPC call timeout handler was delayed by -1.5502596519997951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2106s for a response
W20260709 13:14:00.619424 29495 connection.cc:256] RPC call timeout handler was delayed by -1.5151596519999657s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21450000000000002s for a response
W20260709 13:14:00.623289 29495 connection.cc:256] RPC call timeout handler was delayed by -1.1578596519998428s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2542s for a response
W20260709 13:14:00.738669 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:00.764065 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.764706 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:00.749696 29376 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 18.
I20260709 13:14:00.654317  2860 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.625849  2851 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:14:00.762213 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 147274us
I20260709 13:14:00.769127 29421 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:14:00.771715 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.758836  2780 raft_consensus.cc:2804] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:00.777976 29419 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:00.750185  2840 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.778240 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:00.656840 29526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f"
dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:52288
I20260709 13:14:00.784209 29524 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:14:00.785596 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:14:00.781711 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.763047  2844 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:14:00.793944 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.797935 29419 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:00.798213 29523 raft_consensus.cc:3055] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:14:00.801748 29523 raft_consensus.cc:740] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:00.802544 29419 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:00.811714 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:00.812711 29524 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:14:00.782919  2780 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:00.797242  2796 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.814666  2830 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:14:00.816931  2851 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:00.842300 29344 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:00.843832 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.815191  2689 consensus_queue.cc:1048] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:14:00.775213  2860 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:00.875168 29526 raft_consensus.cc:606] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:00.875696 29526 raft_consensus.cc:614] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:00.876876  2860 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:00.845794  2796 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:00.879192  2796 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:00.843286 29523 consensus_queue.cc:260] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:00.858246  2834 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:00.859740  2801 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:00.864300  2830 raft_consensus.cc:697] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 18 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:00.880337 29523 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:14:00.851116  2574 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.826s	user 0.051s	sys 0.046s
I20260709 13:14:00.829080  2780 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:00.792757  2840 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:00.885424  2574 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.052s	sys 0.046s
I20260709 13:14:00.903445 29375 raft_consensus.cc:1275] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:14:00.906015 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:00.882483  2456 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.915781  2456 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:00.922822  2456 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:00.925717 29327 auto_rebalancer.cc:629] Failed to schedule move for tablet f343c91124ea4cd5b19e26f3530e1247: Illegal state: Replica 183db85c071f489fbc8de63a9edd8a3a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:00.925740  2801 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.926584  2801 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:00.928942  2801 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:00.933081 29327 auto_rebalancer.cc:629] Failed to schedule move for tablet f05e651bcfb64af6a9b5e97f9e40229f: Illegal state: Replica 71aa3578fd924765ab9ac0729c8d1483 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:00.933116  2801 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.934185  2801 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:00.934279  2836 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:00.937408  2801 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:00.938797 29327 auto_rebalancer.cc:629] Failed to schedule move for tablet f06f688759cd438a95541a7639513cec: Illegal state: Replica 183db85c071f489fbc8de63a9edd8a3a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:00.900430  2558 raft_consensus.cc:2749] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:00.886602  2434 consensus_queue.cc:1048] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:14:00.967744 29372 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
W20260709 13:14:00.990773 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 47847.5us
I20260709 13:14:00.990698 29523 raft_consensus.cc:1275] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:14:01.026672 29526 raft_consensus.cc:1275] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:14:01.030138 29495 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:14:01.050604 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 281599us
I20260709 13:14:00.987387  2830 consensus_queue.cc:237] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:01.039623  2840 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:01.044020  2860 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:14:01.088270 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 73422.4us
I20260709 13:14:01.126868 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:01.128633 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:01.130103 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:01.124781  2840 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:01.131526  2840 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:01.133594 29495 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:01.131842  2860 consensus_queue.cc:1048] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:14:01.130225  2780 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:01.040102  2762 consensus_queue.cc:1048] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:14:01.159613  2851 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:14:01.154098 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:01.143656 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 53271.9us
W20260709 13:14:01.185621 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 52139.1us
I20260709 13:14:01.139391  2844 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:01.189004 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:01.189736 29381 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:01.140180  2836 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:01.193239 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:01.156800 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 357318us
I20260709 13:14:01.193049 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:01.194337 29419 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:01.162544 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 320272us
W20260709 13:14:01.145887 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 56433.9us
I20260709 13:14:01.194465 29379 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 18.
W20260709 13:14:01.203403 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:01.204748 29419 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:01.141567  2840 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:01.211011  2876 raft_consensus.cc:2749] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:01.212404  2646 consensus_queue.cc:1048] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:01.184489  2351 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:01.217743 29344 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:01.218423 29381 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 22.
I20260709 13:14:01.190584  2860 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:01.220867  2456 consensus_queue.cc:1048] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:14:01.225265  2646 consensus_queue.cc:1048] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:14:01.231922  2844 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:01.222491 29344 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:01.234628 29344 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:01.224964  2522 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:01.241045 29419 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:01.248035 29344 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:01.232878  2844 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:01.244946  2880 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:14:01.258670  2880 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:01.258805  2881 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:01.259167  2880 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:01.259368  2881 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:01.259967  2881 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:01.241902  2878 raft_consensus.cc:2749] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:14:01.237252  2456 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:01.246731  2522 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:01.255973  2787 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:01.236327  2834 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:01.264034 29495 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:01.263301 29419 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:01.274037  2434 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:01.274744  2434 raft_consensus.cc:697] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:01.275960 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:01.266199 29344 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:01.278229 29344 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:01.266536  2522 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:01.269347  2875 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:01.264590  2456 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:01.283905 29346 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:01.292328 29495 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:01.283658  2796 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:01.296267  2796 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:01.286844  2456 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:01.298884  2796 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:01.301534  2780 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:01.300804 29275 catalog_manager.cc:5697] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 11 to 13, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 13 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:01.287871  2882 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:14:01.305415 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:01.275774  2434 consensus_queue.cc:237] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:01.311643 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:01.313410 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:01.316867 29448 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 22.
I20260709 13:14:01.317977 29453 raft_consensus.cc:1275] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:14:01.317903 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:01.319629 29453 raft_consensus.cc:1275] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:14:01.320416 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:01.269692  2787 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:01.306813  2574 consensus_queue.cc:1048] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:14:01.316362  2875 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:01.324229  2875 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:01.289002  2883 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:01.330483 29526 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:14:01.305069  2513 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:14:01.343274  2513 raft_consensus.cc:697] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:01.344453  2513 consensus_queue.cc:237] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:01.336911 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:01.335216 29453 raft_consensus.cc:1275] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:14:01.338821  2880 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:01.341287 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:01.320477  2882 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:01.354171 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:01.356029 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:01.358680 29448 raft_consensus.cc:1240] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:01.308187  2780 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:01.326786  2875 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:01.367672  2796 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:01.370404 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:01.419080 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:01.421273 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:01.438475 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:01.442269 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:14:01.449409 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 157237us
I20260709 13:14:01.454367 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:01.443372 29448 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:14:01.455659 29453 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 14.
W20260709 13:14:01.438311  2895 log.cc:927] Time spent T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:14:01.359067  2882 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:01.439047  2434 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:14:01.483433 29448 raft_consensus.cc:1275] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:14:01.419718  2780 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:01.520687 29495 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:01.527384 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:01.496834  2880 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:01.503136  2844 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:01.528445 29448 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:14:01.572983 29449 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 14.
I20260709 13:14:01.508257  2434 raft_consensus.cc:697] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:01.608081 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:01.622785 29448 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:14:01.585683  2875 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:01.568748  2851 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:01.640985 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:01.588536  2899 raft_consensus.cc:2804] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:01.643272 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:14:01.672199  2892 log.cc:927] Time spent T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 13:14:01.675026  2787 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:01.637641  2844 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:01.687085 29344 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:14:01.691080 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:01.661921  2899 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:01.722471 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:01.724169 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:01.765269 29522 raft_consensus.cc:1275] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:14:01.754417 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:01.767742 29448 raft_consensus.cc:1275] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:14:01.618513  2768 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:01.770393  2768 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:01.771787 29456 raft_consensus.cc:1275] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:14:01.773037  2768 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:01.785085 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 66122.2us
I20260709 13:14:01.669402  2851 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:01.669670  2875 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:01.789880 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 104435us
W20260709 13:14:01.777359  2895 log.cc:927] Time spent T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:14:01.793913 29346 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:01.717535  2787 consensus_queue.cc:1048] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:14:01.775950  2899 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:01.805445 29346 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:01.722729  2844 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:01.782292  2840 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:01.821278 29495 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
W20260709 13:14:01.827759 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 132496us
I20260709 13:14:01.792460  2836 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:01.803844  2350 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:01.836964 29452 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:14:01.809484  2796 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:01.789577  2456 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:01.826377  2779 raft_consensus.cc:2749] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:01.855912 29346 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:01.805927  2903 consensus_queue.cc:1048] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:14:01.838281  2350 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:01.873476  2893 log.cc:927] Time spent T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
W20260709 13:14:01.873909  2896 log.cc:927] Time spent T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:14:01.804893  2434 consensus_queue.cc:237] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:01.831416  2840 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:01.841264  2836 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:01.916332  2780 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:01.869634  2796 consensus_queue.cc:1059] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:14:01.933393  2796 raft_consensus.cc:3055] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:01.933980  2796 raft_consensus.cc:740] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:01.940156  2851 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:01.869474  2574 raft_consensus.cc:2749] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:14:01.860808  2758 consensus_queue.cc:1048] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:14:01.920923  2904 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:01.922756  2919 consensus_queue.cc:1048] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:14:01.928436  2897 log.cc:927] Time spent T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:14:01.883071  2350 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:14:01.947290  2522 consensus_meta.cc:287] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.665s	user 0.010s	sys 0.005s
W20260709 13:14:01.905874  2901 log.cc:927] Time spent T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.264s	user 0.001s	sys 0.000s
W20260709 13:14:01.950692 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 242781us
W20260709 13:14:01.951238 29524 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.009s	sys 0.016s
W20260709 13:14:01.958736 29524 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.009s	sys 0.016s
W20260709 13:14:01.966259 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 83915.8us
I20260709 13:14:01.947969  2904 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:01.935040  2796 consensus_queue.cc:260] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:01.974269  2456 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:01.990180  2881 consensus_meta.cc:287] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.730s	user 0.015s	sys 0.000s
I20260709 13:14:02.017381  2881 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:02.020341  2881 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:01.960778  2522 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:02.023161  2522 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:02.009150  2840 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:01.985126  2904 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:02.029016 29275 catalog_manager.cc:5697] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 10 to 12, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 12 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:02.032223  2883 consensus_meta.cc:287] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.679s	user 0.014s	sys 0.000s
I20260709 13:14:02.032733  2883 raft_consensus.cc:2749] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:02.033069  2840 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:02.033736  2844 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:02.034471  2837 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:02.035050  2837 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:02.035221  2904 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:02.037644  2904 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:02.033660  2840 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:02.040325  2836 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:14:02.041368  2918 log.cc:927] Time spent T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:14:02.042541  2796 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:02.038823  2837 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:02.044270 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:02.045068 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:02.045439 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:02.047269 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 226138us
I20260709 13:14:02.048288  2769 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:01.996590 29346 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:02.048897  2769 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:02.050504  2574 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:14:02.050439 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 53947.1us
I20260709 13:14:02.051450  2898 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:02.052059  2898 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:02.052431  2860 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:02.053023  2860 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:02.054304  2898 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:02.050863  2928 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:02.055900  2928 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:02.056375  2928 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:14:02.060006  2882 consensus_meta.cc:287] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.565s	user 0.014s	sys 0.000s
I20260709 13:14:02.055341  2860 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:02.060667  2882 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:02.061818  2899 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:02.062908  2882 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:02.064054 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:02.064698 29529 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:14:02.066349  2456 consensus_queue.cc:1048] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:02.066582 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:02.067345 29525 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:14:02.045534 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:02.072824 29421 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:02.050462 29495 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:02.076857 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:02.074146 29421 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:02.077623 29455 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:02.081069 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:02.081979 29447 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:02.086866  2875 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:02.084208  2883 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:02.092039  2883 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:02.092708  2883 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:02.097501  2836 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:14:02.098235  2836 raft_consensus.cc:697] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 22 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:02.099459  2836 consensus_queue.cc:237] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:02.103438 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 53059.9us
I20260709 13:14:02.104413 29495 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:02.106397 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:02.108064  2899 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:02.109011 29275 catalog_manager.cc:5697] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 12 to 14, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 14 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:02.084549  2840 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:02.111574 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:02.113729 29377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52172 (request call id 2434) took 1602 ms. Trace:
W20260709 13:14:02.115541 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:02.116437 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:02.117061 29529 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:02.118240 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:02.119099 29530 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:02.122665 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:02.135355 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:02.136343 29526 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 20.
I20260709 13:14:02.144119 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:02.145069 29526 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:02.146669 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:02.147724 29372 raft_consensus.cc:1240] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 18. Current term is 19. Ops: []
W20260709 13:14:02.129251 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 44540us
I20260709 13:14:02.153606 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:02.051469  2769 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:02.156693  2860 raft_consensus.cc:2749] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:14:02.160466 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:02.161363 29375 raft_consensus.cc:2368] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 15. Current term is 16.
I20260709 13:14:02.164182 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:02.166988 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:02.169366 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:02.172338  2844 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:02.172904  2844 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:02.174925 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:02.114156 29377 rpcz_store.cc:276] 0709 13:14:00.510967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:00.574295 (+ 63328us) service_pool.cc:224] Handling call
0709 13:14:00.574679 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:00.574943 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:14:00.762551 (+187608us) log.cc:844] Serialized 14 byte log entry
0709 13:14:01.463665 (+701114us) spinlock_profiling.cc:243] Waited 3.13 ms on lock 0x7b180030eb60. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c13c0a 00007f6a82353219 00007f6a78c9ba40 00007f6a78c964e4 00007f6a78c96455 00007f6a7f77e3c7 00007f6a7bd909a7 00007f6a7bda00bf 00007f6a7bda0038
0709 13:14:01.463959 (+   294us) log.cc:844] Serialized 14 byte log entry
0709 13:14:02.112215 (+648256us) spinlock_profiling.cc:243] Waited 9.55 ms on lock 0x7b180030eb60. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c13c0a 00007f6a82353219 00007f6a7fc5a58f 00007f6a78c99571 00007f6a78c9b7c1 00007f6a78c9b779 00007f6a78c9b709 00007f6a78c9b6d1 00007f6a78c9a9cd
0709 13:14:02.112795 (+   580us) log.cc:844] Serialized 14 byte log entry
0709 13:14:02.113195 (+   400us) log.cc:844] Serialized 14 byte log entry
0709 13:14:02.113338 (+   143us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:02.113379 (+    41us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:02.113429 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:02.113529 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:02.113671 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":696613,"prepare.queue_time_us":1388629,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":103,"raft.queue_time_us":120320,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":11409,"spinlock_wait_cycles":29176576,"thread_start_us":604181,"threads_started":3,"wal-append.queue_time_us":372622}
I20260709 13:14:02.177834 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:14:02.178205 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 73890.7us
I20260709 13:14:02.179000 29372 raft_consensus.cc:2393] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 22: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:02.182685 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:02.194789 29447 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 18.
W20260709 13:14:02.197551 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:02.180006 29495 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:02.200706 29455 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 23.
W20260709 13:14:02.162220  2915 log.cc:927] Time spent T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.171s	user 0.002s	sys 0.000s
I20260709 13:14:02.210494 29530 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
W20260709 13:14:02.198099 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:02.214967 29421 leader_election.cc:400] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 15. Current term is 16.
I20260709 13:14:02.215365 29421 leader_election.cc:403] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:02.217881 29529 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 19.
I20260709 13:14:02.215320 29526 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:14:02.204463 29525 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 18.
I20260709 13:14:02.205399 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:02.113596  2513 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:02.232581 29344 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:02.221300  2769 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:02.236415  2907 raft_consensus.cc:2804] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:02.236930  2907 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:02.237342  2907 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:02.177598  2882 consensus_queue.cc:1048] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:14:02.212172  2899 raft_consensus.cc:2749] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:14:02.243332  2513 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:02.231794  2818 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:14:02.197099  2834 consensus_queue.cc:1059] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:14:02.261093 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:02.275655 29451 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:02.275556 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:02.276309 29449 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:02.257673 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:02.269959 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:02.250857 29344 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:02.202243  2860 consensus_queue.cc:1059] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:14:02.224517  2902 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:02.266943 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:02.277773 29344 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:02.284814 29344 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:02.287387 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:02.288290 29453 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:02.287096 29344 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:02.294934 29451 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:14:02.289450 29344 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:14:02.301033 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:02.306329 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 126466us
I20260709 13:14:02.297072 29449 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:14:02.282949  2919 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:14:02.318141 29453 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:14:02.331799 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
W20260709 13:14:02.360846  2933 log.cc:927] Time spent T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:14:02.296883  2758 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:14:02.365257 29495 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:02.322350  2522 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:14:02.322953  2919 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:02.369601  2844 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:02.303917  2837 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:14:02.286160  2851 raft_consensus.cc:3055] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:14:02.287451  2790 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:14:02.381424 29419 leader_election.cc:336] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.979s (SENT)
I20260709 13:14:02.370941  2883 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:02.410944 29495 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:02.413774 29419 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:02.425109 29419 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:02.395629  2919 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:02.429092 29495 leader_election.cc:304] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:02.393455  2928 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:02.435133 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:02.284296  2902 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:02.411228  2934 raft_consensus.cc:2749] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:02.436532 29524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 4112) took 1075 ms. Trace:
I20260709 13:14:02.445437 29524 rpcz_store.cc:276] 0709 13:14:01.361008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:01.361237 (+   229us) service_pool.cc:224] Handling call
0709 13:14:01.363968 (+  2731us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:01.959275 (+595307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:01.959328 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:01.985551 (+ 26223us) log.cc:844] Serialized 26 byte log entry
0709 13:14:02.200454 (+214903us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:14:02.200505 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:02.202104 (+  1599us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:02.436312 (+234208us) raft_consensus.cc:1685] finished
0709 13:14:02.436333 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:02.436468 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16327,"raft.queue_time_us":83919,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":100,"thread_start_us":733334,"threads_started":2,"wal-append.queue_time_us":222177}
I20260709 13:14:02.372486  2350 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:02.454051 29419 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:02.410337  2758 raft_consensus.cc:697] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:02.465415  2758 consensus_queue.cc:237] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:02.418520  2522 raft_consensus.cc:697] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:02.426924  2844 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:14:02.468895  2522 consensus_queue.cc:237] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:02.430768  2558 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:02.463447  2840 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:02.463938  2836 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:02.473403  2934 raft_consensus.cc:2749] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:02.473592  2836 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:02.476815  2836 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:02.448591  2837 raft_consensus.cc:697] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:02.479195  2837 consensus_queue.cc:237] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:02.483814 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:02.488272 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 59299.4us
I20260709 13:14:02.496467  2350 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:02.497495 29375 raft_consensus.cc:2393] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 17: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:02.497979  2902 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:02.500085  2513 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:02.433326  2790 raft_consensus.cc:697] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:02.435482  2860 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:14:02.413287  2851 raft_consensus.cc:740] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:02.499395 29495 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:02.435774  2928 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:02.500586  2907 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:02.524979 29495 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:02.514139  2860 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:02.547415 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 221514us
I20260709 13:14:02.542142  2902 raft_consensus.cc:2804] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:02.544518  2351 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:02.561209  2860 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:02.574596 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:02.575533 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:02.568907  2851 consensus_queue.cc:260] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:02.576507 29453 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:02.558897  2928 raft_consensus.cc:2749] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:02.593279 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:02.593847 29373 raft_consensus.cc:1275] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:14:02.594185 29377 raft_consensus.cc:2393] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 16: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:02.599689 29495 leader_election.cc:304] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:02.569419  2902 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:02.608291 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:02.610597 29375 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 16.
I20260709 13:14:02.615774 29453 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:14:02.575711  2351 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:02.602495  2934 raft_consensus.cc:2749] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:02.606530  2902 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:02.632270  2351 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:02.639283  2881 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:02.646193  2837 consensus_queue.cc:1048] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:14:02.647298  2881 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:02.643872 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:02.649631  2881 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:02.649569  2902 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:02.610296  2851 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:02.652952  2902 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:14:02.656009 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 56425.9us
I20260709 13:14:02.660060 29346 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:02.714844 29327 auto_rebalancer.cc:629] Failed to schedule move for tablet 5d440001d38e4a58becc5e57e767a12f: Illegal state: Replica 429e58eb058349e3bf72b5a870c8f6e5 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
W20260709 13:14:02.717404 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 60472.4us
I20260709 13:14:02.574028  2790 consensus_queue.cc:237] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:02.737953 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:02.738678 29521 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:02.741825 29495 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:02.705288  2351 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:14:02.718736 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 58975.3us
W20260709 13:14:02.721670 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:02.720291  2883 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:02.806556 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:02.821404 29530 raft_consensus.cc:2393] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 19: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:02.822630 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:02.823367 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:02.823596 29526 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:14:02.735359  2882 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:02.833082 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 91375.8us
I20260709 13:14:02.836024 29380 raft_consensus.cc:1240] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:02.840955 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:02.841953 29524 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 14.
I20260709 13:14:02.847211 29495 leader_election.cc:400] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 21. Current term is 22.
I20260709 13:14:02.817632  2787 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:02.818850  2928 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:02.855171  2907 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:02.864351  2944 log.cc:927] Time spent T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:14:02.838713  2882 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:02.868297  2946 log.cc:927] Time spent T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
W20260709 13:14:02.870003 29327 auto_rebalancer.cc:629] Failed to schedule move for tablet 4962756209e1496ca6cb92e47ee866b3: Illegal state: Replica 183db85c071f489fbc8de63a9edd8a3a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:02.870298  2882 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:02.744514  2899 consensus_queue.cc:1059] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.094s
W20260709 13:14:02.880153 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 46268.7us
I20260709 13:14:02.887743 29521 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:14:02.838047  2883 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:14:03.080441 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 197697us
I20260709 13:14:02.875262  2787 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:03.097935 29419 leader_election.cc:336] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 2.748s (SENT)
W20260709 13:14:03.092638 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 254314us
I20260709 13:14:02.894838  2919 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:03.094985 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 279053us
I20260709 13:14:03.118016 29495 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:03.124155 29495 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:02.906616  2883 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:03.155860  2787 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:03.106619  2456 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:03.106915  2836 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:03.130621  2844 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:14:03.152964  2851 consensus_meta.cc:287] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.501s	user 0.010s	sys 0.001s
I20260709 13:14:03.137187  2928 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:14:03.156214  2961 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:03.091745  2899 consensus_queue.cc:1059] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
W20260709 13:14:03.167984 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 43989.2us
W20260709 13:14:03.071019  2818 consensus_meta.cc:287] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.790s	user 0.016s	sys 0.001s
I20260709 13:14:03.177085  2919 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:03.177467  2952 log.cc:927] Time spent T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 13:14:03.168725 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 57309.9us
I20260709 13:14:03.195840 29346 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:03.181594 29495 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:03.177798  2928 raft_consensus.cc:697] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 18 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
W20260709 13:14:03.191135  2954 log.cc:927] Time spent T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.447s	user 0.000s	sys 0.001s
I20260709 13:14:03.180174  2769 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:14:03.213641 29495 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
W20260709 13:14:03.223644 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 112342us
I20260709 13:14:03.164822  2456 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:03.191530  2960 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:03.199219  2818 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 15. Current term is 16.
I20260709 13:14:03.178277  2844 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:03.225318  2957 log.cc:927] Time spent T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.161s	user 0.000s	sys 0.002s
I20260709 13:14:03.166226  2836 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:03.210274  2851 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:03.250304 29346 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:03.183668  2961 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:03.257741  2844 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:03.258546  2928 consensus_queue.cc:237] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:03.257741  2961 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:03.247732  2960 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:03.244175  2351 raft_consensus.cc:697] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:03.266044  2960 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:03.265838  2351 consensus_queue.cc:237] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:03.268731 29419 leader_election.cc:336] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.650s (SENT)
I20260709 13:14:03.269383 29419 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:03.278105 29455 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:14:03.239157  2837 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:14:03.540616 29493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 350617us
I20260709 13:14:03.283591  2818 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:14:03.542804 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:03.538532 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 131981us
I20260709 13:14:03.406390  2962 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:14:03.499754  2954 log.cc:927] Time spent T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
W20260709 13:14:03.551643 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 309548us
W20260709 13:14:03.560529 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 350406us
W20260709 13:14:03.548084  2788 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.051s	sys 0.052s
W20260709 13:14:03.569902 29327 auto_rebalancer.cc:629] Failed to schedule move for tablet f343c91124ea4cd5b19e26f3530e1247: Illegal state: Replica 183db85c071f489fbc8de63a9edd8a3a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
W20260709 13:14:03.570752 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 366539us
I20260709 13:14:03.281656  2851 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:03.577889 29495 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:14:03.578634  2788 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.052s	sys 0.052s
I20260709 13:14:03.543509  2837 raft_consensus.cc:697] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:03.544915  2434 raft_consensus.cc:3055] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:14:03.592824  2434 raft_consensus.cc:740] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
W20260709 13:14:03.642916 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 75827.3us
I20260709 13:14:03.626922  2883 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:03.639189  2972 raft_consensus.cc:2804] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:14:03.692489  2860 consensus_meta.cc:287] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 1.100s	user 0.015s	sys 0.001s
I20260709 13:14:03.710528  2860 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:03.713011  2860 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:03.683012  2976 raft_consensus.cc:2804] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:03.700379  2975 raft_consensus.cc:2764] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election decision vote started in defunct term 17: won
I20260709 13:14:03.683176  2434 consensus_queue.cc:260] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:03.716984  2976 raft_consensus.cc:697] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:03.720008  2851 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:03.720595  2976 consensus_queue.cc:237] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:03.717237  2456 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:03.718935  2972 raft_consensus.cc:697] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:03.725322  2972 consensus_queue.cc:237] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:03.730993 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 153243us
I20260709 13:14:03.733006 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:03.718966  2434 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:03.753353 29375 raft_consensus.cc:1275] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:14:03.727908  2962 raft_consensus.cc:697] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:03.744585  2964 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:03.784855  2962 consensus_queue.cc:237] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:03.792505  2883 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:03.793507  2883 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:03.797967  2883 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:03.799695  2883 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:03.800820  2883 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:03.744285  2456 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:03.803911  2456 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:03.761816 29495 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:03.807456  2985 raft_consensus.cc:2804] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:03.808085  2975 consensus_queue.cc:1048] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
W20260709 13:14:03.808781 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 47222.6us
I20260709 13:14:03.811570  2964 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:03.813145 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:03.817572 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:03.818509 29451 raft_consensus.cc:2393] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 18: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:03.818464  2836 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:03.713676  2860 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:03.682710  2837 consensus_queue.cc:237] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:03.823542 29455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45798 (request call id 3214) took 1567 ms. Trace:
I20260709 13:14:03.824028 29455 rpcz_store.cc:276] 0709 13:14:02.256588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.257412 (+   824us) service_pool.cc:224] Handling call
0709 13:14:03.823328 (+1565916us) spinlock_profiling.cc:243] Waited 990 ms on lock 0x7b54002918d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:14:03.823455 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2276570496}
I20260709 13:14:03.841437  2836 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:03.826745  2985 raft_consensus.cc:697] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:03.844487  2456 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:03.872038 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:03.872206 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:03.873414  2983 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:03.853915  2836 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:03.876371 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:03.876645  2983 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:03.878259  2836 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:03.879163 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:03.879550 29455 raft_consensus.cc:2468] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 12.
I20260709 13:14:03.880095 29451 raft_consensus.cc:2410] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:14:03.881840 29380 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 18.
I20260709 13:14:03.883013 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:03.852722  2984 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:03.885468 29374 raft_consensus.cc:2410] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:14:03.878942  2983 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:03.885536 29530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53428 (request call id 928) took 1052 ms. Trace:
W20260709 13:14:03.890997 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 239459us
W20260709 13:14:03.892261 29419 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.009s	sys 0.010s
W20260709 13:14:03.893870 29419 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.009s	sys 0.010s
I20260709 13:14:03.896006 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:03.896942 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:03.896971 29374 raft_consensus.cc:2368] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 21. Current term is 22.
W20260709 13:14:03.899148 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:03.900085 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:03.900957 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:14:03.902148 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 622752us
I20260709 13:14:03.841862  2860 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:03.908926 29346 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:03.903270 29344 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:03.891317 29530 rpcz_store.cc:276] 0709 13:14:02.832706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.832861 (+   155us) service_pool.cc:224] Handling call
0709 13:14:02.833188 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:02.833386 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:14:03.406829 (+573443us) log.cc:844] Serialized 14 byte log entry
0709 13:14:03.883289 (+476460us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:03.883376 (+    87us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:03.883454 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:03.883594 (+   140us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:03.885454 (+  1860us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":156869,"prepare.queue_time_us":272701,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":4302,"raft.queue_time_us":95403,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"spinlock_wait_cycles":37445888,"thread_start_us":649757,"threads_started":3,"wal-append.queue_time_us":308899}
I20260709 13:14:03.925420 29344 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:03.927305 29344 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:03.928031  2456 raft_consensus.cc:2804] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:03.928279 28234 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:14:03.928531  2456 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:03.928951  2989 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:03.931771  2983 raft_consensus.cc:2804] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:03.932313  2983 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:03.932396 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:03.932750  2983 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:03.933158 29452 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 18.
I20260709 13:14:03.933660 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:03.934379 29453 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16.
I20260709 13:14:03.934552 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:03.935231 29447 raft_consensus.cc:2468] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
I20260709 13:14:03.929081  2456 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:03.935690 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:03.937481 29448 raft_consensus.cc:1240] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 15. Current term is 16. Ops: []
I20260709 13:14:03.938081 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:03.939134 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:03.940241 29375 raft_consensus.cc:1240] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:14:03.940282 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:03.927204 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:03.943053 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:03.943857 29372 raft_consensus.cc:1240] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:14:03.940663 29373 raft_consensus.cc:2393] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 16: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
W20260709 13:14:03.944568 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 195817us
I20260709 13:14:03.946161 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:03.948683 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:03.904227  2928 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:03.805528  2883 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:03.950277 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:03.944152 28234 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:03.952180 29380 raft_consensus.cc:1240] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 15. Current term is 16. Ops: []
I20260709 13:14:03.953512 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:03.953913 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:03.954635 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:03.955019 29372 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:03.956179 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:03.957229 29451 raft_consensus.cc:2393] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 16: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:03.958169 29375 raft_consensus.cc:1240] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 20. Current term is 22. Ops: [18.10-20.11]
I20260709 13:14:03.958191 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:03.958786 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:03.959640 29381 raft_consensus.cc:2393] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 21: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
W20260709 13:14:03.963730 29419 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.944s (SENT) [suppressed 19 similar messages]
I20260709 13:14:03.957432 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:03.969031 29379 raft_consensus.cc:1240] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:14:03.975147 29448 raft_consensus.cc:1240] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 22. Current term is 23. Ops: []
W20260709 13:14:03.966682 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:03.892786  2984 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:03.983275 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:03.984098 29451 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:14:03.992673 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:03.957908  2928 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:03.998759  2928 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:03.968709  2985 consensus_queue.cc:237] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:03.968966  2995 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:14:04.005389 29374 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16.
W20260709 13:14:04.006151 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 51448.2us
I20260709 13:14:04.003355 29451 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 14.
I20260709 13:14:04.010983 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:04.011910 29447 raft_consensus.cc:2376] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16. Re-sending same reply.
I20260709 13:14:04.015362 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:04.020124 29372 raft_consensus.cc:2410] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:14:04.020944 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:03.980826  2883 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:04.020403 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:14:04.037176 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:04.037840 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:04.033216 29451 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
I20260709 13:14:04.033788 29448 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 18.
I20260709 13:14:04.042145 29421 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:04.043661 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:04.009200  2860 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:04.043306 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:04.048576 29525 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:04.018061  2984 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:04.054452 29524 raft_consensus.cc:1275] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:14:04.041261  2818 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.055254  2818 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:04.050763 29378 raft_consensus.cc:1240] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:14:04.042450  2883 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:04.058039  2818 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:04.058758  2818 raft_consensus.cc:2804] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:04.059149  2818 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:04.049865  2836 consensus_queue.cc:1048] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:14:04.050251 29451 raft_consensus.cc:1275] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:14:04.039880  2558 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:04.054085 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:04.060024 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:14:04.092480 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:04.066053 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:04.099181 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:04.065318 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:04.068511 29451 raft_consensus.cc:1275] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:14:04.100761 29455 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 18.
I20260709 13:14:04.102062 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:14:04.062811 30120 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.009s	sys 0.011s
I20260709 13:14:04.108814 29374 raft_consensus.cc:1240] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 15. Current term is 16. Ops: []
I20260709 13:14:04.109051 29377 raft_consensus.cc:1240] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 15. Current term is 16. Ops: []
I20260709 13:14:04.111174 29374 raft_consensus.cc:1240] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 20. Current term is 21. Ops: []
I20260709 13:14:04.111232 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:04.119796 29456 raft_consensus.cc:1275] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:14:04.158644  2928 raft_consensus.cc:493] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:04.159410  2928 raft_consensus.cc:515] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:04.161213 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:04.161893  2928 leader_election.cc:290] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:04.161994 29528 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 18.
I20260709 13:14:04.165405 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:04.171212 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:04.182942  2836 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.183965  2836 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:04.187455 29530 raft_consensus.cc:1275] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 13:14:04.188305 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 80945.5us
I20260709 13:14:04.189152 29521 raft_consensus.cc:2393] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 21: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:04.189610 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:04.192112 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:04.193805 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:04.197065 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:04.199400 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:04.193131 29375 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 17.
I20260709 13:14:04.063836  2984 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.059607  2818 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:04.059473  2883 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:04.202700 29525 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:14:04.216619 29346 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:04.208900 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:04.196112  2989 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:04.221647 29346 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:04.062770  2558 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:04.217479  2957 log.cc:927] Time spent T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:14:04.203984  2788 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.211010  2881 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.233156 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:04.233995 29419 leader_election.cc:336] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.746s (SENT)
I20260709 13:14:04.186936  2456 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:04.205962  2350 raft_consensus.cc:493] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
W20260709 13:14:04.241132 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 199048us
I20260709 13:14:04.244655 29523 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:14:04.244964 29419 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:04.225456  2928 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:04.230063  2962 raft_consensus.cc:2804] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:04.224907  2837 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:04.269542 29526 raft_consensus.cc:3055] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:14:04.283743 29530 raft_consensus.cc:1275] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:14:04.298744 29526 raft_consensus.cc:740] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:04.225235  2860 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:04.227761 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:04.208634  2984 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:04.294034 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:04.264603  2985 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:04.268265  2976 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:04.357213 29373 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
I20260709 13:14:04.285007  2881 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:04.352387 29526 consensus_queue.cc:260] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:04.358456 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 64541.9us
W20260709 13:14:04.436993  2945 log.cc:927] Time spent T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 1.693s	user 0.014s	sys 0.016s
I20260709 13:14:04.482880 29526 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:14:04.483349 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:04.288805  2350 raft_consensus.cc:515] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:04.395746  2976 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:04.414552  3007 consensus_queue.cc:1048] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:04.247085  2788 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:04.345132  2434 raft_consensus.cc:493] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:04.391880  2456 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:04.362171  2860 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:04.379908  2985 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:04.545940  2985 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:04.271447  2983 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:04.548900  2983 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:04.386920  2984 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:04.450354 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:04.550420 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:04.288813  2836 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:04.454931  2964 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:04.247994  2959 consensus_queue.cc:1048] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.120s
I20260709 13:14:04.396413  3008 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:04.551324  2836 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.389976  2558 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:04.551805  3008 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:04.552006  2836 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:04.296973  2928 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:04.554792  2928 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:04.554953  2836 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:04.297415  2837 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:04.421693  2790 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:04.578471  2928 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:04.587805  2837 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:04.587970  2790 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:04.588277  2928 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:04.590487  2790 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:04.229535  2995 raft_consensus.cc:697] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:04.295341  2962 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:04.575356  2860 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:04.592417  2962 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:14:04.593302  2981 log.cc:927] Time spent T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.877s	user 0.009s	sys 0.013s
W20260709 13:14:04.522019 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:04.554718  3008 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:04.500180  2818 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:04.598237  2818 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:04.484229  2796 raft_consensus.cc:493] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:04.599359  2995 consensus_queue.cc:237] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:04.600684  2796 raft_consensus.cc:515] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:04.602866  2796 leader_election.cc:290] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:04.525535  2788 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:04.525902  2976 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:04.542275  2881 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:04.603937  2976 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:04.379598  3010 log.cc:927] Time spent T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:14:04.557943  3004 log.cc:927] Time spent T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 13:14:04.563694  3013 raft_consensus.cc:2749] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:04.565696 29372 raft_consensus.cc:1240] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:04.568127 29450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 3217) took 2310 ms. Trace:
I20260709 13:14:04.570093  2350 leader_election.cc:290] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:14:04.570847  3005 log.cc:927] Time spent T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 13:14:04.574261 29495 connection.cc:256] RPC call timeout handler was delayed by -2.5101799320000282s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1539s for a response
W20260709 13:14:04.555423 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:04.658972 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:04.618243 29450 rpcz_store.cc:276] 0709 13:14:02.257476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.259123 (+  1647us) service_pool.cc:224] Handling call
0709 13:14:02.259447 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:02.259822 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:02.259855 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:02.260338 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 13:14:02.569855 (+309517us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:14:02.571255 (+  1400us) log.cc:844] Serialized 14 byte log entry
0709 13:14:02.571564 (+   309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:02.572210 (+   646us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:03.409839 (+837629us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b18003a1aa0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c99522 00007f6a78c9b7c1 00007f6a78c9b779 00007f6a78c9b709 00007f6a78c9b6d1 00007f6a78c9a9cd 000000000038f354 000000000038f199 00007f6a78c7c83a
0709 13:14:03.820004 (+410165us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b18003a1aa0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c993f3 00007f6a78c9b7c1 00007f6a78c9b779 00007f6a78c9b709 00007f6a78c9b6d1 00007f6a78c9a9cd 000000000038f354 000000000038f199 00007f6a78c7c83a
0709 13:14:04.286313 (+466309us) spinlock_profiling.cc:243] Waited 4.73 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:14:04.567837 (+281524us) raft_consensus.cc:1685] finished
0709 13:14:04.567866 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:04.568028 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1953,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":190,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":3320,"spinlock_wait_cycles":20510720,"thread_start_us":309059,"threads_started":1,"wal-append.queue_time_us":357642}
W20260709 13:14:04.659802 29495 connection.cc:256] RPC call timeout handler was delayed by -2.4309799319999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1627s for a response
W20260709 13:14:04.660221 29495 connection.cc:256] RPC call timeout handler was delayed by -2.3832799320000504s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.168s for a response
W20260709 13:14:04.660632 29495 connection.cc:256] RPC call timeout handler was delayed by -2.3652799320000213s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17s for a response
W20260709 13:14:04.660998 29495 connection.cc:256] RPC call timeout handler was delayed by -2.3499799319999966s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17170000000000002s for a response
W20260709 13:14:04.661347 29495 connection.cc:256] RPC call timeout handler was delayed by -2.2752799320001031s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18000000000000002s for a response
W20260709 13:14:04.661700 29495 connection.cc:256] RPC call timeout handler was delayed by -2.21767993200001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1864s for a response
W20260709 13:14:04.662051 29495 connection.cc:256] RPC call timeout handler was delayed by -2.1600799319999169s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1928s for a response
W20260709 13:14:04.662438 29495 connection.cc:256] RPC call timeout handler was delayed by -2.1438799319998907s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1946s for a response
W20260709 13:14:04.662807 29495 connection.cc:256] RPC call timeout handler was delayed by -2.1411799319998863s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19490000000000002s for a response
W20260709 13:14:04.663144 29495 connection.cc:256] RPC call timeout handler was delayed by -2.0763799320000089s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2021s for a response
W20260709 13:14:04.663893 29495 connection.cc:256] RPC call timeout handler was delayed by -1.9701799320000646s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21389999999999998s for a response
W20260709 13:14:04.664369 29495 connection.cc:256] RPC call timeout handler was delayed by -1.96117993200005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2149s for a response
W20260709 13:14:04.664822 29495 connection.cc:256] RPC call timeout handler was delayed by -1.9530799320000369s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2158s for a response
W20260709 13:14:04.665432 29495 connection.cc:256] RPC call timeout handler was delayed by -1.5597799320000831s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2595s for a response
I20260709 13:14:04.667546 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:04.668519 29521 raft_consensus.cc:2368] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 16. Current term is 17.
I20260709 13:14:04.670609 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:04.613175 29526 raft_consensus.cc:1275] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:14:04.604496  2976 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:04.640770 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 354861us
I20260709 13:14:04.577315  2434 raft_consensus.cc:515] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:04.672233 29526 pending_rounds.cc:85] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 9
I20260709 13:14:04.673411 29526 pending_rounds.cc:107] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:14:04.673834 29526 raft_consensus.cc:2889] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:14:04.669602 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 440753us
I20260709 13:14:04.590512  2928 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:04.676739 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:04.715201 29526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 4152) took 1887 ms. Trace:
I20260709 13:14:04.715873 29526 rpcz_store.cc:276] 0709 13:14:02.828096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.828249 (+   153us) service_pool.cc:224] Handling call
0709 13:14:02.828622 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:04.269278 (+1440656us) spinlock_profiling.cc:243] Waited 66.6 ms on lock 0x7b5400460120. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bcfddc0 00007f6a7bd881c0 00007f6a7bd89231 00007f6a7bd85d8f 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c
0709 13:14:04.714740 (+445462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:04.715111 (+   371us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":153225088}
I20260709 13:14:04.727999 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:04.728405 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:04.729360 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:04.730480 29375 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 16.
I20260709 13:14:04.741236 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:04.744663 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:04.758061 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:14:04.723080  2902 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 13:14:04.773955 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:04.714947  2836 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:14:04.785786 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 551822us
W20260709 13:14:04.786587 29419 leader_election.cc:336] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.840s (SENT)
I20260709 13:14:04.783275 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:04.722782  2818 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:04.786682 29530 raft_consensus.cc:1240] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:14:04.723275  2787 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:04.781188 29346 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:04.787403 29377 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:04.777029 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:04.805785 29526 raft_consensus.cc:1240] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 15. Current term is 17. Ops: []
I20260709 13:14:04.822539 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:04.812616 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:04.849551 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:04.771658 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
W20260709 13:14:04.809248  3004 log.cc:927] Time spent T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:14:04.811029 29523 raft_consensus.cc:1275] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:14:04.810413 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:04.674969  2769 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.426s	user 0.010s	sys 0.013s
I20260709 13:14:04.815810 29421 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:14:04.869364  2968 log.cc:927] Time spent T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 1.613s	user 0.003s	sys 0.008s
I20260709 13:14:04.879681 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:04.863337 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:04.839955 29521 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:14:04.881620 29376 raft_consensus.cc:1240] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 22. Current term is 23. Ops: []
I20260709 13:14:04.841171 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:04.839540  2350 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:04.810992 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:04.887732 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:04.889385 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:14:04.891819 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 76154.5us
W20260709 13:14:04.868291  2769 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.624s	user 0.011s	sys 0.013s
I20260709 13:14:04.897636 29525 raft_consensus.cc:1240] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:14:04.804872  2836 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:04.790372  2907 consensus_queue.cc:1048] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.078s
W20260709 13:14:04.878682  2899 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.667s	user 0.018s	sys 0.038s
W20260709 13:14:04.862699  2949 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.147s	user 0.009s	sys 0.043s
I20260709 13:14:04.932967 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:04.865825  3013 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:04.839784  2787 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:14:04.940613 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 152216us
I20260709 13:14:04.920120 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:04.924557 29421 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:04.869928  2960 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
W20260709 13:14:04.897291  2980 log.cc:927] Time spent T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 1.182s	user 0.010s	sys 0.005s
I20260709 13:14:04.856699  2522 consensus_queue.cc:1048] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:14:04.808614  2818 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:04.886709  2350 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:04.932693  2899 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.725s	user 0.018s	sys 0.038s
I20260709 13:14:04.947286  2990 consensus_queue.cc:1048] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:14:04.950851 29419 leader_election.cc:336] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.790s (SENT)
I20260709 13:14:04.953549 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:04.871869  2837 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:04.954533 29344 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:04.937140  2949 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.218s	user 0.009s	sys 0.044s
I20260709 13:14:04.900451  3015 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:14:04.986197 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:04.907008  2840 consensus_queue.cc:1059] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:14:04.919390  2558 consensus_queue.cc:1059] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:14:04.981805  2899 consensus_queue.cc:1243] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer 429e58eb058349e3bf72b5a870c8f6e5 log is divergent from this leader: its last log entry 20.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:14:04.975450  2350 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:14:04.998577 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:05.004778 29529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 4144) took 2281 ms. Trace:
I20260709 13:14:05.006109 29529 rpcz_store.cc:276] 0709 13:14:02.722949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:02.723129 (+   180us) service_pool.cc:224] Handling call
0709 13:14:02.723579 (+   450us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:02.729980 (+  6401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:02.730049 (+    69us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:02.753618 (+ 23569us) log.cc:844] Serialized 52 byte log entry
0709 13:14:03.190997 (+437379us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:14:03.191095 (+    98us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:03.191158 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:04.677009 (+1485851us) spinlock_profiling.cc:243] Waited 25.4 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:14:05.000166 (+323157us) raft_consensus.cc:1685] finished
0709 13:14:05.000190 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:05.004697 (+  4507us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10965,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":63230,"spinlock_wait_cycles":58509568,"thread_start_us":344403,"threads_started":1,"wal-append.queue_time_us":429000}
I20260709 13:14:04.902873  2769 raft_consensus.cc:697] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:05.009166 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.004662 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:05.015848 29527 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:14:05.012004 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 57605.5us
I20260709 13:14:05.016913 29344 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:05.018426 29529 raft_consensus.cc:2393] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 18: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:05.018981 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:04.963538  2984 consensus_queue.cc:1048] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:14:05.015082 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.003968  2434 leader_election.cc:290] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:04.955839  2960 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:05.030334 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.025497 29344 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:04.944115  3013 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:14:05.049247 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:05.064389 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:05.065135 29421 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:05.074047 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.079053 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.080902 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.016985  2976 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:05.019853  2779 raft_consensus.cc:2749] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:14:05.085657 29527 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 12.
I20260709 13:14:05.033955  2964 raft_consensus.cc:2804] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:14:05.092818 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.091073 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:05.063530  3023 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:05.093500 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:05.098268 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.102860 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.104518  2837 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:05.106727 29527 raft_consensus.cc:1240] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:14:05.108863 29527 raft_consensus.cc:1240] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:14:05.111581 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:05.111552 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:05.121133 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:05.121529 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:05.123358 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 97990.6us
I20260709 13:14:05.123606  2989 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:05.124125  2989 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:05.124524  2989 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:05.126016  2995 consensus_queue.cc:1048] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:05.127842  2788 consensus_queue.cc:1048] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:05.130303 29372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52172 (request call id 2462) took 1026 ms. Trace:
I20260709 13:14:05.130851 29372 rpcz_store.cc:276] 0709 13:14:04.103829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:04.104000 (+   171us) service_pool.cc:224] Handling call
0709 13:14:04.565420 (+461420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:04.618203 (+ 52783us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:05.130079 (+511876us) spinlock_profiling.cc:243] Waited 461 ms on lock 0x7b54001ee950. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd858ad 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:14:05.130219 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1060112256}
I20260709 13:14:05.140058 29344 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:05.141930  2995 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.145459  2995 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:05.147748  3017 consensus_queue.cc:1059] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.200s
I20260709 13:14:05.093027  3021 raft_consensus.cc:2804] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:05.164193 29376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 1984) took 1206 ms. Trace:
I20260709 13:14:05.165213 29376 rpcz_store.cc:276] 0709 13:14:03.957719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:03.958007 (+   288us) service_pool.cc:224] Handling call
0709 13:14:03.958340 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:04.882164 (+923824us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:05.157458 (+275294us) spinlock_profiling.cc:243] Waited 923 ms on lock 0x7b54003903d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:14:05.164111 (+  6653us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2122892288}
I20260709 13:14:05.167229 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.172478 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.154935 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:05.156731 29526 raft_consensus.cc:3055] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:14:05.173672 29526 raft_consensus.cc:740] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:05.174685 29526 consensus_queue.cc:260] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:05.175836 29526 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:05.177906 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.178915 29523 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:14:05.180749 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:05.154039  3026 log.cc:927] Time spent T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:14:05.152446 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.183804 29524 raft_consensus.cc:2410] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:14:05.173830 29528 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 16.
I20260709 13:14:05.200248 29524 raft_consensus.cc:3055] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:14:05.201462 29524 raft_consensus.cc:740] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:05.117146  2964 raft_consensus.cc:697] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:05.210865 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:05.148393  2995 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:05.149236  2837 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:05.173321  3021 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:05.214093 29377 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 17.
I20260709 13:14:05.223717 29527 raft_consensus.cc:2393] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 17: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:05.111016  3023 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:05.232689 29526 raft_consensus.cc:1275] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 12. (term mismatch)
I20260709 13:14:05.342023 29526 pending_rounds.cc:85] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 11
I20260709 13:14:05.342388 29526 pending_rounds.cc:107] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 22.12
I20260709 13:14:05.233884 29528 raft_consensus.cc:3055] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:14:05.342890 29528 raft_consensus.cc:740] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:05.222018 29524 consensus_queue.cc:260] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:05.267553 29523 raft_consensus.cc:2393] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 18: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:14:05.300069 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:05.315891 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:05.342730 29526 raft_consensus.cc:2889] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:05.349733 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.096527  2769 consensus_queue.cc:237] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:05.347278 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.350656 29527 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 17.
I20260709 13:14:05.347860 29524 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:05.353855 29528 consensus_queue.cc:260] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:05.358000 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.358351 29528 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:05.359083 29527 raft_consensus.cc:2410] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 19 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:14:05.216915  3015 raft_consensus.cc:697] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 18 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:05.360558 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.360607 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:05.379982 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:05.382042 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:05.342724  3032 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.363464 29450 raft_consensus.cc:1275] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:14:05.345968  3026 log.cc:927] Time spent T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:14:05.387728 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.367990 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:14:05.368261 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 303180us
W20260709 13:14:05.389451 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:05.369287 29529 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 21.
I20260709 13:14:05.341657  2434 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.357328 29523 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 17.
I20260709 13:14:05.341333  3021 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:05.386462 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:05.361676  3036 raft_consensus.cc:3055] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:14:05.394016 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.395634 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.402067 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.397456 29447 raft_consensus.cc:2410] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:14:05.361812  2836 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:05.356575  2787 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:05.403800 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:05.405925 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:05.407612 29456 raft_consensus.cc:2410] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 23 because replica has last-logged OpId of term: 21 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 9.
I20260709 13:14:05.407789 29451 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:05.410089 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.394683  2818 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:05.414543 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.416396 29447 raft_consensus.cc:1275] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:14:05.418401 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:05.421555 29455 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:14:05.403033  3017 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.424396 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:05.425556 29526 raft_consensus.cc:2393] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 18: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:05.400863  3036 raft_consensus.cc:740] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:05.430325 29455 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 12.
W20260709 13:14:05.431704  3030 log.cc:927] Time spent T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:14:05.404670  2851 raft_consensus.cc:3055] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:14:05.404814  3037 raft_consensus.cc:2804] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:05.434506 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.434160 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:14:05.437719  3028 log.cc:927] Time spent T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 13:14:05.440399 29455 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:05.412874  2960 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:05.400552  2434 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:05.425428  2836 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.394835  3032 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:05.445011 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:05.432381  3013 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:05.449976 29526 raft_consensus.cc:2376] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 12. Re-sending same reply.
W20260709 13:14:05.453428 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:05.436817  2851 raft_consensus.cc:740] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:05.458110 29451 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:14:05.463367 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:05.464277 29451 raft_consensus.cc:2468] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:14:05.471658 29455 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:14:05.476123 29455 raft_consensus.cc:1275] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:14:05.483587 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:05.442929  3042 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.484328 29451 raft_consensus.cc:2468] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 9.
I20260709 13:14:05.405293  2964 consensus_queue.cc:237] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:05.485139 29454 raft_consensus.cc:1275] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:14:05.434850  3017 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:05.485726 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.491585 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.497093 29526 raft_consensus.cc:1240] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:05.432169  3015 consensus_queue.cc:237] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:05.497999 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.512220 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.513172 29524 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 16.
I20260709 13:14:05.449569  2836 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:05.522122 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:05.525369 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.526010 29524 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 23.
I20260709 13:14:05.528613 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.517669  2997 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:05.539806 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.542848 29524 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 16.
I20260709 13:14:05.489300  3042 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:05.547039 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:05.487553  3036 consensus_queue.cc:260] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:05.541220  2962 consensus_meta.cc:287] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.948s	user 0.016s	sys 0.000s
I20260709 13:14:05.535064  3023 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:05.537241 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:05.572336  3032 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:05.573597  2434 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:05.575142  3017 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:05.575985 29523 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:05.581475  3042 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:05.545636  2997 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:05.583052  2934 raft_consensus.cc:3055] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:14:05.520840  2851 consensus_queue.cc:260] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:05.590021 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.590934 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.591274 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.597955 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.598347 29528 raft_consensus.cc:1275] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:14:05.566828  2989 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:05.611960 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.615173 29524 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:14:05.617942 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 85379.6us
I20260709 13:14:05.613860  3038 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:05.660048 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.660967 29526 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 18.
I20260709 13:14:05.662680 29521 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 16.
W20260709 13:14:05.671609  3054 log.cc:927] Time spent T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:14:05.629024  2934 raft_consensus.cc:740] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:05.684201 29523 raft_consensus.cc:1275] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:14:05.622175  2962 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:05.682346 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:05.664637  2350 consensus_meta.cc:287] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.647s	user 0.011s	sys 0.003s
I20260709 13:14:05.663287  3038 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:05.692528 29524 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 17.
W20260709 13:14:05.695688 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:05.697789  2997 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:05.675801  2836 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:05.712785 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 52429.5us
I20260709 13:14:05.714346 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.719097 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:05.719748  3057 log.cc:927] Time spent T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:14:05.720129 29524 raft_consensus.cc:2393] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 17: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:05.720618  3038 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:05.692078  2350 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:05.723098  3061 log.cc:927] Time spent T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:14:05.724818  2350 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:05.725302  2934 consensus_queue.cc:260] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 21.9, Last appended by leader: 9, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:05.729691 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:05.730484 29448 raft_consensus.cc:2468] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 8.
I20260709 13:14:05.717985  3021 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:05.734969 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.735424  3021 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:05.735782 29530 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 19.
I20260709 13:14:05.736876 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.737555 29521 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 17.
I20260709 13:14:05.740149 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:05.741349 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:05.741430 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.742125 29525 raft_consensus.cc:2393] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 18: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:05.742029 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.743084 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.745119 29374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1022) took 1253 ms. Trace:
I20260709 13:14:05.745641 30121 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:14:05.745530 29374 rpcz_store.cc:276] 0709 13:14:04.491881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:04.492069 (+   188us) service_pool.cc:224] Handling call
0709 13:14:04.492589 (+   520us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:04.591742 (+ 99153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:04.591779 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:04.591828 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:14:04.591860 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:05.744843 (+1152983us) spinlock_profiling.cc:243] Waited 98.9 ms on lock 0x7b5400190d54. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:14:05.744894 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:05.745039 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":227483904}
I20260709 13:14:05.750379 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.751109  2989 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:05.751278  3025 log.cc:927] Time spent T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.732s	user 0.002s	sys 0.011s
I20260709 13:14:05.730762  2934 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:05.751714  2996 raft_consensus.cc:2804] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:14:05.755820  2996 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:05.756367  2996 raft_consensus.cc:3060] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:05.768792 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.770066 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.769706 29527 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 22.
I20260709 13:14:05.774117 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.775215 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.776065 29527 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 17.
W20260709 13:14:05.776224 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:05.783564 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
W20260709 13:14:05.784047 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:05.784572 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:05.784927 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:05.785475 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:05.785995 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:05.786338 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:05.786418 29495 leader_election.cc:400] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 17. Current term is 18.
I20260709 13:14:05.786803 29495 leader_election.cc:403] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:14:05.787807  3037 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:05.788370  3037 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:05.788479  2434 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:05.789302  2434 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:05.792374 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:05.792480 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:05.793072 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:05.787663 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.793617 29530 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:14:05.793807 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:05.794150 29419 leader_election.cc:336] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.693s (SENT)
I20260709 13:14:05.794499 29419 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:05.794555 29526 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 22.
I20260709 13:14:05.792954 29495 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:05.799475  3023 raft_consensus.cc:2749] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:05.800208  2883 raft_consensus.cc:2749] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:05.801277  2434 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:05.797948 29495 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:05.812675  2434 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:05.813576 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:05.798106  2934 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 17. Current term is 18.
I20260709 13:14:05.815927  3036 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:14:05.817829 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:05.831046 29346 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:05.812481 29495 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:05.836231 29530 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 18.
I20260709 13:14:05.843577  2989 raft_consensus.cc:2749] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:05.844583  2962 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:05.745023 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:05.835176  2996 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:05.847065 30153 raft_consensus.cc:1240] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 8. Current term is 9. Ops: []
I20260709 13:14:05.846861  2978 consensus_queue.cc:1048] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:05.850376 29346 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:05.852393 29346 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:05.854225 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:05.854889 29522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37968 (request call id 4183) took 1042 ms. Trace:
I20260709 13:14:05.855650 29495 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:05.855295 29522 rpcz_store.cc:276] 0709 13:14:04.812145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:04.812314 (+   169us) service_pool.cc:224] Handling call
0709 13:14:05.854688 (+1042374us) spinlock_profiling.cc:243] Waited 638 ms on lock 0x7b54000fa5d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:14:05.854821 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1468497280}
W20260709 13:14:05.861693 29419 leader_election.cc:336] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.775s (SENT)
I20260709 13:14:05.861764 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:05.861949 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:05.862325 29419 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:05.862920 29530 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:05.867754 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:14:05.870050 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:05.871755 29379 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58422 (request call id 1025) took 1351 ms. Trace:
W20260709 13:14:05.812470  2840 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.799s	user 0.017s	sys 0.017s
I20260709 13:14:05.851447  2646 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:05.874089 29344 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:05.851670  3037 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:05.872176 29379 rpcz_store.cc:276] 0709 13:14:04.520721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:04.521110 (+   389us) service_pool.cc:224] Handling call
0709 13:14:04.543383 (+ 22273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:04.576867 (+ 33484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:04.576915 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:04.576975 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:14:04.577021 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:05.871293 (+1294272us) spinlock_profiling.cc:243] Waited 33.2 ms on lock 0x7b5400081954. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:14:05.871350 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:05.871691 (+   341us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":76336000}
W20260709 13:14:05.875682 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:05.887585  3037 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:05.872645  2978 raft_consensus.cc:2749] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:05.873908  2902 raft_consensus.cc:2749] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:14:05.874449  2840 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.017s	sys 0.018s
I20260709 13:14:05.876061 29495 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:05.889496  2902 raft_consensus.cc:2749] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:05.889808  2996 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:05.890723 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:14:05.876991 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:05.871532  2434 consensus_queue.cc:1059] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
W20260709 13:14:05.892019 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 76780.9us
I20260709 13:14:05.891378 29455 raft_consensus.cc:3060] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:14:05.891606 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:05.890940 29327 auto_rebalancer.cc:629] Failed to schedule move for tablet e66f47d21a0c4572ac5357c6cf623284: Illegal state: Replica 429e58eb058349e3bf72b5a870c8f6e5 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:05.902768 29344 leader_election.cc:304] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:05.905426 29530 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 19.
I20260709 13:14:05.907932  2434 consensus_queue.cc:1048] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:14:05.909729  2646 raft_consensus.cc:2804] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:05.910449  2646 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:05.910840  2646 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:05.911757  2837 consensus_queue.cc:1048] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:05.873063  2934 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:05.913914  3037 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:05.914476  3037 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:05.909801  2434 raft_consensus.cc:3055] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:14:05.916229 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 54682us
I20260709 13:14:05.874812  3036 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:05.918627  3037 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:05.920301 29346 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:05.923430 29346 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:05.923238 29344 leader_election.cc:304] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:05.927385 29346 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:05.931850 29455 raft_consensus.cc:2468] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 9.
I20260709 13:14:05.933213  2350 raft_consensus.cc:2804] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:14:05.934063  2350 raft_consensus.cc:697] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:05.927670  2978 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:05.935146  2350 consensus_queue.cc:237] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:05.935948  2978 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:05.936527  2978 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:05.938288  2851 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:05.941977 29346 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:05.941058 30121 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:14:05.946141 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:05.947132 29495 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:05.919857  2434 raft_consensus.cc:740] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:05.939857  2989 raft_consensus.cc:2804] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:05.955320 29495 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:14:05.955857 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:05.926750  2962 raft_consensus.cc:2749] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:05.958488  2934 raft_consensus.cc:2749] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:05.921260  2574 consensus_queue.cc:1048] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:14:05.957026 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:05.952664  2989 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:05.956669  2881 raft_consensus.cc:2804] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:05.962212  2902 raft_consensus.cc:2749] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:05.969175 29495 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:05.966166  2989 raft_consensus.cc:3060] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:05.978643 29495 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:05.982925 29495 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:05.952198 29344 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:05.980322  2881 raft_consensus.cc:697] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:05.986780 29346 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:05.986020  2934 raft_consensus.cc:2804] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:05.988775  2934 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:05.989248  2934 raft_consensus.cc:3060] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:05.992642 29495 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:05.986069  3023 raft_consensus.cc:2804] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:05.997054  3023 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:05.997545  3023 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:05.986136  2574 raft_consensus.cc:2804] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:05.999887  2574 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:06.000283  2574 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:05.981348  2976 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:06.011176 29452 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:06.011152 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:06.013391 29449 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 18.
I20260709 13:14:06.014606 29447 raft_consensus.cc:1275] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:14:06.016242 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:06.020032 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:14:06.021447 29419 leader_election.cc:336] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.944s (SENT)
I20260709 13:14:06.026643 29452 raft_consensus.cc:1275] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:14:06.027998 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:06.029222 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:06.028676 29447 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
W20260709 13:14:06.003052  3056 log.cc:927] Time spent T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.402s	user 0.006s	sys 0.000s
I20260709 13:14:05.995975  2837 raft_consensus.cc:2804] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:14:06.031029 29452 raft_consensus.cc:2410] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 17 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:14:06.032038 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:14:06.032763 29419 leader_election.cc:336] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.955s (SENT)
I20260709 13:14:06.037436 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:06.040772 29455 raft_consensus.cc:2393] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 18: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:06.002874  2966 raft_consensus.cc:2804] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:14:06.041518 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:06.017926  3047 raft_consensus.cc:2804] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:06.018201  3018 raft_consensus.cc:2749] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:06.042868 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:06.005463  3014 consensus_queue.cc:1048] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:14:06.056190 29421 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:06.005596  2976 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:06.044683 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:06.059437 29449 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
I20260709 13:14:06.048097  2881 consensus_queue.cc:237] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:06.043385 29419 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:06.039077  2837 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:06.060720 29495 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:06.059157  2966 raft_consensus.cc:697] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:14:06.065955  2934 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:06.066838  3037 raft_consensus.cc:2749] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:06.052686  3047 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:06.067309  3013 raft_consensus.cc:2804] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:14:06.057260  2851 consensus_queue.cc:1059] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:14:06.069147  2558 raft_consensus.cc:3055] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:14:06.023571  2979 consensus_queue.cc:1048] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:14:06.072389 29449 raft_consensus.cc:1240] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:14:06.079280 29419 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:06.073509  2646 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:06.081658  2902 raft_consensus.cc:2749] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:14:06.041782  2796 consensus_queue.cc:1048] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:14:06.040082  2840 consensus_queue.cc:1059] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:14:06.085208  2966 consensus_queue.cc:237] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:06.102255  2646 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:06.089283 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:06.103521 29448 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
W20260709 13:14:06.104277 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 49970us
I20260709 13:14:06.070813  2976 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:06.076537  2837 raft_consensus.cc:3060] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:06.130035 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 50871us
I20260709 13:14:06.092833  3047 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:06.095728  2558 raft_consensus.cc:740] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:06.134310  2434 consensus_queue.cc:260] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:06.119889  3013 raft_consensus.cc:697] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 17 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:06.124909  2883 raft_consensus.cc:2749] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:14:06.183463  3068 log.cc:927] Time spent T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
W20260709 13:14:06.231787 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 171556us
I20260709 13:14:06.289690  2574 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:06.293104 29495 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:14:06.314079 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 208992us
I20260709 13:14:06.321283  2902 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.319437  3013 consensus_queue.cc:237] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:06.322096  2902 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:06.336026 29495 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:06.322156  2976 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:06.336508  2902 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:06.306360 29419 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:06.353577 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 47326.7us
I20260709 13:14:06.354504 29419 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:06.343850  3075 raft_consensus.cc:2749] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:06.346469  3079 raft_consensus.cc:2749] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:06.360695 29419 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:06.362872 29419 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:06.364652 29419 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:06.370219  2851 raft_consensus.cc:2749] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:06.372257 29344 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:06.373148  2934 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:06.374722  2964 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:14:06.375392  2964 raft_consensus.cc:697] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:06.376546  2964 consensus_queue.cc:237] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:06.382125  3047 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:06.383829  3023 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:06.382647  2574 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:06.398497  3047 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:06.398149  3042 consensus_queue.cc:1048] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:06.402971 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:14:06.399708 29419 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:06.359248  3037 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:14:06.406544 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:06.405553  2851 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:06.363057  3036 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:06.337606  2978 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:06.410699 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:06.415093 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:06.413272 29419 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:14:06.416356 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:06.418782 29419 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:06.420015 29526 raft_consensus.cc:1240] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:06.384836  2840 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:14:06.418787 29523 raft_consensus.cc:1240] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:06.424522 29526 raft_consensus.cc:1240] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:06.428462 29521 raft_consensus.cc:1275] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:14:06.438614 29521 raft_consensus.cc:1275] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:14:06.363902  2883 consensus_queue.cc:1059] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:14:06.447479 29525 raft_consensus.cc:1240] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:14:06.415102  2851 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:06.460000 29419 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:14:06.457508 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 122273us
I20260709 13:14:06.414417  3042 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:14:06.462605 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:06.464560 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:06.465272 29524 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:06.441118  3044 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:06.442884  2840 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:06.467059 29419 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:06.463985  2851 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:06.469281 29525 pending_rounds.cc:85] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 8
I20260709 13:14:06.449496  3037 raft_consensus.cc:2749] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:06.444409  2976 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:06.475075 29495 leader_election.cc:304] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:06.483398 29525 pending_rounds.cc:107] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:14:06.484381 29525 raft_consensus.cc:2889] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:06.488857 29419 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:06.498359 29524 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
I20260709 13:14:06.464115  2883 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:06.475924  3036 raft_consensus.cc:2804] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:06.482688  2840 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:14:06.511059 29495 leader_election.cc:400] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 21. Current term is 22.
I20260709 13:14:06.473659  3044 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:06.494338  3047 raft_consensus.cc:2749] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:06.493620  3042 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:06.544886  3044 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:06.559667 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:06.560392 29527 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:06.510742  3036 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:06.563877  2574 consensus_queue.cc:1059] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:06.581966  3036 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:06.581779  2558 consensus_queue.cc:260] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:06.582782  2574 raft_consensus.cc:3055] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:14:06.542578  2837 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:06.584182 29376 raft_consensus.cc:1240] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 15. Current term is 16. Ops: []
I20260709 13:14:06.585237  2837 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:06.585966 29379 raft_consensus.cc:1240] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:14:06.586447 29372 raft_consensus.cc:1240] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 14. Current term is 15. Ops: []
W20260709 13:14:06.587059 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 76160.6us
I20260709 13:14:06.579160  3023 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:06.592976 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:06.601099 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:06.605691  3018 consensus_queue.cc:1059] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:14:06.607705  2990 consensus_queue.cc:1048] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:06.609368  2990 consensus_queue.cc:1059] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:06.541543  3037 raft_consensus.cc:2749] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:06.532599  2883 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:06.610174  2851 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:06.610636  2930 raft_consensus.cc:3055] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:14:06.611125  2930 raft_consensus.cc:740] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:06.607733  3023 consensus_queue.cc:1059] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
W20260709 13:14:06.553828  2989 consensus_meta.cc:287] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.569s	user 0.007s	sys 0.010s
I20260709 13:14:06.612540  3023 raft_consensus.cc:3055] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:14:06.612174  2930 consensus_queue.cc:260] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:06.613021  3023 raft_consensus.cc:740] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:06.612917  2989 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:06.614171 29378 raft_consensus.cc:1240] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:06.583194  2558 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:06.613804  2930 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:06.578419 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:06.579166  3064 raft_consensus.cc:3055] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:14:06.617630  3064 raft_consensus.cc:740] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:06.618669  3064 consensus_queue.cc:260] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:06.620234  3064 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:06.621140  3089 consensus_queue.cc:1059] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:06.622428  3089 consensus_queue.cc:1059] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:06.623749  2994 raft_consensus.cc:3055] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:06.624140  2994 raft_consensus.cc:740] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:14:06.625228 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:06.625030  2994 consensus_queue.cc:260] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:06.564677  2978 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:06.581041 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:06.583194  2574 raft_consensus.cc:740] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:06.583015  2434 raft_consensus.cc:3060] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:14:06.629129  2574 consensus_queue.cc:260] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:06.630450  2574 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:06.614639  3023 consensus_queue.cc:260] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:06.616195  2350 raft_consensus.cc:3055] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:14:06.631671  3023 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:06.631788  2350 raft_consensus.cc:740] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:06.632864  2350 consensus_queue.cc:260] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:06.580157 29374 raft_consensus.cc:1240] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:06.607024  3018 consensus_queue.cc:1048] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:14:06.612102  2883 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:06.635944 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:06.637888 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:06.639890 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:06.640129  3089 raft_consensus.cc:3055] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:06.640527  3089 raft_consensus.cc:740] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:14:06.640544 29380 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
I20260709 13:14:06.641475  3089 consensus_queue.cc:260] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:06.642829  3089 raft_consensus.cc:3060] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:06.644145  2994 raft_consensus.cc:3060] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:06.644006 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:06.646755 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:06.648396 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:06.649813 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:06.653442 29377 raft_consensus.cc:2393] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 22: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:06.615336  2989 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:14:06.654898 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 49477us
I20260709 13:14:06.674757 29344 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:06.675966  2989 raft_consensus.cc:2804] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:06.676553  2851 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:06.676783  2989 raft_consensus.cc:697] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:06.677978  2989 consensus_queue.cc:237] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:06.651903 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:06.651959 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:06.682152 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:06.682976 29374 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:06.654062 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:06.688159 29380 raft_consensus.cc:2393] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 11: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:06.628232 29495 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:06.656512 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:06.656874 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:06.659889 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:06.689296 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:06.689508 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:06.660835 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:06.661470  3044 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:06.662564  2350 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:06.663823  2840 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:06.666800 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:14:06.671970 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 183193us
I20260709 13:14:06.682265 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:06.650861 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:06.655146 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:06.690784 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:14:06.693110 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 64999.1us
I20260709 13:14:06.712152 29377 raft_consensus.cc:1240] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:06.712560 29378 raft_consensus.cc:1240] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:06.713460 29495 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:06.714036 29419 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:06.715597 29419 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:06.716118  3047 raft_consensus.cc:2749] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:14:06.717533  3094 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:06.690583 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:06.718289  3094 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:06.718720  3094 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:06.707789 29376 raft_consensus.cc:1240] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 16. Current term is 17. Ops: []
I20260709 13:14:06.719756  2851 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:06.692567  2976 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:06.711865 29379 raft_consensus.cc:2393] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 19: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
W20260709 13:14:06.700031 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 253101us
I20260709 13:14:06.717630 29495 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:06.708670 29375 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:06.690038 29380 raft_consensus.cc:2368] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 14. Current term is 15.
I20260709 13:14:06.720310  2851 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:06.722107  2851 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:06.726147 29527 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:14:06.732059  2840 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:06.733296 29419 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:06.737946 29495 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:06.738564 29374 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 17.
I20260709 13:14:06.735973  2976 raft_consensus.cc:2749] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:06.727332  3036 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:06.740378  3047 raft_consensus.cc:2764] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader election decision vote started in defunct term 16: won
I20260709 13:14:06.744757  3036 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:06.745654 30120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:06.741371 29495 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:06.741595  3064 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:06.735183 29375 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 18.
I20260709 13:14:06.755888 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:14:06.756153 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:14:06.756325  3089 consensus_queue.cc:1059] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:14:06.757701  3019 raft_consensus.cc:3055] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:14:06.758138  3019 raft_consensus.cc:740] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:14:06.759073  3019 consensus_queue.cc:260] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:06.705664  3044 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:06.767459 30155 raft_consensus.cc:2468] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:14:06.769164 30153 raft_consensus.cc:2468] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 10.
I20260709 13:14:06.772295  3047 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:14:06.773981 29419 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:06.774572 29528 raft_consensus.cc:3055] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:06.775014 29528 raft_consensus.cc:740] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:06.775952 29528 consensus_queue.cc:260] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:06.776993 29528 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:06.780879 29495 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:06.775367 29419 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:06.783972 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:06.786329 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:06.786587 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:06.787180 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:06.788550  2976 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:14:06.788761 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:06.789230  2976 raft_consensus.cc:697] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:06.788966  3094 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:06.789582 29525 raft_consensus.cc:2393] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 13: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:06.782521  3064 raft_consensus.cc:2749] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:06.791224  3019 raft_consensus.cc:3060] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:14:06.792265  3044 raft_consensus.cc:2749] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:06.792380  3064 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:06.793531 29419 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:06.794405  3064 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:06.794803  3064 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:06.795207  3064 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:06.802402 29528 raft_consensus.cc:1275] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:14:06.803949 29344 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:06.804272 29528 pending_rounds.cc:85] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 10
I20260709 13:14:06.804960  2989 raft_consensus.cc:2804] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:14:06.805299 29528 pending_rounds.cc:107] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:14:06.790225  2976 consensus_queue.cc:237] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:06.805684 29528 raft_consensus.cc:2889] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:06.812129 29419 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:06.815382 29421 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:06.817356 29524 raft_consensus.cc:1240] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:06.818862 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:06.819329 29526 raft_consensus.cc:3055] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:06.820003 29526 raft_consensus.cc:740] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:06.821270 29526 consensus_queue.cc:260] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:06.822578 29526 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:06.823484 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:06.824237  3013 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:06.826593 29452 raft_consensus.cc:1240] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:06.825778  2851 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:06.834820 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:06.835870 29452 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
I20260709 13:14:06.817624  3044 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:06.818675  2989 raft_consensus.cc:697] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:06.851032 29526 raft_consensus.cc:1275] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:14:06.852563 29526 pending_rounds.cc:85] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 8
I20260709 13:14:06.852982 29526 pending_rounds.cc:107] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:14:06.853296 29526 raft_consensus.cc:2889] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:06.851716 29523 raft_consensus.cc:1275] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:14:06.857028 29522 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:06.861857  2851 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:06.871587  3094 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:06.872565  2989 consensus_queue.cc:237] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:06.884110  3064 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:06.934969 29373 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "71aa3578fd924765ab9ac0729c8d1483"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:14:06.937492 29373 raft_consensus.cc:606] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Received request to transfer leadership to TS 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:06.818078 29419 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:14:06.946110 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 127935us
W20260709 13:14:06.948225 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:06.948894 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:14:06.944492 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:06.951457 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:06.952450 29452 raft_consensus.cc:1240] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 15. Current term is 17. Ops: []
I20260709 13:14:06.975924  2996 consensus_queue.cc:1048] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:14:06.978701 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:06.958438  3000 consensus_queue.cc:1048] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:14:06.980088 29448 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:06.947166 29421 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:06.960804  3064 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:06.991972  3094 raft_consensus.cc:2804] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:14:06.993331  3094 raft_consensus.cc:697] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 18 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:06.999243 29419 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:14:07.002038 30122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:07.004531 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:07.005843 29449 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:07.006517 29495 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:07.008320 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:07.010159 29455 raft_consensus.cc:2393] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 17: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:07.018438 29278 catalog_manager.cc:5697] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 13 to 16, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 16 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
W20260709 13:14:07.027050 30122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:07.033890 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 87357.4us
I20260709 13:14:07.034967  2851 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:14:07.035821  3064 raft_consensus.cc:3060] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:14:07.031975 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 84457us
W20260709 13:14:07.046540 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 54267.5us
I20260709 13:14:07.042271  2851 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:07.050978  2851 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:07.052500 29421 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:07.061929 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 56088.4us
I20260709 13:14:07.062724  3044 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:07.074473 29278 catalog_manager.cc:5697] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 16 to 19, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 19 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:07.085309 29448 raft_consensus.cc:2468] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:14:07.043690  3094 consensus_queue.cc:237] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:07.080041 29278 catalog_manager.cc:5697] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 15 to 16, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 16 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:07.083824 29441 tablet_service.cc:1558] Processing DeleteTablet for tablet 95122b0f733946aba19edf1d98467467 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:35524
I20260709 13:14:07.091321  2930 consensus_queue.cc:1048] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:14:07.093320  3080 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.096272  2434 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:07.096873  2434 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:07.096669  3080 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:07.097397  2434 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:07.086057  3044 consensus_queue.cc:1048] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:14:07.100638  3080 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:07.102042  2979 raft_consensus.cc:993] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5: : Instructing follower 71aa3578fd924765ab9ac0729c8d1483 to start an election
I20260709 13:14:07.103626 29419 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:07.109815  2930 raft_consensus.cc:1081] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Signalling peer 71aa3578fd924765ab9ac0729c8d1483 to start an election
I20260709 13:14:07.111738  3023 consensus_queue.cc:1048] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:07.116575 29495 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:07.114936  3023 consensus_queue.cc:1048] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:14:07.116832 29278 catalog_manager.cc:5697] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:07.125599  3044 raft_consensus.cc:2749] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:07.125469 29419 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:07.129953 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:07.139173 29278 catalog_manager.cc:5697] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:07.147557 29522 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 17.
I20260709 13:14:07.148335  3013 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:07.144938 29278 catalog_manager.cc:5697] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 10 to 14, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 14 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:07.154807 29278 catalog_manager.cc:5697] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 12 to 15, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 15 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:07.159941 29344 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:14:07.161587 29344 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:14:07.162636 29419 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:07.164713  3013 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:14:07.165707  3013 consensus_queue.cc:1059] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:07.166919  3013 raft_consensus.cc:3055] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:14:07.167569 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:07.167876  3023 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:14:07.162659 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 46622.7us
W20260709 13:14:07.176378 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:07.177794  2989 raft_consensus.cc:2804] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:14:07.178467  2989 raft_consensus.cc:697] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:07.181540  2989 consensus_queue.cc:237] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:14:07.186447 29275 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37594 (request call id 139) took 30774 ms (client timeout 15000 ms). Trace:
I20260709 13:14:07.173086  3013 raft_consensus.cc:740] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:07.208632  3013 consensus_queue.cc:260] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:07.172500  3023 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:07.191907  3036 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:07.192291 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:07.190687 29495 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:14:07.211854 30120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:07.222496  3023 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:07.223469 29278 catalog_manager.cc:5697] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 12 to 14, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 14 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:07.225696 29278 catalog_manager.cc:5697] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 14 to 16, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 16 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:07.231446 29528 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4"
dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
 from {username='slave'} at 127.0.0.1:37968
I20260709 13:14:07.232486 29528 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:07.233040 29528 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:07.237794  2976 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:07.238392  2976 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:07.238819  2976 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:14:07.241578 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 51100.6us
I20260709 13:14:07.192624  3000 raft_consensus.cc:2804] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:14:07.253276 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 213951us
I20260709 13:14:07.262701 29449 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
W20260709 13:14:07.205024 29275 rpcz_store.cc:269] 0709 13:13:36.412244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:36.416733 (+  4489us) service_pool.cc:224] Handling call
0709 13:13:36.642401 (+225668us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b5400422054. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcf0090 00007f6a7bd8ef3a 00007f6a81b451cc 00007f6a81c4337e 00007f6a801042a4 00007f6a80104232 00007f6a80104161 00007f6a801040dc 00007f6a80103392 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:14:07.186118 (+30543717us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:02.814593 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:03.096666 (+282073us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:03.106836 (+ 10170us) write_op.cc:435] Acquired schema lock
0709 13:14:03.113931 (+  7095us) tablet.cc:662] Decoding operations
0709 13:14:03.229109 (+115178us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:03.233415 (+  4306us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:03.238769 (+  5354us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:14:03.500987 (+262218us) tablet.cc:701] Row locks acquired
0709 13:14:03.537689 (+ 36702us) write_op.cc:260] PREPARE: finished
0709 13:14:03.559890 (+ 22201us) write_op.cc:270] Start()
0709 13:14:03.571998 (+ 12108us) write_op.cc:276] Timestamp: P: 1783602843548995 usec, L: 0
0709 13:14:03.579770 (+  7772us) op_driver.cc:348] REPLICATION: starting
0709 13:14:03.686897 (+107127us) log.cc:844] Serialized 1326 byte log entry
0709 13:14:04.438355 (+751458us) spinlock_profiling.cc:243] Waited 29.2 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a78c7c0ac 00007f6a81ad6ab9 00007f6a78c9869b 00007f6a78c9693f 00007f6a78c98c02 00007f6a7b92020b
0709 13:14:05.431916 (+993561us) op_driver.cc:464] REPLICATION: finished
0709 13:14:05.467059 (+ 35143us) write_op.cc:301] APPLY: starting
0709 13:14:05.467193 (+   134us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:05.470205 (+  3012us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:05.470243 (+    38us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:05.473579 (+  3336us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:05.473795 (+   216us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:14:05.473857 (+    62us) write_op.cc:312] APPLY: finished
0709 13:14:05.474129 (+   272us) log.cc:844] Serialized 41 byte log entry
0709 13:14:05.474329 (+   200us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:05.474441 (+   112us) write_op.cc:454] Released schema lock
0709 13:14:05.474487 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:05.494172 (+ 19685us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:05.496857 (+  2685us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":34213,"reported_tablets":55,"spinlock_wait_cycles":288525696,"child_traces":[["op",{"apply.queue_time_us":34822,"apply.run_cpu_time_us":7018,"apply.run_wall_time_us":19242,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16643,"num_ops":3,"prepare.queue_time_us":282130,"prepare.run_cpu_time_us":62108,"prepare.run_wall_time_us":2268502,"raft.queue_time_us":302480,"raft.run_cpu_time_us":1441,"raft.run_wall_time_us":35196,"replication_time_us":1851936,"spinlock_wait_cycles":67190016,"thread_start_us":1749455,"threads_started":4,"wal-append.queue_time_us":1333395,"wal-append.run_cpu_time_us":51897,"wal-append.run_wall_time_us":1442207}]]}
I20260709 13:14:07.277974  3036 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:07.257939  3064 raft_consensus.cc:2749] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:07.258060  3000 raft_consensus.cc:697] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:07.281380  3036 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:07.291154 29421 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:07.295655 29528 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:07.324290 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:07.324786 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:07.326538 29528 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:07.326242  2851 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:07.297057  2434 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:07.300838 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:07.327559 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:14:07.309976 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 50109.2us
I20260709 13:14:07.310662  3013 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:14:07.316988 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 54123.1us
I20260709 13:14:07.293642 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:07.316262 29278 catalog_manager.cc:5697] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 12 to 17, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 17 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:07.317474  3111 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.318251 29447 raft_consensus.cc:1240] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:14:07.317704  3036 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:07.319110  2930 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.320581 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:07.322268 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:07.322466 29372 raft_consensus.cc:1240] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 16. Current term is 17. Ops: []
I20260709 13:14:07.334787 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:07.340098 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:07.340874 29455 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:07.343086  2930 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:07.344619  3000 consensus_queue.cc:237] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:07.347774  2930 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:07.339999 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:07.355225 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:07.356588 29455 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:14:07.359447 29524 raft_consensus.cc:1240] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:07.362686 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:07.369370 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:07.370132 29455 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:07.371446 29421 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:07.333629  3111 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:07.372548 29495 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:07.376477 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:07.383601 29523 raft_consensus.cc:3055] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:14:07.384985 29523 raft_consensus.cc:740] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:07.386022 29523 consensus_queue.cc:260] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:07.387193 29523 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:14:07.391110 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:07.393186  2434 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:07.394408  3036 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:14:07.394992 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 46496.4us
I20260709 13:14:07.400539  2851 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:07.402963 29374 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
I20260709 13:14:07.405277 29449 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:07.408506 29373 raft_consensus.cc:2468] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
W20260709 13:14:07.413093 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 52416.8us
I20260709 13:14:07.413965 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:07.411547 29380 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
I20260709 13:14:07.410061  2574 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.417560 29278 catalog_manager.cc:5697] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:07.418941  2574 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:07.419626 29278 catalog_manager.cc:5697] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 12 to 13, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 13 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
W20260709 13:14:07.421800 30122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:07.423054  2574 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:07.422518 29278 catalog_manager.cc:5697] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:07.425218  3111 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:07.424764 29278 catalog_manager.cc:5697] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:07.426608 29278 catalog_manager.cc:5697] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 13 to 14, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 14 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:07.431524 29421 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:07.431041 29278 catalog_manager.cc:5697] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:07.432688  3036 raft_consensus.cc:2749] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:07.431689  2851 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.433951 29278 catalog_manager.cc:5697] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 13 to 18, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 18 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:07.434705  2434 raft_consensus.cc:2804] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:07.435638  2434 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:07.436120  2434 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:07.436520 29278 catalog_manager.cc:5697] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 14 to 17, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 17 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:07.435079  2851 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:07.449117  2851 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:07.464617 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:07.465610 29495 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:07.466733  3080 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:07.467262  3080 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:07.467700  3080 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:07.478328 29449 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
I20260709 13:14:07.478556 29455 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:14:07.484675 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:07.499092 29523 raft_consensus.cc:1275] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:14:07.499693 29523 pending_rounds.cc:85] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 10
I20260709 13:14:07.505298 29455 raft_consensus.cc:1275] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:14:07.500262 29523 pending_rounds.cc:107] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:14:07.508512 29523 raft_consensus.cc:2889] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:14:07.511715 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 65663.7us
I20260709 13:14:07.520815 29448 raft_consensus.cc:1240] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
W20260709 13:14:07.525764 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:07.529321 29448 raft_consensus.cc:1240] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 23. Current term is 24. Ops: [23.12-23.12]
I20260709 13:14:07.531327 29450 raft_consensus.cc:1275] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:14:07.499720  3023 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:07.532513  3121 log.cc:927] Time spent T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 13:14:07.533950 30122 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:07.536792  3023 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:07.535176 29450 raft_consensus.cc:1240] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:14:07.540751 29265 catalog_manager.cc:5028] TS 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): tablet 95122b0f733946aba19edf1d98467467 (table test-workload [id=364c32d53f7748a2857a4a9acd17c671]) successfully deleted
I20260709 13:14:07.540776 29495 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:07.545619 29495 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:07.549139  2976 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:07.552999 29450 raft_consensus.cc:1275] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:14:07.556227 29450 raft_consensus.cc:1240] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:14:07.558192 29449 raft_consensus.cc:1240] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:14:07.564309  3047 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:14:07.570436 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:07.570791 29523 raft_consensus.cc:1240] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:14:07.566869 29450 raft_consensus.cc:1240] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:07.575484 29447 raft_consensus.cc:1240] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:14:07.578174 29452 raft_consensus.cc:2410] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:14:07.578838 29453 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:07.587337 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:07.566706  2851 consensus_queue.cc:1059] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:14:07.589483  2851 raft_consensus.cc:3055] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:14:07.589597 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:07.589949  2851 raft_consensus.cc:740] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:07.591970 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:07.592859 29449 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:07.575555  3023 raft_consensus.cc:2804] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:07.603193  3023 raft_consensus.cc:697] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:07.599086 29523 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:14:07.604406 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:07.610545 29495 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:07.559355  3080 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:07.618636 29524 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 21.
I20260709 13:14:07.631647 29421 leader_election.cc:400] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 14. Current term is 15.
I20260709 13:14:07.632046 29421 leader_election.cc:403] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:14:07.630970 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 47607.4us
I20260709 13:14:07.591015  2851 consensus_queue.cc:260] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:07.641928 29523 raft_consensus.cc:1275] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:14:07.643533 29456 raft_consensus.cc:1240] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:14:07.646376 29449 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:14:07.631783  3047 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:14:07.648792 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:07.635951  2976 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:14:07.655628 30120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:07.658002 29379 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "71aa3578fd924765ab9ac0729c8d1483"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:14:07.658866 29449 raft_consensus.cc:1275] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:14:07.670962 29456 raft_consensus.cc:1275] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:14:07.663966 29379 raft_consensus.cc:606] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Received request to transfer leadership to TS 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:07.675890 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 88062.8us
I20260709 13:14:07.653028  3094 raft_consensus.cc:2749] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 14. Current term is 15.
I20260709 13:14:07.683833  3080 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:07.663304  3047 raft_consensus.cc:697] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
W20260709 13:14:07.686192  3125 log.cc:927] Time spent T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.124s	user 0.002s	sys 0.000s
I20260709 13:14:07.685918  3047 consensus_queue.cc:237] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:07.632073  3023 consensus_queue.cc:237] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:07.693636 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:07.699373 29449 raft_consensus.cc:1275] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 13:14:07.702193 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:07.699178  3094 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.708170  3094 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:07.710726  3094 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:07.697933 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:07.712396 29379 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "71aa3578fd924765ab9ac0729c8d1483"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:14:07.713249 29379 raft_consensus.cc:606] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Received request to transfer leadership to TS 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:07.713680 29379 raft_consensus.cc:614] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:14:07.723933 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:07.724815 29456 raft_consensus.cc:1275] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:14:07.728806 29453 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 19.
I20260709 13:14:07.732271  3080 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.732956  3080 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:07.735924  3080 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:07.693693  2851 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:07.716886 29421 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:07.712174 29449 pending_rounds.cc:85] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 9
I20260709 13:14:07.753803 29449 pending_rounds.cc:107] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 13:14:07.754127 29449 raft_consensus.cc:2889] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:07.755534 29451 raft_consensus.cc:1275] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:14:07.756248 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 106492us
I20260709 13:14:07.757241 29495 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:07.759039 29346 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:07.761219 29447 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 19.
I20260709 13:14:07.764735 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:07.772855 29453 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 21.
W20260709 13:14:07.772667 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 76532.8us
I20260709 13:14:07.777513  2990 consensus_queue.cc:1048] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:14:07.798902 29454 raft_consensus.cc:2468] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
I20260709 13:14:07.778666  3064 raft_consensus.cc:2804] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:14:07.780308  3080 raft_consensus.cc:2749] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:14:07.802450 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 43808.9us
I20260709 13:14:07.808638  3064 raft_consensus.cc:697] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 17 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:07.810081  3064 consensus_queue.cc:237] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:07.811574  2574 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:14:07.815754 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 89474.5us
I20260709 13:14:07.816906 29495 leader_election.cc:304] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:07.819149  3080 raft_consensus.cc:2749] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:07.819777 29495 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:07.820986  2990 consensus_queue.cc:1059] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:14:07.822461 29495 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:07.822494  2990 raft_consensus.cc:3055] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:14:07.823436  2990 raft_consensus.cc:740] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:07.823714  2976 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:07.824714  2976 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:07.825130  2990 consensus_queue.cc:260] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:07.826815  2990 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:07.830606  3019 consensus_queue.cc:1048] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:07.817193 29346 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:07.834766  2837 raft_consensus.cc:2804] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:07.835369  2837 raft_consensus.cc:697] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:07.836143 29346 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:07.836985  2837 consensus_queue.cc:237] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:07.838932  2962 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:07.784291  2434 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:07.846084  2434 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:07.848793 29495 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:07.857182  3023 consensus_queue.cc:1059] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:07.859972 29344 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:07.864297 29344 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:07.865345  2962 raft_consensus.cc:2804] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:07.881002  2964 consensus_queue.cc:1048] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:07.881078  2962 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:07.882215  2976 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:07.883139  2574 consensus_queue.cc:1048] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:14:07.884151  2434 raft_consensus.cc:3055] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:14:07.884663  2434 raft_consensus.cc:740] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:07.883201  2962 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:07.883405  2350 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:14:07.889150  3023 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:07.900400 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:07.904171 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:07.904783 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 56106.6us
I20260709 13:14:07.909066 29524 raft_consensus.cc:1240] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:14:07.882170  3135 consensus_queue.cc:1059] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:14:07.898752  2350 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:07.917948 29530 raft_consensus.cc:1240] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:14:07.922420 30153 raft_consensus.cc:1275] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:14:07.908543  3013 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:07.931797 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:07.935887  2978 consensus_queue.cc:1059] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:14:07.937592  3013 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:07.941150  2978 raft_consensus.cc:3055] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:14:07.941684  2978 raft_consensus.cc:740] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:07.912341  2574 consensus_queue.cc:1059] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:14:07.943599  2574 raft_consensus.cc:3055] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:14:07.944096  2574 raft_consensus.cc:740] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:07.945001  2574 consensus_queue.cc:260] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:07.946482  2574 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:07.915964  2350 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:07.935602 29495 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:07.943722 29522 raft_consensus.cc:1275] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:14:07.949492  3131 log.cc:927] Time spent T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.264s	user 0.005s	sys 0.000s
I20260709 13:14:07.954281  3135 consensus_queue.cc:1048] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:07.957986  3013 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:07.961733  2979 raft_consensus.cc:3055] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:14:07.962275  2979 raft_consensus.cc:740] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:07.963179  2979 consensus_queue.cc:260] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:07.964653 29529 raft_consensus.cc:1240] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:14:07.965632  2979 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:07.967763  2978 consensus_queue.cc:260] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:07.969554  2978 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:14:07.906177  3023 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:07.976835 29523 raft_consensus.cc:1275] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:14:07.983651  3047 raft_consensus.cc:2764] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:14:07.931700  2434 consensus_queue.cc:260] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:07.994118  2434 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:07.994769  3112 consensus_queue.cc:1059] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:14:07.995949  3111 raft_consensus.cc:3055] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:14:07.996594  3111 raft_consensus.cc:740] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:14:07.997891 29419 leader_election.cc:336] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 2.036s (SENT)
I20260709 13:14:07.997643  3111 consensus_queue.cc:260] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:07.998458 29419 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:07.999511  3013 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:07.999264  3111 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:14:08.007191 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 89894.6us
I20260709 13:14:08.008438 29495 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:08.012965  3000 consensus_queue.cc:1048] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:14:08.013661  3135 consensus_queue.cc:1059] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:08.013715  2990 consensus_queue.cc:1059] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:08.014997  3135 raft_consensus.cc:3055] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:14:08.015028  2990 raft_consensus.cc:3055] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:14:08.015527  3135 raft_consensus.cc:740] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:08.015576  2990 raft_consensus.cc:740] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:08.016695  2990 consensus_queue.cc:260] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:08.016686  3135 consensus_queue.cc:260] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:08.018360  2990 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:08.018450  3135 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:07.991242  2350 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:08.061125 30155 raft_consensus.cc:1275] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:14:08.062358 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:08.063683  3112 consensus_queue.cc:1059] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:14:08.065312  3112 raft_consensus.cc:3055] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:14:08.065799  3112 raft_consensus.cc:740] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:14:08.069996 29419 leader_election.cc:336] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 2.071s (SENT)
I20260709 13:14:08.070739 29419 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:08.071898  3013 raft_consensus.cc:2749] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:08.072706  2350 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 22 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:08.067034  3112 consensus_queue.cc:260] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:08.075443  3112 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:08.076365  3023 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:08.036433  2976 raft_consensus.cc:2749] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:14:08.083532 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:08.061198 29495 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:08.096871  2979 consensus_queue.cc:1048] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:08.098651 29346 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:08.103701 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:08.104408 29525 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:08.110363  2964 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:14:08.111091  2964 raft_consensus.cc:697] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:08.112242  2964 consensus_queue.cc:237] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:08.118016  2962 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:08.118312  3111 consensus_queue.cc:1048] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:14:08.119892 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 58795.6us
I20260709 13:14:08.120805 29495 leader_election.cc:304] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:08.121717  3080 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:08.122820  3080 raft_consensus.cc:2749] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:08.126096  2350 consensus_queue.cc:1048] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:14:08.127063 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:08.149297 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:08.159641  2964 consensus_queue.cc:1059] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:14:08.179804  2964 raft_consensus.cc:3055] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:14:08.180248  2964 raft_consensus.cc:740] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:08.181227  2964 consensus_queue.cc:260] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:08.182770  2964 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:08.172178  2930 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:08.185810  2930 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:08.129881  2976 consensus_queue.cc:1059] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:14:08.212059  2990 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:08.212289  3080 raft_consensus.cc:3055] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:14:08.212898  2990 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:08.213999  2962 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:08.212898  3080 raft_consensus.cc:740] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:08.216374 29346 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:08.218397  2837 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:14:08.218788 29495 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:08.218956  2837 raft_consensus.cc:697] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:08.219481  2990 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:08.219872  3111 consensus_queue.cc:1048] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:14:08.220496  2434 raft_consensus.cc:2804] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:14:08.221504  3111 consensus_queue.cc:1048] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:08.222333 29449 raft_consensus.cc:1240] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 16. Current term is 17. Ops: []
I20260709 13:14:08.222731 29454 raft_consensus.cc:1240] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 15. Current term is 16. Ops: []
I20260709 13:14:08.221694 29346 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:08.225445 29449 raft_consensus.cc:1240] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:14:08.226267 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:08.215706  3080 consensus_queue.cc:260] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:08.225603  2837 consensus_queue.cc:237] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:08.225533 29450 raft_consensus.cc:1240] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:14:08.228067  2978 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:08.228523  2978 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:08.228909  2978 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:08.227672  3080 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:08.238209  2930 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:08.241868 29525 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 22.
I20260709 13:14:08.244251 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:08.249090 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:08.252347 29449 raft_consensus.cc:2393] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 18: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:08.253636 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:08.255467 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:08.254328 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:08.258395 29450 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:08.259217 29455 raft_consensus.cc:2393] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 18: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:08.224356  2434 raft_consensus.cc:697] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 17 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:08.261523 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:08.262147 29453 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
I20260709 13:14:08.262953 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 23 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:08.263619 29454 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 22.
I20260709 13:14:08.267088 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:08.256184  2976 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:08.268952  2976 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:08.271478  2976 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:08.278242 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:08.281064 29526 raft_consensus.cc:1217] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Deduplicated request from leader. Original: 14.10->[15.11-15.11]   Dedup: 15.11->[]
I20260709 13:14:08.281693 29526 raft_consensus.cc:1240] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:14:08.290781 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:08.291795 29522 raft_consensus.cc:2410] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:14:08.292065  2434 consensus_queue.cc:237] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:08.295157 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:08.297319 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:08.299194 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:08.302278 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:08.304330 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:08.305181 29522 raft_consensus.cc:2393] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 18: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:08.251879  3112 consensus_queue.cc:1048] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:14:08.308722 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:08.308993 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:08.315223 29524 raft_consensus.cc:2393] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 18: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:14:08.342722 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:08.344812 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 79155.6us
I20260709 13:14:08.348485 29448 raft_consensus.cc:3060] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:14:08.353104 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:08.359051 29448 raft_consensus.cc:1275] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:14:08.365396 29450 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 18.
I20260709 13:14:08.383554 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:08.384747 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:08.385407 29449 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:08.409242 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:08.409884 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:08.410632 29525 raft_consensus.cc:2393] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 22: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
W20260709 13:14:08.411206 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 238826us
W20260709 13:14:08.418795 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:08.420253 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:08.429530 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:08.429821 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:08.439949 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:08.443022 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:08.443456 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:08.445230 29380 raft_consensus.cc:2410] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
W20260709 13:14:08.465441 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:08.467053 29525 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 22.
I20260709 13:14:08.469271 29373 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 18.
I20260709 13:14:08.475303 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:08.475680 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:08.474687  2978 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:08.480048  3156 consensus_queue.cc:1048] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:14:08.485246 29375 raft_consensus.cc:1240] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 19. Current term is 20. Ops: []
I20260709 13:14:08.507763 29374 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
W20260709 13:14:08.507826 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:08.495021 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:08.496004 29524 raft_consensus.cc:1275] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:14:08.482568 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 23 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:08.513489 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:08.517042 29449 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 22.
I20260709 13:14:08.488579 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:08.537536 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:08.546895 29525 raft_consensus.cc:1275] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:14:08.562177 29380 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 22.
I20260709 13:14:08.565433 29379 raft_consensus.cc:1240] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:08.569383 29449 raft_consensus.cc:1275] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:14:08.486678  2978 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:08.571223 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:08.572182 29374 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 18.
I20260709 13:14:08.573165 29495 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:08.574252 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:08.576756 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:08.578176 29449 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
I20260709 13:14:08.577325 29495 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:08.582530 29495 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:08.604120 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:08.605165 29373 raft_consensus.cc:2393] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 22: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:08.618173 29495 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:08.576998  3080 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:08.624293 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 184159us
I20260709 13:14:08.593904  2434 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:08.630267 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:08.593050  3023 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:14:08.632263 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:08.633951  2434 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:08.634044  3163 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:08.634488  2434 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:08.634765  3163 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:08.636704 29378 raft_consensus.cc:1275] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:14:08.641600 29373 raft_consensus.cc:2393] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 22: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:08.625244  3047 raft_consensus.cc:2804] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:14:08.646373  2434 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:08.580349  2976 consensus_queue.cc:1059] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:14:08.653789 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:08.654757 29375 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "71aa3578fd924765ab9ac0729c8d1483"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:14:08.656291  3163 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:08.656737  3157 log.cc:927] Time spent T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:14:08.639696  3023 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:08.659663  3023 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:14:08.664717  3165 log.cc:927] Time spent T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:14:08.665892 29372 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 18.
I20260709 13:14:08.675786 29376 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 18.
I20260709 13:14:08.678764 29378 raft_consensus.cc:1240] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 17. Current term is 18. Ops: []
I20260709 13:14:08.681713 29419 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:08.682605 29375 raft_consensus.cc:606] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Received request to transfer leadership to TS 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:08.683048 29375 raft_consensus.cc:614] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:08.686642  2837 consensus_queue.cc:1048] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:14:08.686743 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 54340.6us
W20260709 13:14:08.687901 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 69877.7us
I20260709 13:14:08.690023 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:08.690802 29525 raft_consensus.cc:2468] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 10.
I20260709 13:14:08.692075 29455 raft_consensus.cc:1275] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:14:08.692422 30119 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:14:08.696568  2434 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:08.696987 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:08.700521 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:08.701351  2434 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:08.701798  2434 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:08.702147  2434 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:08.632534  3080 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:08.710335 29346 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:08.739100  3160 raft_consensus.cc:2749] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:08.740468  3130 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:14:08.741117 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 78743.4us
I20260709 13:14:08.741930 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:08.743084 29374 raft_consensus.cc:2393] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 17: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:08.746743  2434 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:08.700412  2930 consensus_queue.cc:1048] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
W20260709 13:14:08.834378 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 81820.4us
I20260709 13:14:08.836184  2434 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:08.698079  3013 consensus_queue.cc:1048] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:14:08.837750 29419 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:08.851624  2434 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:08.852690  2434 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:08.743575  3171 consensus_queue.cc:1048] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.217s
I20260709 13:14:08.856750 29525 raft_consensus.cc:1275] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:14:08.856444 29495 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:08.873760 29495 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:08.875921 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:08.876245 29495 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:08.877125 29525 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:08.839282  3047 raft_consensus.cc:697] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:08.885018 29373 raft_consensus.cc:1275] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:14:08.853551  3160 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:08.928516 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 91920.9us
I20260709 13:14:08.930451 29419 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:08.923758 29276 catalog_manager.cc:5697] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 14 to 18, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 18 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:08.933835  3136 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:08.934448 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:08.935307  3162 raft_consensus.cc:2804] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:14:08.936082  3162 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:08.936487  3162 raft_consensus.cc:3060] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:08.942135  3179 raft_consensus.cc:2749] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:08.943184  3179 raft_consensus.cc:2749] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:14:08.944175  3180 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:14:08.951738  3180 raft_consensus.cc:697] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:08.952893  3180 consensus_queue.cc:237] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:08.947813  3173 raft_consensus.cc:3055] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:08.955907  3173 raft_consensus.cc:740] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:08.957062  3173 consensus_queue.cc:260] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:08.959472  3173 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:08.949574 29419 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:08.964598  3036 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:14:08.950523  3136 raft_consensus.cc:2749] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:14:08.947379  3160 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:08.969257  3160 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:08.966418 29419 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:08.933013 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 56961.2us
I20260709 13:14:08.861727  3130 raft_consensus.cc:697] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:08.976176  2434 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:08.976715 29525 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 18.
I20260709 13:14:08.981987 29495 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:08.983368  3080 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:08.984014  3080 raft_consensus.cc:2804] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:14:08.984555  3080 raft_consensus.cc:697] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:08.984989 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:08.982613  3130 consensus_queue.cc:237] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:08.985517  3080 consensus_queue.cc:237] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:08.987912 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:08.990640 29527 raft_consensus.cc:1240] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:14:08.991437 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:14:08.991155 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 212264us
I20260709 13:14:08.975716  3160 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:14:08.997502 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:08.987831 29419 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:09.001693 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:09.009749 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:09.017277  3135 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:09.018218  3135 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:09.019706  3136 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:14:09.032262 29455 raft_consensus.cc:1275] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:14:09.037518 29373 consensus_queue.cc:237] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:14:09.000137  3171 consensus_queue.cc:1048] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:14:09.036259 29344 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:09.046337 29448 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
I20260709 13:14:08.977020  3047 consensus_queue.cc:237] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:09.027853  3136 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:14:09.047434 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 59698.6us
I20260709 13:14:09.048838  3160 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:09.053602 29419 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:09.055408 29495 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:09.067312  2434 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:14:09.067948  2434 raft_consensus.cc:697] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:09.067997 29495 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:09.051873  3136 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:09.074256  3186 consensus_queue.cc:1059] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:14:09.074560  2434 consensus_queue.cc:237] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:09.075563  2964 raft_consensus.cc:2749] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:09.049058  3013 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:09.076109  3135 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:09.064340  3036 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:14:09.122228  3188 log.cc:927] Time spent T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:14:09.047408  3023 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:09.096891  3179 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:14:09.051921  3162 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:14:09.126154 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 72678.9us
W20260709 13:14:09.135887 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:09.173506 29419 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:09.065008  3160 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:09.125535  3180 raft_consensus.cc:3055] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:14:09.180130 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:09.111464  3194 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:14:09.183346  3194 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:09.127987  3013 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:09.191458 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:09.189241 29419 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:09.193846 29380 raft_consensus.cc:2393] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 17: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:09.176688  3179 raft_consensus.cc:697] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:09.128993  3036 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:09.180002  3180 raft_consensus.cc:740] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:09.192046  3194 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:09.206517  3180 consensus_queue.cc:260] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:09.207791  3180 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:09.209585  3162 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 11 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:09.188897  3188 log.cc:927] Time spent T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:14:09.204591  3136 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:09.213765  3160 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:09.214558 29374 raft_consensus.cc:1275] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:14:09.214742 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:09.215837 29377 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
I20260709 13:14:09.216257 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:09.217264 29375 raft_consensus.cc:1240] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:14:09.199652 29380 raft_consensus.cc:1275] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:14:09.219895 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:09.223856  3136 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:09.224493  3136 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:09.227218  3160 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:14:09.227295 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:09.228163 29521 raft_consensus.cc:3060] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:09.228499  3136 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:09.229138  3136 raft_consensus.cc:2749] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:14:09.235675 29373 raft_consensus.cc:1275] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:14:09.236577 29495 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:09.239630 29380 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:14:09.244387 29447 raft_consensus.cc:1275] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:14:09.249291 29380 raft_consensus.cc:606] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:09.249742 29380 raft_consensus.cc:614] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:09.252324  3171 consensus_queue.cc:1048] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:14:09.252364  3179 consensus_queue.cc:237] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:09.254558 29525 raft_consensus.cc:1275] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:14:09.255628 29495 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:09.254987 29525 pending_rounds.cc:85] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 7
I20260709 13:14:09.264945 29525 pending_rounds.cc:107] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:14:09.265215 29525 raft_consensus.cc:2889] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:09.265689 29495 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:09.256490  3186 raft_consensus.cc:2749] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:14:09.271482 28234 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:14:09.264235  2976 raft_consensus.cc:2804] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:09.272318  2976 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:09.272751  2976 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:09.276927  3194 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:09.344441 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 308264us
I20260709 13:14:09.345395 29344 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:09.269688  3173 consensus_queue.cc:1048] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
W20260709 13:14:09.408875 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 56593.3us
I20260709 13:14:09.342144  3180 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:09.427426 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:09.429755 29344 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:09.350240  2962 raft_consensus.cc:2804] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:14:09.430823  2434 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:14:09.432485 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 243327us
I20260709 13:14:09.433001 29521 raft_consensus.cc:2468] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 11.
I20260709 13:14:09.433350 29419 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:09.434782 30119 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:14:09.434780 29419 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:09.431448  2434 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:09.436987 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:09.438954 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:09.443789 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:09.446760 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:09.455029  3209 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:09.457234  2434 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:09.456003  3209 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:09.467846  2574 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:09.468514  2574 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:09.470319 29419 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:09.448410  2930 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:09.475975  2434 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:09.423935  3160 consensus_queue.cc:1048] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:14:09.482940  2434 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:09.478231  2574 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:09.481473  3209 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:09.442210  3163 raft_consensus.cc:2804] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:09.453150  3136 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:09.436264  2837 consensus_queue.cc:1059] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
W20260709 13:14:09.493952 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 228327us
I20260709 13:14:09.412309  3181 consensus_queue.cc:1048] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 13:14:09.450316  2962 raft_consensus.cc:697] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:09.456422  3194 raft_consensus.cc:2749] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:09.503960 29495 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:09.456632  3013 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:09.429005  3197 consensus_queue.cc:1059] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 13:14:09.523802  2434 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:09.530665  2434 consensus_queue.cc:1048] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:09.533977  3163 raft_consensus.cc:697] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:14:09.533679  3047 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:14:09.545573  2962 consensus_queue.cc:237] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:09.553918  3178 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:09.554760  3178 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:09.558924 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:09.559128  3210 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:09.559866  3210 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:09.560649  3136 raft_consensus.cc:3055] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:14:09.561087  3136 raft_consensus.cc:740] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:09.561642  2574 raft_consensus.cc:3055] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:14:09.562083  2574 raft_consensus.cc:740] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:09.562201  3210 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:09.562114  3136 consensus_queue.cc:260] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:09.568073  3178 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:09.570469  3136 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:09.572139  3214 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:14:09.600543 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:09.608934 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 113861us
I20260709 13:14:09.544308  3163 consensus_queue.cc:237] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:09.598162  3047 raft_consensus.cc:697] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:09.563141  2574 consensus_queue.cc:260] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:09.619160 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 96575.1us
I20260709 13:14:09.603171  3197 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:09.628058  3197 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:09.627024 29523 raft_consensus.cc:1275] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 13:14:09.629184 29523 pending_rounds.cc:85] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 10
I20260709 13:14:09.629498 29523 pending_rounds.cc:107] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:14:09.629747 29523 raft_consensus.cc:2889] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:09.630631  3197 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:09.633741 29522 raft_consensus.cc:1275] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:14:09.605825  3214 raft_consensus.cc:697] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 22 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:09.626613 29419 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:09.609484  3156 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:09.610321  2990 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:09.639869 29419 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:09.649574  3215 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:09.644613  3197 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:09.650362  3215 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:09.644896  3210 raft_consensus.cc:2749] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:09.618603  3181 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:09.651772  3181 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:09.652858  3171 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:09.653470  3171 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:09.653906  3181 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:09.658983  3013 consensus_queue.cc:1048] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:14:09.661381  3213 log.cc:927] Time spent T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:14:09.661175  3047 consensus_queue.cc:237] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:09.646378 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:09.668162 29523 raft_consensus.cc:1275] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 13:14:09.652904  3215 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:14:09.690332 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:09.670043 29523 pending_rounds.cc:85] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 9
I20260709 13:14:09.693675 29523 pending_rounds.cc:107] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 13:14:09.694063 29523 raft_consensus.cc:2889] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:09.706214  3218 consensus_queue.cc:1048] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:14:09.691131  2574 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:09.650933  3214 consensus_queue.cc:237] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 21.9, Last appended by leader: 9, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:09.692652  3205 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:09.664911  2990 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:09.646081  3156 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:09.704615  3171 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:09.732321 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:09.740165 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:09.722805  3218 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:09.724362  3194 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:09.728179  3197 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:09.732662  3013 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:09.721311  2976 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:09.742611  3000 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:09.743049  2930 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:09.764730 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:09.757824  3013 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:09.765311 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:09.767297  3013 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:09.723995  3205 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:09.768769 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:09.762717  2930 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:09.767449  2976 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:09.796862 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:09.756642  3197 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:09.797994 29375 raft_consensus.cc:2393] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 19: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:09.761114  3000 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:09.759820  3194 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:09.792693  3013 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:09.751042  3218 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:09.831349 28234 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:14:09.834373 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 90440.6us
I20260709 13:14:09.839947 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:09.840689 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:09.841380 29522 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 17.
I20260709 13:14:09.841542 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:09.843888  3218 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:09.844228 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:09.845661 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:09.847147 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:09.848595 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:09.843902 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:09.813303  3036 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:09.851675 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:09.858814 29375 raft_consensus.cc:2393] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 18: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:09.863637 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:09.866578 29380 raft_consensus.cc:1275] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:14:09.862887 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 23 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:09.869956 29375 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:09.872246 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:09.873683 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:09.874795 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:09.875378 29372 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
I20260709 13:14:09.834884  3173 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:09.880927 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:09.865253 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:09.881728 29381 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 24.
I20260709 13:14:09.884270  3225 consensus_queue.cc:1048] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:14:09.854764  2930 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:09.888379 29529 raft_consensus.cc:1240] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:14:09.889463 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:09.889967 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:09.890794 29447 raft_consensus.cc:2393] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 24: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:09.891222 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:09.891372 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:09.891738  3136 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:09.891903 29448 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16.
I20260709 13:14:09.892088 29455 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16.
I20260709 13:14:09.892287  3136 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:09.895253  3136 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:09.833976  3013 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:09.897033 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:09.897866 29453 raft_consensus.cc:2393] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 19: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:09.898427  3013 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:09.896246 29456 raft_consensus.cc:1275] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:14:09.901094  3156 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:09.896267  3194 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:09.901516 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:09.883445 29375 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 23.
I20260709 13:14:09.905658  3205 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:09.907368  3197 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:09.908463  3023 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:09.913021 29375 raft_consensus.cc:1275] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:14:09.914314 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:09.859813  3218 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:09.926141 29378 raft_consensus.cc:1275] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:14:09.928088 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:09.929683 29495 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:09.930775 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:09.919631  3214 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:09.943598 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 23 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:09.919629  3036 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:09.919790  3197 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:09.959306 29448 raft_consensus.cc:1275] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:14:09.959306 29449 raft_consensus.cc:1275] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:14:09.912930  3173 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:09.965699 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:09.966446 29495 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:09.968112 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:09.970707  2434 raft_consensus.cc:2804] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:09.971130  2434 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:09.971592  2434 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:09.974052 29449 raft_consensus.cc:1275] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:14:09.952641  3225 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:09.953239  3047 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:09.932034  3218 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:09.967321  3237 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:09.979341 29495 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:09.969218  2976 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:09.999223 29495 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:09.950868  3214 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:10.002737 29456 raft_consensus.cc:1275] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:14:10.002983 29495 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:09.975728  3080 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:10.006624 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:09.961032  3036 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:09.964740  3197 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:10.014739 29495 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:10.042928 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:10.046681 29495 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:10.043675 29456 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:14:09.988408  3225 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:10.000962  2976 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:10.051868 29451 raft_consensus.cc:1275] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:14:10.005733  3215 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:14:10.053568  3231 log.cc:927] Time spent T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:14:10.053851  3215 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:14:10.054738  3215 raft_consensus.cc:697] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:10.057133  3215 consensus_queue.cc:237] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 21.9, Last appended by leader: 9, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:10.059278 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:10.004015  3237 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:10.060984 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:10.001375  3047 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:10.039091  3080 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:10.062247  3237 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:10.053393 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:10.062894  3080 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:10.063271 29447 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 20.
I20260709 13:14:10.064419  3047 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:14:10.061195  3240 log.cc:927] Time spent T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:14:10.062865 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:10.062281 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:10.070173 29454 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 24.
I20260709 13:14:09.979817  3179 consensus_queue.cc:1048] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:14:10.078666 29419 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:10.041457  3023 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:14:10.009650  3180 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:10.082278 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:10.082350 29454 raft_consensus.cc:1275] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:14:10.083483 29419 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:10.090180 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:10.090904 29456 raft_consensus.cc:3060] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:14:10.050921  3171 raft_consensus.cc:2749] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:10.056942 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:10.050590  3000 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:10.009812  3181 consensus_queue.cc:1048] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.079s
I20260709 13:14:10.117043 29346 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:10.118892 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 72308.5us
I20260709 13:14:10.139015 29454 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:10.086551  3237 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:10.086225  3023 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:10.145078  3023 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:14:10.146462  3215 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:10.149632  3215 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:10.138731  2434 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:10.089031  3180 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:10.155742 29346 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:10.157166 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:10.157974 29525 raft_consensus.cc:2368] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 10. Current term is 11.
I20260709 13:14:10.158107 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:10.159116 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:10.159266 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:10.159539 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:10.159684 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:10.161010 29529 raft_consensus.cc:1240] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:14:10.161681 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:10.164644 29453 raft_consensus.cc:1275] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:14:10.170132 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:10.170881 29378 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 20.
I20260709 13:14:10.172811  2434 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:10.182884 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:14:10.184216 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 100827us
I20260709 13:14:10.182695 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:10.185820 29419 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:10.153838  3171 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:10.127059  2978 consensus_queue.cc:1048] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:14:10.141654  3047 consensus_queue.cc:1048] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:14:10.189796 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:10.168816  3180 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:10.153499  2930 consensus_queue.cc:1048] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:14:10.139776  3135 consensus_queue.cc:1048] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:14:10.170507  3000 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:10.192962 29377 raft_consensus.cc:1275] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:14:10.196514 29452 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
I20260709 13:14:10.166594  3237 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:10.209450 29419 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:10.192631  3173 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:10.217978 29452 raft_consensus.cc:1275] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:14:10.215188 29454 raft_consensus.cc:1275] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:14:10.223974 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 65451.2us
I20260709 13:14:10.229444  3251 raft_consensus.cc:2804] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:10.192507  3171 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:10.201973  3000 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:10.230341  3216 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:14:10.272915 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 63606.1us
I20260709 13:14:10.230360  3251 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:10.274039 29419 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:10.235299  3000 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:10.281760 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:10.282821 29452 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:10.279955  3214 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:10.229671  3182 consensus_queue.cc:1048] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.134s
I20260709 13:14:10.271992  3218 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:10.300994  3259 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:10.301899  3259 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:10.302618  3246 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:10.303447  3246 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:10.306617  3246 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:10.282771  3251 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:10.325807 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:10.272635  3226 consensus_queue.cc:1048] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.155s
I20260709 13:14:10.330354  3237 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:10.331247  3239 log.cc:927] Time spent T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 13:14:10.334129  3215 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:10.340067  3244 raft_consensus.cc:2749] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:10.341917  3247 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:10.342710  3247 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:10.345203  3171 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:10.345688  3247 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:10.347529  3249 log.cc:927] Time spent T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:14:10.372145  3260 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:10.373569  3260 raft_consensus.cc:2749] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:10.376549  3259 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:10.378768  3036 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:10.390794  3255 log.cc:927] Time spent T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:14:10.406857  2976 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:10.374279  3023 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:10.409997  3023 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:10.410091  3080 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:10.362507  3246 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:10.406451 29276 catalog_manager.cc:5697] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 17 to 18, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 18 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:10.417315 29528 raft_consensus.cc:1275] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:14:10.418885 29456 raft_consensus.cc:2468] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 11.
I20260709 13:14:10.449069 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:10.451838 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:10.449854 29452 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
W20260709 13:14:10.461230 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:10.494709 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 220113us
I20260709 13:14:10.495195 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:10.495708 29419 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:10.485005  3023 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:10.500020  3214 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:10.499719 29419 leader_election.cc:400] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 10. Current term is 11.
I20260709 13:14:10.501912 29419 leader_election.cc:403] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:10.503141  3214 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 10. Current term is 11.
I20260709 13:14:10.505046 29419 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:10.506932  3214 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:10.518175  3023 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:10.521622  3023 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:10.522110  3214 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:10.523792 29419 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:10.529392 29419 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:10.530107  3194 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:10.530295  3246 consensus_queue.cc:1059] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:14:10.530965  3194 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:10.531245  3246 raft_consensus.cc:3055] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:14:10.531692  3246 raft_consensus.cc:740] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:10.532582  3246 consensus_queue.cc:260] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:10.533950  3246 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:10.527072  3184 consensus_queue.cc:1048] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:14:10.542229 29529 raft_consensus.cc:1275] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:14:10.543370 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:10.544021 29529 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:14:10.544772 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:10.545526 29522 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 19.
I20260709 13:14:10.546711 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:10.500303  3219 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:10.550779  3219 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:10.553119  3219 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:10.547374 29522 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 24.
I20260709 13:14:10.544814 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:10.567353  3197 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:10.581096 29278 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37608 (request call id 157) took 22358 ms (client timeout 15000 ms). Trace:
W20260709 13:14:10.571038 29344 consensus_peers.cc:597] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 -> Peer ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671): Couldn't send request to peer ca041dab9b2f44409ed7bf4c6cf66ab2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c2aced39aead4259aa7f2a9995ec3ea5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:10.584628 29344 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:10.584959 29495 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:10.585448  2837 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:10.572486  3216 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:10.585807  3023 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:10.586706  3023 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:10.587592  3023 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:10.587057  3216 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:10.588088 29276 catalog_manager.cc:5697] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:10.589926  3216 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:10.590425 29276 catalog_manager.cc:5697] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:10.592133  3171 consensus_queue.cc:1048] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:14:10.594372  2990 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:10.596367  3250 log.cc:927] Time spent T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.328s	user 0.003s	sys 0.000s
I20260709 13:14:10.597584  3182 consensus_queue.cc:1048] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:10.599676  3225 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:10.599521 29276 catalog_manager.cc:5697] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:10.601073  3182 consensus_queue.cc:1048] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:14:10.603585  2979 consensus_queue.cc:1048] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:14:10.604907  2434 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:10.605229 29449 raft_consensus.cc:1275] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:14:10.602712  3023 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:10.605475  2434 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:10.606308 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:14:10.606961 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 77636.3us
I20260709 13:14:10.609249 29419 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:10.610224  3023 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:10.610937  2434 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:10.611449 29520 tablet_service.cc:1558] Processing DeleteTablet for tablet 829dc08ee0ca4212a3b2c870b0ea1b35 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 8 (current committed config index is 10)) from {username='slave'} at 127.0.0.1:37954
I20260709 13:14:10.612782 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:10.613587 29449 raft_consensus.cc:1275] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:14:10.626715 29455 raft_consensus.cc:2393] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 17: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:10.616254 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:10.627475 29456 raft_consensus.cc:2393] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 24: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
W20260709 13:14:10.581543 29278 rpcz_store.cc:269] 0709 13:13:48.296132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:48.298554 (+  2422us) service_pool.cc:224] Handling call
0709 13:14:10.580985 (+22282431us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:07.732087 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:07.732941 (+   854us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:07.733004 (+    63us) write_op.cc:435] Acquired schema lock
0709 13:14:07.733035 (+    31us) tablet.cc:662] Decoding operations
0709 13:14:07.813643 (+ 80608us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:07.813748 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:07.813779 (+    31us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:14:07.815828 (+  2049us) tablet.cc:701] Row locks acquired
0709 13:14:07.815892 (+    64us) write_op.cc:260] PREPARE: finished
0709 13:14:07.816127 (+   235us) write_op.cc:270] Start()
0709 13:14:07.816448 (+   321us) write_op.cc:276] Timestamp: P: 1783602847816024 usec, L: 0
0709 13:14:07.816494 (+    46us) op_driver.cc:348] REPLICATION: starting
0709 13:14:07.837895 (+ 21401us) log.cc:844] Serialized 7188 byte log entry
0709 13:14:08.143384 (+305489us) op_driver.cc:464] REPLICATION: finished
0709 13:14:08.147475 (+  4091us) write_op.cc:301] APPLY: starting
0709 13:14:08.147620 (+   145us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:08.267352 (+119732us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:08.267614 (+   262us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:08.327334 (+ 59720us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:08.327779 (+   445us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=36,mrs_lookups=0
0709 13:14:08.327839 (+    60us) write_op.cc:312] APPLY: finished
0709 13:14:08.328342 (+   503us) log.cc:844] Serialized 164 byte log entry
0709 13:14:08.331695 (+  3353us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:08.331896 (+   201us) write_op.cc:454] Released schema lock
0709 13:14:08.331993 (+    97us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:08.332507 (+   514us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:08.332535 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":323507,"reported_tablets":55,"child_traces":[["op",{"apply.queue_time_us":3617,"apply.run_cpu_time_us":35694,"apply.run_wall_time_us":184929,"cfile_cache_hit":74,"cfile_cache_hit_bytes":79223,"num_ops":18,"prepare.queue_time_us":128148,"prepare.run_cpu_time_us":19484,"prepare.run_wall_time_us":217790,"raft.queue_time_us":157340,"raft.run_cpu_time_us":4233,"raft.run_wall_time_us":4235,"replication_time_us":326644,"thread_start_us":252966,"threads_started":4,"wal-append.queue_time_us":94013,"wal-append.run_cpu_time_us":36614,"wal-append.run_wall_time_us":1399652}]]}
I20260709 13:14:10.603314 29276 catalog_manager.cc:5697] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 13 to 16, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 16 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:10.620132  3219 consensus_queue.cc:1048] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:14:10.620528 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:10.630119 29453 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 15.
I20260709 13:14:10.632369  3214 raft_consensus.cc:2749] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:10.633906 29419 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:10.621059 29495 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:10.621260 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:10.635175 29451 raft_consensus.cc:2410] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 23 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:14:10.635326 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:10.636968  3219 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:10.637449  3219 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:10.637876  3219 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:10.638198  2434 consensus_queue.cc:1048] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:10.638531 29495 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:10.634048 29376 raft_consensus.cc:1275] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:14:10.615558 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:10.642408 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:10.642515 29452 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
I20260709 13:14:10.638087  3023 consensus_queue.cc:1048] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:10.620882  3080 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:10.643312 29376 raft_consensus.cc:1275] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:14:10.640640  2990 consensus_queue.cc:1048] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:10.644773 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:10.646168  3080 raft_consensus.cc:2804] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:14:10.646241  3023 consensus_queue.cc:1048] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:14:10.648695 29419 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:10.649787  3216 consensus_queue.cc:1059] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:10.651322  2990 raft_consensus.cc:3055] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:14:10.651741  2990 raft_consensus.cc:740] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:10.633383 29276 catalog_manager.cc:5697] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
W20260709 13:14:10.662120 29450 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.050s	sys 0.052s
W20260709 13:14:10.662650 29450 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.051s	sys 0.053s
I20260709 13:14:10.663393 29419 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:10.673009 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:10.680900 29419 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:10.681126 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:14:10.655344  3210 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.923s	user 0.034s	sys 0.017s
I20260709 13:14:10.686507 29376 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 24.
I20260709 13:14:10.681375 29495 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:10.690681  2434 raft_consensus.cc:2804] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:10.691205  2434 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:10.691624  2434 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:10.692399 29419 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:10.661870  3080 raft_consensus.cc:697] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 17 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
W20260709 13:14:10.683079  3210 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.959s	user 0.034s	sys 0.017s
I20260709 13:14:10.694308 29495 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:10.669224  3246 raft_consensus.cc:2749] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:10.715157 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:10.715997 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:10.697505 30121 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:10.719563 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:10.719775 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:10.720474 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:10.720741 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:10.694715 29344 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:10.721325 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:10.721462 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:10.722556 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:10.725728 29530 raft_consensus.cc:1240] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 22. Current term is 23. Ops: []
I20260709 13:14:10.729202 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:10.663522  3182 consensus_queue.cc:1048] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 13:14:10.733662 29525 raft_consensus.cc:2393] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 20: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:10.700974  3218 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:14:10.769748 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:10.683209  3225 consensus_queue.cc:1048] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:14:10.770676 29495 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:10.771150 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:10.771103 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:10.702090  3214 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:10.804605 29455 raft_consensus.cc:1240] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:14:10.772830 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:10.771224 29276 catalog_manager.cc:5697] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:10.692050  2990 consensus_queue.cc:260] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:10.776154 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:10.815407 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:10.693352  3194 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:10.783968 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:10.722209  3023 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:10.683658  3000 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:10.770381 29450 raft_consensus.cc:3055] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:14:10.828143 29450 raft_consensus.cc:740] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
W20260709 13:14:10.778667 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 46094.8us
I20260709 13:14:10.788285 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:10.802763 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:10.803428 29447 raft_consensus.cc:2393] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 20: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:10.708603  3013 raft_consensus.cc:2749] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:14:10.814599 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 43994.7us
W20260709 13:14:10.789887  3160 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.026s	sys 0.043s
W20260709 13:14:10.812034  3180 consensus_meta.cc:287] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.603s	user 0.014s	sys 0.000s
I20260709 13:14:10.816888 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:10.832602 29495 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:10.834012 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:10.787317  3216 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:14:10.825131 29524 raft_consensus.cc:2393] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 18: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:10.802807 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:10.835461  2434 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:10.866839 29276 catalog_manager.cc:5697] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 16 to 17, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 17 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:10.870111 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:10.870823 29380 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 18.
I20260709 13:14:10.810384  3247 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:10.834110  3160 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.026s	sys 0.043s
I20260709 13:14:10.896196 29276 catalog_manager.cc:5697] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 11 to 14, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 14 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:10.893774 29529 raft_consensus.cc:2393] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 16: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:10.899346 29379 raft_consensus.cc:2368] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 17. Current term is 18.
I20260709 13:14:10.899887  2434 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:10.893512 29450 consensus_queue.cc:260] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 22.10, Last appended by leader: 10, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:10.831175  3023 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:10.899741 29344 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:10.812501  3246 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:10.911211 29450 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:10.865566  3216 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:10.866101  3248 raft_consensus.cc:2749] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:14:10.902712  3251 consensus_meta.cc:287] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.583s	user 0.012s	sys 0.002s
I20260709 13:14:10.945706  3023 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:10.904819  3195 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:10.905218  2990 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:10.875715  3180 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:10.993484  3180 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:10.970367  3185 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:10.946208  3247 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:10.970893  3257 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:10.970180 29276 catalog_manager.cc:5697] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 12 to 15, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 15 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:10.909196  3270 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:10.836364  3194 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:10.983418  3234 log.cc:927] Time spent T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:14:10.979151  3251 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:10.984665  3268 log.cc:927] Time spent T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:14:10.988464  3195 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:10.995296 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:10.961814  3216 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:10.962441  3245 raft_consensus.cc:2749] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:14:11.023384 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:10.973346  3111 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:14:11.040720 29276 catalog_manager.cc:5697] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 13 to 16, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 16 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:10.958455  3171 consensus_queue.cc:1048] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:14:10.946785  3246 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:11.065680 29451 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 19.
I20260709 13:14:11.086958 29447 raft_consensus.cc:1240] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
W20260709 13:14:11.075292 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:10.941561  3080 consensus_queue.cc:237] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:11.078089  3261 log.cc:927] Time spent T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 13:14:11.079433  3195 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:11.084268 29276 catalog_manager.cc:5697] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 14 to 17, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 17 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:11.102648 29276 catalog_manager.cc:5697] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 10 to 12, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 12 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:11.104813 29276 catalog_manager.cc:5697] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:11.106673 29276 catalog_manager.cc:5697] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 6 to 14, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 14 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:11.108916  3257 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:11.109510  3257 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:11.109772 29419 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:11.111763 29276 catalog_manager.cc:5697] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:11.113112  3257 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:11.114493 29276 catalog_manager.cc:5697] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 12 to 17. New cstate: current_term: 17 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:11.116488 29276 catalog_manager.cc:5697] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:11.118543 29276 catalog_manager.cc:5697] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:11.123584 29276 catalog_manager.cc:5697] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 12 to 14, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 14 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:11.128003 29276 catalog_manager.cc:5697] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 16 to 18, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 18 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:11.072974  3111 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:11.136269 29450 raft_consensus.cc:1275] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 22 index: 10. Preceding OpId from leader: term: 23 index: 10. (term mismatch)
I20260709 13:14:11.142926 29450 pending_rounds.cc:85] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 9
I20260709 13:14:11.143342 29450 pending_rounds.cc:107] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 22.10
I20260709 13:14:11.034808  3270 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:11.088063  3265 log.cc:927] Time spent T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:14:11.144408 29450 raft_consensus.cc:2889] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:14:11.140568 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 266906us
W20260709 13:14:11.100467  3264 log.cc:927] Time spent T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:14:11.160905 29495 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:11.187059  2434 raft_consensus.cc:2749] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:11.088775  3267 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.188380 29495 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
W20260709 13:14:11.189149 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 251999us
I20260709 13:14:11.144841  3111 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:14:11.192935 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:11.194191 29450 raft_consensus.cc:1275] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:14:11.194576 29450 pending_rounds.cc:85] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 10
I20260709 13:14:11.194818 29450 pending_rounds.cc:107] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:14:11.195341  2434 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:11.197674 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:11.197598 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:11.195930 29450 raft_consensus.cc:2889] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:11.200112 29419 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:11.161870  3019 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:11.205427 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:11.205730 29419 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:11.206113 29525 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 19.
I20260709 13:14:11.201309  2434 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:11.207558 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:11.208890  2964 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.209475  2964 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:11.213351 29346 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:11.213697 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:11.219563 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:11.222891 29526 raft_consensus.cc:1275] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:14:11.189320  3036 raft_consensus.cc:2749] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:11.227560 29376 raft_consensus.cc:1275] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 20 index: 9. Preceding OpId from leader: term: 23 index: 10. (index mismatch)
I20260709 13:14:11.191430  3173 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:11.216055 29419 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:11.227270 29344 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:11.191033  3000 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:11.236248 29419 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:11.203872  3180 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:14:11.210887  3179 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.174916  3257 consensus_queue.cc:1048] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
W20260709 13:14:11.250902 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:11.250726 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:11.241882  3259 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:11.246763  3160 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:11.260218  2979 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:11.224961  3019 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:11.261269  3179 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:11.242489  3173 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:11.283726 29521 raft_consensus.cc:1240] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:14:11.222890  2978 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.225869  3245 raft_consensus.cc:2749] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:11.305120 29450 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:11.212123  3269 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:14:11.312172  3181 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.015s	sys 0.021s
I20260709 13:14:11.231796  3248 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.289336 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:11.327797  2434 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:14:11.229001 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 454328us
I20260709 13:14:11.301280  2350 consensus_queue.cc:1048] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:14:11.318651 29454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2172) took 1045 ms. Trace:
I20260709 13:14:11.198770  3267 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:11.299818  3266 log.cc:927] Time spent T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.111s	user 0.002s	sys 0.000s
I20260709 13:14:11.238951  3225 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:14:11.343930  3239 log.cc:927] Time spent T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:14:11.317523  3180 raft_consensus.cc:697] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:11.283479  3257 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:11.351873 29454 rpcz_store.cc:276] 0709 13:14:10.273569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:10.273879 (+   310us) service_pool.cc:224] Handling call
0709 13:14:10.274872 (+   993us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:10.281076 (+  6204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:10.281132 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:10.286022 (+  4890us) log.cc:844] Serialized 26 byte log entry
0709 13:14:10.497473 (+211451us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:14:10.497538 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:10.497632 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:11.318299 (+820667us) raft_consensus.cc:1685] finished
0709 13:14:11.318336 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:11.318565 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":98000,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":142,"thread_start_us":185458,"threads_started":1,"wal-append.queue_time_us":563944}
I20260709 13:14:11.297479  3000 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:11.369812  3000 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:11.369956 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:11.370285  3000 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:11.383000 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:11.385171 29263 catalog_manager.cc:5028] TS 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): tablet 829dc08ee0ca4212a3b2c870b0ea1b35 (table test-workload [id=364c32d53f7748a2857a4a9acd17c671]) successfully deleted
I20260709 13:14:11.387957 29525 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:14:11.354934 29447 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16.
W20260709 13:14:11.350561  3181 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.015s	sys 0.021s
I20260709 13:14:11.346664  3254 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.418594 29450 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16.
W20260709 13:14:11.437646 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:11.471655  3210 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:11.472478  3210 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:11.476177  3180 consensus_queue.cc:237] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:11.480074  2964 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:11.395521  3257 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:11.424832  3254 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:11.350757  2978 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:11.419760  3251 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:11.406750  3197 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:11.356711  3248 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:11.524621 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 289051us
I20260709 13:14:11.525620 29495 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:11.367796  3225 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:11.530972 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:11.532986 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 303353us
I20260709 13:14:11.524245  3281 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.562232 29346 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:11.557330 29525 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 18.
I20260709 13:14:11.539753  2837 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
W20260709 13:14:11.562119  3219 consensus_meta.cc:287] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.924s	user 0.009s	sys 0.006s
I20260709 13:14:11.529347  3181 consensus_queue.cc:1048] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:14:11.577078 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:11.578164 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:11.541471  3197 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:11.570195  3135 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:11.576848  3269 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:11.604945 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:11.564108  3281 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:11.607326  3290 consensus_queue.cc:1048] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 13:14:11.612418  3251 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:11.572523  2837 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:11.575618  3219 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:11.601565  3019 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:11.664202 29450 raft_consensus.cc:1275] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:14:11.625468  3245 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:11.680750 29528 raft_consensus.cc:1240] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:14:11.625101  3294 raft_consensus.cc:2804] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:14:11.623274  3195 consensus_queue.cc:1048] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
W20260709 13:14:11.678700  2990 consensus_meta.cc:287] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.683s	user 0.014s	sys 0.000s
I20260709 13:14:11.687247 29344 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:11.666244  3180 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
W20260709 13:14:11.744781  3287 log.cc:927] Time spent T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 13:14:11.620957  3269 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:11.759152  3180 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:11.759974  3298 ts_tablet_manager.cc:933] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2: Initiating tablet copy from peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127)
I20260709 13:14:11.761555  3180 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:11.762199  3180 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.762681  3180 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:11.763798  3248 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:11.764479  3248 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:11.764998  3248 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:11.766542  3000 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:11.680605  3267 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:11.736469  3254 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:11.771842  2978 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:11.773335 29374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 2052) took 1136 ms. Trace:
I20260709 13:14:11.773994  3281 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:11.676192  2964 consensus_queue.cc:1059] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 13:14:11.776121  2964 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:11.776222  3197 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:11.776499  3246 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:11.776984  3290 raft_consensus.cc:3055] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:14:11.638835  3251 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:11.745489  3279 log.cc:927] Time spent T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 13:14:11.757799 29523 raft_consensus.cc:1240] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:14:11.773761 29374 rpcz_store.cc:276] 0709 13:14:10.637206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:10.637341 (+   135us) service_pool.cc:224] Handling call
0709 13:14:10.637794 (+   453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:10.640147 (+  2353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:10.640200 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:10.640738 (+   538us) log.cc:844] Serialized 26 byte log entry
0709 13:14:10.998908 (+358170us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:10.998951 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:10.999025 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:11.735150 (+736125us) spinlock_profiling.cc:243] Waited 49.2 ms on lock 0x7b2400116678. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78b1f9c4 00007f6a78b1dacb 00007f6a78cd8dc9 00007f6a78cd8a55 00007f6a78cd7fb0 00007f6a7b94e488 00007f6a7b94ebe8 00007f6a7b926398 00007f6a7b92176a 00007f6a7b920bb6
0709 13:14:11.773000 (+ 37850us) raft_consensus.cc:1685] finished
0709 13:14:11.773024 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:11.773251 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1851,"raft.queue_time_us":2272,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"spinlock_wait_cycles":113241344,"thread_start_us":357776,"threads_started":1,"wal-append.queue_time_us":570632}
I20260709 13:14:11.761564  3269 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:11.784960  3247 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:11.688313  3245 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:11.777441  3290 raft_consensus.cc:740] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:11.786584  3290 consensus_queue.cc:260] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:11.787228  3245 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:11.753830  3219 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:11.778455 29373 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 20.
I20260709 13:14:11.781329  2837 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:11.785068  3194 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:11.801899  3111 consensus_meta.cc:287] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.586s	user 0.010s	sys 0.001s
I20260709 13:14:11.802275 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:11.767362  3248 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:14:11.779608  3288 log.cc:927] Time spent T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
W20260709 13:14:11.781652  3216 consensus_meta.cc:287] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.702s	user 0.010s	sys 0.004s
W20260709 13:14:11.791734 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 104668us
I20260709 13:14:11.776775  2964 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:11.817162  3216 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:11.818462 29378 raft_consensus.cc:2368] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 20. Current term is 21.
I20260709 13:14:11.811532 29449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 3395) took 1013 ms. Trace:
I20260709 13:14:11.819329  3216 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:11.819645 29449 rpcz_store.cc:276] 0709 13:14:10.797751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:11.605265 (+807514us) service_pool.cc:224] Handling call
0709 13:14:11.783166 (+177901us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:11.783333 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:11.783355 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:11.783391 (+    36us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:14:11.783422 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:11.783516 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:11.811322 (+ 27806us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b54002918d0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd858ad 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:14:11.811444 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":408323328}
W20260709 13:14:11.814117 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 146450us
I20260709 13:14:11.824476 29346 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:11.813311 29495 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:11.805267  3156 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:14:11.813951  3290 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:11.802444  3111 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:11.888839  3111 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 25 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:11.861027  3257 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:14:11.862298 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:11.869050  3248 raft_consensus.cc:493] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
W20260709 13:14:11.872361  3275 log.cc:927] Time spent T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.680s	user 0.000s	sys 0.002s
I20260709 13:14:11.880441  3251 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:11.881834  3180 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:11.884979 29456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2189) took 1170 ms. Trace:
I20260709 13:14:11.948253 29419 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:11.823333  3219 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:11.885237  3080 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:11.819368  2964 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:11.842469  3023 consensus_meta.cc:287] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.858s	user 0.014s	sys 0.009s
I20260709 13:14:11.968293 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:11.900415  3288 log.cc:927] Time spent T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:14:11.947889 29456 rpcz_store.cc:276] 0709 13:14:10.714597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:10.715726 (+  1129us) service_pool.cc:224] Handling call
0709 13:14:10.771478 (+ 55752us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:10.789475 (+ 17997us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:10.789525 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:10.824336 (+ 34811us) log.cc:844] Serialized 26 byte log entry
0709 13:14:11.292792 (+468456us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b18002caac0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c7be07 00007f6a81ad6ab9 00007f6a78c9869b 00007f6a78c9693f 00007f6a78c98c02 00007f6a7b92020b 00007f6a7b925d23 00007f6a7b9260d1 00007f6a7bd41a0f
0709 13:14:11.605994 (+313202us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:14:11.606053 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:11.606151 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:11.884492 (+278341us) raft_consensus.cc:1685] finished
0709 13:14:11.884529 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:11.884858 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57149,"raft.queue_time_us":17632,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":35907,"spinlock_wait_cycles":6373120,"thread_start_us":312913,"threads_started":1,"wal-append.queue_time_us":955427}
I20260709 13:14:11.963006 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:11.884984  3000 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:11.966035 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:11.993172 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:11.996600 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:11.998214 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:11.954828  3248 raft_consensus.cc:515] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:12.001277  2990 raft_consensus.cc:2955] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:14:12.002800  3248 leader_election.cc:290] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:11.969435  3156 raft_consensus.cc:697] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:11.947340  3194 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:12.004544 29453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2190) took 1228 ms. Trace:
I20260709 13:14:11.964026 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:12.041957 29524 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 20.
I20260709 13:14:12.004863 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:14:11.995046 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 140227us
I20260709 13:14:11.827520 29525 raft_consensus.cc:1240] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 17 LEADER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:14:12.002542 29527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53428 (request call id 1003) took 1454 ms. Trace:
I20260709 13:14:11.951109  3036 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:14:12.036883 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 212521us
I20260709 13:14:11.952363  3245 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:11.955291  3080 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:12.045931 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:11.973769  3251 raft_consensus.cc:2749] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:12.039553 29453 rpcz_store.cc:276] 0709 13:14:10.776681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:10.776861 (+   180us) service_pool.cc:224] Handling call
0709 13:14:10.813498 (+ 36637us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:11.048406 (+234908us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:14:11.082730 (+ 34324us) log.cc:844] Serialized 14 byte log entry
0709 13:14:11.516146 (+433416us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:11.531640 (+ 15494us) log.cc:844] Serialized 52 byte log entry
0709 13:14:11.531854 (+   214us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:11.532150 (+   296us) log.cc:844] Serialized 14 byte log entry
0709 13:14:11.539706 (+  7556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:11.770897 (+231191us) spinlock_profiling.cc:243] Waited 3.23 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:14:11.858604 (+ 87707us) spinlock_profiling.cc:243] Waited 4.1 ms on lock 0x7b18002fc7a0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c672a6 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419
0709 13:14:11.859074 (+   470us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b54001c2854. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:14:11.859114 (+    40us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:11.887158 (+ 28044us) spinlock_profiling.cc:243] Waited 4.16 ms on lock 0x7b18002fc7a0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c99557 00007f6a78c9b7c1 00007f6a78c9b779 00007f6a78c9b709 00007f6a78c9b6d1 00007f6a78c9a9cd 000000000038f354 000000000038f199 00007f6a78c7c83a
0709 13:14:12.004225 (+117067us) raft_consensus.cc:1685] finished
0709 13:14:12.004260 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:12.004469 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2582,"prepare.queue_time_us":22178,"prepare.run_cpu_time_us":120,"prepare.run_wall_time_us":127,"raft.queue_time_us":18637,"raft.run_cpu_time_us":836,"raft.run_wall_time_us":24280,"spinlock_wait_cycles":559367936,"thread_start_us":331430,"threads_started":1,"wal-append.queue_time_us":450695}
I20260709 13:14:12.048583 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:12.036653 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:12.049783 29528 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 19.
I20260709 13:14:12.044389 29527 rpcz_store.cc:276] 0709 13:14:10.548573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:10.549744 (+  1171us) service_pool.cc:224] Handling call
0709 13:14:10.550109 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:10.550539 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:10.550568 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:10.551071 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 13:14:11.006088 (+455017us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:11.006137 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:11.006700 (+   563us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:11.871342 (+864642us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:14:12.002169 (+130827us) raft_consensus.cc:1685] finished
0709 13:14:12.002196 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:12.002446 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3205,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":138,"spinlock_wait_cycles":252980480,"thread_start_us":454603,"threads_started":1,"wal-append.queue_time_us":582524}
I20260709 13:14:11.968509  3219 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:12.045295  3000 raft_consensus.cc:2749] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:12.039610  3294 raft_consensus.cc:697] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:12.003554  3178 consensus_queue.cc:1048] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:14:12.055124  3080 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:11.975864  3023 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:12.060829  3180 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:12.048959  3248 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:12.068626  3300 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:12.046582  3194 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:12.056167  3036 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:12.055367  3245 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:12.062911  2964 consensus_queue.cc:1048] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:14:12.138968 29522 raft_consensus.cc:1240] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:14:12.068868  3111 consensus_queue.cc:1059] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:14:12.082578  2930 consensus_queue.cc:1059] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:14:12.147902  3298 tablet_copy_client.cc:323] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Beginning tablet copy session from remote peer at address 127.27.146.129:42127
I20260709 13:14:12.157393 29452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2192) took 1284 ms. Trace:
I20260709 13:14:12.129194  3000 consensus_queue.cc:1059] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:14:12.098621  3180 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:12.158052 29452 rpcz_store.cc:276] 0709 13:14:10.872820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:11.785974 (+913154us) service_pool.cc:224] Handling call
0709 13:14:11.786303 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:11.786675 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:11.786706 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:11.787214 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 13:14:12.083910 (+296696us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:12.083977 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:12.084096 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:12.156813 (+ 72717us) raft_consensus.cc:1685] finished
0709 13:14:12.156853 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:12.157066 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1163,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":13390,"thread_start_us":296252,"threads_started":1,"wal-append.queue_time_us":367378}
I20260709 13:14:12.160337  3180 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:12.140226  3300 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:12.163648  3300 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:12.152652  3270 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:12.130205  3251 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.155428  3023 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:12.097774  3248 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:12.170517 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 197387us
I20260709 13:14:12.168823 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:12.178081 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 80868.7us
I20260709 13:14:12.182937 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:12.183446 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:12.183882  2350 consensus_queue.cc:1059] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:14:12.184237 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:12.186997 29521 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:12.184595 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:12.194799 29527 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 18.
I20260709 13:14:12.201297 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:12.202370 29527 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:12.202481 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:12.204602 29451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 3392) took 1409 ms. Trace:
W20260709 13:14:12.213104 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 112636us
I20260709 13:14:12.207548 29451 rpcz_store.cc:276] 0709 13:14:10.795423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:11.590923 (+795500us) service_pool.cc:224] Handling call
0709 13:14:11.591283 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:11.591562 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:14:12.036280 (+444718us) log.cc:844] Serialized 14 byte log entry
0709 13:14:12.204197 (+167917us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:12.204266 (+    69us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:14:12.204318 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:12.204390 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:12.204530 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":295642,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":71,"raft.queue_time_us":12726,"thread_start_us":566674,"threads_started":2}
I20260709 13:14:12.231884  3036 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:12.084960  3156 consensus_queue.cc:237] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:12.253765 29525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 4368) took 1034 ms. Trace:
I20260709 13:14:12.255226 29522 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 4357) took 1052 ms. Trace:
I20260709 13:14:12.188783  3251 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:12.261637 29522 rpcz_store.cc:276] 0709 13:14:11.207587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:11.207713 (+   126us) service_pool.cc:224] Handling call
0709 13:14:11.208066 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:12.143202 (+935136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:12.254862 (+111660us) spinlock_profiling.cc:243] Waited 926 ms on lock 0x7b540019e454. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:14:12.255144 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2130487040}
I20260709 13:14:12.260979 29525 rpcz_store.cc:276] 0709 13:14:11.218937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:11.666315 (+447378us) service_pool.cc:224] Handling call
0709 13:14:11.667339 (+  1024us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:12.044051 (+376712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:12.253154 (+209103us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54000faad4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:14:12.253669 (+   515us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":367638912}
I20260709 13:14:12.265868 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:12.266359 29521 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 21.
W20260709 13:14:12.263693  3271 log.cc:927] Time spent T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 1.077s	user 0.001s	sys 0.006s
I20260709 13:14:12.261233 29528 raft_consensus.cc:2955] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:14:12.227026  3247 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:12.281728 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 65210.6us
I20260709 13:14:12.205078  3294 consensus_queue.cc:237] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:12.276875  3182 raft_consensus.cc:3055] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:14:12.291550  3179 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:12.295535  3270 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:12.296432  3270 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:12.298776  3216 raft_consensus.cc:3055] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:14:12.299367  3216 raft_consensus.cc:740] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:12.300781 29450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2194) took 1101 ms. Trace:
I20260709 13:14:12.301239 29450 rpcz_store.cc:276] 0709 13:14:11.199133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:11.800786 (+601653us) service_pool.cc:224] Handling call
0709 13:14:11.801251 (+   465us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:11.801644 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:11.801680 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:11.802226 (+   546us) log.cc:844] Serialized 26 byte log entry
0709 13:14:12.074313 (+272087us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:14:12.074357 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:12.074444 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:12.300534 (+226090us) raft_consensus.cc:1685] finished
0709 13:14:12.300559 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:12.300712 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1360,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":4531,"thread_start_us":271618,"threads_started":1,"wal-append.queue_time_us":370120}
I20260709 13:14:12.300406  3216 consensus_queue.cc:260] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:12.304051  3270 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:12.305028  3248 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:12.306694  3216 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:12.307989 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:12.312280  3173 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:12.312973  3251 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:12.314033  3219 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:14:12.316162  3313 log.cc:927] Time spent T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:14:12.316413  3194 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:12.279469  3247 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:12.317552 29447 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2191) took 1503 ms. Trace:
I20260709 13:14:12.318329  3080 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:12.319353  3247 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:12.317945 29447 rpcz_store.cc:276] 0709 13:14:10.814164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:11.782391 (+968227us) service_pool.cc:224] Handling call
0709 13:14:11.782766 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:11.783132 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:11.783160 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:11.788243 (+  5083us) log.cc:844] Serialized 26 byte log entry
0709 13:14:12.059922 (+271679us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:14:12.059990 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:12.060096 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:12.317286 (+257190us) raft_consensus.cc:1685] finished
0709 13:14:12.317312 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:12.317484 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1488,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"thread_start_us":219345,"threads_started":1,"wal-append.queue_time_us":326871}
I20260709 13:14:12.319451 29525 raft_consensus.cc:1240] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:14:12.323536 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 24 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:12.327059 29527 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 20.
I20260709 13:14:12.329596 29448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 3356) took 2365 ms. Trace:
I20260709 13:14:12.330006 29448 rpcz_store.cc:276] 0709 13:14:09.958455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:09.960331 (+  1876us) service_pool.cc:224] Handling call
0709 13:14:09.960575 (+   244us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:10.091905 (+131330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:10.091942 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:10.139578 (+ 47636us) log.cc:844] Serialized 26 byte log entry
0709 13:14:10.356119 (+216541us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b1800346060. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c7be07 00007f6a81ad6ab9 00007f6a78c9869b 00007f6a78c9693f 00007f6a78c98c02 00007f6a7b92020b 00007f6a7b925d23 00007f6a7b9260d1 00007f6a7bd41a0f
0709 13:14:10.701501 (+345382us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:14:10.701548 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:10.701628 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:12.208147 (+1506519us) spinlock_profiling.cc:243] Waited 93 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:14:12.323578 (+115431us) raft_consensus.cc:1685] finished
0709 13:14:12.323609 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:12.323763 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18191,"raft.queue_time_us":200531,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":18341,"spinlock_wait_cycles":220301568,"thread_start_us":473542,"threads_started":2,"wal-append.queue_time_us":907120}
W20260709 13:14:12.333355 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 50758us
W20260709 13:14:12.336397 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:12.345326 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:12.349102 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:12.350734 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:12.351626 29447 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:12.353173 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:12.355157 29451 raft_consensus.cc:1240] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:14:12.355716 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:12.360361 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:12.361290 29449 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:12.362414 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:12.363184 29455 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:12.367771 29495 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:12.368095 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:12.368798 29454 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:14:12.369199 29495 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:12.335466 29421 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:12.371892 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:12.378935 29421 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:12.383872 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:12.294216  3036 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:12.293933  3182 raft_consensus.cc:740] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:12.390972 29421 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:12.319672  3245 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:12.402289  2434 consensus_queue.cc:1048] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:14:12.416111 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:12.329288  3210 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:12.423870 29447 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 18.
I20260709 13:14:12.434480 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:12.374010  2930 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:12.387641  3320 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:12.386454  3194 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:12.387195  3171 raft_consensus.cc:2749] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:12.410816  2434 consensus_queue.cc:1243] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer 429e58eb058349e3bf72b5a870c8f6e5 log is divergent from this leader: its last log entry 20.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:14:12.436583 29495 leader_election.cc:400] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 17. Current term is 18.
I20260709 13:14:12.451323 29495 leader_election.cc:403] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:14:12.439199 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 267949us
I20260709 13:14:12.393057  3248 raft_consensus.cc:2749] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:14:12.405076  3251 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:12.435135  3245 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:12.452739 29454 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 25.
I20260709 13:14:12.448196 29449 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 21.
W20260709 13:14:12.458547 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 54991.6us
I20260709 13:14:12.452323 29455 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 20.
I20260709 13:14:12.458253  2434 raft_consensus.cc:2749] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 17. Current term is 18.
W20260709 13:14:12.449410  3292 log.cc:927] Time spent T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:14:12.476877 29495 leader_election.cc:400] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 20. Current term is 21.
I20260709 13:14:12.480434 29495 leader_election.cc:403] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
W20260709 13:14:12.481144 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 285280us
I20260709 13:14:12.406812  3036 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:12.484730  2962 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.485580  3036 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:12.476444  3182 consensus_queue.cc:260] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:12.487313 29448 raft_consensus.cc:2410] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:14:12.485350  2962 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:12.488015 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:12.456622  3251 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:12.459810  3210 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:12.469695  3270 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:12.477538  3245 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:12.455837  2930 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:12.501001  3182 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:12.514374 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:12.517833 29528 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 18.
I20260709 13:14:12.503225  2976 raft_consensus.cc:2749] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 20. Current term is 21.
I20260709 13:14:12.502609  3036 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:12.524998 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:12.522996 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:12.524668 29378 raft_consensus.cc:1240] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 22. Current term is 23. Ops: []
I20260709 13:14:12.530130  2930 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:12.532887  3080 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:12.514573  3210 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:12.535878 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:12.536327  3210 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:12.519728 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:12.538278  3225 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:12.541306  3291 raft_consensus.cc:3055] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:14:12.541770  3291 raft_consensus.cc:740] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:12.544629 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:14:12.545070  2990 consensus_meta.cc:287] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.506s	user 0.013s	sys 0.001s
I20260709 13:14:12.545549 29379 raft_consensus.cc:2393] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 20: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:12.510017  3251 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:12.541141 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:12.553972 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:12.515374  3245 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:12.574038 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:12.511920  3321 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:12.584173 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:12.586308 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:12.587973 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:12.588140 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:12.579501 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 188662us
I20260709 13:14:12.453771  3320 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:12.585064 29374 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 19.
I20260709 13:14:12.547622  3284 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.592929 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:12.591025 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:12.596439 29379 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 17.
I20260709 13:14:12.597656 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:12.596395 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:12.517155  3270 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:12.615862 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:12.626886 29391 tablet_copy_service.cc:140] P 429e58eb058349e3bf72b5a870c8f6e5: Received BeginTabletCopySession request for tablet c2aced39aead4259aa7f2a9995ec3ea5 from peer ca041dab9b2f44409ed7bf4c6cf66ab2 ({username='slave'} at 127.0.0.1:58422)
I20260709 13:14:12.542635  3291 consensus_queue.cc:260] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:12.632879 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:12.562186  3036 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:12.595409  3210 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:12.637068 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:12.664834  3210 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:12.667219  3210 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:12.613651  2964 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:12.643792  3320 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:12.645318  3270 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:12.590340  3321 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:12.610078  3284 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:12.655409  3291 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:12.655922 29344 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:12.656579  3216 consensus_queue.cc:1059] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:12.661485  3036 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:12.664191  2962 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:12.634168 29391 tablet_copy_service.cc:161] P 429e58eb058349e3bf72b5a870c8f6e5: Beginning new tablet copy session on tablet c2aced39aead4259aa7f2a9995ec3ea5 from peer ca041dab9b2f44409ed7bf4c6cf66ab2 at {username='slave'} at 127.0.0.1:58422: session id = ca041dab9b2f44409ed7bf4c6cf66ab2-c2aced39aead4259aa7f2a9995ec3ea5
I20260709 13:14:12.671561 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:12.673619 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:12.674594 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:12.675522 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:12.677893 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:12.682521 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:12.686710  2964 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:12.689832 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 24 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:14:12.690625 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 186971us
I20260709 13:14:12.695308 29419 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:14:12.761140 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 65945.5us
W20260709 13:14:12.760206 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 104369us
I20260709 13:14:12.763268 29450 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:12.765470 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:12.766755 29456 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
I20260709 13:14:12.768900 29456 raft_consensus.cc:1275] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:14:12.770869 29451 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
I20260709 13:14:12.771171 30121 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:12.771859 29453 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:14:12.760370 29373 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 23.
I20260709 13:14:12.761860 29419 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:12.777590  3036 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:12.777745  3270 raft_consensus.cc:2764] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:14:12.776576 29419 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:12.773234  3294 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:12.781178  3335 raft_consensus.cc:2804] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:12.781302  3294 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:12.781728 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:12.781793  3335 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:12.783186 29380 raft_consensus.cc:2393] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 20: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:12.773358  2978 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:14:12.785215  2978 raft_consensus.cc:697] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:12.786410  2978 consensus_queue.cc:237] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:12.796263 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:12.797432 29449 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:12.800166 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:12.800199 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:12.800976 29373 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 17.
I20260709 13:14:12.801761 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:12.803350 29344 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:12.781225  3285 raft_consensus.cc:2749] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:12.806954 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:12.788254  3335 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:12.811134 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:12.814105 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:12.815001 29456 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
I20260709 13:14:12.815702 29373 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 18.
I20260709 13:14:12.822197 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:12.826200 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:12.830938 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:12.831218 29449 raft_consensus.cc:2410] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 20 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:14:12.811945  3326 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:14:12.842926 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:12.843075 29450 raft_consensus.cc:2410] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:14:12.812077  2990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:45410 (request call id 5) took 3783 ms. Trace:
I20260709 13:14:12.846011  2990 rpcz_store.cc:276] 0709 13:14:09.022537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:09.022687 (+   150us) service_pool.cc:224] Handling call
0709 13:14:09.074924 (+ 52237us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b4c002e84c0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7a052a20 00007f6a7a063a29 00007f6a7a029644 00007f6a7a050f2d 00007f6a7a050b93 00007f6a7bcdf1af 00007f6a7bcdef3e 00007f6a7bd64888 00007f6a7bd8175c 00007f6a7bd8276a 00007f6a7bd8191b
0709 13:14:09.127260 (+ 52336us) log.cc:844] Serialized 513 byte log entry
0709 13:14:09.227882 (+100622us) spinlock_profiling.cc:243] Waited 5.4 ms on lock 0x7b540005e9a0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bcff142 00007f6a7bcdfeaa 00007f6a7bce6d53 00007f6a7bce6cd9 00007f6a7bce6c69 00007f6a7bce6c31 00007f6a7bce5dfd 000000000038f354 000000000038f199 00007f6a78c99475
0709 13:14:09.238763 (+ 10881us) spinlock_profiling.cc:243] Waited 904 us on lock 0x7b540005e9a0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bcff142 00007f6a7bcdfeaa 00007f6a7bce6d53 00007f6a7bce6cd9 00007f6a7bce6c69 00007f6a7bce6c31 00007f6a7bce5dfd 000000000038f354 000000000038f199 00007f6a78c99475
0709 13:14:09.239951 (+  1188us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b18003684a0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c672a6 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd06b26 00007f6a7bd0049a 00007f6a7bcff714
0709 13:14:09.240401 (+   450us) spinlock_profiling.cc:243] Waited 2.92 ms on lock 0x7b540005e9a0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd06b26 00007f6a7bd0049a 00007f6a7bcff714 00007f6a7bcdfeaa 00007f6a7bce6d53 00007f6a7bce6cd9 00007f6a7bce6c69 00007f6a7bce6c31 00007f6a7bce5dfd 000000000038f354
0709 13:14:12.805871 (+3565470us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36,"raft.queue_time_us":3888,"raft.run_cpu_time_us":6563,"raft.run_wall_time_us":145847,"spinlock_wait_cycles":69708800,"thread_start_us":57714,"threads_started":1,"wal-append.queue_time_us":98908,"wal-append.run_cpu_time_us":2489,"wal-append.run_wall_time_us":1007443}
I20260709 13:14:12.847823  2930 consensus_queue.cc:1059] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:12.849179  2930 raft_consensus.cc:3055] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:14:12.849558  2930 raft_consensus.cc:740] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:12.850529  2930 consensus_queue.cc:260] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:12.828873 29419 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:12.852411  3270 raft_consensus.cc:2804] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:12.852854  3270 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:12.853174  3270 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:12.857708  3251 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:12.859717  3225 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:12.860307  3225 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:12.862483  3225 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:12.862605  3270 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:12.864156 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:12.865041 29526 raft_consensus.cc:2393] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 18: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:12.844998 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:12.866312 29449 raft_consensus.cc:2393] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 19: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:12.867101 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:12.869626 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 24 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:12.870183  3270 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:12.872915 29495 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:12.875324  3294 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:12.883095 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:12.883410 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:12.879969 29451 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 18.
I20260709 13:14:12.883976 29373 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 18.
I20260709 13:14:12.893464 29495 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:12.895412 29495 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:12.898427 29495 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:12.902361 29495 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:14:12.907392 29421 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.512s (SENT) [suppressed 26 similar messages]
I20260709 13:14:12.909202  2930 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:12.909417  3182 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:12.910172  3182 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:12.912352  2990 raft_consensus.cc:3055] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:14:12.912690  3257 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:14:12.912801  2990 raft_consensus.cc:740] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:12.913391  3257 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:12.914067  3257 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:12.914299  2990 consensus_queue.cc:260] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:14:12.915834 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:12.916025  2990 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:12.904292  3294 raft_consensus.cc:2804] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:12.917109  3080 raft_consensus.cc:2804] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:12.925796  3080 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:12.925659  3245 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:12.926280  3080 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:12.929980 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:12.930898 29373 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 18.
I20260709 13:14:12.917563 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:12.935308 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:12.927942 29454 raft_consensus.cc:2410] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 21 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:14:12.916172 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:12.923954 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:12.937366 29375 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:14:12.917254 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:14:12.940212 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:12.893040  3289 raft_consensus.cc:2804] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:12.944763 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:12.948808 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:12.949708 29372 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 18.
I20260709 13:14:12.950664 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:12.952294 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:12.951867 29495 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:12.900584  3180 raft_consensus.cc:2749] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:12.893711  3326 raft_consensus.cc:697] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:12.964136 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:12.965217 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:12.964334 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:12.978421 29526 raft_consensus.cc:2393] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 20: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:12.913328  3251 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:12.900432  3270 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:12.979279 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:12.981011 29524 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:12.979452 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:12.983686 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:12.918332  3294 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:12.987232 29528 raft_consensus.cc:2393] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 18: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:12.922282  3321 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:12.989396  3270 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:13.044210 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 136857us
I20260709 13:14:12.990756 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:12.995069 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:12.996968 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:12.896881  3225 consensus_queue.cc:1048] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.076s
W20260709 13:14:13.004487  3341 log.cc:927] Time spent T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:14:13.008205  3036 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:12.946347  3289 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:12.990811  3182 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:13.052573 29523 raft_consensus.cc:1275] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:14:13.053972 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:13.076001 29451 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 15.
I20260709 13:14:13.058005 29375 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 19.
I20260709 13:14:12.974987  3173 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:13.085512 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:13.086488 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:13.038043  3294 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:13.087440 29375 raft_consensus.cc:2410] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:14:13.088457 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:13.089114 29375 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 20.
I20260709 13:14:13.090175 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:13.060254  3036 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:13.068392  3289 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:14:13.083972  3328 log.cc:927] Time spent T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:14:13.105393 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:13.116940 29375 raft_consensus.cc:2410] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 21 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
W20260709 13:14:13.092849  3313 log.cc:927] Time spent T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:14:13.085248  3173 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:13.115422  3339 log.cc:927] Time spent T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 13:14:13.108299 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:13.077859  3180 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:13.123051 29372 raft_consensus.cc:1240] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 25 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 24. Current term is 25. Ops: []
W20260709 13:14:13.113562  3343 log.cc:927] Time spent T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.189s	user 0.003s	sys 0.000s
I20260709 13:14:13.124238 29454 raft_consensus.cc:1240] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 24. Current term is 25. Ops: []
I20260709 13:14:13.124550 29377 raft_consensus.cc:1275] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:14:13.133409 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:13.094959  2837 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:13.105625  2979 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:13.105993  3251 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:13.167863 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:13.121985  2964 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:13.178213 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:13.182331 29379 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
I20260709 13:14:13.142235  3245 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:13.183420  3194 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:14:13.186174  3351 log.cc:927] Time spent T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:14:13.213198 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:13.139164  3173 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:13.202147 29524 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 19.
I20260709 13:14:13.142769  3284 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:13.214963 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:13.219579 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:14:13.223985  3353 log.cc:927] Time spent T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:14:13.216042  3194 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:13.230209  3194 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:13.234042  3270 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:13.180130  2837 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:14:13.236177  3345 log.cc:927] Time spent T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 13:14:13.237447  2837 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:13.243924 29375 raft_consensus.cc:2393] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 19: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:13.246711 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:13.161259  3180 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:13.121680  3326 consensus_queue.cc:237] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:13.175712  2979 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:13.269615 29528 raft_consensus.cc:1240] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:14:13.270531 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:13.179819  3251 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:13.256783  2930 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:13.289193 29381 pending_rounds.cc:85] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5: Aborting all ops after (but not including) 8
I20260709 13:14:13.289785 29381 pending_rounds.cc:107] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5: Aborting uncommitted NO_OP operation due to leader change: 20.9
I20260709 13:14:13.290234 29381 raft_consensus.cc:2889] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:14:13.274927  3291 consensus_meta.cc:287] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.561s	user 0.013s	sys 0.000s
I20260709 13:14:13.264678  3364 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:13.272060  3225 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:13.333098 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:13.279188  3245 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:13.273128  3194 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:13.311583  3036 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:13.278524  3270 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:13.317327  2979 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:13.321180  3180 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:13.322162  3173 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:13.339012  3364 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:13.363719  3365 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:13.364382  3365 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:13.364828  3173 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:13.365118  3364 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:13.365801 29525 raft_consensus.cc:2368] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 18. Current term is 19.
I20260709 13:14:13.291841  2930 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:13.323424  3251 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:13.324126  3285 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:13.284588  3257 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:13.372805  3285 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:13.352279  3270 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:13.374862  3257 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:13.376818 29523 raft_consensus.cc:2393] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 21: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:14:13.327435  3361 log.cc:927] Time spent T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:14:13.378065  3080 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:13.304059 29376 raft_consensus.cc:2410] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:14:13.294626 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:13.332096  3225 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:13.346621  3363 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:13.382843  3363 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:13.383615  3225 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:13.385412  3363 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:13.387012 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:13.326007 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:13.362039 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:14:13.361497  3335 consensus_meta.cc:287] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.532s	user 0.011s	sys 0.001s
W20260709 13:14:13.376737 29327 auto_rebalancer.cc:629] Failed to schedule move for tablet f3ea78f0332644d3b941842ae07c5d95: Illegal state: Replica 183db85c071f489fbc8de63a9edd8a3a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:13.351984  3194 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:13.386914  3289 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:13.393352 29421 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:13.412931 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:13.391042  3365 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:13.414839  3080 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:13.418182 29530 raft_consensus.cc:1240] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:14:13.418872  3135 raft_consensus.cc:3055] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:14:13.419303  3135 raft_consensus.cc:740] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:13.420297  3135 consensus_queue.cc:260] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:13.421381  3135 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:13.425467  3294 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:13.426832 29524 raft_consensus.cc:1240] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 14. Current term is 15. Ops: []
W20260709 13:14:13.428709 29327 auto_rebalancer.cc:629] Failed to schedule move for tablet d7c3c09667374b9aa86861c27221f6d3: Illegal state: Replica 183db85c071f489fbc8de63a9edd8a3a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:13.429136 29421 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:13.372749  2930 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:13.432729 29421 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:13.389357  3285 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:14:13.432391 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:13.437006 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:13.438109 29421 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:13.439126 29346 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:13.441267 29421 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:13.443596 29421 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:13.343537  3245 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:13.427280  3289 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:13.448199 29346 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:13.433162  3036 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:13.440182  3251 raft_consensus.cc:2749] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:13.454815 29377 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "71aa3578fd924765ab9ac0729c8d1483"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:14:13.435374  3363 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:13.455183 29346 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:13.392787  3335 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:13.461777 29377 raft_consensus.cc:606] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Received request to transfer leadership to TS 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:13.467521 29377 raft_consensus.cc:614] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:13.446095  3364 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:13.442816  3270 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:13.459616 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 120271us
I20260709 13:14:13.449559  2978 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:13.473261  3195 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:13.444327  3366 raft_consensus.cc:2749] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:13.461127  2979 raft_consensus.cc:2749] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:13.475948  3365 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:13.466987  3372 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:13.489610  3335 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:13.493512 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 50033.8us
I20260709 13:14:13.496178 29495 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:13.504729 29421 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:13.505571 29346 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:13.506992 29421 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:13.491349  3364 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:13.505893  3366 raft_consensus.cc:2749] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:13.507838  3257 consensus_queue.cc:1059] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:13.518559  3080 raft_consensus.cc:3055] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:14:13.519050  3080 raft_consensus.cc:740] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:13.494169  3289 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:13.519976  3289 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:13.520618 29391 tablet_copy_source_session.cc:215] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:13.520164  3080 consensus_queue.cc:260] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:13.521616  3080 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:14:13.522042 29391 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:58422 (request call id 1094) took 1062 ms. Trace:
I20260709 13:14:13.522460  3289 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:13.506696  3225 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:13.514075 29421 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:13.535833 29449 raft_consensus.cc:1240] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:14:13.536455 29451 raft_consensus.cc:1240] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 19. Current term is 20. Ops: []
I20260709 13:14:13.540670 29421 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:13.516757  3270 raft_consensus.cc:2749] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:13.529805  3225 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:13.543388  3225 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:13.530196  3156 raft_consensus.cc:2749] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:13.504007  3372 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:13.551052 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:13.552168 29452 raft_consensus.cc:2368] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 18. Current term is 19.
I20260709 13:14:13.517411  3364 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:13.536814  3294 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:13.555100 29448 raft_consensus.cc:1240] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:14:13.562350 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:13.564146 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 24 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:13.540108  3335 raft_consensus.cc:2749] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:13.515268 29346 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:13.547303  3270 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:13.617501 29450 raft_consensus.cc:1275] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:14:13.618831 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:13.545300 29421 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:13.537776  3366 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:13.566565 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:13.556080  3372 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:13.630043 29452 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 18.
W20260709 13:14:13.637776 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 92576.2us
I20260709 13:14:13.638198 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:14:13.631251 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 116104us
I20260709 13:14:13.634142 29373 raft_consensus.cc:1275] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 13:14:13.634703 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:13.639199 29373 pending_rounds.cc:85] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5: Aborting all ops after (but not including) 7
I20260709 13:14:13.626062 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:13.639458 29455 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:13.639032 29452 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 18.
I20260709 13:14:13.639587 29373 pending_rounds.cc:107] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 13:14:13.640617 29373 raft_consensus.cc:2889] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:13.639850 29448 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 18.
I20260709 13:14:13.641266  3366 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:13.620460 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:13.642311 29421 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:13.650779 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:13.651688 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:13.651924 29522 raft_consensus.cc:2393] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 20: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:13.652366 29523 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 18.
I20260709 13:14:13.654234 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:13.654107 29421 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:13.654971 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:13.655331 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:13.655560 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:13.656392 29525 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 18.
I20260709 13:14:13.656931 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:13.658617 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:13.659407 29526 raft_consensus.cc:2393] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 17: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:13.660158 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:13.661736 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:13.662582 29448 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:13.664606 29346 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:13.667982 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:13.669085 29530 raft_consensus.cc:2368] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 20. Current term is 21.
I20260709 13:14:13.670145 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:13.671048 29529 raft_consensus.cc:2393] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 17: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:13.522473 29391 rpcz_store.cc:276] 0709 13:14:12.475549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:12.519342 (+ 43793us) service_pool.cc:224] Handling call
0709 13:14:13.520186 (+1000844us) spinlock_profiling.cc:243] Waited 515 ms on lock 0x7b540039e9d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd903f7 00007f6a80d26036 00007f6a80d2fa3e 00007f6a785f327b 00007f6a80d2f9ba 00007f6a80d2aacc 00007f6a80d25c7b 00007f6a80d1a8d1 00007f6a7fdce4b4 00007f6a7fdce442
0709 13:14:13.521898 (+  1712us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1184362752}
I20260709 13:14:13.674784 29421 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:13.676386 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:13.676950 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:13.678078 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:13.678857 29374 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 17.
I20260709 13:14:13.677951 29495 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:13.679886 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:13.680070 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:13.681299  3381 raft_consensus.cc:2749] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:13.681435  2979 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:13.683033 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:13.683224 29421 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:13.684118  3335 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:13.684504  3335 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:13.684737 29421 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:13.684921  3335 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:13.685807  3210 raft_consensus.cc:2749] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:13.686556  3210 raft_consensus.cc:2764] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:14:13.688028 29421 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:13.689011  3311 log.cc:927] Time spent T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.597s	user 0.004s	sys 0.000s
I20260709 13:14:13.689146  3381 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:14:13.690717  3378 log.cc:927] Time spent T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:14:13.694795 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:13.634150  3156 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:14:13.703940 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:13.703754 29454 raft_consensus.cc:1275] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:14:13.706009 29495 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:13.706302 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:13.708181 29455 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 21.
I20260709 13:14:13.698055 29421 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:13.648013  3270 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:13.713078 29495 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:13.714956 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:13.711588 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:13.711138 29378 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 20.
I20260709 13:14:13.698972 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:13.700254 29419 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:13.717078  3257 raft_consensus.cc:2749] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:13.710265  3368 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:13.716881  3381 raft_consensus.cc:2804] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:13.720191  3381 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:13.720672  3381 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:13.721150 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:13.719647  3210 raft_consensus.cc:2804] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:14:13.721575 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:13.722219  3210 raft_consensus.cc:697] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 19 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:13.722389 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:13.723438 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:13.723649 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:13.723299  3210 consensus_queue.cc:237] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:13.725976 29419 leader_election.cc:400] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 18. Current term is 19.
I20260709 13:14:13.726461 29419 leader_election.cc:403] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
W20260709 13:14:13.726142 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:13.727248  3379 log.cc:927] Time spent T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:14:13.728047 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:13.728884 29379 raft_consensus.cc:2393] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 20: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:13.729664  3368 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:13.730223  3245 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:13.730523  3368 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:13.735050  3368 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:13.722376 29376 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
I20260709 13:14:13.736770 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:13.673089  3080 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:13.771024 29495 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:13.771664 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:13.774106 29377 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:13.675554  3365 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:14:13.776989 29495 leader_election.cc:304] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:13.778815 29495 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:13.776808 29373 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 18.
I20260709 13:14:13.781245 29495 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:13.783303 29495 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:13.762681  3368 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:13.785955 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:13.789033 29448 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
I20260709 13:14:13.790604 30121 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:14:13.791815 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:13.796988 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:13.798866 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:13.803840 29495 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:13.739805  3156 raft_consensus.cc:697] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 25 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:13.813308  3184 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:13.816262  3298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2aced39aead4259aa7f2a9995ec3ea5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:13.817255 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:13.818048 29526 raft_consensus.cc:1240] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:14:13.771765  3257 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:13.786718  3294 raft_consensus.cc:2749] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:14:13.848762 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:13.849437 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:13.786887  3289 raft_consensus.cc:2749] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:13.827229 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:13.854214 29456 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:13.855786 29455 raft_consensus.cc:1275] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:14:13.782444  3373 raft_consensus.cc:2749] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:13.831769 29346 leader_election.cc:400] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 18. Current term is 19.
I20260709 13:14:13.806579  2976 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:13.842352  3366 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:13.817983  3173 consensus_queue.cc:1048] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:14:13.817683  3180 raft_consensus.cc:2749] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:13.802171  3248 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:14:13.801925  3247 raft_consensus.cc:2749] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 18. Current term is 19.
W20260709 13:14:13.845503 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 133221us
W20260709 13:14:13.804193  3382 log.cc:927] Time spent T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:14:13.779663  3365 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:13.859849 29346 leader_election.cc:403] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:13.861171 29455 raft_consensus.cc:1240] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:13.783231  3080 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:13.871716 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:13.876160 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:13.880569 29421 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:13.879284 29374 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16.
W20260709 13:14:13.888298 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 56981.5us
I20260709 13:14:13.895306 29346 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:13.903891 29346 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:13.859367  3257 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:14:13.905030 29456 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 18.
I20260709 13:14:13.887349  3365 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:14:13.885078  3194 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:13.896323  3284 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 18. Current term is 19.
I20260709 13:14:13.911115 29447 raft_consensus.cc:1240] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:14:13.888991  2990 consensus_queue.cc:1048] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:14:13.922693 29346 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:13.925215  2978 raft_consensus.cc:2749] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:13.903932  3337 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:13.907343  2930 consensus_queue.cc:1059] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:14:13.932099 29346 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:13.921536  2979 raft_consensus.cc:2749] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:14:13.941867 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 61407.6us
I20260709 13:14:13.941506 29346 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:13.946341 29421 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:13.949832 29346 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:13.955618  3210 raft_consensus.cc:2749] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:13.904444  3156 consensus_queue.cc:237] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:13.954033  3366 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:13.950018  3290 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:13.955888  3307 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:13.970829 29346 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:13.940610  3135 consensus_queue.cc:1048] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.031s
W20260709 13:14:13.979287 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 118490us
I20260709 13:14:13.968181  2930 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:13.976783  3366 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:13.988555  3366 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:13.976580  3290 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:14.011037  3386 log.cc:927] Time spent T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:14:14.003062  3290 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:14:14.017918  3385 log.cc:927] Time spent T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:14:14.024029 29346 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:14.031729 29377 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 21.
I20260709 13:14:14.036868  3307 consensus_queue.cc:1059] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:14:14.038286  3307 raft_consensus.cc:3055] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:14:14.038544  3326 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:14.036958  2930 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:14.038691  3307 raft_consensus.cc:740] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:14.018141  3080 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:14.037015  3270 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:14.044454  3270 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:14.046491 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 234726us
I20260709 13:14:14.046875  3270 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:14.048327 29495 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:14.059521  3080 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:14.043107  3257 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:14.041025  2979 consensus_queue.cc:1059] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:14:14.073277  2979 raft_consensus.cc:3055] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:14:14.073819  2979 raft_consensus.cc:740] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:14.075640 29495 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:14.077970  3257 raft_consensus.cc:2749] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:14:14.082794  3384 log.cc:927] Time spent T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.130s	user 0.004s	sys 0.000s
I20260709 13:14:14.089008  3337 raft_consensus.cc:3055] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:14:14.089643  3337 raft_consensus.cc:740] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:14.090668 29495 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:14.089730  3335 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:14.094828  3335 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:14.096061  3307 consensus_queue.cc:260] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:14.056778  3364 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:14.108945  3307 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:14.109031 29277 catalog_manager.cc:5697] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:14.110208  3364 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:14.064301 29421 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:14.111716 29449 raft_consensus.cc:1240] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 19. Current term is 20. Ops: []
W20260709 13:14:14.112084 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 47952.6us
I20260709 13:14:14.098881  2976 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:14:14.074795  2979 consensus_queue.cc:260] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:14.117166  2979 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:14.039840  3381 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:14.101234  3372 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:14.023427  3135 consensus_queue.cc:1048] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:14:14.119280 29277 catalog_manager.cc:5697] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:14.024596  3225 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:14.121837  3381 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:14.122488  3225 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:14.122668  3381 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:14:14.124272  3381 raft_consensus.cc:697] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 20 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:14.123255  3365 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:14.130509  3372 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:14.132002 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 173982us
I20260709 13:14:14.132428 29495 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:14.150501  3337 consensus_queue.cc:260] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:14.154342 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 52776.7us
I20260709 13:14:14.160288  3337 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:14.162014 29344 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:14.162940  3364 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.162789  2978 consensus_queue.cc:1059] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:14:14.163573  3364 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:14.165760  2978 raft_consensus.cc:3055] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:14.166281  2978 raft_consensus.cc:740] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:14.167320 29449 raft_consensus.cc:1275] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:14:14.168505  3080 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:14.169275  3389 consensus_queue.cc:1048] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:14.171775 29453 raft_consensus.cc:1240] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 23. Current term is 24. Ops: []
I20260709 13:14:14.172642  3135 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:14.166106  3364 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:14.178275 29524 raft_consensus.cc:1240] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:14:14.180753  3365 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:14.186379 29524 raft_consensus.cc:1275] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:14:14.195622 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:14.196329 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:14.196696 29374 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 17.
I20260709 13:14:14.198825 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:14.198889 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:14.199064 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:14.199820 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:14.200353 29374 raft_consensus.cc:2410] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:14:14.201521 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:14.201802 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:14.202169 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:14.202579 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:14.203776 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:14.203860 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 24 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:14.204903 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:14.205015 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:14.205091 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:14.205822 29375 raft_consensus.cc:2368] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 20. Current term is 21.
I20260709 13:14:14.205965 29373 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 16.
I20260709 13:14:14.202906 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:14.209766 29453 raft_consensus.cc:1240] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:14.212018 29372 raft_consensus.cc:2410] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:14:14.212504 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:14.207877 29421 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:14.216746 29421 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:14.218187 29381 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47da517282ee462792de545e40119636"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:14:14.219120 29381 raft_consensus.cc:606] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:14.219638 29381 raft_consensus.cc:614] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:14.221251 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:14.224135 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:14.221939 29419 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:14:14.225325 29327 auto_rebalancer.cc:629] Failed to schedule move for tablet ab0baf9ea21a4fe78401601893e7ff66: Illegal state: Replica 429e58eb058349e3bf72b5a870c8f6e5 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:14.222136 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:14.237704 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:14.249238 29419 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:14.251749 29419 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:14:14.261217 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:14.262180 29453 raft_consensus.cc:1240] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:14.237133  3381 consensus_queue.cc:237] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:14.265198 29447 raft_consensus.cc:1240] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 17. Current term is 18. Ops: []
I20260709 13:14:14.239423  3364 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:14.238442  3335 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:14:14.269502 29495 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:14.276175 29495 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:14.267829 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:14.255769  3247 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:14.282125  2976 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:14.282572 29495 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:14.282637  3368 consensus_queue.cc:1048] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:14.283120  3389 raft_consensus.cc:2804] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:14:14.299767 29276 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37586 (request call id 139) took 14038 ms (client timeout 15000 ms). Trace:
I20260709 13:14:14.267903  3080 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.256245  3194 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:14.295817 29451 raft_consensus.cc:2393] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 18: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:14.297461 29495 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:14.271054  3365 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:14.243770  3326 consensus_queue.cc:1059] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:14:14.307047 29495 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:14.309501  3365 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:14.310070  3365 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:14.305002  3389 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:14.310930  3248 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:14:14.311323  3389 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:14.296595  2976 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:14.315776  2976 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:14.310832 29495 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:14.320701 29495 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:14.322263  3180 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:14.322405 29495 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:14.330829  3326 raft_consensus.cc:3055] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:14:14.330989  3289 raft_consensus.cc:2804] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:14:14.331570  3326 raft_consensus.cc:740] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:14.331786  3289 raft_consensus.cc:697] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:14.332535  3326 consensus_queue.cc:260] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:14.332713  3289 consensus_queue.cc:237] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:14.253870  2990 consensus_queue.cc:1048] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:14:14.337718  3173 consensus_queue.cc:1059] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:14.337982  3294 consensus_queue.cc:1059] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 23.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:14.269383  3364 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:14.348126 29524 raft_consensus.cc:1275] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:14:14.323033  3180 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:14:14.295316  3247 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:14.245414  2978 consensus_queue.cc:260] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:14.305542  3257 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:14:14.272536  3366 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:14.300236 29276 rpcz_store.cc:269] 0709 13:14:00.246600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:00.246811 (+   211us) service_pool.cc:224] Handling call
0709 13:14:14.285169 (+14038358us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:11.685790 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:11.746386 (+ 60596us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:11.746430 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:14:11.746447 (+    17us) tablet.cc:662] Decoding operations
0709 13:14:11.748204 (+  1757us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:11.748283 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:11.748310 (+    27us) tablet.cc:685] Acquiring locks for 22 operations
0709 13:14:11.749837 (+  1527us) tablet.cc:701] Row locks acquired
0709 13:14:11.749859 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:14:11.750054 (+   195us) write_op.cc:270] Start()
0709 13:14:11.750193 (+   139us) write_op.cc:276] Timestamp: P: 1783602851749976 usec, L: 0
0709 13:14:11.750214 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:14:11.751371 (+  1157us) log.cc:844] Serialized 8747 byte log entry
0709 13:14:12.647930 (+896559us) op_driver.cc:464] REPLICATION: finished
0709 13:14:12.888989 (+241059us) write_op.cc:301] APPLY: starting
0709 13:14:12.889102 (+   113us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:13.369938 (+480836us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:13.370076 (+   138us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:13.484022 (+113946us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:13.484391 (+   369us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=44,mrs_lookups=0
0709 13:14:13.484441 (+    50us) write_op.cc:312] APPLY: finished
0709 13:14:13.484910 (+   469us) log.cc:844] Serialized 196 byte log entry
0709 13:14:13.485856 (+   946us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:13.486129 (+   273us) write_op.cc:454] Released schema lock
0709 13:14:13.486204 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:13.486632 (+   428us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:13.486662 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1713310,"reported_tablets":55,"child_traces":[["op",{"apply.queue_time_us":236592,"apply.run_cpu_time_us":35403,"apply.run_wall_time_us":601727,"cfile_cache_hit":90,"cfile_cache_hit_bytes":95911,"num_ops":22,"prepare.queue_time_us":378797,"prepare.run_cpu_time_us":64469,"prepare.run_wall_time_us":465226,"raft.queue_time_us":290721,"raft.run_cpu_time_us":24958,"raft.run_wall_time_us":230204,"replication_time_us":867052,"thread_start_us":943519,"threads_started":5,"wal-append.queue_time_us":472784}]]}
I20260709 13:14:14.356720  3373 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:14:14.369218  3364 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:14.337262  3326 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:14.376333  3270 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.401965  3389 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:14.357340  3080 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:14.368306  3290 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:14.415727  3257 raft_consensus.cc:697] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
W20260709 13:14:14.432184 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 180545us
I20260709 13:14:14.405884  3366 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:14.387262  3247 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:14.455472  3337 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.417248  3373 raft_consensus.cc:697] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:14.391276  2990 consensus_queue.cc:1048] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:14:14.416622  3368 consensus_queue.cc:1059] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:14:14.407471  2976 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:14.454397  3270 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:14.501634 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 143215us
W20260709 13:14:14.503872 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 164772us
I20260709 13:14:14.502686  3389 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:14.484864  3337 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:14.516319  2979 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:14:14.581092 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 105943us
I20260709 13:14:14.587870 29419 leader_election.cc:400] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 20. Current term is 21.
I20260709 13:14:14.588380 29419 leader_election.cc:403] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
W20260709 13:14:14.611909 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 102590us
I20260709 13:14:14.526614  3257 consensus_queue.cc:237] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:14.594919  2979 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:14.646916  3389 consensus_queue.cc:1059] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:14:14.648397  3400 log.cc:927] Time spent T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.064s	user 0.001s	sys 0.001s
W20260709 13:14:14.649377  3393 log.cc:927] Time spent T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:14:14.563104  3373 consensus_queue.cc:237] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:14.658725  3080 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:14.612717  3395 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 20. Current term is 21.
I20260709 13:14:14.664036  3270 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:14.665405  3298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:54212 (request call id 218) took 3312 ms. Trace:
I20260709 13:14:14.666666  2976 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:14.667886  3337 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:14.668717  3173 raft_consensus.cc:3055] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:14:14.635654  3394 log.cc:927] Time spent T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.179s	user 0.002s	sys 0.000s
I20260709 13:14:14.672272  2350 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.691854  2350 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
W20260709 13:14:14.694883 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:14.701896  3391 log.cc:927] Time spent T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.281s	user 0.000s	sys 0.003s
I20260709 13:14:14.690980  3173 raft_consensus.cc:740] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:14.677903  3365 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:14.704877  3173 consensus_queue.cc:260] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:14.706002  3173 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:14.706468  3365 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:14.688405  3298 rpcz_store.cc:276] 0709 13:14:11.360234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:11.360405 (+   171us) service_pool.cc:224] Handling call
0709 13:14:11.760540 (+400135us) ts_tablet_manager.cc:934] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2: Initiating tablet copy from peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127)
0709 13:14:13.814731 (+2054191us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:14:14.145841 (+331110us) tablet_metadata.cc:665] Metadata flushed
0709 13:14:14.145983 (+   142us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:14:14.576165 (+430182us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:14:14.626032 (+ 49867us) tablet_replica.cc:206] Creating consensus instance
0709 13:14:14.665207 (+ 39175us) ts_tablet_manager.cc:989] Replica registered.
0709 13:14:14.665290 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":40288,"tablet-copy.queue_time_us":286825,"thread_start_us":479774,"threads_started":2}
I20260709 13:14:14.711107  3298 tablet_copy_client.cc:806] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:14.712255  2350 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:14.713675  3225 raft_consensus.cc:3055] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:14:14.714167  3225 raft_consensus.cc:740] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:14.716014  3389 raft_consensus.cc:3055] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:14:14.716463  3389 raft_consensus.cc:740] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:14.717272  3389 consensus_queue.cc:260] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:14.673235 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 141861us
I20260709 13:14:14.620170  3402 consensus_queue.cc:1059] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.066s
I20260709 13:14:14.682965  3180 raft_consensus.cc:3055] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:14:14.660449  3290 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:14.687469  2979 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:14.687070  2978 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:14:14.693502 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 52822.7us
I20260709 13:14:14.719132 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:14.721153 29529 raft_consensus.cc:1240] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:14.719843 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:14.729758 29526 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 18.
I20260709 13:14:14.731935 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:14.736138 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:14.740018 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:14.731122 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:14.719808 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 122977us
I20260709 13:14:14.723845 29522 raft_consensus.cc:1275] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 13. (term mismatch)
I20260709 13:14:14.744752 29522 pending_rounds.cc:85] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 12
I20260709 13:14:14.752571 29522 pending_rounds.cc:107] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 24.13
I20260709 13:14:14.752928 29522 raft_consensus.cc:2889] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:14.722641  3180 raft_consensus.cc:740] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:14.718130  3247 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:14.757469  3180 consensus_queue.cc:260] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 23.10, Last appended by leader: 10, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:14.758836  3180 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:14:14.759997 29525 raft_consensus.cc:1240] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:14.715116  3225 consensus_queue.cc:260] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:14.761207 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:14.762555 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:14.769819 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:14.755642 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:14.761809  3225 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:14.774828 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:14.776556 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 24 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:14.777675 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:14.758862  3247 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:14.784049 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:14.784238  3397 consensus_queue.cc:1048] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:14:14.784929 29528 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:14:14.792630 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:14.793552 29530 raft_consensus.cc:2393] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 17: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:14.793604 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:14.797035 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:14.797986 29448 raft_consensus.cc:1240] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:14.775111 29344 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:14.803450  2350 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:14.803941  2350 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:14.804266  2350 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:14.804581 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:14.806792 29455 raft_consensus.cc:1240] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 19. Current term is 20. Ops: []
I20260709 13:14:14.809657 29419 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:14.802124 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:14.811837 29448 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
I20260709 13:14:14.726013  3291 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:14.864418 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 51458.5us
W20260709 13:14:14.871946 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 50292.4us
W20260709 13:14:14.867055 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 57527.6us
W20260709 13:14:14.864362 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 74141.3us
I20260709 13:14:14.875423 29419 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:14.794521  3389 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:14.880120 29526 raft_consensus.cc:1275] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:14:14.877082 29495 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:14.812394  3298 tablet_copy_client.cc:670] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:14.878880  3365 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:14:14.906191  2350 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:14.877276  3270 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:14.885576  3247 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:14.816681  3284 consensus_queue.cc:1048] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.088s
I20260709 13:14:14.901867  3404 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:14.881505  2990 consensus_queue.cc:1059] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:14:14.881646  3291 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:14.945809  2350 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:14.958290 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:14.959054 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 332251us
I20260709 13:14:14.936338  3404 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:14.919926  3270 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:14.966894  3396 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:14.981441  3396 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:14.932826 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 58096.7us
W20260709 13:14:14.973526 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 50870.2us
I20260709 13:14:14.910816  3366 consensus_queue.cc:1048] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:14:15.000491  3270 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:14.973122  3404 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:15.004760 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 26 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:15.005832 29528 raft_consensus.cc:2410] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 26 because replica has last-logged OpId of term: 23 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 11.
I20260709 13:14:14.950315  3364 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:15.010063  3364 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:15.010922  3364 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.012805 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:15.037532 29530 raft_consensus.cc:2393] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 17: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:15.037786 29455 raft_consensus.cc:1240] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:15.013537  3425 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:15.018777  3411 raft_consensus.cc:3055] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:14:14.937423  3397 consensus_queue.cc:1059] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:14:15.046875 29450 raft_consensus.cc:1275] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:14:15.025425 29421 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:15.028000 29453 raft_consensus.cc:1240] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:15.032063  3326 raft_consensus.cc:3055] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:14:15.048465  3326 raft_consensus.cc:740] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:15.048705 29421 leader_election.cc:400] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 20. Current term is 21.
I20260709 13:14:15.049422  3326 consensus_queue.cc:260] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:15.050752  3326 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:15.038762 29456 raft_consensus.cc:1275] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:14:15.036572 29344 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:15.052686  3284 raft_consensus.cc:2804] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:15.053074  3284 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:15.053435  3284 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:15.009944  3291 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:15.041630 29530 raft_consensus.cc:1275] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:14:15.036834 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:15.043395 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:15.047132  2930 raft_consensus.cc:3055] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:14:15.049685 29421 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:15.021283 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:15.061360 29521 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:15.056630 29524 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 20.
I20260709 13:14:15.044656  3425 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:15.062289 29421 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:15.065371 29421 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:15.070217  3257 consensus_queue.cc:1059] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 13:14:15.070806  3372 raft_consensus.cc:2804] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:15.084362 29376 raft_consensus.cc:1275] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:14:15.084574  3372 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:15.085129  3372 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:15.071645  3366 raft_consensus.cc:2749] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:14:15.088094  3366 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:15.092523 29421 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:15.093484  3335 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:15.097146 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:15.098119 29453 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 18.
I20260709 13:14:15.099344 29522 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 18.
I20260709 13:14:15.103924 29521 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 19.
I20260709 13:14:15.108264 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:15.109076 29447 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:15.058393 29525 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 19.
I20260709 13:14:15.057204 29448 raft_consensus.cc:2393] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 19: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:15.067466 29344 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:15.075205 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:15.076429 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:15.077823 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:15.043843  3411 raft_consensus.cc:740] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:15.118649 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:15.119052 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:15.119423 29454 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 20.
I20260709 13:14:15.114862 29450 raft_consensus.cc:2393] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 20: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:15.079186 29449 raft_consensus.cc:1240] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:15.066907  3270 raft_consensus.cc:2749] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:15.078325  3337 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:15.082340  3425 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:15.082887 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:15.044232  3364 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:15.093986 29421 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:15.115298 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:15.066588  2930 raft_consensus.cc:740] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:15.116880 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:15.122040 29374 raft_consensus.cc:1275] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:14:15.156987 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:15.123849 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:14:15.157622 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 63722.7us
I20260709 13:14:15.124907 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:15.125819 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:15.128053 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:15.129124 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 26 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:15.141217 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:14:15.113754 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 46393.7us
I20260709 13:14:15.160434 29419 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:14:15.163709 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:15.166209 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:15.167045 29522 raft_consensus.cc:2393] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 18: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:15.162312 29344 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:15.169723 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:15.128990  3428 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:14:15.077754  3173 consensus_queue.cc:1048] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.082s
W20260709 13:14:15.158314  3421 log.cc:927] Time spent T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
W20260709 13:14:15.180063 29277 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35182 (request call id 75) took 14779 ms (client timeout 15000 ms). Trace:
I20260709 13:14:15.185297 29419 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:15.152484  3396 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:15.159397  3270 raft_consensus.cc:2749] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:15.186474 29447 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 19.
I20260709 13:14:15.168782  3210 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:15.172302  3395 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:15.183564  3291 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:14:15.151240  3337 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:15.179653  3428 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:15.209349 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:15.214541 29372 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 17.
I20260709 13:14:15.184175  3368 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:15.220315 29523 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 24.
I20260709 13:14:15.196693  3366 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:14:15.176491  3381 consensus_queue.cc:1048] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:14:15.198675  3247 raft_consensus.cc:2804] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:14:15.221819  3298 tablet_copy_client.cc:538] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:15.225095  2930 consensus_queue.cc:260] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:15.219362  3428 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:15.272123 29449 raft_consensus.cc:1275] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:14:15.210042  3395 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:15.207095  3404 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:15.194473  3411 consensus_queue.cc:260] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:15.233510  3291 raft_consensus.cc:697] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:15.210122  3210 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:15.306262 29380 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16.
I20260709 13:14:15.232685  3368 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:15.189456 29277 rpcz_store.cc:269] 0709 13:14:00.400792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:00.401048 (+   256us) service_pool.cc:224] Handling call
0709 13:14:15.179978 (+14778930us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:14.323812 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:14.324488 (+   676us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:14.324537 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:14:14.324558 (+    21us) tablet.cc:662] Decoding operations
0709 13:14:14.325086 (+   528us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:14.325186 (+   100us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:14.325220 (+    34us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:14:14.325571 (+   351us) tablet.cc:701] Row locks acquired
0709 13:14:14.325602 (+    31us) write_op.cc:260] PREPARE: finished
0709 13:14:14.325780 (+   178us) write_op.cc:270] Start()
0709 13:14:14.325916 (+   136us) write_op.cc:276] Timestamp: P: 1783602854325727 usec, L: 0
0709 13:14:14.325941 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:14:14.326847 (+   906us) log.cc:844] Serialized 925 byte log entry
0709 13:14:14.669952 (+343105us) op_driver.cc:464] REPLICATION: finished
0709 13:14:14.892624 (+222672us) write_op.cc:301] APPLY: starting
0709 13:14:14.909973 (+ 17349us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:14.979648 (+ 69675us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:14.979764 (+   116us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:14.989676 (+  9912us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:14.989893 (+   217us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:14:14.989992 (+    99us) write_op.cc:312] APPLY: finished
0709 13:14:15.042272 (+ 52280us) log.cc:844] Serialized 33 byte log entry
0709 13:14:15.054965 (+ 12693us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:15.055080 (+   115us) write_op.cc:454] Released schema lock
0709 13:14:15.055132 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:15.055602 (+   470us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:15.055640 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":101448,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":208130,"apply.run_cpu_time_us":6534,"apply.run_wall_time_us":173717,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12471,"num_ops":2,"prepare.queue_time_us":177286,"prepare.run_cpu_time_us":3420,"prepare.run_wall_time_us":3420,"replication_time_us":343810,"thread_start_us":233663,"threads_started":2}]]}
W20260709 13:14:15.348310 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:15.305431  2990 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.317286  3366 raft_consensus.cc:697] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 18 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:15.339462  3247 raft_consensus.cc:697] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 19 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:15.374207 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:15.369071 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:15.373384  3411 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:15.405558  3210 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:15.408006  3432 log.cc:927] Time spent T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:14:15.409240  3291 consensus_queue.cc:237] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:15.411108 29379 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 17.
I20260709 13:14:15.413220  3395 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:15.417065  3372 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:15.418922  2978 consensus_meta.cc:287] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.656s	user 0.008s	sys 0.004s
I20260709 13:14:15.420823  2930 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:15.422381 29447 raft_consensus.cc:1275] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:14:15.483052 29373 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 15.
I20260709 13:14:15.435878 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:15.451333 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:15.485340 29530 raft_consensus.cc:2393] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 19: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
W20260709 13:14:15.433287 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:15.475317 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 164592us
I20260709 13:14:15.475744 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:15.487891 29521 raft_consensus.cc:2393] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 15: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:15.478386 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:15.493079  3248 consensus_queue.cc:1048] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:15.476485  3408 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.498693  3408 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:15.501097  3408 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:15.482018  3257 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:15.502219  3257 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:15.505438 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:15.427386 29419 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:14:15.510946 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 83669.4us
I20260709 13:14:15.516721 29524 raft_consensus.cc:2393] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 18: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:14:15.434275  3434 log.cc:927] Time spent T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
W20260709 13:14:15.520905 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:15.527020 29449 raft_consensus.cc:1240] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 16. Current term is 17. Ops: []
I20260709 13:14:15.515892 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:15.477336  3423 log.cc:927] Time spent T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:14:15.512298  3381 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:14:15.427749  3364 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:15.540957 29377 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 19.
I20260709 13:14:15.431311  3337 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:15.364786  2990 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:15.528626  3395 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.547372  3257 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:15.549866 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:15.430567  3389 consensus_queue.cc:1048] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.112s
W20260709 13:14:15.531045  3225 consensus_meta.cc:287] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.717s	user 0.011s	sys 0.003s
I20260709 13:14:15.427278  3284 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:14:15.586198  3404 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:15.587158  3395 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:15.593007 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:15.596220 29379 raft_consensus.cc:1275] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:14:15.613989 29454 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:15.597077 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:15.599412 29421 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:15.614930 29375 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
I20260709 13:14:15.615788  3364 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:14:15.600416 29372 raft_consensus.cc:1275] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:14:15.601987 29495 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:15.617684 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:15.579293 29453 raft_consensus.cc:2393] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 19: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:15.432457  3366 consensus_queue.cc:237] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:15.606302 29376 raft_consensus.cc:1275] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:14:15.555755  3381 raft_consensus.cc:697] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 24 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:15.435056  3247 consensus_queue.cc:237] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:15.599414 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:15.617799 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:15.600976 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:15.664448 29454 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 18.
I20260709 13:14:15.619791 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:15.621721 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:14:15.645161 30183 heartbeater.cc:646] Failed to heartbeat to 127.27.146.190:37499 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.27.146.190:37499 timed out after 15.000s (SENT)
I20260709 13:14:15.650087  3368 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:15.649573  3428 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:15.609459  3365 consensus_queue.cc:1048] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:14:15.654825 29527 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 20.
W20260709 13:14:15.656618 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 54724.2us
I20260709 13:14:15.658665 29421 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:15.662602 29374 raft_consensus.cc:2368] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 18. Current term is 19.
I20260709 13:14:15.656316  3404 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:14:15.682248 29378 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:15.685600 29495 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:15.686502 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:15.692550 29421 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:15.694307 29495 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:15.699299 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:15.700316 29530 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:14:15.700330 29421 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:15.706626 29495 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:15.709072 29421 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:15.702508  3210 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:14:15.703387  3364 raft_consensus.cc:2749] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:15.702930  3368 raft_consensus.cc:2749] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:15.704275  3284 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:15.674875  3444 consensus_queue.cc:1048] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:14:15.720129  3335 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:14:15.720269  3248 raft_consensus.cc:2749] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:15.726634  3270 raft_consensus.cc:2764] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election decision vote started in defunct term 17: won
I20260709 13:14:15.746357  3372 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:15.746604  3395 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:15.733947  3404 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:14:15.773736  3404 raft_consensus.cc:697] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:15.776726  3428 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:15.747655  3449 log.cc:927] Time spent T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:14:15.757686 29380 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
I20260709 13:14:15.749130  2930 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:15.705581  3425 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:15.757078 29495 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:15.767899  3248 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:15.795992  2976 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:15.797923  3248 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:15.798173  2976 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:15.768112  3448 log.cc:927] Time spent T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:14:15.780258 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:15.800176 29524 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:15.774850  3404 consensus_queue.cc:237] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:15.800693  2976 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:15.781092 29530 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 19.
I20260709 13:14:15.793669 29378 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 18.
I20260709 13:14:15.804646 29344 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:15.820713 29524 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 21.
I20260709 13:14:15.800261  3373 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:14:15.824889 29344 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:15.829386  3298 tablet_bootstrap.cc:492] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap starting.
I20260709 13:14:15.788146  3335 raft_consensus.cc:697] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 17 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:15.731889  3381 consensus_queue.cc:237] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 23.10, Last appended by leader: 10, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:15.840559 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 131583us
I20260709 13:14:15.854835 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:15.875331 29524 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 18.
I20260709 13:14:15.829939  3408 raft_consensus.cc:2804] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:14:15.837970  3195 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:14:15.808970  2930 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:15.900663  3248 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:15.901067  2930 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:15.877206 29344 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:15.902784  3337 raft_consensus.cc:2804] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:15.893450  3455 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:15.903324  3337 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:15.903855  3337 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:15.903760  3455 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:15.906401  3455 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:15.907739  3195 raft_consensus.cc:697] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:15.855479  2990 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:15.908820  3195 consensus_queue.cc:237] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:15.820214  3425 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:15.916723 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:15.917564 29521 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 18.
I20260709 13:14:15.895318  3335 consensus_queue.cc:237] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:15.898710  3408 raft_consensus.cc:697] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:15.956631 29344 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:14:15.972486  3430 log.cc:927] Time spent T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.711s	user 0.003s	sys 0.004s
I20260709 13:14:15.923358  3408 consensus_queue.cc:237] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
W20260709 13:14:15.990779 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:15.966102  3428 raft_consensus.cc:2804] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:15.997718 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:14:15.999249 29495 leader_election.cc:336] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.621s (SENT)
I20260709 13:14:16.007328 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:16.011271 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:16.013141 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:16.015439 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:15.993412  3428 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:16.003103  3425 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:16.039955  3457 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:16.040622  3457 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:16.028985  3428 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:16.033246 29527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37958 (request call id 2451) took 1296 ms. Trace:
I20260709 13:14:16.047866 29527 rpcz_store.cc:276] 0709 13:14:14.731838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:14.735683 (+  3845us) service_pool.cc:224] Handling call
0709 13:14:16.028345 (+1292662us) spinlock_profiling.cc:243] Waited 872 ms on lock 0x7b54000a3054. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:14:16.028524 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2006080768}
I20260709 13:14:16.035573 29526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 2463) took 1034 ms. Trace:
I20260709 13:14:16.049216 29526 rpcz_store.cc:276] 0709 13:14:15.001421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:15.011267 (+  9846us) service_pool.cc:224] Handling call
0709 13:14:15.011697 (+   430us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:15.012459 (+   762us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:15.012492 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:15.013181 (+   689us) log.cc:844] Serialized 52 byte log entry
0709 13:14:15.071848 (+ 58667us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:14:15.131386 (+ 59538us) log.cc:844] Serialized 14 byte log entry
0709 13:14:15.131730 (+   344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:15.131838 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:15.919010 (+787172us) spinlock_profiling.cc:243] Waited 6.01 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:14:16.031436 (+112426us) raft_consensus.cc:1685] finished
0709 13:14:16.035204 (+  3768us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:16.035454 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":73362,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":6541,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":14151,"spinlock_wait_cycles":13831424,"thread_start_us":57973,"threads_started":1,"wal-append.queue_time_us":185099}
W20260709 13:14:16.054747 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 90670.8us
I20260709 13:14:16.057860 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:16.059937 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:16.061633 29527 raft_consensus.cc:1275] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:14:16.066347 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:16.075788 29419 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:16.067376  3457 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:16.079077 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:16.129369 29447 raft_consensus.cc:2393] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 19: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
W20260709 13:14:16.131814 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 53291.6us
I20260709 13:14:16.112617  3291 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.147374 29495 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:14:16.168041 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 63865.8us
I20260709 13:14:16.132057  3455 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:14:16.220285 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 140318us
I20260709 13:14:16.155210  3291 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:16.245420  3396 consensus_queue.cc:1059] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:14:16.222723  3459 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:14:16.256456 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 86734.6us
I20260709 13:14:16.247596  3465 consensus_queue.cc:1048] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:14:16.262775  3248 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.264025  3455 raft_consensus.cc:697] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 20 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:16.263618  3180 consensus_queue.cc:1059] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:14:16.163705  3408 consensus_queue.cc:1048] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.118s
I20260709 13:14:16.318516  3368 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.350945  3368 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:16.349954 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 73645.7us
I20260709 13:14:16.354244 29346 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:16.296996  3248 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:16.346513  3257 raft_consensus.cc:3055] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:14:16.348366  3180 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.360452  3257 raft_consensus.cc:740] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:16.366638  3257 consensus_queue.cc:260] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:16.368284  3257 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:16.372028  3465 raft_consensus.cc:2749] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:14:16.373117  3368 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:16.378914  3428 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:16.378017  3337 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:16.382547 29346 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:16.383037  3455 consensus_queue.cc:237] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:16.405483  3291 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:16.411310  3417 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:14:16.429370 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 152302us
I20260709 13:14:16.434283 29346 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:16.434995 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:16.435796 29447 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
I20260709 13:14:16.437009 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:16.401718  3248 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:16.444659 29346 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:16.440047 29495 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:16.450093 29346 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:16.435506  3460 log.cc:927] Time spent T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
W20260709 13:14:16.439596  3461 log.cc:927] Time spent T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.131s	user 0.000s	sys 0.002s
I20260709 13:14:16.458587  2990 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:16.454609  3248 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:16.455761  2978 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:14:16.466580  3468 log.cc:927] Time spent T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:14:16.469180 29450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2272) took 1028 ms. Trace:
I20260709 13:14:16.496001 29450 rpcz_store.cc:276] 0709 13:14:15.441224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:15.441379 (+   155us) service_pool.cc:224] Handling call
0709 13:14:15.441888 (+   509us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:15.447673 (+  5785us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:15.447716 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:15.637546 (+189830us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b18003c1ea0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c672a6 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7a67fa11 00007f6a7a68f372 00007f6a7bdc1a01 00007f6a7bd8643a
0709 13:14:16.013169 (+375623us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b2c0005b3b8. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7a67fa11 00007f6a7a68f372 00007f6a7bdc1a01 00007f6a7bd8643a 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2
0709 13:14:16.013742 (+   573us) log.cc:844] Serialized 26 byte log entry
0709 13:14:16.157465 (+143723us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:14:16.157504 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:16.157593 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:16.468805 (+311212us) raft_consensus.cc:1685] finished
0709 13:14:16.468840 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:16.469081 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5096,"raft.queue_time_us":5365,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":20145,"spinlock_wait_cycles":31914112,"thread_start_us":143309,"threads_started":1,"wal-append.queue_time_us":369126}
W20260709 13:14:16.470398  3462 log.cc:927] Time spent T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:14:16.365067  3180 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:16.451081  3396 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:16.492061  3248 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:16.531841 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 118890us
W20260709 13:14:16.535816 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 85809.3us
I20260709 13:14:16.534082  3248 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:16.537014 29346 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:16.538082  3486 raft_consensus.cc:2749] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:16.539068 29377 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:14:16.539781 29377 raft_consensus.cc:606] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 LEADER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:16.546145  3335 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:16.547958 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:16.549614 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:16.549754 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:16.550238 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:16.550534 29374 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 15.
I20260709 13:14:16.551426 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:16.552225 29372 raft_consensus.cc:2393] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 16: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:14:16.552502 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:16.554865 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:16.556054 29377 raft_consensus.cc:2368] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 18. Current term is 19.
I20260709 13:14:16.558315 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:16.559011 29381 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 19.
W20260709 13:14:16.572736 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 46224.4us
I20260709 13:14:16.546875  3335 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:16.613687  3444 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:16.597182  3248 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:16.602792  3478 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:16.614738  3337 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:16.620373  3477 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:16.621345  3444 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:16.675794  3477 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:16.651639  3459 raft_consensus.cc:697] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 18 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:16.638943  3478 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:16.722723 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 48316.3us
I20260709 13:14:16.706139  3284 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:16.712190  3180 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:14:16.751395  3491 log.cc:927] Time spent T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:14:16.753435  3492 log.cc:927] Time spent T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:14:16.756160  3335 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:16.762135  3478 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:16.763415  3459 consensus_queue.cc:237] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:16.776057  3248 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:16.767165  3428 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:16.807355  3477 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:14:16.813078  3497 log.cc:927] Time spent T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:14:16.820389  3444 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:16.820928  3472 raft_consensus.cc:3055] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:14:16.802982  3451 log.cc:927] Time spent T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:14:16.821404  3472 raft_consensus.cc:740] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:16.823096  3396 raft_consensus.cc:2749] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:16.732478  3284 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:16.827845 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:16.828267 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:16.828630 29450 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:14:16.828835 29454 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:16.830930 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:16.831699 29447 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 21.
I20260709 13:14:16.835515 29495 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:16.827903 29381 raft_consensus.cc:1275] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:14:16.848780 29495 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:16.851395 29454 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 20.
I20260709 13:14:16.826193  3284 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:16.855305 29495 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:16.858096  3487 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:14:16.858852  3487 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:16.859371  3487 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:16.880086  3396 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:16.888339  3396 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:16.852370  2964 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:16.850440  3411 raft_consensus.cc:2804] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:16.846514  3472 consensus_queue.cc:260] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:16.854916  3373 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.891465  3396 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:16.900826  3173 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:14:16.949433  3173 raft_consensus.cc:697] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:16.950378  3173 consensus_queue.cc:237] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:16.905519  2978 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:16.905947  3411 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:16.956066  3411 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:16.954535 29379 raft_consensus.cc:1275] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:14:16.959438  3415 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:16.960153  3415 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:16.960987  3417 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:16.919889 29495 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:16.962502  3415 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:16.964952  2976 raft_consensus.cc:2804] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:16.965463  2976 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:16.965865  2976 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:16.967635  3444 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:16.967972 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:16.968302  3444 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:16.970528  3444 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:16.970813 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:16.934932  3502 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:14:16.963384 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 43604.9us
I20260709 13:14:16.975004 29495 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:14:16.926542 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:16.980890 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:16.981592 29521 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:16.980976 29527 raft_consensus.cc:1275] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:14:16.984336 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:16.989856 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:16.994891 29523 raft_consensus.cc:1275] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:14:16.998162 29447 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:16.920070  3503 consensus_queue.cc:1048] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.083s
I20260709 13:14:16.908053  3472 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:16.993462  3247 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:16.993422  3389 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:17.004221  3247 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:17.005102  3389 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:16.999411  3455 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:17.008023  3455 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:16.971630  3502 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:17.010814 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:17.015081 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:17.019091 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:17.069805 29530 raft_consensus.cc:1275] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:14:17.072388 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 53242.5us
I20260709 13:14:17.073244 29529 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:14:17.021826 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:17.081002 29521 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 19.
I20260709 13:14:16.994576  3477 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:17.086365 29447 raft_consensus.cc:1275] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:14:16.894268  3337 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:16.894793  2964 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:17.095628  3502 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:17.007383  3247 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:17.097535  3428 consensus_queue.cc:1048] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:17.021359  3381 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:17.099939  3294 consensus_queue.cc:1048] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:14:17.101593  3366 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:17.101766 29344 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:16.993983  3457 raft_consensus.cc:2749] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:17.045684  3389 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:17.011565  3444 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:17.106822 29421 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:17.123034 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:17.102397  3284 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:17.197888 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:17.021904  3490 consensus_queue.cc:1048] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.140s
I20260709 13:14:17.211086 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:17.200680 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:17.214438 29447 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
I20260709 13:14:16.908733  3373 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:17.215775 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:14:17.199702 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 97997us
W20260709 13:14:17.230958 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 220908us
I20260709 13:14:17.224023 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:16.996834  3404 consensus_queue.cc:1048] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.115s
I20260709 13:14:17.233760 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:17.232569 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:17.236122 29379 raft_consensus.cc:2376] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19. Re-sending same reply.
I20260709 13:14:17.233760 29495 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:17.237102 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:17.237946 29379 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 15.
I20260709 13:14:17.239619 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:17.239740 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 337116us
I20260709 13:14:17.235307 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:17.233248 29344 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:17.250212 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:17.237373 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:17.253640 29372 raft_consensus.cc:1275] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:14:17.206583  3430 log.cc:927] Time spent T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:14:17.263862 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:17.263990 29381 raft_consensus.cc:1275] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:14:17.197453  3474 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:17.124989  3417 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:17.102643  3477 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:17.292361 29527 raft_consensus.cc:1275] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:14:17.201999  3326 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:17.201225  2964 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:17.301790  3326 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:17.302415  3326 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:17.120286  3415 consensus_queue.cc:1048] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.130s
I20260709 13:14:17.196660  3484 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:17.304773  3484 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:17.124729  3337 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:17.235078  3455 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:17.229705  3284 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:17.328012  3284 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:17.320776 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 214096us
I20260709 13:14:17.274346  3457 raft_consensus.cc:2749] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:17.199349  2976 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:17.229620  3366 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:17.224627  3381 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:17.290336  3502 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.229385  3444 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:17.311826  3471 raft_consensus.cc:2804] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:14:17.313473  3247 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:17.355823  2976 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:17.356529 29525 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:17.343757  3513 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:17.362336  3366 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:17.366464  3444 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:17.369323  3381 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:17.298637  3474 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:17.370344  3506 raft_consensus.cc:493] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:17.299978  3417 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:17.332553  3455 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:17.387426  3471 raft_consensus.cc:697] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:17.380360  3502 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:17.420475  3484 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:17.420318  3373 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:17.389660  3513 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:17.422497  3417 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:17.424217  3513 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:17.425104  3337 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:17.428819  3474 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:17.398825  3506 raft_consensus.cc:515] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:17.431005  3411 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:17.431972  3506 leader_election.cc:290] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:17.398644  3455 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:17.432564  3477 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:17.433686  3411 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:17.434238  3455 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:17.434506  3502 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:17.467993 29279 catalog_manager.cc:5697] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 14 to 15, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 15 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:17.473254 29279 catalog_manager.cc:5697] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 16 to 17, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 17 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:17.478273 29279 catalog_manager.cc:5697] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 19 to 20, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 20 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:17.483193 29279 catalog_manager.cc:5697] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 16 to 21. New cstate: current_term: 21 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:17.492385 29279 catalog_manager.cc:5697] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:17.497081 29279 catalog_manager.cc:5697] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 14 to 15, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 15 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:17.505618 29373 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:14:17.503748 29279 catalog_manager.cc:5697] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 17 to 20, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 20 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:17.513576 29279 catalog_manager.cc:5697] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 14 to 15, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 15 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:17.518989 29373 raft_consensus.cc:606] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 LEADER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:17.520339 29375 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 18.
I20260709 13:14:17.521674 29376 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
I20260709 13:14:17.524142 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:17.525319 29373 raft_consensus.cc:2376] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 19. Re-sending same reply.
I20260709 13:14:17.526417 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:17.529656 29381 raft_consensus.cc:2393] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 19: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:17.530767 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:17.531576 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:17.532491 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:17.535980 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:17.536417 29374 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:14:17.336217 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 104524us
W20260709 13:14:17.542670 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 203270us
I20260709 13:14:17.544746 29421 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:17.560511 29421 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:17.524353 29279 catalog_manager.cc:5697] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 14 to 15, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 15 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:17.564309 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:17.569085 29526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 4491) took 1052 ms. Trace:
I20260709 13:14:17.535226 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:17.530961 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:17.569744 29526 rpcz_store.cc:276] 0709 13:14:16.517060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:16.517631 (+   571us) service_pool.cc:224] Handling call
0709 13:14:16.526482 (+  8851us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:16.834564 (+308082us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:16.834596 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:16.835229 (+   633us) log.cc:844] Serialized 52 byte log entry
0709 13:14:17.220857 (+385628us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:17.223167 (+  2310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:17.223249 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:17.568351 (+345102us) raft_consensus.cc:1685] finished
0709 13:14:17.568393 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:17.568804 (+   411us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":77503,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":5519,"thread_start_us":639640,"threads_started":2,"wal-append.queue_time_us":490837}
I20260709 13:14:17.435963  3471 consensus_queue.cc:237] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:17.389146  3247 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:17.640273  3326 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:17.642642 29379 raft_consensus.cc:2393] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 18: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:17.672261  3396 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.685174  3396 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:17.687808  3404 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.689381  3404 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:17.697068  3472 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.698097  3472 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:17.702164 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:17.706405  3472 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:17.707338  3396 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:17.708426  3444 raft_consensus.cc:2749] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:14:17.714167  3518 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.715050  3518 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:17.716452 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:17.723843  3368 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.724660  3368 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:17.631007 29279 catalog_manager.cc:5697] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 9 to 16, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 16 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:17.739253  3502 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.706487  3335 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.740032  3502 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:17.740314  3335 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:17.742697  3502 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:17.745290  3247 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:17.756147 29381 raft_consensus.cc:1240] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 17. Current term is 18. Ops: []
I20260709 13:14:17.765033  3366 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:17.768396  3335 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:17.770004  3518 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:17.727344  3368 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:17.738336 29279 catalog_manager.cc:5697] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 11 to 18, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 18 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:17.775884 29495 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:17.782959  3506 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:17.711292  3444 raft_consensus.cc:2804] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:17.687271  3326 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:17.815104 29374 raft_consensus.cc:1275] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 23 index: 10. Preceding OpId from leader: term: 24 index: 11. (index mismatch)
I20260709 13:14:17.796569  3465 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:17.816890  3506 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
W20260709 13:14:17.829312 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 134820us
I20260709 13:14:17.829934  3506 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:17.831373  3404 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:17.805079  3444 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:17.844640  3518 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:17.845557  3518 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:14:17.848686 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 288529us
I20260709 13:14:17.850104 29421 leader_election.cc:400] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 18. Current term is 19.
I20260709 13:14:17.850486 29421 leader_election.cc:403] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:17.854074  3524 consensus_queue.cc:1048] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:17.855567 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:17.856319 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:17.857205 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:17.858129 29375 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:17.858351 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:17.858985 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:17.859328 29380 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 18.
I20260709 13:14:17.859647  3195 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:17.859889 29379 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
W20260709 13:14:17.860100 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 84586.6us
I20260709 13:14:17.860409  3195 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:17.856643 29376 raft_consensus.cc:2368] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 19. Current term is 20.
I20260709 13:14:17.862874  3465 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:17.866865  3195 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:17.873704 29495 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:17.894009 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:17.884575 29493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 54355.8us
I20260709 13:14:17.841961  3444 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:14:17.931558 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 81811.9us
I20260709 13:14:17.932894 29421 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:17.933764 29525 consensus_meta.cc:287] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.548s	user 0.007s	sys 0.015s
I20260709 13:14:17.934433 29525 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 20.
I20260709 13:14:17.934506  3335 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:17.935266  3335 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:17.935714  3335 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:17.936071 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:17.944977 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:17.946262 29449 raft_consensus.cc:2393] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 19: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:17.996274 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:18.010774 29447 raft_consensus.cc:1275] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:14:18.028057 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:18.043993  3506 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:17.995834  3457 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:18.050004 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:18.050673  3337 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.051044 29522 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:14:18.003322  3514 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:14:18.054068  3518 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:18.051312  3337 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:18.072853  3518 consensus_queue.cc:1048] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:18.073926 29421 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:18.077175 29421 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:18.078226  3518 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:14:18.078516  3247 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:18.079046  3518 raft_consensus.cc:697] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 19 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:18.081419 29421 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:18.081074  3518 consensus_queue.cc:237] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:18.084787  3506 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:18.085927  3506 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:18.088970  3506 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:17.991312  3404 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:18.095008 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 232531us
I20260709 13:14:18.097198  3411 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:18.104610 29525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37968 (request call id 4498) took 1125 ms. Trace:
I20260709 13:14:18.117797 29525 rpcz_store.cc:276] 0709 13:14:16.979544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:16.979676 (+   132us) service_pool.cc:224] Handling call
0709 13:14:18.104355 (+1124679us) spinlock_profiling.cc:243] Waited 371 ms on lock 0x7b5400100ed4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:14:18.104529 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":854361856}
I20260709 13:14:18.098601 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:18.133306 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:18.102937  3381 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:18.157908 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:18.184010 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:18.184965 29456 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:18.185570  3506 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:18.185825  3513 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.186462  3513 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:18.188674  3511 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.132302  3326 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:18.099462  3335 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:18.191200  3487 consensus_meta.cc:287] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 1.256s	user 0.010s	sys 0.013s
I20260709 13:14:18.097472  3457 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:18.242115 29522 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:18.243885 29375 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16.
I20260709 13:14:18.257843 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:18.186391  3506 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:18.104943  3517 consensus_queue.cc:1048] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.136s
I20260709 13:14:18.259079 29449 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 19.
I20260709 13:14:18.104251  3516 consensus_queue.cc:1059] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.153s
I20260709 13:14:18.273128 29495 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:18.189409  3511 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:18.097198  3525 consensus_queue.cc:1048] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.175s
I20260709 13:14:18.220472  3326 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:18.194936  3404 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:18.284006 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:18.286598 29375 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:14:18.282366 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:18.287606 29375 raft_consensus.cc:606] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 25 LEADER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:18.297807 29447 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:18.266780  3465 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:18.308360 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:18.314222  3368 raft_consensus.cc:2804] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:14:18.324179 29344 consensus_peers.cc:597] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 -> Peer ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671): Couldn't send request to peer ca041dab9b2f44409ed7bf4c6cf66ab2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:18.325037 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 142560us
I20260709 13:14:18.261442  3487 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:18.340888  3526 log.cc:927] Time spent T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:14:18.340420  3465 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:18.341818  3444 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:18.384034 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:18.365049  3513 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:18.402163 29524 raft_consensus.cc:1240] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 21. Current term is 22. Ops: []
I20260709 13:14:18.399199 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:18.384162  3415 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.416123  3411 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:14:18.427752 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 237489us
W20260709 13:14:18.432351  3532 log.cc:927] Time spent T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.147s	user 0.001s	sys 0.001s
I20260709 13:14:18.438629  3404 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:18.439702 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:18.441250  3457 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:14:18.442444  3530 log.cc:927] Time spent T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:14:18.465652 29454 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:18.393280  3516 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:18.472771 29447 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 21.
I20260709 13:14:18.495748 29456 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 19.
I20260709 13:14:18.499460 29449 raft_consensus.cc:1275] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:14:18.501667 29522 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 18.
I20260709 13:14:18.406169  3465 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:18.486558  3528 log.cc:927] Time spent T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 13:14:18.518869  3513 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:18.520705 29495 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:18.520116  3513 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:14:18.513954 29346 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 1.585s (SENT) [suppressed 11 similar messages]
W20260709 13:14:18.529666 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 135148us
I20260709 13:14:18.505815  3525 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:18.500080  3368 raft_consensus.cc:697] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 19 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:18.523365  3539 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:18.509478  3337 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:18.523366  3457 raft_consensus.cc:2749] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:18.516220  3506 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:18.487486  3411 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:18.511649  3381 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:18.502764  3415 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:18.531263  3326 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:18.547257  3487 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:18.567246 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:18.553090  3247 raft_consensus.cc:3055] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:14:18.571656  3539 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:18.573771  3511 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:18.574688  3298 tablet_bootstrap.cc:492] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:18.576368  3298 tablet_bootstrap.cc:492] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap complete.
I20260709 13:14:18.576879  3465 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:18.577527  3298 ts_tablet_manager.cc:1403] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent bootstrapping tablet: real 2.748s	user 0.098s	sys 0.109s
I20260709 13:14:18.577150  3381 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:18.578035  3457 consensus_queue.cc:1048] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:18.527164  3516 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:18.579869  3381 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:18.581208  3516 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:18.567468  3506 consensus_queue.cc:1048] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:14:18.581894  3415 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:18.555953  3525 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:18.569453  3247 raft_consensus.cc:740] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:18.584743  3247 consensus_queue.cc:260] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:18.585472  3525 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:18.586012  3247 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:18.587600  3411 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:18.595841 29452 raft_consensus.cc:1275] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:14:18.599934  3539 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:14:18.604550 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 246158us
W20260709 13:14:18.605608  3534 log.cc:927] Time spent T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 13:14:18.607924  3444 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:18.607921 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:18.610357 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:18.625562  3513 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:18.626695 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 25 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:18.627542 29522 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 24.
I20260709 13:14:18.627916 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:18.628916 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:18.629961 29522 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 19.
I20260709 13:14:18.631958 29521 raft_consensus.cc:1275] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:14:18.633121 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:18.634159 29526 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 20.
I20260709 13:14:18.635023 29528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 4515) took 1056 ms. Trace:
I20260709 13:14:18.636859 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:18.635728 29528 rpcz_store.cc:276] 0709 13:14:17.567379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:17.642197 (+ 74818us) service_pool.cc:224] Handling call
0709 13:14:17.642966 (+   769us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:17.744187 (+101221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:17.744223 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:17.744879 (+   656us) log.cc:844] Serialized 26 byte log entry
0709 13:14:17.987263 (+242384us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:14:17.987388 (+   125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:17.987619 (+   231us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:18.623730 (+636111us) raft_consensus.cc:1685] finished
0709 13:14:18.623755 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:18.623930 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100306,"raft.queue_time_us":100951,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":145,"thread_start_us":239323,"threads_started":1,"wal-append.queue_time_us":487938}
I20260709 13:14:18.632099 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:18.642643 29525 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 22.
I20260709 13:14:18.644343 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:18.644693 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:18.645182 29449 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:18.633234 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:18.648705 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:14:18.650166 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 57897.5us
I20260709 13:14:18.652011 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:18.653009 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:18.604384  3368 consensus_queue.cc:237] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:18.651907 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:18.660171 29447 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
W20260709 13:14:18.672205 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:18.676422  3298 raft_consensus.cc:359] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:14:18.677855  3543 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:18.678110  3298 raft_consensus.cc:740] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Initialized, Role: LEARNER
I20260709 13:14:18.679759 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:18.680442 29455 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 18.
I20260709 13:14:18.678568  3543 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:18.681368  3298 consensus_queue.cc:260] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:14:18.685093  3543 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:18.685752  3298 ts_tablet_manager.cc:1434] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent starting tablet: real 0.108s	user 0.004s	sys 0.009s
I20260709 13:14:18.692653 29524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 4509) took 1455 ms. Trace:
I20260709 13:14:18.676132 29344 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:18.694252 29454 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16.
I20260709 13:14:18.695186 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:18.693171 29524 rpcz_store.cc:276] 0709 13:14:17.236946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:17.239132 (+  2186us) service_pool.cc:224] Handling call
0709 13:14:17.285797 (+ 46665us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:18.466815 (+1181018us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:18.692355 (+225540us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54000a3a54. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:14:18.692580 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2444278016}
I20260709 13:14:18.699589 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:18.700358 29377 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 19.
W20260709 13:14:18.703722  3514 consensus_meta.cc:287] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.651s	user 0.015s	sys 0.008s
I20260709 13:14:18.704471  3514 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 18. Current term is 19.
I20260709 13:14:18.705597 29450 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 19.
I20260709 13:14:18.709069 29448 raft_consensus.cc:1275] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:14:18.693102  3335 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:18.710361 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:18.711226 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:18.712144 29448 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 18.
I20260709 13:14:18.715166 29449 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 20.
W20260709 13:14:18.719444 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 141980us
W20260709 13:14:18.725147 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 49098.2us
I20260709 13:14:18.731747 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:18.718832  3543 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.735695 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:18.728900  3465 raft_consensus.cc:2804] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:18.744411 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:18.745586 29379 raft_consensus.cc:2393] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 20: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:18.746829  3465 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:18.747589 29377 raft_consensus.cc:1275] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:14:18.754113 29391 tablet_copy_service.cc:342] P 429e58eb058349e3bf72b5a870c8f6e5: Request end of tablet copy session ca041dab9b2f44409ed7bf4c6cf66ab2-c2aced39aead4259aa7f2a9995ec3ea5 received from {username='slave'} at 127.0.0.1:58422
I20260709 13:14:18.754992 29391 tablet_copy_service.cc:434] P 429e58eb058349e3bf72b5a870c8f6e5: ending tablet copy session ca041dab9b2f44409ed7bf4c6cf66ab2-c2aced39aead4259aa7f2a9995ec3ea5 on tablet c2aced39aead4259aa7f2a9995ec3ea5 with peer ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:18.747566  3465 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:18.766355 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:18.775615 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:18.775913  3326 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:18.777451 29495 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:18.778939 29454 raft_consensus.cc:2368] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 19. Current term is 20.
I20260709 13:14:18.781940 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:18.784303  3326 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:18.786854  3326 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:18.787962 29344 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:18.766368  3543 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:18.788622 29495 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:18.789228  3547 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:18.795841 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:18.796706 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:18.812489 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:18.796957 29450 raft_consensus.cc:2410] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:14:18.797322 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:18.797554 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:18.797957 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:18.798166 28234 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:14:18.818367 29378 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 18.
I20260709 13:14:18.821678 28234 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:18.822393  3465 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:18.825400  3465 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:18.830562 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:18.834887 29377 raft_consensus.cc:2368] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 15. Current term is 16.
I20260709 13:14:18.813743 29380 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 17.
I20260709 13:14:18.836675 29454 raft_consensus.cc:2393] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 17: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:18.839411 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:18.836354  3326 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:14:18.840456 29450 raft_consensus.cc:2410] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:14:18.841005 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:18.841230 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:18.841429 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:18.842139 29448 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 18.
I20260709 13:14:18.848030 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:18.849129 29379 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 18.
I20260709 13:14:18.851392  3326 raft_consensus.cc:697] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:18.852867  3326 consensus_queue.cc:237] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:18.854790  3411 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:14:18.855261 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 66791.2us
I20260709 13:14:18.855511  3411 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:18.856129  3411 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:18.856804 29495 leader_election.cc:304] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:18.854049 29421 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:18.858426 29449 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 18.
I20260709 13:14:18.860774 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 25 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:18.862660 29344 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:18.865571 29344 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:18.868367 29344 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:18.863201  3547 raft_consensus.cc:2749] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:18.863605  3247 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:18.876153  3247 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:18.876259  3444 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:18.876773  3247 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:18.877084  3444 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:18.879652  3444 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:18.871987  3195 consensus_queue.cc:1048] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:14:18.870759  3337 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:18.882040  3337 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:18.882450  3337 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:18.865288  3514 consensus_queue.cc:1048] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:14:18.890728 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:18.891057 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:18.891374 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:18.892288 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:18.892518 29419 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:18.892673 29454 raft_consensus.cc:1275] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:14:18.893263 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:18.892518 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:18.894549 29447 raft_consensus.cc:2468] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 13.
I20260709 13:14:18.899799 29450 raft_consensus.cc:2376] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 19. Re-sending same reply.
I20260709 13:14:18.872991 29495 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:18.904404  3547 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:18.904633 29495 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:18.904989  3547 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:18.905444  3547 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:18.906033 29495 leader_election.cc:400] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 19. Current term is 20.
I20260709 13:14:18.906414 29495 leader_election.cc:403] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:14:18.907732  3506 raft_consensus.cc:2804] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:18.908308  3506 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:18.908728  3506 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:18.909268  3543 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:18.907758  3457 raft_consensus.cc:2749] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 19. Current term is 20.
I20260709 13:14:18.911031  3335 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:18.912817 29419 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:18.913722 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:14:18.916338 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 46098.9us
I20260709 13:14:18.920190 29455 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 19.
W20260709 13:14:18.920382 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 52058us
I20260709 13:14:18.921813  3506 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:18.922397  3465 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:14:18.922776 29495 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:18.928568  3335 raft_consensus.cc:2749] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:18.950690  3411 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:18.942444  3465 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
W20260709 13:14:18.975626 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 44581.6us
I20260709 13:14:18.990998 29344 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:18.975826  3457 raft_consensus.cc:2804] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:14:18.992007  3457 raft_consensus.cc:697] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:18.993003  3457 consensus_queue.cc:237] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:18.994753  3506 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:18.977277  3247 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:18.976051  3465 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:19.031134 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 25 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:19.045646 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:18.999583  3547 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:19.048656 29450 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
I20260709 13:14:19.056183  3411 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:19.057092  3547 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:19.057790  2978 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:14:19.058629  3563 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:14:19.059098  3563 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:19.059460  3563 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:19.061092 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:19.076835  3247 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:19.080969  3411 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:19.081666  3547 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:19.081849  3411 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:19.082271  3547 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:19.082782  3487 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:19.083539  3487 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:19.084398  3547 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:19.086076  3487 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:19.091200  3411 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:19.094437 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:19.100376 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:19.104020 29447 raft_consensus.cc:1240] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 19. Current term is 20. Ops: []
I20260709 13:14:19.111184 29495 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:19.072423  3337 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:19.123096 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:19.130142 29421 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:19.120819  2978 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:19.123378  3547 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:19.138981 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:19.127362  3368 raft_consensus.cc:2804] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:19.151870 29421 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:19.130280  3563 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:19.135810 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 114143us
I20260709 13:14:19.161607 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:19.136231  3335 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:19.149577  2978 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:14:19.166415  3335 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:19.171717  3335 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:19.172633  3337 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:19.153503  3368 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:19.174166 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:19.165091  3444 raft_consensus.cc:2804] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:19.175997  3368 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:19.166014  3547 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:19.177071  3444 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:19.205798 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:19.223086 29456 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
I20260709 13:14:19.205178 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:19.204980 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:19.205305 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:19.217808  3563 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:19.195860  3567 consensus_queue.cc:1059] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 13:14:19.224962 29455 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
I20260709 13:14:19.221472 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:19.226823 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:19.199060 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:14:19.231994 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:19.233356 30157 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 18 LEARNER]: Advancing to term 19
I20260709 13:14:19.235759 29524 raft_consensus.cc:2376] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 20. Re-sending same reply.
W20260709 13:14:19.243276 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 130279us
I20260709 13:14:19.246186 29421 leader_election.cc:400] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 15. Current term is 16.
I20260709 13:14:19.246622 29421 leader_election.cc:403] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:14:19.249177 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:19.250389 29456 raft_consensus.cc:2393] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 17: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:19.251758 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:19.256337 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:19.201864  3547 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:19.264958  3543 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:19.265843  3543 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:19.268611  3567 raft_consensus.cc:3055] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:14:19.269145  3567 raft_consensus.cc:740] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:19.270213  3567 consensus_queue.cc:260] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:19.227923  3444 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:19.281162 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:19.281433 29419 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:19.281890 29455 raft_consensus.cc:2376] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 20. Re-sending same reply.
W20260709 13:14:19.271319  3564 log.cc:927] Time spent T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:14:19.292749 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:19.292825 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:19.279170  3543 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:19.297132 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:19.298619 29521 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:19.307303 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:19.309551 29527 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:19.310408 29344 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:19.306172  3567 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:19.317354 29346 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:19.323721  3195 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:19.321331  3465 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:19.339313 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 94636.5us
I20260709 13:14:19.293282  3563 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:19.297433  3517 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 15. Current term is 16.
W20260709 13:14:19.348795 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 52800us
I20260709 13:14:19.360514 29528 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:14:19.362011  3517 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:14:19.394171 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 51703.6us
W20260709 13:14:19.388715 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 155559us
I20260709 13:14:19.395474 29421 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:19.355676  3457 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:19.348395  3543 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:14:19.399869 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 50182.5us
I20260709 13:14:19.362812  3195 raft_consensus.cc:2804] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:14:19.336140  3513 consensus_queue.cc:1048] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.073s
I20260709 13:14:19.444304 29527 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 20.
I20260709 13:14:19.356242  3563 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:19.396847  3415 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:19.457424  3517 raft_consensus.cc:2804] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:14:19.497095 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 60740.6us
I20260709 13:14:19.440495  3561 consensus_queue.cc:1048] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:14:19.447948  3543 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:19.453274  3487 consensus_queue.cc:1048] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:14:19.449849  3457 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:19.531332 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 91414us
I20260709 13:14:19.496363  3517 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:14:19.532698 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 136241us
I20260709 13:14:19.484308  3415 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:19.550064 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 136972us
W20260709 13:14:19.548736 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 55351.7us
I20260709 13:14:19.546607  3517 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:19.548540  3195 raft_consensus.cc:697] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:19.554489  3579 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:19.614926 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:19.615748 29526 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:19.557806  2978 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:19.624547  3576 log.cc:927] Time spent T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 13:14:19.628371  3573 log.cc:927] Time spent T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:14:19.639364 29522 raft_consensus.cc:1275] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:14:19.640158  3415 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:19.642006  2978 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 25 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:19.597846  3579 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:19.597437  3465 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:19.643762 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 25 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:19.644449 29525 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:14:19.644948  3579 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:19.646921  3579 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:19.592298  3560 consensus_queue.cc:1048] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:14:19.647471  3579 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:19.680575  3457 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:19.682512  3579 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:19.687026  3335 consensus_meta.cc:287] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.515s	user 0.012s	sys 0.000s
I20260709 13:14:19.693583  3471 raft_consensus.cc:993] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5: : Instructing follower 183db85c071f489fbc8de63a9edd8a3a to start an election
I20260709 13:14:19.648113 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:19.652686 29526 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 21.
I20260709 13:14:19.659010 29525 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 25.
I20260709 13:14:19.666743 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:19.712980 29529 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 20.
I20260709 13:14:19.650383 29521 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 23.
I20260709 13:14:19.654000  3517 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:19.655431 29495 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:19.664665  3563 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:19.720628 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 65449.5us
W20260709 13:14:19.671689  3568 log.cc:927] Time spent T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.223s	user 0.002s	sys 0.000s
I20260709 13:14:19.664393  3543 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:19.734529 29346 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:19.742106 29495 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:19.728330  3547 raft_consensus.cc:2804] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:19.743185  3444 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:19.658023  3195 consensus_queue.cc:237] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:19.743788  3547 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:19.745512  3547 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:19.746289  3444 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:19.714563  3415 raft_consensus.cc:1081] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 25 LEADER]: Signalling peer 183db85c071f489fbc8de63a9edd8a3a to start an election
I20260709 13:14:19.748456 29344 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:19.747953 29346 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:19.753756 29344 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:19.707240  3335 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:19.773590 29495 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:19.783463  3561 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:14:19.802366  3561 raft_consensus.cc:697] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:19.803589  3561 consensus_queue.cc:237] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:19.778151  2978 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:19.768003  3575 raft_consensus.cc:2804] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:19.811556  3575 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:19.812023  3575 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:19.751762  3578 raft_consensus.cc:2804] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:19.816447  3578 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:19.816912  3578 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:19.733947  3465 consensus_queue.cc:1048] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:14:19.759186  3543 consensus_queue.cc:1059] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.082s
I20260709 13:14:19.842455  3588 raft_consensus.cc:3055] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:14:19.844923 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 122624us
I20260709 13:14:19.777153  3567 raft_consensus.cc:2804] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:14:19.854737 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 106878us
I20260709 13:14:19.854425 29529 raft_consensus.cc:1240] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 24. Current term is 25. Ops: []
I20260709 13:14:19.842988  3588 raft_consensus.cc:740] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:19.860549 29346 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:19.864253 29529 raft_consensus.cc:1240] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 17. Current term is 18. Ops: []
W20260709 13:14:19.866604 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 65891us
I20260709 13:14:19.869740  3582 raft_consensus.cc:2749] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:19.862569  2978 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:19.871955  2978 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:19.874487  3594 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:19.875254  2978 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:19.875192  3594 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:19.875975  3513 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:19.876592  3513 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:19.878569 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:19.878598  3444 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:19.879695  3444 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:19.882126  3444 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:19.878633  3514 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:14:19.884496  3584 log.cc:927] Time spent T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.263s	user 0.002s	sys 0.007s
I20260709 13:14:19.884198  3514 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:19.888827  3514 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:19.890383  3335 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:19.863124  3567 raft_consensus.cc:697] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:19.893287  3567 consensus_queue.cc:237] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:19.896420 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:19.907112 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:19.908035 29521 raft_consensus.cc:1275] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:14:19.913343 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 57158.5us
I20260709 13:14:19.914289 29346 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:19.917737  3444 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:19.918453  3444 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:19.929001 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 143363us
I20260709 13:14:19.930351 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:19.934741  3368 consensus_meta.cc:287] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.655s	user 0.016s	sys 0.000s
I20260709 13:14:19.932022  3560 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:19.938251 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:19.939608  2978 consensus_queue.cc:1048] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:19.940881 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:19.941234 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:19.945564 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:19.952327 29346 leader_election.cc:400] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 19. Current term is 20.
I20260709 13:14:19.953470 29346 leader_election.cc:403] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:19.955292 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:19.953945 29344 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:19.935359  3368 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:19.956677  3588 consensus_queue.cc:260] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:19.967264  3594 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:19.967828  3588 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:19.968117  2978 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:14:19.968730  2978 raft_consensus.cc:697] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:19.969877  2978 consensus_queue.cc:237] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:19.965364 29344 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:19.979933 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:20.009824  3517 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:20.034906 29521 raft_consensus.cc:1240] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 20. Current term is 21. Ops: []
I20260709 13:14:20.035933 29524 raft_consensus.cc:1240] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:14:20.036533 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:20.036654 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:20.037472 29528 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 19.
I20260709 13:14:20.038412 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:20.042330 29528 raft_consensus.cc:1240] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 22. Current term is 23. Ops: []
I20260709 13:14:20.010883 29346 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:20.042660 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:20.043942 29346 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:20.044298 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:20.045944 29529 raft_consensus.cc:2393] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 20: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:20.046478 29346 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:19.980513 29344 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:19.961335  3566 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:14:19.961903  3444 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:20.046669  3337 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:20.012118  3561 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:14:20.054777 29346 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:20.056919 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 76538.1us
I20260709 13:14:20.066723 29344 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:20.062630  3415 raft_consensus.cc:2804] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:20.056814  3563 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:14:20.069247 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:20.067989  3415 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:20.071713  3415 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:20.073000  3513 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:20.056442  3601 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:20.076668  3587 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:20.087744 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:19.871264 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:20.055716  3465 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:20.103790 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:19.956900  3578 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:20.105460 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 74574.3us
I20260709 13:14:20.113971 29346 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:20.085539  3563 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:20.117430 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:20.070657  3561 raft_consensus.cc:697] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 25 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:20.101362  3601 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:14:20.124274 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:20.134690  3337 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.135468  3337 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:20.138096  3337 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:20.140551 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:20.145160 29344 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:20.145673 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:20.110683  3465 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:20.091032  3547 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:20.151544 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:20.172761 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 58947.4us
I20260709 13:14:20.126902  3563 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:20.178596 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:20.180820 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:20.157516  3578 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:20.119786  3195 consensus_queue.cc:1048] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:14:20.185909 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:20.186946 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:20.159194  3465 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:20.153927  3582 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:20.172022  3513 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:20.179050  3337 raft_consensus.cc:2804] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:20.174109  3601 raft_consensus.cc:697] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:20.180580  3517 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:20.196502 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:20.178589  3444 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:20.216810  3415 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:20.197238 29524 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:14:20.198978 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:20.194218  3337 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:20.220578  3337 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:20.224208 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:20.224817  3547 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:20.225654 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:20.197149  3513 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:20.227280 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:20.230527  3513 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:20.231521 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:20.232097  3582 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.177028  3575 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:20.232669  3582 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:20.206306 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:20.236049 29529 raft_consensus.cc:1240] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 19. Current term is 20. Ops: []
I20260709 13:14:20.219913  3517 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:20.236541 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:20.237099  3575 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:20.237943 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:20.238384  3517 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:20.239108 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:20.252055 29530 raft_consensus.cc:2393] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 22: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:20.252341 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:20.252990 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:20.253281 29447 raft_consensus.cc:2368] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 19. Current term is 20.
I20260709 13:14:20.254469 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:20.212836  3368 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:20.158519  3561 consensus_queue.cc:237] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 24.11, Last appended by leader: 11, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:20.216238  3601 consensus_queue.cc:237] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:20.255867 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:20.256661 29450 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 21.
I20260709 13:14:20.257781 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:20.213757  3587 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:20.259110  3587 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:20.217451  3444 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:20.260084 29448 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:20.261646 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:20.262154  3444 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:20.210434 29346 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:20.263386 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 53039.1us
I20260709 13:14:20.264227 29346 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:20.259155 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:20.265144 29456 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 13.
I20260709 13:14:20.270396 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:20.273340  3580 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:20.274398  3580 raft_consensus.cc:2749] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:20.276260  3578 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:20.277150  3578 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:20.279670  3578 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:20.282053  3578 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:20.282678  3578 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:20.284922  3578 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:20.287935 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 25 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:20.244325 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:20.237111  3582 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:20.245257  3415 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:20.245357 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:20.248958 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:20.254395 29530 raft_consensus.cc:1240] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 19. Current term is 20. Ops: []
I20260709 13:14:20.295614 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:20.297410 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:20.299307 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:20.300115 29455 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 15.
I20260709 13:14:20.279367 29524 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 20.
I20260709 13:14:20.232658 29526 raft_consensus.cc:1240] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:14:20.307752 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:20.309762 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:20.313653 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:20.313748 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:20.317595 29528 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 20.
I20260709 13:14:20.324579 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:20.325438 29453 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 25.
I20260709 13:14:20.326480 29448 raft_consensus.cc:1275] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:14:20.332118 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:20.245738  3566 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 19. Current term is 20.
I20260709 13:14:20.340237 29372 raft_consensus.cc:1240] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:20.349563 29454 raft_consensus.cc:1275] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:14:20.352029  3337 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:20.353211 29375 raft_consensus.cc:1240] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:20.354452  3337 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:20.355770 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:14:20.355799 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 151075us
I20260709 13:14:20.356323 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:20.363270 29419 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:20.364332 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:20.356698 29372 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
I20260709 13:14:20.366647 29376 raft_consensus.cc:1275] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:14:20.367825 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:20.368369 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:20.368486 29528 raft_consensus.cc:2376] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 20. Re-sending same reply.
I20260709 13:14:20.369024 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:20.369493 29447 raft_consensus.cc:1240] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:20.369740 29375 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:20.304962  3465 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:20.370172 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:20.293695  3563 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:20.376114 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:20.365083 29453 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
I20260709 13:14:20.376848 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:20.372360 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:20.377703 29372 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:20.372215 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:20.382066 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:20.382424 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:20.383241 29528 raft_consensus.cc:2393] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 20: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:20.384150 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:20.384460 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:20.386082 29449 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:20.380880 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:20.386859 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:20.386623 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:20.390075 29447 raft_consensus.cc:1240] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:20.390450 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:20.391456 29521 raft_consensus.cc:2393] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 18: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:20.392584 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:20.394013 29527 raft_consensus.cc:1275] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:14:20.394145 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:20.394975 29374 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 18.
I20260709 13:14:20.330272  3587 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:20.406658 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:20.401710 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:20.409065 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:20.409991 29453 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:20.410929 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:20.411981 29524 raft_consensus.cc:2393] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 19: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:20.413585 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:20.416661 29495 leader_election.cc:400] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 19. Current term is 20.
I20260709 13:14:20.418874 29495 leader_election.cc:403] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:14:20.420213 29380 raft_consensus.cc:1240] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:14:20.422155 29373 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
I20260709 13:14:20.350682  3444 consensus_queue.cc:1059] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:14:20.424503 29379 raft_consensus.cc:2393] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 21: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:20.424778 29447 raft_consensus.cc:1240] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 17. Current term is 18. Ops: []
I20260709 13:14:20.425307 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:20.427068 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:20.427238 29419 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:20.430639 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:20.384610  3594 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:20.433290 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:20.396306  3590 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:20.433420 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:20.371922  3513 consensus_queue.cc:1048] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:14:20.442902  3465 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:20.436414  3368 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 19. Current term is 20.
I20260709 13:14:20.445294  3587 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:20.449189 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:20.433949 29525 raft_consensus.cc:2393] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 20: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:20.434307  3517 consensus_queue.cc:1059] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:14:20.384409  3561 consensus_queue.cc:1059] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:14:20.476320 29377 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 22.
I20260709 13:14:20.479063 29449 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 18.
I20260709 13:14:20.432451 29448 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:20.434787 29495 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:14:20.489318 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 54641.1us
I20260709 13:14:20.468767  3563 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:20.491060 29495 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:20.501112 29448 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 20.
I20260709 13:14:20.494163 29453 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 18.
I20260709 13:14:20.420388  3567 consensus_queue.cc:1048] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:14:20.505064 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:20.508086  3611 raft_consensus.cc:1064] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5: attempting to promote NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 to VOTER
I20260709 13:14:20.509435 29495 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:20.431273  3595 consensus_queue.cc:1059] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:14:20.503677  3587 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:14:20.522799 29521 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:20.510077  3368 raft_consensus.cc:2804] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:14:20.532359 29380 raft_consensus.cc:1240] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 19. Current term is 20. Ops: []
I20260709 13:14:20.530987 29495 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:20.534132 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:20.535132 29376 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 18.
I20260709 13:14:20.543206  3547 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:14:20.543812  3547 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:20.544209  3547 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:14:20.539108  3575 raft_consensus.cc:2804] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:20.547998  3575 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:20.548548  3575 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:20.548020 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:20.553011 29528 raft_consensus.cc:1240] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:14:20.539067  3368 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:20.553642  3368 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:20.554507  3513 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:20.568435  3415 consensus_queue.cc:1059] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:14:20.569636  3415 raft_consensus.cc:3055] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:14:20.570132  3415 raft_consensus.cc:740] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:20.573742  3594 raft_consensus.cc:3055] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:14:20.531581  3587 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:20.575716  3587 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:20.571201  3415 consensus_queue.cc:260] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:20.574487  3594 raft_consensus.cc:740] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:20.514241  3566 raft_consensus.cc:3055] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:14:20.584451  3566 raft_consensus.cc:740] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:20.584805  3594 consensus_queue.cc:260] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 24.11, Last appended by leader: 11, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:20.586289  3594 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:14:20.585805  3566 consensus_queue.cc:260] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:20.469429  3590 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:20.573601  3595 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:20.560555  3611 consensus_queue.cc:237] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 11, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:20.609366 29525 raft_consensus.cc:1275] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:14:20.610452 29521 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 21.
W20260709 13:14:20.629580 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 93951us
I20260709 13:14:20.630465 29374 raft_consensus.cc:1275] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:14:20.631600 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:20.634769 29375 raft_consensus.cc:2410] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:14:20.607997 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:14:20.642411 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 215275us
I20260709 13:14:20.641527 29372 raft_consensus.cc:2410] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:14:20.604751  3457 consensus_queue.cc:1048] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:14:20.555316  3513 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:20.644340 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:20.606551  3415 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:20.656451 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:20.656930 29419 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:20.658624 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:20.631844  3566 raft_consensus.cc:3060] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:20.656734 29344 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:20.659582 29374 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 20.
I20260709 13:14:20.663654 29381 raft_consensus.cc:1240] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 20. Current term is 21. Ops: [20.12-20.12]
W20260709 13:14:20.665549 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:20.682320  3465 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:14:20.682060  3578 consensus_queue.cc:1048] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:20.683099  3465 raft_consensus.cc:697] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:20.684122  3465 consensus_queue.cc:237] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:20.687641 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:20.688477 29527 raft_consensus.cc:1275] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:14:20.689229  3617 consensus_queue.cc:1059] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:14:20.690264  3590 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:20.691047  3590 raft_consensus.cc:2749] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:20.649829  3595 raft_consensus.cc:3055] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:14:20.699245 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:20.699997 29372 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:20.650178  3517 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:20.642556  3588 consensus_queue.cc:1048] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:14:20.715755  3622 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:14:20.716424 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:20.675467 29279 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37594 (request call id 140) took 22852 ms (client timeout 15000 ms). Trace:
I20260709 13:14:20.696990  3595 raft_consensus.cc:740] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:20.735467  3517 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:20.738370 29374 raft_consensus.cc:1240] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 22. Current term is 23. Ops: []
I20260709 13:14:20.706442  3590 raft_consensus.cc:3055] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:14:20.782878  3513 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:20.789885 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:20.792863  3622 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:20.809912  3595 consensus_queue.cc:260] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:20.785329 29279 rpcz_store.cc:269] 0709 13:13:57.823394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:57.826858 (+  3464us) service_pool.cc:224] Handling call
0709 13:14:20.675327 (+22848469us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:18.504498 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:18.562733 (+ 58235us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:18.570503 (+  7770us) write_op.cc:435] Acquired schema lock
0709 13:14:18.604742 (+ 34239us) tablet.cc:662] Decoding operations
0709 13:14:18.625802 (+ 21060us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:18.625884 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:18.625914 (+    30us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:14:18.627193 (+  1279us) tablet.cc:701] Row locks acquired
0709 13:14:18.627239 (+    46us) write_op.cc:260] PREPARE: finished
0709 13:14:18.627444 (+   205us) write_op.cc:270] Start()
0709 13:14:18.629536 (+  2092us) write_op.cc:276] Timestamp: P: 1783602858627362 usec, L: 0
0709 13:14:18.629583 (+    47us) op_driver.cc:348] REPLICATION: starting
0709 13:14:18.630555 (+   972us) log.cc:844] Serialized 4455 byte log entry
0709 13:14:18.908418 (+277863us) op_driver.cc:464] REPLICATION: finished
0709 13:14:19.052056 (+143638us) write_op.cc:301] APPLY: starting
0709 13:14:19.052451 (+   395us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:19.143855 (+ 91404us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:19.143998 (+   143us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:19.362542 (+218544us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:19.444971 (+ 82429us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 13:14:19.460154 (+ 15183us) write_op.cc:312] APPLY: finished
0709 13:14:19.576209 (+116055us) log.cc:844] Serialized 105 byte log entry
0709 13:14:19.600546 (+ 24337us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:19.619002 (+ 18456us) write_op.cc:454] Released schema lock
0709 13:14:19.637081 (+ 18079us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:19.645015 (+  7934us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:19.645051 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9049,"reported_tablets":56,"child_traces":[["op",{"apply.queue_time_us":128419,"apply.run_cpu_time_us":24412,"apply.run_wall_time_us":601322,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50019,"num_ops":11,"prepare.queue_time_us":387397,"prepare.run_cpu_time_us":19994,"prepare.run_wall_time_us":209305,"raft.queue_time_us":168121,"raft.run_cpu_time_us":44778,"raft.run_wall_time_us":68357,"replication_time_us":278550,"thread_start_us":394327,"threads_started":4,"wal-append.queue_time_us":18229,"wal-append.run_cpu_time_us":16914,"wal-append.run_wall_time_us":2021947}]]}
I20260709 13:14:20.812192  3590 raft_consensus.cc:740] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:20.818202 29521 raft_consensus.cc:1240] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 19. Current term is 20. Ops: []
I20260709 13:14:20.829000 29529 raft_consensus.cc:1275] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 23 index: 10. Preceding OpId from leader: term: 25 index: 12. (index mismatch)
I20260709 13:14:20.845404 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:20.702996  3582 consensus_queue.cc:1048] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.118s
W20260709 13:14:20.853485 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 221720us
I20260709 13:14:20.853094  3444 raft_consensus.cc:3055] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:14:20.881215 29495 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:20.897830  3411 consensus_queue.cc:1059] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:14:20.899305  3411 consensus_queue.cc:1059] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:14:20.901490  3411 raft_consensus.cc:3055] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:14:20.903131  3411 raft_consensus.cc:740] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:20.906195 29381 raft_consensus.cc:1240] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:20.907140 29495 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:20.793286 29276 catalog_manager.cc:5697] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 15 to 18, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 18 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:20.908169 29495 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:20.909058 29495 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:20.918932 29372 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 20.
I20260709 13:14:20.921161  3580 consensus_queue.cc:1059] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:14:20.904798  3411 consensus_queue.cc:260] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:20.906888  3588 raft_consensus.cc:2804] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:20.928510 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:20.880466  3444 raft_consensus.cc:740] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
W20260709 13:14:20.930963 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 272281us
I20260709 13:14:20.926819 29276 catalog_manager.cc:5697] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 15 to 19, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 19 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:20.948089 29419 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:20.892508  3457 consensus_queue.cc:1059] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:14:20.954862 29419 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:20.964962 29276 catalog_manager.cc:5697] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:20.935997  3588 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:20.980805 29419 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:20.921216  3337 consensus_queue.cc:1048] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.038s
W20260709 13:14:20.986126 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 77180.9us
I20260709 13:14:20.981781 29276 catalog_manager.cc:5697] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 17 to 18, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 18 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:20.988931 29276 catalog_manager.cc:5697] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:20.972172  3618 raft_consensus.cc:2749] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:20.974936  3513 raft_consensus.cc:2749] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:20.995834 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:20.982182  3411 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:21.008726  3587 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:21.010119 29525 raft_consensus.cc:1240] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 21. Current term is 22. Ops: []
I20260709 13:14:21.011147  3587 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:21.026973  3561 raft_consensus.cc:3055] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:14:20.999670  3444 consensus_queue.cc:260] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:21.001343  3627 raft_consensus.cc:2804] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:14:21.003859  3517 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:21.004410 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:21.005090 29276 catalog_manager.cc:5697] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 18 to 21, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 21 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:21.012943  3547 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:21.013430 29381 raft_consensus.cc:1240] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 19. Current term is 20. Ops: []
I20260709 13:14:21.014065 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:21.037631 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:21.014756 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:21.015565 29378 raft_consensus.cc:1240] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 20. Current term is 21. Ops: []
I20260709 13:14:21.039268 29375 raft_consensus.cc:2393] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 19: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:21.017305 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:21.018280  3595 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:21.019220 29376 raft_consensus.cc:1240] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 19. Current term is 20. Ops: []
I20260709 13:14:20.999575  3368 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:20.988709  3588 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:20.990031  3625 raft_consensus.cc:3055] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:14:21.063681  3625 raft_consensus.cc:740] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:21.064744  3625 consensus_queue.cc:260] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:21.066074  3625 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:21.041541 29276 catalog_manager.cc:5697] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 20 to 22, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 22 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:21.069031 29524 raft_consensus.cc:1240] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 26 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 25. Current term is 26. Ops: []
I20260709 13:14:21.048452 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:21.053045 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:21.053654 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:14:21.069896 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 89183.2us
I20260709 13:14:21.055246 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:21.056216 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:21.070784 29419 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:20.958494  3590 consensus_queue.cc:260] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:21.057374 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:21.058272  3627 raft_consensus.cc:697] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 18 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:21.059715  3630 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:21.060380 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:21.057438  3628 raft_consensus.cc:2804] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:14:21.073062 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:21.073967 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:21.074918 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:20.997941  3626 raft_consensus.cc:2749] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:21.029577  3561 raft_consensus.cc:740] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:21.091023 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:21.040804  3506 raft_consensus.cc:2804] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:14:21.112336  3444 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:21.136981  3547 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 26 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:21.146919 29521 raft_consensus.cc:1240] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:21.147866 29527 raft_consensus.cc:1275] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:14:21.150043 29523 raft_consensus.cc:1240] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 19. Current term is 20. Ops: []
I20260709 13:14:21.158471  3588 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:21.093480 29276 catalog_manager.cc:5697] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:21.096588  3630 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:21.162312 29276 catalog_manager.cc:5697] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:21.163827  3630 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:21.097591 29378 raft_consensus.cc:2393] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 22: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:21.164083 29276 catalog_manager.cc:5697] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
W20260709 13:14:21.100826  3575 consensus_meta.cc:287] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.552s	user 0.009s	sys 0.006s
I20260709 13:14:21.165216  3575 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:21.166333 29528 raft_consensus.cc:1240] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:14:21.101636  3622 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:21.104817  3368 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:14:21.167626 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:21.108168  3624 log.cc:927] Time spent T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
W20260709 13:14:21.117874 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:21.169338  3627 consensus_queue.cc:237] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:21.179311  3575 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:21.161023  3560 consensus_queue.cc:1059] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 25.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:14:21.180151  3628 raft_consensus.cc:697] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:21.180869  3560 raft_consensus.cc:3055] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:14:21.181427  3560 raft_consensus.cc:740] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:21.181207  3628 consensus_queue.cc:237] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:21.098281 29372 raft_consensus.cc:1240] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 25 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 24. Current term is 25. Ops: []
I20260709 13:14:21.183962  3590 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:21.164359  3563 consensus_queue.cc:1059] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:14:21.185128  3563 raft_consensus.cc:3055] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:14:21.185577  3563 raft_consensus.cc:740] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:21.182576  3560 consensus_queue.cc:260] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:21.112327  3513 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:14:21.179540 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 78087.9us
I20260709 13:14:21.191560 29276 catalog_manager.cc:5697] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:21.201049 29419 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:21.186637  3563 consensus_queue.cc:260] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:21.212976 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:21.215672  3415 consensus_meta.cc:287] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.553s	user 0.016s	sys 0.000s
I20260709 13:14:21.208482 29276 catalog_manager.cc:5697] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 10 to 15, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 15 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:21.219344 29379 raft_consensus.cc:2410] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:14:21.221167  3337 consensus_queue.cc:1059] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:14:21.209872  3617 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:14:21.222289  3337 raft_consensus.cc:3055] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:21.222671  3337 raft_consensus.cc:740] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:21.224454  3582 consensus_queue.cc:1048] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:14:21.225258  3578 consensus_queue.cc:1059] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:21.196579  3506 raft_consensus.cc:697] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:21.227149  3506 consensus_queue.cc:237] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:21.228540  3587 raft_consensus.cc:3055] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:14:21.228951  3587 raft_consensus.cc:740] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:21.227210  3578 raft_consensus.cc:3055] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:14:21.236991 29419 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:14:21.240837 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 252151us
I20260709 13:14:21.248786 29276 catalog_manager.cc:5697] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 17 to 18, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 18 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:21.230378  3578 raft_consensus.cc:740] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:21.250723 29526 raft_consensus.cc:1275] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:14:21.254406 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:21.250737  3617 raft_consensus.cc:697] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 20 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:21.218227  3560 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:14:21.260699 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:21.268005 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:21.270740 29456 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:21.208014  3622 consensus_queue.cc:1059] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:14:21.229866  3587 consensus_queue.cc:260] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:21.274253 29276 catalog_manager.cc:5697] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 16 to 17, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 17 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:21.276703 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:21.251551  3563 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:14:21.283061 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:21.287320 29448 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:14:21.275982 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:21.297673 29421 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:21.261627  3626 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:14:21.295943 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:21.301229 29447 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:14:21.296500 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:21.310627 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:21.311442 29454 raft_consensus.cc:2468] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:14:21.250941  3517 consensus_queue.cc:1059] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
W20260709 13:14:21.314623 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:21.315337 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:21.317449 29449 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:21.319324 29448 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 22.
I20260709 13:14:21.320416 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:21.321003 29448 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:21.313063  3513 raft_consensus.cc:3055] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:14:21.329705  3513 raft_consensus.cc:740] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:21.331115  3513 consensus_queue.cc:260] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:21.335793 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 25 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:21.339983 29495 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:21.299902  3623 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:21.347169 29456 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 20.
I20260709 13:14:21.250818  3337 consensus_queue.cc:260] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:21.366298 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:21.367439 29495 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:21.368887 29495 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:21.370080 29448 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16.
I20260709 13:14:21.371269 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:21.372123 29456 raft_consensus.cc:2368] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 21. Current term is 22.
I20260709 13:14:21.257565  3561 consensus_queue.cc:260] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:21.378887 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:21.379587 29456 raft_consensus.cc:2376] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 20. Re-sending same reply.
I20260709 13:14:21.378207 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:21.380745 29448 raft_consensus.cc:2393] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 19: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:21.389582 29449 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:14:21.327708  3587 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:14:21.349625  3566 consensus_meta.cc:287] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.641s	user 0.014s	sys 0.003s
I20260709 13:14:21.401542 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:21.323767  3626 raft_consensus.cc:697] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 20 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:21.401686 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:21.410175 29447 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 26.
W20260709 13:14:21.398041 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 156960us
I20260709 13:14:21.337752  3513 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:14:21.418040 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:21.419185 29447 raft_consensus.cc:1240] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 21. Current term is 22. Ops: [21.11-21.11]
I20260709 13:14:21.351308  3618 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:14:21.374251  3411 raft_consensus.cc:2749] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:14:21.365914  3634 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:14:21.433136 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:21.427999 29276 catalog_manager.cc:5697] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 17 to 20, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 20 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:21.452034 29449 raft_consensus.cc:1275] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:14:21.450052 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:21.456848 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:21.457440 29276 catalog_manager.cc:5697] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 8 to 9, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132). New cstate: current_term: 9 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:21.458431 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:21.460894 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:21.452515 29449 pending_rounds.cc:85] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 9
I20260709 13:14:21.465085 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:21.453472 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:21.422143  3561 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:21.431484 29447 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531"
dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:45798
I20260709 13:14:21.469000 29447 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 26 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:21.469374 29447 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:14:21.470485 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:21.468088 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:21.423332  3618 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:21.483814 29276 catalog_manager.cc:5697] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:21.438887  3457 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:21.461817 29449 pending_rounds.cc:107] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:14:21.486754 29449 raft_consensus.cc:2889] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:21.431001  3635 raft_consensus.cc:2749] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:21.454612  3337 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:14:21.468214  3594 consensus_meta.cc:287] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.881s	user 0.006s	sys 0.015s
I20260709 13:14:21.365958  3623 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:21.504451 29276 catalog_manager.cc:5697] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 12 to 13, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 13 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:21.365567  3578 consensus_queue.cc:260] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:21.504068 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:21.501693 29447 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 27 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:21.495329  3638 log.cc:927] Time spent T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 13:14:21.486003  3588 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:21.487761  3618 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:14:21.551961 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 183135us
I20260709 13:14:21.556258 29495 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:21.558640 29495 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:21.562003 29447 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 27 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:21.416787  3617 consensus_queue.cc:237] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:21.575591 29276 catalog_manager.cc:5697] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 15 to 17, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 17 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:21.454828  3634 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:21.578893 29449 raft_consensus.cc:1240] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:14:21.592022 29276 catalog_manager.cc:5697] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 15 to 17, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 17 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:21.595852  3506 consensus_queue.cc:1059] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:21.600808  3588 raft_consensus.cc:3055] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:14:21.607673 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:14:21.585453 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 104283us
W20260709 13:14:21.427306  3567 consensus_queue.cc:1175] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "71aa3578fd924765ab9ac0729c8d1483" responder_term: 20 status { last_received { term: 19 index: 12 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 19. Current term is 20. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:14:21.621474 29276 catalog_manager.cc:5697] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 12 to 18. New cstate: current_term: 18 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:21.625674 29453 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 25.
I20260709 13:14:21.580871  3411 raft_consensus.cc:2749] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:21.664136 29276 catalog_manager.cc:5697] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 17 to 19, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 19 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:21.668324 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:21.673456 29453 raft_consensus.cc:1240] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 13. Current term is 14. Ops: []
W20260709 13:14:21.631233  3640 log.cc:927] Time spent T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
W20260709 13:14:21.680514 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:21.614073  3588 raft_consensus.cc:740] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:21.639315 29380 raft_consensus.cc:2468] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 20.
I20260709 13:14:21.586565  3578 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:21.693264 29380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 2202) took 1045 ms. Trace:
I20260709 13:14:21.693701 29380 rpcz_store.cc:276] 0709 13:14:20.647557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:20.647973 (+   416us) service_pool.cc:224] Handling call
0709 13:14:21.693044 (+1045071us) spinlock_profiling.cc:243] Waited 759 ms on lock 0x7b5400081454. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:14:21.693193 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1745230720}
I20260709 13:14:21.574676  3457 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:21.646799 29449 raft_consensus.cc:1240] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 27 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 25. Current term is 27. Ops: []
I20260709 13:14:21.696781 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:21.697144  3634 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:21.698182 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:21.698923 29449 raft_consensus.cc:2393] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 19: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:21.675001 29447 raft_consensus.cc:1240] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:14:21.703950 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:14:21.707067  3649 log.cc:927] Time spent T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:14:21.708458 29447 raft_consensus.cc:1240] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:14:21.711318 29450 raft_consensus.cc:1240] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:14:21.712738  3623 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:21.713641  3631 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:21.691463  3588 consensus_queue.cc:260] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:21.714344  3631 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:14:21.717504  3631 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:21.721314  3588 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:14:21.679633 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:21.612958 29448 raft_consensus.cc:2955] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:14:21.741223 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:21.742944 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:14:21.744163 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:21.746469 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:21.748448 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:21.749347 29449 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:14:21.747207 29447 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 19.
I20260709 13:14:21.752143 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:21.755170 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:21.607365 29495 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
W20260709 13:14:21.761405 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 463810us
W20260709 13:14:21.740536  3590 consensus_meta.cc:287] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.556s	user 0.008s	sys 0.005s
I20260709 13:14:21.778235 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:21.779150 29377 raft_consensus.cc:2393] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 14: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:21.774217 29447 raft_consensus.cc:1275] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:14:21.782811 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 175564us
I20260709 13:14:21.786433 29495 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:14:21.787335 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:21.782724 29276 catalog_manager.cc:5697] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 13 to 15, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 15 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:21.815894 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: true dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:14:21.842593 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 56412.9us
I20260709 13:14:21.844806 29495 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:21.846226 29276 catalog_manager.cc:5697] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 20 to 22, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 22 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:21.848245 29449 raft_consensus.cc:2468] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 14.
I20260709 13:14:21.853358  3636 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:21.854557  3655 consensus_queue.cc:1048] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.211s
I20260709 13:14:21.563885  3626 consensus_queue.cc:237] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:21.864015 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:21.876637  3625 consensus_meta.cc:287] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.810s	user 0.014s	sys 0.000s
W20260709 13:14:21.880136  3595 consensus_meta.cc:287] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.826s	user 0.010s	sys 0.002s
I20260709 13:14:21.884932 29451 raft_consensus.cc:2410] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
W20260709 13:14:21.887202  3563 consensus_meta.cc:287] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.584s	user 0.008s	sys 0.000s
I20260709 13:14:21.887673 29379 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 20.
I20260709 13:14:21.890372  3457 consensus_queue.cc:1048] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:14:21.849155  3415 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:14:21.900194 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:21.853677 29450 raft_consensus.cc:3055] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:14:21.937474 29450 raft_consensus.cc:740] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
W20260709 13:14:21.905228 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:21.915971 29528 raft_consensus.cc:1240] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 18 LEADER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:14:21.925444 29453 raft_consensus.cc:1275] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 13:14:21.940062 29453 pending_rounds.cc:85] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 10
I20260709 13:14:21.940356 29453 pending_rounds.cc:107] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 13:14:21.940586 29453 raft_consensus.cc:2889] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:21.941387 29527 raft_consensus.cc:1275] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 13:14:21.932701 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 87935.3us
I20260709 13:14:21.942703 29451 raft_consensus.cc:1275] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 24 index: 11. Preceding OpId from leader: term: 25 index: 12. (index mismatch)
W20260709 13:14:21.945227 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:21.947048 29454 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 21.
I20260709 13:14:21.947925 29276 catalog_manager.cc:5697] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 10 to 11, leader changed from ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 11 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:21.838704  3631 raft_consensus.cc:2804] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:21.966604 29346 leader_election.cc:400] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 21. Current term is 22.
W20260709 13:14:21.903391  3651 log.cc:927] Time spent T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
I20260709 13:14:21.975667 29529 raft_consensus.cc:1240] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:14:21.979710 29346 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:21.981837  3560 consensus_meta.cc:287] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.703s	user 0.007s	sys 0.006s
I20260709 13:14:21.977650  3660 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:21.983448  3622 raft_consensus.cc:3055] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:14:21.983929  3622 raft_consensus.cc:740] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:21.983481  3660 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:21.984911  3660 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:21.985055  3622 consensus_queue.cc:260] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:21.986455  3622 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:21.972762 29276 catalog_manager.cc:5697] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 15 to 17, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 17 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:21.993042 29276 catalog_manager.cc:5697] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 18 to 19, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 19 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:21.995260 29276 catalog_manager.cc:5697] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 16 to 18, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 18 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
W20260709 13:14:21.997831  3587 consensus_meta.cc:287] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.582s	user 0.010s	sys 0.000s
I20260709 13:14:21.997653 29276 catalog_manager.cc:5697] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 9 to 10, leader changed from ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 10 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:22.005757 29378 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 26.
W20260709 13:14:22.006935 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 218719us
I20260709 13:14:21.968291 29450 consensus_queue.cc:260] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:22.007858 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:22.008970 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:21.999122 29276 catalog_manager.cc:5697] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 12 to 18. New cstate: current_term: 18 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:22.011000 29372 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 22.
I20260709 13:14:22.016314 29376 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16.
I20260709 13:14:22.020802 29495 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:21.911692  3561 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:14:22.049535 30119 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.052s	sys 0.053s
W20260709 13:14:22.064143 30119 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.053s	sys 0.053s
I20260709 13:14:22.051817 29419 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:22.055734 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:22.070890 29451 raft_consensus.cc:1275] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:14:21.946909  2978 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:21.971917  3631 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
W20260709 13:14:22.064539 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 747760us
W20260709 13:14:22.087731 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:22.093146 29419 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:22.093293 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 113665us
I20260709 13:14:22.091889  3631 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:22.110244  3634 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:14:22.110412  3465 consensus_queue.cc:1048] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:22.110906  3634 raft_consensus.cc:697] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:22.112087  3634 consensus_queue.cc:237] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:22.117364  3660 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:22.072635  3601 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.008s	sys 0.015s
W20260709 13:14:22.109875 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 89162.9us
I20260709 13:14:22.048461  3578 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:21.969781  3415 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:22.121096 29346 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:22.129107 29346 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:22.132350 29421 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:22.133726 29419 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:22.096903  3617 raft_consensus.cc:2749] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:14:22.122430  3601 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.008s	sys 0.015s
I20260709 13:14:22.153687 29421 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:22.155095 29449 raft_consensus.cc:1275] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:14:22.048276  3411 consensus_queue.cc:1059] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.081s
I20260709 13:14:22.157420 29495 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:22.172915 29421 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:22.178028 29495 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:22.174578  3590 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:14:22.197252 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 63602.8us
I20260709 13:14:22.204524 29419 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:22.109534  3661 consensus_queue.cc:1059] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.094s
I20260709 13:14:22.143078  3563 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:22.198515 29421 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:22.074869  3561 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:22.092298  2978 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:22.204767  3623 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:22.158023  3560 raft_consensus.cc:2749] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:14:22.250746 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 52333.8us
I20260709 13:14:22.196296  3665 raft_consensus.cc:2749] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:22.252929 29421 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:22.253154 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 75262.1us
I20260709 13:14:22.200471  3513 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:14:22.256357 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 51931.3us
I20260709 13:14:22.200893  3517 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:22.259814 29419 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:22.204360  3587 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:14:22.273340 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 73161.6us
I20260709 13:14:22.248190  3617 raft_consensus.cc:2749] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:14:22.257473  3647 log.cc:927] Time spent T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:14:22.238730  3457 raft_consensus.cc:2804] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:14:22.258509  3649 log.cc:927] Time spent T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.060s	user 0.003s	sys 0.000s
I20260709 13:14:22.279668 29495 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:14:22.282411 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:22.256093  3626 raft_consensus.cc:2749] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:14:22.297034  3662 log.cc:927] Time spent T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 13:14:22.298317  3663 log.cc:927] Time spent T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:14:22.299976 29455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2357) took 1032 ms. Trace:
I20260709 13:14:22.300513 29455 rpcz_store.cc:276] 0709 13:14:21.267940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:21.268390 (+   450us) service_pool.cc:224] Handling call
0709 13:14:21.292187 (+ 23797us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:21.323269 (+ 31082us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:21.323303 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:21.374212 (+ 50909us) log.cc:844] Serialized 26 byte log entry
0709 13:14:21.931523 (+557311us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:14:21.931586 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:21.931681 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:22.299621 (+367940us) raft_consensus.cc:1685] finished
0709 13:14:22.299658 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:22.299887 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20188,"raft.queue_time_us":18033,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":9085,"thread_start_us":509447,"threads_started":2,"wal-append.queue_time_us":721240}
I20260709 13:14:22.303714  3636 raft_consensus.cc:2749] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:14:22.313910  2978 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:22.337155  3561 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:22.278961  3635 consensus_queue.cc:1059] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:14:22.339000  3636 raft_consensus.cc:3055] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:14:22.339427  3636 raft_consensus.cc:740] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:22.339843  3415 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:22.340476  3636 consensus_queue.cc:260] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:22.276930  3566 consensus_queue.cc:1059] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
I20260709 13:14:22.341894  3636 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:22.342012  3566 consensus_queue.cc:1243] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer 71aa3578fd924765ab9ac0729c8d1483 log is divergent from this leader: its last log entry 18.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:14:22.342597  3566 raft_consensus.cc:3055] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:14:22.342932  3566 raft_consensus.cc:740] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:14:22.344056 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 69010.7us
I20260709 13:14:22.275102  3595 raft_consensus.cc:2749] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:14:22.272468  3411 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:22.352644  3337 consensus_meta.cc:287] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.844s	user 0.012s	sys 0.000s
I20260709 13:14:22.354161  3644 consensus_queue.cc:1048] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.150s
I20260709 13:14:22.291252  3661 raft_consensus.cc:2749] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:22.284688  3457 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
W20260709 13:14:22.394716 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 141869us
W20260709 13:14:22.410925 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 144494us
W20260709 13:14:22.535115 29452 consensus_meta.cc:287] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.686s	user 0.010s	sys 0.003s
I20260709 13:14:22.535058 29421 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:22.397827 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 138087us
I20260709 13:14:22.537353 29419 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:22.399924 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:22.419776  3680 raft_consensus.cc:493] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:22.445022  3660 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:22.549980  3680 raft_consensus.cc:515] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:22.419929 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:22.420835 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:22.464736 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:22.505630 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:22.403113  3337 consensus_queue.cc:1059] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:14:22.369076  3411 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:22.439164  3618 consensus_meta.cc:287] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.857s	user 0.009s	sys 0.002s
I20260709 13:14:22.423077 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:22.567638  3618 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:22.568646 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:22.442256  3631 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:22.570295 29529 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 18.
I20260709 13:14:22.571772  3631 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:22.478646 30157 raft_consensus.cc:1275] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 19 LEARNER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:14:22.410209  3677 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:22.573882  3677 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:22.407534  3547 raft_consensus.cc:3055] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:14:22.577772  3547 raft_consensus.cc:740] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:22.579002  3547 consensus_queue.cc:260] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:22.366647  3566 consensus_queue.cc:260] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:22.368937  3587 consensus_queue.cc:1048] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.095s
I20260709 13:14:22.469604  3578 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:22.417100 29456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45798 (request call id 3549) took 1118 ms. Trace:
I20260709 13:14:22.395653  3457 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:22.491777 29375 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:14:22.581411 29456 rpcz_store.cc:276] 0709 13:14:21.298375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:21.401427 (+103052us) service_pool.cc:224] Handling call
0709 13:14:22.416812 (+1015385us) spinlock_profiling.cc:243] Waited 844 ms on lock 0x7b5400371ed4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:14:22.417016 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1940268416}
I20260709 13:14:22.582827  3566 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:22.535882 29346 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:22.582206 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 286948us
W20260709 13:14:22.584231 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 48447.4us
I20260709 13:14:22.429831 29450 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:22.539796  3560 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:22.539551  3567 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:22.541729  3590 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:22.542565  3626 raft_consensus.cc:2749] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:22.587088  3415 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:22.543666 29419 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:22.588624 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 45053.5us
I20260709 13:14:22.589452 29419 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:22.592288  3567 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:22.596480  3560 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:22.598861  3560 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:22.600081  3626 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:22.600543  3664 raft_consensus.cc:3055] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:14:22.600725  3626 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:22.601039  3664 raft_consensus.cc:740] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:22.602599 29375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 2206) took 1146 ms. Trace:
I20260709 13:14:22.602062  3664 consensus_queue.cc:260] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:22.604027  3664 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:22.569829  3618 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:22.586767  3634 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:22.610059  3634 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:22.612707  3634 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:22.598768  3457 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:22.581723  3547 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:22.615800  3457 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:22.602977 29375 rpcz_store.cc:276] 0709 13:14:21.455872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:21.456557 (+   685us) service_pool.cc:224] Handling call
0709 13:14:22.602385 (+1145828us) spinlock_profiling.cc:243] Waited 935 ms on lock 0x7b54003f3254. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:14:22.602507 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2150984448}
I20260709 13:14:22.545516 29421 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:22.535642 29452 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 23.
W20260709 13:14:22.548137  3622 consensus_meta.cc:287] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.561s	user 0.015s	sys 0.002s
I20260709 13:14:22.554069  3680 leader_election.cc:290] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:22.556016  3643 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:22.561465 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:22.561771 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:22.630148 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 44150.1us
I20260709 13:14:22.569720  3411 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:22.585274 29495 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:22.595427  3567 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:22.626636  3643 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:22.635932  3411 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:14:22.634837 29346 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:22.637972  3643 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:22.634799 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 49606.6us
I20260709 13:14:22.577147  3677 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:22.638314  3680 raft_consensus.cc:2749] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:22.638541 29346 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:22.640774 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 95359.1us
I20260709 13:14:22.641746 29421 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:22.642227 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:22.642475 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:22.643285 29447 raft_consensus.cc:1275] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:14:22.643846 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: true dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:22.644048 29527 raft_consensus.cc:1240] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:22.644471 29525 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:14:22.648872 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:22.651445 29521 raft_consensus.cc:1240] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 19. Current term is 20. Ops: []
I20260709 13:14:22.649576 29526 raft_consensus.cc:2468] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
I20260709 13:14:22.650468 29344 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:22.653254 29452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45798 (request call id 3541) took 1348 ms. Trace:
I20260709 13:14:22.653388 29529 raft_consensus.cc:1240] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:22.654335 29421 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:22.654480 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:22.655213 29530 raft_consensus.cc:1275] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:14:22.645124 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:22.655606 29421 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:22.653630 29452 rpcz_store.cc:276] 0709 13:14:21.295891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:21.296007 (+   116us) service_pool.cc:224] Handling call
0709 13:14:22.642830 (+1346823us) spinlock_profiling.cc:243] Waited 486 ms on lock 0x7b54000195d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:14:22.643936 (+  1106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1118099712}
I20260709 13:14:22.658672 29452 raft_consensus.cc:1240] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 13. Current term is 14. Ops: []
I20260709 13:14:22.659086 29346 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:22.658529 29421 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:22.656893  3677 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:22.660691 29522 raft_consensus.cc:1240] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:14:22.661198  3679 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:14:22.661991  3626 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:22.664938 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:22.669090 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:22.670506 29452 raft_consensus.cc:1240] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 20. Current term is 21. Ops: []
I20260709 13:14:22.671944  3415 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:14:22.677644  3457 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:22.673823 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:22.679335 29495 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:22.679335 29346 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:22.683706  3587 raft_consensus.cc:2804] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:22.681963 29495 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:22.685310 29451 raft_consensus.cc:1275] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:14:22.685676 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:22.684171  3587 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:22.684309  3680 consensus_queue.cc:1048] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:14:22.689838  3631 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:14:22.690492  3631 raft_consensus.cc:697] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 22 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:22.656914  3563 raft_consensus.cc:2764] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:14:22.691535  3631 consensus_queue.cc:237] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:22.692466  3465 raft_consensus.cc:2749] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:14:22.681457  3411 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:22.693332  3411 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:22.693815 29346 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:22.694846  3465 raft_consensus.cc:2804] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:22.653077  3618 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 27 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:14:22.680543  3566 raft_consensus.cc:2804] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:22.695339  3465 raft_consensus.cc:697] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:22.684993 29495 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:22.695914  3566 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:22.696405  3566 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:22.696915  3634 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:14:22.696501  3465 consensus_queue.cc:237] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:22.697474  3634 raft_consensus.cc:697] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:22.698530  3634 consensus_queue.cc:237] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:22.687402  3587 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:22.702625  3611 consensus_queue.cc:1048] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:22.689253 29344 leader_election.cc:304] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:22.706717  3567 raft_consensus.cc:2749] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:22.707952 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:22.709761 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:22.696569 29495 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:22.710873 29528 raft_consensus.cc:2393] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 19: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:22.711889 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:22.714401  3682 raft_consensus.cc:2804] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:14:22.720125  3682 raft_consensus.cc:697] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 16 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:22.720201  3415 consensus_queue.cc:1048] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:14:22.714610 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:22.721118 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:22.721263  3682 consensus_queue.cc:237] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:22.723184 29456 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 18.
I20260709 13:14:22.715006 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:22.717614  3611 consensus_queue.cc:1048] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:14:22.718343  3587 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:22.719058 29450 raft_consensus.cc:1275] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:14:22.678452  3457 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:22.724359 29455 raft_consensus.cc:1275] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:14:22.714093 29495 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:22.742369 29346 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:22.725993 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:14:22.745082 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 86635.7us
I20260709 13:14:22.746032 29421 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:22.747823 29421 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:22.742797 29495 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:22.691228  3680 consensus_queue.cc:1048] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:14:22.755435 29421 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:22.762751 29525 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 27.
I20260709 13:14:22.730993  3411 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:22.751942  3590 raft_consensus.cc:2749] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:22.756729  3635 raft_consensus.cc:2804] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:14:22.751672  3618 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:22.753089  3622 raft_consensus.cc:2749] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:22.756268  3626 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:22.775388 29421 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:22.756351  3578 raft_consensus.cc:2749] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:22.783934 29421 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:22.793269 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:22.794592 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:22.795660 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:22.795909 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:22.796281 29449 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 21.
I20260709 13:14:22.794045 29447 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 18.
I20260709 13:14:22.779333  3679 raft_consensus.cc:2749] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:22.803335 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:22.804360 29455 raft_consensus.cc:2393] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 18: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:22.800966 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:22.777328  3660 raft_consensus.cc:2764] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 27 FOLLOWER]: Leader election decision vote started in defunct term 26: won
I20260709 13:14:22.778918  3677 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:22.779518  2978 consensus_queue.cc:1048] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:14:22.803364  3590 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:22.783113  3411 consensus_queue.cc:1059] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:14:22.784864  3595 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:22.792776  3618 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:22.825335  3677 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:22.826895  3618 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:22.827764  3677 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:22.828035  3661 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:22.828277  3654 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:22.828665  3661 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:22.828884  3654 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:22.830963  3661 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:22.832717  3588 raft_consensus.cc:3055] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:14:22.833148  3588 raft_consensus.cc:740] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:22.764032  3683 consensus_queue.cc:1048] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 13:14:22.835161 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:22.831295  3654 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:22.856998 29523 raft_consensus.cc:1240] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:22.812595  3337 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:22.880510 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:22.893496 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:22.893543 29378 raft_consensus.cc:1275] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:14:22.898631 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:22.900002 29376 raft_consensus.cc:1275] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
I20260709 13:14:22.900614 29376 pending_rounds.cc:85] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5: Aborting all ops after (but not including) 8
I20260709 13:14:22.900942 29376 pending_rounds.cc:107] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 13:14:22.901232 29376 raft_consensus.cc:2889] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:22.904119 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:22.904773 29372 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:22.909789 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:22.849932  3578 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:22.913442 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:22.858124  3415 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
W20260709 13:14:22.912957 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 137076us
I20260709 13:14:22.913867 29375 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 18.
I20260709 13:14:22.929700 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:22.914772 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:22.968029 29380 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
I20260709 13:14:22.870645  3664 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:22.978803 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:22.978989 29495 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:22.995163 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:22.999336  3628 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:22.999873  3636 raft_consensus.cc:2804] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:23.000068  3628 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:22.980741  3664 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:22.994381  3634 consensus_queue.cc:1048] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:14:23.002303 29375 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:23.002547  3628 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:23.000517  3636 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:23.003718  3636 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:23.007663  3682 consensus_queue.cc:1048] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:14:23.011989 29375 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
I20260709 13:14:23.014331  3590 raft_consensus.cc:2749] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:14:23.008381  3693 log.cc:927] Time spent T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:14:23.014223  3636 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:23.024179  3636 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:22.945338  3587 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:23.031946 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:23.044188 29447 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
W20260709 13:14:23.048031 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 75702.3us
I20260709 13:14:23.051064 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:22.974347  3457 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:23.053987 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:23.054744 29454 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
I20260709 13:14:23.055147 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:23.056464 29447 raft_consensus.cc:1275] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:14:23.033720 29372 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
I20260709 13:14:23.058315 29346 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:23.066653 29372 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:14:22.875290  3337 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:23.067592 29372 raft_consensus.cc:606] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 LEADER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:23.083523 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:23.084551 29456 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:22.975343  3415 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:23.070603 29346 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:22.973678  3578 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:22.931068  3588 consensus_queue.cc:260] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:22.998847  3635 raft_consensus.cc:697] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:23.038746  3695 consensus_queue.cc:1048] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:14:23.071794  3567 raft_consensus.cc:2749] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:23.116434 29377 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:23.109534  3683 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:14:23.115702  3588 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:14:23.148056  3691 log.cc:927] Time spent T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.272s	user 0.001s	sys 0.001s
I20260709 13:14:23.148047  3683 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:23.187412 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 135007us
I20260709 13:14:23.176996 29456 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
W20260709 13:14:23.199949  3697 log.cc:927] Time spent T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 13:14:23.205176 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 134664us
I20260709 13:14:23.207021 29346 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:23.209985  3703 log.cc:927] Time spent T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:14:23.210223  3611 raft_consensus.cc:2804] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:23.210888  3611 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:23.211422  3611 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:23.218588  3587 consensus_queue.cc:1048] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:23.220978 29495 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:23.222496 29346 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:23.224673  3587 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:23.226480  3415 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:23.196007  3683 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:23.237161 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:23.237809 29377 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 20.
I20260709 13:14:23.181586  3566 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:23.242425 29346 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:23.241993 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:23.224987  3611 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:23.250320  3415 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:23.253829 29529 raft_consensus.cc:1275] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:14:23.273923 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:23.221333  3664 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:23.277081 29530 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 20.
I20260709 13:14:23.294708 29495 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:14:23.321657 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 124774us
I20260709 13:14:23.238806  3587 consensus_queue.cc:1048] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
W20260709 13:14:23.328030 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 50287.6us
I20260709 13:14:23.324553 29381 raft_consensus.cc:2468] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 18.
I20260709 13:14:23.279970  3643 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:23.325078 29495 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:23.230223  3635 consensus_queue.cc:237] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:23.335455  3634 raft_consensus.cc:2804] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:23.359751 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:23.373147 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:23.374346 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:23.374948 29375 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
I20260709 13:14:23.360441 29373 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:23.361135 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:23.364153 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:23.376767 29421 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:23.337136  3628 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:23.371232 29379 raft_consensus.cc:1275] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:14:23.334965  3578 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:23.377135 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:23.377529 29372 raft_consensus.cc:2410] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 21 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:14:23.369815  3611 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:23.378577 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:23.336917  3337 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:23.382562  3677 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:14:23.392464 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:23.393963 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:23.394845 29378 raft_consensus.cc:2393] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 20: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:23.396001 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:23.396602 29373 raft_consensus.cc:1275] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:14:23.372267  3634 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:23.398514 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:14:23.399720 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 65981.8us
I20260709 13:14:23.381433  3628 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:23.344694  3631 consensus_queue.cc:1048] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 13:14:23.408972 29495 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:23.409214 29373 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 20.
I20260709 13:14:23.410241 29378 raft_consensus.cc:1240] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:23.414950 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:23.417659 29379 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
I20260709 13:14:23.409070  3634 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:23.414299  3628 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:14:23.432123 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 58007.4us
I20260709 13:14:23.426170  3588 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:23.426667  3636 raft_consensus.cc:2804] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:14:23.439713 29379 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:14:23.440310 29379 raft_consensus.cc:606] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:23.440613 29379 raft_consensus.cc:614] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:23.408630  3677 consensus_queue.cc:1048] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:14:23.408382  3618 consensus_queue.cc:1048] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:14:23.442411 29495 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:23.444409 29456 raft_consensus.cc:1275] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:14:23.444536  3698 raft_consensus.cc:2804] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:14:23.445384  3698 raft_consensus.cc:697] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:23.446314 29451 raft_consensus.cc:1275] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:14:23.446417  3698 consensus_queue.cc:237] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:23.448192  3705 log.cc:927] Time spent T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.169s	user 0.001s	sys 0.001s
I20260709 13:14:23.451678  3636 raft_consensus.cc:697] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 19 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:23.451864 29495 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:23.452764  3636 consensus_queue.cc:237] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:23.455994  3700 log.cc:927] Time spent T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.133s	user 0.001s	sys 0.001s
I20260709 13:14:23.456238  3547 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:14:23.456712  3547 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:23.457068  3547 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:14:23.459896  3709 log.cc:927] Time spent T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:14:23.465934 29419 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:23.474426 29495 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:23.478087 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:23.482563 29379 raft_consensus.cc:2376] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 26 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 26. Re-sending same reply.
I20260709 13:14:23.490537 29419 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:23.494647 29379 raft_consensus.cc:1275] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:14:23.496268 29495 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
W20260709 13:14:23.499612 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:23.512112  3635 raft_consensus.cc:2749] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:23.512217  3631 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:14:23.488427  3618 raft_consensus.cc:2764] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:14:23.514381 29379 raft_consensus.cc:1275] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:14:23.518541 29495 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:23.442631  3588 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:23.482161  3677 consensus_queue.cc:1059] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:14:23.504076  3728 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:14:23.491789  3679 consensus_queue.cc:1059] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:14:23.550423  3567 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:23.560700  3566 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:23.578449  3636 raft_consensus.cc:2804] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:14:23.606788  3636 raft_consensus.cc:697] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:23.607921  3636 consensus_queue.cc:237] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:23.612816  3588 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:14:23.615782  3719 log.cc:927] Time spent T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.287s	user 0.004s	sys 0.000s
W20260709 13:14:23.604951 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 112779us
I20260709 13:14:23.627053 29373 raft_consensus.cc:1240] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 18. Current term is 19. Ops: [18.9-18.9]
I20260709 13:14:23.593248  3622 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:23.606791  3679 raft_consensus.cc:3055] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:14:23.633414  3729 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:23.633762  3679 raft_consensus.cc:740] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:23.634076  3729 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:23.593453  3618 consensus_queue.cc:1048] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:14:23.637245 29376 raft_consensus.cc:1240] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 19. Current term is 20. Ops: []
I20260709 13:14:23.615365  3578 consensus_queue.cc:1059] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:14:23.639484 29372 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "71aa3578fd924765ab9ac0729c8d1483"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:14:23.650410 29372 raft_consensus.cc:606] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Received request to transfer leadership to TS 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:23.650799 29372 raft_consensus.cc:614] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:23.649549 29419 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:23.653410 29419 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:23.634842  3679 consensus_queue.cc:260] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:23.591286  3567 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:23.633265  3622 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:23.663008  3722 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:23.674641 29372 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "71aa3578fd924765ab9ac0729c8d1483"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:14:23.675626 29372 raft_consensus.cc:606] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Received request to transfer leadership to TS 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:23.676056 29372 raft_consensus.cc:614] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:23.684186  3729 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:23.685099  3729 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:23.686209  3729 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:14:23.686739  3729 raft_consensus.cc:697] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 27 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:23.687794  3729 consensus_queue.cc:237] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:23.683147  3618 consensus_queue.cc:1059] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 13:14:23.692800  3618 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:23.693701  3618 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:23.697624  3547 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:23.700232 29372 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "71aa3578fd924765ab9ac0729c8d1483"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:14:23.700973 29372 raft_consensus.cc:606] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 LEADER]: Received request to transfer leadership to TS 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:23.701403 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 182961us
I20260709 13:14:23.703042 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:23.702962 29495 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:23.712940 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:23.713622 29495 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:23.678973  3679 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:23.719440 29530 raft_consensus.cc:2393] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 20: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:23.678371  3722 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:23.724820 28234 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:14:23.728057 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:23.721076  3733 raft_consensus.cc:2749] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:14:23.730783 28234 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:23.731715 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:23.715281  3582 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:23.700879  3631 raft_consensus.cc:697] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:23.738561 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:14:23.755509 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 102199us
I20260709 13:14:23.756594 29419 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:23.766052 29419 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:23.769438 29528 raft_consensus.cc:1275] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:14:23.734498  3683 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:23.734331  3660 consensus_queue.cc:1048] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:14:23.743273  3582 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:23.785090  3547 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:23.786263  3567 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:23.787381  3622 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:23.788054  3622 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:23.755014  3628 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:23.790603  3634 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:23.792369  3628 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:23.793031  3634 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:23.794607 29379 raft_consensus.cc:1240] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 22. Current term is 23. Ops: []
I20260709 13:14:23.771549 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:23.776101  3730 raft_consensus.cc:3055] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:14:23.797947 29372 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 19.
I20260709 13:14:23.737001  3457 consensus_queue.cc:1048] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:14:23.765453  3618 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:23.808802 29419 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:23.809163 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:14:23.809451 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 77236us
I20260709 13:14:23.812988 29495 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:23.803833  3730 raft_consensus.cc:740] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:23.829981 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:23.834744 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:23.822261  3634 raft_consensus.cc:2804] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:14:23.835701 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:23.811067  3618 consensus_queue.cc:1048] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:14:23.843075  3735 raft_consensus.cc:2804] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:14:23.840845  3738 log.cc:927] Time spent T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:14:23.850455 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:23.835482  3722 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:23.857312 29530 raft_consensus.cc:2393] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 27: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:23.814435  3733 consensus_queue.cc:1059] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:14:23.869107 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:23.863409 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:23.880599 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:23.846582  3732 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:14:23.855875  3735 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:23.881579 29454 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:23.880679 29448 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:23.883417  3560 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:23.870461  3634 raft_consensus.cc:697] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 20 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:23.911518  3634 consensus_queue.cc:237] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:23.890592  3729 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:23.920955  3720 raft_consensus.cc:993] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5: : Instructing follower 183db85c071f489fbc8de63a9edd8a3a to start an election
I20260709 13:14:23.891078  3622 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:23.907989  3560 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:23.886735  3737 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:23.920436  3729 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:23.900691  3739 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:23.829360  3631 consensus_queue.cc:237] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:23.926254 29454 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 20.
I20260709 13:14:23.884752  3732 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:23.930884  3720 raft_consensus.cc:1081] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 LEADER]: Signalling peer 183db85c071f489fbc8de63a9edd8a3a to start an election
I20260709 13:14:23.939266 29448 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 20.
I20260709 13:14:23.949368  3660 consensus_queue.cc:1048] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:23.950471  3729 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:23.951562  3732 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:23.954277  3683 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:23.892333  3735 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:23.955374  3728 raft_consensus.cc:3055] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:14:23.956379  3728 raft_consensus.cc:740] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:23.956229  3567 consensus_queue.cc:1048] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:23.960359 29495 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:23.951077  3729 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:23.965896  3729 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:23.938980  3415 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:23.966742  3560 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:23.966894  3415 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:23.968253  3729 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:23.969280  3415 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:23.964731 29495 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:23.979827 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:23.983475 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:23.985277 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:23.986565 29529 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 19.
I20260709 13:14:23.951042  3660 consensus_queue.cc:1048] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:14:23.991183 29452 raft_consensus.cc:1275] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:14:23.932500  3661 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:23.985087 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:23.864692  3730 consensus_queue.cc:260] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:23.996253  3415 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:23.988744  3682 raft_consensus.cc:2804] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:14:24.003706  3415 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:24.004081  3682 raft_consensus.cc:697] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:24.005405  3682 consensus_queue.cc:237] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:24.009404  3415 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:24.026219  3730 raft_consensus.cc:3060] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:24.003101  3741 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.032255  3741 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:23.939316  3737 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:24.018939 29454 raft_consensus.cc:1275] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:14:23.932830  3622 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:24.020691  3661 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:23.996922  3722 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:14:24.037940 29455 raft_consensus.cc:3060] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:24.046434 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:24.051888 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:24.053057  3729 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:24.049787 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:24.060766 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:24.062161 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:24.063139 29452 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 19.
I20260709 13:14:24.063863  3741 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:24.064287  3590 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:24.065099  3661 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:14:24.054632  3742 log.cc:927] Time spent T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:14:24.064812  3590 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:24.075883 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:24.078912 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:24.083766 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:24.085055 29452 raft_consensus.cc:2368] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 18. Current term is 19.
I20260709 13:14:24.086431 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:24.087993 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:24.057047  3636 consensus_queue.cc:1048] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:14:24.093914 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:24.096606 29452 raft_consensus.cc:1275] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:14:24.096549 29419 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:14:24.126266 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:24.068421  3722 raft_consensus.cc:697] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
W20260709 13:14:24.135303 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 74927.1us
I20260709 13:14:24.133932 29455 raft_consensus.cc:1275] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:14:24.059799  3729 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:24.143465 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
W20260709 13:14:24.138957  3721 log.cc:927] Time spent T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 13:14:24.229307 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 88428.2us
W20260709 13:14:24.287067 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 56544.3us
I20260709 13:14:24.300155 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:24.301829 29452 raft_consensus.cc:2410] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 21 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:14:24.302572 29456 raft_consensus.cc:1275] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:14:24.320286  3746 log.cc:927] Time spent T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:14:24.289796  3636 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:24.312559  3733 consensus_queue.cc:1048] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
W20260709 13:14:24.323400  3753 log.cc:927] Time spent T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
W20260709 13:14:24.366566 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:24.374178  3590 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:24.378443 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:24.386219 29526 raft_consensus.cc:1240] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:14:24.379196 29528 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 20.
I20260709 13:14:24.391808 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:24.394905 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:24.396312 29381 raft_consensus.cc:2410] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:14:24.398768 29372 raft_consensus.cc:1240] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:24.392933 29378 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 20.
I20260709 13:14:24.409312 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:24.356704  3750 log.cc:927] Time spent T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:14:24.413326  2978 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:24.232151  3722 consensus_queue.cc:237] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:24.417099  2978 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:24.375916  3729 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:24.338464  3622 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:24.355902  3660 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.426066  3337 raft_consensus.cc:3055] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:24.426383 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:24.426579  3635 consensus_queue.cc:1059] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:14:24.405716  3643 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:24.428056  2978 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:24.430040 29346 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:24.430454 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:24.437120 29378 raft_consensus.cc:2410] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for term 23 because replica has last-logged OpId of term: 21 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 13:14:24.430049 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:24.439051  2978 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:24.340653  3636 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:24.300485  3587 consensus_queue.cc:1048] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.138s
I20260709 13:14:24.442373  3643 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:24.418689  3411 consensus_queue.cc:1048] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:14:24.338049  3728 consensus_queue.cc:260] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:24.458376 29376 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52172 (request call id 2699) took 1096 ms. Trace:
I20260709 13:14:24.431774  3337 raft_consensus.cc:740] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:24.436726  3737 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:24.460422 29376 rpcz_store.cc:276] 0709 13:14:23.362104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:23.461948 (+ 99844us) service_pool.cc:224] Handling call
0709 13:14:23.637042 (+175094us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:23.637711 (+   669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:24.457977 (+820266us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b540039f3d0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd858ad 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:14:24.458137 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":401580928}
I20260709 13:14:24.434219  3660 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:24.476699  3578 raft_consensus.cc:993] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5: : Instructing follower 71aa3578fd924765ab9ac0729c8d1483 to start an election
I20260709 13:14:24.477536  3578 raft_consensus.cc:1081] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 LEADER]: Signalling peer 71aa3578fd924765ab9ac0729c8d1483 to start an election
I20260709 13:14:24.497438  3751 raft_consensus.cc:3055] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:14:24.498019  3751 raft_consensus.cc:740] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:24.504089  3337 consensus_queue.cc:260] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:24.505838  3337 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:14:24.511098  3716 log.cc:927] Time spent T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 1.150s	user 0.005s	sys 0.009s
I20260709 13:14:24.514325 29453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2391) took 1460 ms. Trace:
I20260709 13:14:24.514760 29453 rpcz_store.cc:276] 0709 13:14:23.053668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:23.056172 (+  2504us) service_pool.cc:224] Handling call
0709 13:14:23.056480 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:23.070600 (+ 14120us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:14:23.151865 (+ 81265us) log.cc:844] Serialized 14 byte log entry
0709 13:14:23.196327 (+ 44462us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:23.207677 (+ 11350us) log.cc:844] Serialized 26 byte log entry
0709 13:14:23.207869 (+   192us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:14:23.207907 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:23.207993 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:23.903085 (+695092us) spinlock_profiling.cc:243] Waited 5.36 ms on lock 0x7b480012e7d8. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a80cafaa1 00007f6a80ca6b37 00007f6a80ca69ca 00007f6a80d9e26f 00007f6a80d9df37 00007f6a80db255c 00007f6a80db2508 00007f6a80db2488 00007f6a80db2443 00007f6a80db16ec 00007f6a7fcdba96
0709 13:14:24.447300 (+544215us) spinlock_profiling.cc:243] Waited 3.86 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:14:24.514042 (+ 66742us) raft_consensus.cc:1685] finished
0709 13:14:24.514077 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:24.514227 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75463,"prepare.queue_time_us":126075,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":1564,"raft.run_cpu_time_us":4645,"raft.run_wall_time_us":838909,"spinlock_wait_cycles":21221504,"thread_start_us":88622,"threads_started":2,"wal-append.queue_time_us":171463}
W20260709 13:14:24.519579 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 423096us
I20260709 13:14:24.522470  3636 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:24.524716  3590 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:24.525187  3590 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:24.525545  3590 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:24.525684  3739 consensus_queue.cc:1059] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:14:24.526783  3661 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:24.527287  3661 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:24.528294 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:24.528612  3745 raft_consensus.cc:3055] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:14:24.529050  3745 raft_consensus.cc:740] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:24.529563  3661 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:24.529923  3745 consensus_queue.cc:260] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:24.531090  3729 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.531632  3729 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:24.533001  3618 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:24.533799  3618 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:24.534124  3729 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:24.535828  3728 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:24.521275  3679 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:24.536038  3618 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:24.348058  3567 raft_consensus.cc:2955] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 LEADER]: Committing config change with OpId 19.13: config changed from index 11 to 13, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
W20260709 13:14:24.547575 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:24.549187  3683 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:24.576471  3732 consensus_meta.cc:287] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.624s	user 0.014s	sys 0.000s
I20260709 13:14:24.577131  3732 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:24.585450 29530 raft_consensus.cc:1240] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:14:24.586551  3590 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:24.591446  3547 raft_consensus.cc:3055] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:14:24.592267  3547 raft_consensus.cc:740] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:24.593777  3547 consensus_queue.cc:260] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:24.595055  3547 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:24.561780  3660 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:24.624956  3660 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.625782  3660 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:24.626400  3631 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.504204  3582 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:24.627231  3631 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:24.576189  3683 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:24.561813  3679 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:24.610363 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 73301us
I20260709 13:14:24.612725  3590 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:24.541201  3643 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:24.635135  3683 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:24.637641  3679 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:24.642159 29521 raft_consensus.cc:2955] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 11 to 13, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:24.455644  3735 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:24.654579  3735 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:24.648039 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:24.499038  3751 consensus_queue.cc:260] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:24.658778  3751 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:24.636580  3660 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:24.661963 29530 raft_consensus.cc:1240] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 14. Current term is 15. Ops: []
W20260709 13:14:24.666343  3730 consensus_meta.cc:287] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.639s	user 0.010s	sys 0.002s
I20260709 13:14:24.671398 30155 raft_consensus.cc:2955] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 11 to 13, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:24.635217  3631 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:24.696420  3732 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:24.717269 29451 raft_consensus.cc:2468] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 20.
I20260709 13:14:24.721254 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:24.722136 29524 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 21.
I20260709 13:14:24.726533 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:24.754508 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:24.764107 29522 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9"
dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
 from {username='slave'} at 127.0.0.1:37968
I20260709 13:14:24.764902 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:24.765394 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 324815us
I20260709 13:14:24.768772 29522 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:24.798126 29522 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:14:24.764814 29454 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.023s	sys 0.033s
W20260709 13:14:24.819831 29454 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.023s	sys 0.034s
I20260709 13:14:24.786162  3643 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.821489  3643 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:24.835206 29346 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:24.854207 29525 raft_consensus.cc:1240] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 20 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 19. Current term is 20. Ops: []
I20260709 13:14:24.855711 29346 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:24.859762 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 336256us
I20260709 13:14:24.860822 29419 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:24.842697 29522 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:24.865043 29346 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:24.866711 29419 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:24.872687 29344 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:24.854571  3465 raft_consensus.cc:2764] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:14:24.900578 29448 raft_consensus.cc:1275] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:14:24.866168  3728 raft_consensus.cc:2804] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:14:24.914038 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:24.914631 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:24.904595 29522 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:14:24.917802 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 51968.3us
I20260709 13:14:24.918965 29419 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:24.866449  3560 raft_consensus.cc:2749] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:24.868597  3590 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:24.933749 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:24.934031 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:24.935065 29524 raft_consensus.cc:1275] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 27 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 27 index: 14. (index mismatch)
I20260709 13:14:24.935015 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:24.935810 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:24.938334 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:24.912364  3643 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:24.935032 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:24.897872  3730 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:24.949054 29454 raft_consensus.cc:1275] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:14:24.950157 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:24.950464 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:24.919770  3582 raft_consensus.cc:2749] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:14:24.960263 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:24.955029 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:24.870745  3735 consensus_queue.cc:1059] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
W20260709 13:14:24.954156 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:24.971380 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:24.921294  3679 raft_consensus.cc:2749] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:24.921167  3415 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:14:24.922634  3728 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:25.013520 29452 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3"
dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:45798
I20260709 13:14:25.041229 29452 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:25.041656 29452 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:25.015105 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:25.016207 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:25.017637 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:25.044219 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:14:24.994848 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:25.020064 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:25.022882 29419 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:25.030697 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:25.046864 29529 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:25.032208 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
W20260709 13:14:25.036227 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 172397us
I20260709 13:14:25.037266 29453 pending_rounds.cc:85] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 11
I20260709 13:14:25.047911 29453 pending_rounds.cc:107] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 13:14:25.048185 29453 raft_consensus.cc:2889] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:25.038516 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:24.932184  3765 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:25.052245 29346 leader_election.cc:400] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 18. Current term is 19.
I20260709 13:14:25.103895 29346 leader_election.cc:403] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
W20260709 13:14:25.107610 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 50569.1us
I20260709 13:14:24.946648  3590 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:25.030879  3767 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:14:25.126968 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 78870.5us
I20260709 13:14:25.128391 29346 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:25.112807 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 180563us
I20260709 13:14:25.119131 29524 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 20.
I20260709 13:14:25.051723  3728 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:25.040586  3415 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:25.100668  3737 raft_consensus.cc:2749] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:25.011610  3730 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:25.136420  3770 log.cc:927] Time spent T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:14:25.121016  3679 consensus_queue.cc:1048] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 13:14:25.133610  3767 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:25.169799 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:25.146324  3590 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:25.096612  3729 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:25.102236  3582 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:25.132855  3773 raft_consensus.cc:3060] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:25.172698 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:25.187987 29451 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 18.
I20260709 13:14:25.189584 29346 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:25.191393  3775 consensus_queue.cc:1048] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:25.193063  3775 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:14:25.113867 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 208523us
I20260709 13:14:25.152544  3337 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
W20260709 13:14:25.205114  3769 log.cc:927] Time spent T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:14:25.204749  3337 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:25.153790  3765 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:25.212443 29529 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 20.
I20260709 13:14:25.163480  3415 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:25.164336  3763 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:25.218837 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:25.172184  3560 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:25.212060  3729 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:25.216946  3765 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:25.242308  3773 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 18. Current term is 19.
I20260709 13:14:25.212694  3582 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:25.224025  3763 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:25.207191  3337 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:25.245514  3745 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:14:25.248984  3762 log.cc:927] Time spent T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.380s	user 0.005s	sys 0.003s
I20260709 13:14:25.249644 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:25.251088 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:25.222177 29452 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:25.251861 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: true dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:25.360515 29454 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:25.207298  3730 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:25.254959  3728 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:25.285198  3661 raft_consensus.cc:3055] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:14:25.302225 29419 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:25.303697 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:25.345074 29455 raft_consensus.cc:1275] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:14:25.370589 29447 raft_consensus.cc:1275] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:14:25.362543 29451 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 21.
W20260709 13:14:25.374472 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 72432.5us
I20260709 13:14:25.375823 29419 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:25.381659 29452 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:25.378901 29419 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:25.384403  3737 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:14:25.385035  3737 raft_consensus.cc:697] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 20 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:25.386046  3737 consensus_queue.cc:237] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:25.389607  3582 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:25.353036  3739 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.393862  3739 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:25.350252  3766 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:25.395874  3766 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:25.396693  3739 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:25.353454  3634 consensus_queue.cc:1048] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:14:25.398555  3766 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:25.400787  3763 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:25.375099  3587 consensus_queue.cc:1048] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:14:25.401189  3679 raft_consensus.cc:2804] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:14:25.401855  3679 raft_consensus.cc:697] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 20 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
W20260709 13:14:25.402841 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:25.427115  3767 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:25.436331  3763 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.437062  3763 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:25.441838  3763 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:25.453598  3415 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:25.377399  3730 raft_consensus.cc:2749] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:25.364523  3661 raft_consensus.cc:740] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:25.445823 29454 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 22.
W20260709 13:14:25.459630 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:25.400789  3728 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:25.403978  3765 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:25.468886 29421 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.513s (SENT) [suppressed 22 similar messages]
I20260709 13:14:25.402908  3679 consensus_queue.cc:237] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:25.506829  3729 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:25.518832 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 362999us
I20260709 13:14:25.509621  3661 consensus_queue.cc:260] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:25.521528  3661 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:25.529419  3722 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.529573  3415 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:25.538196 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 347378us
W20260709 13:14:25.545936 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:25.519102  3643 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:25.559628 29346 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:25.568495 29346 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:25.573419  2978 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:25.574337 29346 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:25.557838  3775 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:14:25.577674 29346 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:25.578445 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 375158us
I20260709 13:14:25.581405 29346 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:25.582870 29346 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:25.564843  3763 raft_consensus.cc:2764] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:14:25.539676  3722 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:25.572326  3729 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:25.558959  3643 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:25.604976 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:25.607663 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:25.608084 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:25.585620  3465 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:25.608989 29521 raft_consensus.cc:2393] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 21: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:25.609622  2978 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:25.610327 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:25.611142 29528 raft_consensus.cc:2393] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 20: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:25.592902  3415 raft_consensus.cc:2749] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:25.594684  3728 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:25.612936 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:25.617656 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:25.618321 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:25.614347 29523 raft_consensus.cc:2393] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 21: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:25.594841  3720 raft_consensus.cc:2749] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:14:25.620890 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:25.621783 29372 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:25.621151 29525 raft_consensus.cc:1240] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 21. Current term is 22. Ops: []
I20260709 13:14:25.625125 29381 raft_consensus.cc:1275] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:14:25.625818 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:14:25.627846  3779 log.cc:927] Time spent T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:14:25.628742  3643 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:25.600111  3730 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:25.631842  3730 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:25.634298  3730 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:25.609438  3729 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:25.639992  3729 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:25.611733  3767 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.640960  3767 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:25.610340  3765 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:25.644013  3765 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:25.646215  3765 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:25.655021 29372 raft_consensus.cc:2410] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:14:25.654868 29378 raft_consensus.cc:1275] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:14:25.659335 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:25.660072 29380 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:25.666276  3722 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:25.669900 29380 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 20.
I20260709 13:14:25.671702 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:25.604851  3618 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:25.614982  3582 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.696146 29521 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 21.
W20260709 13:14:25.679693 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 318437us
I20260709 13:14:25.666288  3767 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:25.668267  3745 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:25.675062  3765 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:14:25.726675 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 257809us
I20260709 13:14:25.722352  3785 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:25.729246 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:25.746644 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:25.696952  3631 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:14:25.744675  3779 log.cc:927] Time spent T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:14:25.756156 29495 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:25.758307 29378 raft_consensus.cc:1275] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:14:25.671079  3728 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:25.694259  3618 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:25.744287  3767 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:25.751104  3729 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:25.702811  3582 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:25.749220  3765 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:25.775048 29378 raft_consensus.cc:1275] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:14:25.756337  3730 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:25.766633  3722 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:25.746793  3745 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:25.778522  3729 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:25.782047 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:25.799872 29372 raft_consensus.cc:2410] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 21 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:14:25.801612 29372 raft_consensus.cc:1275] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:14:25.804625 29380 raft_consensus.cc:1240] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 18. Current term is 19. Ops: [18.9-18.9]
I20260709 13:14:25.755132  3631 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:25.787794  3634 consensus_queue.cc:1048] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:25.794358 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:25.794492 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:25.842166 29376 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
I20260709 13:14:25.842839 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:25.843173 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:25.796623 29378 raft_consensus.cc:1275] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:14:25.787117 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 81140.3us
I20260709 13:14:25.844525 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:25.807825 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:25.846176 29380 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 21.
I20260709 13:14:25.809268 29372 raft_consensus.cc:1275] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:14:25.813525 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:25.848001 29381 raft_consensus.cc:1275] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:14:25.795053 29495 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:14:25.849172 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:25.849473 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 58282.9us
I20260709 13:14:25.818616  3729 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:25.819600  3682 consensus_queue.cc:1048] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:14:25.820760 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:25.844579 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: true dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:25.853494 29378 raft_consensus.cc:3055] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:14:25.853827 29378 raft_consensus.cc:740] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:25.853947 29453 raft_consensus.cc:2393] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 21: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:25.810115 29421 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:25.823247 29375 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:25.825250 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:25.828928 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:14:25.855540 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 45574.4us
I20260709 13:14:25.850273 29495 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:25.750977  3785 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:25.814709 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:25.860543 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:25.862257 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:25.855906 29451 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 21.
I20260709 13:14:25.834297 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:25.857182 29421 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:25.799037  3722 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:25.858805 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:25.854579 29378 consensus_queue.cc:260] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:25.873461 29378 raft_consensus.cc:3060] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:25.870649 29448 raft_consensus.cc:2955] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 11 to 13, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:25.777086  3767 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:25.883960 29447 raft_consensus.cc:2393] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 21: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:25.848809  3547 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:25.864071  3587 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:14:25.864128  3737 raft_consensus.cc:2749] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:25.876746  3722 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:25.804184  3730 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:25.908478 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 51429.6us
I20260709 13:14:25.912792 29421 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:25.876181  3790 raft_consensus.cc:2804] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:14:25.878878  3766 raft_consensus.cc:2749] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:25.915699 29421 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:25.895033  3587 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:25.923481 29375 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 20.
W20260709 13:14:25.918463  3793 log.cc:927] Time spent T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:14:25.932927 29376 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 27.
I20260709 13:14:25.900647  3547 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:25.950501  3798 log.cc:927] Time spent T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:14:25.950668  3547 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:25.963222  3765 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:25.964771  3582 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:25.965564  3582 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.966174  3582 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:25.968503  3745 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:25.968941  3728 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:14:25.936662  3792 log.cc:927] Time spent T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
W20260709 13:14:25.971318 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:25.930374  3782 log.cc:927] Time spent T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:14:25.974349 29455 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 21.
I20260709 13:14:25.924168  3679 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:25.975858 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:25.978859  3767 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:25.981292  3631 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:25.983482  3635 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.984198  3635 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:25.985205  3679 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:25.985812  3679 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:25.991556  3730 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:25.993180  3730 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:25.970639  3785 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:25.924592 29378 raft_consensus.cc:2468] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 22.
I20260709 13:14:25.975924 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:26.072633 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:26.068250 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:14:26.066838 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 201898us
I20260709 13:14:26.073494 29373 raft_consensus.cc:2468] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 18.
I20260709 13:14:26.001581 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:26.074954 29380 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:26.069023 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:26.075240 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:26.077193 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:26.099995 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:26.104790 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:26.100754 29381 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 19.
I20260709 13:14:26.105515 29376 raft_consensus.cc:1275] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 27 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 27 index: 14. (index mismatch)
I20260709 13:14:26.106377 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:26.107122 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:26.107949 29373 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 16.
I20260709 13:14:26.108973 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:26.109714 29373 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:25.917165  3729 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:26.099545 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:26.120450 29447 raft_consensus.cc:2468] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:14:26.111950 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:25.937189  3587 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:26.105522 29377 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:25.995358  3618 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:26.027168  3797 log.cc:927] Time spent T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:14:26.126736 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:26.130076 29381 raft_consensus.cc:3055] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:14:26.126605 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:26.066090  3766 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:26.114360 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:26.137415 29373 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 21.
I20260709 13:14:26.130463 29381 raft_consensus.cc:740] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:26.139925 29380 raft_consensus.cc:2410] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 21 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:14:26.017611  3635 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:26.141692 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:14:26.143811 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 252317us
I20260709 13:14:26.147958 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:26.152623 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:26.153522 29380 raft_consensus.cc:2393] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 19: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:26.154452 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:26.158928 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:26.163230 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:26.164188 29380 raft_consensus.cc:2393] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 20: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:26.165194 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:26.003669  3730 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:26.161788 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:26.162295 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:26.166564 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:26.169066 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:26.160547 29377 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 20.
I20260709 13:14:26.180999 29528 raft_consensus.cc:2410] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:14:26.181998 29380 raft_consensus.cc:2393] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 19: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:26.141013  3631 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:26.182484 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:14:26.184139 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:26.196890  2978 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:26.190905 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:26.194341 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:26.219223 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:26.187561 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:26.197650  2978 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:26.259454 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:26.297854 29380 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 19.
I20260709 13:14:26.299280 29378 raft_consensus.cc:2468] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 15.
I20260709 13:14:26.299876  2978 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:26.302175 29376 raft_consensus.cc:1275] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:14:26.303668 29379 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 14.
I20260709 13:14:26.143612  3766 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:26.312951  3766 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:26.316740 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:14:26.305083 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 115756us
W20260709 13:14:26.305155 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 105343us
I20260709 13:14:26.307880  3635 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:26.309010 29380 raft_consensus.cc:1240] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 20. Current term is 21. Ops: []
I20260709 13:14:26.310871  3730 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:26.168085  3790 raft_consensus.cc:697] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:26.245937  3728 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:26.253109  3679 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:26.336046  3582 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:26.318190 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:26.393249 29455 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16.
I20260709 13:14:26.183881  3816 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:26.395901  3816 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:26.339180 29376 raft_consensus.cc:1275] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:14:26.166342  3547 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:26.401554  3547 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:26.165970  3682 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:26.403985  3682 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:26.340483 29346 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:26.406248  3682 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:14:26.368548 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:26.333626 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:26.407405  3547 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:26.399256  3816 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:14:26.411403 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 54200.8us
W20260709 13:14:26.412127 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 57732.3us
I20260709 13:14:26.245383  3631 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:26.425604 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 85175.8us
I20260709 13:14:26.388622  3707 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:26.426877 29346 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:26.428823 29344 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:26.435879  2978 raft_consensus.cc:2749] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:26.436659 29346 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:26.347119  3635 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:26.354383  3722 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:26.459213 29346 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:26.484194 29346 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:26.391021  3728 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:26.429852  3582 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:14:26.493036 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 73898.8us
I20260709 13:14:26.499264  2978 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:26.488350  3791 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:26.468123  3578 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:26.490450  3601 raft_consensus.cc:2764] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:14:26.439229  3817 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:26.507510  3790 consensus_queue.cc:237] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:26.549115  3722 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:26.551604  3635 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:26.556214  3728 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:26.527755  3791 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:26.560200  3631 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:26.562369 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:26.566291  3791 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:14:26.446439 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 306838us
I20260709 13:14:26.452909  3707 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:26.598675  3707 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:26.600126 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:26.601450 30155 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
I20260709 13:14:26.435189 29344 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:14:26.608320 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 173253us
I20260709 13:14:26.592988 29495 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:26.600987 29526 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 19.
I20260709 13:14:26.629288 29495 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:26.635228 29344 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:26.636875  2978 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:26.640852 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:26.641750 29526 raft_consensus.cc:2468] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:14:26.627177  3578 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:14:26.644342 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:26.643975 29495 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:26.662132  3578 raft_consensus.cc:697] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:26.633204  3791 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:26.644444  3635 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:26.720064  3737 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:26.720682  3737 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:26.725833  3679 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:26.726475  3679 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:26.731351 29375 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 2242) took 1107 ms. Trace:
I20260709 13:14:26.731768 29372 raft_consensus.cc:1275] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:14:26.731837 29375 rpcz_store.cc:276] 0709 13:14:25.624359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:25.625456 (+  1097us) service_pool.cc:224] Handling call
0709 13:14:26.731138 (+1105682us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b54003dca54. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:14:26.731284 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":451880320}
I20260709 13:14:26.702996 29495 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:26.664364  3578 consensus_queue.cc:237] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:26.684970  3722 consensus_queue.cc:1048] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:14:26.679896  3791 raft_consensus.cc:2749] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:14:26.704360  3682 consensus_queue.cc:1048] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:26.705152  3816 consensus_queue.cc:1048] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:14:26.102252 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:14:26.717664 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:26.718134  3587 consensus_meta.cc:287] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.573s	user 0.009s	sys 0.006s
I20260709 13:14:26.636225  3631 consensus_queue.cc:1048] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:14:26.738431 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:26.738773 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:26.825613 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:26.737898 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:26.826644 29526 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:26.740849 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:26.732074 29344 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:14:26.827894 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 95949us
I20260709 13:14:26.828294 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:26.829442 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:26.789927 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:26.825341 29495 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:26.791816 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:26.723251  3737 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:26.795390 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:26.741997  3825 raft_consensus.cc:2749] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:26.804973  3635 consensus_queue.cc:1048] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
W20260709 13:14:26.819183  3803 log.cc:927] Time spent T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.889s	user 0.017s	sys 0.033s
I20260709 13:14:26.729949  3679 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:26.824525 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:26.827040 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:26.838229 29521 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 19.
I20260709 13:14:26.831432 29529 raft_consensus.cc:2368] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 19. Current term is 20.
I20260709 13:14:26.839172 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:26.832480 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:26.840183 29525 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:26.840853 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:26.830065 29523 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 22.
I20260709 13:14:26.832129 29527 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 17.
I20260709 13:14:26.841573 29524 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 16.
I20260709 13:14:26.831789  3730 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:26.842451 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:26.842980  3730 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:26.845296  3730 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:26.832268  3587 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:26.838241  3722 raft_consensus.cc:2804] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:26.848444  3722 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:26.848834  3722 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:26.849398  3587 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:26.850556 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:26.852448 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:26.822786  3661 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:26.829075  3729 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:26.858413  3661 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:26.859189  3729 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:26.860826  3661 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:26.861385  3729 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:26.863417 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:26.864790 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:26.864825 29526 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 21.
I20260709 13:14:26.836122  3465 raft_consensus.cc:2804] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:26.868287 29495 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:26.837237  3737 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:26.866998  3465 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:26.880400 29525 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 21.
I20260709 13:14:26.877323  3737 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:26.886993  3737 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:26.883155  3587 raft_consensus.cc:2804] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:26.891985  3587 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:26.892609  3587 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:26.879086  3465 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:26.919981  3635 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:26.951375 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:26.959900 29453 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 18.
I20260709 13:14:26.954190 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:26.951483 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:26.963646 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:26.964967 29453 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:14:26.967439 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:26.975708 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:26.977000 29449 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 23.
I20260709 13:14:26.942457  3635 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:26.983891 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:26.998032 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:26.998893 29449 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:27.003782 29453 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 20.
I20260709 13:14:27.012959 29450 raft_consensus.cc:1275] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:14:27.032773  3722 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:27.037834  3722 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:27.009756  3816 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:27.038853 29521 raft_consensus.cc:2368] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 15. Current term is 16.
I20260709 13:14:27.046528 29419 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:14:27.061337 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 559791us
I20260709 13:14:27.064349  3635 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:27.068481 29346 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:27.072387 29372 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52186 (request call id 2267) took 1260 ms. Trace:
I20260709 13:14:27.073935 29372 rpcz_store.cc:276] 0709 13:14:25.808099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:25.848185 (+ 40086us) service_pool.cc:224] Handling call
0709 13:14:26.731355 (+883170us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:26.732241 (+   886us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:27.068613 (+336372us) spinlock_profiling.cc:243] Waited 883 ms on lock 0x7b54003dca50. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd858ad 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:14:27.068787 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2030340992}
I20260709 13:14:27.054957  3587 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:27.087044 29419 leader_election.cc:400] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 19. Current term is 20.
I20260709 13:14:27.040361 29449 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 22.
I20260709 13:14:27.085456  3775 raft_consensus.cc:2764] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:14:27.062119  3816 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:27.107686 29421 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:27.088398 29419 leader_election.cc:403] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:14:27.096316 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 87738.3us
I20260709 13:14:27.115759 29421 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:27.144450 29421 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:27.146369 29421 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:27.160800 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 74058.5us
I20260709 13:14:27.162762 29419 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:27.088471  3618 raft_consensus.cc:2804] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:27.087579  3737 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:27.139513  3661 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:27.165577 29495 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:27.126919  3763 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:27.169679  3679 raft_consensus.cc:2749] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 19. Current term is 20.
I20260709 13:14:27.166950  3840 raft_consensus.cc:2749] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:14:27.239287 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 73784.9us
W20260709 13:14:27.209722  3830 log.cc:927] Time spent T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:14:27.170864  3618 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:27.244017 29495 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:27.215907  3737 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:27.241305  3763 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:27.258096  3635 raft_consensus.cc:2804] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:27.225698  3683 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:27.284915  3722 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:14:27.287027 29495 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:14:27.298800 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:27.305800  3635 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:27.338197  3635 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:27.309500 29495 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:27.291242  3729 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:27.306057  3720 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:27.331540  3683 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:27.354039  3720 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:27.327683  3790 consensus_queue.cc:1048] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
W20260709 13:14:27.292325  3850 log.cc:927] Time spent T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
W20260709 13:14:27.308746  3852 log.cc:927] Time spent T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:14:27.287665  3618 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:27.327595  3845 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:14:27.348459  3751 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:14:27.308425  3722 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:27.390089  3722 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:14:27.396307  3766 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:27.397109  3766 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:27.351827  3587 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:27.352974  3816 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:27.415752  3845 raft_consensus.cc:697] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 20 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:27.416471  3751 raft_consensus.cc:697] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:27.417241  3845 consensus_queue.cc:237] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:27.306340  3661 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:14:27.364876  3683 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:27.371776  3737 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:27.377022  3763 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:27.377823 29381 consensus_queue.cc:260] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:27.569316 29381 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:14:27.388738 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 47269.8us
I20260709 13:14:27.417564  3751 consensus_queue.cc:237] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:27.291621  3679 raft_consensus.cc:2804] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:14:27.598428 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 166282us
I20260709 13:14:27.605459 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:27.606598 29447 raft_consensus.cc:3060] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 16
W20260709 13:14:27.617848 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:27.622263 29455 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.018s	sys 0.032s
W20260709 13:14:27.622946 29455 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.018s	sys 0.033s
I20260709 13:14:27.626575 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:27.469080  3661 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:27.631031 29381 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 21.
W20260709 13:14:27.634727 29381 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52172 (request call id 2721) took 1563 ms (client timeout 2014 ms). Trace:
W20260709 13:14:27.635473 29381 rpcz_store.cc:269] 0709 13:14:26.076453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:26.126445 (+ 49992us) service_pool.cc:224] Handling call
0709 13:14:27.377183 (+1250738us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b4c002e8300. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7a052a20 00007f6a7a063a29 00007f6a7a029644 00007f6a7a050f2d 00007f6a7a050b93 00007f6a7bd8118b 00007f6a7bd81cb5 00007f6a7bd7cf30 00007f6a7bd7e7de 00007f6a7bd8a27c 00007f6a80d4bb17
0709 13:14:27.634633 (+257450us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6743936}
W20260709 13:14:27.643827 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 497557us
I20260709 13:14:27.658331  3866 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:27.659238  3866 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:27.660007 29447 raft_consensus.cc:2468] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16.
I20260709 13:14:27.662245  3866 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:27.608733  3679 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:14:27.665948 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 503261us
I20260709 13:14:27.668947 29421 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:27.668771 29419 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:27.637989  3661 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:27.664078  3870 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:27.630124  3862 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:27.689677 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:27.691876 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:27.691964 29421 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:27.697248 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:27.698086 29453 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:27.672147  3737 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:27.674954  3679 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:27.680279  3866 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:27.709316 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:27.674688  3765 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:27.715406 29530 raft_consensus.cc:1240] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:14:27.715831 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:14:27.709663  3836 log.cc:927] Time spent T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:14:27.698408  3766 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:27.730311 29453 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
I20260709 13:14:27.702821  3870 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:27.755314 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 164711us
W20260709 13:14:27.745061  3465 consensus_meta.cc:287] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.827s	user 0.011s	sys 0.004s
I20260709 13:14:27.703686  3862 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:27.716611  3866 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:27.714702  3737 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:27.718091  3765 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:27.767432 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 98742.5us
I20260709 13:14:27.756794  3745 raft_consensus.cc:2749] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:27.744211  3766 consensus_queue.cc:1048] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
W20260709 13:14:27.775589 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:27.770752 29419 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:27.780638 29419 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:27.769433  3848 consensus_queue.cc:1048] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:14:27.770123  3868 raft_consensus.cc:2804] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:27.796043 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:27.796499 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:27.797914 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:27.798686 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:27.806401 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:27.799870 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:27.796015 29525 raft_consensus.cc:1275] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:14:27.810225  3862 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:27.810503  3737 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:27.811733  3737 raft_consensus.cc:2764] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:14:27.812475  3737 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:27.814599  3765 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:27.820724  3879 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:27.821244 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:27.821525  3879 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:27.832065 29528 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 23.
I20260709 13:14:27.833714  3879 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:27.822098  3843 log.cc:927] Time spent T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.850s	user 0.001s	sys 0.021s
I20260709 13:14:27.822758  3847 consensus_queue.cc:1048] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:14:27.822942  3635 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:27.836875  3866 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:27.759773  3465 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:27.838080  3635 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:27.823887  3729 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:27.838827  3729 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:27.839370  3465 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:27.840510  3722 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:27.842433  3618 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:27.837182  3859 log.cc:927] Time spent T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.487s	user 0.000s	sys 0.003s
I20260709 13:14:27.842844  3722 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:27.843325 29522 raft_consensus.cc:1240] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 23. Current term is 24. Ops: []
I20260709 13:14:27.849858  3870 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:27.834050  3842 log.cc:927] Time spent T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.792s	user 0.006s	sys 0.011s
I20260709 13:14:27.774716  3863 raft_consensus.cc:2749] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:14:27.829144  3861 log.cc:927] Time spent T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:14:27.774564  3682 consensus_queue.cc:1048] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:14:27.870514  3729 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:27.873378  3729 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:27.873903  3849 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:27.776575  3825 consensus_queue.cc:1048] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:14:27.805431  3868 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:27.867822  3578 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:27.892920  3618 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:27.873407  3720 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:27.877089  3849 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:27.893890  3868 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:27.892270  3679 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:28.000699  3817 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:28.002317  3817 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:28.004454 29452 raft_consensus.cc:1240] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 16. Current term is 17. Ops: []
W20260709 13:14:27.949175 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 168347us
W20260709 13:14:27.950235 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 161803us
I20260709 13:14:27.959262 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:27.960318 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:27.961021 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:27.961512 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:27.962327 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:27.959031 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:14:27.969209 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 277169us
W20260709 13:14:27.982059 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 93525.9us
I20260709 13:14:27.891425  3578 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:27.912374  3849 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:28.016830 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:28.024643 29419 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:28.027652  3880 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:14:28.029953 29451 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:28.036803 29377 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 23.
I20260709 13:14:28.036677 29421 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:28.042147 29380 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
I20260709 13:14:28.044474  3578 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:28.045758 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:28.048388 29448 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:14:28.048806  3679 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:28.050685  3811 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:28.053629 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:28.053937 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:28.055429 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:28.057592 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:28.058698 29379 raft_consensus.cc:2376] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 20. Re-sending same reply.
I20260709 13:14:28.060187 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:28.063154 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:28.063844 29375 raft_consensus.cc:2376] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 20. Re-sending same reply.
I20260709 13:14:28.065707  3811 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:28.068040  3882 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:28.069159  3811 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:28.069006  3882 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:28.055361 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:28.072289 29376 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:28.078209  3881 consensus_queue.cc:1059] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:28.080586  3878 raft_consensus.cc:3055] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:14:28.081067  3878 raft_consensus.cc:740] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:14:28.082007 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 63987.8us
I20260709 13:14:28.082526  3878 consensus_queue.cc:260] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:28.084088 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:28.045962  3817 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:28.088580 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 52220.1us
I20260709 13:14:28.091693 29276 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37594 (request call id 141) took 11128 ms. Trace:
I20260709 13:14:28.092098 29495 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:28.094170  3682 raft_consensus.cc:2804] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:14:28.089115  3882 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:28.089180  3878 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:28.099829  3679 raft_consensus.cc:2804] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:14:28.100814  3679 raft_consensus.cc:697] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 21 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:28.102731  3679 consensus_queue.cc:237] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:28.105386  3661 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:28.107234 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:28.108282  3881 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:28.114895 29378 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52172 (request call id 2737) took 1958 ms (client timeout 1788 ms). Trace:
I20260709 13:14:28.118408 29521 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37958 (request call id 2594) took 1321 ms. Trace:
I20260709 13:14:28.125136 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:28.168793 29376 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 20.
I20260709 13:14:28.165783 29448 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 24.
W20260709 13:14:28.138662 29378 rpcz_store.cc:269] 0709 13:14:26.156400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:26.158876 (+  2476us) service_pool.cc:224] Handling call
0709 13:14:28.114329 (+1955453us) spinlock_profiling.cc:243] Waited 62.2 ms on lock 0x7b54000d98d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:14:28.114597 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143065472}
I20260709 13:14:28.139037 29521 rpcz_store.cc:276] 0709 13:14:26.796374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:26.838892 (+ 42518us) service_pool.cc:224] Handling call
0709 13:14:28.117886 (+1278994us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b5400304dd4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:14:28.118160 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":457164544}
W20260709 13:14:28.168215 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 81614.9us
I20260709 13:14:28.173023 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:28.170588  3682 raft_consensus.cc:697] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:28.198323 29419 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:14:28.207674 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 49853.4us
I20260709 13:14:28.092366 29276 rpcz_store.cc:276] 0709 13:14:16.963055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:16.964529 (+  1474us) service_pool.cc:224] Handling call
0709 13:14:28.091309 (+11126780us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:22.539985 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:22.540609 (+   624us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:22.540644 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:14:22.540662 (+    18us) tablet.cc:662] Decoding operations
0709 13:14:22.543595 (+  2933us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:22.543683 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:22.543713 (+    30us) tablet.cc:685] Acquiring locks for 30 operations
0709 13:14:22.548704 (+  4991us) tablet.cc:701] Row locks acquired
0709 13:14:22.548739 (+    35us) write_op.cc:260] PREPARE: finished
0709 13:14:22.548990 (+   251us) write_op.cc:270] Start()
0709 13:14:22.549199 (+   209us) write_op.cc:276] Timestamp: P: 1783602862548908 usec, L: 0
0709 13:14:22.549239 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 13:14:22.588278 (+ 39039us) log.cc:844] Serialized 11860 byte log entry
0709 13:14:23.120878 (+532600us) op_driver.cc:464] REPLICATION: finished
0709 13:14:23.580820 (+459942us) write_op.cc:301] APPLY: starting
0709 13:14:23.591026 (+ 10206us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:23.596555 (+  5529us) spinlock_profiling.cc:243] Waited 6.15 ms on lock 0x7b5400422054. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8332a 00007f6a7bd08f14 00007f6a7bd08ec3 00007f6a7bd08e38 00007f6a7bd08df3 00007f6a7bd080dc 00007f6a7bd31e16 00007f6a7bd19cbb 00007f6a7bd0439d 00007f6a7bd07d75
0709 13:14:23.856297 (+259742us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:23.857703 (+  1406us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:24.815231 (+957528us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:24.862748 (+ 47517us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=60,key_file_lookups=60,delta_file_lookups=60,mrs_lookups=0
0709 13:14:24.870439 (+  7691us) write_op.cc:312] APPLY: finished
0709 13:14:25.135187 (+264748us) log.cc:844] Serialized 260 byte log entry
0709 13:14:25.471147 (+335960us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:25.474550 (+  3403us) write_op.cc:454] Released schema lock
0709 13:14:25.474659 (+   109us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:25.475156 (+   497us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:25.475196 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":247921,"reported_tablets":56,"child_traces":[["op",{"apply.queue_time_us":379176,"apply.run_cpu_time_us":94341,"apply.run_wall_time_us":1938375,"cfile_cache_hit":122,"cfile_cache_hit_bytes":129287,"num_ops":30,"prepare.queue_time_us":87333,"prepare.run_cpu_time_us":54124,"prepare.run_wall_time_us":185975,"raft.queue_time_us":255451,"raft.run_cpu_time_us":36975,"raft.run_wall_time_us":530153,"replication_time_us":546490,"spinlock_wait_cycles":14151552,"thread_start_us":894972,"threads_started":5,"wal-append.queue_time_us":611350,"wal-append.run_cpu_time_us":22955,"wal-append.run_wall_time_us":2202329}]]}
I20260709 13:14:28.213958 29421 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:28.216917 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:28.220633  3880 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:14:28.221527  3880 raft_consensus.cc:697] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 21 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:28.229339  3661 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:28.230742 29495 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:28.247530  3661 consensus_queue.cc:1048] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:28.249634  3682 consensus_queue.cc:237] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:28.260106 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:28.202968  3881 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:28.264243  3881 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:28.218132 29451 raft_consensus.cc:2468] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 20.
I20260709 13:14:28.269310  3547 raft_consensus.cc:2804] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:14:28.270277  3547 raft_consensus.cc:697] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:28.223176  3880 consensus_queue.cc:237] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:28.276826 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:28.277552  3547 consensus_queue.cc:237] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:28.265380 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 65282.5us
I20260709 13:14:28.284925 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:28.290613 29419 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:28.282351  3661 raft_consensus.cc:2749] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:28.306880 29529 raft_consensus.cc:1240] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 LEADER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 21. Current term is 22. Ops: []
I20260709 13:14:28.310649 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:28.307925 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:28.327230 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:28.333662 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:28.334318 29421 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:28.337854 29375 raft_consensus.cc:2393] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 16: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:28.345273 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:28.348172  3889 log.cc:927] Time spent T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.069s	user 0.000s	sys 0.002s
W20260709 13:14:28.354149 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 106640us
I20260709 13:14:28.364101 29524 raft_consensus.cc:2393] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 20: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:28.355691  3661 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:14:28.357529 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:28.389935 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:28.392231 29521 raft_consensus.cc:2410] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 24 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
W20260709 13:14:28.388787 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 44619.3us
I20260709 13:14:28.387941 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:28.396039  3880 raft_consensus.cc:2749] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:28.382012  3661 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:28.360776  3868 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:28.426812 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:28.419718  3661 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:28.434192 29378 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 20.
I20260709 13:14:28.440011 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:28.435829 29453 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 19.
I20260709 13:14:28.433472 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:14:28.446441 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 59205.7us
I20260709 13:14:28.451857 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:14:28.443266  3804 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.006s	user 0.017s	sys 0.035s
I20260709 13:14:28.451225 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:28.442242  3881 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:28.452615 29381 raft_consensus.cc:2376] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 20. Re-sending same reply.
I20260709 13:14:28.465466  3881 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:28.459476  3804 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.125s	user 0.019s	sys 0.035s
I20260709 13:14:28.477048 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:28.482800 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:14:28.486331 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 191685us
I20260709 13:14:28.492882 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: true dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:28.500840  3868 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:28.507324  3465 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:28.508211  3465 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:28.508714  3853 log.cc:927] Time spent T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 1.203s	user 0.003s	sys 0.003s
I20260709 13:14:28.510828 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:28.488803  3817 consensus_queue.cc:1059] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:14:28.512543 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:28.513602 29421 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:28.514437 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:28.514474 29381 raft_consensus.cc:2410] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 21 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:14:28.491847 29495 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:28.523679 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:28.525043 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:28.530346 29372 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 27.
I20260709 13:14:28.526494 29373 raft_consensus.cc:2376] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 22. Re-sending same reply.
W20260709 13:14:28.544580 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 74225.8us
I20260709 13:14:28.513224  3773 consensus_queue.cc:1059] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:14:28.535192  3868 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:28.562368 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:28.550341  3634 raft_consensus.cc:2804] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:14:28.567054 29373 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 20.
I20260709 13:14:28.574637 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:28.577879 29376 raft_consensus.cc:2410] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 21 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:14:28.581573 29454 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 18.
I20260709 13:14:28.586925  3634 raft_consensus.cc:697] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:28.588660  3634 consensus_queue.cc:237] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:28.596938 29447 raft_consensus.cc:1275] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 13:14:28.597824 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 84546.4us
I20260709 13:14:28.608834 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:28.611622  3773 consensus_queue.cc:1243] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer 71aa3578fd924765ab9ac0729c8d1483 log is divergent from this leader: its last log entry 22.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:14:28.612490  3773 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:28.612674 30157 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54212 (request call id 260) took 1969 ms. Trace:
I20260709 13:14:28.613271  3773 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:28.616705  3804 raft_consensus.cc:3055] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:14:28.617298  3804 raft_consensus.cc:740] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:28.618279 29421 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:28.613147 30157 rpcz_store.cc:276] 0709 13:14:26.643168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:26.643426 (+   258us) service_pool.cc:224] Handling call
0709 13:14:27.496487 (+853061us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:27.496858 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:27.496897 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:27.496964 (+    67us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:14:27.497013 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:27.497099 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:28.612236 (+1115137us) spinlock_profiling.cc:243] Waited 853 ms on lock 0x7b5400a12cd0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd858ad 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:14:28.612435 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1960913792}
I20260709 13:14:28.619757  3881 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:28.618443  3804 consensus_queue.cc:260] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:28.634281  3868 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:28.654556 29447 raft_consensus.cc:1240] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 19. Current term is 20. Ops: []
I20260709 13:14:28.666263 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:14:28.684643 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 66494.5us
W20260709 13:14:28.686398 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:28.686532 29374 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
I20260709 13:14:28.732736 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:28.681859  3804 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:28.744591 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:28.755602 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:28.740604  3773 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:28.706182  3465 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:28.779676  3661 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:28.784467 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:28.785782 29381 raft_consensus.cc:2393] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 23: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:28.788156 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:28.784849  3661 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:28.790684 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:14:28.794883 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:28.787148 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:28.797399 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:14:28.798409  3905 log.cc:927] Time spent T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:14:28.798637 29381 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 18.
I20260709 13:14:28.799947  3547 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:28.800400 29375 raft_consensus.cc:2393] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 20: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:28.800777  3547 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:28.801352 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:28.802166 29376 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 16.
I20260709 13:14:28.803108 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:28.804378  3547 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:28.800007 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:28.770591  3868 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:28.808187  3868 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:28.810593  3868 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:28.770318  3880 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:28.813565  3880 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:28.801410 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:28.823990 29455 raft_consensus.cc:1240] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:14:28.829592 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:28.832345 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:28.836462 29452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 2496) took 1020 ms. Trace:
I20260709 13:14:28.837100 29452 rpcz_store.cc:276] 0709 13:14:27.816124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:27.819609 (+  3485us) service_pool.cc:224] Handling call
0709 13:14:27.820039 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:28.007608 (+187569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:28.836038 (+828430us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b54000c26d4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:14:28.836362 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":422453504}
I20260709 13:14:28.848737 29421 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:28.866564  3894 log.cc:927] Time spent T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.298s	user 0.001s	sys 0.002s
I20260709 13:14:28.867842  3880 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:28.887539 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 43739.7us
I20260709 13:14:28.922668 29421 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:28.915895 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 229667us
I20260709 13:14:28.934214 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:28.938892 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 145426us
I20260709 13:14:28.940912 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:28.910894  3679 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:28.943727 29452 raft_consensus.cc:2393] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 20: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:28.917735  3868 raft_consensus.cc:2804] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:28.948714  3679 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:28.951943  3878 raft_consensus.cc:3055] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:14:28.952515  3878 raft_consensus.cc:740] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:28.953585  3878 consensus_queue.cc:260] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:28.955804  3880 raft_consensus.cc:2804] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:28.956547  3880 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:28.957106  3880 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:28.920406  3661 consensus_queue.cc:1048] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:14:28.967038  3679 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:28.986073 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:28.974160  3868 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:29.001212 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:29.002485 29448 raft_consensus.cc:2393] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 16: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:28.989251  3868 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:29.015345 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:29.016078 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:29.016757 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:29.017401 29448 raft_consensus.cc:1240] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:14:29.019797  3679 consensus_queue.cc:1048] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:29.022701 29421 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:29.025309  3878 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:14:29.026377 29421 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:29.027381  3661 raft_consensus.cc:2764] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:14:29.030968  3661 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:14:29.031432  3661 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:29.037597  3661 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:29.042876  3868 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:29.049947 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:29.057633 29448 raft_consensus.cc:1240] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 21. Current term is 22. Ops: []
I20260709 13:14:29.063516 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:29.065440 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:29.066491 29450 raft_consensus.cc:2410] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 21 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
I20260709 13:14:29.060129 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:29.069320 29456 raft_consensus.cc:1240] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 22. Current term is 23. Ops: []
I20260709 13:14:29.074222 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:29.061033 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:29.076298 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:29.075404 29454 raft_consensus.cc:2393] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 16: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:29.081310 29452 raft_consensus.cc:1240] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 21 LEADER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 20. Current term is 21. Ops: []
I20260709 13:14:29.082645 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:29.083618 29529 raft_consensus.cc:1240] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 23. Current term is 24. Ops: []
I20260709 13:14:29.084522 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:29.086577 29454 raft_consensus.cc:2393] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 20: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:29.091827 29456 raft_consensus.cc:2410] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 22 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:14:29.082899 29275 catalog_manager.cc:5697] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 15 to 16, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 16 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:29.095902 29275 catalog_manager.cc:5697] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 13 to 18, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 18 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:29.101560 29275 catalog_manager.cc:5697] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:29.105026 29421 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:29.106365  3868 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:29.108361 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:29.119586 29447 raft_consensus.cc:1275] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:14:29.129869 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:29.130944 29453 raft_consensus.cc:2410] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 24 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
I20260709 13:14:29.134656 29455 raft_consensus.cc:1275] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:14:29.136121  3878 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:29.130966  3661 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:29.136646  3878 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:29.137444 29451 raft_consensus.cc:1240] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 20. Current term is 21. Ops: []
I20260709 13:14:29.139284  3763 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:29.140412 29275 catalog_manager.cc:5697] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:29.148065  3763 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:29.150643  3763 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:29.151405 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:29.151932  3661 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:29.150183 29275 catalog_manager.cc:5697] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:29.156368  3868 raft_consensus.cc:2749] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:14:29.156958 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 71557.8us
I20260709 13:14:29.160132  3878 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:29.161895 29377 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47da517282ee462792de545e40119636"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "71aa3578fd924765ab9ac0729c8d1483"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:14:29.164947 29377 raft_consensus.cc:606] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Received request to transfer leadership to TS 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:29.165350 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:29.162357 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:29.164865  3878 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:29.166607 29373 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 23.
I20260709 13:14:29.163146 29275 catalog_manager.cc:5697] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 17 to 18, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 18 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:29.166699  3878 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:29.169099 29275 catalog_manager.cc:5697] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 13 to 14, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 14 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:29.170038  3878 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:29.171362 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:29.174305 29495 leader_election.cc:336] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.555s (SENT)
I20260709 13:14:29.176319 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:29.177400 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:29.177928 29451 raft_consensus.cc:1240] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 23. Current term is 24. Ops: []
I20260709 13:14:29.178800 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:29.180086 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:29.174556 29275 catalog_manager.cc:5697] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 18 to 19, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 19 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:29.181460 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:29.176703 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:29.175545 29447 raft_consensus.cc:1275] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:14:29.191979 29374 raft_consensus.cc:1275] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:14:29.188822 29275 catalog_manager.cc:5697] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 15 to 17, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 17 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:29.198316 29275 catalog_manager.cc:5697] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 16 to 17, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 17 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:29.203029 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:29.203924 29374 raft_consensus.cc:1275] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 14. (term mismatch)
I20260709 13:14:29.204048 29372 raft_consensus.cc:2410] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 22 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:14:29.204280 29374 pending_rounds.cc:85] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5: Aborting all ops after (but not including) 13
I20260709 13:14:29.204504 29374 pending_rounds.cc:107] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5: Aborting uncommitted NO_OP operation due to leader change: 21.14
I20260709 13:14:29.204780 29374 raft_consensus.cc:2889] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:29.165387 29421 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:29.207592  3868 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:14:29.208881 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 44762.5us
W20260709 13:14:29.199514 29495 leader_election.cc:336] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 1.586s (SENT)
I20260709 13:14:29.201843 29377 raft_consensus.cc:1275] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:14:29.229959 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:29.230474 29372 raft_consensus.cc:1275] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:14:29.231726  3880 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:29.232650 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:29.236167 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:29.236938 29527 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 21.
I20260709 13:14:29.238289 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:29.243876 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:29.243636 29344 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:29.247481 29448 raft_consensus.cc:1240] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:29.256016  3864 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:14:29.256887  3864 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:29.257427  3864 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:29.252219 29524 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 20.
W20260709 13:14:29.272478 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 73045.5us
I20260709 13:14:29.263866  3868 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:29.268826  3679 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:29.282961  3868 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:29.285806  3868 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:29.277948  3679 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:29.290011 29421 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:29.291007  3880 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:29.291754  3661 raft_consensus.cc:2749] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:29.293426 29421 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:29.294881 29421 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:29.297014  3880 raft_consensus.cc:2749] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:29.299252  3880 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:29.301997 29421 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:29.304499 29421 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:29.305258  3880 raft_consensus.cc:2804] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:29.316020  3880 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:29.316593  3880 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:29.296350  3679 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:29.324102  3679 raft_consensus.cc:2804] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:29.324749  3679 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:29.325233  3679 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:29.331871  3880 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:29.334879  3880 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:29.348057 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 50259.8us
I20260709 13:14:29.349578 29495 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:29.370353 29344 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:14:29.432540 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 60070.4us
I20260709 13:14:29.370337  3634 raft_consensus.cc:2749] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:29.440989 29421 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:29.378895  3878 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:14:29.459987 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 110611us
W20260709 13:14:29.462296 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:29.462272 29495 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:29.463660  3634 raft_consensus.cc:2749] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:29.472419  3878 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:29.472960  3878 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:29.471709  3679 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:29.484772  3864 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:29.485718  3679 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:29.488646 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:29.489377 29527 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:29.487190  3864 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 22 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:29.523430 29527 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 22.
W20260709 13:14:29.524000 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 154825us
I20260709 13:14:29.524947 29344 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:14:29.525645 29421 leader_election.cc:336] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Timed out: RequestConsensusVote RPC to 127.27.146.129:42127 timed out after 2.155s (SENT)
I20260709 13:14:29.525869  3804 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:14:29.526126 29421 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:29.526425  3804 raft_consensus.cc:697] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:29.527263  3922 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:29.528051  3922 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:29.527532  3804 consensus_queue.cc:237] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:29.536731 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 83613.6us
I20260709 13:14:29.537742  3775 raft_consensus.cc:993] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5: : Instructing follower 71aa3578fd924765ab9ac0729c8d1483 to start an election
I20260709 13:14:29.538282  3775 raft_consensus.cc:1081] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Signalling peer 71aa3578fd924765ab9ac0729c8d1483 to start an election
I20260709 13:14:29.540309 29527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47da517282ee462792de545e40119636"
dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
 from {username='slave'} at 127.0.0.1:37968
I20260709 13:14:29.541126 29527 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:29.541549 29527 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:14:29.577368 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:29.578603 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 209073us
W20260709 13:14:29.581542 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 205735us
W20260709 13:14:29.584106 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 96349.7us
I20260709 13:14:29.572870  3864 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:29.589594 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:29.567353  3878 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:29.622586 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:29.622838 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:29.627314 29527 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:29.630487 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:29.630787 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:29.631302 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:29.631982 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:29.632097 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:29.633064 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:29.633919 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:29.634651 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:29.637495 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:29.637822 29381 raft_consensus.cc:2393] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 23: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:29.638396 29380 raft_consensus.cc:2393] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 19: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:29.638548 29373 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 21.
I20260709 13:14:29.643157 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:14:29.644294 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:29.650050 29527 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:29.629372  3763 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:29.617864  3864 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:29.648610 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:29.655229 29379 raft_consensus.cc:1275] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:14:29.636219  3465 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:29.660135  3465 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:29.662428  3465 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:29.664821 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:29.669127 29373 raft_consensus.cc:1240] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:14:29.671725 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:29.672542 29373 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:29.674998 29495 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:29.678885  3878 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:29.679812  3763 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:29.682367  3763 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:29.683578 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:29.684321 29529 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:29.688526 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:29.704367 29375 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:14:29.719696 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 44816.7us
I20260709 13:14:29.725366 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:29.726919 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:14:29.734771 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:29.727656 29452 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 21.
I20260709 13:14:29.739156 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:29.751134 29529 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 21.
I20260709 13:14:29.752898 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:29.753731 29374 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 21.
I20260709 13:14:29.755950 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:29.755333 29344 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:14:29.760085 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 117741us
I20260709 13:14:29.761852 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:29.764895 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:29.766283 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:29.767148 30121 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:29.738555  3679 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:29.768201  3926 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:29.768707  3679 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:29.758996  3922 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:29.771947  3922 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:29.774223  3922 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:29.779925  3683 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:14:29.780609  3683 raft_consensus.cc:697] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:29.781533  3683 consensus_queue.cc:237] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:29.783718 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:29.804574 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:29.755949  3907 raft_consensus.cc:2804] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:14:29.809141  3907 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:29.809597  3907 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:29.814994 29495 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:29.816902 29495 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:29.817626  3790 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:29.818625  3790 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:14:29.754442  3864 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:29.829949 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:29.830271 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:29.830751 29374 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 20.
I20260709 13:14:29.832000 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:29.832878 29376 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 22.
I20260709 13:14:29.839249 29346 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:29.845839 29373 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 20.
I20260709 13:14:29.820220 29495 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:29.771241  3679 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:29.856403 29381 raft_consensus.cc:1275] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:14:29.849428  3804 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:29.865222  3634 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:14:29.866601  3634 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:29.867026  3634 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:14:29.879779 29375 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 17.
I20260709 13:14:29.855399  3881 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:14:29.889176 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 50088.5us
W20260709 13:14:29.891695 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 71560.3us
I20260709 13:14:29.902328 29495 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:29.911816 29346 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:29.912930  3864 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:29.913705 29346 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:29.914732  3930 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:29.915851  3790 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:29.897845  3881 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:29.922576  3881 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:29.928112 29530 raft_consensus.cc:1240] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:29.928375 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:29.930694 29346 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:29.934756  3804 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:29.935935  3804 consensus_queue.cc:1059] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:14:29.938687  3683 raft_consensus.cc:3055] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:14:29.939121  3683 raft_consensus.cc:740] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:29.939973 29346 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:29.940228  3683 consensus_queue.cc:260] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:29.941044  3775 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:29.941022  3907 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:29.941977  3683 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:29.947851 29527 raft_consensus.cc:1275] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:14:29.950098  3864 consensus_queue.cc:1048] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:14:29.951421  3634 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:29.969286 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 70713.1us
I20260709 13:14:29.954627  3634 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 28 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:29.967694  3679 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:29.977489  3679 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:29.981055  3907 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:29.990301  3679 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:29.969441  3930 raft_consensus.cc:2749] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:14:30.006230 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:30.016309  3804 consensus_queue.cc:1059] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:30.018234  3804 raft_consensus.cc:3055] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:14:30.018985  3804 raft_consensus.cc:740] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:30.040268 29495 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:30.059108  3634 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:14:30.059585  3634 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:30.059944  3634 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:14:30.059376  3804 consensus_queue.cc:260] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:30.067879  3928 consensus_queue.cc:1048] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:14:30.018270 29346 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:30.070425 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 52258.3us
I20260709 13:14:30.072227  3928 consensus_queue.cc:1048] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:14:30.073529  3907 consensus_queue.cc:1048] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:30.073594  3936 consensus_queue.cc:1048] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:30.074451  3930 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:30.074939 29530 raft_consensus.cc:1240] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 20. Current term is 21. Ops: []
I20260709 13:14:30.074234 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:30.075246  3804 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:30.075556 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:30.077778 29346 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:30.080646 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:30.082098 29529 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 21.
I20260709 13:14:30.089486 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:30.091382 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:30.092703 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:30.092978 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:30.093791 29522 raft_consensus.cc:1240] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:14:30.094290 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:30.094491 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:30.094851  3864 raft_consensus.cc:2749] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:30.096575 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:30.100510 29346 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:30.102207  3864 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:30.102870  3864 consensus_queue.cc:1059] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:14:30.103551  3679 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:30.103965  3683 raft_consensus.cc:3055] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:14:30.104419  3683 raft_consensus.cc:740] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:30.104116  3679 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:30.105373  3683 consensus_queue.cc:260] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:30.106493  3679 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:30.106772  3683 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:30.109601 29346 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:30.112960  3864 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:30.115962 29346 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:30.116677  3634 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:30.117928 29346 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:30.118804  3864 raft_consensus.cc:2749] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:14:30.119097  3634 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:30.119505  3864 raft_consensus.cc:3060] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:30.122375 29278 catalog_manager.cc:5697] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:30.125964 29346 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:30.127359 29523 raft_consensus.cc:2368] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 23. Current term is 24.
I20260709 13:14:30.132758 29278 catalog_manager.cc:5697] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 17 to 19, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 19 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:30.134526 29278 catalog_manager.cc:5697] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: config changed from index -1 to 11, term changed from 17 to 19, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New cstate: current_term: 19 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:30.137301 29278 catalog_manager.cc:5697] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 14 to 18, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 18 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:30.140230 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:30.141276 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:30.132019 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:30.140926 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:30.140597 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:30.142904 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:30.139073 29275 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37608 (request call id 158) took 21940 ms (client timeout 15000 ms). Trace:
I20260709 13:14:30.143631 29522 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 21.
I20260709 13:14:30.145579 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:30.146341 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:30.147735 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:30.147123 29523 raft_consensus.cc:1275] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:14:30.147550 29521 raft_consensus.cc:1275] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:14:30.147423 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:30.148522 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:30.139951 29278 catalog_manager.cc:5697] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 17 to 18, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 18 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:30.153476 29278 catalog_manager.cc:5697] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
W20260709 13:14:30.143508 29275 rpcz_store.cc:269] 0709 13:14:08.203857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:08.204090 (+   233us) service_pool.cc:224] Handling call
0709 13:14:30.138952 (+21934862us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:29.434146 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:29.434999 (+   853us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:29.435049 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:14:29.435078 (+    29us) tablet.cc:662] Decoding operations
0709 13:14:29.436269 (+  1191us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:29.436381 (+   112us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:29.436411 (+    30us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:14:29.437350 (+   939us) tablet.cc:701] Row locks acquired
0709 13:14:29.437398 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:14:29.437583 (+   185us) write_op.cc:270] Start()
0709 13:14:29.437749 (+   166us) write_op.cc:276] Timestamp: P: 1783602869437505 usec, L: 0
0709 13:14:29.437772 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:14:29.438633 (+   861us) log.cc:844] Serialized 4064 byte log entry
0709 13:14:29.910964 (+472331us) op_driver.cc:464] REPLICATION: finished
0709 13:14:29.989345 (+ 78381us) write_op.cc:301] APPLY: starting
0709 13:14:29.989470 (+   125us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:29.999187 (+  9717us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:29.999313 (+   126us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:30.006145 (+  6832us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:30.006606 (+   461us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 13:14:30.006666 (+    60us) write_op.cc:312] APPLY: finished
0709 13:14:30.007114 (+   448us) log.cc:844] Serialized 97 byte log entry
0709 13:14:30.008261 (+  1147us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:30.008446 (+   185us) write_op.cc:454] Released schema lock
0709 13:14:30.008564 (+   118us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:30.009168 (+   604us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:30.009222 (+    54us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":867832,"reported_tablets":56,"child_traces":[["op",{"apply.queue_time_us":77985,"apply.run_cpu_time_us":17401,"apply.run_wall_time_us":19787,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45847,"num_ops":10,"prepare.queue_time_us":149889,"prepare.run_cpu_time_us":12637,"prepare.run_wall_time_us":149627,"raft.queue_time_us":98479,"raft.run_cpu_time_us":13580,"raft.run_wall_time_us":65466,"replication_time_us":466950,"thread_start_us":354658,"threads_started":4,"wal-append.queue_time_us":157477}]]}
I20260709 13:14:30.163797 29278 catalog_manager.cc:5697] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 16 to 19, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 19 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:30.168641 29278 catalog_manager.cc:5697] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:30.172194  3864 raft_consensus.cc:2749] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:30.176666  3679 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:30.177500  3679 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:30.178503 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:30.176781 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:30.181541  3679 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:30.182441  3465 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:14:30.186319 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 60435us
I20260709 13:14:30.188144 29522 raft_consensus.cc:1240] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 28 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 27. Current term is 28. Ops: []
I20260709 13:14:30.190366 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:30.190671 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:30.191161 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:30.191886 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:30.201196 29346 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:30.192569 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:30.191547 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:30.193005 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:30.202415 29523 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 21.
I20260709 13:14:30.194124 29278 catalog_manager.cc:5697] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 18 to 21, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 21 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:30.203929  3930 raft_consensus.cc:2749] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:14:30.202720 29346 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:30.203987 29278 catalog_manager.cc:5697] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:30.205224  3465 raft_consensus.cc:2749] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:30.206489 29346 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:30.207233  3465 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:30.208940 29346 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:30.225157 29529 raft_consensus.cc:1275] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:14:30.227929  3634 consensus_queue.cc:1048] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:14:30.235746  3936 consensus_queue.cc:1059] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:14:30.247109  3936 raft_consensus.cc:3055] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:14:30.247587  3936 raft_consensus.cc:740] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:30.248931  3936 consensus_queue.cc:260] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:30.251441  3936 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:30.258291  3804 consensus_queue.cc:1048] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:30.237111 29495 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:30.261327  3634 raft_consensus.cc:2764] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:14:30.269047  3804 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:14:30.272298 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 63420.1us
I20260709 13:14:30.275846 29346 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:30.294704  3804 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:14:30.274333 29495 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:30.295317 29346 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:30.307243  3804 raft_consensus.cc:2749] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:30.309182 29346 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:30.314281  3634 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:14:30.324041  3634 raft_consensus.cc:697] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:30.325070  3634 consensus_queue.cc:237] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:30.315037  3907 consensus_queue.cc:1059] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:14:30.328255  3907 raft_consensus.cc:3055] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:14:30.328641  3907 raft_consensus.cc:740] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:30.329819  3679 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:30.329627  3907 consensus_queue.cc:260] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:30.330504  3679 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:30.334295  3679 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:30.336369  3907 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:30.319737 29495 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:30.348814  3938 raft_consensus.cc:2749] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:30.351733  3804 raft_consensus.cc:2749] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:30.360631 29346 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:30.367902 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 48259.7us
I20260709 13:14:30.366852  3465 raft_consensus.cc:2749] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:30.371739 29421 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:30.373355 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:30.374769 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:30.375169 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:30.376282 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:30.376833 29449 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:30.377101 29452 raft_consensus.cc:2393] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 20: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:30.377236 29421 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:30.376835 29456 raft_consensus.cc:2393] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 16: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:30.378188  3679 raft_consensus.cc:2749] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:30.380326 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:30.389029 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:30.389264  3938 consensus_queue.cc:1048] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:14:30.390002 29448 raft_consensus.cc:2393] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 17: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:30.391090 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:30.391804 29452 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:14:30.402679 29449 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 22.
I20260709 13:14:30.408255 29453 raft_consensus.cc:1275] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:14:30.408823  3928 consensus_queue.cc:1059] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:14:30.410544  3907 raft_consensus.cc:3055] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:14:30.410950  3907 raft_consensus.cc:740] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:30.411737  3790 consensus_queue.cc:1048] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:30.411845  3907 consensus_queue.cc:260] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:30.413987  3907 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:30.415874  3928 consensus_queue.cc:1048] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:14:30.418978  3928 consensus_queue.cc:1059] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:14:30.420022  3790 raft_consensus.cc:3055] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:30.420449  3790 raft_consensus.cc:740] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:30.421370  3790 consensus_queue.cc:260] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:30.424292  3864 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:30.424711  3804 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:30.424988  3465 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:30.424943  3864 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:30.425360  3804 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:30.425895  3790 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:30.425680  3465 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:30.427973  3465 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:30.429318 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:30.430081 29527 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 21.
I20260709 13:14:30.430806 29378 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:14:30.431123 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:30.431394 29378 raft_consensus.cc:606] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:30.431558  3864 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:30.429687 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:30.434290 29344 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:30.435426  3864 raft_consensus.cc:2804] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:14:30.436007  3864 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:30.437526 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:30.439067 29378 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 17.
I20260709 13:14:30.440732 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:30.442209 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:30.443606 29447 raft_consensus.cc:3055] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:14:30.444144 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:30.444031 29447 raft_consensus.cc:740] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:30.441334 29378 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 16.
I20260709 13:14:30.445920 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:30.446770 29453 raft_consensus.cc:1240] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 19. Current term is 20. Ops: []
I20260709 13:14:30.447947 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:30.428172  3804 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:30.451628 29378 raft_consensus.cc:1275] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:14:30.452104 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 74961.5us
I20260709 13:14:30.453104 29373 raft_consensus.cc:1240] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 19. Current term is 20. Ops: []
I20260709 13:14:30.449501 29447 consensus_queue.cc:260] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:30.453934 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:30.453912 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:30.454671 29456 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:30.454773 29447 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:30.456403 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:30.456799 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:30.457070 29380 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 19.
I20260709 13:14:30.457391 29375 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 18.
W20260709 13:14:30.457935  3679 consensus_queue.cc:1175] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "71aa3578fd924765ab9ac0729c8d1483" responder_term: 21 status { last_received { term: 17 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 20. Current term is 21. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:14:30.458822 29381 raft_consensus.cc:1275] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:14:30.445832  3864 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:30.474552  3864 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:30.477636  3864 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 22 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:30.479204 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:30.479964 29523 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:30.485924 29447 raft_consensus.cc:1275] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 13. (term mismatch)
I20260709 13:14:30.486788 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:30.489042 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:30.492441 29449 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:14:30.490599 29375 raft_consensus.cc:1240] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 16. Current term is 17. Ops: []
I20260709 13:14:30.492622 29447 pending_rounds.cc:85] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 12
I20260709 13:14:30.495144 29447 pending_rounds.cc:107] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 13:14:30.495430 29447 raft_consensus.cc:2889] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:30.497813  3679 consensus_queue.cc:1048] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:14:30.500489 29421 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:30.508260 29523 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 22.
I20260709 13:14:30.513624 29381 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
I20260709 13:14:30.512061 29456 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
I20260709 13:14:30.513820 29344 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:30.518935  3864 raft_consensus.cc:2804] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:14:30.519547  3864 raft_consensus.cc:697] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:30.520514  3864 consensus_queue.cc:237] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:30.523865 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:30.524605 29451 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 19.
I20260709 13:14:30.516183 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:30.511135 29449 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 24.
I20260709 13:14:30.540894 29495 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:30.544225 29421 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:30.546764 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:30.546510  3679 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:14:30.576241 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:30.578881 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:30.580376 29378 raft_consensus.cc:3060] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:14:30.552290  3907 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:30.606801 29495 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:30.564579  3679 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:30.626556 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:30.648650 29447 raft_consensus.cc:1240] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 16. Current term is 17. Ops: []
I20260709 13:14:30.649142 29450 raft_consensus.cc:1240] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:30.650374 29448 raft_consensus.cc:1275] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:14:30.660321 29419 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:30.620999  3936 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:14:30.630319  3679 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:30.662595 29276 catalog_manager.cc:5697] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 19 to 20, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 20 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:30.611263  3928 consensus_queue.cc:1059] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
W20260709 13:14:30.678050 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:30.727756 29276 catalog_manager.cc:5697] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 15 to 20. New cstate: current_term: 20 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:30.730235 29276 catalog_manager.cc:5697] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:30.731949 29380 raft_consensus.cc:1240] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 19. Current term is 20. Ops: []
W20260709 13:14:30.735936 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 75898us
I20260709 13:14:30.736894 29419 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:30.672727  3945 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:30.746119 29276 catalog_manager.cc:5697] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 20 to 21, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 21 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:30.757438 29276 catalog_manager.cc:5697] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 25 to 27, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 27 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:30.759869 29276 catalog_manager.cc:5697] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:30.762002 29276 catalog_manager.cc:5697] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 15 to 16, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 16 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:30.677186  3936 raft_consensus.cc:697] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:30.764410 29276 catalog_manager.cc:5697] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:30.768091 29276 catalog_manager.cc:5697] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:30.781857 29346 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:30.775466 29276 catalog_manager.cc:5697] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 19 to 20, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 20 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:30.785856 29276 catalog_manager.cc:5697] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 19 to 20, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 20 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:30.798607 29419 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:30.792285 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:30.825246 29278 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37586 (request call id 140) took 11568 ms (client timeout 15000 ms). Trace:
I20260709 13:14:30.774655  3952 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:30.775148  3958 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:30.779320  3953 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:30.819439  3864 raft_consensus.cc:2749] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:30.767225  3945 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:14:30.826572 29278 rpcz_store.cc:269] 0709 13:14:19.256707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:19.258016 (+  1309us) service_pool.cc:224] Handling call
0709 13:14:30.825137 (+11567121us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:30.285192 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:30.285784 (+   592us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:30.285820 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:14:30.285838 (+    18us) tablet.cc:662] Decoding operations
0709 13:14:30.287329 (+  1491us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:30.287419 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:30.287454 (+    35us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:14:30.288314 (+   860us) tablet.cc:701] Row locks acquired
0709 13:14:30.288334 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:14:30.288487 (+   153us) write_op.cc:270] Start()
0709 13:14:30.288713 (+   226us) write_op.cc:276] Timestamp: P: 1783602870288436 usec, L: 0
0709 13:14:30.288740 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:14:30.289680 (+   940us) log.cc:844] Serialized 4119 byte log entry
0709 13:14:30.355826 (+ 66146us) op_driver.cc:464] REPLICATION: finished
0709 13:14:30.360275 (+  4449us) write_op.cc:301] APPLY: starting
0709 13:14:30.361176 (+   901us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:30.415840 (+ 54664us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:30.415942 (+   102us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:30.521764 (+105822us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:30.521999 (+   235us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 13:14:30.522046 (+    47us) write_op.cc:312] APPLY: finished
0709 13:14:30.522508 (+   462us) log.cc:844] Serialized 97 byte log entry
0709 13:14:30.546660 (+ 24152us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:30.552197 (+  5537us) write_op.cc:454] Released schema lock
0709 13:14:30.555721 (+  3524us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:30.629285 (+ 73564us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:30.640758 (+ 11473us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":12368,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":1256,"apply.run_cpu_time_us":15651,"apply.run_wall_time_us":223412,"cfile_cache_hit":40,"cfile_cache_hit_bytes":41720,"num_ops":10,"prepare.queue_time_us":72535,"prepare.run_cpu_time_us":4684,"prepare.run_wall_time_us":64541,"replication_time_us":66893,"thread_start_us":72231,"threads_started":1}]]}
I20260709 13:14:30.823999  3962 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:14:30.920863 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 376715us
I20260709 13:14:30.920768  3962 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:30.921764 29421 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:30.826022  3963 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:14:30.926155  3948 log.cc:927] Time spent T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
W20260709 13:14:30.913715  3949 log.cc:927] Time spent T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
W20260709 13:14:30.928517 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 142541us
I20260709 13:14:30.938668 29346 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:30.928402  3958 raft_consensus.cc:2749] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:14:30.951656 29277 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35182 (request call id 76) took 14124 ms (client timeout 15000 ms). Trace:
W20260709 13:14:30.952101 29277 rpcz_store.cc:269] 0709 13:14:16.827171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:16.827405 (+   234us) service_pool.cc:224] Handling call
0709 13:14:16.966877 (+139472us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b5400002490. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61b71 00007f6a78c620b2 00007f6a81bdba89 00007f6a81b73da6 00007f6a81b45088 00007f6a81c4337e 00007f6a801042a4 00007f6a80104232 00007f6a80104161 00007f6a801040dc
0709 13:14:30.951403 (+13984526us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52916,"reported_tablets":10,"spinlock_wait_cycles":26144128}
I20260709 13:14:30.954919 29346 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:30.955719  3465 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:30.955577 29276 catalog_manager.cc:5697] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 17 to 18, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 18 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:30.956918 29276 catalog_manager.cc:5697] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 20 to 22, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 22 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
W20260709 13:14:30.958482  3964 log.cc:927] Time spent T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:14:30.958281 29276 catalog_manager.cc:5697] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 18 to 25. New cstate: current_term: 25 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:30.959676 29346 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:30.907312  3952 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:30.962596 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:30.965020 29276 catalog_manager.cc:5697] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 18 to 20, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 20 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:30.970009 29276 catalog_manager.cc:5697] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 21 to 22, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 22 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:30.909369  3936 consensus_queue.cc:237] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:30.948750  3963 consensus_queue.cc:1059] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:14:30.950456  3938 raft_consensus.cc:3055] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:14:30.974931 29276 catalog_manager.cc:5697] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: config changed from index 11 to 13, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:30.913301  3953 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:30.980053  3950 log.cc:927] Time spent T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
I20260709 13:14:30.981168  3951 raft_consensus.cc:2749] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:14:30.986217 29378 raft_consensus.cc:2468] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 24.
I20260709 13:14:30.968063  3465 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:30.966064  3804 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:30.994213 29276 catalog_manager.cc:5697] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
W20260709 13:14:31.011421 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 89750.1us
I20260709 13:14:30.993659  3930 consensus_queue.cc:1048] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.022s
W20260709 13:14:31.018996 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 220476us
W20260709 13:14:31.019685 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 409707us
I20260709 13:14:31.016672  3465 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:31.027786  3465 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:31.031838  3967 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:14:31.037163  3953 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:31.039902  3947 log.cc:927] Time spent T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 13:14:31.056012  3952 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:31.061726  3945 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:30.983381  3938 raft_consensus.cc:740] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
W20260709 13:14:31.063241 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 51965.4us
I20260709 13:14:31.022935 29276 catalog_manager.cc:5697] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:31.022419 29421 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:14:31.065928 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 43580.4us
W20260709 13:14:31.067595 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 110221us
I20260709 13:14:31.066455 29421 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:31.073312 29276 catalog_manager.cc:5697] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 18 to 21. New cstate: current_term: 21 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:31.074102 29421 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:31.070811 29495 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:31.081765 29276 catalog_manager.cc:5697] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 13 to 14, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 14 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:31.086539 29419 leader_election.cc:400] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 23. Current term is 24.
I20260709 13:14:31.021210  3962 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:31.095322 29419 leader_election.cc:403] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
W20260709 13:14:31.096364 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 124919us
I20260709 13:14:31.098127 29421 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:31.078348  3953 raft_consensus.cc:2804] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:14:31.108147  3938 consensus_queue.cc:260] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:31.109782  3938 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:31.109606  3679 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:31.096307  3952 raft_consensus.cc:2804] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:14:31.125224  3945 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:14:31.144351  3679 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:31.095232  3951 consensus_queue.cc:1048] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:14:31.161218  3679 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:31.161949  3679 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:31.125448  3960 consensus_queue.cc:1059] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:14:31.127610  3978 raft_consensus.cc:2749] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 23. Current term is 24.
I20260709 13:14:31.168408  3946 raft_consensus.cc:3055] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:14:31.168946  3946 raft_consensus.cc:740] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:31.170313  3679 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:31.170065  3946 consensus_queue.cc:260] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:31.173025  3465 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:31.175470  3465 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:31.179008  3977 raft_consensus.cc:2804] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:31.179600  3977 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:31.179967  3977 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:31.184255  3958 raft_consensus.cc:3055] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:14:31.184764  3979 raft_consensus.cc:2804] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:14:31.185907  3979 raft_consensus.cc:697] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:31.184844  3958 raft_consensus.cc:740] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:31.141801 29421 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:14:31.189124 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 47466us
I20260709 13:14:31.189977 29421 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:14:31.184242  3976 log.cc:927] Time spent T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:14:31.211001 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 185933us
I20260709 13:14:31.214380 29419 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:31.209442  3679 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:31.215847  3679 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:31.216248  3679 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:31.186903  3979 consensus_queue.cc:237] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:31.230080 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:31.207652  3951 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:31.235436 29419 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:31.237017 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 144485us
I20260709 13:14:31.236678  3951 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:31.242045  3951 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:31.244577  3683 raft_consensus.cc:993] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5: : Instructing follower 183db85c071f489fbc8de63a9edd8a3a to start an election
I20260709 13:14:31.245244  3683 raft_consensus.cc:1081] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Signalling peer 183db85c071f489fbc8de63a9edd8a3a to start an election
I20260709 13:14:31.252957  3945 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:31.253584  3945 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:31.255808  3967 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:31.256624  3967 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:31.207731  3952 raft_consensus.cc:697] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 17 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:31.209573  3953 raft_consensus.cc:697] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 20 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:31.271708 29523 raft_consensus.cc:1275] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:14:31.188189  3958 consensus_queue.cc:260] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:31.276054 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:31.277197 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:31.278127 29419 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:31.278759 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:31.279431 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:31.280655 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:31.281201 29378 raft_consensus.cc:1240] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 13:14:31.281293 29380 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:31.282117  3982 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:14:31.282518 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:31.285254  3987 raft_consensus.cc:2749] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:31.286728  3946 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:31.288810 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:31.291162 29419 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:31.293555 29419 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:31.294751  3986 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:31.295620  3986 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:31.296057  3982 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:14:31.281103  3958 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:31.300760 29380 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 22.
I20260709 13:14:31.295228 29419 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:31.305404 29380 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "71aa3578fd924765ab9ac0729c8d1483"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:14:31.306216 29380 raft_consensus.cc:606] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Received request to transfer leadership to TS 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:31.307039 29380 raft_consensus.cc:614] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:31.308343 29421 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:14:31.316140 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:31.318382 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 43783.1us
I20260709 13:14:31.319747 29419 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:31.321409 29419 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:31.266516  3634 consensus_queue.cc:1048] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:14:31.274484  3928 consensus_queue.cc:1059] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:14:31.325050  3986 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:14:31.333715  3982 raft_consensus.cc:2749] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:31.324689  3963 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:14:31.324900  3978 consensus_queue.cc:1048] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
W20260709 13:14:31.360294 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:31.314321  3987 consensus_queue.cc:1059] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:14:31.337270  3683 consensus_queue.cc:1048] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:14:31.392891 29380 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "71aa3578fd924765ab9ac0729c8d1483"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:14:31.397392 29380 raft_consensus.cc:606] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Received request to transfer leadership to TS 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:31.380899  3982 raft_consensus.cc:2749] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:14:31.432196 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:31.365864  3953 consensus_queue.cc:237] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:31.433616 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 112297us
W20260709 13:14:31.421480 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 49745.4us
I20260709 13:14:31.372292  3952 consensus_queue.cc:237] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:31.448196 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:31.448348  3986 raft_consensus.cc:697] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 22 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
W20260709 13:14:31.458809  3989 log.cc:927] Time spent T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:14:31.495777 29375 raft_consensus.cc:1275] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:14:31.497380 29456 raft_consensus.cc:1275] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:14:31.499712 29419 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:31.466913  3864 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.434612  3679 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:31.521863  3679 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:31.503752  3951 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:31.522867 29454 raft_consensus.cc:1240] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 19. Current term is 20. Ops: []
I20260709 13:14:31.523222  3864 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:31.537042  3938 raft_consensus.cc:3055] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:14:31.537632  3938 raft_consensus.cc:740] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:31.539752  3993 consensus_queue.cc:1059] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 27.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.042s
I20260709 13:14:31.540964  3993 raft_consensus.cc:3055] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:14:31.541363  3993 raft_consensus.cc:740] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:31.542313  3993 consensus_queue.cc:260] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 27.14, Last appended by leader: 14, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:31.545223  3986 consensus_queue.cc:237] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:31.545774  3960 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.546492  3634 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.556543  3634 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:31.559070  3634 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:31.538769  3938 consensus_queue.cc:260] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:31.554162 29419 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:31.515440  3982 raft_consensus.cc:2749] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:14:31.590740 29495 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:31.539225  3864 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:31.585427 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:14:31.622814 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 68836.9us
I20260709 13:14:31.625514 29419 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:31.568722  3960 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:31.624742  3987 consensus_queue.cc:1243] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer 429e58eb058349e3bf72b5a870c8f6e5 log is divergent from this leader: its last log entry 22.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:14:31.665706  3960 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:31.666534  3963 raft_consensus.cc:3055] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:14:31.666944  3963 raft_consensus.cc:740] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:31.667073  3634 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:31.654556  3977 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:31.610420  3953 raft_consensus.cc:2749] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:31.619961  3993 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 27 FOLLOWER]: Advancing to term 28
W20260709 13:14:31.681702 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 91068.2us
I20260709 13:14:31.680230  3978 raft_consensus.cc:2749] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:31.679564 29375 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "71aa3578fd924765ab9ac0729c8d1483"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:14:31.623662  3938 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:31.690145 29375 raft_consensus.cc:606] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Received request to transfer leadership to TS 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:31.699744 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 74350us
I20260709 13:14:31.701105 29419 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:31.667968  3963 consensus_queue.cc:260] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:31.694481 29495 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
W20260709 13:14:31.711673 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:31.712606  3984 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:31.709177  3953 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:31.713272  3984 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:31.713678  3953 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:31.715912  3953 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:31.716835  3946 raft_consensus.cc:2804] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:31.717285  3946 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:31.717645  3946 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:31.719151 29419 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:31.720297  3978 raft_consensus.cc:2749] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:31.721150  3978 raft_consensus.cc:2749] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:14:31.724504 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:31.726315 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:31.658253  3967 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:31.730078 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:31.737771 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:31.738507 29451 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 24.
I20260709 13:14:31.688674  3945 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:31.748914 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 56031.2us
W20260709 13:14:31.761752 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 78838.9us
I20260709 13:14:31.735168  3963 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:31.765035 29449 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf"
dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:45798
I20260709 13:14:31.767123 29449 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:31.767571 29449 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:31.758100  3683 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.792547  3683 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:31.793732  3997 log.cc:927] Time spent T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:14:31.772305  3790 consensus_queue.cc:1048] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:14:31.755457  3984 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:31.808964  3967 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:31.727418  3962 consensus_queue.cc:1175] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "71aa3578fd924765ab9ac0729c8d1483" responder_term: 21 status { last_received { term: 18 index: 12 } last_committed_idx: 12 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:14:31.789587 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:31.810436 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:31.812446 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:14:31.816596 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:31.816111 29521 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 22.
W20260709 13:14:31.832331 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 63698.5us
I20260709 13:14:31.842185  3790 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.827781 29449 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:31.844261 29450 raft_consensus.cc:1240] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:31.835081 29495 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:31.853214 29495 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:31.811663  3951 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:31.859333 29449 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:31.858958  3928 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:14:31.866925 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:14:31.869336 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:31.881035 28234 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:14:31.889145 29456 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 23.
I20260709 13:14:31.889658  3967 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:31.831720  4008 consensus_queue.cc:1048] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:14:31.885634  3985 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 13:14:31.903795 28234 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:31.915155 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:31.915961 29453 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 20.
I20260709 13:14:31.920125 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:31.852187  3790 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:31.911212  3967 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:31.926337  3967 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:31.927060  3977 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:31.931915  3790 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:31.938050 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:31.939131 29451 raft_consensus.cc:2393] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 21: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:31.952112 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
W20260709 13:14:31.952983  4005 log.cc:927] Time spent T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b: Append to log took a long time: real 0.103s	user 0.000s	sys 0.003s
I20260709 13:14:31.947886  3945 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:31.957144 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
W20260709 13:14:31.973649 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 184823us
I20260709 13:14:31.977154  3683 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:31.977916  3969 raft_consensus.cc:993] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5: : Instructing follower 71aa3578fd924765ab9ac0729c8d1483 to start an election
I20260709 13:14:31.978648  3969 raft_consensus.cc:1081] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Signalling peer 71aa3578fd924765ab9ac0729c8d1483 to start an election
I20260709 13:14:31.980777 29346 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:31.980963  3465 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:31.981465  3465 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:31.982613 29346 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:31.983747  3974 consensus_queue.cc:1048] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:14:31.985147 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:31.982965  3930 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:31.993350 29521 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 21.
I20260709 13:14:31.985126  3804 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:14:31.996824  3804 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:31.997346  3804 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:14:31.997910 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:31.998700 29524 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 20.
I20260709 13:14:31.993909  3930 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:32.000036  3930 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:32.001473  3465 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:32.003997 29454 raft_consensus.cc:2410] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 22 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
I20260709 13:14:31.950042  3986 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:32.004622  3986 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:32.007093 29452 raft_consensus.cc:1275] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 14. (term mismatch)
I20260709 13:14:32.007665 29452 pending_rounds.cc:85] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 13
I20260709 13:14:32.007898 29452 pending_rounds.cc:107] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 21.14
I20260709 13:14:32.008126 29452 raft_consensus.cc:2889] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:32.012008 29346 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:31.953521  3946 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:31.995950  3683 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:32.016091  3683 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:32.017608  3946 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:32.018663  3683 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:32.020143  3804 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:32.023139  3963 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.023840  3963 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:32.025765  3804 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 25 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:32.027766 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 50110us
I20260709 13:14:32.007228  3986 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:32.031280  3683 raft_consensus.cc:993] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5: : Instructing follower 71aa3578fd924765ab9ac0729c8d1483 to start an election
I20260709 13:14:32.032281  3683 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:14:32.033317  3864 raft_consensus.cc:1081] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Signalling peer 71aa3578fd924765ab9ac0729c8d1483 to start an election
I20260709 13:14:32.031188 29344 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:32.042040  3974 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:14:32.042515  3974 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:32.042973  3974 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:14:32.045009  3980 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:32.045746  3980 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:32.037458 29419 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:32.039093  3679 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:14:32.040591 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 89540.7us
I20260709 13:14:32.048969 29344 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:32.054116 29452 raft_consensus.cc:1240] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 22. Current term is 23. Ops: []
I20260709 13:14:32.062458 29452 raft_consensus.cc:1240] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 17. Current term is 18. Ops: []
I20260709 13:14:32.062351 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:32.050132 29344 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:32.064271 29450 raft_consensus.cc:1240] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 16. Current term is 17. Ops: []
I20260709 13:14:32.063999 29454 raft_consensus.cc:1240] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 20. Current term is 21. Ops: []
I20260709 13:14:32.067613  3967 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:32.068246  3967 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:32.066310  3946 consensus_queue.cc:1048] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:14:32.063963 29455 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 20.
I20260709 13:14:32.029114  3963 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:32.073611 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:32.076825 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:32.077466 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:32.078807  3804 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:14:32.066136  3679 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:32.081700  3804 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:32.082206  3804 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:32.083901  3679 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:32.071682  3962 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.084817  3962 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:32.085979 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:32.071394  3683 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:14:32.087045  3962 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:32.127671 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:32.125842 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:32.118234 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:32.131569 29453 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:14:32.131749 29449 raft_consensus.cc:2393] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 18: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:32.105109 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:32.132279 29379 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:32.145076 29381 raft_consensus.cc:1275] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:14:32.087842 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:32.110800 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:32.147264 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:32.147553 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:32.094789 29525 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7"
dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
 from {username='slave'} at 127.0.0.1:37968
I20260709 13:14:32.148355 29525 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:32.148737 29525 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:32.104974 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:32.149673 29380 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:32.105490 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:32.152297 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:32.152673 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:32.153749 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:32.094995  3984 consensus_queue.cc:1048] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.060s
I20260709 13:14:32.155294 29527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5"
dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
 from {username='slave'} at 127.0.0.1:37968
I20260709 13:14:32.155895  3465 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:32.145185  3946 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.094695  3983 consensus_queue.cc:1059] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:14:32.157406 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:32.158020  3864 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:32.158733 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:32.158627  3864 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:32.160787  3864 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:32.161023  3974 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:32.162489  3967 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:32.165254 29448 raft_consensus.cc:1275] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:14:32.161470 29374 raft_consensus.cc:1275] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:14:32.166464  3962 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:32.155921 29527 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:32.158164 29530 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:32.168987 29527 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:32.156492  3465 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:32.065690  3945 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:32.147650 29378 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 19.
I20260709 13:14:32.175988 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:32.181238 29449 raft_consensus.cc:2393] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 18: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:32.176838 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:32.182106 29455 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 21.
I20260709 13:14:32.183712 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:32.183914 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:32.197754 29454 raft_consensus.cc:1275] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:14:32.163268  3974 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 24 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:32.198005 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:32.199067 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:32.199404 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:32.080606  3634 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.167029  3962 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:32.204288 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:32.087388  3683 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:32.200307 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:32.201917 29375 raft_consensus.cc:3055] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:32.206864 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:32.207415 29375 raft_consensus.cc:740] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:32.096433  3980 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:32.209599 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:32.183653  3967 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:32.208645 29375 consensus_queue.cc:260] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:32.074766  3930 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:32.212829 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:32.213809  3465 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:32.213734 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:32.214996 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:32.156566  3946 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:32.227630 29380 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 23.
I20260709 13:14:32.233224 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:32.229935 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:32.235352 29524 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:32.230008 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:32.202945  3864 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:32.251729 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:32.210309  3683 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:32.256469 29528 raft_consensus.cc:1275] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:14:32.252602 29529 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:14:32.228430  3968 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.264802 29522 raft_consensus.cc:1275] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:14:32.216148  3974 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:32.262238 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:32.228653  3980 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:32.210172  3634 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:32.237056  3984 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.221356  3804 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:32.259559  3465 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:32.234889  3967 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:32.257634  3864 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:32.268663  3968 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:32.293376  3968 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:32.294086  3864 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:32.277470  3984 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:32.298734 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:32.302476 29527 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:32.270864  3974 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:32.311295 29529 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 24.
I20260709 13:14:32.300899  3634 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:32.280936  3465 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:32.322156  3465 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:32.300956  3967 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:32.326440 29524 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 15.
I20260709 13:14:32.328735 29379 raft_consensus.cc:2468] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 18.
I20260709 13:14:32.329797  3804 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:32.274784  3980 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:32.356194 29453 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 25.
W20260709 13:14:32.359650 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 49671.9us
I20260709 13:14:32.363416 29527 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:32.359622 29525 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:32.369320 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:32.370267 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:32.384095  3930 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:32.392928  3980 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:32.365971  3979 consensus_queue.cc:1048] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.074s
I20260709 13:14:32.456771 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:32.452562 29375 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:32.400153 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:32.462445 29526 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:14:32.467540 29530 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 22.
I20260709 13:14:32.467891 29525 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:32.472738 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:32.473637 29529 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:32.473570 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:32.474472 29379 raft_consensus.cc:2393] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 21: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:32.475066 29376 raft_consensus.cc:1275] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:14:32.475090 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:32.478503 29380 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
I20260709 13:14:32.443327  3984 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:32.442215  3974 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:32.423192  3962 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:32.490921 29379 raft_consensus.cc:1240] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 22. Current term is 23. Ops: []
I20260709 13:14:32.492583 29529 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 21.
I20260709 13:14:32.493709 29377 raft_consensus.cc:1240] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 19. Current term is 20. Ops: []
W20260709 13:14:32.494481 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 119993us
I20260709 13:14:32.481209 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:32.496233 29372 raft_consensus.cc:1275] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:14:32.496330 29373 raft_consensus.cc:1240] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 17. Current term is 18. Ops: []
I20260709 13:14:32.496981 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:32.476368  3930 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:32.549521  3790 consensus_queue.cc:1059] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:14:32.550925  3790 consensus_queue.cc:1059] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:14:32.553464  3938 raft_consensus.cc:3055] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:14:32.554911  3938 raft_consensus.cc:740] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:32.556106  3938 consensus_queue.cc:260] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:32.557370  3938 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:32.553704  3634 consensus_queue.cc:1059] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:14:32.550371  3683 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:32.554930  3936 consensus_queue.cc:1059] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:14:32.577725 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:32.586331 29454 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:14:32.579205 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:32.576908 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:32.587289 29421 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:32.587186 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:32.590197 29380 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 21.
I20260709 13:14:32.593386  3683 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:32.476069  4002 consensus_queue.cc:1059] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.098s
W20260709 13:14:32.598716 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 62022.5us
I20260709 13:14:32.612679 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:32.614085 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:32.563536  3946 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:32.623198 29455 raft_consensus.cc:2393] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 17: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:32.625774 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:32.626542 29448 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:32.632758 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:32.633723 29452 raft_consensus.cc:2393] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 20: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:32.634559 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:32.635306 29452 raft_consensus.cc:2393] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 21: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:32.636176 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:32.636701 29452 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 23.
I20260709 13:14:32.634933 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:32.649371 29346 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:32.659070 29381 raft_consensus.cc:1275] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:14:32.661223 29451 raft_consensus.cc:1240] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:32.665102 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:32.607712  3979 raft_consensus.cc:3055] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:14:32.572899  3930 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:32.650102 29344 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:32.571566  3962 consensus_queue.cc:1048] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.051s
W20260709 13:14:32.665005 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 112038us
I20260709 13:14:32.676754 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:32.619289  3967 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:32.674903 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:32.663195  3980 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:32.685449 29375 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 15.
W20260709 13:14:32.688310 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 101134us
I20260709 13:14:32.686996 29373 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 21.
I20260709 13:14:32.693290 29448 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 21.
I20260709 13:14:32.608460  3945 consensus_queue.cc:1048] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 13:14:32.662588  4025 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:32.672936  4022 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:14:32.698339 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 48329.9us
I20260709 13:14:32.682950  4023 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:32.696550  3974 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:14:32.682086  4002 raft_consensus.cc:3055] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:14:32.703806 29421 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:32.709975 29344 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:32.689265 29495 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:32.674852  3979 raft_consensus.cc:740] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:32.723718 29421 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:14:32.705049  3983 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:14:32.701923  4031 raft_consensus.cc:3055] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:14:32.724849 29421 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:32.732254  3967 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:14:32.731987  3963 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:32.719839  4002 raft_consensus.cc:740] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:32.727732  3878 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:32.703615  3980 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:32.732275  4031 raft_consensus.cc:740] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:32.713330  4025 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:32.716224  4022 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:32.777693 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:32.766987  3963 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:32.782663  3963 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:32.785944  3946 raft_consensus.cc:3055] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:14:32.786525  3946 raft_consensus.cc:740] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:32.722200  4023 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:32.820870 29372 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 18.
W20260709 13:14:32.810204  4027 log.cc:927] Time spent T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.192s	user 0.000s	sys 0.002s
I20260709 13:14:32.832295  3864 raft_consensus.cc:2749] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:32.794090  3963 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:32.842329  4029 log.cc:927] Time spent T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:14:32.843632  3963 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:32.805636  4025 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:32.809029  3991 raft_consensus.cc:2764] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:14:32.846817  4023 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:32.826778  4002 consensus_queue.cc:260] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:32.857012  4002 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:32.837308  4026 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.860106  4026 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:32.860924  4022 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:32.803222  3946 consensus_queue.cc:260] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:32.862528 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 137766us
I20260709 13:14:32.862872  3946 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:32.866724  3962 raft_consensus.cc:2804] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:14:32.867362  3962 raft_consensus.cc:697] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 18 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:32.868420  3962 consensus_queue.cc:237] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:32.794112  4031 consensus_queue.cc:260] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:32.870329  3945 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.870924  3945 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:32.875396  4036 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:32.876101  4036 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:32.878521  4036 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:32.878968  4033 log.cc:927] Time spent T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:14:32.882184 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 172326us
W20260709 13:14:32.883235 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 194045us
I20260709 13:14:32.884320 29454 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 24.
I20260709 13:14:32.896668 29344 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:32.898589  3465 raft_consensus.cc:2749] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:32.901022 29344 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:32.875459  4030 log.cc:927] Time spent T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.120s	user 0.001s	sys 0.003s
I20260709 13:14:32.921303 29344 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:32.925091 29495 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:32.775839  3979 consensus_queue.cc:260] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:32.942302 29344 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:32.943853 29344 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:32.945449 29344 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:32.946415 29419 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:32.926184  4022 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:32.919199  3930 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:32.949010 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:32.939096  3967 raft_consensus.cc:697] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 23 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
W20260709 13:14:32.969911 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 251306us
I20260709 13:14:33.078994 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:33.079335 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:14:32.995211 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:33.080031 29456 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:32.935480  3974 raft_consensus.cc:697] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 25 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:33.041389 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:33.084039 29454 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 15.
W20260709 13:14:33.039667 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:33.046880 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:33.086655 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:33.087112 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:33.087553 29453 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:14:33.039464 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 93155.6us
I20260709 13:14:33.051986 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:32.945158  3979 raft_consensus.cc:3060] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:14:33.053035 29495 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:32.946569  3804 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:14:32.947047  4023 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:14:32.946934  3984 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:32.949848  3790 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:14:33.114423 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:32.927744  3634 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.123009 29525 raft_consensus.cc:1240] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:32.947166  4043 raft_consensus.cc:2804] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:32.937085  3991 consensus_queue.cc:1048] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.109s
I20260709 13:14:33.033525  4025 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:33.088274 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:33.101243 29448 raft_consensus.cc:1240] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 24. Current term is 25. Ops: [24.14-24.14]
I20260709 13:14:33.042414  3864 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:33.104059 29447 raft_consensus.cc:1240] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 19. Current term is 20. Ops: []
I20260709 13:14:33.058586  4036 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:33.059192  3963 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:33.111162 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:33.119460 29522 raft_consensus.cc:1240] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:33.119841 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:33.119972 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:33.158345 29524 raft_consensus.cc:2393] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 28: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:33.119463 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:33.078804  4038 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:33.148675 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 67649.3us
I20260709 13:14:33.148854 29453 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
I20260709 13:14:33.111429  4026 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:33.038957  4042 consensus_queue.cc:1048] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.167s
W20260709 13:14:33.132745  3938 consensus_meta.cc:287] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.575s	user 0.015s	sys 0.001s
I20260709 13:14:33.153556  3804 raft_consensus.cc:697] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:33.125623  3790 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:33.114573  3983 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:33.140801  4043 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:14:33.224000 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 130249us
I20260709 13:14:33.156459 29526 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:14:33.152402  3945 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:33.234453 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:33.251104 29495 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:33.154693 29346 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:33.154343  3980 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:33.183112  4048 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.181509  4023 raft_consensus.cc:697] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:33.264804  3465 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:14:33.265306  3465 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:33.265429 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:33.243046 29529 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 23.
I20260709 13:14:33.266758 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:33.156472  3864 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:33.236546  4051 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.161864  4025 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:33.256791 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 102190us
I20260709 13:14:33.244740  3790 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:33.261409  3938 consensus_queue.cc:1059] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:14:33.265672 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:33.279901 29346 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:33.267931 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:33.280745 29525 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 17.
I20260709 13:14:33.265754  3465 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:14:33.242462 29456 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
W20260709 13:14:33.246729 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 171664us
I20260709 13:14:33.237783  3962 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:33.271623 29419 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:33.147606  3634 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:33.214023  3963 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:33.239984  4036 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.291965 29527 raft_consensus.cc:1275] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:14:33.292263  4036 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:33.294818  4036 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:33.217084  4038 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:33.297006  4038 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:33.253470  4043 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:33.256136  3968 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:33.225972  4050 consensus_queue.cc:1048] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.058s
I20260709 13:14:33.266039  3945 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:33.271428  4032 raft_consensus.cc:2804] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:33.289499  3804 consensus_queue.cc:237] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:33.291247  4049 log.cc:927] Time spent T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:14:33.236693  3974 consensus_queue.cc:237] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:33.291646  3634 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:33.307106 29346 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:33.303970  3968 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:33.279100  4051 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:33.269905  4048 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:33.253168  3983 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:33.367746  3945 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:33.359210  4036 raft_consensus.cc:2749] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:33.368913  4055 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:33.238245  3967 consensus_queue.cc:237] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:33.370765 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 103038us
I20260709 13:14:33.362003  4023 consensus_queue.cc:237] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:33.377184 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 70183.1us
I20260709 13:14:33.273680  3936 consensus_queue.cc:1048] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.096s
I20260709 13:14:33.279601  3980 consensus_queue.cc:1059] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.098s
I20260709 13:14:33.272759  3984 consensus_queue.cc:1059] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:14:33.314428  4032 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:33.392267 29495 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:33.400619  4061 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:33.401214  4051 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:33.402287  3946 consensus_meta.cc:287] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.539s	user 0.011s	sys 0.000s
I20260709 13:14:33.403121  3968 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:33.403802  4057 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.404865  3963 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:33.405889  4025 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:33.378362  4056 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.311051  3962 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:33.399176  4055 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:33.387517  4024 raft_consensus.cc:2749] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:33.427923  3967 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:33.431289 29346 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:33.417513  4032 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:33.385931  3878 raft_consensus.cc:2749] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:33.434538  3465 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:33.441948 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:33.437525 29495 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:33.432503  4051 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:33.436044  3938 raft_consensus.cc:2804] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:14:33.468688  3984 raft_consensus.cc:2749] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:33.470891 29495 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:33.471112  3634 raft_consensus.cc:2804] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:14:33.471971  3634 raft_consensus.cc:697] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:33.473246  3634 consensus_queue.cc:237] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:33.467310  3967 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:33.478844  3967 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:33.447731  3945 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:33.486951 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 215463us
I20260709 13:14:33.488297 29419 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:33.491456 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:33.480886  3938 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:33.492362  3938 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:33.493974  4055 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:33.502885 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:33.505307 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:33.449524  3946 consensus_queue.cc:1059] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:14:33.507377 29495 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:33.507961 29448 raft_consensus.cc:1240] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
W20260709 13:14:33.484567  4002 consensus_meta.cc:287] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.627s	user 0.015s	sys 0.000s
I20260709 13:14:33.482786  3864 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:33.480180  3983 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:33.430497  4061 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:33.518375 29530 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 21.
I20260709 13:14:33.511632  4024 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.522715  3983 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.484961  4051 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:33.508015  3790 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:33.524200  3962 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:33.525156  4048 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:33.525588  4043 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:33.528712 29344 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:33.530015  4041 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:14:33.464121  4056 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:33.597695 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:33.597856 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:33.598570 29522 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 19.
I20260709 13:14:33.530488  3946 raft_consensus.cc:3055] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:14:33.545542 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:33.599522  4037 raft_consensus.cc:2804] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:14:33.599658  3946 raft_consensus.cc:740] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:33.599879 29528 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 20.
I20260709 13:14:33.445031  4057 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:33.600291  4037 raft_consensus.cc:697] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:33.600898  3946 consensus_queue.cc:260] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:33.558944 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:33.602039  4057 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:33.558810 29372 raft_consensus.cc:1240] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 16. Current term is 17. Ops: []
I20260709 13:14:33.559921 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:33.565716 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:33.559893 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:33.532786  3991 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:33.571759 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:33.582335 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:33.584925  4059 consensus_queue.cc:1059] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:14:33.568919 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:33.595866  4066 log.cc:927] Time spent T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:14:33.596937 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 68316.6us
I20260709 13:14:33.597880  4041 raft_consensus.cc:697] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:33.601260  4037 consensus_queue.cc:237] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:33.587255 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:33.603103  3946 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:14:33.570242  3983 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:33.646588  3983 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:33.611212 29456 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
I20260709 13:14:33.647956 29374 raft_consensus.cc:3055] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:14:33.648399 29374 raft_consensus.cc:740] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:33.641496  4047 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:33.649092  4047 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:33.649433 29374 consensus_queue.cc:260] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:33.649982  3991 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:33.603343  4061 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:33.639884 29521 raft_consensus.cc:2368] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 21. Current term is 22.
I20260709 13:14:33.653968  3991 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:33.567566 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:33.655452 29381 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 20.
I20260709 13:14:33.655789 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:33.656428 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:33.657179 29381 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 17.
I20260709 13:14:33.658015 29526 raft_consensus.cc:2393] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 21: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:33.637539  3465 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 24 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:33.632963  4043 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:33.626793  4051 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:33.620729  3790 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:33.554917  4024 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:33.604354  3930 raft_consensus.cc:2804] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:14:33.669939  4024 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:33.670245 29373 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 14.
I20260709 13:14:33.676267 29375 raft_consensus.cc:3055] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:14:33.656699 29378 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 20.
I20260709 13:14:33.676697 29375 raft_consensus.cc:740] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:33.603477 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:33.687322 29372 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:33.650674 29374 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:33.688134 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:14:33.685520 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:33.688799 29455 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:33.688174 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:33.693353 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:33.693608 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:33.696532 29530 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 22.
I20260709 13:14:33.697881 29378 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 18.
I20260709 13:14:33.695477 29526 raft_consensus.cc:1240] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 LEADER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:33.683708 29344 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:33.678566 29495 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:33.677309 29377 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 18.
I20260709 13:14:33.712898 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:33.710224 29344 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:14:33.714076 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 218318us
I20260709 13:14:33.717634 29421 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:33.719089 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:33.720047 29375 consensus_queue.cc:260] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:33.716581 29344 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:33.721438 29375 raft_consensus.cc:3060] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:33.721498 29456 raft_consensus.cc:2410] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 22 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:14:33.721833 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:33.722576 29378 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 27.
I20260709 13:14:33.719208 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:33.723451 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:33.628024  4031 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:33.728291 29344 leader_election.cc:400] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 21. Current term is 22.
I20260709 13:14:33.728677 29344 leader_election.cc:403] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:14:33.600291  4056 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:33.674401  3930 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:33.736351 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:33.714589  4002 raft_consensus.cc:2804] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:33.749176 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:33.743711  4025 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:33.752063  4032 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:33.757967 29421 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:33.758901  4032 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:33.759032  4056 raft_consensus.cc:2804] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:33.759723  4056 raft_consensus.cc:697] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 15 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:33.760767 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:33.760679  4056 consensus_queue.cc:237] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:33.719091  4024 raft_consensus.cc:2804] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:33.746387 29344 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:33.772495 29495 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:33.772940 29421 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:33.781430 29495 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:33.764904  4025 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 21. Current term is 22.
I20260709 13:14:33.737892  4043 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:14:33.796960 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:33.746989  4002 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:33.748126  3930 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:33.808063 29374 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
I20260709 13:14:33.798275 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:33.814213 29376 raft_consensus.cc:1240] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 25 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 24. Current term is 25. Ops: [24.14-24.14]
I20260709 13:14:33.808971 29372 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 20.
I20260709 13:14:33.729079  4036 consensus_queue.cc:1048] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:14:33.781662  4024 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:33.782480  3790 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:33.818425 29524 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:14:33.792409  4026 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:14:33.795787  4032 raft_consensus.cc:2804] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:14:33.796862  4043 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:33.826685 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:33.817040 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:33.826056 29344 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:14:33.887046 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 61122.3us
I20260709 13:14:33.825028 29375 raft_consensus.cc:2468] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
I20260709 13:14:33.888947 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:33.889014 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:33.812278  4002 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:33.802491  4042 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:33.825048  4024 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:33.829595  4032 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:33.891597  3465 raft_consensus.cc:2804] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:14:33.829355  4026 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:33.896698  4040 raft_consensus.cc:2804] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:14:33.896981  3938 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:33.899016  4022 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 13:14:33.886901  4043 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:33.903769 29455 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 22.
I20260709 13:14:33.907639 29377 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 22.
W20260709 13:14:33.891970  4045 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 13:14:33.909584 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:33.912613 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:33.915460 29375 raft_consensus.cc:2410] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 22 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:14:33.903375  4032 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:33.906860  4042 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:33.951766  4055 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:14:33.951982  3962 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:14:33.952399  4055 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:33.952890  4055 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:14:33.953094 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 180275us
I20260709 13:14:33.955739  4051 raft_consensus.cc:2804] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:33.957170  4051 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:33.957547  4051 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:33.955109  4032 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:33.957957 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 469785us
I20260709 13:14:33.959621  4039 raft_consensus.cc:3055] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:14:33.960043  4039 raft_consensus.cc:740] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:33.960947  4039 consensus_queue.cc:260] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:33.965428 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:33.959311 29419 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:33.967937  4060 raft_consensus.cc:2749] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:14:33.955106 29421 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:33.907320  4026 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:33.969161 29421 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:33.988277 29421 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:33.990020  4048 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:33.990710  4048 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:33.991564  3962 raft_consensus.cc:2804] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:33.992015  3962 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:33.992363  3962 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:33.980108  4057 raft_consensus.cc:2804] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:14:33.996306  4057 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:33.996702  4057 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:33.915158  4040 raft_consensus.cc:697] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:33.999852  4040 consensus_queue.cc:237] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:33.812008  4041 consensus_queue.cc:237] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:34.004050  4060 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:14:34.004451  4060 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:34.004879  4060 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:14:34.028518  3465 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:34.029409  3465 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:14:34.033856 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:34.003402 29421 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:14:34.039866 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:34.051677 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 48332us
I20260709 13:14:34.075424 29495 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:34.061615  4036 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:14:34.101001  3465 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:34.103507  3465 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:34.104964  3945 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:34.105472  4048 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:34.105888  3945 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:34.109894  3945 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:34.082422  4061 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:34.099862  4050 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:14:34.122361  4061 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:34.132169 29419 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:34.134994 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:34.112252  3938 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:34.154415 29419 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:34.115622  4036 raft_consensus.cc:697] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 20 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:34.165073 29419 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:34.130304  4056 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:34.174330  4050 raft_consensus.cc:697] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:34.156384  3991 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.184863 29277 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35182 (request call id 77) took 3059 ms. Trace:
I20260709 13:14:34.169291  4045 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.186672 29277 rpcz_store.cc:276] 0709 13:14:31.125146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:31.125342 (+   196us) service_pool.cc:224] Handling call
0709 13:14:34.184744 (+3059402us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":101682,"reported_tablets":1}
I20260709 13:14:34.169034  3945 raft_consensus.cc:2749] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:34.208439  4050 consensus_queue.cc:237] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:34.220796  4061 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:34.221552  4061 raft_consensus.cc:2749] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:14:34.177224  4048 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:14:34.235909  4036 consensus_queue.cc:237] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:34.251868  4047 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:34.253078  4032 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:34.192786  3991 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:34.257514  3991 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:34.260977  4051 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:34.183984  4056 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:34.265676  4045 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:34.268214 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:34.270339  4042 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:34.196487  4055 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:34.326709  4055 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:34.285648 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:34.351054 29376 raft_consensus.cc:1275] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:14:34.353785 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:34.354205  4060 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:34.324469 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:34.358073  4057 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:34.305058  4026 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:34.361203 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:34.363366  4045 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:34.359333  4002 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:34.364128 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:34.301849  4043 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:34.367847 29523 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 20.
I20260709 13:14:34.371635  3974 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.373199  3962 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:34.376192  4056 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:34.376996  4051 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:34.405051 29529 raft_consensus.cc:1275] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:14:34.380659 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 268232us
I20260709 13:14:34.361997  4039 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:34.407099 29376 raft_consensus.cc:1240] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 13:14:34.421103 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:34.422070 29449 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:34.423988 29448 raft_consensus.cc:1240] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 21. Current term is 22. Ops: []
I20260709 13:14:34.450558 29276 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37594 (request call id 142) took 4746 ms. Trace:
I20260709 13:14:34.469492 29530 raft_consensus.cc:1275] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:14:34.451084 29276 rpcz_store.cc:276] 0709 13:14:29.663800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:29.664003 (+   203us) service_pool.cc:224] Handling call
0709 13:14:34.409631 (+4745628us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:31.347516 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:31.462627 (+115111us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:31.466595 (+  3968us) write_op.cc:435] Acquired schema lock
0709 13:14:31.470520 (+  3925us) tablet.cc:662] Decoding operations
0709 13:14:31.517089 (+ 46569us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:31.517162 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:31.517197 (+    35us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:14:31.519020 (+  1823us) tablet.cc:701] Row locks acquired
0709 13:14:31.519045 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:14:31.519242 (+   197us) write_op.cc:270] Start()
0709 13:14:31.519394 (+   152us) write_op.cc:276] Timestamp: P: 1783602871519172 usec, L: 0
0709 13:14:31.519433 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:14:31.662991 (+143558us) log.cc:844] Serialized 8424 byte log entry
0709 13:14:32.166907 (+503916us) op_driver.cc:464] REPLICATION: finished
0709 13:14:32.306656 (+139749us) write_op.cc:301] APPLY: starting
0709 13:14:32.314123 (+  7467us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:32.856535 (+542412us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:32.856664 (+   129us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:33.500384 (+643720us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:33.500762 (+   378us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 13:14:33.500808 (+    46us) write_op.cc:312] APPLY: finished
0709 13:14:33.521697 (+ 20889us) log.cc:844] Serialized 188 byte log entry
0709 13:14:33.830776 (+309079us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:33.904800 (+ 74024us) write_op.cc:454] Released schema lock
0709 13:14:33.912726 (+  7926us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:33.994669 (+ 81943us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:33.994727 (+    58us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":240141,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":135888,"apply.run_cpu_time_us":62927,"apply.run_wall_time_us":1677022,"cfile_cache_hit":86,"cfile_cache_hit_bytes":91739,"num_ops":21,"prepare.queue_time_us":93628,"prepare.run_cpu_time_us":17541,"prepare.run_wall_time_us":391853,"raft.queue_time_us":212391,"raft.run_cpu_time_us":39134,"raft.run_wall_time_us":96831,"replication_time_us":647301,"thread_start_us":602665,"threads_started":5,"wal-append.queue_time_us":428563,"wal-append.run_cpu_time_us":24250,"wal-append.run_wall_time_us":1272743}]]}
I20260709 13:14:34.402571  3946 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.503532  4060 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 29 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:34.503878  4057 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:34.510033 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:34.510977 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:34.514482 29373 raft_consensus.cc:1275] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:14:34.517747 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:14:34.525656 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 360960us
I20260709 13:14:34.485184  4031 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.529413  3465 consensus_queue.cc:1048] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:14:34.547201 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:34.524556  4040 consensus_queue.cc:1048] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 13:14:34.407716  3974 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:34.531047  4024 consensus_meta.cc:287] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.622s	user 0.009s	sys 0.006s
I20260709 13:14:34.556357 29449 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16.
I20260709 13:14:34.565161 29456 raft_consensus.cc:1240] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 20 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:14:34.567476 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:34.568503 29448 raft_consensus.cc:2393] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 29: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:34.569576 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:34.571741 29455 raft_consensus.cc:1275] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:14:34.572082  3962 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:34.510425  3946 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:34.577754 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:34.579604 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:34.580687 29449 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
W20260709 13:14:34.602481 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 437446us
I20260709 13:14:34.542192  4031 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:34.553059  4060 consensus_queue.cc:1048] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:14:34.648447 29495 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:34.588404  3991 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:34.606454 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:34.674052 29529 raft_consensus.cc:2393] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 21: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:14:34.607753  3930 consensus_meta.cc:287] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.782s	user 0.009s	sys 0.009s
I20260709 13:14:34.667644 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:34.676708 29378 raft_consensus.cc:1275] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:14:34.677383 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:34.614610  4043 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:34.559063  4024 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:34.616266 29523 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37968 (request call id 4886) took 1667 ms (client timeout 2109 ms). Trace:
I20260709 13:14:34.618057 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:34.629629 29528 raft_consensus.cc:1275] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 14. (term mismatch)
I20260709 13:14:34.690115 29528 pending_rounds.cc:85] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 13
I20260709 13:14:34.690459 29528 pending_rounds.cc:107] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 24.14
I20260709 13:14:34.690779 29528 raft_consensus.cc:2889] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:34.634595  4026 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:34.638327 29524 raft_consensus.cc:1275] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:14:34.663069 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:34.668478 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:14:34.688671 29523 rpcz_store.cc:269] 0709 13:14:32.948552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:32.948722 (+   170us) service_pool.cc:224] Handling call
0709 13:14:34.616081 (+1667359us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400358ed4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:14:34.616203 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2666306944}
W20260709 13:14:34.672981  4080 log.cc:927] Time spent T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.130s	user 0.001s	sys 0.001s
I20260709 13:14:34.674635 29373 raft_consensus.cc:1240] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:14:34.587628  4057 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:34.701495 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:34.702294 29375 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:14:34.702410 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 54077.5us
I20260709 13:14:34.692934 29376 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 27.
I20260709 13:14:34.710350 29380 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 19.
I20260709 13:14:34.715902 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:34.716166 29495 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:34.716645 29372 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:14:34.718358 29344 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:34.682054 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:34.683861 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:34.707401  4042 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:34.683352  3930 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:34.697346  3980 consensus_queue.cc:1048] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:14:34.687757 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:34.683293  3991 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:34.679013  4036 consensus_queue.cc:1059] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:14:34.696645 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:34.605530 29419 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:34.709815  3804 consensus_queue.cc:1048] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:14:34.760246 29529 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:34.734856  3683 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:14:34.731276 29379 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 27 FOLLOWER]: Advancing to term 29
I20260709 13:14:34.710021  4057 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:34.772966 29377 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 15.
I20260709 13:14:34.724210  4083 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:14:34.736354  4002 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:34.791803 29529 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 23.
W20260709 13:14:34.806617 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 201190us
I20260709 13:14:34.808599 29344 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:34.810683 29419 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:34.814330 29372 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 22.
I20260709 13:14:34.815763 29375 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 19.
I20260709 13:14:34.818204 29419 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:34.806635  4060 raft_consensus.cc:3055] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:14:34.824838 29421 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:34.794363  4032 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:34.791560  3683 raft_consensus.cc:697] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:34.807917  4056 raft_consensus.cc:2749] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:34.834219 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:34.849110 29529 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 15.
I20260709 13:14:34.840240  4057 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:34.840898  3930 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:34.842437  3683 consensus_queue.cc:237] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:34.813097  4031 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:34.810382  4086 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:34.817574  4043 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:14:34.888639 29380 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52172 (request call id 2829) took 1135 ms. Trace:
I20260709 13:14:34.846571  4032 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:34.889081 29380 rpcz_store.cc:276] 0709 13:14:33.753315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:33.888617 (+135302us) service_pool.cc:224] Handling call
0709 13:14:34.888449 (+999832us) spinlock_profiling.cc:243] Waited 820 ms on lock 0x7b540039eed4. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:14:34.888558 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1886510976}
I20260709 13:14:34.829465  4060 raft_consensus.cc:740] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:34.890867  4060 consensus_queue.cc:260] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:34.887816  4087 raft_consensus.cc:2804] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:14:34.892181  4060 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:34.892597  4087 raft_consensus.cc:697] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 22 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:34.893528  4087 consensus_queue.cc:237] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:34.897086  3946 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:34.887835 29377 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52172 (request call id 2827) took 1135 ms. Trace:
I20260709 13:14:34.903688 29377 rpcz_store.cc:276] 0709 13:14:33.752634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:33.912328 (+159694us) service_pool.cc:224] Handling call
0709 13:14:34.887637 (+975309us) spinlock_profiling.cc:243] Waited 858 ms on lock 0x7b54003f3254. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:14:34.887767 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1972292480}
I20260709 13:14:34.880998 29379 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 29.
I20260709 13:14:34.817147  4085 raft_consensus.cc:2749] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:34.846339 29372 raft_consensus.cc:1240] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 20. Current term is 21. Ops: []
I20260709 13:14:34.854806 29522 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 21.
I20260709 13:14:34.847870 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:14:34.845777 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 124394us
I20260709 13:14:34.845162  3991 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:34.916253 29526 raft_consensus.cc:2368] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 15. Current term is 16.
I20260709 13:14:34.878489 29344 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:14:34.927191 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 48823.4us
I20260709 13:14:34.837683  3974 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:34.861003  4036 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:14:34.951807 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:34.950598 29344 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:34.955137 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:34.955968 29525 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:14:34.956269 29344 leader_election.cc:400] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 15. Current term is 16.
I20260709 13:14:34.956655 29344 leader_election.cc:403] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
W20260709 13:14:34.953244 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 128528us
I20260709 13:14:34.959532 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:14:34.977011 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:34.983453 29379 raft_consensus.cc:1275] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:14:34.918243  4043 raft_consensus.cc:697] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:34.944389  3983 raft_consensus.cc:2804] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:14:35.021526 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 66826.1us
W20260709 13:14:35.027422 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 69868.5us
W20260709 13:14:35.030205 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 212072us
I20260709 13:14:35.036330 29344 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:14:35.037403 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 80739.5us
I20260709 13:14:35.031085 29421 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:35.040150 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:35.040246 29495 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:35.042309 29525 raft_consensus.cc:2368] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 19. Current term is 20.
I20260709 13:14:34.924470  4086 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:35.047722  4002 consensus_queue.cc:1048] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:14:35.049816  4086 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:14:35.050009  4084 log.cc:927] Time spent T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.319s	user 0.002s	sys 0.000s
I20260709 13:14:34.955075  4024 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:35.054275 29344 leader_election.cc:400] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 19. Current term is 20.
W20260709 13:14:35.055078 29346 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.146.130:40551 timed out after 1.558s (SENT) [suppressed 28 similar messages]
I20260709 13:14:35.060122 29344 leader_election.cc:403] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:14:35.019987  4085 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.025796  3930 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:14:35.022706  4026 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:35.078899 29419 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:35.079753 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 58405.8us
I20260709 13:14:35.026314  3983 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:35.077169  4024 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:35.042114  3804 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:14:35.096007  4090 log.cc:927] Time spent T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.285s	user 0.000s	sys 0.002s
I20260709 13:14:35.095872  3930 raft_consensus.cc:697] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
W20260709 13:14:35.096418  4096 log.cc:927] Time spent T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:14:35.096669  4032 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:35.097039  4043 consensus_queue.cc:237] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:35.100936 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:35.099679 29421 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:35.114847 29419 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:35.105808  3983 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:35.108498  4050 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:35.108043  4086 raft_consensus.cc:2804] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:14:35.128304 29421 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:35.109709  4057 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.107128  3804 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:35.123806 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 95686.9us
I20260709 13:14:35.129908 29495 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:35.107892  4061 consensus_queue.cc:1048] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
W20260709 13:14:35.121748 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 66705.6us
I20260709 13:14:35.138165  4097 consensus_queue.cc:1048] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:14:35.098151  4085 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:35.106614  4100 consensus_queue.cc:1048] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:14:35.129545  3945 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:35.153082 29377 raft_consensus.cc:1275] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:14:35.153792 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:35.154115 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:35.153748 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:35.155694 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:35.155763 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:35.156509 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:35.145197  4061 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:35.159125  4032 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:14:35.159940 29380 raft_consensus.cc:1275] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:14:35.136358  4102 raft_consensus.cc:2804] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:35.136065  3930 consensus_queue.cc:237] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:35.137297  3804 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:35.177191  4100 raft_consensus.cc:2764] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
W20260709 13:14:35.178325  4039 consensus_meta.cc:287] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.710s	user 0.012s	sys 0.000s
I20260709 13:14:35.170078  4102 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:35.184254  4102 raft_consensus.cc:3060] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:35.168864  4032 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:35.189498  4032 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:14:35.211982 29495 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:35.215754 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:35.216812 29455 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
I20260709 13:14:35.140260  4057 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:35.227671 29451 raft_consensus.cc:1275] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:14:35.220435 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:35.215862  4039 consensus_queue.cc:1059] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 13:14:35.219468  4054 raft_consensus.cc:2804] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:14:35.232327  4057 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:35.229048 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 114314us
I20260709 13:14:35.240525 29495 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:35.244163 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:35.246356 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:35.246520 29455 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 20.
I20260709 13:14:35.246985 29451 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 21.
I20260709 13:14:35.249311 29419 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:35.244922  4086 raft_consensus.cc:697] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 19 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:35.276202 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:35.278280 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:35.279102 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:35.279868 29453 raft_consensus.cc:2368] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 15. Current term is 16.
I20260709 13:14:35.280254 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:35.281854 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:35.259459  3946 raft_consensus.cc:2749] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:14:35.280356 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:35.285439  3983 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:35.294942  4024 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 19. Current term is 20.
I20260709 13:14:35.252126  4056 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:35.254489  4054 raft_consensus.cc:697] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:35.300459 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:35.300253  4054 consensus_queue.cc:237] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:35.303411 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:35.304351 29453 raft_consensus.cc:2368] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 28. Current term is 29.
I20260709 13:14:35.307330  3983 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:35.307106 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:35.310731  4026 raft_consensus.cc:2749] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 15. Current term is 16.
I20260709 13:14:35.311702 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:35.315382 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:35.317301  4097 consensus_queue.cc:1048] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:14:35.318493 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 63126.3us
I20260709 13:14:35.321426  4086 consensus_queue.cc:237] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:35.331251 29375 raft_consensus.cc:2468] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 20.
W20260709 13:14:35.345273 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 217171us
I20260709 13:14:35.346071 29421 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:35.342741  4032 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:35.359876  4114 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:14:35.362093 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:35.363834 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:35.364166 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:35.364838 29455 raft_consensus.cc:2368] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 21. Current term is 22.
I20260709 13:14:35.364985 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:35.365923 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:35.363337 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:35.358275 29495 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:35.376516 29452 raft_consensus.cc:1240] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:35.379057 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:35.379951 29447 raft_consensus.cc:2410] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 23 because replica has last-logged OpId of term: 22 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 13:14:35.379799 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:35.380728 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:35.382236 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:35.386873 29448 raft_consensus.cc:2368] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 17. Current term is 18.
I20260709 13:14:35.387684 29449 raft_consensus.cc:1275] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:14:35.388824 29448 raft_consensus.cc:1275] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:14:35.389643 29449 raft_consensus.cc:1275] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:14:35.392205 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:35.399917 29455 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:14:35.392452  4083 consensus_queue.cc:1048] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 13:14:35.384809  4056 consensus_queue.cc:1048] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:14:35.377889  4110 consensus_queue.cc:1059] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:14:35.392794  3991 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:35.405750  4110 raft_consensus.cc:3055] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:14:35.405984  3991 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:35.406198  4110 raft_consensus.cc:740] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:35.406450  3991 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:35.391283  3804 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:35.428467  4102 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:35.430117 29454 raft_consensus.cc:2393] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 20: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:35.374979  4114 raft_consensus.cc:697] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 29 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:35.463445  4115 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.456599  3983 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:35.467938  3983 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:35.470419  3983 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:35.472482  3804 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:35.474766 29378 raft_consensus.cc:2393] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 18: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:35.474993  4032 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 29 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:35.475675  4032 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:35.467053  4115 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:35.477097 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:35.477941 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:35.478257 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:35.476971 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:35.480135 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:35.480135 29530 raft_consensus.cc:1275] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:14:35.481798 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:35.482800 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:35.483091 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:35.485028 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:35.487459 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:35.488337 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:35.495755 29529 raft_consensus.cc:2393] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 20: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:35.426388  4038 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.486446 29527 raft_consensus.cc:2393] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 29: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:35.436928  4110 consensus_queue.cc:260] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:35.476188  4032 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:35.654884 29450 raft_consensus.cc:1240] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:35.913206 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:35.837545 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:35.925100 29449 raft_consensus.cc:2368] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 19. Current term is 20.
I20260709 13:14:35.905932 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:35.533133 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:35.519560 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:35.524288 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:35.927376 29521 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 21.
I20260709 13:14:35.522114 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:35.793169 29448 raft_consensus.cc:1240] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:14:35.512845 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:35.835855 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:14:35.936600 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:35.936839 29523 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:35.837198 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:35.512598 29456 raft_consensus.cc:1240] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 19 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:35.938162 29451 raft_consensus.cc:2393] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 21: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:35.938230 29454 raft_consensus.cc:2410] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 23 because replica has last-logged OpId of term: 22 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 13:14:35.457278  4024 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:35.457603  3974 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:35.950556 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:35.952080 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:35.953261 29524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 4944) took 1093 ms. Trace:
I20260709 13:14:35.941869 29455 raft_consensus.cc:1275] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:14:35.954035 29522 raft_consensus.cc:3060] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:35.943732 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:35.953969 29524 rpcz_store.cc:276] 0709 13:14:34.848188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:34.849364 (+  1176us) service_pool.cc:224] Handling call
0709 13:14:34.849685 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:34.850021 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:34.850063 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:35.236546 (+386483us) spinlock_profiling.cc:243] Waited 5.22 ms on lock 0x7b2c001231f8. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7a67fa11 00007f6a7a68f372 00007f6a7bdc1a01 00007f6a7bd8643a 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2
0709 13:14:35.236971 (+   425us) log.cc:844] Serialized 26 byte log entry
0709 13:14:35.437490 (+200519us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:14:35.437528 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:35.437614 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:35.794092 (+356478us) raft_consensus.cc:1685] finished
0709 13:14:35.794127 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:35.941817 (+147690us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":30609,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":71,"spinlock_wait_cycles":12017024,"thread_start_us":200187,"threads_started":1,"wal-append.queue_time_us":459605}
I20260709 13:14:35.952996 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:35.957545  3979 consensus_queue.cc:1048] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:14:35.957656 29452 raft_consensus.cc:2368] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 15. Current term is 16.
I20260709 13:14:35.954866 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:35.957777 29495 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:35.942575 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:35.961627 29524 raft_consensus.cc:1240] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:14:35.961812  4031 raft_consensus.cc:2749] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:35.962812 29530 raft_consensus.cc:1240] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:14:35.943899  3465 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:35.973992  3465 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:35.974401 29524 raft_consensus.cc:1275] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:14:35.976375  3465 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:35.977952 29524 raft_consensus.cc:1275] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:14:35.941741 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:35.940291  3790 consensus_queue.cc:1048] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:14:35.979014  4024 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:35.981985 29279 catalog_manager.cc:5697] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 22 to 23, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 23 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:35.982854  3962 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:35.983450  3962 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:35.983939  4024 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:35.985692  3962 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:35.987885 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:35.543188  4102 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:35.702065  4022 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:35.992964  4022 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:35.946458  3936 raft_consensus.cc:3055] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:14:35.995944  3936 raft_consensus.cc:740] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:35.996829  4022 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:35.940449  4038 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:35.997381  3936 consensus_queue.cc:260] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:35.998477  3936 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:35.635737  4097 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.000183  4097 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:36.002535  4097 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:36.004398 29528 raft_consensus.cc:1275] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:14:36.007819  3974 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:35.931375  4115 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:36.000211  4038 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:35.961692 29495 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:14:36.016383 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 54770.2us
I20260709 13:14:35.940876 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:35.984660 29279 catalog_manager.cc:5697] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 14 to 16, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 16 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:36.022006 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:36.027936 29527 raft_consensus.cc:2393] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 29: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:36.025249 29523 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 16.
I20260709 13:14:35.528538  4085 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:36.040156 29279 catalog_manager.cc:5697] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:36.042896 29279 catalog_manager.cc:5697] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 17 to 18, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 18 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:35.979506  4055 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.011497  3974 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:36.072992 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:36.079766 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:36.074344 29279 catalog_manager.cc:5697] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 15 to 16, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 16 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:36.082057 29279 catalog_manager.cc:5697] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 18 to 19, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 19 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:36.080533  4102 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:36.096196  4102 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:36.074164 29419 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:36.050642  4038 raft_consensus.cc:2804] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:14:36.061280 29522 raft_consensus.cc:2468] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 22.
I20260709 13:14:36.120361 29419 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:36.104087 29279 catalog_manager.cc:5697] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 13 to 14, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 14 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:36.109504 29452 raft_consensus.cc:1240] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 21. Current term is 22. Ops: []
I20260709 13:14:36.124732 29279 catalog_manager.cc:5697] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 18 to 19, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 19 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:36.122954 29419 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:35.534058  4114 consensus_queue.cc:237] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 27.14, Last appended by leader: 14, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:36.137180 29419 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:36.142532 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:36.143107 29419 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:36.139786  4115 consensus_queue.cc:1048] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:14:36.132843  4086 raft_consensus.cc:2749] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:36.070323  4055 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:36.147346  4038 raft_consensus.cc:697] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 20 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:36.173038  4038 consensus_queue.cc:237] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:36.140288  4051 raft_consensus.cc:2749] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:14:36.147445  3930 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.175995  3930 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:36.178656  3930 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:36.148324  4087 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:36.180452  4110 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:14:36.181635  3991 consensus_meta.cc:287] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.775s	user 0.007s	sys 0.013s
I20260709 13:14:36.182127  3991 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:36.160444  4086 raft_consensus.cc:2749] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:36.183437 29525 raft_consensus.cc:2393] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 18: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:36.141099  4061 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:36.165484  4102 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:36.171408  4032 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:14:36.153985 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:36.190994 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 105926us
W20260709 13:14:36.192301 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 132039us
W20260709 13:14:36.191661 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 228157us
I20260709 13:14:36.207562  3930 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:36.223013 29378 raft_consensus.cc:1240] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:14:36.217685  3804 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:36.237447 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:36.242959 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:36.228504 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:36.242107 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
W20260709 13:14:36.243935 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 100976us
I20260709 13:14:36.244334 29375 raft_consensus.cc:2393] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 29: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:36.244669 29373 raft_consensus.cc:1275] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:14:36.269388 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:36.269732 29419 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:36.244769 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:36.248790 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:36.276131 29524 raft_consensus.cc:2410] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:14:36.276221 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:36.277159 29372 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 20.
W20260709 13:14:36.227357  4122 log.cc:927] Time spent T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.147s	user 0.000s	sys 0.003s
I20260709 13:14:36.252051 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:36.257653 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:36.279986 29495 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:36.265764 29527 raft_consensus.cc:1275] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:14:36.282011 29495 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:36.246548  3804 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:36.283362 29374 raft_consensus.cc:2393] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 24: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:36.285748 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:36.294704 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:36.304776 29419 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:36.275104  3991 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:36.301177  3946 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:14:36.279664  4036 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:36.246390  3930 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:36.308001 29344 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:36.313134  3465 raft_consensus.cc:2804] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:14:36.317672  3465 raft_consensus.cc:697] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:36.316231 29419 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:36.325706 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:36.326969 29372 raft_consensus.cc:2393] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 20: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:36.319088  3465 consensus_queue.cc:237] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:36.330348 29419 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:36.340889 29419 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:36.310617  3946 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:36.347808 29419 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:36.349124 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:36.315593  4136 raft_consensus.cc:2749] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:36.353552 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:36.353741 29419 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:36.317091  4022 consensus_queue.cc:1048] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:14:36.330169  4102 raft_consensus.cc:2749] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:36.371363 29419 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:36.373818 29373 raft_consensus.cc:1275] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:14:36.374290 29376 raft_consensus.cc:1240] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 23. Current term is 24. Ops: []
I20260709 13:14:36.317462  4031 consensus_queue.cc:1059] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:14:36.317039  4026 consensus_queue.cc:1048] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 13:14:36.376628 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:36.353417  4085 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:14:36.352536  4086 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:36.352701  3946 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:36.351588  4036 raft_consensus.cc:2749] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:36.376323  4087 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:36.385758  4136 raft_consensus.cc:2749] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:36.359823  4061 consensus_queue.cc:1059] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:14:36.362779  4115 consensus_queue.cc:1048] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 13:14:36.378307 29419 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:36.403901 29419 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:36.397861  4031 consensus_queue.cc:1243] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer 183db85c071f489fbc8de63a9edd8a3a log is divergent from this leader: its last log entry 19.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:14:36.405752  3930 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:36.396993  3979 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:14:36.420382 29419 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:36.422891 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:36.424495 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:36.424762 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:36.426652 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:36.428398 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:36.428978 29453 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:36.434203 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:36.434521 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:36.425666  4136 raft_consensus.cc:2749] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:36.416095  4087 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:14:36.427209 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 121885us
I20260709 13:14:36.415444  4061 raft_consensus.cc:2749] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:36.447824 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:36.445366 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:36.455556 29527 raft_consensus.cc:2393] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 18: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:36.458664 29372 raft_consensus.cc:1240] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 15. Current term is 16. Ops: []
I20260709 13:14:36.463049 29453 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 18.
I20260709 13:14:36.467384 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:36.445844  4097 consensus_queue.cc:1048] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:14:36.472388 29454 raft_consensus.cc:1275] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:14:36.473819  4136 consensus_queue.cc:1048] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:14:36.476761  3979 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:36.478134  3936 raft_consensus.cc:3055] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:14:36.484333  4086 consensus_queue.cc:1059] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:14:36.454077  3804 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:36.492538 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:36.518582 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:36.493086 29451 raft_consensus.cc:1275] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:14:36.515760 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:36.518553 29452 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 19.
I20260709 13:14:36.516916  3936 raft_consensus.cc:740] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:36.521581 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:36.523842 29346 leader_election.cc:400] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 28 pre-election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 28. Current term is 29.
I20260709 13:14:36.524255 29346 leader_election.cc:403] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 28 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:36.524801  3465 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 29 FOLLOWER]: Leader pre-election lost for term 28. Reason: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 28. Current term is 29.
I20260709 13:14:36.517151  3979 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:36.533447  4114 raft_consensus.cc:3055] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:14:36.534001  4114 raft_consensus.cc:740] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:36.534912  4114 consensus_queue.cc:260] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:36.536360  4114 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:14:36.540490  3936 consensus_queue.cc:260] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:36.541904  3936 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:36.549093  4036 raft_consensus.cc:3055] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:14:36.555276  3804 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.549393  4055 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:36.565773 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 96751.9us
I20260709 13:14:36.563831 29346 leader_election.cc:400] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 21. Current term is 22.
I20260709 13:14:36.580724 29419 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:36.560173  4036 raft_consensus.cc:740] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:36.584726 29419 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:36.589393  4086 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:14:36.566723  4110 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.594080 29346 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:36.595274 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:36.596520 29451 raft_consensus.cc:1275] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:14:36.598079 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:36.574118  4055 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.608129 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:36.612377 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:36.613304 29530 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 21.
I20260709 13:14:36.616473 29452 raft_consensus.cc:2393] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 18: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:36.573773  3804 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:36.623893 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:36.606763  4087 raft_consensus.cc:2749] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:36.615121  4055 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:36.665984  4055 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:36.671775  4148 log.cc:927] Time spent T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:14:36.679963  4043 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:36.680749  4043 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:36.609804  4110 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:36.668334  4036 consensus_queue.cc:260] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:36.614073  3974 raft_consensus.cc:2749] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:14:36.621342  3683 consensus_queue.cc:1048] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.069s
I20260709 13:14:36.683336  4043 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:36.714179  4110 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:36.707240  3979 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:36.658576  3930 consensus_queue.cc:1048] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 13:14:36.684157  4026 consensus_queue.cc:1048] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:14:36.717911  3979 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:36.723137  3804 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:36.683887  4036 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:36.797247  3946 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:36.808174 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 191152us
W20260709 13:14:36.811218 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:36.811982 29346 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:36.825227  3974 consensus_queue.cc:1048] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:14:36.829154 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 140569us
I20260709 13:14:36.830196 29495 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:36.829245 29346 leader_election.cc:400] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 19. Current term is 20.
I20260709 13:14:36.832223  3683 consensus_queue.cc:1059] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:36.842170  3946 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:36.840073  3683 raft_consensus.cc:3055] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:14:36.843850  3683 raft_consensus.cc:740] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:36.844868  3683 consensus_queue.cc:260] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:36.846417  3683 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:36.818857  4154 raft_consensus.cc:2749] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:14:36.852131  4159 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
W20260709 13:14:36.863255 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:36.865043 29346 leader_election.cc:400] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 15. Current term is 16.
I20260709 13:14:36.866344 29346 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:36.868512 29346 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:36.876155  4165 consensus_queue.cc:1048] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:36.879710  4154 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:14:36.881359  4159 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.881966  4159 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:36.884407  4159 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:36.884971  4036 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:36.885824  4154 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:36.886416  4154 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:36.887712  4087 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:36.888275  4087 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:36.888820  4154 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:36.885567  4036 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:36.885838 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 44937.5us
I20260709 13:14:36.890889 29346 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:36.893373 29495 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:36.894788 29346 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:36.896253 29495 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:36.897380 29346 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:36.898705 29346 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:36.899453 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:36.899792 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:36.900820 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:36.902541 29524 raft_consensus.cc:1240] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 15. Current term is 16. Ops: []
I20260709 13:14:36.894834  4026 raft_consensus.cc:2749] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:36.902740  4155 raft_consensus.cc:2749] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:36.903466 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:36.905799  4159 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:14:36.907317 29530 raft_consensus.cc:1275] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:14:36.892560  4154 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:14:36.918138 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 261261us
I20260709 13:14:36.897148  4038 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:14:36.925645  4038 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:36.927323  4038 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:36.927237  4022 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:36.931768  4036 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:36.932981  4087 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:36.917881  4114 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:36.939996  4114 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:36.942364  4114 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:36.921576  4086 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:36.946128  4086 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:36.927224 29346 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:36.953651 29525 raft_consensus.cc:1275] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 13:14:36.956841 29525 pending_rounds.cc:85] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 11
I20260709 13:14:36.957056 29525 pending_rounds.cc:107] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 13:14:36.957304 29525 raft_consensus.cc:2889] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:36.926469 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:36.906777  4161 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:36.968393  4022 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:14:36.969172  4022 raft_consensus.cc:697] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:36.970227  4022 consensus_queue.cc:237] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:36.952843  4086 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:36.971655  4127 consensus_queue.cc:1048] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:14:36.971920 29346 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:36.972807  3683 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:36.973672 29344 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:36.975265  4161 consensus_queue.cc:1048] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:14:36.975953  3974 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:14:36.976567  3974 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:36.977090  3974 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:36.973721 29346 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:36.989650 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:36.991858 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:36.992908 29451 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:37.007787  4086 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:37.010277 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:37.009873  4086 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:37.015663 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:37.016377 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:37.017040 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:37.017606 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:37.017695 29527 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 19.
I20260709 13:14:37.018776 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:37.019315 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:37.021121 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:37.014653 29525 raft_consensus.cc:1275] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 29 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 27 index: 14. Preceding OpId from leader: term: 29 index: 15. (index mismatch)
I20260709 13:14:37.024832 29528 raft_consensus.cc:1240] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:14:37.026243 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:37.026902 29344 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:37.032645 29456 raft_consensus.cc:1275] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:14:37.046675 29279 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37608 (request call id 159) took 8811 ms. Trace:
W20260709 13:14:37.048955 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 75305.2us
I20260709 13:14:37.048985 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:37.050031 29346 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:37.050611 29456 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:37.058121 29346 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:37.029681  4086 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:37.064445 29451 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 22.
I20260709 13:14:37.069396 29419 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:37.047593 29279 rpcz_store.cc:276] 0709 13:14:28.235948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:28.236283 (+   335us) service_pool.cc:224] Handling call
0709 13:14:37.046589 (+8810306us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:36.323933 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:36.423845 (+ 99912us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:36.426111 (+  2266us) write_op.cc:435] Acquired schema lock
0709 13:14:36.427762 (+  1651us) tablet.cc:662] Decoding operations
0709 13:14:36.453621 (+ 25859us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:36.453712 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:36.453753 (+    41us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:14:36.473493 (+ 19740us) tablet.cc:701] Row locks acquired
0709 13:14:36.473531 (+    38us) write_op.cc:260] PREPARE: finished
0709 13:14:36.473704 (+   173us) write_op.cc:270] Start()
0709 13:14:36.473845 (+   141us) write_op.cc:276] Timestamp: P: 1783602876473647 usec, L: 0
0709 13:14:36.473871 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:14:36.475580 (+  1709us) log.cc:844] Serialized 3282 byte log entry
0709 13:14:36.702875 (+227295us) op_driver.cc:464] REPLICATION: finished
0709 13:14:36.835551 (+132676us) write_op.cc:301] APPLY: starting
0709 13:14:36.835651 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:36.848939 (+ 13288us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:36.849080 (+   141us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:36.930227 (+ 81147us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:36.930483 (+   256us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:14:36.930549 (+    66us) write_op.cc:312] APPLY: finished
0709 13:14:36.930851 (+   302us) log.cc:844] Serialized 81 byte log entry
0709 13:14:36.931042 (+   191us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:36.931194 (+   152us) write_op.cc:454] Released schema lock
0709 13:14:36.931250 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:36.942101 (+ 10851us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:36.942137 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":56,"child_traces":[["op",{"apply.queue_time_us":132376,"apply.run_cpu_time_us":14008,"apply.run_wall_time_us":99261,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37503,"num_ops":8,"prepare.queue_time_us":155064,"prepare.run_cpu_time_us":24090,"prepare.run_wall_time_us":239483,"raft.queue_time_us":140129,"raft.run_cpu_time_us":14943,"raft.run_wall_time_us":105751,"replication_time_us":228810,"spinlock_wait_cycles":496000,"thread_start_us":274758,"threads_started":4,"wal-append.queue_time_us":81518}]]}
I20260709 13:14:37.049317  4026 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:37.075958 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:37.076551  3983 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:37.061542 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:37.079236  4043 consensus_queue.cc:1059] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:14:37.080054  4127 raft_consensus.cc:2749] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:37.079957 29346 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:37.085736  4032 consensus_queue.cc:1048] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:37.090426 29419 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:37.061064  4114 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.108654 29419 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:37.110119 29456 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 21.
I20260709 13:14:37.118927 29372 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:14:37.119837 29372 raft_consensus.cc:606] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 LEADER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:37.136380 29419 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:37.094520  3983 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:37.107321  4086 raft_consensus.cc:2749] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:37.135708  4022 raft_consensus.cc:3055] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:14:37.139215  4087 raft_consensus.cc:2749] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:14:37.143813  3962 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:14:37.181293 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 123612us
I20260709 13:14:37.093770  4038 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:37.141772  4026 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:37.168525  4036 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:37.185645 29495 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:14:37.188426 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:37.134840  4114 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:37.170094  3983 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:37.181864 29278 catalog_manager.cc:5697] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 19 to 22, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 22 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:37.144281  4136 consensus_queue.cc:1059] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:14:37.182408  4022 raft_consensus.cc:740] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:37.219738 29522 raft_consensus.cc:1240] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 20. Current term is 21. Ops: []
I20260709 13:14:37.217491 29278 catalog_manager.cc:5697] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 16 to 17, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 17 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:37.234459 29453 raft_consensus.cc:2410] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:14:37.221077  3790 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:14:37.244372  3790 raft_consensus.cc:697] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:37.245391  3790 consensus_queue.cc:237] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:37.249181 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:37.259788 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 123507us
I20260709 13:14:37.234612  4136 consensus_queue.cc:1243] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer 429e58eb058349e3bf72b5a870c8f6e5 log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:14:37.235476  4159 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:14:37.255924 29278 catalog_manager.cc:5697] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:37.275724 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:37.275900 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:37.278824 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:37.280215 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:37.283028 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:37.285432 29377 raft_consensus.cc:2410] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:14:37.287478 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:37.288368 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:37.289312 29278 catalog_manager.cc:5697] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 20 to 21, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 21 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:37.291999 29278 catalog_manager.cc:5697] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 16 to 20, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 20 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:37.298415 29278 catalog_manager.cc:5697] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 21 to 22, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 22 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:37.271365  4134 log.cc:927] Time spent T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:14:37.302327 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:37.293071 29419 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:37.381915 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 88981.4us
I20260709 13:14:37.332032 29523 raft_consensus.cc:1240] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 23. Current term is 24. Ops: [23.15-23.15]
I20260709 13:14:37.333657 29380 raft_consensus.cc:1275] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 29 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 27 index: 14. Preceding OpId from leader: term: 29 index: 15. (index mismatch)
I20260709 13:14:37.384991 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:37.302004  4087 consensus_queue.cc:1048] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
W20260709 13:14:37.298246  4167 log.cc:927] Time spent T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:14:37.365803 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:14:37.362301 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 74624.1us
I20260709 13:14:37.298120  4128 raft_consensus.cc:2804] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:37.369393 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:37.271199  4149 consensus_queue.cc:1048] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.223s
I20260709 13:14:37.290796  4036 consensus_queue.cc:1059] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 13:14:37.376303 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:37.407056 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:37.299614  4136 consensus_queue.cc:1048] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.071s
I20260709 13:14:37.385972 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:37.388113 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:37.389297 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:14:37.381680 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 144461us
I20260709 13:14:37.431422 29451 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 18.
I20260709 13:14:37.431900 29495 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:37.432076 29421 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:37.401124 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:37.433279 29453 raft_consensus.cc:2368] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 17. Current term is 18.
I20260709 13:14:37.402261 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:37.403712 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:37.434973 29451 raft_consensus.cc:1240] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 13:14:37.405680 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:37.435781 29452 pending_rounds.cc:85] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 11
I20260709 13:14:37.436115 29452 pending_rounds.cc:107] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 22.12
I20260709 13:14:37.436439 29452 raft_consensus.cc:2889] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:37.437733 29346 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:37.410847 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:37.439383  4043 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:37.413209 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:37.417688 29530 raft_consensus.cc:1275] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:14:37.442065 29346 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:37.442265 29447 raft_consensus.cc:1240] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:14:37.443007  4026 raft_consensus.cc:2804] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:37.419934 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:37.443724 29346 leader_election.cc:400] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 17. Current term is 18.
I20260709 13:14:37.444020 29379 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 21.
I20260709 13:14:37.426071 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:37.443411  4026 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:37.445436  4026 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:37.446102 29346 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:37.404275 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:37.448033 29455 raft_consensus.cc:2368] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 15. Current term is 16.
I20260709 13:14:37.457505 29450 raft_consensus.cc:2368] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 19. Current term is 20.
I20260709 13:14:37.460580 29419 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:37.453828  3465 consensus_queue.cc:1059] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 13:14:37.418843  4128 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.299098  4022 consensus_queue.cc:260] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:37.505643  3936 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:37.427295  4173 raft_consensus.cc:2749] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:14:37.466583  4160 log.cc:927] Time spent T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:14:37.530969 29522 raft_consensus.cc:1240] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 LEADER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 21. Current term is 22. Ops: []
I20260709 13:14:37.390725  3974 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:37.473248  4043 raft_consensus.cc:2749] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:14:37.540611 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 108600us
I20260709 13:14:37.481534  4128 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:37.456951  4110 consensus_queue.cc:1048] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.097s
I20260709 13:14:37.488126  4177 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:14:37.542562 29421 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:37.531436  4114 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:37.533401  4038 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:14:37.550693  4167 log.cc:927] Time spent T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:14:37.480751  4024 consensus_queue.cc:1048] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
W20260709 13:14:37.562866  4146 log.cc:927] Time spent T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:14:37.582839 29373 raft_consensus.cc:1240] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 21. Current term is 22. Ops: []
I20260709 13:14:37.577818 29421 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:37.601235  4136 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:37.601476  4177 raft_consensus.cc:697] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:37.605460  4177 consensus_queue.cc:237] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:37.611425  4183 log.cc:927] Time spent T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:14:37.615587  4173 raft_consensus.cc:2804] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:14:37.615935 29495 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:37.616329  4173 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:37.616834  4173 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:37.617972 29495 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:14:37.620157  4174 log.cc:927] Time spent T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:14:37.620424  4158 raft_consensus.cc:2749] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:37.622758  4178 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:37.626330 29495 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:14:37.626946 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 49267us
I20260709 13:14:37.627156  4054 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:14:37.627928  4168 log.cc:927] Time spent T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.325s	user 0.001s	sys 0.000s
I20260709 13:14:37.630546  3974 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 22 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:37.632197 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:37.636016 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:37.563247  4126 consensus_queue.cc:1059] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.099s
I20260709 13:14:37.564791  4055 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:37.664057 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:37.534015  3936 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:37.683120 29522 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427"
dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:52288
I20260709 13:14:37.684096 29522 raft_consensus.cc:606] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:37.684543 29522 raft_consensus.cc:614] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:14:37.676682 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 219767us
I20260709 13:14:37.686493 29346 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:37.697866 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 237370us
I20260709 13:14:37.699234 29419 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:37.701884 29346 leader_election.cc:400] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 15. Current term is 16.
I20260709 13:14:37.702699 29528 raft_consensus.cc:1275] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:14:37.710115 29419 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:37.704160 29346 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:37.727290 29419 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:37.729328 29419 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:37.730476  4086 consensus_queue.cc:1048] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:14:37.735082 29419 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:37.694943  4154 raft_consensus.cc:2749] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:37.764621 29452 raft_consensus.cc:1275] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:14:37.769418 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:37.731915  4055 raft_consensus.cc:2749] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:14:37.691789  3983 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:37.737702  4036 raft_consensus.cc:2749] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:37.868762  3465 consensus_queue.cc:1048] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:14:37.748558  4191 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:37.752923  3974 consensus_queue.cc:1059] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.157s
W20260709 13:14:37.932065 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 261997us
W20260709 13:14:37.938575 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 182126us
I20260709 13:14:37.944512 29451 raft_consensus.cc:3055] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:14:37.945019 29451 raft_consensus.cc:740] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:37.945935 29451 consensus_queue.cc:260] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:37.915310  4198 raft_consensus.cc:2749] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:37.964395 29451 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:37.929417  4181 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:14:37.910485  4197 raft_consensus.cc:2749] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:37.907655  4173 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:37.951742  4026 consensus_meta.cc:287] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.506s	user 0.014s	sys 0.000s
I20260709 13:14:37.910279  4194 consensus_queue.cc:1059] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.104s
I20260709 13:14:37.983587  4165 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.024823  4165 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:38.035878  4195 raft_consensus.cc:2749] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:38.037469  4165 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:38.008389  3974 consensus_queue.cc:1243] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer 71aa3578fd924765ab9ac0729c8d1483 log is divergent from this leader: its last log entry 22.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
W20260709 13:14:38.038834  4188 log.cc:927] Time spent T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.298s	user 0.000s	sys 0.001s
I20260709 13:14:38.039620  4196 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:38.040454  4196 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:38.042779  4196 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:38.043529  4164 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:38.044121  4164 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:38.046339  4164 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:38.048696  4194 consensus_queue.cc:1243] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer 71aa3578fd924765ab9ac0729c8d1483 log is divergent from this leader: its last log entry 19.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:14:38.049351  4194 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.050168  4194 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:38.052011  4203 raft_consensus.cc:3055] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:14:38.052608  4203 raft_consensus.cc:740] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:38.053599  4203 consensus_queue.cc:260] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:38.008304  4026 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:38.116357 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:38.118589 29451 raft_consensus.cc:1275] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:14:38.119221 29451 pending_rounds.cc:85] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a: Aborting all ops after (but not including) 9
I20260709 13:14:38.067507  3936 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:38.092260  4136 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:38.129055 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:38.136548 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:38.138631 29451 pending_rounds.cc:107] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:14:38.139142 29451 raft_consensus.cc:2889] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:38.120864  4054 raft_consensus.cc:493] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
W20260709 13:14:38.141191 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 258315us
I20260709 13:14:38.108400  4195 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:38.147653  4195 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:38.160634  3962 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 13:14:38.160952  4054 raft_consensus.cc:515] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:38.174376  4054 leader_election.cc:290] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:14:38.180744  4214 log.cc:927] Time spent T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:14:38.185111 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:38.196614  4127 raft_consensus.cc:993] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5: : Instructing follower 183db85c071f489fbc8de63a9edd8a3a to start an election
I20260709 13:14:38.197299  4127 raft_consensus.cc:1081] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 LEADER]: Signalling peer 183db85c071f489fbc8de63a9edd8a3a to start an election
W20260709 13:14:38.201848  4208 log.cc:927] Time spent T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:14:38.202514  4172 raft_consensus.cc:3055] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:14:38.202996  4172 raft_consensus.cc:740] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:38.203945  4172 consensus_queue.cc:260] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:38.205941  4194 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:38.211952  4026 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:38.214782 29494 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.006s	sys 0.029s
W20260709 13:14:38.215052 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 47416.5us
W20260709 13:14:38.219410 29494 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.007s	sys 0.029s
I20260709 13:14:38.161882  3983 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:38.216648  3936 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:38.229348  3936 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:38.141574  4136 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:38.233460  4136 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:38.218797  4114 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.220046  4191 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.243821 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:38.249441 29523 raft_consensus.cc:2393] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 18: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:38.299813  4194 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:38.300586  4194 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:14:38.321220 29347 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:38.253268  4114 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:38.335400  4194 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:38.337067 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:38.347643  4209 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:38.348723  4209 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:38.354647  4209 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:38.361696  4213 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:38.362926  4213 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:38.367688  4213 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:38.367928 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:38.368847 29524 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:14:38.370965 29344 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:38.372136  4213 raft_consensus.cc:2804] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:38.372701  4213 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:38.373144  4213 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:38.374410  4173 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:38.330825  4172 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:14:38.380700 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 53929us
W20260709 13:14:38.430891 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:38.438127  4022 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:38.446197  4213 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:38.448547 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:38.459386 29495 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.000s	sys 0.003s
W20260709 13:14:38.460121 29495 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.000s	sys 0.004s
W20260709 13:14:38.465096 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:38.437989  4195 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:38.490880 29453 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.073s	sys 0.103s
W20260709 13:14:38.629514 29453 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.074s	sys 0.104s
W20260709 13:14:38.622025 29346 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.066s	sys 0.140s
W20260709 13:14:38.631840 29346 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.067s	sys 0.141s
I20260709 13:14:38.639683 29456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 3825) took 1227 ms. Trace:
I20260709 13:14:38.640470 29456 rpcz_store.cc:276] 0709 13:14:37.412242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.429827 (+ 17585us) service_pool.cc:224] Handling call
0709 13:14:37.430234 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:37.430684 (+   450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:37.430729 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:37.466867 (+ 36138us) log.cc:844] Serialized 26 byte log entry
0709 13:14:37.819697 (+352830us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:14:37.907968 (+ 88271us) log.cc:844] Serialized 14 byte log entry
0709 13:14:37.908295 (+   327us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:37.908421 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:38.450820 (+542399us) spinlock_profiling.cc:243] Waited 7.26 ms on lock 0x7b1800355de0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c672a6 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c993f3 00007f6a78c9b7c1
0709 13:14:38.517728 (+ 66908us) spinlock_profiling.cc:243] Waited 5.35 ms on lock 0x7b1800355de0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c993f3 00007f6a78c9b7c1 00007f6a78c9b779 00007f6a78c9b709 00007f6a78c9b6d1 00007f6a78c9a9cd 000000000038f354 000000000038f199 00007f6a78c7c83a
0709 13:14:38.639078 (+121350us) raft_consensus.cc:1685] finished
0709 13:14:38.639114 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:38.639420 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15137,"prepare.queue_time_us":88006,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":101119,"raft.run_cpu_time_us":446,"raft.run_wall_time_us":36893,"spinlock_wait_cycles":29011584,"thread_start_us":267334,"threads_started":1,"wal-append.queue_time_us":411299}
I20260709 13:14:38.644657 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:38.648015 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:38.649158 29381 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 21.
I20260709 13:14:38.652743 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:38.654891 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:38.656085 29372 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 24.
I20260709 13:14:38.656231 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:38.657096 29379 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:38.657421 29380 raft_consensus.cc:1275] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:14:38.657775 29372 raft_consensus.cc:1240] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 19. Current term is 20. Ops: []
I20260709 13:14:38.659812 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:38.667378 29453 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 3829) took 1253 ms. Trace:
I20260709 13:14:38.667872 29453 rpcz_store.cc:276] 0709 13:14:37.413560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.433881 (+ 20321us) service_pool.cc:224] Handling call
0709 13:14:37.434204 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:37.929601 (+495397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:37.929641 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:37.930221 (+   580us) log.cc:844] Serialized 26 byte log entry
0709 13:14:38.630899 (+700678us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:14:38.666273 (+ 35374us) log.cc:844] Serialized 14 byte log entry
0709 13:14:38.666908 (+   635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:38.667044 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:38.667110 (+    66us) raft_consensus.cc:1685] finished
0709 13:14:38.667121 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:38.667312 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17401,"raft.queue_time_us":129636,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":23733,"thread_start_us":1204599,"threads_started":3,"wal-append.queue_time_us":600186}
I20260709 13:14:38.665649 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:38.670370 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:38.671353 29455 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 22.
I20260709 13:14:38.675551 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:38.676357 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:38.677762 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:38.678699 29521 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:38.669286 29276 catalog_manager.cc:5697] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 21 to 24, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 24 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:38.495548 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:38.686342 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:38.686564 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:38.687987 29455 raft_consensus.cc:2410] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:14:38.688352 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:38.689779 29522 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 24.
I20260709 13:14:38.692168 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:38.693374 29453 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 22.
I20260709 13:14:38.702430 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:38.704903 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:14:38.708185 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:38.709179 29522 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:14:38.715217 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:38.714986 29276 catalog_manager.cc:5697] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 17 to 18, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 18 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:38.720391 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:38.769366 29527 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 22.
I20260709 13:14:38.724921 29453 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1"
dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:45798
I20260709 13:14:38.734040 29529 raft_consensus.cc:1217] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Deduplicated request from leader. Original: 14.9->[15.10-15.10]   Dedup: 15.10->[]
I20260709 13:14:38.737782 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:38.772457 29529 raft_consensus.cc:1240] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:14:38.739075 29452 raft_consensus.cc:1275] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:14:38.737766 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:38.745159 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:38.775718 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:38.464829  3936 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:38.775954 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:38.504956  4039 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:38.507097  4114 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:38.546072  4128 consensus_meta.cc:287] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.980s	user 0.017s	sys 0.000s
I20260709 13:14:38.254345  4191 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:38.561689  4203 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:38.556733  4213 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:38.524459  4225 log.cc:927] Time spent T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.262s	user 0.000s	sys 0.001s
W20260709 13:14:39.009859 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 182597us
I20260709 13:14:39.010702 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:38.777952 29453 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:39.014645 29453 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:39.016269  4194 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.017047  4195 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:39.017730  4195 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:38.783452  3946 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:39.020068  3946 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:38.815874 29455 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
I20260709 13:14:39.023208 29278 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37586 (request call id 141) took 6933 ms. Trace:
I20260709 13:14:38.816622 29451 raft_consensus.cc:1240] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 13:14:39.025228  3790 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:39.026134  4031 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:39.025970  3790 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:39.026791  4031 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:39.017076  4194 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:39.029830 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:39.030825  3946 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:39.031826  4197 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:39.032554  4197 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:38.887257 29379 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 22.
I20260709 13:14:38.878309 29495 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:14:38.894337  4206 log.cc:927] Time spent T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.550s	user 0.006s	sys 0.000s
I20260709 13:14:38.948055  4161 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:38.894102 29376 raft_consensus.cc:1217] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Deduplicated request from leader. Original: 14.9->[15.10-15.10]   Dedup: 15.10->[]
I20260709 13:14:38.943435  4127 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.038235  4127 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:39.040423  4031 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:39.040880  4127 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:38.826290  3991 raft_consensus.cc:493] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:39.055382 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:38.828856  4038 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:38.948834  4173 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:38.920485 29276 catalog_manager.cc:5697] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 27 to 29. New cstate: current_term: 29 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:39.032696  4039 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:39.033691  4106 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:38.895722  4110 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:38.831409 29421 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:38.893064  4136 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:38.977860 29521 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 22.
I20260709 13:14:38.894560  3962 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:38.948151  3804 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:39.042536 29376 raft_consensus.cc:1240] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:14:39.006631 29522 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 19.
I20260709 13:14:39.047063  4129 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:39.047870  4126 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:39.051599 29373 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
W20260709 13:14:39.048831 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 272104us
I20260709 13:14:39.053503  4247 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:39.054263  4197 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:39.055920  4215 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:39.056787  4054 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:14:39.056711  4204 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:39.057592  4198 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:39.058360  4155 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:39.098985  4204 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:39.101886  4204 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:39.102687  4215 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:39.103174 29449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45798 (request call id 3834) took 1688 ms. Trace:
I20260709 13:14:39.103641 29449 rpcz_store.cc:276] 0709 13:14:37.415089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.439224 (+ 24135us) service_pool.cc:224] Handling call
0709 13:14:37.439675 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:37.534282 (+ 94607us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:14:37.554028 (+ 19746us) log.cc:844] Serialized 14 byte log entry
0709 13:14:37.856721 (+302693us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:37.857290 (+   569us) log.cc:844] Serialized 26 byte log entry
0709 13:14:37.857446 (+   156us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:14:37.857481 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:37.857565 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:38.565177 (+707612us) spinlock_profiling.cc:243] Waited 3.28 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:14:39.102628 (+537451us) raft_consensus.cc:1685] finished
0709 13:14:39.102801 (+   173us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:39.102990 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45591,"prepare.queue_time_us":19609,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":194708,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":25560,"spinlock_wait_cycles":7549824,"thread_start_us":356585,"threads_started":2,"wal-append.queue_time_us":664048}
I20260709 13:14:39.105211  4215 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:39.106122 29454 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:38.953651  3983 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:39.077734 29453 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:39.067085  4038 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:39.106071 29373 raft_consensus.cc:606] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 LEADER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:39.090230 29450 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 18.
W20260709 13:14:39.096494 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:39.097842  4054 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:39.101513  4155 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:39.054680 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:38.829838  4181 consensus_queue.cc:1059] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.239s
W20260709 13:14:39.109097 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 278150us
I20260709 13:14:39.124692  4114 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:14:39.125342  4114 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:39.125754  4114 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:39.126443  4026 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:39.126637  4038 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:39.135239 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:39.127830  4039 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:39.127301  4126 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:39.128629  4129 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:39.063895  4173 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:39.141705 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:39.129045  3804 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:39.129592  4106 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:39.087908  3790 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:39.059478  3991 raft_consensus.cc:515] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:39.137279 29453 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:39.121016 29276 catalog_manager.cc:5697] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 18 to 19, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 19 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:39.122574  4054 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:39.099249  4198 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:39.159655  3930 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:39.091966  3962 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:39.160110  4195 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:39.172686  4250 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:39.110234  4161 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:39.175652  3930 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:39.178102  3930 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:39.178200  4161 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:39.183452  4022 consensus_meta.cc:287] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.725s	user 0.019s	sys 0.001s
I20260709 13:14:39.184875 29375 raft_consensus.cc:2410] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 21 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
I20260709 13:14:39.184973  4191 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:39.120676  4110 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:39.185935  4191 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:39.190083  4024 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.190884  4024 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:39.146983  3983 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:39.170698 29346 leader_election.cc:400] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 19. Current term is 20.
I20260709 13:14:39.136312  4247 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:39.186725  4191 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:39.131912  4136 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:39.023718 29278 rpcz_store.cc:276] 0709 13:14:32.089760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:32.089936 (+   176us) service_pool.cc:224] Handling call
0709 13:14:32.169159 (+ 79223us) spinlock_profiling.cc:243] Waited 49.1 ms on lock 0x7b5400422054. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcf0090 00007f6a7bd8ef3a 00007f6a81b451cc 00007f6a81c4337e 00007f6a801042a4 00007f6a80104232 00007f6a80104161 00007f6a801040dc 00007f6a80103392 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:14:39.022870 (+6853711us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:37.588443 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:37.604391 (+ 15948us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:37.604455 (+    64us) write_op.cc:435] Acquired schema lock
0709 13:14:37.604478 (+    23us) tablet.cc:662] Decoding operations
0709 13:14:37.605360 (+   882us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:37.605424 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:37.605462 (+    38us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:14:37.606080 (+   618us) tablet.cc:701] Row locks acquired
0709 13:14:37.606102 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:14:37.606292 (+   190us) write_op.cc:270] Start()
0709 13:14:37.606430 (+   138us) write_op.cc:276] Timestamp: P: 1783602877606234 usec, L: 0
0709 13:14:37.606458 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:14:37.607247 (+   789us) log.cc:844] Serialized 2500 byte log entry
0709 13:14:38.065916 (+458669us) op_driver.cc:464] REPLICATION: finished
0709 13:14:38.540343 (+474427us) write_op.cc:301] APPLY: starting
0709 13:14:38.542131 (+  1788us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:38.559859 (+ 17728us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:38.559982 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:38.564150 (+  4168us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:38.564454 (+   304us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:14:38.564509 (+    55us) write_op.cc:312] APPLY: finished
0709 13:14:38.564832 (+   323us) log.cc:844] Serialized 65 byte log entry
0709 13:14:38.565044 (+   212us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:38.565193 (+   149us) write_op.cc:454] Released schema lock
0709 13:14:38.565288 (+    95us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:38.565869 (+   581us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:38.565914 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3610,"reported_tablets":36,"spinlock_wait_cycles":112956160,"child_traces":[["op",{"apply.queue_time_us":458822,"apply.run_cpu_time_us":10342,"apply.run_wall_time_us":25509,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29159,"num_ops":6,"prepare.queue_time_us":133066,"prepare.run_cpu_time_us":4319,"prepare.run_wall_time_us":67229,"replication_time_us":418543,"thread_start_us":401047,"threads_started":2}]]}
W20260709 13:14:39.229017 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 64759.1us
I20260709 13:14:39.237090 29421 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:39.244933  3804 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:39.249775  3983 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:39.252907  3962 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:39.256677  4198 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:39.259580  4194 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:39.262506 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:39.167198  4026 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:39.213800  4173 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:39.223932  4110 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:39.173761  4250 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:39.288349 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:39.298237 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:39.299710  4129 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:39.306212  4193 raft_consensus.cc:3055] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:14:39.323800  4193 raft_consensus.cc:740] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:39.293150  4155 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:39.328903  4126 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:39.334789 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 52316.5us
I20260709 13:14:39.358074 29276 catalog_manager.cc:5697] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:39.359835 29276 catalog_manager.cc:5697] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:39.363866  4106 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:14:39.289191 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 92359.2us
I20260709 13:14:39.366322  4247 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:39.355834  4110 raft_consensus.cc:2749] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:39.367319 29421 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:39.373049  4136 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:39.373832 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 236085us
I20260709 13:14:39.376550  4191 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:39.379197 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:39.380443 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:39.382405 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:39.391942  4024 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:39.392089 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:39.393898  3991 leader_election.cc:290] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:39.395211 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:39.397217 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:39.402336  4026 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:39.246639  4128 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:39.405133 29374 raft_consensus.cc:1240] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 19. Current term is 20. Ops: []
I20260709 13:14:39.407110 29374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52172 (request call id 2868) took 2103 ms. Trace:
I20260709 13:14:39.407778 29454 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 19.
W20260709 13:14:39.346336 29375 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52186 (request call id 2445) took 2066 ms (client timeout 2169 ms). Trace:
I20260709 13:14:39.407642 29374 rpcz_store.cc:276] 0709 13:14:37.303916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.304331 (+   415us) service_pool.cc:224] Handling call
0709 13:14:37.304733 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:39.405771 (+2101038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:39.406690 (+   919us) spinlock_profiling.cc:243] Waited 2.1 s on lock 0x7b54001d3654. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd86e01 00007f6a7bd8583e 00007f6a80d4a419 00007f6a7a2c1bd4 00007f6a7a2c1b62 00007f6a7a2c1a91 00007f6a7a2c1a0c 00007f6a7a2c0cc2 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:14:39.406996 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4829266816}
W20260709 13:14:39.411708 29375 rpcz_store.cc:269] 0709 13:14:37.279768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:37.279920 (+   152us) service_pool.cc:224] Handling call
0709 13:14:39.345996 (+2066076us) spinlock_profiling.cc:243] Waited 1.9 s on lock 0x7b54003f3754. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd8a2fa 00007f6a80d4bb17 00007f6a7a2c66d4 00007f6a7a2c6662 00007f6a7a2c6591 00007f6a7a2c650c 00007f6a7a2c57c2 00007f6a7a0c148c 00007f6a7a0c08c6 00007f6a7a0c026f
0709 13:14:39.346217 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4368274816}
I20260709 13:14:39.411816  4209 consensus_queue.cc:1048] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:14:39.327167  4250 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:39.416728  4114 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:39.357460  4172 consensus_meta.cc:287] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.981s	user 0.014s	sys 0.006s
I20260709 13:14:39.362548 29276 catalog_manager.cc:5697] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 18 to 23. New cstate: current_term: 23 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
W20260709 13:14:39.410352 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 46174.9us
I20260709 13:14:39.420209 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:39.420209  4173 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:14:39.421988 29346 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:39.424644  4128 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:39.423161  4193 consensus_queue.cc:260] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:39.425177  4247 consensus_queue.cc:1048] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:14:39.422041  4110 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:39.432056  4194 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.463725 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:39.463814  4194 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:39.466898  4194 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:39.467161  4191 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:39.467831  4203 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:39.467903  4191 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:39.468780  4193 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:39.468658  4203 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:39.470491  4191 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:39.434403  4250 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:39.434468  3962 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:39.443408  4136 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:39.473059 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:39.450311 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:39.458191 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:39.461647 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:39.460661 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:39.472275 29419 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:39.475853 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:39.481874 29453 raft_consensus.cc:1275] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:14:39.482143 29527 raft_consensus.cc:2393] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 21: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:39.456327  4173 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:39.472250  4247 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:39.470986  4203 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:39.436926  4054 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:39.483188  3962 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:39.492265 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 70404.9us
I20260709 13:14:39.491631  4155 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:14:39.487247 29276 catalog_manager.cc:5697] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:39.485657  4110 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:39.496788  3962 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:39.496183 29276 catalog_manager.cc:5697] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 14 to 16, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 16 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:39.498569  4250 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:39.503556  4250 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:39.502240 29276 catalog_manager.cc:5697] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 18 to 20, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 20 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:39.487380  4173 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:14:39.503654  4247 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:39.505230 29276 catalog_manager.cc:5697] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 14 to 15, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 15 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:39.507009 29276 catalog_manager.cc:5697] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 17 to 19, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 19 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:39.508684 29276 catalog_manager.cc:5697] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 18 to 19, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 19 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:39.510752  4250 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.511375  4250 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:39.512256 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:39.514022  4250 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:39.518641 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:39.491904  4136 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:39.519336  4110 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:39.531261 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 59213us
I20260709 13:14:39.524652  4155 consensus_queue.cc:1048] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:14:39.526883  4247 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:39.543068 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:39.535265  3962 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:39.545888 29344 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:39.553958 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:39.554858 29522 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:39.559867 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:39.560122 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:39.562124 29346 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:39.564443 29523 raft_consensus.cc:2393] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 19: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
W20260709 13:14:39.570230 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 95500.9us
I20260709 13:14:39.576948 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:39.563328  3962 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:39.583771 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:39.567528  4252 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:39.568646  4114 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:39.578598  4247 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:14:39.592639 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:39.600633 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:39.587272  4155 raft_consensus.cc:2804] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:14:39.601675  4054 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:14:39.618986 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:39.619782  4136 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:39.623852 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:39.594873  4247 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:14:39.634939 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 96515.5us
W20260709 13:14:39.636802 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 79322.6us
I20260709 13:14:39.625507  4247 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:39.626046  4155 raft_consensus.cc:697] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:39.645473 29346 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:39.653496 29419 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:39.636132  4039 consensus_queue.cc:1048] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 13:14:39.667441 29495 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:39.655272  4204 raft_consensus.cc:2749] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:39.684499  3991 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:14:39.670042  4136 raft_consensus.cc:2749] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:14:39.694773 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 46990.6us
I20260709 13:14:39.656193  4054 consensus_queue.cc:1059] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.041s
W20260709 13:14:39.707242 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 69536.6us
W20260709 13:14:39.711143 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:39.710960 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:39.710812 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:39.716495 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:39.717216 29450 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 21.
I20260709 13:14:39.724870  4038 consensus_queue.cc:1048] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 13:14:39.716573  3962 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:39.739781 29495 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:39.731633 29346 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:39.745258 29421 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:39.750921 29522 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 21.
I20260709 13:14:39.750973 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:39.753000 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:39.716171  4155 consensus_queue.cc:237] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:39.755424  4209 raft_consensus.cc:2749] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:39.774714  3683 raft_consensus.cc:2749] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:14:39.776889 29346 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:39.778307  4215 raft_consensus.cc:2804] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:14:39.778842  4215 raft_consensus.cc:697] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:39.771085  3991 raft_consensus.cc:3055] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:14:39.796396  4215 consensus_queue.cc:237] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:39.794380  3991 raft_consensus.cc:740] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:39.810190  3991 consensus_queue.cc:260] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:39.811455  3991 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:39.852254 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:39.853535 29375 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 21.
I20260709 13:14:39.855158 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:39.857026 29419 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:39.894783  4136 raft_consensus.cc:2804] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:14:39.895923  4136 raft_consensus.cc:697] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 22 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:39.896975  4136 consensus_queue.cc:237] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:39.900288 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:39.901459 29447 raft_consensus.cc:2468] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 11.
I20260709 13:14:39.917034  4247 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:39.942034 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 202335us
I20260709 13:14:39.944669 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:39.944360 29495 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:39.926744  4173 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:39.957945  4039 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:14:39.958592  4039 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:39.959082  4039 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:39.955763  4252 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:39.960417 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:39.968286  4247 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:39.996234 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:14:40.010157 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 50760.8us
I20260709 13:14:40.012501 29455 raft_consensus.cc:2393] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 23: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:40.021000 29379 raft_consensus.cc:1275] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:14:40.019539 29419 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:39.970496  4252 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:40.015720  4173 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 25 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:40.073871 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:40.075922 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:40.077720 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:40.078119 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:40.079094 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:40.086388 29374 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Advancing to term 23
W20260709 13:14:40.061443  4255 log.cc:927] Time spent T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:14:40.077782 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:40.042825  4114 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:14:40.100862 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:40.103271 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:40.105041 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:40.113112 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:40.119824 29381 raft_consensus.cc:1275] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 14. (term mismatch)
I20260709 13:14:40.119997 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:40.120389 29381 pending_rounds.cc:85] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5: Aborting all ops after (but not including) 13
I20260709 13:14:40.120708 29381 pending_rounds.cc:107] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5: Aborting uncommitted NO_OP operation due to leader change: 20.14
I20260709 13:14:40.120997 29381 raft_consensus.cc:2889] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:40.141263  4252 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:40.142051 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 136969us
I20260709 13:14:40.143843  4155 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:40.144555  4155 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:40.147740  4155 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:40.147948 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:40.149300 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:40.150470 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:40.151012 29448 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 21.
I20260709 13:14:40.151886 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:40.153232 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:40.174721 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:40.106594  4114 raft_consensus.cc:697] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 21 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:40.186139 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:40.186579 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:40.187458 29376 raft_consensus.cc:2393] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 23: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:40.188280 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:40.188519  4252 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:40.189101 29373 raft_consensus.cc:3055] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:14:40.188314 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:40.190364 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:40.192397 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:40.192633 30121 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:14:40.193583 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 202077us
I20260709 13:14:40.194680 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:40.189522 29373 raft_consensus.cc:740] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:40.196224 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:14:40.196936 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 169043us
I20260709 13:14:40.195681 29381 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 22.
I20260709 13:14:40.199456 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:40.199864  3962 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:40.200434  3962 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:40.201993  4194 consensus_queue.cc:1059] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:14:40.202796  3962 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:40.203064  4194 raft_consensus.cc:3055] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:14:40.205103 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:40.204402 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:40.239302 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:40.240876 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:40.241796 29528 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 21.
I20260709 13:14:40.243170 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:40.158464  4039 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:40.243161 29373 consensus_queue.cc:260] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:40.252573 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:40.252722 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:40.248594 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:40.248683 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:40.258639 29373 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:40.259537 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:40.236250  4194 raft_consensus.cc:740] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:40.189184  4252 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:40.194125  4215 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.203961  4106 raft_consensus.cc:2804] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:14:40.249308  4172 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.284278 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:40.271886  4114 consensus_queue.cc:237] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:40.244168  4054 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:40.280737  4039 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:40.283298 29373 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 21.
I20260709 13:14:40.289681 29374 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 23.
I20260709 13:14:40.293286 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:40.302354 29530 raft_consensus.cc:2393] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 23: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:40.255218  4193 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:40.198334  3683 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:40.256845  4173 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:40.303735 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:40.306619 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:40.311429 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:40.292064  4106 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:40.317292 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:40.293411  3991 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:40.320495 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:40.321282  4106 raft_consensus.cc:3060] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:40.302254  4136 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:14:40.332475 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:40.332603 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:14:40.335673  4267 log.cc:927] Time spent T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:14:40.326460  3991 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:40.321430  3683 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:40.338562  3991 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:14:40.341837  4259 log.cc:927] Time spent T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.314s	user 0.003s	sys 0.000s
I20260709 13:14:40.311479  4172 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:40.353055  4172 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:40.324731  4194 consensus_queue.cc:260] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:40.362766  4194 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:40.366408  4106 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:40.370870  4106 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 12 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:40.373636 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:40.390945 29529 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 29.
I20260709 13:14:40.376783 29523 raft_consensus.cc:1240] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 20. Current term is 21. Ops: []
I20260709 13:14:40.378062 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:40.391983  3962 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:40.392627 29530 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 24.
I20260709 13:14:40.392923  3962 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:40.305212  4054 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:40.311811  4193 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:40.318311  4173 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:40.412945  4136 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:40.416750 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:40.417717 29379 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 21.
I20260709 13:14:40.417865 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:40.418790 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:40.419430 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:40.421095 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:40.422338 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:40.423178 29373 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 20.
I20260709 13:14:40.418869 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:40.440342 29344 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:40.459009 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:40.460261 29376 raft_consensus.cc:2393] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 23: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:40.387115  4252 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:40.472290 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:40.292497  4215 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:40.480101 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:40.485144 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:40.491040 29374 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:14:40.478718  4172 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 13:14:40.489820 29344 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:14:40.500324 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:40.500697 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:40.507117 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:40.506960 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:40.545332 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:40.546777 29373 raft_consensus.cc:2376] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 22. Re-sending same reply.
I20260709 13:14:40.548026 30153 raft_consensus.cc:1240] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 12 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:14:40.551679 29421 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:40.494583  4172 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 29 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:40.562634 29522 raft_consensus.cc:1275] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:14:40.558030 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:40.566632 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:40.569070 29528 raft_consensus.cc:3060] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:14:40.579807 29528 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 25.
I20260709 13:14:40.581959 29421 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:40.587344 29455 raft_consensus.cc:1240] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 21 LEADER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 20. Current term is 21. Ops: []
I20260709 13:14:40.590991 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:40.544970  3683 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:40.563719  3962 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:40.576370  4172 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:14:40.593215  4114 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:40.589095  4136 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:14:40.661523 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:40.620204 29495 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:40.610421  4054 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:40.623075  3962 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:40.733783 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:14:40.776975 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:40.788054 29377 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf5703156380472bb793863fd4fd7544"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:14:40.777057 29374 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 25.
W20260709 13:14:40.784317  4271 log.cc:927] Time spent T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.228s	user 0.002s	sys 0.000s
I20260709 13:14:40.740841  4054 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:40.817422 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:40.817780 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:40.789054 29377 raft_consensus.cc:606] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:40.823318 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:40.823451 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:14:40.794878 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 206289us
I20260709 13:14:40.796238  4024 raft_consensus.cc:2764] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 25 FOLLOWER]: Leader pre-election decision vote started in defunct term 24: won
W20260709 13:14:40.847065 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 265255us
W20260709 13:14:40.849225 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 229111us
I20260709 13:14:40.854200 29455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:40.858048 29455 raft_consensus.cc:2393] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 25: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:40.858321 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:14:40.856793 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 314422us
W20260709 13:14:40.872255  4282 log.cc:927] Time spent T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:14:40.873322 29374 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 21.
I20260709 13:14:40.850162 29421 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:40.875260  3962 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:14:40.875793  3962 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:14:40.876279  4280 log.cc:927] Time spent T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:14:40.876230  3962 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:40.877784 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:40.879021 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:40.880481 29421 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:40.881255 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:40.881489 29346 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:40.881908 29421 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:40.882400 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:40.884956 29455 raft_consensus.cc:1275] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 13:14:40.858675  4278 log.cc:927] Time spent T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:14:40.888875 29346 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:40.866842 29376 consensus_queue.cc:237] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:40.893488 29346 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:40.894881 29451 raft_consensus.cc:1275] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:14:40.893708 29419 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:40.896499 29346 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:40.898100  4258 raft_consensus.cc:2749] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:40.861012  4215 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:40.893718  4204 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:40.900463  4291 raft_consensus.cc:2749] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:40.917016  4136 raft_consensus.cc:2749] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:40.901998 29346 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:40.904727  4285 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:40.904552  4279 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:14:40.938215  4279 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:40.938586  4279 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:40.907234  4290 raft_consensus.cc:2749] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:40.941562 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:40.944605 29346 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:40.945715  4204 raft_consensus.cc:2749] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:40.946385  4204 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:40.946235 29346 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:40.915122  4114 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:14:40.947381 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 47606us
I20260709 13:14:40.951007  4172 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:40.910247  4288 log.cc:927] Time spent T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:14:40.947320  4173 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:40.984949 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:40.985386 30121 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:40.986654 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:40.990281 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 44158us
I20260709 13:14:40.993327 29346 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:40.988024 29495 leader_election.cc:304] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:40.998610 29346 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:40.999580  4291 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:41.002036 29381 raft_consensus.cc:1240] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 30 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 29. Current term is 30. Ops: []
I20260709 13:14:41.001781  3991 raft_consensus.cc:2749] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:41.008037  4285 consensus_queue.cc:1048] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:14:41.012192 29521 raft_consensus.cc:1240] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 21. Current term is 22. Ops: []
I20260709 13:14:41.014890 29495 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:41.015981  3991 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:41.021015  4172 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 30 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:41.022544  4129 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:40.999209  4289 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:14:41.002645 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:41.024132 29495 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:40.998828  4221 raft_consensus.cc:2749] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:14:41.032945 29346 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:41.031584 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 149754us
I20260709 13:14:41.034945 29421 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:41.037147 29346 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:41.038367 29346 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:41.026414  4193 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:41.040244 29346 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:41.032845  4289 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:41.044731  4289 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:41.042804  3683 raft_consensus.cc:2749] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:14:41.040167  4126 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:41.050959 29421 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:41.042819 29346 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:41.054702  4215 raft_consensus.cc:2749] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:41.056463 29346 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:41.064643 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:14:41.067458  4281 log.cc:927] Time spent T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.570s	user 0.007s	sys 0.004s
I20260709 13:14:41.039767  3962 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:41.112715 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:41.036067  4054 raft_consensus.cc:2749] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:41.039393  4285 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:41.063695  4193 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:41.040397  4291 raft_consensus.cc:2749] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:14:41.148571 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 97713.1us
I20260709 13:14:41.176581 29421 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:41.149572 29530 raft_consensus.cc:1275] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:14:41.154366 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 97978.8us
I20260709 13:14:41.155141  4039 consensus_queue.cc:1048] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:14:41.162983  4194 consensus_meta.cc:287] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.800s	user 0.017s	sys 0.000s
W20260709 13:14:41.149964 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 96327us
I20260709 13:14:41.157727  4247 raft_consensus.cc:2749] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:14:41.161967 29375 raft_consensus.cc:2393] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 25: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
W20260709 13:14:41.158944 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 83461.8us
I20260709 13:14:41.156376 29526 raft_consensus.cc:1275] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:14:41.178372 29346 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:41.158697  4173 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:41.183923 29421 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:41.169641  4297 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.197708  4194 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:14:41.189832  4252 raft_consensus.cc:2749] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:41.209481 29421 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:41.216300 29421 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:41.221022 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:41.171986  4279 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:41.224371  4279 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:41.228621 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 50461.5us
I20260709 13:14:41.228271 29421 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:41.205538  3683 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:41.233953  4193 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:41.234803  4193 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:41.236729  4300 log.cc:927] Time spent T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.066s	user 0.003s	sys 0.000s
I20260709 13:14:41.237864  4193 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:41.238803  4194 raft_consensus.cc:2749] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:14:41.245142 29495 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:41.228775  4173 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:41.240031 29421 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:41.247704 29346 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:41.272716 29421 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:41.252341  4054 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:14:41.263242  3962 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:41.264186  4173 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:41.241451  4279 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:14:41.280436  4155 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:14:41.270711  4194 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:41.285614 29346 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:41.287940 29346 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:41.290172  4247 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:41.248010 29495 leader_election.cc:304] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:41.210553  4297 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:41.276469 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 69656.9us
I20260709 13:14:41.277973 29421 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:41.302678  4126 consensus_queue.cc:1048] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:14:41.309100  4297 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:41.303236  4204 consensus_queue.cc:1059] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:14:41.272445  4285 consensus_queue.cc:1048] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:14:41.298679  4252 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:41.303896  4173 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:41.319856  4302 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.320681  4302 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:41.324852  4289 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:41.299818  4279 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:41.331903  4279 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:41.338147  4289 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:41.319327  4173 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:41.340368 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 92430us
W20260709 13:14:41.342617 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 50057.4us
I20260709 13:14:41.345638 29495 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:14:41.347100 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 69240.2us
I20260709 13:14:41.347980 29421 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:41.344473  4054 raft_consensus.cc:2749] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:41.291471  4247 raft_consensus.cc:2749] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:41.353247  4039 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:14:41.354164  4292 consensus_queue.cc:1048] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:14:41.350589  4173 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:41.364948 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:41.359179  3683 raft_consensus.cc:993] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5: : Instructing follower 183db85c071f489fbc8de63a9edd8a3a to start an election
I20260709 13:14:41.359923 29495 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:14:41.350545 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 161241us
I20260709 13:14:41.345510  4302 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:41.374607 29524 raft_consensus.cc:2393] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 21: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:41.346223  4291 consensus_queue.cc:1048] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:14:41.380791  4301 consensus_queue.cc:1048] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:41.376201  4252 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:41.385987 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:41.387809  3683 raft_consensus.cc:1081] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 LEADER]: Signalling peer 183db85c071f489fbc8de63a9edd8a3a to start an election
I20260709 13:14:41.388899  3683 raft_consensus.cc:3055] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:14:41.389299  3683 raft_consensus.cc:740] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:41.394685 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:41.395601 29447 raft_consensus.cc:2368] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 21. Current term is 22.
I20260709 13:14:41.396471  4292 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:14:41.402312 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 44694.6us
I20260709 13:14:41.376858 29421 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:41.361402  4172 consensus_queue.cc:1059] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:14:41.408450  4172 raft_consensus.cc:3055] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:14:41.408936  4172 raft_consensus.cc:740] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:41.409957  4172 consensus_queue.cc:260] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:41.412819  4247 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.413041 30153 raft_consensus.cc:1275] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 19 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:14:41.413581  4247 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:41.423830 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 47094.5us
I20260709 13:14:41.425413 29421 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:41.435472 29421 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:41.432178  3683 consensus_queue.cc:260] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:41.411439  4172 raft_consensus.cc:3060] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:14:41.456375 29276 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37594 (request call id 143) took 4529 ms. Trace:
W20260709 13:14:41.460255 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 100433us
I20260709 13:14:41.431463  4252 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:14:41.446933  4173 raft_consensus.cc:2749] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:14:41.461095 29495 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:41.463912  4297 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:41.471127 29421 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:41.456878 29276 rpcz_store.cc:276] 0709 13:14:36.927128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:36.927334 (+   206us) service_pool.cc:224] Handling call
0709 13:14:36.945255 (+ 17921us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b5400002490. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61b71 00007f6a78c620b2 00007f6a81bdba89 00007f6a81b73da6 00007f6a81b45088 00007f6a81c4337e 00007f6a801042a4 00007f6a80104232 00007f6a80104161 00007f6a801040dc
0709 13:14:41.456293 (+4511038us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:39.683888 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:39.739263 (+ 55375us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:39.739324 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:14:39.739344 (+    20us) tablet.cc:662] Decoding operations
0709 13:14:39.803342 (+ 63998us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:39.803456 (+   114us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:39.803602 (+   146us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:14:39.804954 (+  1352us) tablet.cc:701] Row locks acquired
0709 13:14:39.805024 (+    70us) write_op.cc:260] PREPARE: finished
0709 13:14:39.805224 (+   200us) write_op.cc:270] Start()
0709 13:14:39.805403 (+   179us) write_op.cc:276] Timestamp: P: 1783602879805146 usec, L: 0
0709 13:14:39.805434 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:14:39.908371 (+102937us) log.cc:844] Serialized 5237 byte log entry
0709 13:14:40.270763 (+362392us) op_driver.cc:464] REPLICATION: finished
0709 13:14:40.485267 (+214504us) write_op.cc:301] APPLY: starting
0709 13:14:40.485380 (+   113us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:41.045297 (+559917us) spinlock_profiling.cc:243] Waited 7.1 ms on lock 0x7b18000c74e0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a7bac50ec 00007f6a7bac7af7 00007f6a7bac8fb0 00007f6a7f7dd1bb 00007f6a7f7dd532 00007f6a7f824b93 00007f6a7f6d1de3 00007f6a7f6d16ab 00007f6a7f6d2e77
0709 13:14:41.052309 (+  7012us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:41.052355 (+    46us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:41.259965 (+207610us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:41.260531 (+   566us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 13:14:41.260605 (+    74us) write_op.cc:312] APPLY: finished
0709 13:14:41.261144 (+   539us) log.cc:844] Serialized 121 byte log entry
0709 13:14:41.261381 (+   237us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:41.261636 (+   255us) write_op.cc:454] Released schema lock
0709 13:14:41.261718 (+    82us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:41.299983 (+ 38265us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:41.304871 (+  4888us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":46483,"reported_tablets":21,"spinlock_wait_cycles":31354752,"child_traces":[["op",{"apply.queue_time_us":214142,"apply.run_cpu_time_us":48462,"apply.run_wall_time_us":788258,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58363,"num_ops":13,"prepare.queue_time_us":134662,"prepare.run_cpu_time_us":31752,"prepare.run_wall_time_us":303882,"raft.queue_time_us":185610,"raft.run_cpu_time_us":94217,"raft.run_wall_time_us":220501,"replication_time_us":461308,"spinlock_wait_cycles":16338304,"thread_start_us":516283,"threads_started":4,"wal-append.queue_time_us":115256}]]}
I20260709 13:14:41.478003  4292 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:14:41.480360  4193 raft_consensus.cc:2804] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:14:41.495353  4136 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:41.469237  4279 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:41.501390  3962 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:41.481387  4194 consensus_queue.cc:1059] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 29.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.022s
I20260709 13:14:41.500933  4247 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:41.509320  4292 raft_consensus.cc:697] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:41.530308  4292 consensus_queue.cc:237] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:41.506901  4136 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:41.519615  4291 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.538393  4136 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:41.541720 29375 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f06f688759cd438a95541a7639513cec"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:14:41.542514 29375 raft_consensus.cc:606] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:41.543409 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:41.544176 29521 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 21.
I20260709 13:14:41.547962 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:14:41.551620 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:41.553561 29381 raft_consensus.cc:1275] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:14:41.526081  3683 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:41.527662  4194 raft_consensus.cc:3055] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 29 LEADER]: Stepping down as leader of term 29
I20260709 13:14:41.558625 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:41.559216 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:41.559235 29377 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:41.528844  4297 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:41.538080  4291 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:41.526722  4279 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:41.557134 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:41.572023 29379 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 22.
I20260709 13:14:41.557399 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:41.557699 29346 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:41.573074 29378 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 22.
I20260709 13:14:41.562863 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:41.574119 29373 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 16.
I20260709 13:14:41.563540 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:14:41.564466 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 57734.6us
I20260709 13:14:41.566672 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:41.570184 29376 raft_consensus.cc:1275] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:14:41.575229 29380 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:41.578428  4291 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:41.574066  4299 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:41.579692 29454 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98"
dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:45798
I20260709 13:14:41.579628  4299 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:41.580427 29454 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:41.580850 29454 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:41.569985  4297 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:41.506381  4193 raft_consensus.cc:697] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 25 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:41.584441  4193 consensus_queue.cc:237] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:41.585067  4297 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:41.588243  4307 consensus_queue.cc:1048] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 13:14:41.596544  4258 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:41.597304  4258 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:41.600842 29346 leader_election.cc:400] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 21. Current term is 22.
I20260709 13:14:41.601328  4289 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 13:14:41.604890 29377 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 22.
I20260709 13:14:41.601338 29346 leader_election.cc:403] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:14:41.559049  4194 raft_consensus.cc:740] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 29 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:41.607100  4301 raft_consensus.cc:2955] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 LEADER]: Committing config change with OpId 19.14: config changed from index 13 to 14, VOTER 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:41.608430  4285 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 21. Current term is 22.
I20260709 13:14:41.608523  4194 consensus_queue.cc:260] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 29.15, Last appended by leader: 15, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:41.610023  4194 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:14:41.563858  3962 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:41.615932  4291 raft_consensus.cc:993] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5: : Instructing follower 183db85c071f489fbc8de63a9edd8a3a to start an election
I20260709 13:14:41.616544  4291 raft_consensus.cc:1081] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Signalling peer 183db85c071f489fbc8de63a9edd8a3a to start an election
I20260709 13:14:41.605870 29344 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:41.617472  4129 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:14:41.617939  4129 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:41.618275  4129 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:41.620750  4024 raft_consensus.cc:993] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5: : Instructing follower 183db85c071f489fbc8de63a9edd8a3a to start an election
I20260709 13:14:41.621292  4024 raft_consensus.cc:1081] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Signalling peer 183db85c071f489fbc8de63a9edd8a3a to start an election
I20260709 13:14:41.628567 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:41.629331 29522 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 20.
I20260709 13:14:41.629511 29380 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 23.
I20260709 13:14:41.638335 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:41.649631 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:41.650569 29375 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:41.639211 29448 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 22.
I20260709 13:14:41.653059 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:41.653421 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:41.653729 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:41.653939 29380 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 17.
I20260709 13:14:41.654101 29377 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 20.
I20260709 13:14:41.635164 29454 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:41.636067 29522 raft_consensus.cc:2955] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, VOTER 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:41.595335 29278 catalog_manager.cc:5697] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:41.668632 29376 raft_consensus.cc:2393] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 20: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:41.582278  4299 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:41.676997 29344 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:41.677403 29421 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:41.682663 29421 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:41.697525 29278 catalog_manager.cc:5697] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:41.716926 29421 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:41.687263  4289 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:14:41.693774  4297 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:14:41.729473 29278 catalog_manager.cc:5697] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:41.740374 29454 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:41.675957  4279 consensus_queue.cc:1048] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:14:41.721870  4299 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:41.724826  4252 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:14:41.770068 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 44497.6us
I20260709 13:14:41.775851 29376 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:14:41.776592 29376 raft_consensus.cc:606] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:41.777009 29376 raft_consensus.cc:614] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:14:41.761673 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:41.755422 29278 catalog_manager.cc:5697] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 20 to 21, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 21 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:41.739053  4289 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:41.785036 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 95213.3us
I20260709 13:14:41.796416 29278 catalog_manager.cc:5697] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:41.745879  4173 raft_consensus.cc:2804] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:41.746485  4297 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:41.804293  4297 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:41.803884 29278 catalog_manager.cc:5697] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 19 to 22. New cstate: current_term: 22 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:41.806752 29278 catalog_manager.cc:5697] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:41.741397  4193 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:41.799088  4173 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:41.781407  4039 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:41.779016  4252 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:41.797995  4289 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:41.834574 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:41.788447  3962 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:41.800021  4215 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:41.778366  4136 consensus_queue.cc:1048] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:14:41.828326  4173 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:41.840981 29278 catalog_manager.cc:5697] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 16 to 18, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 18 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
W20260709 13:14:41.849288 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 123084us
I20260709 13:14:41.854521 29421 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:41.854159 29278 catalog_manager.cc:5697] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 15 to 16, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 16 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:41.848151 29495 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:41.842446 28234 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:14:41.832939  4252 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:41.798365  4299 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:41.829612  4258 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:41.855767 29421 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:14:41.861581  4317 log.cc:927] Time spent T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.158s	user 0.000s	sys 0.002s
I20260709 13:14:41.834134  4039 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:41.861409  4279 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:14:41.873363 29421 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:41.837354  4193 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:41.896919 29495 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:41.873888  3991 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:14:41.852380  4215 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:41.903280 29376 raft_consensus.cc:1240] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 22. Current term is 23. Ops: []
I20260709 13:14:41.915791 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:41.921375 29448 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
I20260709 13:14:41.906533 29377 raft_consensus.cc:1240] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 22. Current term is 23. Ops: []
I20260709 13:14:41.922650 29375 raft_consensus.cc:2468] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 22.
I20260709 13:14:41.972225 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:41.899377  4279 raft_consensus.cc:697] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 22 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:42.069820 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:42.208945 29529 raft_consensus.cc:1275] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:14:42.143411 29375 raft_consensus.cc:1240] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 13:14:42.068024 29450 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f06f688759cd438a95541a7639513cec"
dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:45798
I20260709 13:14:42.134678 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:42.315459 29344 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:42.348065 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:42.135350 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:42.132375 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 52753.1us
I20260709 13:14:42.343868 29495 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:42.218138 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:42.464135 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 120400us
I20260709 13:14:42.073460 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:42.358790 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:14:42.032902 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:42.237046 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:42.465873 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:42.208076 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:42.195166 29526 raft_consensus.cc:1275] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:14:42.461310 29447 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 19.
I20260709 13:14:42.143121 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:42.435883 29450 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:42.468655 29450 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:42.339818 29452 raft_consensus.cc:1275] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:14:42.469723 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:41.978125 28234 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:42.470523 29522 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:42.136989 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:42.218727  4313 log.cc:927] Time spent T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.331s	user 0.002s	sys 0.000s
I20260709 13:14:42.473855 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:42.046573 29454 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf5703156380472bb793863fd4fd7544"
dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:45798
I20260709 13:14:42.480252 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:14:42.331951  4297 consensus_meta.cc:287] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.527s	user 0.007s	sys 0.005s
W20260709 13:14:42.281147  4129 consensus_meta.cc:287] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.662s	user 0.012s	sys 0.000s
W20260709 13:14:42.272161  4301 consensus_meta.cc:287] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.663s	user 0.007s	sys 0.007s
I20260709 13:14:42.465332 29495 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:42.301504  4215 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:41.903568  4321 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:14:42.205154  4204 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.004s	sys 0.004s
W20260709 13:14:42.316820  4194 consensus_meta.cc:287] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.706s	user 0.013s	sys 0.002s
I20260709 13:14:42.484886 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:42.486250 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:42.487205 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:42.240535  4327 log.cc:927] Time spent T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:14:41.925760  4303 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:14:41.936897  4024 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:42.252715  4172 consensus_meta.cc:287] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5: Time spent flushing consensus metadata: real 0.796s	user 0.014s	sys 0.000s
I20260709 13:14:42.495930 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:41.928367  4136 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:14:42.497139 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:42.149437  4302 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:42.246652  4039 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:42.496604 29530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37968 (request call id 5106) took 1125 ms. Trace:
I20260709 13:14:41.982390  4193 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:42.055971  3991 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:42.503733 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:41.983485  4314 log.cc:927] Time spent T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:14:42.504251 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:42.230641  4299 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:42.512477  4257 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.556017  4257 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:42.536805  4024 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:42.558804 29379 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 21.
I20260709 13:14:42.559012  4024 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:42.512466 30120 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.000s	sys 0.048s
W20260709 13:14:42.560287 30120 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.000s	sys 0.048s
I20260709 13:14:42.504374  4310 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:14:42.561456 29454 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:42.561808  4310 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:42.561961 29454 raft_consensus.cc:3060] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:42.562286  4310 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:42.519646  3962 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.563781  3962 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:42.564214 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:42.564783  4339 consensus_queue.cc:1059] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:14:42.535869  4308 consensus_queue.cc:1048] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:14:42.566037  3962 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:42.326485  4173 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:42.568200  4173 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:42.568888 29456 raft_consensus.cc:1240] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 16. Current term is 17. Ops: []
I20260709 13:14:42.521407 29522 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 22.
I20260709 13:14:42.350773  4289 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:42.508955  4320 raft_consensus.cc:2749] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:42.522176 29450 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:42.333297  4252 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:42.525288  4204 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.007s	sys 0.006s
I20260709 13:14:42.530969 29524 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 21.
I20260709 13:14:42.537675 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:42.537973 29494 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.780s	user 0.002s	sys 0.018s
W20260709 13:14:42.536981 29278 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.013s	sys 0.007s
I20260709 13:14:42.534992 29530 rpcz_store.cc:276] 0709 13:14:41.361976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.362151 (+   175us) service_pool.cc:224] Handling call
0709 13:14:41.362514 (+   363us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:14:41.473803 (+111289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:41.473843 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:14:41.479604 (+  5761us) log.cc:844] Serialized 52 byte log entry
0709 13:14:41.771861 (+292257us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:14:41.865980 (+ 94119us) log.cc:844] Serialized 14 byte log entry
0709 13:14:41.886419 (+ 20439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:41.886517 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:14:42.486776 (+600259us) raft_consensus.cc:1685] finished
0709 13:14:42.486804 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:14:42.486956 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65998,"prepare.queue_time_us":87295,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":52969,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":12837,"thread_start_us":333754,"threads_started":3,"wal-append.queue_time_us":353460}
W20260709 13:14:42.594430 29494 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.002s	sys 0.018s
I20260709 13:14:42.502987  4129 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:42.595086 29493 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.075s	sys 0.098s
I20260709 13:14:42.497359  4297 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:42.595552 29493 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.076s	sys 0.098s
I20260709 13:14:42.597210  4297 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:42.601773 29346 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:42.602042  4129 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:42.526929  4321 raft_consensus.cc:697] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 23 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:42.603948  4024 raft_consensus.cc:2749] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:42.573912 29454 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:14:42.548764 29421 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.054s	sys 0.051s
W20260709 13:14:42.605584 29421 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.054s	sys 0.051s
W20260709 13:14:42.606202 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 732934us
I20260709 13:14:42.606906 29421 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:42.593976 29450 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:42.603470  4321 consensus_queue.cc:237] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:42.595309 29278 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.013s	sys 0.007s
I20260709 13:14:42.608636 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:42.610057  4331 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:14:42.610409 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:42.610610  4331 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:42.611070  4331 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:42.611231 29454 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:42.612156 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:42.612874 29447 raft_consensus.cc:2393] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 23: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:42.615142 29421 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:42.616376 29421 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:42.617456  3962 raft_consensus.cc:2804] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:42.618037 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:14:42.618091  3962 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:42.619118 30153 raft_consensus.cc:3060] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:42.619400  3962 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:42.621783  4173 raft_consensus.cc:2804] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:14:42.622424  4173 raft_consensus.cc:697] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 22 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:42.577373  4054 consensus_queue.cc:1059] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 13:14:42.570874  3991 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:42.628851  3991 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:42.631637 29373 raft_consensus.cc:2393] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 21: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:42.559057  4257 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:42.636679 29448 raft_consensus.cc:1240] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 22. Current term is 23. Ops: []
W20260709 13:14:42.635149 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 63532.7us
W20260709 13:14:42.636191 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 128522us
I20260709 13:14:42.541164  4279 consensus_queue.cc:237] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:42.634013  4289 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:42.540596  4302 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:42.648998 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:42.650002 29521 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 21.
I20260709 13:14:42.654027 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:42.654785 29522 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:14:42.655479 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:42.656152 29527 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 22.
I20260709 13:14:42.634701  4301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:52164 (request call id 68) took 2045 ms. Trace:
I20260709 13:14:42.660151  4252 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:42.648312  4024 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.660259  4301 rpcz_store.cc:276] 0709 13:14:40.549070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:40.567343 (+ 18273us) service_pool.cc:224] Handling call
0709 13:14:40.865378 (+298035us) spinlock_profiling.cc:243] Waited 34.9 ms on lock 0x7b540005e9a0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bcfdec4 00007f6a7bd818d7 00007f6a7bd8d03c 00007f6a7bd8c6b3 00007f6a7bd849fa 00007f6a80d4c4c9 00007f6a7a2c8c54 00007f6a7a2c8be2 00007f6a7a2c8b11 00007f6a7a2c8a8c
0709 13:14:40.944865 (+ 79487us) log.cc:844] Serialized 508 byte log entry
0709 13:14:41.204075 (+259210us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b540005e9a0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bd06b26 00007f6a7bd0049a 00007f6a7bcff714 00007f6a7bcdfeaa 00007f6a7bce6d53 00007f6a7bce6cd9 00007f6a7bce6c69 00007f6a7bce6c31 00007f6a7bce5dfd 000000000038f354
0709 13:14:41.235992 (+ 31917us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:14:41.315071 (+ 79079us) spinlock_profiling.cc:243] Waited 37.7 ms on lock 0x7b540005e9a0. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcef571 00007f6a7bcfbdbe 00007f6a7bd06930 00007f6a7bd068d8 00007f6a7bd06858 00007f6a7bd06813 00007f6a7bd05a9c 00007f6a81bf1626 00007f6a81bebdd8 00007f6a7bd427cb 00007f6a7bd452c0
0709 13:14:42.593032 (+1277961us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":220,"mutex_wait_us":7663,"raft.queue_time_us":3368,"raft.run_cpu_time_us":6737,"raft.run_wall_time_us":184637,"spinlock_wait_cycles":225795456,"thread_start_us":85745,"threads_started":1,"wal-append.queue_time_us":99146,"wal-append.run_cpu_time_us":11707,"wal-append.run_wall_time_us":1276840}
I20260709 13:14:42.661468  4024 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:42.659788  4173 consensus_queue.cc:237] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:42.664534  4302 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:42.669744 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:42.645327 30155 raft_consensus.cc:2955] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, VOTER 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:42.670053  4342 raft_consensus.cc:3055] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:14:42.676190  4342 raft_consensus.cc:740] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:42.677170  4342 consensus_queue.cc:260] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:42.678504  4342 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:42.679348 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:42.679957 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: true dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:42.680162  4024 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:42.680559 30153 raft_consensus.cc:2468] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11.
I20260709 13:14:42.682947 29419 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:14:42.690498 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:42.690914 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:42.694547 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:42.694650 29377 raft_consensus.cc:3055] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:14:42.691705 29381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:42.695465 29373 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 22.
I20260709 13:14:42.696681 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:42.696993 29421 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:42.697444 29373 raft_consensus.cc:3055] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:14:42.697888 29373 raft_consensus.cc:740] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:42.698694 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:42.699210 29448 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:14:42.695196 29377 raft_consensus.cc:740] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:42.701680 29381 raft_consensus.cc:2393] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 23: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:42.701576 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:42.702286 29454 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 23.
I20260709 13:14:42.702608 29522 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 23.
I20260709 13:14:42.700289 29377 consensus_queue.cc:260] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:42.705277 29377 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:42.704962 29373 consensus_queue.cc:260] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:42.708101 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:42.708613 29378 raft_consensus.cc:1275] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 25 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:14:42.709106 29380 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 20.
I20260709 13:14:42.710299 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:14:42.711670 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 70908.8us
I20260709 13:14:42.707334 29265 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c2aced39aead4259aa7f2a9995ec3ea5 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:42.718884 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:42.711263 29346 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:42.722755 29373 raft_consensus.cc:3060] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:14:42.725108 29448 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 21.
W20260709 13:14:42.711315  4257 consensus_queue.cc:1175] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" responder_term: 10 status { last_received { term: 10 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 10 index: 10 } }
I20260709 13:14:42.704864  3962 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:42.704380  4252 raft_consensus.cc:2804] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:14:42.738422  4129 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:14:42.736009  4215 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:42.707691  4299 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:14:42.810767 29373 raft_consensus.cc:2468] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 11.
I20260709 13:14:42.737202 29346 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:42.723672 29344 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:42.819649  4129 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:14:42.835358 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 98239.3us
I20260709 13:14:42.829144 29377 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 19.
W20260709 13:14:42.805639 29419 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.146.131:35367 timed out after 1.599s (SENT) [suppressed 12 similar messages]
W20260709 13:14:42.839066 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 125749us
I20260709 13:14:42.841224 29421 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:42.835796  4129 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:14:42.846300  4204 raft_consensus.cc:2749] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:42.840116  4257 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:42.842001  4172 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:14:42.849762 29421 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:14:42.858242 29493 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:42.858386 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 145796us
I20260709 13:14:42.840790  3991 raft_consensus.cc:3055] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:14:42.836372  4215 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:42.838837  4252 raft_consensus.cc:697] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 11 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:42.858198 29421 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:42.878530 29495 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:42.870122 29344 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:42.843616  4299 raft_consensus.cc:697] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 22 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:42.904349  4331 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:42.904788  4299 consensus_queue.cc:237] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:42.905462  4279 raft_consensus.cc:2804] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:14:42.906317  4279 raft_consensus.cc:697] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 19 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:42.901278 29448 raft_consensus.cc:1240] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 22 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 21. Current term is 22. Ops: []
W20260709 13:14:42.910144  4349 log.cc:927] Time spent T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 13:14:42.894088 29344 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:42.894068  4320 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:14:42.911288  4320 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:42.911725  4320 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:42.883606  3991 raft_consensus.cc:740] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:42.915055  3991 consensus_queue.cc:260] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:42.908298 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:42.899955 29447 raft_consensus.cc:1240] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 23 LEADER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 22. Current term is 23. Ops: []
I20260709 13:14:42.881946  4303 consensus_queue.cc:1059] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 13:14:42.869164  4336 raft_consensus.cc:2804] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:14:42.862419  4173 consensus_queue.cc:1048] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.072s
I20260709 13:14:42.862577  4172 raft_consensus.cc:697] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:42.853555  4257 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:42.858484  4321 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:42.907172  4331 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:42.918001 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:42.921505 29344 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:42.916853  3962 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:42.945035 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:42.945919 29379 raft_consensus.cc:2393] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 20: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:42.945802  4292 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:42.946431  4292 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:42.948747  4292 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:42.948458 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:42.950800 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:42.952960 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
W20260709 13:14:42.954640 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 149042us
I20260709 13:14:42.954949 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:42.956012  4303 raft_consensus.cc:3055] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:14:42.956779 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:42.924382  4346 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:14:43.003582 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:42.925217  4310 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:43.004177 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:43.005003 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:43.005286 29528 raft_consensus.cc:2368] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 20. Current term is 21.
I20260709 13:14:43.006008  4310 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:42.927732  4336 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:43.006728  4336 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:43.006866  4320 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:43.007570  4307 raft_consensus.cc:2804] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:14:43.009295  4320 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:42.964706 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:42.927361  4252 consensus_queue.cc:237] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:42.929896  4172 consensus_queue.cc:237] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:42.930483  4215 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:42.931738  4257 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:42.920037  3991 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:42.925089  4279 consensus_queue.cc:237] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:42.967370 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:42.967763  4173 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:42.968709 29448 raft_consensus.cc:1240] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 17. Current term is 18. Ops: []
I20260709 13:14:42.971805  4024 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:14:42.986073 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: true dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:42.987567 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:43.056710 29526 raft_consensus.cc:2393] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 22: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:42.989459 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:42.990664 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:42.991143 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:42.992390 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:42.993863 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:43.004974 29529 raft_consensus.cc:2393] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 23: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:43.006500 29527 raft_consensus.cc:1275] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:14:43.009474  4307 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:43.003973  4346 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
W20260709 13:14:43.025743 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 44823.7us
I20260709 13:14:43.052071 29419 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:43.060621 29524 raft_consensus.cc:3060] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:43.011338  4303 raft_consensus.cc:740] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:43.065598  4346 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:43.047564  4342 consensus_queue.cc:1059] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.034s
I20260709 13:14:43.060014  4307 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:43.101158  4039 consensus_queue.cc:1059] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:43.042137  4310 consensus_queue.cc:1059] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:14:43.105378 29373 raft_consensus.cc:1275] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260709 13:14:43.108481 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 56520.3us
I20260709 13:14:43.116209 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:43.117010 29447 raft_consensus.cc:1240] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 20. Current term is 21. Ops: []
I20260709 13:14:43.117633 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:43.120398 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:43.120716 29378 raft_consensus.cc:1240] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 13:14:43.120026 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:43.057166  4308 consensus_queue.cc:1059] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:14:43.121341  3962 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:43.095593  4299 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.080942  4024 raft_consensus.cc:697] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:43.132583 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:43.061064  4173 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:43.131268 29419 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:43.152329 29450 raft_consensus.cc:2393] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 21: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:43.085896  4193 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:43.087751  4129 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:43.158164  3683 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.158838  3683 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:43.168677  4308 consensus_queue.cc:1243] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer 183db85c071f489fbc8de63a9edd8a3a log is divergent from this leader: its last log entry 22.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:14:43.177743 29372 raft_consensus.cc:1240] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 23. Current term is 24. Ops: []
W20260709 13:14:43.177572 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 66343.1us
I20260709 13:14:43.138759  4194 consensus_queue.cc:1048] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:14:43.166069  3962 raft_consensus.cc:2749] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:43.210487 29495 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:43.164163  4024 consensus_queue.cc:237] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:43.211695  4308 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:43.147161  4321 consensus_queue.cc:1048] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:14:43.220543  4221 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.151139  4299 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:43.222369 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 70337.5us
I20260709 13:14:43.174639  4334 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:43.170644  4339 raft_consensus.cc:3055] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:14:43.232407 29524 raft_consensus.cc:2468] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 19.
I20260709 13:14:43.231637 29495 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:43.168814  4193 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:43.243705 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:43.249783 29419 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:43.244336 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:43.253757 29419 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:43.254010 29495 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:43.255231 29495 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:43.181690  4331 consensus_queue.cc:1048] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:14:43.260335 29456 raft_consensus.cc:1240] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 22. Current term is 23. Ops: []
I20260709 13:14:43.258502 29419 leader_election.cc:400] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 20. Current term is 21.
I20260709 13:14:43.259603  4194 raft_consensus.cc:2749] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:43.263156  4194 raft_consensus.cc:2749] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:14:43.263513  4360 log.cc:927] Time spent T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:14:43.263939  4193 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:43.264235  4366 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:14:43.268517  4129 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 24 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:43.271270  4299 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:43.231998  4339 raft_consensus.cc:740] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:43.264966  4366 consensus_queue.cc:1059] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:14:43.276248  4342 raft_consensus.cc:2749] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:43.237694  4221 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:43.261490 29419 leader_election.cc:403] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:43.231451  4326 consensus_queue.cc:1059] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
W20260709 13:14:43.284786 29494 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:43.274093  4257 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.238036  4334 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:43.288076 29419 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:43.284358  4039 raft_consensus.cc:2749] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:14:43.299299  4173 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:43.299665  4331 raft_consensus.cc:2749] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:43.301101  4367 consensus_queue.cc:1048] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:14:43.291798  4257 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:43.307934  4339 consensus_queue.cc:260] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:43.310725  4257 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:43.309993  4339 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:43.313737  4334 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:43.323688  4369 raft_consensus.cc:2749] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 20. Current term is 21.
I20260709 13:14:43.335194  4221 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:43.337507  4373 raft_consensus.cc:3055] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:14:43.338040  4373 raft_consensus.cc:740] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:43.339160 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:43.340121 29377 raft_consensus.cc:2468] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 12.
I20260709 13:14:43.343954 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:43.344962 29448 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 30.
I20260709 13:14:43.346632  4302 raft_consensus.cc:3055] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:14:43.347241  4302 raft_consensus.cc:740] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:43.348527  4302 consensus_queue.cc:260] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:43.350045  4302 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:43.356524 29450 raft_consensus.cc:1240] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 22. Current term is 23. Ops: []
I20260709 13:14:43.356959  4307 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:43.359014 29495 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:43.361598  3991 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 13:14:43.361982  3991 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 29 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:43.362443  3991 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 29 FOLLOWER]: Advancing to term 30
W20260709 13:14:43.367839 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 49961.4us
I20260709 13:14:43.374008 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:14:43.376904  4362 log.cc:927] Time spent T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.212s	user 0.000s	sys 0.003s
I20260709 13:14:43.380000  4303 consensus_queue.cc:260] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:43.381569  4303 raft_consensus.cc:3060] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:43.383229 30121 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:14:43.406562 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:43.407756 29524 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:43.403816  4307 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:43.440081 29524 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 23.
I20260709 13:14:43.423593 29419 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:43.444681 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:43.444777  3683 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:43.445293 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 146128us
I20260709 13:14:43.446575  4136 raft_consensus.cc:2749] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:14:43.339025  4373 consensus_queue.cc:260] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:43.461002  4336 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:43.462544 29454 raft_consensus.cc:2368] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 20. Current term is 21.
I20260709 13:14:43.426031  4346 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:43.465512 29374 raft_consensus.cc:1240] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 21. Current term is 22. Ops: []
I20260709 13:14:43.466554  4346 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 22 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:43.423719  4340 raft_consensus.cc:2804] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:14:43.467536  4340 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:43.467938  4340 raft_consensus.cc:3060] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:43.471987  4336 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:43.478729  4333 consensus_queue.cc:1059] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:14:43.485231  4292 raft_consensus.cc:3055] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:14:43.485785  4292 raft_consensus.cc:740] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:43.486692  4292 consensus_queue.cc:260] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:43.504473  4292 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:43.497298 29495 leader_election.cc:400] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 20. Current term is 21.
I20260709 13:14:43.507714 29495 leader_election.cc:403] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:43.487999  4126 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.508591  4126 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:43.512189  4126 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:43.512571  4340 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:43.513923 30155 raft_consensus.cc:2393] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 13: Already voted for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in this term.
I20260709 13:14:43.514963  4340 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 13 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:43.518761 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:43.520308 29375 raft_consensus.cc:3060] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:14:43.520850 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:43.521646 29376 raft_consensus.cc:2393] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 30: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
W20260709 13:14:43.523664 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 77573.6us
I20260709 13:14:43.525115 29419 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:43.526080  4336 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:14:43.526954 29419 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:43.530033  4373 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:43.533316 29419 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:43.535854  4173 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:14:43.544152 29279 catalog_manager.cc:5697] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: config changed from index 13 to 14, VOTER 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) evicted. New cstate: current_term: 19 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:43.546157 29372 raft_consensus.cc:1240] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 22. Current term is 23. Ops: []
I20260709 13:14:43.544221  4297 raft_consensus.cc:2749] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:14:43.547353 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:43.549135 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:43.549736 29376 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 23.
I20260709 13:14:43.550969 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 31 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:43.550751  3991 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:43.551589 29376 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 30.
I20260709 13:14:43.554165 29378 raft_consensus.cc:1275] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:14:43.554476 29372 raft_consensus.cc:1275] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:14:43.554543 29377 raft_consensus.cc:1275] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:14:43.555251 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:43.562131  4365 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:14:43.572527 29373 raft_consensus.cc:3060] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:43.573465  4126 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:43.561823 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 64706.6us
I20260709 13:14:43.574156  4126 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:43.575784  4308 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:43.567484  4054 raft_consensus.cc:3055] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:14:43.576392  4054 raft_consensus.cc:740] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:43.576318  4308 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:43.567701  4173 consensus_queue.cc:1059] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:14:43.577817  4173 raft_consensus.cc:3055] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:14:43.578202  4173 raft_consensus.cc:740] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:43.579080  4173 consensus_queue.cc:260] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:43.580348  4173 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:43.580672 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:43.578511  4308 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:43.568455 29421 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:43.585013  4279 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:14:43.585078  3991 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 30 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:43.585572  4279 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:43.585988  4279 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:14:43.585934 29421 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:43.586407 29372 raft_consensus.cc:1240] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 13:14:43.589241 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:43.589681  3962 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 13:14:43.593204 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:43.593544  3962 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:43.593895 29372 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 22.
I20260709 13:14:43.566155 29344 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:43.590377  4321 consensus_queue.cc:1048] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:14:43.591068  4136 consensus_queue.cc:1048] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:14:43.595979  4054 consensus_queue.cc:260] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:43.591902 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:43.562196 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:43.597507  4054 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:14:43.598495  3683 raft_consensus.cc:2804] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:14:43.598974  3683 raft_consensus.cc:697] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:43.599906  3683 consensus_queue.cc:237] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:43.600206 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:43.604702 29373 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 21.
I20260709 13:14:43.605931  4136 consensus_queue.cc:1048] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:14:43.593984  3962 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 30 FOLLOWER]: Advancing to term 31
I20260709 13:14:43.607360 29495 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:43.607888 29372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 30 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:43.608247 29375 raft_consensus.cc:2468] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 13.
I20260709 13:14:43.608690 29372 raft_consensus.cc:2393] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 30: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:43.609525 30121 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:14:43.610450  4221 raft_consensus.cc:2804] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:14:43.610958  4221 raft_consensus.cc:697] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 13 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:14:43.560127  4297 consensus_queue.cc:1059] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:14:43.613381 29421 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:43.617249 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:43.617938 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:43.618177 29524 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 23.
I20260709 13:14:43.621680 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:43.622727 29524 raft_consensus.cc:2393] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 22: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:43.628162 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 31 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:43.629530 29528 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 30.
I20260709 13:14:43.639446 29376 raft_consensus.cc:1275] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:14:43.623569  4310 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:14:43.641850  4310 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:43.642210  4310 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:43.611924  4297 raft_consensus.cc:3055] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:14:43.622458  4136 raft_consensus.cc:2804] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:14:43.647815 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:43.645231  4297 raft_consensus.cc:740] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:43.654040  4297 consensus_queue.cc:260] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:43.647756  4136 raft_consensus.cc:697] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 21 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:43.657860  4136 consensus_queue.cc:237] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:43.611884  4221 consensus_queue.cc:237] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:43.665936  4297 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:43.684196  4321 consensus_queue.cc:1048] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:14:43.687278  4346 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:43.688041  4126 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:43.692282 29521 raft_consensus.cc:1275] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:14:43.693281 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:43.693930 29522 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 22.
I20260709 13:14:43.695771 29344 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:43.701356 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:43.702240 29456 raft_consensus.cc:2468] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 11.
W20260709 13:14:43.706302 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:43.706516 29344 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:43.709431  3683 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 13:14:43.709838  3683 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:43.710166  3683 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 30 FOLLOWER]: Advancing to term 31
I20260709 13:14:43.710803  4126 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:14:43.719352  4126 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:43.719791  4126 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:14:43.731105  3683 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:43.735654 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:43.735812 29344 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:43.705291  4024 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:43.741200  3962 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:43.745575  4310 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:43.708110  4365 raft_consensus.cc:2749] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 20. Current term is 21.
I20260709 13:14:43.751540  3683 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 31 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:43.688046  4346 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:43.757382 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:43.760607  3962 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 31 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:43.760772  4368 consensus_queue.cc:1048] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:14:43.766327 29454 raft_consensus.cc:2368] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 30. Current term is 31.
I20260709 13:14:43.768115 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 31 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:43.768290 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 31 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:43.769470 29375 raft_consensus.cc:2393] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 31: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:43.747002  4155 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:14:43.770545 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 31 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:43.772223 29524 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 30 FOLLOWER]: Advancing to term 31
I20260709 13:14:43.784142  4346 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:43.793556 29441 tablet_service.cc:1558] Processing DeleteTablet for tablet c2aced39aead4259aa7f2a9995ec3ea5 with delete_type TABLET_DATA_TOMBSTONED (TS 183db85c071f489fbc8de63a9edd8a3a not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:35524
I20260709 13:14:43.794164  4279 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:43.793638 29495 leader_election.cc:400] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 30 election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 30. Current term is 31.
I20260709 13:14:43.771978  4155 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:43.798298  4155 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:43.799909 29447 raft_consensus.cc:2393] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 24: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:43.797886 29495 leader_election.cc:403] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 30 election: Cancelling election due to peer responding with higher term
I20260709 13:14:43.809752 29452 raft_consensus.cc:1275] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:14:43.809861 29450 raft_consensus.cc:1275] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:14:43.811090 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:43.811813 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:43.812255 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:43.813069 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:43.811723 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:43.814219 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:43.814800 29522 raft_consensus.cc:2376] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 22. Re-sending same reply.
I20260709 13:14:43.814881  4310 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:43.811174 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:43.816751 29449 raft_consensus.cc:2393] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 21: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:43.817819 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:43.818511 29522 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 21.
I20260709 13:14:43.754149  4024 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:43.821328 29344 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:43.829478 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:43.829493 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:43.833137 29456 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 23.
I20260709 13:14:43.833248 29524 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 31.
I20260709 13:14:43.834895 29344 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:43.841362  4279 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:43.839077  4172 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:14:43.844659  4172 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:43.845099  4172 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:43.849080  4155 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:43.849995  4204 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 31 FOLLOWER]: Leader election won for term 31
I20260709 13:14:43.851433 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 31 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:43.866515 29447 raft_consensus.cc:2393] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 31: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:43.837853  4039 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 31 FOLLOWER]: Leader election lost for term 30. Reason: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 30. Current term is 31.
I20260709 13:14:43.854712 29451 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 22.
I20260709 13:14:43.858386 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:43.873622 29522 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 23.
I20260709 13:14:43.860363 29521 raft_consensus.cc:1240] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 22. Current term is 23. Ops: [20.12-22.13]
I20260709 13:14:43.861855 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 31 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:43.863770 29528 raft_consensus.cc:1240] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:14:43.863984 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:43.873777 29276 catalog_manager.cc:5697] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 16 to 18, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 18 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:43.882441 29521 raft_consensus.cc:1275] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:14:43.884290 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 31 candidate_status { last_received { term: 29 index: 15 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:43.890147 29528 raft_consensus.cc:1275] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:14:43.893728  4204 raft_consensus.cc:697] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 31 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:43.895021 29346 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:43.882102 29276 catalog_manager.cc:5697] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 16 to 19, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 19 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:43.898360 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:43.899049 29448 raft_consensus.cc:3060] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:14:43.890255  4155 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:43.899068 29529 raft_consensus.cc:2393] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 31: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:43.902261 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:43.903000 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:43.905283 29524 raft_consensus.cc:1275] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:14:43.905434 29530 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:14:43.907064 29346 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:43.904192 29522 raft_consensus.cc:1275] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:14:43.908953 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:43.914304 29419 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:43.915262 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:43.916188 29456 raft_consensus.cc:2393] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 17: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:43.923254 29419 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:43.915166  4257 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:43.920732  4371 consensus_queue.cc:1048] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:14:43.924743  4299 raft_consensus.cc:2749] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:43.917289  4258 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:43.942963 29346 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:43.948130 29448 raft_consensus.cc:2468] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 13.
I20260709 13:14:43.949695  4126 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:43.939196 29530 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 24.
I20260709 13:14:43.954120 29278 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37608 (request call id 160) took 4391 ms. Trace:
I20260709 13:14:43.954077 29346 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:14:43.971158 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 47992.5us
I20260709 13:14:43.972745 29419 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:43.974858 29419 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:43.979803 29419 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:43.954787 29278 rpcz_store.cc:276] 0709 13:14:39.562455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:39.563830 (+  1375us) service_pool.cc:224] Handling call
0709 13:14:43.954044 (+4390214us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:42.551699 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:42.552297 (+   598us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:42.552335 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:14:42.552362 (+    27us) tablet.cc:662] Decoding operations
0709 13:14:42.553360 (+   998us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:42.553441 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:42.553478 (+    37us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:14:42.554223 (+   745us) tablet.cc:701] Row locks acquired
0709 13:14:42.554237 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:14:42.554395 (+   158us) write_op.cc:270] Start()
0709 13:14:42.554521 (+   126us) write_op.cc:276] Timestamp: P: 1783602882554339 usec, L: 0
0709 13:14:42.554541 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:14:42.555398 (+   857us) log.cc:844] Serialized 3673 byte log entry
0709 13:14:43.128661 (+573263us) op_driver.cc:464] REPLICATION: finished
0709 13:14:43.235809 (+107148us) write_op.cc:301] APPLY: starting
0709 13:14:43.235931 (+   122us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:43.350078 (+114147us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:43.350191 (+   113us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:43.431067 (+ 80876us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:43.431337 (+   270us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 13:14:43.431384 (+    47us) write_op.cc:312] APPLY: finished
0709 13:14:43.455731 (+ 24347us) log.cc:844] Serialized 89 byte log entry
0709 13:14:43.455975 (+   244us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:43.456149 (+   174us) write_op.cc:454] Released schema lock
0709 13:14:43.456214 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:43.456741 (+   527us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:43.456776 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":49900,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":102483,"apply.run_cpu_time_us":16119,"apply.run_wall_time_us":220941,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41675,"num_ops":9,"prepare.queue_time_us":577585,"prepare.run_cpu_time_us":12500,"prepare.run_wall_time_us":132261,"raft.queue_time_us":217108,"raft.run_cpu_time_us":13095,"raft.run_wall_time_us":107157,"replication_time_us":573890,"thread_start_us":989933,"threads_started":4,"wal-append.queue_time_us":149203}]]}
I20260709 13:14:43.956939  4279 raft_consensus.cc:2749] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:43.978296  4155 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:14:43.979321  4299 raft_consensus.cc:2749] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:43.979971  3962 raft_consensus.cc:2749] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:14:43.894906  4204 consensus_queue.cc:237] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 29.15, Last appended by leader: 15, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:43.983484  4193 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:14:44.071746 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 58184.5us
I20260709 13:14:43.984978  4024 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:44.072449 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:43.983323  4301 raft_consensus.cc:2764] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:14:44.066682  4126 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 24 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:43.997058  4054 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:44.067118  4172 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:44.086984  4349 log.cc:927] Time spent T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:14:44.098748  4336 consensus_queue.cc:1048] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:14:44.114773 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:44.131106 29529 raft_consensus.cc:2393] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 24: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:44.073943  4307 consensus_queue.cc:1048] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:14:44.136989 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:44.138648 29526 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:14:44.121479 29419 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:44.164723  4297 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20260709 13:14:44.093464  3962 consensus_queue.cc:1048] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.050s
I20260709 13:14:44.091315  4054 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:44.170017  4388 tablet_replica.cc:333] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
W20260709 13:14:44.203739 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 215838us
W20260709 13:14:44.250830  4386 log.cc:927] Time spent T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2: Append to log took a long time: real 0.258s	user 0.004s	sys 0.000s
I20260709 13:14:44.253068 29344 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:44.258909  4172 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:44.262554 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 57539.3us
I20260709 13:14:44.271711 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:44.275326  4310 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:44.276157  4310 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:44.282306 30155 raft_consensus.cc:1275] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:14:44.291581 29346 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:44.298354  4126 raft_consensus.cc:2804] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:14:44.298978  4126 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:44.299373  4126 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:44.302232 29528 raft_consensus.cc:1275] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:14:44.308344  4155 consensus_queue.cc:1048] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:14:44.310467  4310 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:44.312435  4172 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:14:44.313064  4172 raft_consensus.cc:697] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:44.313252 29376 raft_consensus.cc:1240] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 22. Current term is 23. Ops: []
I20260709 13:14:44.314294  4252 consensus_queue.cc:1048] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:14:44.315052 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:44.315919 29376 raft_consensus.cc:2393] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 24: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:44.319939 29377 raft_consensus.cc:1275] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:14:44.320456 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:44.323053 29278 catalog_manager.cc:5697] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 11 to 13, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132). New cstate: current_term: 13 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:44.314014  4172 consensus_queue.cc:237] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:44.328931 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:44.336120 29448 raft_consensus.cc:2393] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 24: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:44.333046 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:14:44.289325  4387 log.cc:927] Time spent T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 13:14:44.311213  4155 consensus_queue.cc:1048] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:14:44.353380 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:44.355480 29451 raft_consensus.cc:2393] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 21: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:44.358927 29456 raft_consensus.cc:1275] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:14:44.397907 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 130310us
I20260709 13:14:44.417542 29419 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:44.421653 29495 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:44.443156  3991 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:14:44.473572  4388 raft_consensus.cc:2243] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:44.474707  4388 raft_consensus.cc:2272] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:44.486567 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:44.443871  4279 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:14:44.421768  3962 consensus_queue.cc:1059] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:14:44.445262  4297 consensus_queue.cc:1048] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 13:14:44.523357 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:44.529440 29375 raft_consensus.cc:1275] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:14:44.531823 29346 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:44.534175 29346 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:44.546175 29529 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 21.
W20260709 13:14:44.534682 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 99797.5us
W20260709 13:14:44.542768 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 70903.4us
I20260709 13:14:44.554061  4346 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:14:44.517580  4279 raft_consensus.cc:697] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 24 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:44.553723 29447 raft_consensus.cc:1275] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:14:44.532171  4193 raft_consensus.cc:3055] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:14:44.529302  4054 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:44.548869  4215 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:14:44.655203 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 47361.7us
W20260709 13:14:44.605338  4349 log.cc:927] Time spent T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:14:44.534107  4252 consensus_queue.cc:1048] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 13:14:44.532145  4126 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:44.666759 29529 raft_consensus.cc:1240] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 22. Current term is 23. Ops: []
I20260709 13:14:44.668751 29527 raft_consensus.cc:1275] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:14:44.675885 29524 raft_consensus.cc:1275] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:14:44.654410  4193 raft_consensus.cc:740] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:44.714037 29447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:44.670852  4252 consensus_queue.cc:1243] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer 71aa3578fd924765ab9ac0729c8d1483 log is divergent from this leader: its last log entry 19.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260709 13:14:44.730466 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 71651.4us
W20260709 13:14:44.735052 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 185120us
W20260709 13:14:44.774884 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 71996.3us
W20260709 13:14:44.790396 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 49280us
I20260709 13:14:44.762615  4054 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:44.816414 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 55086.3us
I20260709 13:14:44.772766  4404 consensus_queue.cc:1048] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:14:44.806450  4336 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:44.764029  4279 consensus_queue.cc:237] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:44.815744  4054 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:44.850732 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
W20260709 13:14:44.867190 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 86112.5us
W20260709 13:14:44.871671  4409 log.cc:927] Time spent T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:14:44.833304  4336 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:44.875373  4412 log.cc:927] Time spent T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:14:44.877321  4173 consensus_queue.cc:1059] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:14:44.878733  4416 log.cc:927] Time spent T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:14:44.879887  4411 log.cc:927] Time spent T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:14:44.885104  4388 ts_tablet_manager.cc:1916] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:14:44.870332  4406 log.cc:927] Time spent T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.180s	user 0.002s	sys 0.000s
I20260709 13:14:44.901505  4194 raft_consensus.cc:3055] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:14:44.902024  4194 raft_consensus.cc:740] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:44.902917  4194 consensus_queue.cc:260] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:44.910985  4405 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:44.911757  4405 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:44.913596  4193 consensus_queue.cc:260] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:44.914934  4193 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:44.870541  4126 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:44.918067  4336 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:44.921458 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 53306.7us
I20260709 13:14:44.923866 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:44.925037 29456 raft_consensus.cc:2393] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 17: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
W20260709 13:14:44.923787 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 59922.5us
I20260709 13:14:44.934247  4302 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:44.976918 29344 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:44.941615  4336 consensus_queue.cc:1048] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:14:44.941215  4252 consensus_queue.cc:1048] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:14:44.995965 29524 pending_rounds.cc:85] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 10
I20260709 13:14:44.996388 29524 pending_rounds.cc:107] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 13:14:44.996626 29524 raft_consensus.cc:2889] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:44.999873  4391 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:14:45.000790  4391 raft_consensus.cc:697] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:45.002288  4391 consensus_queue.cc:237] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:45.009766 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:44.981810  4302 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:45.125174 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 130335us
I20260709 13:14:45.150848  3962 consensus_queue.cc:1048] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:45.152997  4054 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:45.158227  4431 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:45.159121  4431 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:45.161763  4431 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:45.162415 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:45.193760 29376 raft_consensus.cc:2393] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 24: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:45.158540 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:45.163801  4432 consensus_queue.cc:1048] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:14:45.174278  4302 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:45.176491 29525 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 24.
W20260709 13:14:45.203413 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 198738us
I20260709 13:14:45.204504 29495 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:45.216204 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:45.234038 29495 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:45.207103  4204 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.218134  4302 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:45.245601 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:45.246881 29452 raft_consensus.cc:2393] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 23: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:45.250414 29454 raft_consensus.cc:1275] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:14:45.242390  4407 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:14:45.252584  4428 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:45.253201  4428 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:45.256458  4438 log.cc:927] Time spent T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.099s	user 0.000s	sys 0.004s
I20260709 13:14:45.258102 29451 raft_consensus.cc:1275] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 31 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 29 index: 15. Preceding OpId from leader: term: 31 index: 16. (index mismatch)
I20260709 13:14:45.261580 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:45.259155 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:45.271144 29373 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 24.
I20260709 13:14:45.272313 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:45.272454 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:45.273934 29451 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 23.
I20260709 13:14:45.276062 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:45.276719 29453 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 18.
I20260709 13:14:45.273880 29375 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
I20260709 13:14:45.277572 29527 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 17.
I20260709 13:14:45.279008 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:45.295254  4302 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.301235  4302 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:45.244848  4204 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:45.303592  4194 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:45.311429 29495 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:45.312386  4398 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:14:45.312841  4398 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:45.313197  4398 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:14:45.316020  4204 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:45.312841 29495 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:45.319731  4308 raft_consensus.cc:2804] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:14:45.320197  4308 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:45.320545  4308 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:45.329455  4388 ts_tablet_manager.cc:1929] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.13
I20260709 13:14:45.330127  4388 log.cc:1199] T c2aced39aead4259aa7f2a9995ec3ea5 P 183db85c071f489fbc8de63a9edd8a3a: Deleting WAL directory at /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/ts-1-root/wals/c2aced39aead4259aa7f2a9995ec3ea5
I20260709 13:14:45.262822  4428 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:45.307739 29419 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:14:45.342680 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 108689us
I20260709 13:14:45.327260  4302 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:45.344676 29344 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:45.346464 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:45.362107  4405 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:45.344199  4428 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:14:45.366611  4428 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting leader election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:45.367060  4428 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:14:45.369696  4388 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:35524 (request call id 2) took 1577 ms. Trace:
I20260709 13:14:45.370318  4388 rpcz_store.cc:276] 0709 13:14:43.792685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:43.793061 (+   376us) service_pool.cc:224] Handling call
0709 13:14:44.095237 (+302176us) ts_tablet_manager.cc:1151] Deleting tablet c2aced39aead4259aa7f2a9995ec3ea5
0709 13:14:44.136044 (+ 40807us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:14:45.158835 (+1022791us) tablet_metadata.cc:665] Metadata flushed
0709 13:14:45.329289 (+170454us) tablet_metadata.cc:665] Metadata flushed
0709 13:14:45.369574 (+ 40285us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":161523,"tablet-delete.queue_time_us":284567,"thread_start_us":192084,"threads_started":1}
I20260709 13:14:45.377125 29376 raft_consensus.cc:1275] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:14:45.383958  4302 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.384948  4302 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:45.391134 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 46576.5us
I20260709 13:14:45.423424 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:45.424249 29522 raft_consensus.cc:1275] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:14:45.426986 29521 raft_consensus.cc:1275] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 31 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 29 index: 15. Preceding OpId from leader: term: 31 index: 16. (index mismatch)
I20260709 13:14:45.419628 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:45.428690 29456 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 23.
I20260709 13:14:45.434839 29495 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:45.436335 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:45.439728 29528 raft_consensus.cc:2410] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for term 22 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
W20260709 13:14:45.440276 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:45.420921  4126 raft_consensus.cc:2804] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:14:45.433261  4194 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:45.475917 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:45.446636  4365 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:14:45.476903 29449 raft_consensus.cc:2410] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 23 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 13:14:45.431110  4408 consensus_queue.cc:1048] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:14:45.448923  4297 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.471622  4302 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:45.490298  3683 consensus_queue.cc:1048] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:45.492764  4368 consensus_queue.cc:1048] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:14:45.492792 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:45.506494 29278 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35182 (request call id 85) took 1244 ms. Trace:
I20260709 13:14:45.510429 29521 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66"
dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:52288
I20260709 13:14:45.531599 29521 raft_consensus.cc:606] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 LEADER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:45.475246  4398 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:45.464226  4126 raft_consensus.cc:697] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:45.482064  4365 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:45.477509  3991 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:14:45.533023  4412 log.cc:927] Time spent T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:14:45.530567 29278 rpcz_store.cc:276] 0709 13:14:44.261907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:44.262316 (+   409us) service_pool.cc:224] Handling call
0709 13:14:45.506388 (+1244072us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:44.366929 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:44.380165 (+ 13236us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:44.380235 (+    70us) write_op.cc:435] Acquired schema lock
0709 13:14:44.380264 (+    29us) tablet.cc:662] Decoding operations
0709 13:14:44.388505 (+  8241us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:44.398026 (+  9521us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:44.416423 (+ 18397us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:14:44.464706 (+ 48283us) tablet.cc:701] Row locks acquired
0709 13:14:44.464744 (+    38us) write_op.cc:260] PREPARE: finished
0709 13:14:44.464979 (+   235us) write_op.cc:270] Start()
0709 13:14:44.465128 (+   149us) write_op.cc:276] Timestamp: P: 1783602884464915 usec, L: 0
0709 13:14:44.465147 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:14:44.473690 (+  8543us) log.cc:844] Serialized 539 byte log entry
0709 13:14:44.968903 (+495213us) op_driver.cc:464] REPLICATION: finished
0709 13:14:45.160833 (+191930us) write_op.cc:301] APPLY: starting
0709 13:14:45.160929 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:45.162199 (+  1270us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:45.162285 (+    86us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:45.163071 (+   786us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:45.163261 (+   190us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:14:45.163313 (+    52us) write_op.cc:312] APPLY: finished
0709 13:14:45.163471 (+   158us) log.cc:844] Serialized 25 byte log entry
0709 13:14:45.163643 (+   172us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:45.163727 (+    84us) write_op.cc:454] Released schema lock
0709 13:14:45.163774 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:45.232245 (+ 68471us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:45.232286 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":186458,"apply.run_cpu_time_us":14025,"apply.run_wall_time_us":67395,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8299,"num_ops":1,"prepare.queue_time_us":6164,"prepare.run_cpu_time_us":3894,"prepare.run_wall_time_us":107070,"replication_time_us":492345,"thread_start_us":141586,"threads_started":1}]]}
I20260709 13:14:45.543656  4365 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:14:45.548184  4126 consensus_queue.cc:237] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:45.532800  4297 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:45.554421  4297 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:45.557015  4398 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:45.544260  3991 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:45.558702 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:45.560006 29528 raft_consensus.cc:1275] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:14:45.560626  3991 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:45.482391  4194 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:45.563282  4194 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:45.564567 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:45.566093 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:45.568397 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:45.569113 29525 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 17.
I20260709 13:14:45.577702  4428 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:45.580272 29419 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:45.580476  4428 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:45.581271  4428 raft_consensus.cc:2804] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:14:45.581357 29453 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:14:45.581655  4428 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:45.582141  4428 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:45.584903  4054 raft_consensus.cc:993] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483: : Instructing follower 183db85c071f489fbc8de63a9edd8a3a to start an election
I20260709 13:14:45.584748 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:45.585541  4054 raft_consensus.cc:1081] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 LEADER]: Signalling peer 183db85c071f489fbc8de63a9edd8a3a to start an election
I20260709 13:14:45.585902 29521 raft_consensus.cc:2368] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 24. Current term is 25.
I20260709 13:14:45.586851 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:45.591188 29419 leader_election.cc:400] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 24. Current term is 25.
I20260709 13:14:45.591548 29419 leader_election.cc:403] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
I20260709 13:14:45.599921 29449 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66"
dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:45796
I20260709 13:14:45.600739 29449 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:45.601168 29449 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:45.602559 29419 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:45.611351  4297 raft_consensus.cc:2749] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:45.638908 29453 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 25.
I20260709 13:14:45.600412  4308 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:45.642047  4173 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 24. Current term is 25.
I20260709 13:14:45.640584  4193 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.685204  4308 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:45.686769  4193 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:45.689486  4193 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:45.666842 29449 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:45.710325  4428 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:45.713460  4365 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:45.716271 29421 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:45.716698 29527 raft_consensus.cc:2368] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 23. Current term is 24.
I20260709 13:14:45.717947  4297 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:45.731649 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:45.742072 29453 raft_consensus.cc:1275] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:14:45.756153 29374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:14:45.756991 29374 raft_consensus.cc:606] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:45.757500 29374 raft_consensus.cc:614] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:45.758352 29377 raft_consensus.cc:1275] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:14:45.759745 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:45.759992 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:45.767196 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:45.768138 29375 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:45.776432 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:45.777814 29380 raft_consensus.cc:2393] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 24: Already voted for candidate 429e58eb058349e3bf72b5a870c8f6e5 in this term.
I20260709 13:14:45.783708  4428 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:45.790894  4365 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:45.792568  4024 consensus_queue.cc:1048] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:14:45.795737  4346 consensus_queue.cc:1048] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:14:45.797210  4428 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:45.797798  4428 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:45.798039 29346 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:45.803457  4446 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:45.805919 29346 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:45.812508  4450 log.cc:927] Time spent T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.171s	user 0.004s	sys 0.000s
I20260709 13:14:45.828614  4368 consensus_queue.cc:1048] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:14:45.865801  4428 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:45.869792 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:45.870849 29373 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 22.
I20260709 13:14:45.373000 29265 catalog_manager.cc:5028] TS 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): tablet c2aced39aead4259aa7f2a9995ec3ea5 (table test-workload [id=364c32d53f7748a2857a4a9acd17c671]) successfully deleted
I20260709 13:14:45.875830 29375 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 21.
W20260709 13:14:45.876307 29265 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 503294us
I20260709 13:14:45.878137 29278 catalog_manager.cc:5697] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 10 to 11, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 11 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:45.879341 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:45.879945 29448 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:45.883054 29449 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:45.885985 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:45.887528 29374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:45.888401 29374 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 24.
I20260709 13:14:45.891966 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:45.892823 29380 raft_consensus.cc:3060] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:14:45.896509 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 55907.4us
I20260709 13:14:45.904657  3683 raft_consensus.cc:2749] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:45.906852 29495 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:45.911919  4365 raft_consensus.cc:2804] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:14:45.912689  4365 raft_consensus.cc:697] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:45.913859  4365 consensus_queue.cc:237] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:45.920055 29344 leader_election.cc:400] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 23. Current term is 24.
I20260709 13:14:45.924786 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:45.926703 29377 raft_consensus.cc:3060] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:14:45.936528 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:45.937803 29453 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:14:45.946326 29373 raft_consensus.cc:1240] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 20. Current term is 21. Ops: []
I20260709 13:14:45.948530 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:45.949245 29373 raft_consensus.cc:3060] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:14:45.954172 29377 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
I20260709 13:14:45.955641  4428 consensus_queue.cc:1048] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:14:45.928642 29344 leader_election.cc:403] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:45.963843 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:45.964411 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 44626.1us
I20260709 13:14:45.969169 29448 raft_consensus.cc:2468] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
I20260709 13:14:45.972900 29421 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:45.978593 29373 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 24.
I20260709 13:14:45.983785 29375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:46.007586 29276 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37586 (request call id 142) took 4472 ms. Trace:
I20260709 13:14:46.007754 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:46.008605 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:46.009222 29527 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:46.010322 29453 raft_consensus.cc:2468] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 24.
I20260709 13:14:46.008774 29524 raft_consensus.cc:3055] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:14:46.012740 29524 raft_consensus.cc:740] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:46.011793 29380 raft_consensus.cc:2468] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 25.
I20260709 13:14:46.016618 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:46.007684  4405 raft_consensus.cc:2749] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 23. Current term is 24.
I20260709 13:14:46.017326 29526 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 21.
I20260709 13:14:46.013887 29524 consensus_queue.cc:260] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:46.025012 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:46.024329 29495 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:46.008188 29276 rpcz_store.cc:276] 0709 13:14:41.534805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:41.581110 (+ 46305us) service_pool.cc:224] Handling call
0709 13:14:46.007461 (+4426351us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:43.947827 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:43.948479 (+   652us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:43.948522 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:14:43.948541 (+    19us) tablet.cc:662] Decoding operations
0709 13:14:43.949030 (+   489us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:43.949096 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:43.949127 (+    31us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:14:43.949466 (+   339us) tablet.cc:701] Row locks acquired
0709 13:14:43.949492 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:14:43.949658 (+   166us) write_op.cc:270] Start()
0709 13:14:43.949783 (+   125us) write_op.cc:276] Timestamp: P: 1783602883949608 usec, L: 0
0709 13:14:43.949810 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:14:43.955126 (+  5316us) log.cc:844] Serialized 935 byte log entry
0709 13:14:44.663069 (+707943us) op_driver.cc:464] REPLICATION: finished
0709 13:14:45.062137 (+399068us) write_op.cc:301] APPLY: starting
0709 13:14:45.150368 (+ 88231us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:45.160543 (+ 10175us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:45.160669 (+   126us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:45.162444 (+  1775us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:45.162697 (+   253us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:14:45.162750 (+    53us) write_op.cc:312] APPLY: finished
0709 13:14:45.163022 (+   272us) log.cc:844] Serialized 33 byte log entry
0709 13:14:45.163216 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:45.163304 (+    88us) write_op.cc:454] Released schema lock
0709 13:14:45.163348 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:45.361240 (+197892us) spinlock_profiling.cc:243] Waited 4.27 ms on lock 0x7b5400421e00. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7f6f0161 00007f6a7f7c533d 00007f6a7f7be3c2 00007f6a7f7bdb53 00007f6a7f7c1d61 00007f6a7f7c1d19 00007f6a7f7c1ca9 00007f6a7f7c1c71 00007f6a7f7c0e9d 000000000038f354 000000000038f199
0709 13:14:45.363041 (+  1801us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:45.363104 (+    63us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":532215,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":320641,"apply.run_cpu_time_us":14722,"apply.run_wall_time_us":362814,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12471,"num_ops":2,"prepare.queue_time_us":266,"prepare.run_cpu_time_us":3252,"prepare.run_wall_time_us":35359,"replication_time_us":655973,"spinlock_wait_cycles":9821056,"thread_start_us":234671,"threads_started":1}]]}
I20260709 13:14:46.030092 29495 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:46.011783  4428 raft_consensus.cc:2804] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:14:46.040827 29419 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:46.046392 29524 raft_consensus.cc:3060] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:46.053144 29527 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 18.
I20260709 13:14:46.027092  4331 consensus_queue.cc:1048] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 13:14:46.033571  4310 raft_consensus.cc:2804] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:14:46.044255  4407 raft_consensus.cc:2804] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:14:46.053260 29495 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:46.057443  4428 raft_consensus.cc:697] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 21 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:46.071424 29495 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:46.087888 29377 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f06f688759cd438a95541a7639513cec"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:14:46.088614 29377 raft_consensus.cc:606] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:46.088960 29377 raft_consensus.cc:614] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:14:46.095418 29524 raft_consensus.cc:2468] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 21.
I20260709 13:14:46.073943  4310 raft_consensus.cc:697] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 19 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:46.077392  4430 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:46.083703  4428 consensus_queue.cc:237] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:46.100093  4407 raft_consensus.cc:697] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:46.110801  4365 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:14:46.128895 29524 raft_consensus.cc:1275] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:14:46.118922  4336 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:46.138866 29456 raft_consensus.cc:1240] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:14:46.131978  4365 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:46.132835  3962 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.143819  4301 consensus_queue.cc:1048] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 13:14:46.157253  3962 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:46.165424  4470 consensus_queue.cc:1059] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:14:46.166536  4346 raft_consensus.cc:3055] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:14:46.166913  4346 raft_consensus.cc:740] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:46.167804  4346 consensus_queue.cc:260] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:46.168671  3962 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:46.148416  4365 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:14:46.196969 29526 raft_consensus.cc:1240] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:14:46.142874  4310 consensus_queue.cc:237] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:46.186066  4407 consensus_queue.cc:237] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:46.240238 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 102719us
I20260709 13:14:46.247339 29419 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:46.257282 29419 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:46.253599  4336 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:14:46.262461 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 111269us
I20260709 13:14:46.266419  4336 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:46.266924  4336 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:46.272820 29377 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:14:46.273655 29377 raft_consensus.cc:606] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:46.260840  4428 raft_consensus.cc:2804] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:14:46.280197  4346 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:14:46.285398 29377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:46.286214 29377 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 23.
I20260709 13:14:46.304343 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:46.317096  4336 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:46.320282 29377 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:14:46.321874  4428 raft_consensus.cc:697] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 18 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:46.322960  4428 consensus_queue.cc:237] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:46.321851 29377 raft_consensus.cc:606] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 LEADER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:46.327602 29421 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:46.329833  4194 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:14:46.330295  4194 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:46.330658  4194 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:14:46.303627 29530 consensus_queue.cc:237] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:14:46.348680 28234 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:14:46.352159 28234 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:46.369261 29453 raft_consensus.cc:1240] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 21. Current term is 22. Ops: []
I20260709 13:14:46.371361  4371 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:46.385303  4371 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:46.387576  4371 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:46.401252 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:46.402128 29527 raft_consensus.cc:2393] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 23: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:46.394251  4336 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:46.429829 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:46.432753 29379 raft_consensus.cc:1275] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 25 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:14:46.433396 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:46.433964  4365 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:46.436210  4365 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:46.437222 29528 raft_consensus.cc:1240] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 24. Current term is 25. Ops: [24.14-24.14]
I20260709 13:14:46.438995 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:46.439040 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:46.445492  4365 consensus_queue.cc:1048] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:14:46.447222 29495 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:46.448093  4476 consensus_queue.cc:1059] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:14:46.449146  4476 raft_consensus.cc:3055] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:14:46.449715  4476 raft_consensus.cc:740] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:46.455173  4423 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:14:46.470973  4475 log.cc:927] Time spent T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.079s	user 0.003s	sys 0.000s
W20260709 13:14:46.472689  4477 log.cc:927] Time spent T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:14:46.450903  4476 consensus_queue.cc:260] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:46.476994  4476 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:46.455271 29419 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:46.515318 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 60133.9us
I20260709 13:14:46.516513  4336 raft_consensus.cc:2749] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:14:46.548910 29279 catalog_manager.cc:5697] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 22 to 25, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 25 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:46.516634  4365 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.570582 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:46.570845  4365 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:46.571290 29453 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 23.
I20260709 13:14:46.573110  4365 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:46.536109 29448 raft_consensus.cc:1275] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
W20260709 13:14:46.578727 29493 consensus_peers.cc:597] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671): Couldn't send request to peer ca041dab9b2f44409ed7bf4c6cf66ab2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f352c5b8ac3f411ba5fc4901bc7e66a5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:46.579466 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:46.580585 29456 raft_consensus.cc:2410] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 24 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 13:14:46.521881  4194 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:46.581835 29454 raft_consensus.cc:1275] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:14:46.579572 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:46.583792 29379 raft_consensus.cc:2410] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for term 24 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 13:14:46.583738  4194 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:46.579792  4471 consensus_queue.cc:1048] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 13:14:46.585659 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:46.586360 29378 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:14:46.600945 29379 raft_consensus.cc:1275] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:14:46.602927 29495 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:46.572758 29279 catalog_manager.cc:5697] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:46.607949 29279 catalog_manager.cc:5697] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 18 to 19, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 19 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:46.609973 29279 catalog_manager.cc:5697] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 20 to 21, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 21 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:46.615435 29346 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:46.616556 29378 raft_consensus.cc:2468] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 24.
I20260709 13:14:46.611930 29279 catalog_manager.cc:5697] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:46.619148 29279 catalog_manager.cc:5697] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 21 to 22, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 22 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:46.623176 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:46.620478  4471 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:14:46.623206  4428 consensus_queue.cc:1059] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 13:14:46.629366  4476 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:14:46.629930  4476 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:46.630357  4476 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:46.625276  4423 consensus_queue.cc:1048] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:14:46.632711  4471 consensus_queue.cc:1048] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:14:46.634678  4279 raft_consensus.cc:3055] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:14:46.635083  4279 raft_consensus.cc:740] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:46.636888 29279 catalog_manager.cc:5697] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 21 to 22, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 22 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:46.638976 29456 raft_consensus.cc:1275] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:14:46.645061  4476 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:46.638881 29279 catalog_manager.cc:5697] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 19 to 22, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 22 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:46.647909 29279 catalog_manager.cc:5697] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 22 to 23, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 23 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:46.648650  4279 consensus_queue.cc:260] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:46.650102  4471 consensus_queue.cc:1048] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:14:46.650395  4476 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:46.667335 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:46.670096 29528 raft_consensus.cc:2393] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 23: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:46.672067 29421 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:46.673022  4173 raft_consensus.cc:2804] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:14:46.673532  4173 raft_consensus.cc:697] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 24 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:46.674425  4173 consensus_queue.cc:237] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:46.676033 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:46.670917  4423 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:46.677636  4423 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:46.678717  4414 raft_consensus.cc:993] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5: : Instructing follower 183db85c071f489fbc8de63a9edd8a3a to start an election
I20260709 13:14:46.679248  4414 raft_consensus.cc:1081] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Signalling peer 183db85c071f489fbc8de63a9edd8a3a to start an election
I20260709 13:14:46.680001  4423 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:46.684692 29454 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247"
dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:45798
I20260709 13:14:46.685423 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:46.685753 29454 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:46.686393 29454 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:46.687302 29456 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 23.
I20260709 13:14:46.688694 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:46.666162  4279 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:14:46.692598 29379 raft_consensus.cc:2368] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 23. Current term is 24.
I20260709 13:14:46.689845 29346 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:46.677413  4346 raft_consensus.cc:993] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5: : Instructing follower 183db85c071f489fbc8de63a9edd8a3a to start an election
I20260709 13:14:46.716713 29495 leader_election.cc:400] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 23. Current term is 24.
I20260709 13:14:46.717103 29495 leader_election.cc:403] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:46.717389 29456 raft_consensus.cc:1275] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:14:46.718273  4258 raft_consensus.cc:1081] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 LEADER]: Signalling peer 183db85c071f489fbc8de63a9edd8a3a to start an election
I20260709 13:14:46.723121  4476 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:14:46.740809 29454 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:46.767980  4418 raft_consensus.cc:2955] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:14:46.769369 29454 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:46.731134  4039 raft_consensus.cc:3060] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:14:46.734223  4423 consensus_queue.cc:1048] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:14:46.778503  4476 raft_consensus.cc:697] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:46.816385 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:46.817215 29378 raft_consensus.cc:3055] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:14:46.817567 29378 raft_consensus.cc:740] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:46.818349 29378 consensus_queue.cc:260] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:46.821354 29378 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:46.827422 29380 raft_consensus.cc:1275] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:14:46.832291  4476 consensus_queue.cc:237] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:46.838902 29378 raft_consensus.cc:2468] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 15.
I20260709 13:14:46.902415 29421 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:46.909211 29378 raft_consensus.cc:1275] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:14:46.916062 29378 raft_consensus.cc:1275] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
W20260709 13:14:46.924119  4486 log.cc:927] Time spent T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:14:46.925627  4471 consensus_queue.cc:1048] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:14:46.926302  4310 consensus_queue.cc:1048] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:14:46.916992  4252 raft_consensus.cc:2804] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:14:46.938696  4252 raft_consensus.cc:697] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 15 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:46.939777  4252 consensus_queue.cc:237] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:46.910621  4194 consensus_queue.cc:1048] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:14:46.946913 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:46.947679 29528 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:14:46.948606 29530 raft_consensus.cc:1275] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:14:46.957794 29449 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95"
dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:45798
I20260709 13:14:46.958739 29449 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:46.959241 29449 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:46.967456 29380 raft_consensus.cc:1275] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:14:46.968058 29380 pending_rounds.cc:85] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5: Aborting all ops after (but not including) 10
I20260709 13:14:46.968359 29380 pending_rounds.cc:107] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:14:46.968674 29380 raft_consensus.cc:2889] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:46.981010 29524 raft_consensus.cc:1275] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:14:47.005110 29449 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:47.015903 29528 raft_consensus.cc:2468] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 15.
I20260709 13:14:47.105804 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:47.108739 29449 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:46.996762  4336 consensus_queue.cc:1048] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.106s
W20260709 13:14:47.190028 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 186376us
I20260709 13:14:47.213064 29375 raft_consensus.cc:2955] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:14:47.200111  4428 consensus_queue.cc:1048] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
W20260709 13:14:47.231041  4279 consensus_meta.cc:287] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a: Time spent flushing consensus metadata: real 0.523s	user 0.012s	sys 0.001s
I20260709 13:14:47.252637 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:47.253717 29524 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:14:47.255012 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 93269us
I20260709 13:14:47.269222 29524 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 20.
I20260709 13:14:47.279865 29453 raft_consensus.cc:1240] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 19. Current term is 20. Ops: []
I20260709 13:14:47.283417  3683 consensus_queue.cc:1059] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:14:47.290778 29496 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.024s	sys 0.032s
W20260709 13:14:47.291378 29496 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.024s	sys 0.032s
I20260709 13:14:47.314940 29379 raft_consensus.cc:3055] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:14:47.315472 29379 raft_consensus.cc:740] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:47.316377 29379 consensus_queue.cc:260] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:47.328680 29379 raft_consensus.cc:3060] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:14:47.344230 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:47.334367  4499 log.cc:927] Time spent T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
W20260709 13:14:47.341459  4039 consensus_meta.cc:287] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.546s	user 0.013s	sys 0.000s
I20260709 13:14:47.270426  4173 consensus_queue.cc:1048] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.067s
W20260709 13:14:47.374264 29345 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:14:47.374341 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 109619us
W20260709 13:14:47.343024  4487 log.cc:927] Time spent T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 13:14:47.376369 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 95369.9us
I20260709 13:14:47.401193 29379 raft_consensus.cc:2468] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 20.
I20260709 13:14:47.389662 29419 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:47.380003  4039 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127) with higher term. Message: Invalid argument: T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 for earlier term 23. Current term is 24.
W20260709 13:14:47.407122 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 66438.6us
I20260709 13:14:47.387053 29456 raft_consensus.cc:2955] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
W20260709 13:14:47.412612  4476 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260709 13:14:47.426659 29379 raft_consensus.cc:1275] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:14:47.441399  4193 consensus_queue.cc:1048] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:47.459905 29372 raft_consensus.cc:1275] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:14:47.434626  4194 raft_consensus.cc:2804] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:14:47.465907  4194 raft_consensus.cc:697] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 20 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:47.466982  4194 consensus_queue.cc:237] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:47.479884 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 72535.1us
W20260709 13:14:47.499063  4505 log.cc:927] Time spent T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.146s	user 0.003s	sys 0.000s
W20260709 13:14:47.519379  4418 consensus_meta.cc:287] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483: Time spent flushing consensus metadata: real 0.749s	user 0.016s	sys 0.000s
I20260709 13:14:47.542982 29524 raft_consensus.cc:1240] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:14:47.563817 29524 raft_consensus.cc:1240] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 19. Current term is 20. Ops: []
I20260709 13:14:47.614470 29527 raft_consensus.cc:1275] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:14:47.640847 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:47.650344 29448 raft_consensus.cc:1275] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:14:47.616878  4418 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:34382 (request call id 4) took 1308 ms. Trace:
I20260709 13:14:47.671367  4531 ts_tablet_manager.cc:933] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2: Initiating tablet copy from peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:47.607594  4336 consensus_queue.cc:1048] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
W20260709 13:14:47.724255 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 59403.1us
W20260709 13:14:47.731299 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 70745.3us
W20260709 13:14:47.735579  4525 log.cc:927] Time spent T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:14:47.737185  4336 consensus_queue.cc:1048] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:14:47.664191  4418 rpcz_store.cc:276] 0709 13:14:46.258089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.258256 (+   167us) service_pool.cc:224] Handling call
0709 13:14:46.376835 (+118579us) log.cc:844] Serialized 513 byte log entry
0709 13:14:47.557316 (+1180481us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8772,"raft.queue_time_us":28000,"raft.run_cpu_time_us":1832,"raft.run_wall_time_us":2637,"spinlock_wait_cycles":584448,"thread_start_us":153222,"threads_started":1,"wal-append.queue_time_us":177142}
I20260709 13:14:47.747427 29524 raft_consensus.cc:1275] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
W20260709 13:14:47.750324  4504 log.cc:927] Time spent T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.372s	user 0.000s	sys 0.003s
I20260709 13:14:47.759011 29524 raft_consensus.cc:1275] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:14:47.789088 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 66075.3us
I20260709 13:14:47.826251  4193 consensus_queue.cc:1048] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:14:47.802340  4418 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:47.831961  4418 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:47.839571 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:47.840503 29456 raft_consensus.cc:2393] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 22: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:47.835240  4418 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:47.856400  4531 tablet_copy_client.cc:323] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Beginning tablet copy session from remote peer at address 127.27.146.131:35367
I20260709 13:14:47.902879 29378 consensus_queue.cc:237] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:14:47.911391 29540 tablet_copy_service.cc:140] P 71aa3578fd924765ab9ac0729c8d1483: Received BeginTabletCopySession request for tablet f352c5b8ac3f411ba5fc4901bc7e66a5 from peer ca041dab9b2f44409ed7bf4c6cf66ab2 ({username='slave'} at 127.0.0.1:53428)
I20260709 13:14:47.857653  4414 consensus_queue.cc:1048] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:14:47.912545 29540 tablet_copy_service.cc:161] P 71aa3578fd924765ab9ac0729c8d1483: Beginning new tablet copy session on tablet f352c5b8ac3f411ba5fc4901bc7e66a5 from peer ca041dab9b2f44409ed7bf4c6cf66ab2 at {username='slave'} at 127.0.0.1:53428: session id = ca041dab9b2f44409ed7bf4c6cf66ab2-f352c5b8ac3f411ba5fc4901bc7e66a5
I20260709 13:14:47.931640  4470 consensus_queue.cc:1048] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:14:47.934337 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 80911us
I20260709 13:14:47.935721  4155 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:47.936434  4155 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:47.941984  4252 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.947825  4155 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:47.945981  4252 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:47.965852  4252 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:47.961218 29540 tablet_copy_source_session.cc:215] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:47.973340  4531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f352c5b8ac3f411ba5fc4901bc7e66a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:47.980093 29277 catalog_manager.cc:5697] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 21 to 23, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 23 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:47.982688 29277 catalog_manager.cc:5697] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 19 to 21, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 21 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:47.996829 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:47.998667 29521 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 25.
I20260709 13:14:48.000664 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:48.001613 29373 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 24.
I20260709 13:14:48.014180 29419 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:48.017272 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:48.021337 29379 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 22.
I20260709 13:14:48.029462  4336 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:14:48.030072  4336 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:48.030462  4336 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:14:48.042714 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:48.051187 29279 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37594 (request call id 144) took 4110 ms. Trace:
I20260709 13:14:48.078651 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:48.081810 29525 raft_consensus.cc:2393] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 in current term 25: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:48.084758 29495 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:48.053081 29279 rpcz_store.cc:276] 0709 13:14:43.924543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:43.924745 (+   202us) service_pool.cc:224] Handling call
0709 13:14:48.034976 (+4110231us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:46.839748 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:46.840563 (+   815us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:46.840620 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:14:46.840647 (+    27us) tablet.cc:662] Decoding operations
0709 13:14:46.841973 (+  1326us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:46.842096 (+   123us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:46.842138 (+    42us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:14:46.843162 (+  1024us) tablet.cc:701] Row locks acquired
0709 13:14:46.843187 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:14:46.843401 (+   214us) write_op.cc:270] Start()
0709 13:14:46.884858 (+ 41457us) write_op.cc:276] Timestamp: P: 1783602886843326 usec, L: 0
0709 13:14:46.884910 (+    52us) op_driver.cc:348] REPLICATION: starting
0709 13:14:46.891825 (+  6915us) log.cc:844] Serialized 3673 byte log entry
0709 13:14:47.252253 (+360428us) op_driver.cc:464] REPLICATION: finished
0709 13:14:47.632587 (+380334us) write_op.cc:301] APPLY: starting
0709 13:14:47.643215 (+ 10628us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:47.826999 (+183784us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:47.827111 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:47.921322 (+ 94211us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:47.921605 (+   283us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 13:14:47.921713 (+   108us) write_op.cc:312] APPLY: finished
0709 13:14:47.922071 (+   358us) log.cc:844] Serialized 89 byte log entry
0709 13:14:47.922534 (+   463us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:47.922697 (+   163us) write_op.cc:454] Released schema lock
0709 13:14:47.922758 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:47.923409 (+   651us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:47.923456 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":815,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":357375,"apply.run_cpu_time_us":17505,"apply.run_wall_time_us":297733,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41675,"num_ops":9,"prepare.queue_time_us":129546,"prepare.run_cpu_time_us":5842,"prepare.run_wall_time_us":69652,"replication_time_us":354667,"thread_start_us":286717,"threads_started":2}]]}
I20260709 13:14:48.096966  4423 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:14:48.097488  4423 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:48.097906  4423 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:14:48.111711 29344 consensus_peers.cc:597] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 -> Peer ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671): Couldn't send request to peer ca041dab9b2f44409ed7bf4c6cf66ab2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3eb760d2a128422684c16e20d11a9e82. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:48.118988 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 103673us
I20260709 13:14:48.150488 29524 raft_consensus.cc:1275] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:14:48.164283 29525 raft_consensus.cc:1275] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:14:48.171283 29379 raft_consensus.cc:1275] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:14:48.182272 29448 raft_consensus.cc:1275] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:14:48.193957  3962 consensus_queue.cc:1048] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:14:48.200944  4519 consensus_queue.cc:1048] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:14:48.182391  4538 consensus_queue.cc:1048] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:14:48.209913  4446 consensus_queue.cc:1048] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:14:48.215863  4336 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:48.216336  4423 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:48.217326 29456 raft_consensus.cc:2368] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 25. Current term is 26.
I20260709 13:14:48.218626  4423 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:48.225013  4336 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 26 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:48.233302 29456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:48.239189  4531 tablet_copy_client.cc:806] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:48.239851 29456 raft_consensus.cc:2393] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 22: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:48.240043  4531 tablet_copy_client.cc:670] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:48.270262 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:48.270941 29524 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:14:48.274253 29346 leader_election.cc:400] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 25 pre-election: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 25. Current term is 26.
I20260709 13:14:48.274747 29346 leader_election.cc:403] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 25 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:48.275715  4414 raft_consensus.cc:3060] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Advancing to term 26
I20260709 13:14:48.282061 29524 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 26.
I20260709 13:14:48.284916 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:48.283910 29419 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:48.287400 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:48.304471  4428 raft_consensus.cc:2804] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:14:48.335778 29379 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 22.
I20260709 13:14:48.337886 29495 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:48.342720  4494 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:14:48.343324  4494 raft_consensus.cc:697] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:48.344252  4494 consensus_queue.cc:237] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:48.333230  4428 raft_consensus.cc:697] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 26 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:48.365307  4531 tablet_copy_client.cc:538] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:48.366101  4428 consensus_queue.cc:237] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:48.387912  4537 raft_consensus.cc:2955] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 LEADER]: Committing config change with OpId 23.13: config changed from index -1 to 13, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:14:48.400368  4531 tablet_bootstrap.cc:492] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap starting.
I20260709 13:14:48.404371 29449 raft_consensus.cc:2955] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Committing config change with OpId 23.13: config changed from index -1 to 13, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:14:48.404347 29525 raft_consensus.cc:2955] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Committing config change with OpId 23.13: config changed from index -1 to 13, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:14:48.437621  4507 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:48.468813 29277 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37608 (request call id 161) took 3722 ms. Trace:
W20260709 13:14:48.490816  4558 log.cc:927] Time spent T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:14:48.471201 29278 catalog_manager.cc:5697] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 21 to 22, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 22 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:48.468436  4507 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:48.515826 29278 catalog_manager.cc:5697] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 22 to 24, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 24 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:48.477038 29277 rpcz_store.cc:276] 0709 13:14:44.745948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:44.806203 (+ 60255us) service_pool.cc:224] Handling call
0709 13:14:45.304245 (+498042us) spinlock_profiling.cc:243] Waited 86.6 ms on lock 0x7b5400422054. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a7bcf0090 00007f6a7bd8ef3a 00007f6a81b451cc 00007f6a81c4337e 00007f6a801042a4 00007f6a80104232 00007f6a80104161 00007f6a801040dc 00007f6a80103392 00007f6a7a0c148c 00007f6a7a0c08c6
0709 13:14:48.468714 (+3164469us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:48.198064 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:48.198804 (+   740us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:48.198841 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:14:48.198859 (+    18us) tablet.cc:662] Decoding operations
0709 13:14:48.199259 (+   400us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:48.199314 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:48.199345 (+    31us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:14:48.199699 (+   354us) tablet.cc:701] Row locks acquired
0709 13:14:48.199715 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:14:48.199866 (+   151us) write_op.cc:270] Start()
0709 13:14:48.199975 (+   109us) write_op.cc:276] Timestamp: P: 1783602888199822 usec, L: 0
0709 13:14:48.199995 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:14:48.200771 (+   776us) log.cc:844] Serialized 935 byte log entry
0709 13:14:48.383065 (+182294us) op_driver.cc:464] REPLICATION: finished
0709 13:14:48.383861 (+   796us) write_op.cc:301] APPLY: starting
0709 13:14:48.383952 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:48.385656 (+  1704us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:48.385822 (+   166us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:48.390832 (+  5010us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:48.392751 (+  1919us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:14:48.392903 (+   152us) write_op.cc:312] APPLY: finished
0709 13:14:48.397660 (+  4757us) log.cc:844] Serialized 33 byte log entry
0709 13:14:48.399204 (+  1544us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:48.407656 (+  8452us) write_op.cc:454] Released schema lock
0709 13:14:48.407778 (+   122us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:48.442937 (+ 35159us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:48.447309 (+  4372us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":565466,"reported_tablets":13,"spinlock_wait_cycles":199150464,"child_traces":[["op",{"apply.queue_time_us":551,"apply.run_cpu_time_us":5829,"apply.run_wall_time_us":52670,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8344,"num_ops":2,"prepare.queue_time_us":182044,"prepare.run_cpu_time_us":3098,"prepare.run_wall_time_us":6315,"replication_time_us":182899,"thread_start_us":151650,"threads_started":1}]]}
W20260709 13:14:48.532141  4555 log.cc:927] Time spent T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:14:48.526425 29278 catalog_manager.cc:5697] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 29 to 31, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 31 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:48.539423 29278 catalog_manager.cc:5697] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 22 to 23, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 23 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:48.546135 29278 catalog_manager.cc:5697] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:48.587797  4507 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:48.607390 29373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:48.608294 29373 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 22.
I20260709 13:14:48.612088 29421 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
I20260709 13:14:48.620483 29278 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37586 (request call id 143) took 1889 ms. Trace:
I20260709 13:14:48.627853 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:48.621204 29278 rpcz_store.cc:276] 0709 13:14:46.731252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:46.731437 (+   185us) service_pool.cc:224] Handling call
0709 13:14:48.620401 (+1888964us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:48.557493 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:48.558109 (+   616us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:48.558165 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:14:48.558186 (+    21us) tablet.cc:662] Decoding operations
0709 13:14:48.558917 (+   731us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:48.558992 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:48.559019 (+    27us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:14:48.559695 (+   676us) tablet.cc:701] Row locks acquired
0709 13:14:48.559717 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:14:48.559862 (+   145us) write_op.cc:270] Start()
0709 13:14:48.559990 (+   128us) write_op.cc:276] Timestamp: P: 1783602888559813 usec, L: 0
0709 13:14:48.560011 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:14:48.560741 (+   730us) log.cc:844] Serialized 2109 byte log entry
0709 13:14:48.562713 (+  1972us) op_driver.cc:464] REPLICATION: finished
0709 13:14:48.563162 (+   449us) write_op.cc:301] APPLY: starting
0709 13:14:48.563265 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:48.566119 (+  2854us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:48.566216 (+    97us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:48.570798 (+  4582us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:48.570987 (+   189us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:14:48.571036 (+    49us) write_op.cc:312] APPLY: finished
0709 13:14:48.575408 (+  4372us) log.cc:844] Serialized 57 byte log entry
0709 13:14:48.576448 (+  1040us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:48.576578 (+   130us) write_op.cc:454] Released schema lock
0709 13:14:48.576629 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:48.577022 (+   393us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:48.577056 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":236,"apply.run_cpu_time_us":7362,"apply.run_wall_time_us":13816,"cfile_cache_hit":20,"cfile_cache_hit_bytes":20860,"num_ops":5,"prepare.queue_time_us":117,"prepare.run_cpu_time_us":3557,"prepare.run_wall_time_us":3558,"replication_time_us":2582}]]}
I20260709 13:14:48.630630  4428 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:14:48.641402  4428 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:48.641817  4428 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:48.656926 29279 catalog_manager.cc:5697] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:48.659188 29279 catalog_manager.cc:5697] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 14 to 15, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 15 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:48.667291 29279 catalog_manager.cc:5697] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:48.671365 29279 catalog_manager.cc:5697] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 16 to 18, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 18 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:48.675423 29279 catalog_manager.cc:5697] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 19 to 20, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 20 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:48.690021  4414 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: Vote denied by peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551) with higher term. Message: Invalid argument: T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 25. Current term is 26.
I20260709 13:14:48.698931 29279 catalog_manager.cc:5697] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 22 to 23, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 23 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:48.706513 29279 catalog_manager.cc:5697] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: config changed from index -1 to 13, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New cstate: current_term: 18 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:14:48.711382 29279 catalog_manager.cc:5697] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:48.716106 29279 catalog_manager.cc:5697] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:48.718289 29279 catalog_manager.cc:5697] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 20 to 21, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 21 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:48.722991 29378 raft_consensus.cc:2468] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 26.
I20260709 13:14:48.702822 29449 consensus_queue.cc:237] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
W20260709 13:14:48.776422 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 55841.9us
I20260709 13:14:48.797415 29380 raft_consensus.cc:1275] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 26 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:14:48.767285  4428 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:48.827761  4507 consensus_queue.cc:1048] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:14:48.829869 29451 raft_consensus.cc:1240] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 22. Current term is 23. Ops: []
I20260709 13:14:48.830386  4428 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:48.835086 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:48.836493  4563 ts_tablet_manager.cc:933] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2: Initiating tablet copy from peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127)
W20260709 13:14:48.837602 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 86728.4us
I20260709 13:14:48.846971  4423 consensus_queue.cc:1059] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:14:48.848064  4423 raft_consensus.cc:3055] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:14:48.848425  4423 raft_consensus.cc:740] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:48.849306  4423 consensus_queue.cc:260] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:48.850070  4563 tablet_copy_client.cc:323] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Beginning tablet copy session from remote peer at address 127.27.146.129:42127
I20260709 13:14:48.850600  4423 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:48.852821 29391 tablet_copy_service.cc:140] P 429e58eb058349e3bf72b5a870c8f6e5: Received BeginTabletCopySession request for tablet 3eb760d2a128422684c16e20d11a9e82 from peer ca041dab9b2f44409ed7bf4c6cf66ab2 ({username='slave'} at 127.0.0.1:58422)
I20260709 13:14:48.853545 29391 tablet_copy_service.cc:161] P 429e58eb058349e3bf72b5a870c8f6e5: Beginning new tablet copy session on tablet 3eb760d2a128422684c16e20d11a9e82 from peer ca041dab9b2f44409ed7bf4c6cf66ab2 at {username='slave'} at 127.0.0.1:58422: session id = ca041dab9b2f44409ed7bf4c6cf66ab2-3eb760d2a128422684c16e20d11a9e82
I20260709 13:14:48.855542 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:48.877039 29528 raft_consensus.cc:1275] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:14:48.880921 29380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:48.881781 29380 raft_consensus.cc:3060] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:14:48.886116 29419 consensus_peers.cc:597] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a -> Peer ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671): Couldn't send request to peer ca041dab9b2f44409ed7bf4c6cf66ab2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 40c0d06e6f284af29109e961ff953c5f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:48.887745  4336 consensus_queue.cc:1048] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:14:48.889799 29528 raft_consensus.cc:1275] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 26 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:14:48.919566 29277 catalog_manager.cc:5697] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:48.969107 29373 raft_consensus.cc:1275] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:14:48.973143 29380 raft_consensus.cc:2468] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 23.
I20260709 13:14:48.974313 29372 raft_consensus.cc:1240] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 22. Current term is 23. Ops: []
I20260709 13:14:48.976814 29421 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:48.980556 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 45401.9us
I20260709 13:14:48.986822  4252 raft_consensus.cc:2804] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:14:48.935662  4336 consensus_queue.cc:1048] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:14:49.017290 29391 tablet_copy_source_session.cc:215] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:48.979610  4519 consensus_queue.cc:1048] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:14:49.012319  4252 raft_consensus.cc:697] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 23 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:49.061246  4252 consensus_queue.cc:237] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:49.062093  4563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eb760d2a128422684c16e20d11a9e82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:49.096707  4563 tablet_copy_client.cc:806] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:49.097500  4563 tablet_copy_client.cc:670] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Starting download of 1 WAL segments...
W20260709 13:14:49.099725  4571 log.cc:927] Time spent T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
W20260709 13:14:49.110883  4569 log.cc:927] Time spent T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5: Append to log took a long time: real 0.141s	user 0.002s	sys 0.000s
I20260709 13:14:49.183115 29378 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "71aa3578fd924765ab9ac0729c8d1483"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:14:49.190749 29378 raft_consensus.cc:606] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 LEADER]: Received request to transfer leadership to TS 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:49.198758 29279 catalog_manager.cc:5697] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: config changed from index -1 to 13, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New cstate: current_term: 23 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:49.220978 29279 catalog_manager.cc:5697] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } }
I20260709 13:14:49.237749 29528 raft_consensus.cc:2955] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Committing config change with OpId 23.14: config changed from index -1 to 14, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:14:49.244628  4193 raft_consensus.cc:2955] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 23 LEADER]: Committing config change with OpId 23.14: config changed from index -1 to 14, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:14:49.285462  4563 tablet_copy_client.cc:538] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:49.329161  4446 raft_consensus.cc:993] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5: : Instructing follower 71aa3578fd924765ab9ac0729c8d1483 to start an election
I20260709 13:14:49.337024  4446 raft_consensus.cc:1081] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 LEADER]: Signalling peer 71aa3578fd924765ab9ac0729c8d1483 to start an election
I20260709 13:14:49.437341 29525 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93"
dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
 from {username='slave'} at 127.0.0.1:37968
I20260709 13:14:49.438256 29525 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:49.438732 29525 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:49.462443  4531 tablet_bootstrap.cc:492] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=1 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:49.481938  4578 ts_tablet_manager.cc:933] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2: Initiating tablet copy from peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:14:49.499528 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 45260.6us
W20260709 13:14:49.511451 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 49601.1us
I20260709 13:14:49.538240  4531 tablet_bootstrap.cc:492] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap complete.
I20260709 13:14:49.575773  4531 ts_tablet_manager.cc:1403] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent bootstrapping tablet: real 1.176s	user 0.053s	sys 0.031s
I20260709 13:14:49.605719 29525 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:49.609589 29525 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:49.631222  4563 tablet_bootstrap.cc:492] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap starting.
I20260709 13:14:49.632081 29524 raft_consensus.cc:1240] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Rejecting Update request from peer 429e58eb058349e3bf72b5a870c8f6e5 for earlier term 22. Current term is 23. Ops: []
I20260709 13:14:49.619042  4578 tablet_copy_client.cc:323] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Beginning tablet copy session from remote peer at address 127.27.146.130:40551
I20260709 13:14:49.645784  4531 raft_consensus.cc:359] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:14:49.646963  4531 raft_consensus.cc:740] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Initialized, Role: LEARNER
I20260709 13:14:49.662217  4531 consensus_queue.cc:260] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:14:49.662575  4435 consensus_queue.cc:1059] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:14:49.666976 29466 tablet_copy_service.cc:140] P 183db85c071f489fbc8de63a9edd8a3a: Received BeginTabletCopySession request for tablet 40c0d06e6f284af29109e961ff953c5f from peer ca041dab9b2f44409ed7bf4c6cf66ab2 ({username='slave'} at 127.0.0.1:36436)
I20260709 13:14:49.667822 29466 tablet_copy_service.cc:161] P 183db85c071f489fbc8de63a9edd8a3a: Beginning new tablet copy session on tablet 40c0d06e6f284af29109e961ff953c5f from peer ca041dab9b2f44409ed7bf4c6cf66ab2 at {username='slave'} at 127.0.0.1:36436: session id = ca041dab9b2f44409ed7bf4c6cf66ab2-40c0d06e6f284af29109e961ff953c5f
I20260709 13:14:49.667991  4435 raft_consensus.cc:3055] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:14:49.668419  4435 raft_consensus.cc:740] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:49.669315  4531 ts_tablet_manager.cc:1434] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent starting tablet: real 0.092s	user 0.006s	sys 0.003s
I20260709 13:14:49.670267  4435 consensus_queue.cc:260] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:49.678758 29540 tablet_copy_service.cc:342] P 71aa3578fd924765ab9ac0729c8d1483: Request end of tablet copy session ca041dab9b2f44409ed7bf4c6cf66ab2-f352c5b8ac3f411ba5fc4901bc7e66a5 received from {username='slave'} at 127.0.0.1:53428
I20260709 13:14:49.682587 29540 tablet_copy_service.cc:434] P 71aa3578fd924765ab9ac0729c8d1483: ending tablet copy session ca041dab9b2f44409ed7bf4c6cf66ab2-f352c5b8ac3f411ba5fc4901bc7e66a5 on tablet f352c5b8ac3f411ba5fc4901bc7e66a5 with peer ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:49.685623  4435 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:49.705461 30155 raft_consensus.cc:1217] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.12->[18.13-18.13]   Dedup: 18.13->[]
I20260709 13:14:49.692729 29379 consensus_queue.cc:237] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:14:49.715135 29466 tablet_copy_source_session.cc:215] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:14:49.755650 29346 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:14:49.782225 29377 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:14:49.792111 29377 raft_consensus.cc:606] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 LEADER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:49.800544 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: true dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:49.801829 29454 raft_consensus.cc:3060] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:49.794461 29278 catalog_manager.cc:5697] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: config changed from index -1 to 14, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New cstate: current_term: 23 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:14:49.806757 29372 raft_consensus.cc:1275] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:14:49.819036 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: true dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:49.820052  4578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40c0d06e6f284af29109e961ff953c5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:49.827937 29530 raft_consensus.cc:1275] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:14:49.819947 29380 raft_consensus.cc:2955] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Committing config change with OpId 23.14: config changed from index -1 to 14, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:14:49.835716 29381 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "71aa3578fd924765ab9ac0729c8d1483"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:14:49.836404 29381 raft_consensus.cc:606] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Received request to transfer leadership to TS 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:49.833288  4194 consensus_queue.cc:1048] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.010s
I20260709 13:14:49.856925 29378 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 13:14:49.857654 29378 raft_consensus.cc:606] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 LEADER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:49.859776 28234 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:14:49.877737 28234 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:14:49.881354 29344 consensus_peers.cc:597] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 -> Peer ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671): Couldn't send request to peer ca041dab9b2f44409ed7bf4c6cf66ab2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 66ee3283bb6d4ef28061d053b1bde164. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:49.881944 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 49642us
I20260709 13:14:49.893563  4476 consensus_queue.cc:1048] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:14:49.908360 29379 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 23.
I20260709 13:14:49.914155 29454 raft_consensus.cc:2468] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 23.
I20260709 13:14:49.925793 29495 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:49.935606 29451 raft_consensus.cc:1275] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:14:49.938505 29526 raft_consensus.cc:1275] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 15. (term mismatch)
I20260709 13:14:49.939013 29526 pending_rounds.cc:85] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483: Aborting all ops after (but not including) 14
I20260709 13:14:49.939265 29526 pending_rounds.cc:107] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483: Aborting uncommitted NO_OP operation due to leader change: 22.15
I20260709 13:14:49.939664 29526 raft_consensus.cc:2889] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:49.953154  4502 raft_consensus.cc:2804] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:14:49.953788  4502 raft_consensus.cc:697] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:49.954994  4502 consensus_queue.cc:237] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:49.975775  4435 raft_consensus.cc:993] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5: : Instructing follower 183db85c071f489fbc8de63a9edd8a3a to start an election
I20260709 13:14:49.975723  4446 consensus_queue.cc:1048] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:14:49.977128  4476 raft_consensus.cc:1081] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 LEADER]: Signalling peer 183db85c071f489fbc8de63a9edd8a3a to start an election
I20260709 13:14:50.000865 29454 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4"
dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:45798
I20260709 13:14:50.001689 29454 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:50.002158 29454 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:50.019105  4542 raft_consensus.cc:993] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5: : Instructing follower 183db85c071f489fbc8de63a9edd8a3a to start an election
I20260709 13:14:50.020053  4542 raft_consensus.cc:1081] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 LEADER]: Signalling peer 183db85c071f489fbc8de63a9edd8a3a to start an election
I20260709 13:14:50.028056  4549 consensus_queue.cc:1048] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 13:14:50.022945 29454 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:50.037364 29453 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98"
dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:45798
I20260709 13:14:50.037643  4578 tablet_copy_client.cc:806] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:50.038151 29453 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:50.038578 29453 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:14:50.038671  4578 tablet_copy_client.cc:670] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:50.050266  4506 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:50.050907  4506 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:50.054322  4506 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:50.057293  3683 raft_consensus.cc:2955] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 25 LEADER]: Committing config change with OpId 25.15: config changed from index -1 to 15, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:14:50.073932 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5" is_pre_election: true
I20260709 13:14:50.076267 29530 raft_consensus.cc:2955] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Committing config change with OpId 25.15: config changed from index -1 to 15, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:14:50.086988 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:50.090117 29495 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:50.091840  4502 raft_consensus.cc:2749] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:14:50.093657 29454 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:50.104249 29379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: true dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:50.104993 29379 raft_consensus.cc:3055] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:14:50.105290 29379 raft_consensus.cc:740] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:50.105876 29453 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:50.106348 29379 consensus_queue.cc:260] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:50.114364 29379 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:50.118925 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: true dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:50.121438 29453 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:50.121910 29526 raft_consensus.cc:3060] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:50.125751 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: true dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:50.132108 29524 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:14:50.135433 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: true dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:50.136121 29378 raft_consensus.cc:3055] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:14:50.136348 29378 raft_consensus.cc:740] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:50.143721 29379 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 23.
I20260709 13:14:50.138731  4578 tablet_copy_client.cc:538] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:50.137172 29378 consensus_queue.cc:260] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:50.161167 29378 raft_consensus.cc:3060] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:14:50.193894  4578 tablet_bootstrap.cc:492] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap starting.
I20260709 13:14:50.211799 29524 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 24.
I20260709 13:14:50.226969  4449 raft_consensus.cc:993] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5: : Instructing follower 71aa3578fd924765ab9ac0729c8d1483 to start an election
I20260709 13:14:50.236256 29526 raft_consensus.cc:2468] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 23.
I20260709 13:14:50.251305  4574 raft_consensus.cc:1081] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Signalling peer 71aa3578fd924765ab9ac0729c8d1483 to start an election
I20260709 13:14:50.260723 29524 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf"
dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
 from {username='slave'} at 127.0.0.1:37968
I20260709 13:14:50.261816 29524 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:50.262342 29524 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:50.271519  4511 raft_consensus.cc:1064] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483: attempting to promote NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 to VOTER
I20260709 13:14:50.275849  4511 consensus_queue.cc:237] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 11, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:50.286876 29279 catalog_manager.cc:5697] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 22 to 23, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 23 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:50.312340 29378 raft_consensus.cc:2468] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 24.
I20260709 13:14:50.316820 29421 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5; no voters: 
W20260709 13:14:50.317747 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 50508.7us
I20260709 13:14:50.318689  4193 raft_consensus.cc:2804] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:14:50.319339  4193 raft_consensus.cc:697] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 23 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:50.321877 29419 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:50.320449  4193 consensus_queue.cc:237] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:50.324965 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 89185.9us
I20260709 13:14:50.326181  4589 raft_consensus.cc:2804] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:14:50.326831  4589 raft_consensus.cc:697] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 24 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:50.331969  4589 consensus_queue.cc:237] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:50.380556  4599 ts_tablet_manager.cc:933] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2: Initiating tablet copy from peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127)
I20260709 13:14:50.381593 29372 raft_consensus.cc:1275] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:14:50.392663 29524 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:50.397464 29524 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:50.454223 29278 catalog_manager.cc:5697] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: config changed from index -1 to 15, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New cstate: current_term: 25 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:50.446784 29456 raft_consensus.cc:2955] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Committing config change with OpId 25.15: config changed from index -1 to 15, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
W20260709 13:14:50.462409 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 60153.2us
I20260709 13:14:50.466643 29378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:50.476325 29372 raft_consensus.cc:1275] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:14:50.485419 29454 raft_consensus.cc:1275] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:14:50.487637 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:50.488651 29449 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:50.507825  4521 consensus_queue.cc:1048] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.029s
W20260709 13:14:50.512179 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 72892us
I20260709 13:14:50.521770  4511 consensus_queue.cc:1048] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:14:50.546276 30155 raft_consensus.cc:1275] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 18 LEARNER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:14:50.610220 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 64693.1us
I20260709 13:14:50.614419 29449 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
I20260709 13:14:50.671322 29378 raft_consensus.cc:3055] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:14:50.672313 29378 raft_consensus.cc:740] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:50.673707 29378 consensus_queue.cc:260] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:50.675850 29378 raft_consensus.cc:3060] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:14:50.687657 29378 raft_consensus.cc:2468] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 17.
I20260709 13:14:50.663293  4599 tablet_copy_client.cc:323] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Beginning tablet copy session from remote peer at address 127.27.146.129:42127
W20260709 13:14:50.734778  4590 log.cc:927] Time spent T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.083s	user 0.004s	sys 0.000s
I20260709 13:14:50.734975  4407 consensus_queue.cc:1048] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.098s
W20260709 13:14:50.728731 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 115378us
W20260709 13:14:50.782958  4563 log.cc:927] Time spent T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2: Append to log took a long time: real 0.236s	user 0.004s	sys 0.004s
W20260709 13:14:50.770836 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 152083us
W20260709 13:14:50.785337 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 46023.4us
I20260709 13:14:50.815344 29495 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:14:50.852397 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 77416.7us
I20260709 13:14:50.861719  4605 consensus_queue.cc:1048] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.080s
I20260709 13:14:50.867585 29449 raft_consensus.cc:1275] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:14:50.862782  4596 raft_consensus.cc:2804] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:14:50.879729 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:50.886490  4563 tablet_bootstrap.cc:492] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:50.887790  4563 tablet_bootstrap.cc:492] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap complete.
I20260709 13:14:50.901583 29391 tablet_copy_service.cc:140] P 429e58eb058349e3bf72b5a870c8f6e5: Received BeginTabletCopySession request for tablet 66ee3283bb6d4ef28061d053b1bde164 from peer ca041dab9b2f44409ed7bf4c6cf66ab2 ({username='slave'} at 127.0.0.1:58422)
I20260709 13:14:50.902321 29391 tablet_copy_service.cc:161] P 429e58eb058349e3bf72b5a870c8f6e5: Beginning new tablet copy session on tablet 66ee3283bb6d4ef28061d053b1bde164 from peer ca041dab9b2f44409ed7bf4c6cf66ab2 at {username='slave'} at 127.0.0.1:58422: session id = ca041dab9b2f44409ed7bf4c6cf66ab2-66ee3283bb6d4ef28061d053b1bde164
I20260709 13:14:50.914424  4596 raft_consensus.cc:697] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 17 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:50.915045  4563 ts_tablet_manager.cc:1403] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent bootstrapping tablet: real 1.309s	user 0.063s	sys 0.023s
W20260709 13:14:50.922627  4603 log.cc:927] Time spent T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.285s	user 0.000s	sys 0.003s
I20260709 13:14:50.915666  4596 consensus_queue.cc:237] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:50.958117  4563 raft_consensus.cc:359] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 23 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:14:50.965338 29391 tablet_copy_source_session.cc:215] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:50.958680 29279 catalog_manager.cc:5697] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 22 to 23, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 23 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:51.006575 29372 raft_consensus.cc:1275] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:14:51.006794 29379 raft_consensus.cc:1275] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:14:50.959311  4563 raft_consensus.cc:740] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 23 LEARNER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Initialized, Role: LEARNER
I20260709 13:14:51.015477 29525 raft_consensus.cc:1275] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:14:51.004604  4521 consensus_queue.cc:1048] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.054s
I20260709 13:14:51.098297  4595 consensus_queue.cc:1048] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 13:14:51.084276  4563 consensus_queue.cc:260] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
W20260709 13:14:51.140268 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 68870.6us
W20260709 13:14:51.144001 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 75802.9us
I20260709 13:14:51.171743  4428 consensus_queue.cc:1048] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.008s
I20260709 13:14:51.174233  4599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66ee3283bb6d4ef28061d053b1bde164. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:51.183286  4563 ts_tablet_manager.cc:1434] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent starting tablet: real 0.268s	user 0.010s	sys 0.000s
I20260709 13:14:51.188608 30153 raft_consensus.cc:1217] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 23 LEARNER]: Deduplicated request from leader. Original: 23.12->[23.13-23.13]   Dedup: 23.13->[]
I20260709 13:14:51.237409 29391 tablet_copy_service.cc:342] P 429e58eb058349e3bf72b5a870c8f6e5: Request end of tablet copy session ca041dab9b2f44409ed7bf4c6cf66ab2-3eb760d2a128422684c16e20d11a9e82 received from {username='slave'} at 127.0.0.1:58422
I20260709 13:14:51.238054 29391 tablet_copy_service.cc:434] P 429e58eb058349e3bf72b5a870c8f6e5: ending tablet copy session ca041dab9b2f44409ed7bf4c6cf66ab2-3eb760d2a128422684c16e20d11a9e82 on tablet 3eb760d2a128422684c16e20d11a9e82 with peer ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:51.204512  4428 consensus_queue.cc:1048] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.043s
W20260709 13:14:51.273746 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 55216.9us
W20260709 13:14:51.272816  4578 log.cc:927] Time spent T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:14:51.323613 29525 raft_consensus.cc:1275] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
W20260709 13:14:51.483645  4636 log.cc:927] Time spent T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:14:51.497503 29277 catalog_manager.cc:5697] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 22 to 23, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 23 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:51.528514 29277 catalog_manager.cc:5697] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 23 to 24, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 24 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:51.533511 30155 raft_consensus.cc:2955] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:51.546201 29279 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37608 (request call id 164) took 1041 ms. Trace:
I20260709 13:14:51.559609 29279 rpcz_store.cc:276] 0709 13:14:50.504509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.505584 (+  1075us) service_pool.cc:224] Handling call
0709 13:14:51.546124 (+1040540us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:51.020371 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:51.157457 (+137086us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:51.162727 (+  5270us) write_op.cc:435] Acquired schema lock
0709 13:14:51.164875 (+  2148us) tablet.cc:662] Decoding operations
0709 13:14:51.181014 (+ 16139us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:51.181095 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:51.181122 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:14:51.181338 (+   216us) tablet.cc:701] Row locks acquired
0709 13:14:51.181355 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:14:51.181521 (+   166us) write_op.cc:270] Start()
0709 13:14:51.181633 (+   112us) write_op.cc:276] Timestamp: P: 1783602891181471 usec, L: 0
0709 13:14:51.181657 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:14:51.182357 (+   700us) log.cc:844] Serialized 544 byte log entry
0709 13:14:51.304315 (+121958us) op_driver.cc:464] REPLICATION: finished
0709 13:14:51.310772 (+  6457us) write_op.cc:301] APPLY: starting
0709 13:14:51.310864 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:51.311869 (+  1005us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:51.311986 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:51.312762 (+   776us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:51.312931 (+   169us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:14:51.312976 (+    45us) write_op.cc:312] APPLY: finished
0709 13:14:51.313164 (+   188us) log.cc:844] Serialized 25 byte log entry
0709 13:14:51.313336 (+   172us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:51.313428 (+    92us) write_op.cc:454] Released schema lock
0709 13:14:51.313490 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:51.314995 (+  1505us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:51.316101 (+  1106us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":86,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":4206,"apply.run_cpu_time_us":3097,"apply.run_wall_time_us":4170,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4172,"num_ops":1,"prepare.queue_time_us":6707,"prepare.run_cpu_time_us":3535,"prepare.run_wall_time_us":173888,"replication_time_us":122492}]]}
W20260709 13:14:51.601233 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 98850.7us
I20260709 13:14:51.611850  4193 consensus_queue.cc:1048] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:14:51.619544 29380 raft_consensus.cc:1275] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:14:51.642666  4578 tablet_bootstrap.cc:492] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=1 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:51.646950  4578 tablet_bootstrap.cc:492] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap complete.
I20260709 13:14:51.526371  4615 raft_consensus.cc:2955] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index 13 to 14, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:51.647917  4578 ts_tablet_manager.cc:1403] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent bootstrapping tablet: real 1.454s	user 0.065s	sys 0.025s
I20260709 13:14:51.651187 29450 raft_consensus.cc:1275] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:14:51.676417  4617 consensus_queue.cc:1048] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:14:51.692528  4599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:54212 (request call id 339) took 1365 ms. Trace:
I20260709 13:14:51.693087  4599 rpcz_store.cc:276] 0709 13:14:50.326740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:50.327136 (+   396us) service_pool.cc:224] Handling call
0709 13:14:50.381066 (+ 53930us) ts_tablet_manager.cc:934] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2: Initiating tablet copy from peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127)
0709 13:14:51.113714 (+732648us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:14:51.386214 (+272500us) tablet_metadata.cc:665] Metadata flushed
0709 13:14:51.386372 (+   158us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:14:51.686662 (+300290us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:14:51.687002 (+   340us) tablet_replica.cc:206] Creating consensus instance
0709 13:14:51.692359 (+  5357us) ts_tablet_manager.cc:989] Replica registered.
0709 13:14:51.692429 (+    70us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":117295,"tablet-copy.queue_time_us":52598,"thread_start_us":214314,"threads_started":2}
I20260709 13:14:51.694727  4599 tablet_copy_client.cc:806] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:51.695062 29376 raft_consensus.cc:2955] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:51.703629  4578 raft_consensus.cc:359] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 23 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:14:51.704656  4578 raft_consensus.cc:740] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 23 LEARNER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Initialized, Role: LEARNER
I20260709 13:14:51.705631  4578 consensus_queue.cc:260] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:14:51.722673  4599 tablet_copy_client.cc:670] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:51.726142  4578 ts_tablet_manager.cc:1434] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent starting tablet: real 0.078s	user 0.009s	sys 0.001s
I20260709 13:14:51.725405 29449 raft_consensus.cc:2955] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:51.728289 29466 tablet_copy_service.cc:342] P 183db85c071f489fbc8de63a9edd8a3a: Request end of tablet copy session ca041dab9b2f44409ed7bf4c6cf66ab2-40c0d06e6f284af29109e961ff953c5f received from {username='slave'} at 127.0.0.1:36436
I20260709 13:14:51.728863 29466 tablet_copy_service.cc:434] P 183db85c071f489fbc8de63a9edd8a3a: ending tablet copy session ca041dab9b2f44409ed7bf4c6cf66ab2-40c0d06e6f284af29109e961ff953c5f on tablet 40c0d06e6f284af29109e961ff953c5f with peer ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:14:51.744333 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 43735.8us
I20260709 13:14:51.769533  4521 consensus_queue.cc:1048] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:14:51.785780  4599 tablet_copy_client.cc:538] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:51.853777  4635 raft_consensus.cc:1064] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5: attempting to promote NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 to VOTER
I20260709 13:14:51.857311  4635 consensus_queue.cc:237] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 11, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:51.879036 29278 catalog_manager.cc:5697] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: config changed from index 13 to 14, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:51.983088 29275 catalog_manager.cc:5697] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 16 to 17, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 17 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:51.943303  4599 tablet_bootstrap.cc:492] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap starting.
I20260709 13:14:52.008714 29530 raft_consensus.cc:1275] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:14:52.032328 30155 raft_consensus.cc:1275] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 23 LEARNER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:14:52.036115  4542 consensus_queue.cc:1048] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 13:14:52.057482 29521 consensus_queue.cc:237] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:52.058422  4635 consensus_queue.cc:1048] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:14:52.089174 29448 raft_consensus.cc:1275] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:14:52.094437 30153 raft_consensus.cc:1217] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 23 LEARNER]: Deduplicated request from leader. Original: 23.13->[23.14-23.14]   Dedup: 23.14->[]
I20260709 13:14:52.103353 30151 raft_consensus.cc:1275] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 18 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:14:52.116460  4611 consensus_queue.cc:1048] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:14:52.194329 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 120529us
I20260709 13:14:52.196130  4615 consensus_queue.cc:1048] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:14:52.199997 29454 raft_consensus.cc:1275] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 13:14:52.204097 29493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 89685.4us
I20260709 13:14:52.213596  4521 raft_consensus.cc:2955] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 LEADER]: Committing config change with OpId 18.15: config changed from index 14 to 15, VOTER 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:52.216828 30155 raft_consensus.cc:2955] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 18 FOLLOWER]: Committing config change with OpId 18.15: config changed from index 14 to 15, VOTER 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:52.241775  3683 raft_consensus.cc:2955] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 LEADER]: Committing config change with OpId 23.14: config changed from index 13 to 14, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:52.240190  4596 consensus_queue.cc:1048] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.005s
I20260709 13:14:52.257289 29525 raft_consensus.cc:2955] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Committing config change with OpId 23.14: config changed from index 13 to 14, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:52.289424 29263 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f352c5b8ac3f411ba5fc4901bc7e66a5 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:14:52.421849 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 112984us
I20260709 13:14:52.422837 29279 catalog_manager.cc:5697] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: config changed from index 14 to 15, VOTER 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) evicted. New cstate: current_term: 18 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:52.478055 29453 raft_consensus.cc:2955] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Committing config change with OpId 18.15: config changed from index 14 to 15, VOTER 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:52.540208 29275 catalog_manager.cc:5697] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: config changed from index 13 to 14, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New cstate: current_term: 23 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:52.556741 30155 raft_consensus.cc:2955] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 23 FOLLOWER]: Committing config change with OpId 23.14: config changed from index 13 to 14, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:52.628245 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:52.645092 29368 tablet_service.cc:1558] Processing DeleteTablet for tablet f352c5b8ac3f411ba5fc4901bc7e66a5 with delete_type TABLET_DATA_TOMBSTONED (TS 429e58eb058349e3bf72b5a870c8f6e5 not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:52164
I20260709 13:14:52.679773  4664 tablet_replica.cc:333] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:52.681478  4664 raft_consensus.cc:2243] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:52.718726  4664 raft_consensus.cc:2272] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:52.745484  4664 ts_tablet_manager.cc:1916] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:52.841135  4627 raft_consensus.cc:1064] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a: attempting to promote NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 to VOTER
I20260709 13:14:52.870900  4627 consensus_queue.cc:237] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 12, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:14:52.897298 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 58811.8us
I20260709 13:14:52.914397 29378 consensus_queue.cc:237] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:52.920290 30155 raft_consensus.cc:1275] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 23 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:14:52.922164  3683 consensus_queue.cc:1048] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:14:52.937171  4599 tablet_bootstrap.cc:492] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=0 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:52.940166  4599 tablet_bootstrap.cc:492] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap complete.
I20260709 13:14:52.948922  4599 ts_tablet_manager.cc:1403] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent bootstrapping tablet: real 1.006s	user 0.052s	sys 0.024s
I20260709 13:14:52.951283 29454 raft_consensus.cc:2955] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Committing config change with OpId 23.14: config changed from index 13 to 14, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:52.952721  4476 raft_consensus.cc:2955] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 LEADER]: Committing config change with OpId 23.15: config changed from index 14 to 15, VOTER 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:52.953715  4599 raft_consensus.cc:359] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 25 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:14:52.955921  4599 raft_consensus.cc:740] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 25 LEARNER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Initialized, Role: LEARNER
I20260709 13:14:52.956722  4599 consensus_queue.cc:260] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:14:52.958047 30155 raft_consensus.cc:2955] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index 14 to 15, VOTER 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:52.963040  4599 ts_tablet_manager.cc:1434] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:14:52.973767 29448 raft_consensus.cc:1275] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
W20260709 13:14:52.996351 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 45567.8us
I20260709 13:14:53.004786 29391 tablet_copy_service.cc:342] P 429e58eb058349e3bf72b5a870c8f6e5: Request end of tablet copy session ca041dab9b2f44409ed7bf4c6cf66ab2-66ee3283bb6d4ef28061d053b1bde164 received from {username='slave'} at 127.0.0.1:58422
I20260709 13:14:53.005376 29391 tablet_copy_service.cc:434] P 429e58eb058349e3bf72b5a870c8f6e5: ending tablet copy session ca041dab9b2f44409ed7bf4c6cf66ab2-66ee3283bb6d4ef28061d053b1bde164 on tablet 66ee3283bb6d4ef28061d053b1bde164 with peer ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:53.018541 29275 catalog_manager.cc:5697] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: config changed from index 14 to 15, VOTER 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) evicted. New cstate: current_term: 23 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:53.024839 29526 raft_consensus.cc:1275] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:14:53.027009  4628 consensus_queue.cc:1048] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:14:53.029626 30155 raft_consensus.cc:1275] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 23 LEARNER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:14:53.032303  4193 consensus_queue.cc:1048] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:14:53.051192 29520 tablet_service.cc:1558] Processing DeleteTablet for tablet 3eb760d2a128422684c16e20d11a9e82 with delete_type TABLET_DATA_TOMBSTONED (TS 71aa3578fd924765ab9ac0729c8d1483 not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:37954
I20260709 13:14:53.070988  4476 consensus_queue.cc:1048] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:14:53.088188 29376 raft_consensus.cc:1275] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:14:53.086491 29453 raft_consensus.cc:2955] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index 14 to 15, VOTER 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:53.096896 29265 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3eb760d2a128422684c16e20d11a9e82 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:53.110355  4664 ts_tablet_manager.cc:1929] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.14
I20260709 13:14:53.113416  4664 log.cc:1199] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 429e58eb058349e3bf72b5a870c8f6e5: Deleting WAL directory at /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/ts-0-root/wals/f352c5b8ac3f411ba5fc4901bc7e66a5
I20260709 13:14:53.126493 29265 catalog_manager.cc:5028] TS 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): tablet f352c5b8ac3f411ba5fc4901bc7e66a5 (table test-workload [id=364c32d53f7748a2857a4a9acd17c671]) successfully deleted
I20260709 13:14:53.129261  4592 consensus_queue.cc:1048] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:14:53.126904  4670 tablet_replica.cc:333] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:14:53.147176  4670 raft_consensus.cc:2243] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:53.167295 30153 raft_consensus.cc:2955] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index 14 to 15, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:53.178375  4670 raft_consensus.cc:2272] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:53.182574 29453 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7"
dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
mode: GRACEFUL
new_leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
 from {username='slave'} at 127.0.0.1:46172
I20260709 13:14:53.163769  4621 raft_consensus.cc:2955] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 23 LEADER]: Committing config change with OpId 23.15: config changed from index 14 to 15, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
W20260709 13:14:53.209677 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 69295.2us
I20260709 13:14:53.183202 29453 raft_consensus.cc:606] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 18 LEADER]: Received request to transfer leadership to TS 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:14:53.247972 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 55941.2us
I20260709 13:14:53.327590  4670 ts_tablet_manager.cc:1916] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:14:53.337033 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 68148.3us
W20260709 13:14:53.350080 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 82314.7us
I20260709 13:14:53.351850 29453 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247"
dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
mode: GRACEFUL
new_leader_uuid: "71aa3578fd924765ab9ac0729c8d1483"
 from {username='slave'} at 127.0.0.1:46172
I20260709 13:14:53.352738 29453 raft_consensus.cc:606] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 15 LEADER]: Received request to transfer leadership to TS 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:53.375034 29279 catalog_manager.cc:5697] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: config changed from index 14 to 15, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New cstate: current_term: 23 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:53.388695 29524 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5"
dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
mode: GRACEFUL
new_leader_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:52288
I20260709 13:14:53.389480 29524 raft_consensus.cc:606] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 LEADER]: Received request to transfer leadership to TS 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:14:53.395988 30153 raft_consensus.cc:1217] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 25 LEARNER]: Deduplicated request from leader. Original: 25.14->[25.15-25.15]   Dedup: 25.15->[]
I20260709 13:14:53.403613  4670 ts_tablet_manager.cc:1929] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 23.14
I20260709 13:14:53.404268  4670 log.cc:1199] T 3eb760d2a128422684c16e20d11a9e82 P 71aa3578fd924765ab9ac0729c8d1483: Deleting WAL directory at /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/ts-2-root/wals/3eb760d2a128422684c16e20d11a9e82
I20260709 13:14:53.406306 29378 raft_consensus.cc:2955] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index 14 to 15, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:53.432526 29263 catalog_manager.cc:5028] TS 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): tablet 3eb760d2a128422684c16e20d11a9e82 (table test-workload [id=364c32d53f7748a2857a4a9acd17c671]) successfully deleted
I20260709 13:14:53.434285 28234 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:14:53.436667 28234 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:53.438421 29525 raft_consensus.cc:2955] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index 14 to 15, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
W20260709 13:14:53.580042 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 136247us
I20260709 13:14:53.639810 29454 consensus_queue.cc:237] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:53.735795  4621 raft_consensus.cc:993] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a: : Instructing follower 71aa3578fd924765ab9ac0729c8d1483 to start an election
I20260709 13:14:53.736600  4621 raft_consensus.cc:1081] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 15 LEADER]: Signalling peer 71aa3578fd924765ab9ac0729c8d1483 to start an election
I20260709 13:14:53.756830  4628 raft_consensus.cc:993] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a: : Instructing follower 429e58eb058349e3bf72b5a870c8f6e5 to start an election
I20260709 13:14:53.757527  4592 raft_consensus.cc:1081] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 18 LEADER]: Signalling peer 429e58eb058349e3bf72b5a870c8f6e5 to start an election
I20260709 13:14:53.759646 29375 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7"
dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
 from {username='slave'} at 127.0.0.1:52172
I20260709 13:14:53.760249 29375 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:53.760586 29375 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:53.769399 29375 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:53.773077 29375 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:53.773921 30153 raft_consensus.cc:1275] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 23 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:14:53.774236 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:53.776561 29524 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:53.787513 29524 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 19.
I20260709 13:14:53.789927 29344 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:53.791095  4476 raft_consensus.cc:2804] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:14:53.791657  4476 raft_consensus.cc:697] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 LEADER]: Becoming Leader. State: Replica: 429e58eb058349e3bf72b5a870c8f6e5, State: Running, Role: LEADER
I20260709 13:14:53.792603  4476 consensus_queue.cc:237] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:53.794833 29525 raft_consensus.cc:1275] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:14:53.797199 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:53.797900 29454 raft_consensus.cc:3055] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:14:53.798225 29454 raft_consensus.cc:740] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:53.799602 29454 consensus_queue.cc:260] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:53.800885 29454 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:53.801561 29525 raft_consensus.cc:1240] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:53.805632 29525 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247"
dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
 from {username='slave'} at 127.0.0.1:37958
I20260709 13:14:53.806438 29525 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:53.806892 29525 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:53.808696  4193 consensus_queue.cc:1048] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:14:53.824452 29454 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 429e58eb058349e3bf72b5a870c8f6e5 in term 19.
I20260709 13:14:53.825384 29275 catalog_manager.cc:5697] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: term changed from 18 to 19, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129). New cstate: current_term: 19 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:53.833436  4628 raft_consensus.cc:2955] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 23 LEADER]: Committing config change with OpId 23.16: config changed from index 15 to 16, VOTER 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:53.861546 30153 raft_consensus.cc:2955] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 23 FOLLOWER]: Committing config change with OpId 23.16: config changed from index 15 to 16, VOTER 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:53.866102 29265 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 40c0d06e6f284af29109e961ff953c5f with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:53.883946 29275 catalog_manager.cc:5697] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: config changed from index 15 to 16, VOTER 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) evicted. New cstate: current_term: 23 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:14:53.917392 29368 tablet_service.cc:1558] Processing DeleteTablet for tablet 40c0d06e6f284af29109e961ff953c5f with delete_type TABLET_DATA_TOMBSTONED (TS 429e58eb058349e3bf72b5a870c8f6e5 not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:52164
I20260709 13:14:53.925947  4193 consensus_queue.cc:1048] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:14:53.928797 29525 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:53.934967  4680 tablet_replica.cc:333] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:53.939029  4612 raft_consensus.cc:1064] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5: attempting to promote NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 to VOTER
I20260709 13:14:53.945642  4612 consensus_queue.cc:237] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 13, Current term: 25, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:53.950661 29525 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:53.989212  4615 raft_consensus.cc:993] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483: : Instructing follower 183db85c071f489fbc8de63a9edd8a3a to start an election
I20260709 13:14:53.990507  4605 raft_consensus.cc:1081] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 LEADER]: Signalling peer 183db85c071f489fbc8de63a9edd8a3a to start an election
I20260709 13:14:54.005816 29448 raft_consensus.cc:1275] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:14:54.006001 30153 raft_consensus.cc:1275] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 25 LEARNER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:14:54.007597  4476 consensus_queue.cc:1048] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:14:54.008634 29525 raft_consensus.cc:1275] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:14:54.008773  4663 consensus_queue.cc:1048] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:14:54.011261  4663 consensus_queue.cc:1048] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:14:54.017225  4680 raft_consensus.cc:2243] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:54.018179  4680 raft_consensus.cc:2272] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:54.025780  4680 ts_tablet_manager.cc:1916] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:54.039745 29376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "429e58eb058349e3bf72b5a870c8f6e5"
I20260709 13:14:54.040505 29376 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:54.043004 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:54.043740 29453 raft_consensus.cc:3055] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:14:54.044041 29453 raft_consensus.cc:740] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:54.044833 29453 consensus_queue.cc:260] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:54.046042 29453 raft_consensus.cc:3060] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:14:54.069458 29527 raft_consensus.cc:2955] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Committing config change with OpId 23.16: config changed from index 15 to 16, VOTER 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:54.048264 29454 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5"
dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
 from {username='slave'} at 127.0.0.1:45796
I20260709 13:14:54.071158 29454 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:54.071723 29454 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:54.099304 29453 raft_consensus.cc:2468] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16.
W20260709 13:14:54.105315  4683 log.cc:927] Time spent T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:14:54.123978 29495 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:54.049316 29376 raft_consensus.cc:2468] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 16.
I20260709 13:14:54.058132  4612 raft_consensus.cc:2955] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 25 LEADER]: Committing config change with OpId 25.16: config changed from index 15 to 16, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:54.060307 29524 raft_consensus.cc:2955] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Committing config change with OpId 25.16: config changed from index 15 to 16, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:54.062338 29530 raft_consensus.cc:1240] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 15. Current term is 16. Ops: []
I20260709 13:14:54.140974  4680 ts_tablet_manager.cc:1929] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 23.15
I20260709 13:14:54.145339  4680 log.cc:1199] T 40c0d06e6f284af29109e961ff953c5f P 429e58eb058349e3bf72b5a870c8f6e5: Deleting WAL directory at /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/ts-0-root/wals/40c0d06e6f284af29109e961ff953c5f
I20260709 13:14:54.154124  4615 raft_consensus.cc:2804] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:14:54.154938  4615 raft_consensus.cc:697] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:54.156050  4615 consensus_queue.cc:237] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:54.166060 29265 catalog_manager.cc:5028] TS 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): tablet 40c0d06e6f284af29109e961ff953c5f (table test-workload [id=364c32d53f7748a2857a4a9acd17c671]) successfully deleted
I20260709 13:14:54.175163 29454 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:54.176388 29453 raft_consensus.cc:1240] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Rejecting Update request from peer 71aa3578fd924765ab9ac0729c8d1483 for earlier term 18. Current term is 19. Ops: []
I20260709 13:14:54.177342 29454 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 election: Requested vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:54.183218  4605 consensus_queue.cc:1059] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:14:54.184716  4617 raft_consensus.cc:3055] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:14:54.185117  4617 raft_consensus.cc:740] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:54.186017  4617 consensus_queue.cc:260] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:54.187630  4617 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:54.189841 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:14:54.190507 30153 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:14:54.193624 29530 raft_consensus.cc:1275] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:14:54.193967 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:54.209621 30153 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 19.
I20260709 13:14:54.222078  4658 consensus_queue.cc:1048] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:54.228381 29524 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 19.
I20260709 13:14:54.235918 30153 raft_consensus.cc:2955] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 25 FOLLOWER]: Committing config change with OpId 25.16: config changed from index 15 to 16, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:54.262109 29456 raft_consensus.cc:2955] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Committing config change with OpId 25.16: config changed from index 15 to 16, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:54.276943 29279 catalog_manager.cc:5697] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 reported cstate change: config changed from index 15 to 16, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New cstate: current_term: 25 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:14:54.336413 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 54718.9us
I20260709 13:14:54.360261 29419 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:14:54.361608  4193 raft_consensus.cc:2804] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:14:54.362306  4193 raft_consensus.cc:697] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 19 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:14:54.363173  4193 consensus_queue.cc:237] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:54.406317 29278 catalog_manager.cc:5697] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 15 to 16, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 16 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:54.454461 29380 consensus_queue.cc:237] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:54.460264 29456 raft_consensus.cc:1275] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:14:54.465938 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:54.498723 29275 catalog_manager.cc:5697] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 18 to 19, leader changed from 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 19 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:54.508069  4476 consensus_queue.cc:1048] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:54.511358 29521 raft_consensus.cc:1275] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:14:54.511358 30155 raft_consensus.cc:1275] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 25 FOLLOWER]: Refusing update from remote peer 429e58eb058349e3bf72b5a870c8f6e5: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:14:54.519011  4476 consensus_queue.cc:1048] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:14:54.520022  4691 consensus_queue.cc:1048] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:14:54.534389  4606 raft_consensus.cc:2955] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 25 LEADER]: Committing config change with OpId 25.17: config changed from index 16 to 17, VOTER 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:54.545814 29521 raft_consensus.cc:2955] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Committing config change with OpId 25.17: config changed from index 16 to 17, VOTER 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:54.558272 30155 raft_consensus.cc:2955] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 25 FOLLOWER]: Committing config change with OpId 25.17: config changed from index 16 to 17, VOTER 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:54.618860 29279 catalog_manager.cc:5697] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: config changed from index 16 to 17, VOTER 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) evicted. New cstate: current_term: 25 leader_uuid: "429e58eb058349e3bf72b5a870c8f6e5" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:14:54.675787 29454 raft_consensus.cc:1275] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:14:54.677896  4617 consensus_queue.cc:1048] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:14:54.729403 29441 tablet_service.cc:1558] Processing DeleteTablet for tablet 66ee3283bb6d4ef28061d053b1bde164 with delete_type TABLET_DATA_TOMBSTONED (TS 183db85c071f489fbc8de63a9edd8a3a not found in new config with opid_index 17) from {username='slave'} at 127.0.0.1:35524
W20260709 13:14:54.762668 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 167567us
I20260709 13:14:54.767037 29265 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 66ee3283bb6d4ef28061d053b1bde164 with cas_config_opid_index 16: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:14:54.781649  4696 tablet_replica.cc:333] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:14:54.788645 29521 raft_consensus.cc:1275] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:14:54.792807  4592 consensus_queue.cc:1048] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:14:54.825887  4696 raft_consensus.cc:2243] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:54.836933  4696 raft_consensus.cc:2272] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:54.858906  4696 ts_tablet_manager.cc:1916] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:14:54.865025 30155 raft_consensus.cc:1275] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 19 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:14:54.877049  4628 consensus_queue.cc:1048] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:14:55.102102 29377 raft_consensus.cc:1275] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:278: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 3
W20260709 13:14:55.158851 30121 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.040s	sys 0.068s
W20260709 13:14:55.160377 30121 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.041s	sys 0.069s
W20260709 13:14:55.160849 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 552188us
W20260709 13:14:55.172567 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 69313.5us
W20260709 13:14:55.182132 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 283387us
/apache/dev/git/kudu/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20260709 13:14:55.225451 28234 tablet_server.cc:179] TabletServer@127.27.146.129:0 shutting down...
W20260709 13:14:55.430703 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 256702us
W20260709 13:14:55.445178 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 60786.9us
W20260709 13:14:55.457402 30121 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 4 similar messages]
W20260709 13:14:55.534278 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 96256.6us
W20260709 13:14:55.542877 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 108105us
W20260709 13:14:55.570724 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 119517us
W20260709 13:14:55.553725 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 89697.5us
W20260709 13:14:55.579674 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 123782us
I20260709 13:14:55.589780  4696 ts_tablet_manager.cc:1929] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 25.16
I20260709 13:14:55.596203  4696 log.cc:1199] T 66ee3283bb6d4ef28061d053b1bde164 P 183db85c071f489fbc8de63a9edd8a3a: Deleting WAL directory at /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0/minicluster-data/ts-1-root/wals/66ee3283bb6d4ef28061d053b1bde164
I20260709 13:14:55.599721  4714 consensus_queue.cc:1048] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:14:55.601044 29265 catalog_manager.cc:5028] TS 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): tablet 66ee3283bb6d4ef28061d053b1bde164 (table test-workload [id=364c32d53f7748a2857a4a9acd17c671]) successfully deleted
W20260709 13:14:55.613970 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 49603.8us
W20260709 13:14:55.633653 30121 consensus_peers.cc:597] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:55.643067 30121 consensus_peers.cc:597] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:55.655444 29421 consensus_peers.cc:597] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:55.656632 29421 consensus_peers.cc:597] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:55.657369 29421 consensus_peers.cc:597] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:55.658063 29421 consensus_peers.cc:597] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:55.658718 29421 consensus_peers.cc:597] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:55.669045 30121 consensus_peers.cc:597] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:55.672595 30121 consensus_peers.cc:597] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:55.680302 29421 consensus_peers.cc:597] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:55.684417 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 51773.3us
W20260709 13:14:55.694564 29421 consensus_peers.cc:597] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:55.695611 29421 consensus_peers.cc:597] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:55.731695 29421 consensus_peers.cc:597] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:55.742328 29421 consensus_peers.cc:597] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:55.737644 29495 consensus_peers.cc:597] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:55.743602 29495 consensus_peers.cc:597] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:55.744381 29495 consensus_peers.cc:597] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:55.747653 30121 consensus_peers.cc:597] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:55.750501 29495 consensus_peers.cc:597] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:55.752985 29495 consensus_peers.cc:597] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:55.753646 29495 consensus_peers.cc:597] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:55.764220 29495 consensus_peers.cc:597] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:55.789454 29495 consensus_peers.cc:597] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:55.790364 29495 consensus_peers.cc:597] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:55.794691 29421 consensus_peers.cc:597] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:55.803682 29495 consensus_peers.cc:597] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:55.829564 30121 consensus_peers.cc:597] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:55.836395 29495 consensus_peers.cc:597] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:55.837222 29495 consensus_peers.cc:597] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:55.910455  4663 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:55.911176  4663 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:55.913316  3683 raft_consensus.cc:493] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:55.913492  4663 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:55.913957  4710 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:55.914145  3683 raft_consensus.cc:515] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:55.914376  4663 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:55.917209 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:55.914655  4710 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:55.920718  3683 leader_election.cc:290] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:55.922580 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:55.924158 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:55.937994 29421 consensus_peers.cc:597] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:55.946658  3683 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:55.947189  3683 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:55.952354 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:55.956337 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:55.935783  4663 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:55.963243  3683 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:55.941329  4710 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:55.983146 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:55.997932 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:55.978552  4612 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:56.022850  4612 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:56.038678 30121 consensus_peers.cc:597] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:56.051872 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 97596.2us
I20260709 13:14:56.060865 29344 leader_election.cc:304] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:56.050429  4612 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:56.073447  3683 raft_consensus.cc:2749] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:14:56.077075 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:56.076327 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 108022us
I20260709 13:14:56.084566 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:56.083933 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:56.085566 29346 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:56.093031 29346 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:56.097429 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:56.098578 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:14:56.109349 29495 consensus_peers.cc:597] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:56.106071 29344 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:56.104694  4716 raft_consensus.cc:2749] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:14:56.113698  4727 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:56.123023  4727 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:56.127094  4727 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:56.098084  4606 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:56.135427  4663 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:56.105679  4710 raft_consensus.cc:2749] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:56.145653  4691 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:56.153450  4606 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:56.154294  4691 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:56.156849  4606 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:56.146096  3683 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:56.117493  4729 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:56.151806  4708 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:14:56.186427  3683 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:14:56.199074 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 54032.3us
I20260709 13:14:56.217598  3683 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:56.221560 29448 consensus_queue.cc:237] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:14:56.230861  4732 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
W20260709 13:14:56.237887 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 131897us
I20260709 13:14:56.238837 29344 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:56.246059 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:56.250510 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:56.253109 29344 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:56.269394 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:56.259649 28234 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:56.277125 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:56.197569  4729 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:56.280507 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:56.282750 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:56.283162 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:56.273710  4734 raft_consensus.cc:2749] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:14:56.307822 29421 consensus_peers.cc:597] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:56.308785 29421 consensus_peers.cc:597] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:56.295776 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 73357.9us
I20260709 13:14:56.293057 28234 tablet_replica.cc:333] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
W20260709 13:14:56.343847 29495 consensus_peers.cc:597] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:56.261408  4732 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:56.325126 28234 raft_consensus.cc:2243] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:14:56.350425 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:56.315598  4691 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:56.354192 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 44604.7us
I20260709 13:14:56.369379  4705 raft_consensus.cc:2749] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:56.407004  4708 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:56.425350  4708 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:56.431283  4729 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:56.433779  4708 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:56.417037  4705 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:56.451153  4691 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:56.452947  4691 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:56.452123  4705 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:56.453856  4732 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:56.456620 28234 raft_consensus.cc:2272] T 7c4e4c7715074c3f984153e428f3a4f1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.457829  4705 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:56.455286  4691 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:56.479540 29527 raft_consensus.cc:1275] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:14:56.450595  4710 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
W20260709 13:14:56.484624 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 61283.3us
I20260709 13:14:56.485090 29344 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:56.495666  3683 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:56.496380 29344 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:56.500430  3683 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:56.507130 28234 tablet_replica.cc:333] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:56.510398 28234 raft_consensus.cc:2243] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:14:56.506300  4710 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:56.515573  4710 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:56.559819 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:56.560173 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:56.561563 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:14:56.564769 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 56530.5us
I20260709 13:14:56.571537  4743 consensus_queue.cc:1048] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:14:56.573127 29419 consensus_peers.cc:597] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a -> Peer ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671): Couldn't send request to peer ca041dab9b2f44409ed7bf4c6cf66ab2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 84bd3c1c6a8b4dd19afbdd78dae37427. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:56.580039 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:56.583312 28234 raft_consensus.cc:2272] T 75d2e96638024243b35d8c06dcc28486 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.586228  4705 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:56.588294 29344 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:56.591128  4747 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:56.594208 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:56.586838  4705 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:56.595741 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:56.583464 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:56.596943  4705 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:56.597424  4710 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:56.597977  4710 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:56.603113  4750 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:56.603803  4750 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:56.604133 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:56.605576 29344 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:56.606052 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:56.606215  4750 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:56.606745  4750 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:56.608052 28234 tablet_replica.cc:333] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:56.609076 28234 raft_consensus.cc:2243] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.609723  4606 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:14:56.610937  4733 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:56.611215  4663 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:56.611591  4733 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:56.611876  4663 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:56.612289  4751 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:56.612962  4751 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:56.613905  4733 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:56.613937  4663 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:56.615134  4751 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:56.615288  4691 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:56.635828  4691 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:56.637993  4691 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:56.615446  4606 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:56.618187  4708 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:56.638696  4606 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:56.638803  4708 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:56.640827  4606 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:56.641134  4708 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:56.618803  4716 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:56.619107 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:56.642064  4716 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:56.644435  4716 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:56.619674  3683 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:56.645244  3683 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:56.647949 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:56.650907  3683 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:56.623600 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:56.624184  4710 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:56.607213  4750 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:56.660174  4750 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:56.625154 28234 raft_consensus.cc:2272] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:56.625562 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 46988.5us
I20260709 13:14:56.668834 28234 tablet_replica.cc:333] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:56.669971 28234 raft_consensus.cc:2243] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.670635 28234 raft_consensus.cc:2272] T 95122b0f733946aba19edf1d98467467 P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.627739 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:56.622965 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:56.630674 29344 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:56.631462 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:56.632256 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:56.648947 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:56.693771 29344 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 63185.5us
I20260709 13:14:56.694752 29344 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:56.695676  4710 raft_consensus.cc:2749] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:14:56.696393  4710 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:56.697081 29344 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:56.697909  4710 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:14:56.700560 29344 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:56.703248 29344 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:56.703357  4710 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:56.629424  4733 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:56.704536  4733 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:56.707055  4733 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:56.709972  4708 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:56.714413 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:56.714847 28234 tablet_replica.cc:333] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:56.721844  4716 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:56.722980  4716 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:56.725037  4708 raft_consensus.cc:493] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:56.739907  4708 raft_consensus.cc:515] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:56.742151  4708 leader_election.cc:290] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:56.727886  4710 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:56.742725 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:56.743054  4710 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:56.729419 29528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:56.743865 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:56.729588 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:56.731052 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:56.745702 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:56.748238 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:56.731839 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:56.757359 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:56.763113  4710 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:56.733480 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:56.737241 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:56.738756 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:56.767666  4708 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:56.768339 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:56.768354  4708 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:56.770956  4708 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:56.777215 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:56.785859 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:56.787695  4606 raft_consensus.cc:493] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:56.788240 29344 leader_election.cc:304] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:56.788371  4606 raft_consensus.cc:515] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:56.790429  4751 raft_consensus.cc:2749] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:14:56.790784  4606 leader_election.cc:290] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:56.738813 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:56.728816 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:56.732810  3683 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:14:56.796766  3683 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:56.798285 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:56.799785 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:56.800246 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:56.798826 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:56.804446  3683 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:56.806900 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:56.808988 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:56.812146  4716 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:56.813308 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:56.814381 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:56.815675 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:56.816368 28234 raft_consensus.cc:2243] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:14:56.817341 28234 raft_consensus.cc:2272] T 2bc9dbd3a80e4fc79ffab716891c275b P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.815804 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd2ad92265844ca9eb9012eb76e7789" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:56.833575 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
W20260709 13:14:56.838770 29495 consensus_peers.cc:597] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:56.840178 29495 consensus_peers.cc:597] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:56.847009  4606 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:56.847663  4606 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:56.849912  4606 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:56.850389  4606 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:56.850817  4606 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:56.851753 29344 leader_election.cc:304] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:56.854411  4733 raft_consensus.cc:2749] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:14:56.867040 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:56.872745 29346 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:56.873692  4750 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:56.874147  4606 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:56.876720 29346 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:56.878490  4606 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:56.878623 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:56.877959 28234 tablet_replica.cc:333] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:56.882045 28234 raft_consensus.cc:2243] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:14:56.878796 29346 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:56.884379 28234 raft_consensus.cc:2272] T 88a3c543fca4406fae61f154055aeb79 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.907138  4740 raft_consensus.cc:2955] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 25 LEADER]: Committing config change with OpId 25.17: config changed from index -1 to 17, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:14:56.913394 29521 raft_consensus.cc:2955] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Committing config change with OpId 25.17: config changed from index -1 to 17, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
W20260709 13:14:56.934386 29346 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 55671.1us
I20260709 13:14:56.935787 29346 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:56.939021 29346 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:56.939607  4716 raft_consensus.cc:2749] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:56.944893 28234 tablet_replica.cc:333] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:56.935446  4606 raft_consensus.cc:2749] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:56.946046 28234 raft_consensus.cc:2243] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:14:56.944156  4710 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:14:56.945385 29346 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:56.957795 29346 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:56.960690  4716 raft_consensus.cc:2749] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:56.962762  4606 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:56.962126 28234 raft_consensus.cc:2272] T b3d43afcf4e94172a4b40f6c25261ea0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.962088 29346 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:56.968719 29346 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:56.968652 29277 catalog_manager.cc:5697] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: config changed from index -1 to 17, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New cstate: current_term: 25 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:14:56.971601 28234 tablet_replica.cc:333] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:56.972800 28234 raft_consensus.cc:2243] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.973476 28234 raft_consensus.cc:2272] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.969835  4606 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:14:56.981391 28234 tablet_replica.cc:333] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:56.982611 28234 raft_consensus.cc:2243] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:14:56.982465 29346 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:56.983121  4606 raft_consensus.cc:2749] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:14:56.984212  4606 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:56.984594 29346 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:56.985839 29346 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:56.986559  4716 raft_consensus.cc:2749] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:14:56.986951 29346 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:56.987329  4716 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:14:56.988107  4716 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:14:56.997398 29346 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:56.999183  4710 raft_consensus.cc:2749] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:14:57.002110 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:57.002373 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:57.003839 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:57.007237 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:57.008387 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:57.010167  4754 ts_tablet_manager.cc:933] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2: Initiating tablet copy from peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:57.015858 28234 raft_consensus.cc:2272] T 4962756209e1496ca6cb92e47ee866b3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:57.035164 29521 consensus_queue.cc:237] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:14:57.043196 28234 tablet_replica.cc:333] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:57.043310 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:57.047015 28234 raft_consensus.cc:2243] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:57.085748 28234 raft_consensus.cc:2272] T f07124b3443042c0b07f5833ed54ce53 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:57.089757 29346 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:57.091667  3683 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:14:57.091974 29346 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:14:57.092972 29346 raft_consensus.cc:2686] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 429e58eb058349e3bf72b5a870c8f6e5: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:14:57.094446 28234 tablet_replica.cc:333] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:57.093923 29346 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:57.095445 28234 raft_consensus.cc:2243] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:57.101758 28234 raft_consensus.cc:2272] T 843654f7a60942bd9feee060ac9d2dfe P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:57.102057  4710 raft_consensus.cc:2749] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:14:57.104851 29346 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:57.106781  3683 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:14:57.107316 29346 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:57.112864 29346 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:57.114326  3683 raft_consensus.cc:2749] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:14:57.117645 29421 consensus_peers.cc:597] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:57.109903  4710 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:14:57.123541  4754 tablet_copy_client.cc:323] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Beginning tablet copy session from remote peer at address 127.27.146.130:40551
I20260709 13:14:57.131970 28234 tablet_replica.cc:333] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:57.133221 28234 raft_consensus.cc:2243] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:57.132916 29466 tablet_copy_service.cc:140] P 183db85c071f489fbc8de63a9edd8a3a: Received BeginTabletCopySession request for tablet 84bd3c1c6a8b4dd19afbdd78dae37427 from peer ca041dab9b2f44409ed7bf4c6cf66ab2 ({username='slave'} at 127.0.0.1:36436)
I20260709 13:14:57.139969 29466 tablet_copy_service.cc:161] P 183db85c071f489fbc8de63a9edd8a3a: Beginning new tablet copy session on tablet 84bd3c1c6a8b4dd19afbdd78dae37427 from peer ca041dab9b2f44409ed7bf4c6cf66ab2 at {username='slave'} at 127.0.0.1:36436: session id = ca041dab9b2f44409ed7bf4c6cf66ab2-84bd3c1c6a8b4dd19afbdd78dae37427
I20260709 13:14:57.144083 28234 raft_consensus.cc:2272] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 429e58eb058349e3bf72b5a870c8f6e5 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:57.153663 29493 consensus_peers.cc:597] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 -> Peer ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671): Couldn't send request to peer ca041dab9b2f44409ed7bf4c6cf66ab2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5d440001d38e4a58becc5e57e767a12f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:57.155222 29453 raft_consensus.cc:1275] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:14:57.157711  4707 consensus_queue.cc:1048] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:14:57.167943 29495 consensus_peers.cc:597] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:57.183940 28234 tablet_replica.cc:333] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:57.185431 28234 raft_consensus.cc:2243] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:57.186777 28234 raft_consensus.cc:2272] T 132eb7648165463b83338075a7b2e683 P 429e58eb058349e3bf72b5a870c8f6e5 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:57.187253 29466 tablet_copy_source_session.cc:215] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:57.210122 28234 tablet_replica.cc:333] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:57.213380  4754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84bd3c1c6a8b4dd19afbdd78dae37427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.236471 28234 raft_consensus.cc:2243] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:14:57.247984  4707 raft_consensus.cc:2955] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 20 LEADER]: Committing config change with OpId 20.15: config changed from index -1 to 15, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:14:57.255211 29450 raft_consensus.cc:2955] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index -1 to 15, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:14:57.298384 28234 raft_consensus.cc:2272] T f645a08329404baabcc745299ee2efd3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:57.314205 28234 tablet_replica.cc:333] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:57.317902 28234 raft_consensus.cc:2243] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:57.320214 28234 raft_consensus.cc:2272] T 954309d5d9c549439adda625fbaa6b96 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:57.322540 29449 consensus_queue.cc:237] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:14:57.328943 28234 tablet_replica.cc:333] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:57.330897 28234 raft_consensus.cc:2243] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:57.333086 28234 raft_consensus.cc:2272] T 47da517282ee462792de545e40119636 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:57.344723 29419 consensus_peers.cc:597] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a -> Peer ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671): Couldn't send request to peer ca041dab9b2f44409ed7bf4c6cf66ab2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f07124b3443042c0b07f5833ed54ce53. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:57.345007 29527 raft_consensus.cc:1275] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:14:57.346403 29421 consensus_peers.cc:597] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:57.346889  4740 consensus_queue.cc:1048] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:14:57.352852 28234 tablet_replica.cc:333] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:57.346886  4754 tablet_copy_client.cc:806] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:57.361629  4754 tablet_copy_client.cc:670] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:57.369519 28234 raft_consensus.cc:2243] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:57.373178 28234 raft_consensus.cc:2272] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 429e58eb058349e3bf72b5a870c8f6e5 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:57.373857  4754 tablet_copy_client.cc:538] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:57.383549 28234 tablet_replica.cc:333] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:57.384627 28234 raft_consensus.cc:2243] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:57.391438  4702 raft_consensus.cc:2955] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 21 LEADER]: Committing config change with OpId 21.14: config changed from index -1 to 14, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:14:57.385365 28234 raft_consensus.cc:2272] T cbdb7b3723ea4c6ea492ee857ca224d6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:57.400179 28234 tablet_replica.cc:333] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:57.416148 28234 raft_consensus.cc:2243] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:14:57.417505 28234 raft_consensus.cc:2272] T c2aced39aead4259aa7f2a9995ec3ea5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:57.418673 29278 catalog_manager.cc:5697] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: config changed from index -1 to 15, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New cstate: current_term: 20 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:57.420094 29527 raft_consensus.cc:2955] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index -1 to 14, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } } }
I20260709 13:14:57.428895 28234 tablet_replica.cc:333] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:57.432597 28234 raft_consensus.cc:2243] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:57.433368 28234 raft_consensus.cc:2272] T 7184e7b71b434f6fa4689f1d12f276f2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:57.430678  4754 tablet_bootstrap.cc:492] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap starting.
W20260709 13:14:57.447949 29327 auto_rebalancer.cc:629] Failed to schedule move for tablet 86d17089efa841fb8a1c4bfae4950ef6: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:57.451682 28234 tablet_replica.cc:333] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:57.452732 28234 raft_consensus.cc:2243] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:57.453503 28234 raft_consensus.cc:2272] T 8e9b44184de046118890bc6cd6e1dc18 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:57.469511 28234 tablet_replica.cc:333] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:57.470494 28234 raft_consensus.cc:2243] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:57.471146 28234 raft_consensus.cc:2272] T 3cece22da76441f5a3d309c5cb454c42 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:57.490168 28234 tablet_replica.cc:333] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:57.491068 28234 raft_consensus.cc:2243] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:57.491745 28234 raft_consensus.cc:2272] T 74cf9b558ac94704b5cb527efdc594ca P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:57.495148 28234 tablet_replica.cc:333] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:57.513499 28234 raft_consensus.cc:2243] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:57.501333 29277 catalog_manager.cc:5697] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: config changed from index -1 to 14, NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) added. New cstate: current_term: 21 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:57.535869 28234 raft_consensus.cc:2272] T f3ea78f0332644d3b941842ae07c5d95 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:57.558646 28234 tablet_replica.cc:333] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:57.559818 28234 raft_consensus.cc:2243] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:57.560495 28234 raft_consensus.cc:2272] T ab0baf9ea21a4fe78401601893e7ff66 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:57.580680  4766 ts_tablet_manager.cc:933] T 5d440001d38e4a58becc5e57e767a12f P ca041dab9b2f44409ed7bf4c6cf66ab2: Initiating tablet copy from peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:57.603685 28234 tablet_replica.cc:333] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:57.606021 28234 raft_consensus.cc:2243] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:57.606969 28234 raft_consensus.cc:2272] T eea24afe5d794a069e28297bbb74cf5a P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:57.635511 28234 tablet_replica.cc:333] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:57.636438 28234 raft_consensus.cc:2243] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:57.643682 28234 raft_consensus.cc:2272] T 93659d173b6a4dbe9938c612cc5f14e0 P 429e58eb058349e3bf72b5a870c8f6e5 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:57.650112 28234 tablet_replica.cc:333] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:57.651085 28234 raft_consensus.cc:2243] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 31 LEADER]: Raft consensus shutting down.
I20260709 13:14:57.656411  4766 tablet_copy_client.cc:323] T 5d440001d38e4a58becc5e57e767a12f P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Beginning tablet copy session from remote peer at address 127.27.146.131:35367
I20260709 13:14:57.658454 29540 tablet_copy_service.cc:140] P 71aa3578fd924765ab9ac0729c8d1483: Received BeginTabletCopySession request for tablet 5d440001d38e4a58becc5e57e767a12f from peer ca041dab9b2f44409ed7bf4c6cf66ab2 ({username='slave'} at 127.0.0.1:53428)
I20260709 13:14:57.659070 29540 tablet_copy_service.cc:161] P 71aa3578fd924765ab9ac0729c8d1483: Beginning new tablet copy session on tablet 5d440001d38e4a58becc5e57e767a12f from peer ca041dab9b2f44409ed7bf4c6cf66ab2 at {username='slave'} at 127.0.0.1:53428: session id = ca041dab9b2f44409ed7bf4c6cf66ab2-5d440001d38e4a58becc5e57e767a12f
I20260709 13:14:57.677039 29540 tablet_copy_source_session.cc:215] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:57.681620  4766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d440001d38e4a58becc5e57e767a12f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.694025 28234 raft_consensus.cc:2272] T dc82f5f689ca4adaa719b36a68dc3531 P 429e58eb058349e3bf72b5a870c8f6e5 [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:57.697580 28234 tablet_replica.cc:333] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:57.698580 28234 raft_consensus.cc:2243] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:57.699241 28234 raft_consensus.cc:2272] T ee77cbd588da45af9d5274a642fd28a5 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:57.703064  4766 tablet_copy_client.cc:806] T 5d440001d38e4a58becc5e57e767a12f P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:57.716827  4766 tablet_copy_client.cc:670] T 5d440001d38e4a58becc5e57e767a12f P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:57.723935 28234 tablet_replica.cc:333] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:57.724983 28234 raft_consensus.cc:2243] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:14:57.726190 28234 raft_consensus.cc:2272] T d7c3c09667374b9aa86861c27221f6d3 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:57.728591  4766 tablet_copy_client.cc:538] T 5d440001d38e4a58becc5e57e767a12f P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:57.729609 28234 tablet_replica.cc:333] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:57.730723 28234 raft_consensus.cc:2243] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:57.731439 28234 raft_consensus.cc:2272] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:57.746833 28234 tablet_replica.cc:333] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:57.747850 28234 raft_consensus.cc:2243] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:14:57.751828  4754 tablet_bootstrap.cc:492] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap replayed 1/1 log segments. Stats: ops{read=17 overwritten=0 applied=17 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:57.749087 28234 raft_consensus.cc:2272] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:57.757030  4754 tablet_bootstrap.cc:492] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap complete.
I20260709 13:14:57.758023  4754 ts_tablet_manager.cc:1403] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent bootstrapping tablet: real 0.328s	user 0.059s	sys 0.007s
I20260709 13:14:57.759626  4766 tablet_bootstrap.cc:492] T 5d440001d38e4a58becc5e57e767a12f P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap starting.
I20260709 13:14:57.765578  4702 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:57.766479  4702 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:57.775707  4702 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:57.776979 29421 leader_election.cc:336] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:57.777797  4606 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:14:57.778393  4606 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:57.782856 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:57.784639 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:57.785725 29419 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:57.788463  4702 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:14:57.791078  4606 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:57.791260 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:57.792779 29344 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:57.794036  4606 raft_consensus.cc:2749] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:14:57.794795 28234 tablet_replica.cc:333] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:57.795449  4748 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:57.796026 28234 raft_consensus.cc:2243] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:57.796808 28234 raft_consensus.cc:2272] T 26f8335857fe499492a3115b9258c1a4 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:57.796458  4748 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:57.799042  4748 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:57.800450 28234 tablet_replica.cc:333] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:57.802876 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:57.803826 29449 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 22.
I20260709 13:14:57.805150 29495 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:57.788491  4754 raft_consensus.cc:359] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 25 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:14:57.808974  4754 raft_consensus.cc:740] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 25 LEARNER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Initialized, Role: LEARNER
I20260709 13:14:57.809741  4754 consensus_queue.cc:260] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:14:57.812945  4754 ts_tablet_manager.cc:1434] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:14:57.814953 29466 tablet_copy_service.cc:342] P 183db85c071f489fbc8de63a9edd8a3a: Request end of tablet copy session ca041dab9b2f44409ed7bf4c6cf66ab2-84bd3c1c6a8b4dd19afbdd78dae37427 received from {username='slave'} at 127.0.0.1:36436
I20260709 13:14:57.815599 29466 tablet_copy_service.cc:434] P 183db85c071f489fbc8de63a9edd8a3a: ending tablet copy session ca041dab9b2f44409ed7bf4c6cf66ab2-84bd3c1c6a8b4dd19afbdd78dae37427 on tablet 84bd3c1c6a8b4dd19afbdd78dae37427 with peer ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:57.817728  4748 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:14:57.818235  4748 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:57.818578  4748 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:57.815028 28234 raft_consensus.cc:2243] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:57.827750 28234 raft_consensus.cc:2272] T bf5703156380472bb793863fd4fd7544 P 429e58eb058349e3bf72b5a870c8f6e5 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:57.839735 29495 leader_election.cc:336] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:57.851613  4707 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:57.852262  4707 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:57.857334  4707 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:57.864637  4754 ts_tablet_manager.cc:933] T f07124b3443042c0b07f5833ed54ce53 P ca041dab9b2f44409ed7bf4c6cf66ab2: Initiating tablet copy from peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:57.866245 28234 tablet_replica.cc:333] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:57.870169 28234 raft_consensus.cc:2243] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:57.870868 28234 raft_consensus.cc:2272] T 1e3b77a777d14f819c6bc72128621f93 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:57.877938 28234 tablet_replica.cc:333] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:57.878943 28234 raft_consensus.cc:2243] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:57.883908 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:57.890748 28234 raft_consensus.cc:2272] T f05e651bcfb64af6a9b5e97f9e40229f P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:57.902387  4748 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:57.917034  4754 tablet_copy_client.cc:323] T f07124b3443042c0b07f5833ed54ce53 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Beginning tablet copy session from remote peer at address 127.27.146.130:40551
I20260709 13:14:57.919539 29466 tablet_copy_service.cc:140] P 183db85c071f489fbc8de63a9edd8a3a: Received BeginTabletCopySession request for tablet f07124b3443042c0b07f5833ed54ce53 from peer ca041dab9b2f44409ed7bf4c6cf66ab2 ({username='slave'} at 127.0.0.1:36436)
I20260709 13:14:57.920205 29466 tablet_copy_service.cc:161] P 183db85c071f489fbc8de63a9edd8a3a: Beginning new tablet copy session on tablet f07124b3443042c0b07f5833ed54ce53 from peer ca041dab9b2f44409ed7bf4c6cf66ab2 at {username='slave'} at 127.0.0.1:36436: session id = ca041dab9b2f44409ed7bf4c6cf66ab2-f07124b3443042c0b07f5833ed54ce53
I20260709 13:14:57.923022 28234 tablet_replica.cc:333] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:57.924124 28234 raft_consensus.cc:2243] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Raft consensus shutting down.
W20260709 13:14:57.927441 29495 leader_election.cc:336] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:57.925148 28234 raft_consensus.cc:2272] T abd2ad92265844ca9eb9012eb76e7789 P 429e58eb058349e3bf72b5a870c8f6e5 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:57.928030 29495 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:57.932582  4707 raft_consensus.cc:2749] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:14:57.935405 29466 tablet_copy_source_session.cc:215] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:14:57.942224  4754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f07124b3443042c0b07f5833ed54ce53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.944202  4748 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:57.946916 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:57.949728 29449 raft_consensus.cc:3060] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:14:57.962770 29449 raft_consensus.cc:2468] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 23.
I20260709 13:14:57.966766 28234 tablet_replica.cc:333] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:57.980406 28234 raft_consensus.cc:2243] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:57.968708 29495 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:57.988672  4748 raft_consensus.cc:2804] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:14:57.992034  4748 raft_consensus.cc:697] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:57.994102  4748 consensus_queue.cc:237] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:57.998289 29495 leader_election.cc:336] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:57.999156 28234 raft_consensus.cc:2272] T 6b7b1911380a4f0e9a8d9584662a3dce P 429e58eb058349e3bf72b5a870c8f6e5 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.005707 28234 tablet_replica.cc:333] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:58.025528  4754 tablet_copy_client.cc:806] T f07124b3443042c0b07f5833ed54ce53 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Starting download of 0 data blocks...
I20260709 13:14:58.026383  4754 tablet_copy_client.cc:670] T f07124b3443042c0b07f5833ed54ce53 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Starting download of 1 WAL segments...
I20260709 13:14:58.032795 28234 raft_consensus.cc:2243] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:14:58.036937 28234 raft_consensus.cc:2272] T 6847a37cf6234a13a2fb53ac3cefaa64 P 429e58eb058349e3bf72b5a870c8f6e5 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.038404  4754 tablet_copy_client.cc:538] T f07124b3443042c0b07f5833ed54ce53 P ca041dab9b2f44409ed7bf4c6cf66ab2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:14:58.059664  4740 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:58.060672 28234 tablet_replica.cc:333] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:58.060335  4740 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:58.070147 29277 catalog_manager.cc:5697] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 22 to 23, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 23 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:58.071944  4740 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:58.072109 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:58.074409 28234 raft_consensus.cc:2243] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:58.075203 28234 raft_consensus.cc:2272] T f5f9acbb73364212a42eaa5004f5aba9 P 429e58eb058349e3bf72b5a870c8f6e5 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:58.077419 29421 leader_election.cc:336] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:58.078089 29421 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:58.079272  4740 raft_consensus.cc:2749] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:14:58.085036 30121 consensus_peers.cc:597] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:58.085777  4740 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:58.086494  4740 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:58.088837  4740 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:58.089674 28234 tablet_replica.cc:333] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:58.089953 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:14:58.093247 29421 leader_election.cc:336] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:58.093871 29421 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:14:58.094434 30121 consensus_peers.cc:597] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:58.095127  4740 raft_consensus.cc:2749] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:14:58.094178 28234 raft_consensus.cc:2243] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:58.096472 28234 raft_consensus.cc:2272] T f8f882eb054d4655a776901e6e22c617 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.105369 28234 tablet_replica.cc:333] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:58.107707 28234 raft_consensus.cc:2243] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:14:58.106781  4766 tablet_bootstrap.cc:492] T 5d440001d38e4a58becc5e57e767a12f P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=0 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:58.114087  4766 tablet_bootstrap.cc:492] T 5d440001d38e4a58becc5e57e767a12f P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap complete.
I20260709 13:14:58.114985  4766 ts_tablet_manager.cc:1403] T 5d440001d38e4a58becc5e57e767a12f P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent bootstrapping tablet: real 0.356s	user 0.046s	sys 0.013s
I20260709 13:14:58.127451  4766 raft_consensus.cc:359] T 5d440001d38e4a58becc5e57e767a12f P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 20 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:14:58.128953 28234 raft_consensus.cc:2272] T 86d17089efa841fb8a1c4bfae4950ef6 P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.102481  4748 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:58.141062  4748 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:58.142992 28234 tablet_replica.cc:333] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:58.144042 28234 raft_consensus.cc:2243] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:58.153242 28234 raft_consensus.cc:2272] T f06f688759cd438a95541a7639513cec P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.145160  4748 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:58.147840 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:58.165052 29449 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 24.
W20260709 13:14:58.166797 29495 leader_election.cc:336] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:58.144440  4766 raft_consensus.cc:740] T 5d440001d38e4a58becc5e57e767a12f P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 20 LEARNER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Initialized, Role: LEARNER
I20260709 13:14:58.132869  4754 tablet_bootstrap.cc:492] T f07124b3443042c0b07f5833ed54ce53 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap starting.
I20260709 13:14:58.168236 29495 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:58.168673 28234 tablet_replica.cc:333] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:58.170181  4748 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:14:58.170661  4748 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:58.171077  4748 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:14:58.178227 28234 raft_consensus.cc:2243] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:14:58.179744 28234 raft_consensus.cc:2272] T 66ee3283bb6d4ef28061d053b1bde164 P 429e58eb058349e3bf72b5a870c8f6e5 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:58.183111 29421 consensus_peers.cc:597] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:58.183341  4606 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:14:58.184047  4606 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:58.187539 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:58.189343  4606 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:58.196199  4766 consensus_queue.cc:260] T 5d440001d38e4a58becc5e57e767a12f P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:14:58.206001  4766 ts_tablet_manager.cc:1434] T 5d440001d38e4a58becc5e57e767a12f P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent starting tablet: real 0.091s	user 0.000s	sys 0.010s
I20260709 13:14:58.208479 29540 tablet_copy_service.cc:342] P 71aa3578fd924765ab9ac0729c8d1483: Request end of tablet copy session ca041dab9b2f44409ed7bf4c6cf66ab2-5d440001d38e4a58becc5e57e767a12f received from {username='slave'} at 127.0.0.1:53428
I20260709 13:14:58.208995 29540 tablet_copy_service.cc:434] P 71aa3578fd924765ab9ac0729c8d1483: ending tablet copy session ca041dab9b2f44409ed7bf4c6cf66ab2-5d440001d38e4a58becc5e57e767a12f on tablet 5d440001d38e4a58becc5e57e767a12f with peer ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:58.182780 28234 tablet_replica.cc:333] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:58.211890 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "429e58eb058349e3bf72b5a870c8f6e5" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:58.211292 28234 raft_consensus.cc:2243] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:58.214090 28234 raft_consensus.cc:2272] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.217430 28234 tablet_replica.cc:333] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:58.209466  4748 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:58.217522 29346 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 429e58eb058349e3bf72b5a870c8f6e5; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:14:58.223799 28234 raft_consensus.cc:2243] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:58.229952  4606 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:14:58.240577 30121 consensus_peers.cc:597] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:58.252128  4748 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:14:58.256467 30121 consensus_peers.cc:597] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:58.261152 28234 raft_consensus.cc:2272] T f343c91124ea4cd5b19e26f3530e1247 P 429e58eb058349e3bf72b5a870c8f6e5 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.275202 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:58.276307 29449 raft_consensus.cc:3060] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:14:58.278120 28234 tablet_replica.cc:333] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:58.278780 28234 raft_consensus.cc:2243] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:14:58.285605 28234 raft_consensus.cc:2272] T b3604a2976f84b96882e8983ba5b3fd7 P 429e58eb058349e3bf72b5a870c8f6e5 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.303795  4677 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:58.304678  4677 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:58.307258  4677 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:14:58.314697 30121 consensus_peers.cc:597] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:58.316195 30121 consensus_peers.cc:597] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:58.326797 28234 tablet_replica.cc:333] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:58.333395  4742 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:58.334174  4742 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:58.337292 28234 raft_consensus.cc:2243] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:58.341907 30151 raft_consensus.cc:1217] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 25 LEARNER]: Deduplicated request from leader. Original: 25.16->[25.17-25.17]   Dedup: 25.17->[]
W20260709 13:14:58.342177 29421 leader_election.cc:336] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:58.346342  4742 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:58.338189 28234 raft_consensus.cc:2272] T e66f47d21a0c4572ac5357c6cf623284 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.370832 29449 raft_consensus.cc:2468] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 25.
I20260709 13:14:58.377466 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:58.378960 28234 tablet_replica.cc:333] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:58.391672 28234 raft_consensus.cc:2243] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:14:58.393091 28234 raft_consensus.cc:2272] T 3eb760d2a128422684c16e20d11a9e82 P 429e58eb058349e3bf72b5a870c8f6e5 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:58.395331 29421 consensus_peers.cc:597] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:58.396559 28234 tablet_replica.cc:333] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:58.401033  4677 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:58.401077 28234 raft_consensus.cc:2243] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:58.403805 28234 raft_consensus.cc:2272] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 429e58eb058349e3bf72b5a870c8f6e5 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.401685  4677 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:58.408571 29495 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:58.419441 28234 tablet_replica.cc:333] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
W20260709 13:14:58.419821 29421 consensus_peers.cc:597] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:58.416966  4707 raft_consensus.cc:2804] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:14:58.420490 28234 raft_consensus.cc:2243] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:58.420849  4707 raft_consensus.cc:697] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:58.421407 28234 raft_consensus.cc:2272] T 5d440001d38e4a58becc5e57e767a12f P 429e58eb058349e3bf72b5a870c8f6e5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.422302  4707 consensus_queue.cc:237] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:58.431210  4677 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:58.442934 28234 tablet_replica.cc:333] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:58.444149  4754 tablet_bootstrap.cc:492] T f07124b3443042c0b07f5833ed54ce53 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=1 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:14:58.451419  4677 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:58.452450  4677 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:58.463876 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 49288.9us
W20260709 13:14:58.465788 30121 consensus_peers.cc:597] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:58.467913 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:58.468624 29524 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 23.
W20260709 13:14:58.471124 29495 consensus_peers.cc:597] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:58.472069 29495 leader_election.cc:336] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:58.473517 29495 consensus_peers.cc:597] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:58.481190  4677 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:58.484400 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:58.485358 29454 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 23.
I20260709 13:14:58.487452 29419 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:58.488392  4742 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:14:58.488842  4742 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:58.489228  4742 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:14:58.489501 29277 catalog_manager.cc:5697] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 24 to 25, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 25 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:58.500356 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:58.501204 29454 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 23.
I20260709 13:14:58.506163  4702 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:58.506925  4702 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:14:58.512872 29421 leader_election.cc:336] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:58.514621  4702 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:58.515519  4754 tablet_bootstrap.cc:492] T f07124b3443042c0b07f5833ed54ce53 P ca041dab9b2f44409ed7bf4c6cf66ab2: Bootstrap complete.
I20260709 13:14:58.520681  4754 ts_tablet_manager.cc:1403] T f07124b3443042c0b07f5833ed54ce53 P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent bootstrapping tablet: real 0.388s	user 0.047s	sys 0.007s
I20260709 13:14:58.444243 28234 raft_consensus.cc:2243] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:58.520860  4702 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:58.537086  4702 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:58.539841  4702 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:58.506099 29495 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:58.529986  4677 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:58.541154  4677 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:58.541496 29495 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:14:58.542284 28234 raft_consensus.cc:2272] T ae9322ad5c2448f5bbe70c893b323d98 P 429e58eb058349e3bf72b5a870c8f6e5 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.543707  4677 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:14:58.543913  4707 raft_consensus.cc:2804] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:14:58.548101  4707 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:58.548631  4707 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:14:58.549909 29495 leader_election.cc:336] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:58.550451 29495 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:58.543727  4748 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:14:58.551337  4677 raft_consensus.cc:2749] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:14:58.551790  4748 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:58.545310 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:14:58.552241  4748 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:14:58.557602 29421 leader_election.cc:336] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:14:58.565394 29454 raft_consensus.cc:1275] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:14:58.567726  4754 raft_consensus.cc:359] T f07124b3443042c0b07f5833ed54ce53 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 21 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:14:58.574023  4754 raft_consensus.cc:740] T f07124b3443042c0b07f5833ed54ce53 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 21 LEARNER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Initialized, Role: LEARNER
I20260709 13:14:58.578840  4707 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:58.573534 28234 tablet_replica.cc:333] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5: stopping tablet replica
I20260709 13:14:58.580444 28234 raft_consensus.cc:2243] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:58.581338 28234 raft_consensus.cc:2272] T f0059c790a85426c96a8b0fe40c16532 P 429e58eb058349e3bf72b5a870c8f6e5 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:58.595968 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:58.596777 29521 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 20.
I20260709 13:14:58.597626 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:58.598240 29454 raft_consensus.cc:3060] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:14:58.535053  4742 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:58.581404  4707 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:58.563176  4748 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:58.601699  4742 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:58.601785  4748 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:14:58.582041  4754 consensus_queue.cc:260] T f07124b3443042c0b07f5833ed54ce53 P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
W20260709 13:14:58.585937 29421 consensus_peers.cc:597] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:58.593453 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:58.602820 29529 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 21.
I20260709 13:14:58.604148  4754 ts_tablet_manager.cc:1434] T f07124b3443042c0b07f5833ed54ce53 P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.000s
I20260709 13:14:58.608167  4702 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:58.608884  4702 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:58.612112  4702 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:58.612274 29466 tablet_copy_service.cc:342] P 183db85c071f489fbc8de63a9edd8a3a: Request end of tablet copy session ca041dab9b2f44409ed7bf4c6cf66ab2-f07124b3443042c0b07f5833ed54ce53 received from {username='slave'} at 127.0.0.1:36436
I20260709 13:14:58.612744 29466 tablet_copy_service.cc:434] P 183db85c071f489fbc8de63a9edd8a3a: ending tablet copy session ca041dab9b2f44409ed7bf4c6cf66ab2-f07124b3443042c0b07f5833ed54ce53 on tablet f07124b3443042c0b07f5833ed54ce53 with peer ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:14:58.620919 30151 raft_consensus.cc:1217] T 5d440001d38e4a58becc5e57e767a12f P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 20 LEARNER]: Deduplicated request from leader. Original: 20.14->[20.15-20.15]   Dedup: 20.15->[]
W20260709 13:14:58.631561 29495 consensus_peers.cc:597] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:58.632274 29495 leader_election.cc:336] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:58.633277 29495 leader_election.cc:336] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:58.637977 29421 leader_election.cc:336] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:58.641427 29421 consensus_peers.cc:597] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:14:58.646878 29421 leader_election.cc:336] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:58.656531 29421 consensus_peers.cc:597] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:58.659017  4677 consensus_queue.cc:1048] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:14:58.660547 29454 raft_consensus.cc:2468] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 24.
I20260709 13:14:58.673580 29495 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:14:58.676259 29421 consensus_peers.cc:597] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:58.677965  4677 raft_consensus.cc:2804] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:14:58.679294  4677 raft_consensus.cc:697] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:14:58.680606  4677 consensus_queue.cc:237] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:58.687913 29419 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:58.689352  4702 raft_consensus.cc:2804] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:14:58.689839  4702 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:58.690279  4702 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:14:58.703824  4707 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:58.704700  4707 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:58.709060  4707 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:14:58.709913 29421 consensus_peers.cc:597] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:14:58.718564 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:14:58.722915 29454 raft_consensus.cc:2393] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 24: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:14:58.729127  4740 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:58.729938  4740 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:58.732956  4740 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:58.741298 29419 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:14:58.742488  4740 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:14:58.743011  4740 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:58.743515  4740 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:14:58.752135  4723 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:58.752867  4723 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:58.756072  4723 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:58.757820 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:58.758725 29529 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 19.
I20260709 13:14:58.760238 30119 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:14:58.761229  4781 raft_consensus.cc:2804] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:14:58.761650  4781 raft_consensus.cc:493] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:14:58.762238  4781 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:14:58.782078 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:14:58.783116 29529 raft_consensus.cc:2393] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 24: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:14:58.784507 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:58.785116 29529 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 18.
I20260709 13:14:58.738973  4702 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:58.796610  4776 raft_consensus.cc:1064] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a: attempting to promote NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 to VOTER
I20260709 13:14:58.800237  4776 consensus_queue.cc:237] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 15, Current term: 25, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:14:58.804826 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:14:58.805943 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:14:58.806674 29453 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 18.
I20260709 13:14:58.832798  4740 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:14:58.836910  4740 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:14:59.567114  4781 consensus_meta.cc:287] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2: Time spent flushing consensus metadata: real 0.804s	user 0.007s	sys 0.004s
I20260709 13:14:59.599081  4781 raft_consensus.cc:515] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:14:59.978917 29494 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.005s	sys 0.008s
W20260709 13:14:59.979462 29494 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.006s	sys 0.008s
W20260709 13:14:59.991252  4776 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.083s	user 0.015s	sys 0.006s
W20260709 13:14:59.992069  4776 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.161s	user 0.022s	sys 0.006s
I20260709 13:15:00.002430 29529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37958 (request call id 3187) took 1207 ms. Trace:
I20260709 13:15:00.003130 29529 rpcz_store.cc:276] 0709 13:14:58.795374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:58.795588 (+   214us) service_pool.cc:224] Handling call
0709 13:14:58.803164 (+  7576us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:14:58.803476 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:58.803526 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:14:58.803569 (+    43us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:15:00.001843 (+1198274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:00.002040 (+   197us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:00.002272 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:00.012904  4781 leader_election.cc:290] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 20 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:14:59.987017  4677 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:15:00.035844  4786 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:15:00.043051  4786 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:00.049978  4677 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:00.053282  4748 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:00.056053  4748 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:00.058488  4748 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:00.064106  4677 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:00.066507  4789 raft_consensus.cc:493] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:15:00.067974  4760 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:00.067324  4789 raft_consensus.cc:515] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:00.068615  4760 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:00.071223  4786 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:15:00.072947  4760 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:00.076820  4789 leader_election.cc:290] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:15:00.139923  4702 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:00.152904  4677 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:15:00.155802  4778 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:00.157384  4778 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:00.160837  4707 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:15:00.160733  4792 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:00.163079  4792 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:00.162958  4707 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:00.167447  4707 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:00.168404  4707 raft_consensus.cc:493] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:15:00.169577  4707 raft_consensus.cc:515] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:00.167547  4792 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:00.177206  4677 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:00.188288  4677 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:00.185359  4778 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:00.194989 29402 debug-util.cc:398] Leaking SignalData structure 0x7b0800238f20 after lost signal to thread 28237
W20260709 13:15:00.198495 29402 debug-util.cc:398] Leaking SignalData structure 0x7b08001bf900 after lost signal to thread 29313
I20260709 13:15:00.173538  4707 leader_election.cc:290] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:15:00.215721  4723 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:15:00.217935  4723 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:00.222738  4723 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:15:00.234679  4785 log.cc:927] Time spent T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.194s	user 0.002s	sys 0.000s
W20260709 13:15:00.246421 29419 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.438s	user 0.062s	sys 0.071s
W20260709 13:15:00.253319 29419 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.445s	user 0.063s	sys 0.072s
I20260709 13:15:00.255748 29454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45796 (request call id 3230) took 1514 ms. Trace:
I20260709 13:15:00.249002  4702 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:15:00.249468  4742 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:15:00.250838  4748 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:15:00.256031  4784 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:15:00.267298  4742 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:00.267966  4748 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:00.271680  4742 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:00.248157  4793 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:00.267954  4784 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:00.276566  4793 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:00.278898  4784 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:00.271807  4748 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:15:00.279794  4793 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:00.261041  4723 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:15:00.281303  4723 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:00.284112  4723 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:00.267284  4702 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:00.259756 30151 raft_consensus.cc:1217] T f07124b3443042c0b07f5833ed54ce53 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 21 LEARNER]: Deduplicated request from leader. Original: 21.13->[21.14-21.14]   Dedup: 21.14->[]
I20260709 13:15:00.297148  4776 raft_consensus.cc:493] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:15:00.298406  4776 raft_consensus.cc:515] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:15:00.299530 29402 debug-util.cc:398] Leaking SignalData structure 0x7b0800239000 after lost signal to thread 29405
I20260709 13:15:00.299639  4784 raft_consensus.cc:493] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:15:00.300565  4784 raft_consensus.cc:515] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:00.301894 30155 raft_consensus.cc:1275] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 25 LEARNER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:15:00.262295 29454 rpcz_store.cc:276] 0709 13:14:58.741414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:58.741613 (+   199us) service_pool.cc:224] Handling call
0709 13:14:58.742131 (+   518us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:14:58.773568 (+ 31437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:14:58.773607 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:14:58.774159 (+   552us) log.cc:844] Serialized 26 byte log entry
0709 13:14:58.802817 (+ 28658us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:14:58.802859 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:14:58.802966 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:00.057465 (+1254499us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b4400022b4c. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78bbfc85 00007f6a78bc06a2 00007f6a7b9321db 00007f6a7b92daaf 00007f6a7b92186e 00007f6a7b920bb6 00007f6a7b9207d8 00007f6a7b92a221 00007f6a7b92a1d9 00007f6a7b92a169
0709 13:15:00.254621 (+197156us) raft_consensus.cc:1685] finished
0709 13:15:00.254698 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:00.255385 (+   687us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":99,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":773,"spinlock_wait_cycles":27287936,"thread_start_us":28185,"threads_started":1,"wal-append.queue_time_us":1262016}
I20260709 13:15:00.312523  4784 leader_election.cc:290] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:00.313532  4776 leader_election.cc:290] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:15:00.314123 29402 debug-util.cc:398] Leaking SignalData structure 0x7b08002ba140 after lost signal to thread 29480
I20260709 13:15:00.314971  4702 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:15:00.315945 29402 debug-util.cc:398] Leaking SignalData structure 0x7b08000c3fc0 after lost signal to thread 29554
W20260709 13:15:00.316311 29402 debug-util.cc:398] Leaking SignalData structure 0x7b08000c3fe0 after lost signal to thread 29555
I20260709 13:15:00.315224 29278 catalog_manager.cc:5697] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 23 to 24, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 24 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
W20260709 13:15:00.318286 29402 debug-util.cc:398] Leaking SignalData structure 0x7b08000aa880 after lost signal to thread 30182
W20260709 13:15:00.319258 29402 debug-util.cc:398] Leaking SignalData structure 0x7b08003c7a20 after lost signal to thread 4772
I20260709 13:15:00.330472  4748 raft_consensus.cc:493] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:15:00.331658  4748 raft_consensus.cc:515] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:00.332476  4793 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:00.333379  4793 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:00.335917  4677 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:15:00.336905  4677 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:00.341085  4776 raft_consensus.cc:493] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:15:00.342069  4776 raft_consensus.cc:515] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:00.344847  4748 leader_election.cc:290] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:15:00.349941  4748 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:15:00.350782  4748 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:00.351199  4677 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:15:00.353829  4748 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:00.355813 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.364653  4793 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:15:00.366403  4776 leader_election.cc:290] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:00.367187  4677 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:00.368103  4677 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:00.369093 29495 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:15:00.370802  4677 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:00.374689  4748 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:00.375373  4748 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:15:00.375994  4748 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:15:00.387694  4784 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:15:00.388062  4740 raft_consensus.cc:493] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:15:00.388782  4740 raft_consensus.cc:515] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:00.388769  4784 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:00.387724  4702 raft_consensus.cc:493] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.394559  4702 raft_consensus.cc:515] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:00.397446  4784 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:15:00.398253  4702 leader_election.cc:290] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:00.399114  4740 leader_election.cc:290] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:00.411360  4793 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:00.433925  4795 raft_consensus.cc:493] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:15:00.434449  4793 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:00.434844  4795 raft_consensus.cc:515] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:00.437250  4793 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:00.438169  4795 leader_election.cc:290] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:00.420007  4707 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:00.441093  4707 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:15:00.445075  4781 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:00.445904  4798 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
W20260709 13:15:00.446333 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 88524.6us
I20260709 13:15:00.446048  4781 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:00.446851  4798 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:00.449429  4781 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:00.449596  4798 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:00.450227  4798 raft_consensus.cc:493] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:15:00.450110  4677 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:00.431463  4702 raft_consensus.cc:493] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:15:00.460745  4702 raft_consensus.cc:515] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:00.456586  4740 raft_consensus.cc:493] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:15:00.457144  4800 raft_consensus.cc:493] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:15:00.462278  4740 raft_consensus.cc:515] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:00.462430  4800 raft_consensus.cc:515] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:00.451097  4798 raft_consensus.cc:515] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:00.465148  4740 leader_election.cc:290] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:00.465267  4800 leader_election.cc:290] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:15:00.465370  4742 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:15:00.451355  4677 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:00.466101  4798 leader_election.cc:290] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:00.455391  4776 raft_consensus.cc:493] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:15:00.468667  4677 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:15:00.468750  4702 leader_election.cc:290] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:15:00.469694  4776 raft_consensus.cc:515] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:00.471594  4793 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:00.472355  4793 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:00.466264  4742 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:00.472874  4707 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:00.484404  4707 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:15:00.485476  4793 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:00.496443 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2aced39aead4259aa7f2a9995ec3ea5" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:15:00.497929 29529 raft_consensus.cc:3060] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:00.498291  4742 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:00.499748  4793 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:00.500624  4793 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:00.485376  4707 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:00.487692  4796 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:00.504518 30155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:15:00.504266  4796 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:00.505306 30155 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 25.
I20260709 13:15:00.507113  4797 raft_consensus.cc:493] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:15:00.507910  4797 raft_consensus.cc:515] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:00.508368  4793 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:00.514067  4677 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:15:00.514335  4797 leader_election.cc:290] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:00.510851 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:00.514801  4677 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:00.515892 29530 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 23.
I20260709 13:15:00.517400 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:00.517652  4776 leader_election.cc:290] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:00.518270 29526 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 25.
I20260709 13:15:00.521454  4803 raft_consensus.cc:493] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:15:00.522845 30153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95122b0f733946aba19edf1d98467467" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:15:00.525962  4677 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:00.523869 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:15:00.524075 30154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "132eb7648165463b83338075a7b2e683" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:15:00.524885 30152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:15:00.527791  4803 raft_consensus.cc:515] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:00.530237  4748 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:15:00.525255 30121 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 235 similar messages]
I20260709 13:15:00.525341 29529 raft_consensus.cc:2468] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 20.
I20260709 13:15:00.525128 30156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b7b1911380a4f0e9a8d9584662a3dce" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:15:00.535135  4677 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:15:00.535605  4793 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:00.536473  4793 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:15:00.530339  4803 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:15:00.541998  4793 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:00.534646 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 120415us
I20260709 13:15:00.544916  4677 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:00.548651  4677 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:00.553570 30150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:15:00.571971 30158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:15:00.572939 30158 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
W20260709 13:15:00.577328 29421 consensus_peers.cc:597] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:00.578899  4707 leader_election.cc:290] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:15:00.579736  4793 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:15:00.580534  4793 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:00.581192  4778 raft_consensus.cc:1064] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483: attempting to promote NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 to VOTER
I20260709 13:15:00.557400 30150 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 23.
I20260709 13:15:00.585803  4778 consensus_queue.cc:237] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 13, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:00.579319 29493 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:15:00.588798  4786 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:15:00.589385  4786 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:15:00.589926  4786 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:15:00.591384  4796 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:00.596760 30119 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:15:00.598327 30119 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:15:00.599665  4723 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:15:00.600128  4723 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:15:00.600605  4723 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:15:00.603791  4781 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:15:00.604422  4748 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:00.604456  4781 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:00.605156  4748 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:00.605257  4781 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:15:00.605823  4748 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:00.607385  4803 raft_consensus.cc:493] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:15:00.607753  4804 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:15:00.608335  4803 raft_consensus.cc:515] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:00.608572  4804 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:00.611912  4803 leader_election.cc:290] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:00.612327  4804 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:15:00.613481 30119 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:15:00.613703  4804 raft_consensus.cc:493] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:15:00.583364  4793 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:00.614301  4804 raft_consensus.cc:515] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:00.616931  4804 leader_election.cc:290] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:15:00.618564  4776 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:15:00.619274  4776 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:00.620865  4803 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:15:00.621616  4803 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:00.622097  4776 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:00.622783  4776 raft_consensus.cc:493] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:15:00.623373  4776 raft_consensus.cc:515] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:00.625692  4776 leader_election.cc:290] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:15:00.625855 29496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.626742 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:00.627550 29526 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 19.
I20260709 13:15:00.629426 29493 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:15:00.632107 29493 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:15:00.630307  4707 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:00.634372  4792 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:15:00.634431  4789 raft_consensus.cc:2804] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:00.635218  4789 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:00.635035  4707 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:00.635730  4789 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:00.635140  4792 raft_consensus.cc:493] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:00.636790  4792 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:15:00.647176  4803 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:15:00.631119  4677 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:00.648262  4677 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:00.650599  4677 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:00.656543  4707 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:00.651886 30121 leader_election.cc:336] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:15:00.652098 30150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:15:00.663787  4796 raft_consensus.cc:2804] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:15:00.656898  4786 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:00.664443  4796 raft_consensus.cc:697] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 20 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
W20260709 13:15:00.661244 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 47962.6us
I20260709 13:15:00.665694  4796 consensus_queue.cc:237] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:15:00.670496 30121 leader_election.cc:336] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:15:00.673120 30121 leader_election.cc:336] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:15:00.673697  4804 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
W20260709 13:15:00.674381 30121 leader_election.cc:336] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:15:00.674616  4804 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: NON_VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: true } }
I20260709 13:15:00.674669  4786 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 26 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:15:00.678081  4804 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:00.679191  4803 raft_consensus.cc:493] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:00.679996  4803 raft_consensus.cc:515] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:00.682736  4803 leader_election.cc:290] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:00.683425  4803 raft_consensus.cc:493] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:15:00.684089  4803 raft_consensus.cc:515] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:00.688863  4803 leader_election.cc:290] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:00.690838  4797 raft_consensus.cc:493] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:15:00.689957  4807 raft_consensus.cc:493] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:15:00.698115  4797 raft_consensus.cc:515] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:00.698740  4807 raft_consensus.cc:515] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:00.699569 30119 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:15:00.690400  4776 raft_consensus.cc:493] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:15:00.700778  4794 raft_consensus.cc:2804] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:00.701363  4794 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:00.700872  4776 raft_consensus.cc:515] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:00.701831  4794 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:00.700834  4803 raft_consensus.cc:493] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:15:00.702646  4803 raft_consensus.cc:515] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:00.701934  4781 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:00.709762 30157 raft_consensus.cc:1240] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 24 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 23. Current term is 24. Ops: []
I20260709 13:15:00.713567  4781 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 24 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:00.665683  4789 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:00.719015  4789 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:15:00.719743 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 44228.4us
I20260709 13:15:00.692817  4723 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:00.734871 29454 raft_consensus.cc:1275] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:15:00.689180  4748 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:00.768493 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
W20260709 13:15:00.743868 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 116678us
I20260709 13:15:00.775671 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:15:00.779395 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:15:00.780402 29530 raft_consensus.cc:2393] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in current term 26: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:15:00.780699  4792 raft_consensus.cc:515] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:00.781903 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06f688759cd438a95541a7639513cec" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:15:00.782790  4723 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 26 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:00.783558  4792 leader_election.cc:290] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:15:00.783718 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:15:00.784524 29450 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 20.
I20260709 13:15:00.789518 29526 raft_consensus.cc:2393] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in current term 24: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:15:00.795660 30121 leader_election.cc:336] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:15:00.790664 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "829dc08ee0ca4212a3b2c870b0ea1b35" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:15:00.794725  4807 leader_election.cc:290] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:00.794199  4803 leader_election.cc:290] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:15:00.805337 29495 leader_election.cc:336] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:15:00.806813 29495 leader_election.cc:304] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:15:00.808034  4789 raft_consensus.cc:2749] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:15:00.814745 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e9b44184de046118890bc6cd6e1dc18" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:15:00.820744 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:15:00.821231 30150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
W20260709 13:15:00.821702 29422 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:00.822590 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:15:00.819722  4794 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:00.823908 30151 raft_consensus.cc:2393] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 24: Already voted for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in this term.
I20260709 13:15:00.825155 30150 raft_consensus.cc:2393] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 20: Already voted for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in this term.
I20260709 13:15:00.821719 30157 raft_consensus.cc:2393] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 26: Already voted for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in this term.
W20260709 13:15:00.826924 29495 consensus_peers.cc:597] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:00.828527 29495 leader_election.cc:336] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:15:00.829754  4776 leader_election.cc:290] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:00.833124  4797 leader_election.cc:290] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:00.833899 29277 catalog_manager.cc:5697] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 19 to 20, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132). New cstate: current_term: 20 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:00.835199  4794 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 20 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:00.843079 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:15:00.858290 30150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:15:00.860422 29530 raft_consensus.cc:2393] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in current term 20: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:15:00.849526 30121 leader_election.cc:336] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:15:00.861720 30121 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:15:00.866554 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:15:00.867405 30151 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 23.
I20260709 13:15:00.869990 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:15:00.872150  4794 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:15:00.881153 30157 raft_consensus.cc:1275] T 5d440001d38e4a58becc5e57e767a12f P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 20 LEARNER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:15:00.882195 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:15:00.882581  4797 consensus_queue.cc:1059] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:15:00.883086 29449 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 19.
I20260709 13:15:00.883366  4789 consensus_queue.cc:1048] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:15:00.883862  4797 raft_consensus.cc:3055] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:15:00.884322  4797 raft_consensus.cc:740] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:15:00.864356  4776 consensus_queue.cc:1048] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.021s
I20260709 13:15:00.885962 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e9dda7e26f4762beef2df7e4b8b8b2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:15:00.885813 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7184e7b71b434f6fa4689f1d12f276f2" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:15:00.885737  4797 consensus_queue.cc:260] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:00.889173 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:15:00.890164 29453 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 21.
I20260709 13:15:00.896191 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:15:00.897033 29453 raft_consensus.cc:2468] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 11.
I20260709 13:15:00.897800 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdb7b3723ea4c6ea492ee857ca224d6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:15:00.898116 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:15:00.898782 29454 raft_consensus.cc:2468] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 9.
I20260709 13:15:00.911828 29419 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:15:00.922094  4776 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:15:00.922634  4776 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:15:00.927603  4776 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:15:00.928401 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:15:00.929314 29448 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 21.
W20260709 13:15:00.932953 29421 leader_election.cc:336] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:15:00.934317 29421 consensus_peers.cc:597] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:00.936067 29419 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:00.938450 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:15:00.938810  4804 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:15:00.939240  4804 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:15:00.939637  4804 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:15:00.941385 29421 leader_election.cc:336] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:15:00.944844 29421 leader_election.cc:336] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:15:00.947911 29421 consensus_peers.cc:597] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:00.953459 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:15:00.956174 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:15:00.959072  4797 raft_consensus.cc:3060] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:15:00.957458 29421 consensus_peers.cc:597] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:00.973750 29421 leader_election.cc:336] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:15:00.977489 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5703156380472bb793863fd4fd7544" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:15:00.977766 29278 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37608 (request call id 192) took 2200 ms. Trace:
W20260709 13:15:00.976364 29421 leader_election.cc:336] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:15:00.981755 29421 leader_election.cc:336] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:15:00.979256  4804 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:00.992591  4804 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:00.978376 29278 rpcz_store.cc:276] 0709 13:14:58.775599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:14:58.780958 (+  5359us) service_pool.cc:224] Handling call
0709 13:15:00.239191 (+1458233us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b5400002490. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61b71 00007f6a78c620b2 00007f6a81bdba89 00007f6a81b73da6 00007f6a81b45088 00007f6a81c4337e 00007f6a801042a4 00007f6a80104232 00007f6a80104161 00007f6a801040dc
0709 13:15:00.975775 (+736584us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:00.412786 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:00.413601 (+   815us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:00.413663 (+    62us) write_op.cc:435] Acquired schema lock
0709 13:15:00.413698 (+    35us) tablet.cc:662] Decoding operations
0709 13:15:00.414258 (+   560us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:00.414377 (+   119us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:00.414424 (+    47us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:15:00.414845 (+   421us) tablet.cc:701] Row locks acquired
0709 13:15:00.414896 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:15:00.415112 (+   216us) write_op.cc:270] Start()
0709 13:15:00.415295 (+   183us) write_op.cc:276] Timestamp: P: 1783602900415016 usec, L: 0
0709 13:15:00.415347 (+    52us) op_driver.cc:348] REPLICATION: starting
0709 13:15:00.429580 (+ 14233us) log.cc:844] Serialized 544 byte log entry
0709 13:15:00.874059 (+444479us) op_driver.cc:464] REPLICATION: finished
0709 13:15:00.960677 (+ 86618us) spinlock_profiling.cc:243] Waited 30.1 ms on lock 0x7b1800406780. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a81b61de1 00007f6a81b6e5b1 00007f6a78c993f3 00007f6a78c9b7c1 00007f6a78c9b779 00007f6a78c9b709 00007f6a78c9b6d1 00007f6a78c9a9cd 000000000038f354 000000000038f199 00007f6a78c7c83a
0709 13:15:00.960860 (+   183us) write_op.cc:301] APPLY: starting
0709 13:15:00.960982 (+   122us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:00.962831 (+  1849us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:00.962875 (+    44us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:00.963710 (+   835us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:00.964045 (+   335us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:15:00.964131 (+    86us) write_op.cc:312] APPLY: finished
0709 13:15:00.964488 (+   357us) log.cc:844] Serialized 25 byte log entry
0709 13:15:00.964723 (+   235us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:00.966564 (+  1841us) write_op.cc:454] Released schema lock
0709 13:15:00.968225 (+  1661us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:00.968741 (+   516us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:00.968770 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":59710336,"child_traces":[["op",{"apply.queue_time_us":53468,"apply.run_cpu_time_us":4546,"apply.run_wall_time_us":7850,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8299,"num_ops":1,"prepare.queue_time_us":90818,"prepare.run_cpu_time_us":16084,"prepare.run_wall_time_us":159230,"raft.queue_time_us":354666,"raft.run_cpu_time_us":26836,"raft.run_wall_time_us":65166,"replication_time_us":458474,"spinlock_wait_cycles":69127424,"thread_start_us":600691,"threads_started":4,"wal-append.queue_time_us":128277}]]}
I20260709 13:15:01.002431 29449 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 24.
I20260709 13:15:01.005206 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:15:01.005510 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:15:01.008335 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:15:01.012347 30151 raft_consensus.cc:1240] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 20 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 19. Current term is 20. Ops: []
I20260709 13:15:01.015844 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:15:01.021986 29421 leader_election.cc:336] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:15:01.010666  4776 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:15:01.024029 29421 leader_election.cc:336] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:15:01.023015 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4195dd8da2fa4e9a9a0f134c2d81f95a" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:15:01.028331 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc9dbd3a80e4fc79ffab716891c275b" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:15:01.032639 29453 raft_consensus.cc:2393] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in current term 24: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
W20260709 13:15:01.031962 29421 leader_election.cc:336] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:15:01.038982 30121 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:01.041746 29527 raft_consensus.cc:1275] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:15:01.042865  4781 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:01.043946 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:15:01.044656 29530 raft_consensus.cc:3060] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:01.048096 29526 raft_consensus.cc:3060] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:01.052752  4776 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:15:01.057337 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:01.058178 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 32 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:01.058815 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:01.059485 29529 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 21.
W20260709 13:15:01.036476 29421 leader_election.cc:336] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:15:01.058830 29523 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 31.
I20260709 13:15:01.065327 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a1f9233b9e4fcb989ab4963d6a7ad1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:01.066850 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7f35dbd870d4883ac2ca7cf62f3cd06" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:15:01.067368 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:01.068689 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3d43afcf4e94172a4b40f6c25261ea0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:15:01.070101 29421 leader_election.cc:336] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:15:01.071513 29421 leader_election.cc:336] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:15:01.081418 30121 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:15:01.073172 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74cf9b558ac94704b5cb527efdc594ca" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:01.072482 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:01.085512  4781 raft_consensus.cc:2749] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:15:01.089334 30150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eb760d2a128422684c16e20d11a9e82" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:15:01.090273 30150 raft_consensus.cc:3060] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:15:01.099706  4776 consensus_queue.cc:1059] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:15:01.099774 29421 leader_election.cc:336] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:15:01.101791  4776 raft_consensus.cc:3055] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:15:01.102274  4776 raft_consensus.cc:740] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:15:01.102521 30121 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:01.103668  4776 consensus_queue.cc:260] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:15:01.104637 29421 leader_election.cc:336] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:15:01.105075 29523 raft_consensus.cc:1240] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 23. Current term is 24. Ops: []
I20260709 13:15:01.104899 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a13b0d97aec4ead9f25e62f8dcb36cf" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:01.105075  4776 raft_consensus.cc:3060] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:01.106832 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66f47d21a0c4572ac5357c6cf623284" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:01.108753 29522 raft_consensus.cc:1240] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Rejecting Update request from peer 183db85c071f489fbc8de63a9edd8a3a for earlier term 19. Current term is 20. Ops: []
W20260709 13:15:01.105389 29421 leader_election.cc:336] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:15:01.110783 29421 leader_election.cc:304] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:15:01.111894 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:01.112557 29522 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 19.
I20260709 13:15:01.113440  4804 raft_consensus.cc:2749] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:15:01.114929 29421 consensus_peers.cc:597] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:01.122197  4797 raft_consensus.cc:1064] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a: attempting to promote NON_VOTER ca041dab9b2f44409ed7bf4c6cf66ab2 to VOTER
I20260709 13:15:01.125741 29449 raft_consensus.cc:2468] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 24.
I20260709 13:15:01.128827 29530 raft_consensus.cc:2468] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 21.
I20260709 13:15:01.132179  4797 consensus_queue.cc:237] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 12, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:01.135434 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f882eb054d4655a776901e6e22c617" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:01.135810 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "954309d5d9c549439adda625fbaa6b96" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:01.137276 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:01.138226 29523 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 25.
I20260709 13:15:01.140801 30150 raft_consensus.cc:2468] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 24.
I20260709 13:15:01.141579  4781 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:15:01.145840 30121 consensus_peers.cc:597] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:01.147823 30121 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:15:01.148347 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cece22da76441f5a3d309c5cb454c42" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:01.148726  4781 raft_consensus.cc:2804] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:15:01.149340  4781 raft_consensus.cc:697] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 24 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:15:01.150393  4781 consensus_queue.cc:237] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:01.150755 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:01.152240 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4e4c7715074c3f984153e428f3a4f1" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:15:01.154184 29421 leader_election.cc:336] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:15:01.154507 29419 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:15:01.154778 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:01.154912 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6a9a102eba49209ddf2bdf286077e8" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:01.155447 29530 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 20.
I20260709 13:15:01.156256 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee77cbd588da45af9d5274a642fd28a5" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:15:01.154935 29421 leader_election.cc:336] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:15:01.162973 29421 leader_election.cc:304] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:15:01.163897  4776 raft_consensus.cc:2804] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:15:01.164474  4776 raft_consensus.cc:697] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 24 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:15:01.165468  4776 consensus_queue.cc:237] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:01.167064 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:01.167313 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d440001d38e4a58becc5e57e767a12f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:01.168641 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f343c91124ea4cd5b19e26f3530e1247" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:01.171514  4804 raft_consensus.cc:2749] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:01.173575 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3b77a777d14f819c6bc72128621f93" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:01.173904 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843654f7a60942bd9feee060ac9d2dfe" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:01.174449 29527 raft_consensus.cc:1275] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:15:01.175292 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d2e96638024243b35d8c06dcc28486" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:01.176347  4760 consensus_queue.cc:1048] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:15:01.175438 29421 leader_election.cc:336] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:15:01.132354 29526 raft_consensus.cc:2468] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 22.
I20260709 13:15:01.188042 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:01.188890 29521 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 21.
I20260709 13:15:01.189060 29275 catalog_manager.cc:5697] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 23 to 24, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132). New cstate: current_term: 24 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:01.190620 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:15:01.191673 29521 raft_consensus.cc:2393] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 24: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:15:01.193571 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5f9acbb73364212a42eaa5004f5aba9" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:15:01.195832 29421 leader_election.cc:336] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:15:01.199398 30150 raft_consensus.cc:1275] T f07124b3443042c0b07f5833ed54ce53 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 21 LEARNER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:15:01.204089 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e651bcfb64af6a9b5e97f9e40229f" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:01.204761  4797 consensus_queue.cc:1048] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:15:01.228550 29421 leader_election.cc:336] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:15:01.243664 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
W20260709 13:15:01.229557 29421 leader_election.cc:336] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:15:01.246905 29521 raft_consensus.cc:2393] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 19: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:15:01.340373 29527 raft_consensus.cc:1275] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:15:01.342653 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f8335857fe499492a3115b9258c1a4" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:15:01.352152 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:15:01.353111 29449 raft_consensus.cc:2393] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 24: Already voted for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in this term.
I20260709 13:15:01.357434 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:15:01.359594 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47da517282ee462792de545e40119636" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:15:01.361418 29453 raft_consensus.cc:1275] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:15:01.365458 29450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9322ad5c2448f5bbe70c893b323d98" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:15:01.369704 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cced75430d1485689f4eff61c816af0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:15:01.370932 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea24afe5d794a069e28297bbb74cf5a" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:15:01.374100 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 32 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:15:01.374877 29451 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 31.
I20260709 13:15:01.387714 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a3c543fca4406fae61f154055aeb79" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:15:01.388697 29451 raft_consensus.cc:2393] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 21: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:15:01.390476 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:15:01.390798 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:15:01.391302 29453 raft_consensus.cc:2393] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 19: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:15:01.391479 29451 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 25.
I20260709 13:15:01.397650 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ea78f0332644d3b941842ae07c5d95" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:15:01.402218 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab0baf9ea21a4fe78401601893e7ff66" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:15:01.404552 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f352c5b8ac3f411ba5fc4901bc7e66a5" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:15:01.404945 29448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93659d173b6a4dbe9938c612cc5f14e0" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:15:01.407517 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:15:01.421624 29278 catalog_manager.cc:5697] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 23 to 24, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 24 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:01.442828 29421 leader_election.cc:336] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:15:01.444546 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c0d06e6f284af29109e961ff953c5f" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:15:01.444829 29421 leader_election.cc:336] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:15:01.445569 29449 raft_consensus.cc:2393] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 24: Already voted for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in this term.
W20260709 13:15:01.446219 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:01.445653 29421 leader_election.cc:336] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:15:01.452075 29421 leader_election.cc:336] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:15:01.452855 29421 leader_election.cc:336] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:15:01.453613 29421 leader_election.cc:336] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:15:01.458741 29452 raft_consensus.cc:1275] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:15:01.484098 29451 raft_consensus.cc:2468] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 20.
W20260709 13:15:01.483651 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 112385us
W20260709 13:15:01.486037 29421 leader_election.cc:336] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:15:01.486790 29421 leader_election.cc:336] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:15:01.487207 29421 leader_election.cc:304] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:15:01.512306 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:01.517906 29421 leader_election.cc:336] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:15:01.518771 29421 leader_election.cc:336] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:15:01.523594  4807 raft_consensus.cc:2749] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:15:01.527676  4776 consensus_queue.cc:1048] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:15:01.532387 29419 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:15:01.534301  4807 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:15:01.535912 29419 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:01.544457  4807 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 13:15:01.544970  4807 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 31 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:15:01.545373  4807 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 31 FOLLOWER]: Advancing to term 32
I20260709 13:15:01.551465 29419 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:01.560096  4776 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:15:01.560621  4776 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:15:01.561012  4776 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:01.579270 29526 raft_consensus.cc:1275] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:15:01.582010  4823 consensus_queue.cc:1048] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:15:01.582506 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 62711.8us
W20260709 13:15:01.595140 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 43804.4us
W20260709 13:15:01.618413 29420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:01.619757 29419 leader_election.cc:304] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:15:01.638366 29421 leader_election.cc:336] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:15:01.639338 29419 leader_election.cc:304] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:15:01.644398 29421 leader_election.cc:336] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:15:01.636508  4804 raft_consensus.cc:2749] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:01.647904 29419 leader_election.cc:304] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:15:01.652277 29421 consensus_peers.cc:597] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:01.649518  4821 raft_consensus.cc:2749] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:15:01.661160 29419 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:15:01.661814 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 122950us
I20260709 13:15:01.661144  4803 raft_consensus.cc:2749] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:15:01.682766 29419 leader_election.cc:304] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:15:01.685252  4804 raft_consensus.cc:2749] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:15:01.683918  4821 raft_consensus.cc:2749] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:01.697260  4776 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:01.699918  4776 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:01.700681 29419 leader_election.cc:304] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:15:01.702034 29419 leader_election.cc:304] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:15:01.703683  4821 raft_consensus.cc:2749] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:15:01.705163  4797 raft_consensus.cc:2749] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:15:01.707784 29419 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:01.710721  4821 raft_consensus.cc:2804] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:01.711159  4821 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:15:01.711568  4821 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:01.721972  4821 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:01.724514 29419 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:01.729527  4807 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:01.732301  4807 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 32 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:15:01.736888 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 49120.7us
I20260709 13:15:01.737248  4797 raft_consensus.cc:2804] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:15:01.737962  4797 raft_consensus.cc:697] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 21 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:15:01.738920  4826 consensus_queue.cc:1048] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:15:01.740237  4797 consensus_queue.cc:237] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:01.741923 29495 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:15:01.742985 29419 leader_election.cc:304] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:15:01.744773 29421 leader_election.cc:336] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:15:01.746768  4821 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:01.747653  4776 raft_consensus.cc:2749] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:15:01.748489  4778 raft_consensus.cc:2804] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:15:01.748992  4778 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:15:01.749481  4778 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:01.749886 29419 leader_election.cc:304] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:15:01.752872 29421 connection.cc:769] client connection to 127.27.146.129:42127 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:15:01.753924  4776 raft_consensus.cc:2749] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:01.755482 29419 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:01.757349 29419 leader_election.cc:304] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
W20260709 13:15:01.759189 29421 leader_election.cc:336] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 32 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:15:01.761495  4776 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:15:01.762004  4776 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:15:01.762045 29495 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:15:01.762517  4776 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:15:01.763825  4827 raft_consensus.cc:2804] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:01.765250 29419 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:15:01.765364 29495 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:15:01.764315  4827 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:15:01.766536  4827 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:01.766057  4821 raft_consensus.cc:2749] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:15:01.776469  4821 raft_consensus.cc:2749] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:01.779716  4776 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:01.782390  4776 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 26 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:01.783519 29419 leader_election.cc:304] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:15:01.783985  4826 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:15:01.784588  4826 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:15:01.784787 29419 leader_election.cc:304] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:15:01.785077  4826 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:01.786789  4821 raft_consensus.cc:2749] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:15:01.787474  4821 raft_consensus.cc:2749] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:15:01.788151 29495 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:15:01.788622 29419 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:01.789471  4825 raft_consensus.cc:2804] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:15:01.789937  4825 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:15:01.790336  4825 raft_consensus.cc:3060] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:01.790669  4821 raft_consensus.cc:2804] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:15:01.791206  4821 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:15:01.791626  4821 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:01.797307 29419 leader_election.cc:304] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:15:01.800343  4825 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:01.804243  4804 raft_consensus.cc:2749] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:15:01.805894 29419 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:15:01.813030 29419 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:15:01.814875 29419 leader_election.cc:304] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:15:01.816524  4804 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:01.819697 29419 leader_election.cc:304] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:15:01.820358  4804 raft_consensus.cc:2749] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:15:01.820696  4803 raft_consensus.cc:2749] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:15:01.822588 29419 leader_election.cc:304] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:15:01.816591  4776 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:15:01.826722 29419 leader_election.cc:304] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:15:01.825910  4803 raft_consensus.cc:2749] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:15:01.828614  4778 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:01.831132  4778 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:01.833467 29495 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:15:01.834518  4797 raft_consensus.cc:2749] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:15:01.835948 29419 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:01.837064  4836 raft_consensus.cc:2804] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:01.837585  4836 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:15:01.838038  4836 raft_consensus.cc:3060] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:01.845088 29495 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:15:01.845995  4797 raft_consensus.cc:2804] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:15:01.850732  4797 raft_consensus.cc:697] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 22 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:15:01.851975  4797 consensus_queue.cc:237] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:15:01.853569 29421 leader_election.cc:336] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:01.856876 29419 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:15:01.859292 29421 leader_election.cc:336] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:01.860751  4776 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:15:01.861344  4776 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:15:01.861816  4776 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:01.866147  4826 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:01.872704 29419 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:15:01.847426  4827 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:01.874970  4825 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:15:01.884195  4827 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:01.883960  4836 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:01.872442  4821 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:01.876240 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
W20260709 13:15:01.878170 30121 consensus_peers.cc:597] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:15:01.886461  4836 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:15:01.848229  4778 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:15:01.886720  4821 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:01.887085  4778 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:15:01.887614  4778 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:01.888307  4826 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:01.886320 30121 consensus_peers.cc:597] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:01.891433 30121 consensus_peers.cc:597] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:15:01.895654 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:15:01.897501  4803 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:15:01.910176 29526 raft_consensus.cc:1240] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:15:01.917770  4822 consensus_queue.cc:1059] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:01.919070  4822 raft_consensus.cc:3055] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:15:01.919422  4822 raft_consensus.cc:740] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:15:01.920779  4822 consensus_queue.cc:260] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:01.936410 29495 leader_election.cc:304] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:15:01.942965 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 70361.4us
I20260709 13:15:01.939980  4836 raft_consensus.cc:2749] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:15:01.946779 29419 leader_election.cc:304] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:15:01.949781  4827 consensus_queue.cc:1048] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:15:01.949582  4797 raft_consensus.cc:2749] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:15:01.959663 29419 leader_election.cc:304] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:15:01.961436 29419 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:15:01.962404  4821 raft_consensus.cc:2749] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:15:01.963223  4821 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:15:01.946782  4822 raft_consensus.cc:3060] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:15:01.970537 29526 raft_consensus.cc:1240] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Rejecting Update request from peer ca041dab9b2f44409ed7bf4c6cf66ab2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:15:01.972426  4823 consensus_queue.cc:1059] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:01.973723  4794 raft_consensus.cc:3055] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:15:01.974148  4794 raft_consensus.cc:740] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:15:01.975178  4794 consensus_queue.cc:260] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:15:01.976831 29421 leader_election.cc:336] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:01.987461 29419 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:01.991761  4794 raft_consensus.cc:3060] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:01.992985 30157 raft_consensus.cc:1275] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 24 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
W20260709 13:15:02.004918 30121 consensus_peers.cc:597] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:02.011426 30120 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:02.011479 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 62396.5us
I20260709 13:15:02.015148 29495 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:15:02.016065  4836 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 13:15:02.016741  4836 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 31 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:15:02.017148  4836 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 31 FOLLOWER]: Advancing to term 32
I20260709 13:15:02.022627  4778 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:02.025216  4778 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:02.030042 29451 raft_consensus.cc:1275] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:15:02.031721 29495 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:15:02.034986  4827 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:15:02.029632  4836 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:02.041944  4776 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:02.035442  4827 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 429e58eb058349e3bf72b5a870c8f6e5)
I20260709 13:15:02.044004  4827 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:15:02.044569  4776 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:02.045455 29275 catalog_manager.cc:5697] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 20 to 21, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 21 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:02.047848 29275 catalog_manager.cc:5697] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 21 to 22, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 22 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:02.049245  4781 consensus_queue.cc:1048] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:15:02.053635  4836 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 32 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:02.054620  4827 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:02.055536 29495 leader_election.cc:304] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:15:02.059753  4826 raft_consensus.cc:2749] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:15:02.060526  4826 consensus_queue.cc:1048] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:15:02.063396 29495 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:15:02.064390  4826 raft_consensus.cc:2804] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:15:02.064997  4826 raft_consensus.cc:697] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:15:02.066200  4826 consensus_queue.cc:237] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:02.070459  4797 consensus_queue.cc:1048] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:15:02.090444 29495 connection.cc:769] client connection to 127.27.146.129:42127 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:15:02.094427  4776 consensus_queue.cc:1048] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:15:02.116743 29421 consensus_peers.cc:597] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:02.111415  4827 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 26 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:02.130816 29421 leader_election.cc:336] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:02.175050 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 63035.4us
W20260709 13:15:02.176330 29495 leader_election.cc:336] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:15:02.179947 29495 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:02.176367 29278 catalog_manager.cc:5697] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 19 to 20, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 20 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:02.210579 29495 leader_election.cc:336] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:15:02.210712  4827 raft_consensus.cc:2749] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:15:02.212034 29495 consensus_peers.cc:597] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: sendmsg error: Broken pipe (error 32). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:02.222436 29495 leader_election.cc:336] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:15:02.223024 29495 leader_election.cc:304] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:15:02.223937  4827 raft_consensus.cc:2749] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:15:02.224092 29495 consensus_peers.cc:597] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: sendmsg error: Broken pipe (error 32). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:02.224715 29495 consensus_peers.cc:597] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: sendmsg error: Broken pipe (error 32). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:02.225208 29495 consensus_peers.cc:597] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: sendmsg error: Broken pipe (error 32). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:02.225714 29495 leader_election.cc:336] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:15:02.226040 29495 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:02.226716  4827 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:15:02.226814 29495 leader_election.cc:336] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: sendmsg error: Broken pipe (error 32)
W20260709 13:15:02.227775 29495 leader_election.cc:336] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:15:02.228224 29495 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:02.229254  4827 raft_consensus.cc:2749] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:15:02.230461 29495 leader_election.cc:336] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:15:02.230877 29495 leader_election.cc:304] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:15:02.232404 29495 leader_election.cc:336] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:15:02.233541 29495 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:02.234341  4826 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:15:02.234820 29495 leader_election.cc:336] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: sendmsg error: Broken pipe (error 32)
W20260709 13:15:02.235855 29495 leader_election.cc:336] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:15:02.236130 29495 leader_election.cc:304] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:15:02.236727  4826 raft_consensus.cc:2749] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:15:02.237016 29495 leader_election.cc:336] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: sendmsg error: Broken pipe (error 32)
W20260709 13:15:02.237759 29495 leader_election.cc:336] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: sendmsg error: Broken pipe (error 32)
W20260709 13:15:02.238566 29495 leader_election.cc:336] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:15:02.238823 29495 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:02.231690  4827 raft_consensus.cc:2749] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:15:02.239430  4826 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:15:02.239760 29495 consensus_peers.cc:597] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: sendmsg error: Broken pipe (error 32). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:02.240453 29495 consensus_peers.cc:597] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: sendmsg error: Broken pipe (error 32). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:02.240818 29495 consensus_peers.cc:597] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: sendmsg error: Broken pipe (error 32). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:02.241176 29495 consensus_peers.cc:597] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: sendmsg error: Broken pipe (error 32). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:02.241509 29495 leader_election.cc:336] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: sendmsg error: Broken pipe (error 32)
W20260709 13:15:02.242091 29495 consensus_peers.cc:597] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: sendmsg error: Broken pipe (error 32). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:02.242496 29495 consensus_peers.cc:597] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: sendmsg error: Broken pipe (error 32). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:02.242913 29495 leader_election.cc:336] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:15:02.243260 29495 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:02.244051  4827 raft_consensus.cc:2749] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:15:02.258903 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:15:02.257673 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:15:02.264635 29449 raft_consensus.cc:2393] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 21: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:15:02.299619 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:15:02.300601 29451 raft_consensus.cc:2393] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 20: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:15:02.301113 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:15:02.301569 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:15:02.301950 29454 raft_consensus.cc:2393] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 22: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
I20260709 13:15:02.310868 29449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:15:02.311724 29449 raft_consensus.cc:2393] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 22: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
W20260709 13:15:02.316823 30121 consensus_peers.cc:597] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:15:02.317386 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 32 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:15:02.318411 29451 raft_consensus.cc:2393] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 32 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 32: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
W20260709 13:15:02.316992 29421 consensus_peers.cc:597] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:02.324607 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:15:02.325527 29527 raft_consensus.cc:2393] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 20: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:15:02.324667 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 32 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:15:02.327945 29522 raft_consensus.cc:2393] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 32 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 32: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:15:02.327631 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:15:02.329521 29521 raft_consensus.cc:2393] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 22: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:15:02.329800 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:15:02.330116 29525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:15:02.330591 29524 raft_consensus.cc:2393] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 21: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:15:02.330883 29525 raft_consensus.cc:2393] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 22: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:15:02.331282 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:15:02.332309 29530 raft_consensus.cc:2393] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 26: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:15:02.353561 29521 raft_consensus.cc:1275] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:15:02.365582 29453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:15:02.368945 29453 raft_consensus.cc:2393] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 26: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
W20260709 13:15:02.383077 30121 consensus_peers.cc:597] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:02.409091 29495 consensus_peers.cc:597] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:02.409785 29495 leader_election.cc:336] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:02.410187 29495 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:02.418974  4827 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:15:02.426756 29421 consensus_peers.cc:597] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:02.411237 29495 leader_election.cc:336] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:02.433346 29495 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:02.434312  4827 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:15:02.435362 29495 leader_election.cc:336] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:02.436695 29495 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:02.442041  4827 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:15:02.443352 29495 leader_election.cc:336] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:02.444447 29495 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:02.447311  4827 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:15:02.448745 29495 leader_election.cc:336] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:02.451623 29495 leader_election.cc:336] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:02.452373 29495 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:15:02.453869 29495 leader_election.cc:336] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:02.454350 29495 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:02.455168  4827 raft_consensus.cc:2749] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:15:02.458709  4827 raft_consensus.cc:2749] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:15:02.460141 29495 leader_election.cc:336] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:02.468263 29495 consensus_peers.cc:597] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:02.469004 29495 leader_election.cc:336] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:02.469655 29495 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:02.470530  4827 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:15:02.471596 29495 leader_election.cc:336] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:02.472075 29495 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:02.472824  4827 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:15:02.474011 29495 leader_election.cc:336] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:02.474500 29495 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:02.475214  4827 raft_consensus.cc:2749] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:15:02.476393 29495 leader_election.cc:336] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:02.476855 29495 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:15:02.477916  4827 raft_consensus.cc:2749] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260709 13:15:02.479163 29495 leader_election.cc:336] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:02.479676 29495 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:02.480473  4827 raft_consensus.cc:2749] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:15:02.481534 29495 consensus_peers.cc:597] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:02.482169 29495 consensus_peers.cc:597] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:02.482786 29495 leader_election.cc:336] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:02.511941 29419 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:15:02.517606 29495 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:02.518855  4836 raft_consensus.cc:2749] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:15:02.514931  4776 raft_consensus.cc:2749] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:15:02.522933 29495 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:15:02.524248  4836 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:15:02.526325 29495 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
W20260709 13:15:02.527016 30121 consensus_peers.cc:597] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:15:02.527231  4836 raft_consensus.cc:2749] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:15:02.517645 29419 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:15:02.531630  4776 raft_consensus.cc:2749] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:15:02.535264 29419 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:15:02.536214  4776 raft_consensus.cc:2749] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:15:02.537721 29419 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:15:02.543821  4776 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:15:02.545449 29419 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 32 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:15:02.554386  4776 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 32 FOLLOWER]: Leader election lost for term 32. Reason: could not achieve majority
I20260709 13:15:02.557296 29419 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:15:02.560545  4803 raft_consensus.cc:2749] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260709 13:15:02.673765 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 117457us
I20260709 13:15:02.689972 30157 raft_consensus.cc:1275] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 20 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:15:02.697726 29527 raft_consensus.cc:1275] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:15:02.703856 29495 leader_election.cc:336] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:02.704516 29495 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:02.705602  4797 consensus_queue.cc:1048] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:15:02.679136  4862 raft_consensus.cc:2955] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 20 LEADER]: Committing config change with OpId 20.16: config changed from index 15 to 16, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:15:02.707754  4827 consensus_queue.cc:1048] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:15:02.709566  4807 raft_consensus.cc:2955] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 25 LEADER]: Committing config change with OpId 25.18: config changed from index 17 to 18, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:15:02.715497 29454 raft_consensus.cc:1275] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
W20260709 13:15:02.721912 29495 leader_election.cc:336] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:02.722522 29495 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:15:02.728511 29495 leader_election.cc:336] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:02.729100 29495 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:15:02.730151 29495 leader_election.cc:336] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 32 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:02.730613 29495 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 32 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:15:02.731626 29495 leader_election.cc:336] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:02.734229 29495 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:02.731858  4865 raft_consensus.cc:2749] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:15:02.732252  4863 raft_consensus.cc:2749] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:15:02.749323 30150 raft_consensus.cc:2955] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 25 FOLLOWER]: Committing config change with OpId 25.18: config changed from index 17 to 18, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:15:02.753301  4821 raft_consensus.cc:2955] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 21 LEADER]: Committing config change with OpId 21.15: config changed from index 14 to 15, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:15:02.733064  4864 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 32 FOLLOWER]: Leader election lost for term 32. Reason: could not achieve majority
I20260709 13:15:02.732573  4826 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:15:02.743825  4778 raft_consensus.cc:2749] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:15:02.742523 29451 raft_consensus.cc:2955] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Committing config change with OpId 20.16: config changed from index 15 to 16, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
W20260709 13:15:02.791667 28234 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 29402)
I20260709 13:15:02.797607 30151 raft_consensus.cc:2955] T f07124b3443042c0b07f5833ed54ce53 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 14 to 15, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:15:02.876444  4797 consensus_queue.cc:1048] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:15:02.887284 29421 consensus_peers.cc:597] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:15:02.901423 29278 catalog_manager.cc:5697] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: config changed from index 15 to 16, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New cstate: current_term: 20 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:15:02.903462  4867 consensus_queue.cc:1048] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.043s
W20260709 13:15:02.974836 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 75470.3us
W20260709 13:15:02.975310 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 55492.1us
W20260709 13:15:02.995810 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 78735us
I20260709 13:15:03.002923  4877 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.017184 29530 raft_consensus.cc:2955] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 14 to 15, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
W20260709 13:15:03.032280 29495 consensus_peers.cc:597] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:03.041662 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 54920.8us
I20260709 13:15:03.048744 30157 raft_consensus.cc:2955] T 5d440001d38e4a58becc5e57e767a12f P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 20 FOLLOWER]: Committing config change with OpId 20.16: config changed from index 15 to 16, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } attrs { replace: true } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:15:03.012493 29527 raft_consensus.cc:2955] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Committing config change with OpId 25.18: config changed from index 17 to 18, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:15:03.060525 29277 catalog_manager.cc:5697] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: config changed from index 17 to 18, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New cstate: current_term: 25 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:15:03.044900  4877 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:03.163987  4877 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:15:03.253366 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 84208.8us
I20260709 13:15:03.277333  4781 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:03.346098  4781 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:03.349143  4781 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:15:03.349354 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 89341.8us
I20260709 13:15:03.351220 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:03.354506 29523 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 26.
I20260709 13:15:03.358541 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:03.359261 29523 raft_consensus.cc:2468] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 12.
W20260709 13:15:03.365185 29421 consensus_peers.cc:597] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:15:03.368065 30119 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:15:03.369168 30119 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:15:03.374080  4880 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:15:03.374642  4880 raft_consensus.cc:493] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:03.375020  4880 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:15:03.377621  4794 raft_consensus.cc:2804] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:15:03.378104  4794 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:03.378436  4794 raft_consensus.cc:3060] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:15:03.396180 29421 consensus_peers.cc:597] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:03.396801 29421 consensus_peers.cc:597] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:03.397459 29421 consensus_peers.cc:597] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:03.397953 29421 consensus_peers.cc:597] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:03.398440 29421 consensus_peers.cc:597] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:15:03.401525  4794 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:03.395789  4880 raft_consensus.cc:515] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:03.396546 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:15:03.453886  4880 leader_election.cc:290] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 27 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:03.456436 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ee3283bb6d4ef28061d053b1bde164" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:15:03.457222 29526 raft_consensus.cc:3060] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:15:03.460477 30121 leader_election.cc:336] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:03.489876 29526 raft_consensus.cc:2468] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 27.
W20260709 13:15:03.502254 29421 consensus_peers.cc:597] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:03.506723 30119 leader_election.cc:304] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:15:03.508375  4892 raft_consensus.cc:2804] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:15:03.509001  4892 raft_consensus.cc:697] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 27 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:15:03.510535  4892 consensus_queue.cc:237] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:03.511816  4794 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 13 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:03.514901 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:15:03.515885 29526 raft_consensus.cc:3060] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:15:03.529683  4890 raft_consensus.cc:493] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:15:03.534705 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:15:03.530493  4890 raft_consensus.cc:515] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:03.540373 29454 raft_consensus.cc:3060] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:15:03.541781  4890 leader_election.cc:290] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
W20260709 13:15:03.545179 29421 consensus_peers.cc:597] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:03.545799 29421 consensus_peers.cc:597] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:15:03.548925 29454 raft_consensus.cc:2468] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 13.
W20260709 13:15:03.553032 30121 leader_election.cc:336] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:03.558768 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:15:03.560303 30151 raft_consensus.cc:2368] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 12. Current term is 13.
I20260709 13:15:03.561820 29419 leader_election.cc:400] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Vote denied by peer ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671) with higher term. Message: Invalid argument: T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 12. Current term is 13.
I20260709 13:15:03.562184 29419 leader_election.cc:403] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:15:03.565487 29421 consensus_peers.cc:597] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:15:03.569643 30121 leader_election.cc:304] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:15:03.572953 29526 raft_consensus.cc:2468] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 13.
I20260709 13:15:03.576582  4794 raft_consensus.cc:2804] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:15:03.576596  4803 raft_consensus.cc:2749] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671) with higher term. Message: Invalid argument: T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 12. Current term is 13.
I20260709 13:15:03.607157  4794 raft_consensus.cc:697] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 13 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:15:03.609251  4794 consensus_queue.cc:237] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:03.591652 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c4a6169e564566927a70e27f4af6f6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:03.620769 29526 raft_consensus.cc:2368] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 12. Current term is 13.
I20260709 13:15:03.632145 29419 leader_election.cc:400] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 12 pre-election: Vote denied by peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367) with higher term. Message: Invalid argument: T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a for earlier term 12. Current term is 13.
I20260709 13:15:03.645166 29526 consensus_queue.cc:237] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:03.669468  4889 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:15:03.670287  4889 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:03.674036  4889 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:15:03.674721 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:15:03.675488 30151 raft_consensus.cc:2468] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 10.
I20260709 13:15:03.676781 29419 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:15:03.677729  4803 raft_consensus.cc:2804] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:15:03.678220  4803 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Starting leader election (detected failure of leader ca041dab9b2f44409ed7bf4c6cf66ab2)
I20260709 13:15:03.678661  4803 raft_consensus.cc:3060] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:15:03.666213 29275 catalog_manager.cc:5697] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: config changed from index 14 to 15, ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) changed from NON_VOTER to VOTER. New cstate: current_term: 21 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
W20260709 13:15:03.702345 30121 consensus_peers.cc:597] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:03.704205 30151 raft_consensus.cc:1275] T 5d440001d38e4a58becc5e57e767a12f P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 20 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:15:03.705356 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:03.705839  4864 consensus_queue.cc:1048] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:15:03.706219 29530 raft_consensus.cc:2393] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 10: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:15:03.712222 29452 raft_consensus.cc:1275] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:15:03.715750  4826 raft_consensus.cc:2955] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 20 LEADER]: Committing config change with OpId 20.17: config changed from index 16 to 17, VOTER 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:15:03.718681  4867 consensus_queue.cc:1048] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:15:03.720937 29277 catalog_manager.cc:5697] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 25 to 27, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132). New cstate: current_term: 27 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:03.723021 29277 catalog_manager.cc:5697] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:03.729877 30151 raft_consensus.cc:2955] T 5d440001d38e4a58becc5e57e767a12f P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 20 FOLLOWER]: Committing config change with OpId 20.17: config changed from index 16 to 17, VOTER 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:15:03.730881 29451 raft_consensus.cc:2955] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Committing config change with OpId 20.17: config changed from index 16 to 17, VOTER 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } } }
I20260709 13:15:03.690797  4803 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:03.735965  4803 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 election: Requested vote from peers 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:15:03.737138 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2"
I20260709 13:15:03.746225 30157 raft_consensus.cc:2468] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 10.
I20260709 13:15:03.747669 29419 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
W20260709 13:15:03.747982 29421 consensus_peers.cc:597] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:15:03.749150  4889 raft_consensus.cc:2804] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:15:03.749702  4889 raft_consensus.cc:697] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 10 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:15:03.752056  4889 consensus_queue.cc:237] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:03.759833 29263 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5d440001d38e4a58becc5e57e767a12f with cas_config_opid_index 16: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:03.762156 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:15:03.763046 29530 raft_consensus.cc:2393] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 10: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
W20260709 13:15:03.792320 28234 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 29402)
I20260709 13:15:03.828701 29275 catalog_manager.cc:5697] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: config changed from index 16 to 17, VOTER 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) evicted. New cstate: current_term: 20 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:03.922488 29275 catalog_manager.cc:5697] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 9 to 10, leader changed from ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 10 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:03.926630 29265 catalog_manager.cc:4755] TS 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 5d440001d38e4a58becc5e57e767a12f: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:03.941066 29421 consensus_peers.cc:597] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:04.033121 30121 consensus_peers.cc:597] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:04.037932  4889 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.038671  4889 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:04.042903 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:04.043716 29530 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 21.
I20260709 13:15:04.045176 29419 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:15:04.046032  4776 raft_consensus.cc:2804] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:15:04.046461  4776 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:04.046851  4776 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:04.050899  4889 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:04.061345 29530 raft_consensus.cc:1275] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 27 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 13:15:04.061548 29451 raft_consensus.cc:1275] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:15:04.056137  4776 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:04.063963  4892 consensus_queue.cc:1048] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:15:04.068775  4776 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:15:04.069208 29421 leader_election.cc:336] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:04.070243  4781 consensus_queue.cc:1048] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:15:04.071026 29530 raft_consensus.cc:1275] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:15:04.074270  4781 consensus_queue.cc:1048] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:15:04.083655 29495 consensus_peers.cc:597] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:15:04.090655 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d17089efa841fb8a1c4bfae4950ef6" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:15:04.091419 29523 raft_consensus.cc:3060] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:15:04.174021  4826 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.174790  4826 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:04.177796  4826 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:04.149791  4776 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:04.214450  4908 log.cc:927] Time spent T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:15:04.199899  4776 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:15:04.235353 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:44671, user_credentials={real_user=slave}} blocked reactor thread for 47618.2us
I20260709 13:15:04.239271 29452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:15:04.240150 29452 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 24.
I20260709 13:15:04.247910 29495 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:15:04.283103 30151 raft_consensus.cc:1275] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:15:04.285162  4919 consensus_queue.cc:1048] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:15:04.289983 29421 leader_election.cc:336] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:04.260178  4864 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:15:04.297389  4864 raft_consensus.cc:493] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:04.254456  4883 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.256068  4915 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.300747  4915 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:04.303154  4915 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:15:04.303431 29421 leader_election.cc:336] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:04.304575  4883 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:04.298506  4864 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:15:04.309387  4883 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:04.312119  4776 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:15:04.336802 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 84002.1us
I20260709 13:15:04.341465 29523 raft_consensus.cc:2468] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 22.
I20260709 13:15:04.342573  4883 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.343122  4883 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:15:04.344316 29421 leader_election.cc:336] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:04.345355  4883 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:15:04.345427 29421 leader_election.cc:336] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:04.357100  4864 raft_consensus.cc:515] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:04.364876  4864 leader_election.cc:290] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:04.379689  4827 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.391860  4827 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:15:04.397172 29421 leader_election.cc:336] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:04.403088 29421 consensus_peers.cc:597] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:04.410984 29421 consensus_peers.cc:597] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:04.414738  4827 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:15:04.417701 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
W20260709 13:15:04.436363 30121 consensus_peers.cc:597] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:04.297847 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 55412.4us
I20260709 13:15:04.454485  4883 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.455726  4883 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:04.459231  4883 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:15:04.466468 30121 consensus_peers.cc:597] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:04.472808 29421 leader_election.cc:336] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:04.473457 29419 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:04.475459  4883 raft_consensus.cc:2804] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:15:04.476125  4883 raft_consensus.cc:697] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 22 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:15:04.477134  4883 consensus_queue.cc:237] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:04.486666 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4962756209e1496ca6cb92e47ee866b3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
I20260709 13:15:04.487387 29451 raft_consensus.cc:3060] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:15:04.489821 29454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:15:04.524592 29451 raft_consensus.cc:2468] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 25.
I20260709 13:15:04.530089 29530 raft_consensus.cc:1275] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:15:04.540093 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:04.540956 29526 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 19.
I20260709 13:15:04.546794 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 33 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:04.547698 29526 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 32.
I20260709 13:15:04.549149 29526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:04.549889 29526 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 26.
I20260709 13:15:04.551631 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:04.552273 29529 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 20.
I20260709 13:15:04.553162  4883 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.560384 29275 catalog_manager.cc:5697] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 20 to 22, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 22 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:04.553737  4883 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:04.571254 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:04.572082 29530 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 22.
I20260709 13:15:04.575098  4922 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:04.575773  4922 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:04.578215  4922 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:04.580964 29421 leader_election.cc:336] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:04.586417 29495 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:15:04.587544  4827 raft_consensus.cc:2749] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:15:04.589365  4883 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:04.594177 29495 leader_election.cc:304] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:15:04.600274  4827 raft_consensus.cc:2804] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:15:04.600986  4827 raft_consensus.cc:697] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 LEADER]: Becoming Leader. State: Replica: 71aa3578fd924765ab9ac0729c8d1483, State: Running, Role: LEADER
I20260709 13:15:04.602120  4827 consensus_queue.cc:237] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:15:04.609534 29495 consensus_peers.cc:597] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:04.610491 29495 leader_election.cc:336] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:04.611354 29495 consensus_peers.cc:597] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:15:04.635942  4883 consensus_queue.cc:1048] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:15:04.642496 29277 catalog_manager.cc:5697] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 reported cstate change: term changed from 23 to 25, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131). New cstate: current_term: 25 leader_uuid: "71aa3578fd924765ab9ac0729c8d1483" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:04.646934 29419 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:04.649226  4883 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:15:04.649659  4883 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:04.650758  4883 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:04.652861 29419 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:04.653808  4918 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 13:15:04.654247  4918 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 32 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:04.654599  4918 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 32 FOLLOWER]: Advancing to term 33
W20260709 13:15:04.664197 30121 consensus_peers.cc:597] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:15:04.665791 29419 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:04.667824  4919 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:15:04.668344  4919 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:04.668745  4919 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:15:04.676278 29419 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:04.678701  4776 raft_consensus.cc:2804] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:15:04.679116  4776 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:04.679437  4776 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:04.698697 29419 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:04.699404 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a" is_pre_election: true
I20260709 13:15:04.700136 29451 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 22.
I20260709 13:15:04.700469  4915 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:15:04.701136  4915 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:04.701503  4915 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:15:04.710382 29421 consensus_peers.cc:597] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:04.711766  4918 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:04.714732 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:04.715466 29523 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 22.
W20260709 13:15:04.716358 29495 leader_election.cc:336] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:04.717250 29495 consensus_peers.cc:597] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:04.717696 29495 consensus_peers.cc:597] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:04.718194 29495 consensus_peers.cc:597] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:15:04.712428  4919 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:04.721964  4776 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:15:04.728749 29421 leader_election.cc:336] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:04.724124  4918 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 33 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:15:04.730165 30121 consensus_peers.cc:597] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:15:04.730651  4776 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:04.731655  4883 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:15:04.732667 29421 leader_election.cc:336] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 33 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:04.742290  4919 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 27 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:04.762295  4883 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:04.779007 29495 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
I20260709 13:15:04.780089  4923 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:15:04.781211 29421 leader_election.cc:336] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:04.781296 29419 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:15:04.792917 28234 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 29402)
I20260709 13:15:04.780568  4923 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:04.795849  4923 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:15:04.788143  4919 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:15:04.804701  4919 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:04.805150  4919 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:15:04.771852  4915 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:04.811558  4923 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:04.817026  4923 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:04.813024 29495 consensus_peers.cc:597] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:04.818425 29495 consensus_peers.cc:597] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:04.820437 29495 leader_election.cc:336] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:04.838181  4915 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:15:04.843137 29421 leader_election.cc:336] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:04.844380 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc82f5f689ca4adaa719b36a68dc3531" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 33 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:15:04.845070 29529 raft_consensus.cc:3060] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 32 FOLLOWER]: Advancing to term 33
I20260709 13:15:04.845288 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3604a2976f84b96882e8983ba5b3fd7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:15:04.845873 29524 raft_consensus.cc:3060] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:15:04.854177 29524 raft_consensus.cc:2468] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 21.
I20260709 13:15:04.856750 29529 raft_consensus.cc:2468] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 33.
I20260709 13:15:04.859584 29527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6847a37cf6234a13a2fb53ac3cefaa64" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:15:04.871007 29527 raft_consensus.cc:3060] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:15:04.861577 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f645a08329404baabcc745299ee2efd3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:15:04.862833 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9890585c37da4d4fb7b4a3bfa21d48d7" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:15:04.879985 29523 raft_consensus.cc:3060] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:15:04.867038 29451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "183db85c071f489fbc8de63a9edd8a3a"
W20260709 13:15:04.868388 29495 consensus_peers.cc:597] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:15:04.891778  4919 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:04.893348 29451 raft_consensus.cc:2393] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 71aa3578fd924765ab9ac0729c8d1483 in current term 23: Already voted for candidate 183db85c071f489fbc8de63a9edd8a3a in this term.
W20260709 13:15:04.894763 30121 consensus_peers.cc:597] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:15:04.903255 29530 raft_consensus.cc:3060] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:15:04.903959 29419 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:04.904913  4821 raft_consensus.cc:2804] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:15:04.905433  4821 raft_consensus.cc:697] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 21 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:15:04.906397  4821 consensus_queue.cc:237] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:04.908007 29419 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:15:04.909397 29495 leader_election.cc:336] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:04.909456  4915 raft_consensus.cc:2804] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 33 FOLLOWER]: Leader election won for term 33
I20260709 13:15:04.910632 29495 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:04.911002  4915 raft_consensus.cc:697] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 33 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:15:04.911616  4921 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:15:04.912029  4915 consensus_queue.cc:237] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 31.16, Last appended by leader: 16, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:04.919651  4919 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:15:04.921077 29421 leader_election.cc:336] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:04.921414 29527 raft_consensus.cc:2468] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 27.
I20260709 13:15:04.922242 29523 raft_consensus.cc:2468] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 23.
I20260709 13:15:04.923349 29530 raft_consensus.cc:2468] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 20.
I20260709 13:15:04.925595 29523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:15:04.926369 29523 raft_consensus.cc:2393] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 183db85c071f489fbc8de63a9edd8a3a in current term 23: Already voted for candidate 71aa3578fd924765ab9ac0729c8d1483 in this term.
I20260709 13:15:04.928113 29419 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:04.930626 29419 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:04.933375  4776 raft_consensus.cc:2804] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:15:04.933979  4776 raft_consensus.cc:697] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 23 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:15:04.935540  4776 consensus_queue.cc:237] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:15:04.936142 29421 leader_election.cc:336] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:04.937788 29419 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:15:04.943224 29495 consensus_peers.cc:597] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:15:04.945472  4883 raft_consensus.cc:2804] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:15:04.941356  4918 raft_consensus.cc:2804] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:15:04.973491  4918 raft_consensus.cc:697] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 27 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
W20260709 13:15:04.974892 30121 consensus_peers.cc:597] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:15:04.974617  4918 consensus_queue.cc:237] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.12, Last appended by leader: 12, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:15:05.000970 29495 consensus_peers.cc:597] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:05.001818 29495 consensus_peers.cc:597] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:05.003589 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 59575.2us
I20260709 13:15:05.004773 29419 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:15:05.023257  4883 raft_consensus.cc:697] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 20 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:15:05.024478  4883 consensus_queue.cc:237] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:05.034663 29277 catalog_manager.cc:5697] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 19 to 21, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 21 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:05.018924  4821 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:15:05.122149 29495 consensus_peers.cc:597] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:05.129097 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 97055.3us
I20260709 13:15:05.139050 29450 raft_consensus.cc:1275] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Refusing update from remote peer 71aa3578fd924765ab9ac0729c8d1483: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:15:05.150103 29529 raft_consensus.cc:1275] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
W20260709 13:15:05.150698 30121 consensus_peers.cc:597] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:05.200302 29421 consensus_peers.cc:597] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:05.205005 29495 consensus_peers.cc:597] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:05.206589 29495 consensus_peers.cc:597] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:15:05.208074 29277 catalog_manager.cc:5697] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 31 to 33, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 33 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:05.214057  4938 consensus_queue.cc:1048] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
W20260709 13:15:05.222831 29421 consensus_peers.cc:597] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:05.227361 29421 consensus_peers.cc:597] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:05.227814 29277 catalog_manager.cc:5697] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 21 to 23, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 23 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:05.231165 29277 catalog_manager.cc:5697] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 18 to 20, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 20 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:05.237363 29277 catalog_manager.cc:5697] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 25 to 27, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 27 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:05.254931 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 108954us
I20260709 13:15:05.257903  4945 consensus_queue.cc:1048] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [LEADER]: Connected to new peer: Peer: permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:15:05.301584 29265 catalog_manager.cc:4755] TS 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 5d440001d38e4a58becc5e57e767a12f: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:05.331794 29421 consensus_peers.cc:597] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:05.350600 29524 raft_consensus.cc:1275] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:15:05.382128 29421 consensus_peers.cc:597] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:05.441524  4944 consensus_queue.cc:1048] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:15:05.476712 29421 consensus_peers.cc:597] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:05.489553 29495 consensus_peers.cc:597] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:05.491231 29495 consensus_peers.cc:597] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:05.525839 29421 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111) [suppressed 457 similar messages]
W20260709 13:15:05.534976 29421 consensus_peers.cc:597] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:05.570866 29524 raft_consensus.cc:1275] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 33 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 31 index: 16. Preceding OpId from leader: term: 33 index: 17. (index mismatch)
I20260709 13:15:05.573218 29524 raft_consensus.cc:1275] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:15:05.577884 29530 raft_consensus.cc:1275] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 27 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 25 index: 12. Preceding OpId from leader: term: 27 index: 13. (index mismatch)
W20260709 13:15:05.582401 29421 consensus_peers.cc:597] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:15:05.585695 29527 raft_consensus.cc:1275] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:15:05.642884  4948 consensus_queue.cc:1048] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:15:05.643437  4946 consensus_queue.cc:1048] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:15:05.644973  4915 consensus_queue.cc:1048] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.006s
I20260709 13:15:05.645159  4937 consensus_queue.cc:1048] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
W20260709 13:15:05.662799 29421 consensus_peers.cc:597] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:05.675801 29421 consensus_peers.cc:597] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:05.678788 29421 consensus_peers.cc:597] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:05.697293 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 57837us
W20260709 13:15:05.715816 29421 consensus_peers.cc:597] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:05.757877 29421 consensus_peers.cc:597] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:05.776194 29421 consensus_peers.cc:597] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:05.793475 28234 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 29402)
W20260709 13:15:05.908694 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 92301.1us
W20260709 13:15:05.947747 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 81925.7us
W20260709 13:15:05.996111 29421 consensus_peers.cc:597] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:06.006562 29421 consensus_peers.cc:597] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:06.113662 29421 consensus_peers.cc:597] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:06.128165 29495 consensus_peers.cc:597] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:06.192628 29421 consensus_peers.cc:597] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:06.237042 29495 consensus_peers.cc:597] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:06.413878 29265 catalog_manager.cc:4755] TS 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 5d440001d38e4a58becc5e57e767a12f: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:06.455015 30121 consensus_peers.cc:597] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:06.580485 30121 consensus_peers.cc:597] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:06.621132 29421 consensus_peers.cc:597] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:06.621984 29421 consensus_peers.cc:597] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:06.674293 29495 consensus_peers.cc:597] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:15:06.733626  4915 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:06.734239  4915 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:06.737986 29522 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:06.738719 29522 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 23.
I20260709 13:15:06.739516  4915 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:06.743376 29419 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 
W20260709 13:15:06.747396 29421 leader_election.cc:336] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:06.749341  4918 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:15:06.749949  4918 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:06.750334  4918 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:15:06.779448  4918 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:15:06.794037 28234 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 29402)
I20260709 13:15:06.795334 29529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c3c09667374b9aa86861c27221f6d3" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:15:06.796085 29529 raft_consensus.cc:3060] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:15:06.805985  4918 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 election: Requested vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:15:06.802599 29421 leader_election.cc:336] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:06.825024 29529 raft_consensus.cc:2468] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 183db85c071f489fbc8de63a9edd8a3a in term 24.
I20260709 13:15:06.828327 29419 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483; no voters: 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:06.829706  4948 raft_consensus.cc:2804] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:15:06.830312  4948 raft_consensus.cc:697] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 24 LEADER]: Becoming Leader. State: Replica: 183db85c071f489fbc8de63a9edd8a3a, State: Running, Role: LEADER
I20260709 13:15:06.831271  4948 consensus_queue.cc:237] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:15:06.838027 29495 consensus_peers.cc:597] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:06.868889 30121 consensus_peers.cc:597] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:15:06.882251 29275 catalog_manager.cc:5697] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a reported cstate change: term changed from 21 to 24, leader changed from 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129) to 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130). New cstate: current_term: 24 leader_uuid: "183db85c071f489fbc8de63a9edd8a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:06.910888 30121 consensus_peers.cc:597] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:06.931354 29421 consensus_peers.cc:597] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:07.002108 29495 consensus_peers.cc:597] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:07.026100 29495 consensus_peers.cc:597] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:07.085819 29421 consensus_peers.cc:597] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:07.103268 29495 consensus_peers.cc:597] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:07.133595 29495 consensus_peers.cc:597] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:07.222942 29421 consensus_peers.cc:597] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:07.255357 29421 consensus_peers.cc:597] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:07.271551 29495 consensus_peers.cc:597] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:07.284039 29495 consensus_peers.cc:597] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:15:07.294005 29522 raft_consensus.cc:1275] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Refusing update from remote peer 183db85c071f489fbc8de63a9edd8a3a: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:15:07.296789  4915 consensus_queue.cc:1048] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:15:07.298400 30121 consensus_peers.cc:597] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:07.311275 29495 consensus_peers.cc:597] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:07.354895 30121 consensus_peers.cc:597] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:07.422546 29495 consensus_peers.cc:597] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:07.505460 30121 consensus_peers.cc:597] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:07.505650 29495 consensus_peers.cc:597] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:07.524910 29495 consensus_peers.cc:597] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:07.591250 29421 consensus_peers.cc:597] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:07.600565 29421 consensus_peers.cc:597] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:07.639618 30121 consensus_peers.cc:597] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:07.651531 29495 consensus_peers.cc:597] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:07.679168 30121 consensus_peers.cc:597] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:07.687952 29495 consensus_peers.cc:597] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:07.717624 29495 consensus_peers.cc:597] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:07.761904 29421 consensus_peers.cc:597] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:07.794584 28234 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 29402)
W20260709 13:15:07.852726 29421 consensus_peers.cc:597] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:07.894809 29421 consensus_peers.cc:597] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:07.939148 29421 consensus_peers.cc:597] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:07.943822 29495 consensus_peers.cc:597] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:07.999081 29421 consensus_peers.cc:597] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:08.019804 29421 consensus_peers.cc:597] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:08.022583 29495 consensus_peers.cc:597] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:08.035202 29421 consensus_peers.cc:597] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:08.113771 29421 consensus_peers.cc:597] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:08.214666 29421 consensus_peers.cc:597] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:08.240777 29421 consensus_peers.cc:597] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:08.268162 29495 consensus_peers.cc:597] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:08.330835 29421 consensus_peers.cc:597] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:08.366109 29421 consensus_peers.cc:597] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:08.401316 29421 consensus_peers.cc:597] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:08.437958 29421 consensus_peers.cc:597] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:08.499652 29495 consensus_peers.cc:597] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:08.510552 29421 consensus_peers.cc:597] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:08.550235 29265 catalog_manager.cc:4755] TS 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 5d440001d38e4a58becc5e57e767a12f: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:08.795202 28234 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 29402)
W20260709 13:15:08.804708 29421 consensus_peers.cc:597] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:08.914776 29421 consensus_peers.cc:597] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:08.954672 30121 consensus_peers.cc:597] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:09.004189 29421 consensus_peers.cc:597] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:09.317605 30121 consensus_peers.cc:597] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:09.366822 29421 consensus_peers.cc:597] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:09.547211 29495 consensus_peers.cc:597] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:09.565174 30121 consensus_peers.cc:597] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:09.571772 30121 consensus_peers.cc:597] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:09.651165 29421 consensus_peers.cc:597] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:09.693133 29495 consensus_peers.cc:597] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:09.694175 29495 consensus_peers.cc:597] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:09.694250 29421 consensus_peers.cc:597] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:09.700565 29421 consensus_peers.cc:597] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:09.789414 29495 consensus_peers.cc:597] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:09.796968 28234 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 29402)
W20260709 13:15:09.903517 30121 consensus_peers.cc:597] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:09.944250 30121 consensus_peers.cc:597] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:09.986595 29421 consensus_peers.cc:597] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:09.995275 30121 consensus_peers.cc:597] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:10.011991 29495 consensus_peers.cc:597] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:10.028617 29495 consensus_peers.cc:597] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:10.027835 30121 consensus_peers.cc:597] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:10.098718 29421 consensus_peers.cc:597] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:10.126408 29495 consensus_peers.cc:597] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:10.139940 29495 consensus_peers.cc:597] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:10.140694 29495 consensus_peers.cc:597] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:10.206991 29495 consensus_peers.cc:597] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:10.213802 29495 consensus_peers.cc:597] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:10.379688 29421 consensus_peers.cc:597] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:10.396919 29421 consensus_peers.cc:597] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:10.406517 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 95093.7us
W20260709 13:15:10.420933 29495 consensus_peers.cc:597] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:10.424016 29495 consensus_peers.cc:597] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:10.425693 29495 consensus_peers.cc:597] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:10.474154 29421 consensus_peers.cc:597] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:10.487417 29421 consensus_peers.cc:597] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:10.491766 30121 consensus_peers.cc:597] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:10.557667 29421 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111) [suppressed 509 similar messages]
W20260709 13:15:10.574345 29421 consensus_peers.cc:597] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:10.597397 29421 consensus_peers.cc:597] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:10.640301 29495 consensus_peers.cc:597] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:10.680123 29495 consensus_peers.cc:597] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:10.716889 29421 consensus_peers.cc:597] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:10.722440 29421 consensus_peers.cc:597] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:10.733098 29421 consensus_peers.cc:597] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:10.745652 29421 consensus_peers.cc:597] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:10.798905 28234 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 29402)
W20260709 13:15:10.835336 29421 consensus_peers.cc:597] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:11.009825 29421 consensus_peers.cc:597] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:11.027091 29421 consensus_peers.cc:597] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:11.092202 29495 consensus_peers.cc:597] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:11.102569 29421 consensus_peers.cc:597] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:11.138185 29495 consensus_peers.cc:597] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:11.184106 29421 consensus_peers.cc:597] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:11.230055 29421 consensus_peers.cc:597] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:11.277328 30121 consensus_peers.cc:597] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:11.288990 29495 consensus_peers.cc:597] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:11.351070 29421 consensus_peers.cc:597] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:11.638031 29421 consensus_peers.cc:597] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:11.691074 30121 consensus_peers.cc:597] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:11.799595 28234 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 29402)
W20260709 13:15:12.044775 29495 consensus_peers.cc:597] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:12.048352 29421 consensus_peers.cc:597] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:12.066187 29495 consensus_peers.cc:597] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:12.109567 30121 consensus_peers.cc:597] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:12.110198 29421 consensus_peers.cc:597] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:12.124318 30121 consensus_peers.cc:597] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:12.128079 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 44071.6us
W20260709 13:15:12.141592 29495 consensus_peers.cc:597] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:12.200753 30121 consensus_peers.cc:597] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:12.397341 30121 consensus_peers.cc:597] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:12.437975 29421 consensus_peers.cc:597] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:12.448068 29421 consensus_peers.cc:597] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:12.453704 29421 consensus_peers.cc:597] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:12.543156 29495 consensus_peers.cc:597] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:12.544131 29495 consensus_peers.cc:597] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:12.645709 30121 consensus_peers.cc:597] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:12.688120 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 49206.3us
W20260709 13:15:12.739477 30121 consensus_peers.cc:597] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:12.772594 29265 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 63964.6us
W20260709 13:15:12.778467 29265 catalog_manager.cc:4755] TS 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 5d440001d38e4a58becc5e57e767a12f: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:12.764683 29421 consensus_peers.cc:597] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:12.799194 30121 consensus_peers.cc:597] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:12.800173 28234 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 29402)
W20260709 13:15:12.905181 29421 consensus_peers.cc:597] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:12.937520 29421 consensus_peers.cc:597] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:12.969622 29495 consensus_peers.cc:597] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:12.970474 29495 consensus_peers.cc:597] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:12.971033 29495 consensus_peers.cc:597] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:12.999387 29421 consensus_peers.cc:597] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:13.002839 29421 consensus_peers.cc:597] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:13.030841 29495 consensus_peers.cc:597] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:13.031679 29495 consensus_peers.cc:597] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:13.032202 29495 consensus_peers.cc:597] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:13.076761 29495 consensus_peers.cc:597] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:13.092717 29495 consensus_peers.cc:597] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:13.103042 29421 consensus_peers.cc:597] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:13.221669 29421 consensus_peers.cc:597] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:13.271587 29421 consensus_peers.cc:597] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:13.328545 29495 consensus_peers.cc:597] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:13.365306 29421 consensus_peers.cc:597] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:13.379601 29495 consensus_peers.cc:597] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:13.402441 29421 consensus_peers.cc:597] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:13.423175 29421 consensus_peers.cc:597] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:13.455544 29421 consensus_peers.cc:597] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:13.469322 29495 consensus_peers.cc:597] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:13.510043 29421 consensus_peers.cc:597] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:13.572173 29421 consensus_peers.cc:597] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:13.580854 29421 consensus_peers.cc:597] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:13.619683 29421 consensus_peers.cc:597] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:13.677024 29421 consensus_peers.cc:597] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:13.800695 28234 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 29402)
W20260709 13:15:13.955642 30121 consensus_peers.cc:597] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:14.076713 29421 consensus_peers.cc:597] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:14.209348 29421 consensus_peers.cc:597] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:14.272778 30121 consensus_peers.cc:597] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:14.392714 29495 consensus_peers.cc:597] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:14.411048 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 87732.8us
W20260709 13:15:14.475196 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 50272.3us
W20260709 13:15:14.489794 29421 consensus_peers.cc:597] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:14.637060 30121 consensus_peers.cc:597] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:14.692152 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 55174.7us
W20260709 13:15:14.643187 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 60703us
W20260709 13:15:14.746358 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 51071.3us
W20260709 13:15:14.759100 30121 consensus_peers.cc:597] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:14.801303 28234 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 29402)
W20260709 13:15:14.817160 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 73406.7us
W20260709 13:15:14.858006 30121 consensus_peers.cc:597] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:14.879420 29421 consensus_peers.cc:597] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:14.890074 29421 consensus_peers.cc:597] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:15.006639 29421 consensus_peers.cc:597] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:15.078118 30121 consensus_peers.cc:597] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:15.091313 30121 consensus_peers.cc:597] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:15.125547 29421 consensus_peers.cc:597] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:15.140946 29495 consensus_peers.cc:597] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:15.147095 29495 consensus_peers.cc:597] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:15.152840 29495 consensus_peers.cc:597] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:15.293207 30121 consensus_peers.cc:597] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:15.319924 29421 consensus_peers.cc:597] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:15.421314 30121 consensus_peers.cc:597] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:15.441362 29421 consensus_peers.cc:597] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:15.447330 29421 consensus_peers.cc:597] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:15.468433 29421 consensus_peers.cc:597] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:15.487864 29421 consensus_peers.cc:597] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:15.504156 29495 consensus_peers.cc:597] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:15.506858 29495 consensus_peers.cc:597] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:15.538849 29421 consensus_peers.cc:597] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:15.560019 30121 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111) [suppressed 488 similar messages]
W20260709 13:15:15.578402 29495 consensus_peers.cc:597] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:15.613440 29421 consensus_peers.cc:597] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:15.640357 29495 consensus_peers.cc:597] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:15.641204 29495 consensus_peers.cc:597] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:15.649482 29495 consensus_peers.cc:597] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:15.676537 29495 consensus_peers.cc:597] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:15.802281 28234 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 29402)
W20260709 13:15:15.851259 29421 consensus_peers.cc:597] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:15.861886 29421 consensus_peers.cc:597] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:15.864336 29421 consensus_peers.cc:597] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:15.874265 29421 consensus_peers.cc:597] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:15.893272 29495 consensus_peers.cc:597] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:15.914079 29495 consensus_peers.cc:597] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:15.927896 29495 consensus_peers.cc:597] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:15.958721 29495 consensus_peers.cc:597] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:16.085137 29421 consensus_peers.cc:597] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:16.114903 29421 consensus_peers.cc:597] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:16.173162 29421 consensus_peers.cc:597] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:16.222126 29495 consensus_peers.cc:597] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:16.310436 29421 consensus_peers.cc:597] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:16.327168 29421 consensus_peers.cc:597] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:16.335665 29421 consensus_peers.cc:597] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:16.341482 29495 consensus_peers.cc:597] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:16.378258 29421 consensus_peers.cc:597] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:16.434815 30121 consensus_peers.cc:597] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:16.563058 29495 consensus_peers.cc:597] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:16.624863 30121 consensus_peers.cc:597] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:16.634160 29421 consensus_peers.cc:597] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:16.725708 29495 consensus_peers.cc:597] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:16.802888 28234 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 29402)
W20260709 13:15:16.874704 29421 consensus_peers.cc:597] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:16.943127 30121 consensus_peers.cc:597] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:17.100343 29495 consensus_peers.cc:597] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:17.187554 29421 consensus_peers.cc:597] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:15:17.192411 29421 consensus_peers.cc:597] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:17.256275 30121 consensus_peers.cc:597] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:17.303985 29495 consensus_peers.cc:597] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:17.307212 30121 consensus_peers.cc:597] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:17.361501 29421 consensus_peers.cc:597] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:17.379851 30121 consensus_peers.cc:597] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:17.405655 30121 consensus_peers.cc:597] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:17.430588 29495 consensus_peers.cc:597] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:17.635739 29421 consensus_peers.cc:597] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:17.639366 29421 consensus_peers.cc:597] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:17.736454 30121 consensus_peers.cc:597] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:17.767838 29421 consensus_peers.cc:597] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:17.792274 29421 consensus_peers.cc:597] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:17.804121 28234 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 29402)
W20260709 13:15:17.826359 30121 consensus_peers.cc:597] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:17.847231 29495 consensus_peers.cc:597] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:17.865801 29421 consensus_peers.cc:597] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:17.918915 29495 consensus_peers.cc:597] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:17.995234 29495 consensus_peers.cc:597] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:18.048893 29421 consensus_peers.cc:597] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:18.051589 29421 consensus_peers.cc:597] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:18.120821 29495 consensus_peers.cc:597] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:18.130205 29421 consensus_peers.cc:597] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:18.133255 29495 consensus_peers.cc:597] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:18.154990 29495 consensus_peers.cc:597] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:18.194047 29495 consensus_peers.cc:597] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:18.203034 29495 consensus_peers.cc:597] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:18.263861 29495 consensus_peers.cc:597] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:18.266234 29421 consensus_peers.cc:597] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:18.281086 29495 consensus_peers.cc:597] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:18.302645 29421 consensus_peers.cc:597] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:18.332340 29495 consensus_peers.cc:597] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:18.334733 29495 consensus_peers.cc:597] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:18.367810 29421 consensus_peers.cc:597] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:18.435283 29421 consensus_peers.cc:597] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:18.624305 29421 consensus_peers.cc:597] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:18.658627 29421 consensus_peers.cc:597] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:18.683610 29421 consensus_peers.cc:597] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:18.745667 30179 debug-util.cc:398] Leaking SignalData structure 0x7b080018c5a0 after lost signal to thread 28237
W20260709 13:15:18.747306 30179 debug-util.cc:398] Leaking SignalData structure 0x7b08003a5d80 after lost signal to thread 29313
W20260709 13:15:18.749243 30179 debug-util.cc:398] Leaking SignalData structure 0x7b0800396ac0 after lost signal to thread 29480
W20260709 13:15:18.750818 30179 debug-util.cc:398] Leaking SignalData structure 0x7b08002db1a0 after lost signal to thread 29554
W20260709 13:15:18.752456 30179 debug-util.cc:398] Leaking SignalData structure 0x7b080009a7a0 after lost signal to thread 30182
W20260709 13:15:18.804667 28234 thread.cc:527] Waited for 17000ms trying to join with diag-logger (tid 29402)
W20260709 13:15:18.832340 29421 consensus_peers.cc:597] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:18.852959 29421 consensus_peers.cc:597] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:18.883975 29421 consensus_peers.cc:597] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:18.912210 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 56870.9us
W20260709 13:15:18.926961 29495 consensus_peers.cc:597] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:18.934813 29495 consensus_peers.cc:597] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:18.992727 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 50804.4us
W20260709 13:15:19.015934 29495 consensus_peers.cc:597] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:19.106174 30121 consensus_peers.cc:597] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:19.112730 29495 consensus_peers.cc:597] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:19.156677 29421 consensus_peers.cc:597] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:19.375826 29421 consensus_peers.cc:597] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:19.395097 30121 consensus_peers.cc:597] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:19.484875 29421 consensus_peers.cc:597] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:19.503597 30121 consensus_peers.cc:597] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:19.653009 30121 consensus_peers.cc:597] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:19.739846 29495 consensus_peers.cc:597] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:19.747150 29421 consensus_peers.cc:597] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:19.755560 29421 consensus_peers.cc:597] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:19.769165 29421 consensus_peers.cc:597] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:15:19.793514 30121 consensus_peers.cc:597] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:19.805270 28234 thread.cc:527] Waited for 18000ms trying to join with diag-logger (tid 29402)
W20260709 13:15:19.870760 29495 consensus_peers.cc:597] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:19.890087 30121 consensus_peers.cc:597] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:19.944142 29421 consensus_peers.cc:597] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:19.974202 29495 consensus_peers.cc:597] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:20.145671 30121 consensus_peers.cc:597] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:20.149436 30121 consensus_peers.cc:597] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:20.212570 30121 consensus_peers.cc:597] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:20.282440 29421 consensus_peers.cc:597] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:20.454600 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 71250.9us
W20260709 13:15:20.552088 29421 consensus_peers.cc:597] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:20.563050 29421 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111) [suppressed 506 similar messages]
W20260709 13:15:20.565562 29495 consensus_peers.cc:597] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:20.566363 29421 consensus_peers.cc:597] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:20.575443 29419 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 87977.2us
W20260709 13:15:20.579896 29421 consensus_peers.cc:597] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:20.580544 29421 consensus_peers.cc:597] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:20.650660 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 75698.1us
W20260709 13:15:20.672093 29421 consensus_peers.cc:597] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:20.672832 29421 consensus_peers.cc:597] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:20.696535 29495 consensus_peers.cc:597] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:20.702340 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:40551, user_credentials={real_user=slave}} blocked reactor thread for 57576.3us
W20260709 13:15:20.702759 29495 consensus_peers.cc:597] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:20.704581 30119 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:35367, user_credentials={real_user=slave}} blocked reactor thread for 57716.2us
W20260709 13:15:20.767747 29421 consensus_peers.cc:597] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:20.768478 29421 consensus_peers.cc:597] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:20.806047 28234 thread.cc:527] Waited for 19000ms trying to join with diag-logger (tid 29402)
W20260709 13:15:20.827459 29495 consensus_peers.cc:597] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:20.828291 29495 consensus_peers.cc:597] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:20.828891 29495 consensus_peers.cc:597] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:20.971364 29421 consensus_peers.cc:597] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:21.011916 29421 consensus_peers.cc:597] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:21.033259 29495 consensus_peers.cc:597] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:21.037894 29495 consensus_peers.cc:597] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:21.057610 29265 catalog_manager.cc:4755] TS 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 5d440001d38e4a58becc5e57e767a12f: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:21.071151 29495 consensus_peers.cc:597] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:21.145629 29495 consensus_peers.cc:597] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:21.148465 29495 consensus_peers.cc:597] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:21.149071 29495 consensus_peers.cc:597] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:21.150483 29421 consensus_peers.cc:597] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:21.172009 29421 consensus_peers.cc:597] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:21.221052 29421 consensus_peers.cc:597] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:21.287142 29421 consensus_peers.cc:597] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:21.333247 29421 consensus_peers.cc:597] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:21.373028 29495 consensus_peers.cc:597] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:21.419329 30121 consensus_peers.cc:597] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:21.476485 29421 consensus_peers.cc:597] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:21.690984 29495 consensus_peers.cc:597] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:21.735350 29421 consensus_peers.cc:597] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:21.852370 29495 consensus_peers.cc:597] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:21.921959 29495 consensus_peers.cc:597] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:21.973114 30121 consensus_peers.cc:597] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:15:21.981637 29421 consensus_peers.cc:597] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:22.009477 30121 consensus_peers.cc:597] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:22.056169 29421 consensus_peers.cc:597] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:22.148626 29421 consensus_peers.cc:597] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:22.159878 30121 consensus_peers.cc:597] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:15:22.236076 29495 consensus_peers.cc:597] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:22.308439 29421 consensus_peers.cc:597] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:15:22.341935 30121 consensus_peers.cc:597] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:15:22.357734 30121 consensus_peers.cc:597] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:15:22.457787 30121 consensus_peers.cc:597] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:15:22.578395 29421 consensus_peers.cc:597] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:15:22.585230 29421 consensus_peers.cc:597] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:22.623318 30121 consensus_peers.cc:597] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:15:22.709834 29421 consensus_peers.cc:597] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:22.742462 30121 consensus_peers.cc:597] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:15:22.771004 29495 consensus_peers.cc:597] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:22.774704 29495 consensus_peers.cc:597] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:15:23.004468 28234 tablet_server.cc:196] TabletServer@127.27.146.129:0 shutdown complete.
W20260709 13:15:23.021512 29421 consensus_peers.cc:597] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:23.043584 29421 consensus_peers.cc:597] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:23.060509 29421 consensus_peers.cc:597] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:23.064426 29495 consensus_peers.cc:597] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:23.135537 29495 consensus_peers.cc:597] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:23.136168 29421 consensus_peers.cc:597] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:15:23.161298 29495 consensus_peers.cc:597] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:23.162020 29495 consensus_peers.cc:597] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:23.174780 29421 consensus_peers.cc:597] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:23.177980 29495 consensus_peers.cc:597] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:23.178278 29421 consensus_peers.cc:597] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:15:23.231843 29421 consensus_peers.cc:597] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:15:23.299001 29495 consensus_peers.cc:597] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:23.330776 29495 consensus_peers.cc:597] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:23.343025 29495 consensus_peers.cc:597] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:23.356539 29495 consensus_peers.cc:597] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:23.407996 29421 consensus_peers.cc:597] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:15:23.423136 29421 consensus_peers.cc:597] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:15:23.454357 29421 consensus_peers.cc:597] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:23.459744 29495 consensus_peers.cc:597] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:23.477658 29495 consensus_peers.cc:597] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:23.479383 29421 consensus_peers.cc:597] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:15:23.553366 29495 consensus_peers.cc:597] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:15:23.747330 28234 tablet_server.cc:179] TabletServer@127.27.146.130:0 shutting down...
W20260709 13:15:23.759418 29421 consensus_peers.cc:597] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:15:23.779731 29421 consensus_peers.cc:597] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:23.790674 29421 consensus_peers.cc:597] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:15:23.825496 29495 consensus_peers.cc:597] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:23.837800 30121 consensus_peers.cc:597] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:23.843834 29495 consensus_peers.cc:597] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:23.846839 29495 consensus_peers.cc:597] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:23.860714 30121 consensus_peers.cc:597] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:23.869553 29421 consensus_peers.cc:597] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:15:23.871429 29495 consensus_peers.cc:597] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:23.873955 29495 consensus_peers.cc:597] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:23.896342 30121 consensus_peers.cc:597] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:23.899660 29421 consensus_peers.cc:597] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:15:23.948021 30121 consensus_peers.cc:597] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:23.954891 29495 consensus_peers.cc:597] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:23.958011 29495 consensus_peers.cc:597] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:23.963341 29495 consensus_peers.cc:597] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:23.964178 29495 consensus_peers.cc:597] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:23.964886 29495 consensus_peers.cc:597] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:23.965533 29495 consensus_peers.cc:597] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:23.971531 29495 consensus_peers.cc:597] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:23.972291 29495 consensus_peers.cc:597] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:24.007146 28234 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:24.012832 28234 tablet_replica.cc:333] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.014362 28234 raft_consensus.cc:2243] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 22 LEADER]: Raft consensus shutting down.
W20260709 13:15:24.018944 29495 consensus_peers.cc:597] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:24.020871 28234 raft_consensus.cc:2272] T 2bc9dbd3a80e4fc79ffab716891c275b P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.024760 28234 tablet_replica.cc:333] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.025823 28234 raft_consensus.cc:2243] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.026517 28234 raft_consensus.cc:2272] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.029922 28234 tablet_replica.cc:333] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.030969 28234 raft_consensus.cc:2243] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.032122 28234 raft_consensus.cc:2272] T 954309d5d9c549439adda625fbaa6b96 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.035429 28234 tablet_replica.cc:333] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.036563 28234 raft_consensus.cc:2243] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Raft consensus shutting down.
W20260709 13:15:24.050336 29495 consensus_peers.cc:597] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:24.041646 28234 raft_consensus.cc:2272] T 7c4e4c7715074c3f984153e428f3a4f1 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:24.057061 30121 consensus_peers.cc:597] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:24.062198 29495 consensus_peers.cc:597] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:24.063807 28234 tablet_replica.cc:333] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.065248 28234 raft_consensus.cc:2243] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.066058 28234 raft_consensus.cc:2272] T 75d2e96638024243b35d8c06dcc28486 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.069310 28234 tablet_replica.cc:333] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.070410 28234 raft_consensus.cc:2243] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.071329 28234 raft_consensus.cc:2272] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.074894 28234 tablet_replica.cc:333] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.075914 28234 raft_consensus.cc:2243] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:15:24.077548 28234 raft_consensus.cc:2272] T 88a3c543fca4406fae61f154055aeb79 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.088380 28234 tablet_replica.cc:333] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.089521 28234 raft_consensus.cc:2243] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Raft consensus shutting down.
W20260709 13:15:24.090701 29495 consensus_peers.cc:597] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:24.091082 28234 raft_consensus.cc:2272] T 4cced75430d1485689f4eff61c816af0 P 183db85c071f489fbc8de63a9edd8a3a [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.094475 28234 tablet_replica.cc:333] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
W20260709 13:15:24.095425 29495 consensus_peers.cc:597] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:24.095446 28234 raft_consensus.cc:2243] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:15:24.097863 28234 raft_consensus.cc:2272] T f07124b3443042c0b07f5833ed54ce53 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.101109 28234 tablet_replica.cc:333] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.102242 28234 raft_consensus.cc:2243] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.102921 28234 raft_consensus.cc:2272] T 843654f7a60942bd9feee060ac9d2dfe P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.153822 28234 tablet_replica.cc:333] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
W20260709 13:15:24.160998 30121 consensus_peers.cc:597] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:24.179687 28234 raft_consensus.cc:2243] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Raft consensus shutting down.
W20260709 13:15:24.186173 30121 consensus_peers.cc:597] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:24.198382 29495 consensus_peers.cc:597] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:24.199420 29495 consensus_peers.cc:597] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:24.206584 29495 consensus_peers.cc:597] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:24.180805 28234 raft_consensus.cc:2272] T b3d43afcf4e94172a4b40f6c25261ea0 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.231563 28234 tablet_replica.cc:333] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
W20260709 13:15:24.267773 29421 consensus_peers.cc:597] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:15:24.270586 30121 consensus_peers.cc:597] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:24.237341 28234 raft_consensus.cc:2243] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.283049 28234 raft_consensus.cc:2272] T b5c4a6169e564566927a70e27f4af6f6 P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:24.284108 29421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 45326us
I20260709 13:15:24.286149 28234 tablet_replica.cc:333] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.291283 28234 raft_consensus.cc:2243] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.294955 28234 raft_consensus.cc:2272] T 5d440001d38e4a58becc5e57e767a12f P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.298103 28234 tablet_replica.cc:333] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.312330 28234 raft_consensus.cc:2243] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 20 LEADER]: Raft consensus shutting down.
W20260709 13:15:24.312844 29495 consensus_peers.cc:597] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:15:24.314262 28234 raft_consensus.cc:2272] T f645a08329404baabcc745299ee2efd3 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.320669 28234 tablet_replica.cc:333] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.321784 28234 raft_consensus.cc:2243] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.325205 28234 raft_consensus.cc:2272] T 4195dd8da2fa4e9a9a0f134c2d81f95a P 183db85c071f489fbc8de63a9edd8a3a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.329337 28234 tablet_replica.cc:333] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
W20260709 13:15:24.331537 29421 consensus_peers.cc:597] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:15:24.332966 28234 raft_consensus.cc:2243] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.335604 28234 raft_consensus.cc:2272] T 829dc08ee0ca4212a3b2c870b0ea1b35 P 183db85c071f489fbc8de63a9edd8a3a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.338806 28234 tablet_replica.cc:333] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.340346 28234 raft_consensus.cc:2243] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:15:24.341848 28234 raft_consensus.cc:2272] T 47da517282ee462792de545e40119636 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:24.338853 29495 consensus_peers.cc:597] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:24.356951 28234 tablet_replica.cc:333] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.357963 28234 raft_consensus.cc:2243] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 25 LEADER]: Raft consensus shutting down.
W20260709 13:15:24.360819 29495 consensus_peers.cc:597] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:24.361449 29495 consensus_peers.cc:597] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:15:24.370195 28234 raft_consensus.cc:2272] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.395718 28234 tablet_replica.cc:333] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.398957 28234 raft_consensus.cc:2243] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:15:24.407894 28234 raft_consensus.cc:2272] T cbdb7b3723ea4c6ea492ee857ca224d6 P 183db85c071f489fbc8de63a9edd8a3a [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.411111 28234 tablet_replica.cc:333] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.412132 28234 raft_consensus.cc:2243] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:15:24.413622 28234 raft_consensus.cc:2272] T 7184e7b71b434f6fa4689f1d12f276f2 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.417021 28234 tablet_replica.cc:333] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.418111 28234 raft_consensus.cc:2243] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.419706 28234 raft_consensus.cc:2272] T 8e9b44184de046118890bc6cd6e1dc18 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.424005 28234 tablet_replica.cc:333] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.425060 28234 raft_consensus.cc:2243] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.425911 28234 raft_consensus.cc:2272] T 3cece22da76441f5a3d309c5cb454c42 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.430219 28234 tablet_replica.cc:333] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.431116 28234 raft_consensus.cc:2243] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.431939 28234 raft_consensus.cc:2272] T 74cf9b558ac94704b5cb527efdc594ca P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.436192 28234 tablet_replica.cc:333] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.437232 28234 raft_consensus.cc:2243] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:15:24.438653 28234 raft_consensus.cc:2272] T f3ea78f0332644d3b941842ae07c5d95 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:24.441581 30121 consensus_peers.cc:597] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:15:24.443409 28234 tablet_replica.cc:333] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.444391 28234 raft_consensus.cc:2243] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:15:24.445684 28234 raft_consensus.cc:2272] T ab0baf9ea21a4fe78401601893e7ff66 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.448700 28234 tablet_replica.cc:333] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.449694 28234 raft_consensus.cc:2243] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.450387 28234 raft_consensus.cc:2272] T 4962756209e1496ca6cb92e47ee866b3 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:24.452320 29421 consensus_peers.cc:597] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:15:24.464951 28234 tablet_replica.cc:333] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.466241 28234 raft_consensus.cc:2243] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.467748 28234 raft_consensus.cc:2272] T eb6a9a102eba49209ddf2bdf286077e8 P 183db85c071f489fbc8de63a9edd8a3a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.470999 28234 tablet_replica.cc:333] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.473867 28234 raft_consensus.cc:2243] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.475133 28234 raft_consensus.cc:2272] T 1e3b77a777d14f819c6bc72128621f93 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.479739 28234 tablet_replica.cc:333] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.480675 28234 raft_consensus.cc:2243] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.481643 28234 raft_consensus.cc:2272] T f05e651bcfb64af6a9b5e97f9e40229f P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.494227 28234 tablet_replica.cc:333] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.495327 28234 raft_consensus.cc:2243] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:15:24.497164 28234 raft_consensus.cc:2272] T 86d17089efa841fb8a1c4bfae4950ef6 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:24.500861 29421 consensus_peers.cc:597] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:15:24.511181 28234 tablet_replica.cc:333] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.515933 28234 raft_consensus.cc:2243] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.520423 28234 raft_consensus.cc:2272] T f8f882eb054d4655a776901e6e22c617 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.534538 28234 tablet_replica.cc:333] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.538259 28234 raft_consensus.cc:2243] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:15:24.549993 28234 raft_consensus.cc:2272] T bf5703156380472bb793863fd4fd7544 P 183db85c071f489fbc8de63a9edd8a3a [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:24.546403 30121 consensus_peers.cc:597] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:15:24.578099 28234 tablet_replica.cc:333] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.582398 28234 raft_consensus.cc:2243] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 33 LEADER]: Raft consensus shutting down.
I20260709 13:15:24.584323 28234 raft_consensus.cc:2272] T dc82f5f689ca4adaa719b36a68dc3531 P 183db85c071f489fbc8de63a9edd8a3a [term 33 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.600890 28234 tablet_replica.cc:333] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.609747 28234 raft_consensus.cc:2243] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 18 LEADER]: Raft consensus shutting down.
W20260709 13:15:24.612914 30121 consensus_peers.cc:597] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:15:24.619837 28234 raft_consensus.cc:2272] T 93659d173b6a4dbe9938c612cc5f14e0 P 183db85c071f489fbc8de63a9edd8a3a [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.638310 28234 tablet_replica.cc:333] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.639935 28234 raft_consensus.cc:2243] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:15:24.641688 28234 raft_consensus.cc:2272] T eea24afe5d794a069e28297bbb74cf5a P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.647128 28234 tablet_replica.cc:333] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.648298 28234 raft_consensus.cc:2243] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 13:15:24.649231 29495 consensus_peers.cc:597] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:15:24.661521 28234 raft_consensus.cc:2272] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 183db85c071f489fbc8de63a9edd8a3a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.697618 28234 tablet_replica.cc:333] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.699648 28234 raft_consensus.cc:2243] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:15:24.703075 28234 raft_consensus.cc:2272] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.707367 28234 tablet_replica.cc:333] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.708890 28234 raft_consensus.cc:2243] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:15:24.710480 28234 raft_consensus.cc:2272] T 26f8335857fe499492a3115b9258c1a4 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.718183 28234 tablet_replica.cc:333] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.719264 28234 raft_consensus.cc:2243] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:15:24.721836 28234 raft_consensus.cc:2272] T d7c3c09667374b9aa86861c27221f6d3 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.725297 28234 tablet_replica.cc:333] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.727260 28234 raft_consensus.cc:2243] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.728413 28234 raft_consensus.cc:2272] T ee77cbd588da45af9d5274a642fd28a5 P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.732975 28234 tablet_replica.cc:333] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.734297 28234 raft_consensus.cc:2243] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.735134 28234 raft_consensus.cc:2272] T f5f9acbb73364212a42eaa5004f5aba9 P 183db85c071f489fbc8de63a9edd8a3a [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.742889 28234 tablet_replica.cc:333] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.744042 28234 raft_consensus.cc:2243] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:15:24.800249 28234 raft_consensus.cc:2272] T 6847a37cf6234a13a2fb53ac3cefaa64 P 183db85c071f489fbc8de63a9edd8a3a [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.804195 28234 tablet_replica.cc:333] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.806357 28234 raft_consensus.cc:2243] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:15:24.807777 28234 raft_consensus.cc:2272] T f06f688759cd438a95541a7639513cec P 183db85c071f489fbc8de63a9edd8a3a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.811975 28234 tablet_replica.cc:333] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.813042 28234 raft_consensus.cc:2243] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:15:24.814478 28234 raft_consensus.cc:2272] T 77157470a53245d7b1b307fba4d73aad P 183db85c071f489fbc8de63a9edd8a3a [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.818337 28234 tablet_replica.cc:333] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.819259 28234 raft_consensus.cc:2243] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:15:24.820859 28234 raft_consensus.cc:2272] T 3eb760d2a128422684c16e20d11a9e82 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.824913 28234 tablet_replica.cc:333] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.825776 28234 raft_consensus.cc:2243] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:15:24.827085 28234 raft_consensus.cc:2272] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 183db85c071f489fbc8de63a9edd8a3a [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.831063 28234 tablet_replica.cc:333] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.831936 28234 raft_consensus.cc:2243] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.832685 28234 raft_consensus.cc:2272] T f343c91124ea4cd5b19e26f3530e1247 P 183db85c071f489fbc8de63a9edd8a3a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.835853 28234 tablet_replica.cc:333] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.836712 28234 raft_consensus.cc:2243] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:15:24.838254 28234 raft_consensus.cc:2272] T b3604a2976f84b96882e8983ba5b3fd7 P 183db85c071f489fbc8de63a9edd8a3a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.842041 28234 tablet_replica.cc:333] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.842880 28234 raft_consensus.cc:2243] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.848393 28234 raft_consensus.cc:2272] T e66f47d21a0c4572ac5357c6cf623284 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.853581 28234 tablet_replica.cc:333] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.854616 28234 raft_consensus.cc:2243] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:15:24.856354 28234 raft_consensus.cc:2272] T ae9322ad5c2448f5bbe70c893b323d98 P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.860569  5067 raft_consensus.cc:493] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:15:24.861330  5067 raft_consensus.cc:515] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:24.860596 28234 tablet_replica.cc:333] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
W20260709 13:15:24.876700 30121 consensus_peers.cc:597] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:15:24.877629 29421 leader_election.cc:336] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:24.878347 28234 raft_consensus.cc:2243] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.881287 28234 raft_consensus.cc:2272] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 183db85c071f489fbc8de63a9edd8a3a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.895720 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0059c790a85426c96a8b0fe40c16532" candidate_uuid: "183db85c071f489fbc8de63a9edd8a3a" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:24.900007 28234 tablet_replica.cc:333] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.899832 29419 leader_election.cc:304] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 183db85c071f489fbc8de63a9edd8a3a; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:15:24.900882 28234 raft_consensus.cc:2243] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.901093  5070 raft_consensus.cc:2749] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:15:24.907924  5067 leader_election.cc:290] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:24.901648 28234 raft_consensus.cc:2272] T 40c0d06e6f284af29109e961ff953c5f P 183db85c071f489fbc8de63a9edd8a3a [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.926808 28234 tablet_replica.cc:333] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a: stopping tablet replica
I20260709 13:15:24.927681 28234 raft_consensus.cc:2243] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.928582 28234 raft_consensus.cc:2272] T f0059c790a85426c96a8b0fe40c16532 P 183db85c071f489fbc8de63a9edd8a3a [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:24.945912 30121 consensus_peers.cc:597] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:15:25.018074  5057 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:25.018910  5057 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:25.029189  5057 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:25.030963 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
W20260709 13:15:25.036028 30121 leader_election.cc:336] T f07124b3443042c0b07f5833ed54ce53 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:25.048133 30119 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 429e58eb058349e3bf72b5a870c8f6e5, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:15:25.050974  5057 raft_consensus.cc:2749] T f07124b3443042c0b07f5833ed54ce53 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:15:25.064988 30121 leader_election.cc:336] T f07124b3443042c0b07f5833ed54ce53 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:15:25.089075 30121 consensus_peers.cc:597] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:15:25.133622 30121 consensus_peers.cc:597] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:15:25.159569 30121 consensus_peers.cc:597] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:15:25.174449 29495 consensus_peers.cc:597] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:15:25.197381  5077 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:25.198102  5077 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:25.200640  5077 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:25.261209 29495 leader_election.cc:336] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
W20260709 13:15:25.272836 29495 leader_election.cc:336] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:25.273461 29495 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:25.276722  5076 raft_consensus.cc:2749] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:15:25.294858  5077 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:25.295549  5077 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:25.298032  5077 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:25.331187 29495 leader_election.cc:336] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:25.340822 29495 leader_election.cc:336] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:25.341434 29495 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:25.350142  5077 raft_consensus.cc:2749] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:15:25.369215 29495 consensus_peers.cc:597] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:15:25.383230  5065 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:25.384614  5065 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:25.397367  5065 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:15:25.398603 30151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:15:25.399399 30151 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 21.
I20260709 13:15:25.428265  5065 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:25.428941  5065 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:25.431325  5065 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:25.486545  5021 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:25.487207  5021 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:25.491425 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:25.494510  5072 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:25.495252  5072 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:25.498245  5072 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:15:25.498930 29530 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 25.
I20260709 13:15:25.499779  5021 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:15:25.491396 29495 leader_election.cc:336] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:25.503760 29495 consensus_peers.cc:597] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:15:25.505183 29495 leader_election.cc:336] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:25.505614 29495 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:25.506542  5065 raft_consensus.cc:2749] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:15:25.523114 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:15:25.523963 30157 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 25.
W20260709 13:15:25.526539 30121 leader_election.cc:336] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:25.527863 30121 leader_election.cc:336] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:25.528333 30121 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:25.530710  5021 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:15:25.537919 29495 leader_election.cc:336] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
W20260709 13:15:25.542193 29495 leader_election.cc:336] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:25.549367 29495 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:25.550805  5065 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:15:25.557906 29495 leader_election.cc:336] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:25.566181 29495 consensus_peers.cc:597] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:15:25.566820 29495 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111) [suppressed 584 similar messages]
W20260709 13:15:25.570735 29495 leader_election.cc:336] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:25.581481 29495 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:25.583408  5065 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:15:25.590337 29495 consensus_peers.cc:597] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:15:25.627298  5065 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:25.628031  5065 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:25.630784  5065 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:25.640450 29495 consensus_peers.cc:597] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:15:25.642199 29495 leader_election.cc:336] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
W20260709 13:15:25.656383 29495 leader_election.cc:336] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:25.657099 29495 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:25.667961  5065 raft_consensus.cc:2749] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:15:25.677372  5065 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:25.677981  5065 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:25.681362  5065 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:25.683445  5065 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:25.684371  5065 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:25.687773  5021 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:25.699682  5072 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:25.700676  5072 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:25.700644  5021 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:25.702881  5072 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:25.703016  5021 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:25.708992  5065 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:25.712888 29495 leader_election.cc:336] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:25.717057 29495 leader_election.cc:336] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:25.723752 29495 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:15:25.723974 30121 leader_election.cc:336] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:25.724808 30121 leader_election.cc:336] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:25.725250 30121 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:25.726034  5021 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:25.726878  5065 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:15:25.733063 29495 consensus_peers.cc:597] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:15:25.733723 29495 leader_election.cc:336] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:25.734277 29495 leader_election.cc:336] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:25.741570 29495 leader_election.cc:336] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:25.742421 29495 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:25.743707  5065 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:15:25.743731 29495 leader_election.cc:336] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:25.748703 29495 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:25.749917  5065 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:15:25.771822 29495 consensus_peers.cc:597] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:15:25.776439  5065 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 33 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:25.777107  5065 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:25.779626  5065 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:25.791589  5072 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:25.792197  5072 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:25.794586  5072 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:25.808586 29495 leader_election.cc:336] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:25.808750  5065 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:25.809787  5065 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:15:25.810689 29495 leader_election.cc:336] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:25.811221 29495 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:25.812175  5065 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:25.812387  5072 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
W20260709 13:15:25.844642 29495 leader_election.cc:336] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:25.844693 29268 maintenance_manager.cc:419] P 4fe079bd41744b15a21e1f8c8d83890b: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033355
I20260709 13:15:25.846879  5072 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:25.849514  5072 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:25.852355  5072 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:25.848984 29495 consensus_peers.cc:597] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:15:25.856729 29495 leader_election.cc:336] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:25.857872 29495 leader_election.cc:336] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:25.859854  5082 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:25.860651  5082 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:25.863667  5082 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:25.869261  5021 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:25.869957  5021 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:25.872053  5021 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:25.858777 29495 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:25.887730  5072 raft_consensus.cc:2749] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:15:25.889339 29495 leader_election.cc:336] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:25.889813 29495 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:25.890600  5072 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:15:25.900730 30121 leader_election.cc:336] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:25.901602 30121 leader_election.cc:336] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:25.902051 30121 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:25.903812  5021 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:15:25.904160 29495 leader_election.cc:336] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
W20260709 13:15:25.904882 29495 leader_election.cc:336] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
W20260709 13:15:25.905632 29495 leader_election.cc:336] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:25.905999 29495 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:25.912633  5082 raft_consensus.cc:2749] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:15:25.913935 29495 leader_election.cc:336] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:25.915426 29495 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:25.916265  5082 raft_consensus.cc:2749] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:15:25.943694  5082 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:25.944366  5082 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:25.947160  5082 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:25.952850 29267 maintenance_manager.cc:643] P 4fe079bd41744b15a21e1f8c8d83890b: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.103s	user 0.045s	sys 0.009s Metrics: {"bytes_written":8047,"delete_count":0,"lbm_write_time_us":1341,"lbm_writes_lt_1ms":7,"reinsert_count":0,"thread_start_us":11294,"threads_started":1,"update_count":329,"wal-append.queue_time_us":10913}
I20260709 13:15:25.964946 29268 maintenance_manager.cc:419] P 4fe079bd41744b15a21e1f8c8d83890b: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.393226
W20260709 13:15:25.968973 29495 leader_election.cc:336] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
W20260709 13:15:25.970124 29495 leader_election.cc:336] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:25.970482 29495 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:25.973466  5082 raft_consensus.cc:2749] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:15:25.973491  5065 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:25.974241  5065 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:25.978245  5065 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:15:25.984122  5065 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:25.984776  5065 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:25.986039 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:15:25.987046  5065 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:26.042059 29495 leader_election.cc:336] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:26.042624 29495 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, ca041dab9b2f44409ed7bf4c6cf66ab2
I20260709 13:15:26.050674  5065 raft_consensus.cc:2749] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:15:26.052537 29495 leader_election.cc:336] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
W20260709 13:15:26.054003 29495 leader_election.cc:336] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:26.054559 29495 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:26.055409  5065 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:15:26.056679 29495 consensus_peers.cc:597] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:15:26.057262 29495 consensus_peers.cc:597] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:15:26.069156 29495 consensus_peers.cc:597] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:26.104940  5021 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:26.105717  5021 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:26.107823  5021 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:26.109797 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:26.110589 29530 raft_consensus.cc:2468] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 10.
I20260709 13:15:26.112967  5082 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:26.113705 30119 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 
I20260709 13:15:26.113579  5082 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:26.115597  5057 raft_consensus.cc:2804] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:15:26.115764  5082 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:26.116060  5057 raft_consensus.cc:493] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:26.116321  5082 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:26.116451  5057 raft_consensus.cc:3060] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:15:26.116842  5082 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:26.119397  5082 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:26.133087 30121 leader_election.cc:336] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:26.139688  5082 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:26.147832  5082 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:15:26.144876 29495 consensus_peers.cc:597] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:15:26.164803  5082 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:26.166460  5057 raft_consensus.cc:515] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:15:26.179235 30121 consensus_peers.cc:597] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:26.185415  5057 leader_election.cc:290] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 11 election: Requested vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:26.186075 29530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77157470a53245d7b1b307fba4d73aad" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483"
I20260709 13:15:26.187005 29530 raft_consensus.cc:3060] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:15:26.189771 29495 leader_election.cc:336] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:26.190454 29495 leader_election.cc:336] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:26.194967  5072 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
W20260709 13:15:26.195231 30121 leader_election.cc:336] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:26.195658  5072 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:26.198303  5072 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:26.198601 29530 raft_consensus.cc:2468] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 11.
I20260709 13:15:26.199992 30119 leader_election.cc:304] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a
I20260709 13:15:26.200968  5021 raft_consensus.cc:2804] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:15:26.201476  5021 raft_consensus.cc:697] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 LEADER]: Becoming Leader. State: Replica: ca041dab9b2f44409ed7bf4c6cf66ab2, State: Running, Role: LEADER
I20260709 13:15:26.202378  5021 consensus_queue.cc:237] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:15:26.206142 29495 leader_election.cc:336] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:26.216981 29495 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:26.219156  5072 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:15:26.220485 29495 leader_election.cc:336] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:26.222443 29495 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:15:26.213352 30121 consensus_peers.cc:597] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:26.228111  5072 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:26.236943  5072 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:26.236224 29275 catalog_manager.cc:5697] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 reported cstate change: term changed from 10 to 11, leader changed from 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130) to ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132). New cstate: current_term: 11 leader_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:26.244804  5072 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:26.250579  5065 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:26.251235  5065 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:26.257503  5065 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:26.251943  5072 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:15:26.261147 29495 leader_election.cc:336] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
W20260709 13:15:26.263154 29495 consensus_peers.cc:597] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:26.272446 28234 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 29477)
W20260709 13:15:26.284726 29495 consensus_peers.cc:597] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:26.285447 29495 leader_election.cc:336] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:26.285895 29495 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:26.288965  5065 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:15:26.296198 29495 consensus_peers.cc:597] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:15:26.296855 29495 leader_election.cc:336] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:26.297699 29495 consensus_peers.cc:597] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:15:26.298532 29495 leader_election.cc:336] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:26.300066 29495 leader_election.cc:336] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:26.300472 29495 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:26.302502  5065 raft_consensus.cc:2749] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:15:26.302688 29495 consensus_peers.cc:597] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:26.303864 29495 leader_election.cc:336] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:26.304328 29495 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:26.305110  5072 raft_consensus.cc:2749] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:15:26.311414 29495 leader_election.cc:336] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:26.313302 29495 leader_election.cc:336] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:26.313835 29495 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:26.316871  5065 raft_consensus.cc:2749] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:15:26.317507 29495 consensus_peers.cc:597] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:26.324064 29495 consensus_peers.cc:597] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:26.325035 29495 consensus_peers.cc:597] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:26.413856 30121 consensus_peers.cc:597] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:15:26.437700 29267 maintenance_manager.cc:643] P 4fe079bd41744b15a21e1f8c8d83890b: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.472s	user 0.133s	sys 0.036s Metrics: {"cfile_cache_miss":10,"cfile_cache_miss_bytes":30086,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":2,"delta_iterators_relevant":2,"dirs.queue_time_us":26290,"dirs.run_cpu_time_us":835,"dirs.run_wall_time_us":1490,"lbm_read_time_us":2792,"lbm_reads_lt_1ms":26,"lbm_write_time_us":1995,"lbm_writes_lt_1ms":12,"peak_mem_usage":593587,"reinsert_count":0,"thread_start_us":32400,"threads_started":2,"update_count":358}
I20260709 13:15:26.442479 29268 maintenance_manager.cc:419] P 4fe079bd41744b15a21e1f8c8d83890b: Scheduling MinorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.002000
I20260709 13:15:26.445214 29267 maintenance_manager.cc:643] P 4fe079bd41744b15a21e1f8c8d83890b: MinorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {}
W20260709 13:15:26.447520 29495 consensus_peers.cc:597] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:26.450417 29495 consensus_peers.cc:597] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:26.452278 30121 consensus_peers.cc:597] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:26.508766 29495 consensus_peers.cc:597] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:26.537660 29495 consensus_peers.cc:597] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:26.543138 29495 consensus_peers.cc:597] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:26.546450 30121 consensus_peers.cc:597] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:26.553267 29495 consensus_peers.cc:597] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:26.570251 29495 consensus_peers.cc:597] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:26.570828 29495 consensus_peers.cc:597] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:26.575978 29495 consensus_peers.cc:597] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:26.615252 30121 consensus_peers.cc:597] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:26.625918 29530 raft_consensus.cc:1275] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Refusing update from remote peer ca041dab9b2f44409ed7bf4c6cf66ab2: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:15:26.628186  5021 consensus_queue.cc:1048] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:15:26.641389 29495 consensus_peers.cc:597] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:26.659992 29495 consensus_peers.cc:597] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:26.690284 29495 consensus_peers.cc:597] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:26.737249 29495 consensus_peers.cc:597] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:26.753993 29495 consensus_peers.cc:597] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:26.775007 30121 consensus_peers.cc:597] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:26.823410 29495 consensus_peers.cc:597] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:26.839840 30121 consensus_peers.cc:597] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:26.858117  5065 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:26.858799  5065 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:26.861167  5065 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:26.869884 30121 consensus_peers.cc:597] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:26.874539 29495 leader_election.cc:336] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:26.877347 29495 leader_election.cc:336] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:26.877863 29495 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:26.878727  5065 raft_consensus.cc:2749] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:15:26.887573 29495 consensus_peers.cc:597] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:15:26.956934 30121 consensus_peers.cc:597] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:15:26.976276 29495 consensus_peers.cc:597] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:27.058494 30121 consensus_peers.cc:597] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:15:27.092760  5071 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:27.093456  5071 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:27.096459  5071 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:27.097896 29524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:27.098742 29524 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 25.
W20260709 13:15:27.097115 30121 consensus_peers.cc:597] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:15:27.111100 30121 leader_election.cc:336] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:27.130244 30121 leader_election.cc:336] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:27.132982 30121 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:27.137899  5065 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:27.138765  5065 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:27.139678  5021 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:15:27.141227  5065 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:27.152354 30121 consensus_peers.cc:597] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:15:27.175925 29495 leader_election.cc:336] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:27.178663 29495 leader_election.cc:336] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
W20260709 13:15:27.182653 30121 consensus_peers.cc:597] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:15:27.183207 29495 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:27.185869  5065 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:15:27.197494 29495 consensus_peers.cc:597] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:15:27.204568  5065 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:27.205832  5065 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:27.209204  5065 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:15:27.210741 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:15:27.211583 30157 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 21.
W20260709 13:15:27.234016 29495 leader_election.cc:336] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:27.235368 29495 leader_election.cc:336] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:27.235895 29495 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:27.237102  5065 raft_consensus.cc:2749] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:15:27.273034 28234 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 29477)
W20260709 13:15:27.331406 29495 consensus_peers.cc:597] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:15:27.384414  5093 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:27.385104  5093 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:27.406081  5093 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:27.413599  5093 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:27.414225  5093 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:27.416574  5093 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:27.428000 29495 leader_election.cc:336] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
W20260709 13:15:27.432502 29495 leader_election.cc:336] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:27.439745 29495 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:27.440881  5093 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:15:27.446676 29495 leader_election.cc:336] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
W20260709 13:15:27.450407 29495 leader_election.cc:336] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:27.450965 29495 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:27.451848  5093 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:15:27.536141  5093 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:27.536756  5093 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:27.538982  5093 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:27.572551 29495 leader_election.cc:336] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:27.590669 30121 consensus_peers.cc:597] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:15:27.591688 29495 leader_election.cc:336] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:27.594167 29495 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:27.595290  5093 raft_consensus.cc:2749] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:15:27.624668  5093 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:27.625480  5093 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:27.628005  5093 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:27.628719  5057 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:27.629297  5057 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:27.631292  5057 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:27.657950 30121 leader_election.cc:336] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
W20260709 13:15:27.659940 30121 leader_election.cc:336] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:27.665789 30121 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:27.666719  5057 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:15:27.668591  5093 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:27.669251  5093 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:27.671958  5093 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:27.686124  5057 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:27.686820  5057 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:27.695858  5057 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:27.702147 29495 leader_election.cc:336] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:27.717089 29495 leader_election.cc:336] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:27.717749 29495 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:27.726294  5093 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:15:27.739678 30121 consensus_peers.cc:597] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:15:27.741353 30121 leader_election.cc:336] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:27.742301 30121 leader_election.cc:336] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:27.743571 30121 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:27.744411  5057 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:15:27.748404 29495 leader_election.cc:336] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:27.750056 30121 consensus_peers.cc:597] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:15:27.754129  5072 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 33 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:27.755025  5072 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:27.758045  5072 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:27.772938 29495 leader_election.cc:336] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:27.773715 29495 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:27.777132  5072 raft_consensus.cc:2749] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:15:27.777841  5072 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:27.778316  5072 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:27.782982  5072 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:27.812853  5072 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:27.813717  5072 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:27.815994  5072 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:27.816215 29495 consensus_peers.cc:597] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:15:27.828433 29495 leader_election.cc:336] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:27.831208  5094 raft_consensus.cc:493] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:27.831939  5094 raft_consensus.cc:515] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:27.834345  5094 leader_election.cc:290] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:27.836269 29495 leader_election.cc:336] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:27.836789 29495 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:15:27.839212 29495 leader_election.cc:336] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
W20260709 13:15:27.840294 29495 leader_election.cc:336] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:27.840672 29495 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:27.841409  5072 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 13:15:27.841881  5094 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:15:27.857168  5094 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:27.857877  5094 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:27.860551  5094 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:27.862512 29495 leader_election.cc:336] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:27.867691 29495 leader_election.cc:336] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:27.868290 29495 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:27.869176  5072 raft_consensus.cc:2749] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:15:27.882195 29495 leader_election.cc:336] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:27.885244 29495 leader_election.cc:336] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:27.885821 29495 leader_election.cc:304] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:27.886772  5072 raft_consensus.cc:2749] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:15:27.891371 29495 leader_election.cc:336] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:27.893922 29495 leader_election.cc:336] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:27.894433 29495 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:27.895323  5072 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:15:27.909852  5072 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:27.910617  5072 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:27.916230  5072 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:27.917040 29495 consensus_peers.cc:597] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:15:27.924134 29495 leader_election.cc:336] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:27.927532 29495 leader_election.cc:336] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:27.928092  5072 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:27.938256  5072 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:27.941466  5072 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:27.942638 29495 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:27.943595  5072 raft_consensus.cc:2749] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:15:27.945012 29495 consensus_peers.cc:597] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:15:27.952247 29495 leader_election.cc:336] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
W20260709 13:15:27.953068 29495 leader_election.cc:336] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:27.953522 29495 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:27.965888  5072 raft_consensus.cc:2749] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:15:27.989156 29495 consensus_peers.cc:597] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:15:28.009171  5072 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:28.009859  5072 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:28.012456  5072 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:28.021347 29495 leader_election.cc:336] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:28.028345 29495 leader_election.cc:336] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:28.028945 29495 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:28.039740  5072 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:15:28.042270 29495 consensus_peers.cc:597] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:15:28.055717 29495 consensus_peers.cc:597] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:15:28.060716  5095 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:28.061501  5095 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:28.074085  5095 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:28.076290 29495 leader_election.cc:336] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:28.080706 29495 leader_election.cc:336] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:28.081238 29495 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:28.083009  5093 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:15:28.129921 29495 consensus_peers.cc:597] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:15:28.186686  5095 raft_consensus.cc:493] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:28.187453  5095 raft_consensus.cc:515] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:28.190032  5095 leader_election.cc:290] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:28.199395 29495 leader_election.cc:336] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:28.201877 29495 leader_election.cc:336] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:28.202406 29495 leader_election.cc:304] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:28.203361  5095 raft_consensus.cc:2749] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:15:28.270695 29495 consensus_peers.cc:597] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:15:28.273576 28234 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 29477)
I20260709 13:15:28.326817  5093 raft_consensus.cc:493] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:28.327575  5093 raft_consensus.cc:515] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:28.329993  5093 leader_election.cc:290] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:28.348413 29495 leader_election.cc:336] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:28.355214 29495 leader_election.cc:336] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:28.355926 29495 leader_election.cc:304] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:28.356899  5095 raft_consensus.cc:2749] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:15:28.363693 29495 consensus_peers.cc:597] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:15:28.402612  5093 raft_consensus.cc:493] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:28.403406  5093 raft_consensus.cc:515] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:28.405809  5093 leader_election.cc:290] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:28.407177 29495 consensus_peers.cc:597] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:15:28.424860 29495 leader_election.cc:336] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:28.426172 29495 leader_election.cc:336] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:28.426716 29495 leader_election.cc:304] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:28.427717  5093 raft_consensus.cc:2749] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:15:28.441051 29495 consensus_peers.cc:597] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:28.445434 29495 consensus_peers.cc:597] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:15:28.522751 29495 consensus_peers.cc:597] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:15:28.528324  5095 raft_consensus.cc:493] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:28.529058  5095 raft_consensus.cc:515] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:28.531661  5095 leader_election.cc:290] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:28.539142 29495 leader_election.cc:336] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:28.540170 29495 leader_election.cc:336] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:28.540727 29495 leader_election.cc:304] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:28.541738  5095 raft_consensus.cc:2749] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:15:28.581276 30121 consensus_peers.cc:597] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:28.671370 29495 consensus_peers.cc:597] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:28.693584 29495 consensus_peers.cc:597] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:28.784796 29495 consensus_peers.cc:597] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:15:28.816267 29495 consensus_peers.cc:597] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:28.825031 29495 consensus_peers.cc:597] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:15:28.853909 29495 consensus_peers.cc:597] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:28.855051 29495 consensus_peers.cc:597] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:28.864684 30121 consensus_peers.cc:597] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:28.890543 29495 consensus_peers.cc:597] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:15:28.907150 30121 consensus_peers.cc:597] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:28.924389 29495 consensus_peers.cc:597] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:15:28.943152 29495 consensus_peers.cc:597] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:29.011631 29495 consensus_peers.cc:597] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:29.057161 29495 consensus_peers.cc:597] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:29.065258 30121 consensus_peers.cc:597] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:15:29.076964 29495 consensus_peers.cc:597] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:29.118830 29495 consensus_peers.cc:597] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:29.119598 29495 consensus_peers.cc:597] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:29.132623 30121 consensus_peers.cc:597] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:29.218838 30121 consensus_peers.cc:597] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:29.278710  5093 raft_consensus.cc:493] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:29.279426  5093 raft_consensus.cc:515] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:29.282297  5093 leader_election.cc:290] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:29.302812 29495 consensus_peers.cc:597] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:29.308553 29495 consensus_peers.cc:597] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:29.309252 29495 consensus_peers.cc:597] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:29.315820 29495 consensus_peers.cc:597] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:29.316711 29495 leader_election.cc:336] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
W20260709 13:15:29.329471 29495 leader_election.cc:336] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:29.330175 29495 leader_election.cc:304] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:29.331341  5093 raft_consensus.cc:2749] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:15:29.332119 29495 consensus_peers.cc:597] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:29.346939 29495 consensus_peers.cc:597] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:29.365875 29495 consensus_peers.cc:597] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:29.371464 30121 consensus_peers.cc:597] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:15:29.395748  5097 raft_consensus.cc:493] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:29.398783  5093 raft_consensus.cc:493] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:29.399431  5093 raft_consensus.cc:515] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:29.403571  5093 leader_election.cc:290] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:29.397116  5097 raft_consensus.cc:515] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:29.406404  5097 leader_election.cc:290] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:29.412827 29495 leader_election.cc:336] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:29.414764 29495 leader_election.cc:336] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:29.415294 29495 leader_election.cc:304] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:29.416188  5097 raft_consensus.cc:2749] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:15:29.416391 29495 leader_election.cc:336] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
W20260709 13:15:29.420461 29495 leader_election.cc:336] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:29.421047 29495 leader_election.cc:304] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:29.422066  5093 raft_consensus.cc:2749] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:15:29.438091 29495 consensus_peers.cc:597] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:15:29.471148  5093 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:29.471776  5093 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:15:29.473564 29495 consensus_peers.cc:597] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:15:29.479882 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f07124b3443042c0b07f5833ed54ce53" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:15:29.480712 30157 raft_consensus.cc:2468] T f07124b3443042c0b07f5833ed54ce53 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 21.
I20260709 13:15:29.480763  5093 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:15:29.488051  5093 raft_consensus.cc:493] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 33 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:29.488790  5093 raft_consensus.cc:515] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:29.491312  5093 leader_election.cc:290] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:29.492630 29495 leader_election.cc:336] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:29.493562 29495 leader_election.cc:336] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:29.494058 29495 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:29.494907  5093 raft_consensus.cc:2749] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:15:29.505019 30121 consensus_peers.cc:597] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:15:29.505450 29495 leader_election.cc:336] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:29.506400 29495 leader_election.cc:336] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:29.506855 29495 leader_election.cc:304] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:29.507709  5093 raft_consensus.cc:2749] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
I20260709 13:15:29.545136  5057 raft_consensus.cc:493] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:29.545804  5057 raft_consensus.cc:515] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:29.547881  5057 leader_election.cc:290] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:29.558161 30121 leader_election.cc:336] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:29.559166 30121 leader_election.cc:336] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:29.559676 30121 leader_election.cc:304] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:29.560997  5057 raft_consensus.cc:2749] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:15:29.566269  5057 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:29.566954  5057 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:29.569497  5057 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:29.582073 30121 leader_election.cc:336] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:29.583694 30121 leader_election.cc:336] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:29.584345 30121 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:29.585529  5057 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:15:29.588982 29495 consensus_peers.cc:597] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:15:29.600188  5097 raft_consensus.cc:493] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:29.600891  5097 raft_consensus.cc:515] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:29.603245  5097 leader_election.cc:290] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:29.616056 30121 consensus_peers.cc:597] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:15:29.619257 29495 consensus_peers.cc:597] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:15:29.619915 29495 leader_election.cc:336] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:29.621021 29495 leader_election.cc:336] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:29.621433 29495 leader_election.cc:304] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:29.623793  5097 raft_consensus.cc:2749] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:15:29.627336  5093 raft_consensus.cc:493] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:29.627924  5093 raft_consensus.cc:515] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:29.630040  5093 leader_election.cc:290] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:29.663800  5021 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:29.664856  5021 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:15:29.747860 30121 leader_election.cc:336] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
W20260709 13:15:29.749367 30121 leader_election.cc:336] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:29.749924 30121 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:29.751364  5057 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:15:29.812005  5021 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:30.031602  5100 raft_consensus.cc:493] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:30.033610  5100 raft_consensus.cc:515] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:30.040577  5100 leader_election.cc:290] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:30.050899  5104 raft_consensus.cc:493] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:30.051192  5100 raft_consensus.cc:493] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
W20260709 13:15:29.639070 29495 leader_election.cc:336] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:30.051653  5104 raft_consensus.cc:515] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:30.051851  5100 raft_consensus.cc:515] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:15:30.052368 29495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 413318us
W20260709 13:15:30.053512 29495 leader_election.cc:336] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:30.053953 29495 leader_election.cc:304] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:30.054173  5104 leader_election.cc:290] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:30.054986  5100 leader_election.cc:290] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), ca041dab9b2f44409ed7bf4c6cf66ab2 (127.27.146.132:44671)
I20260709 13:15:30.056423 28234 tablet_server.cc:196] TabletServer@127.27.146.130:0 shutdown complete.
I20260709 13:15:30.062208  5102 raft_consensus.cc:2749] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:15:30.087149 30121 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:42127, user_credentials={real_user=slave}} blocked reactor thread for 337768us
W20260709 13:15:30.120293 30121 consensus_peers.cc:597] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:15:30.122862 30121 consensus_peers.cc:597] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:15:30.124152 30121 consensus_peers.cc:597] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:15:30.126201 30121 consensus_peers.cc:597] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:15:30.149389  5099 raft_consensus.cc:493] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:30.152592  5099 raft_consensus.cc:515] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:30.156868  5099 leader_election.cc:290] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:30.160300 30121 consensus_peers.cc:597] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:15:30.163892 30121 consensus_peers.cc:597] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:15:30.164525 30121 consensus_peers.cc:597] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:15:30.165041 30121 consensus_peers.cc:597] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 13:15:30.173636 29521 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "71aa3578fd924765ab9ac0729c8d1483" is_pre_election: true
I20260709 13:15:30.174544 29521 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca041dab9b2f44409ed7bf4c6cf66ab2 in term 25.
I20260709 13:15:30.176542 30157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84bd3c1c6a8b4dd19afbdd78dae37427" candidate_uuid: "71aa3578fd924765ab9ac0729c8d1483" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" is_pre_election: true
I20260709 13:15:30.177225 30157 raft_consensus.cc:2468] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71aa3578fd924765ab9ac0729c8d1483 in term 25.
W20260709 13:15:30.196235 29495 leader_election.cc:336] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:30.197881 29495 leader_election.cc:336] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:30.198397 29495 leader_election.cc:336] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:30.199514 29495 consensus_peers.cc:597] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:15:30.204129  5106 raft_consensus.cc:493] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:30.204838  5106 raft_consensus.cc:515] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:30.206686  5099 raft_consensus.cc:493] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:30.207595  5106 leader_election.cc:290] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:30.207253  5099 raft_consensus.cc:515] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:30.210441  5099 leader_election.cc:290] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:30.223281 29495 leader_election.cc:336] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
W20260709 13:15:30.224495 29495 leader_election.cc:336] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:30.224931 29495 leader_election.cc:304] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
W20260709 13:15:30.226320 29495 leader_election.cc:336] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:30.226805 29495 leader_election.cc:304] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:30.227685  5099 raft_consensus.cc:2749] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:15:30.228505  5099 raft_consensus.cc:2749] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:15:30.229869 29495 leader_election.cc:336] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:30.230346 29495 leader_election.cc:304] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483, ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:30.231287  5105 raft_consensus.cc:2749] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:15:30.240006 29495 leader_election.cc:336] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:30.240655 29495 leader_election.cc:336] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:30.241575 29495 leader_election.cc:336] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:30.242039 29495 leader_election.cc:304] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:30.243055  5105 raft_consensus.cc:2749] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:15:30.243619 29551 debug-util.cc:398] Leaking SignalData structure 0x7b080010eca0 after lost signal to thread 28237
W20260709 13:15:30.245122 29551 debug-util.cc:398] Leaking SignalData structure 0x7b080030ddc0 after lost signal to thread 29313
W20260709 13:15:30.246407 29495 leader_election.cc:336] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
W20260709 13:15:30.246762 29551 debug-util.cc:398] Leaking SignalData structure 0x7b080026a2c0 after lost signal to thread 29554
I20260709 13:15:30.246896 29495 leader_election.cc:304] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:30.247746  5105 raft_consensus.cc:2749] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:15:30.248422 29551 debug-util.cc:398] Leaking SignalData structure 0x7b0800241560 after lost signal to thread 30182
W20260709 13:15:30.248960 29495 leader_election.cc:336] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:30.249451 29495 leader_election.cc:304] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:30.250273  5105 raft_consensus.cc:2749] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:15:30.252038  5105 raft_consensus.cc:493] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:30.252543  5105 raft_consensus.cc:515] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:30.255067  5105 leader_election.cc:290] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:30.267017 29495 leader_election.cc:336] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:30.267328  5105 raft_consensus.cc:493] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
W20260709 13:15:30.267876 29495 leader_election.cc:336] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:30.267936  5105 raft_consensus.cc:515] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:30.268414 29495 leader_election.cc:304] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:30.270485  5105 leader_election.cc:290] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
I20260709 13:15:30.269964  5099 raft_consensus.cc:2749] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:15:30.300791  5099 raft_consensus.cc:493] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:30.301462  5099 raft_consensus.cc:515] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
W20260709 13:15:30.303450 29495 leader_election.cc:336] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:30.303870  5099 leader_election.cc:290] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:30.312397 29495 leader_election.cc:336] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:30.313001 29495 leader_election.cc:304] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:30.313889  5099 raft_consensus.cc:2749] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:15:30.317524 29495 leader_election.cc:336] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
W20260709 13:15:30.318248 29495 leader_election.cc:336] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:30.318693 29495 leader_election.cc:304] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:30.319516  5099 raft_consensus.cc:2749] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:15:30.320474  5099 raft_consensus.cc:493] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:30.321082  5099 raft_consensus.cc:515] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } }
I20260709 13:15:30.323624  5099 leader_election.cc:290] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:30.334421 29495 leader_election.cc:336] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:30.335201 29495 leader_election.cc:336] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:30.335812 29495 leader_election.cc:304] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71aa3578fd924765ab9ac0729c8d1483; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:30.336650  5099 raft_consensus.cc:2749] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:15:30.368656 28234 tablet_server.cc:179] TabletServer@127.27.146.131:0 shutting down...
I20260709 13:15:30.451721 28234 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:30.452893 28234 tablet_replica.cc:333] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.453925 28234 raft_consensus.cc:2243] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:30.455036 28234 raft_consensus.cc:2272] T 2bc9dbd3a80e4fc79ffab716891c275b P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.460130 28234 tablet_replica.cc:333] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.461344 28234 raft_consensus.cc:2243] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:15:30.462913 28234 raft_consensus.cc:2272] T f352c5b8ac3f411ba5fc4901bc7e66a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.470944 28234 tablet_replica.cc:333] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.471870 28234 raft_consensus.cc:2243] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:15:30.473076 28234 raft_consensus.cc:2272] T 75d2e96638024243b35d8c06dcc28486 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.475574 28234 tablet_replica.cc:333] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.476200 28234 raft_consensus.cc:2243] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:15:30.477351 28234 raft_consensus.cc:2272] T 7c4e4c7715074c3f984153e428f3a4f1 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.479878 28234 tablet_replica.cc:333] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.480463 28234 raft_consensus.cc:2243] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:15:30.482044 28234 raft_consensus.cc:2272] T b3d43afcf4e94172a4b40f6c25261ea0 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.486553 28234 tablet_replica.cc:333] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.487813 28234 raft_consensus.cc:2243] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:30.488756 28234 raft_consensus.cc:2272] T eb6a9a102eba49209ddf2bdf286077e8 P 71aa3578fd924765ab9ac0729c8d1483 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.492861 28234 tablet_replica.cc:333] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.494020 28234 raft_consensus.cc:2243] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:15:30.495571 28234 raft_consensus.cc:2272] T 954309d5d9c549439adda625fbaa6b96 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:30.567155 29495 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111) [suppressed 652 similar messages]
I20260709 13:15:30.588047 28234 tablet_replica.cc:333] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.590816 28234 raft_consensus.cc:2243] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:30.593781 28234 raft_consensus.cc:2272] T 88a3c543fca4406fae61f154055aeb79 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.599529 28234 tablet_replica.cc:333] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.605417 28234 raft_consensus.cc:2243] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:30.607743 28234 raft_consensus.cc:2272] T 4cced75430d1485689f4eff61c816af0 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.612862 28234 tablet_replica.cc:333] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.614884 28234 raft_consensus.cc:2243] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:15:30.621806 28234 raft_consensus.cc:2272] T 843654f7a60942bd9feee060ac9d2dfe P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.626338 28234 tablet_replica.cc:333] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.628693 28234 raft_consensus.cc:2243] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 13:15:30.633224 29495 consensus_peers.cc:597] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:15:30.633970 29495 consensus_peers.cc:597] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:15:30.634090 28234 raft_consensus.cc:2272] T f07124b3443042c0b07f5833ed54ce53 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:30.641498 30119 consensus_peers.cc:597] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Couldn't send request to peer 71aa3578fd924765ab9ac0729c8d1483. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:30.641081 28234 tablet_replica.cc:333] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
W20260709 13:15:30.642210 30119 consensus_peers.cc:597] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Couldn't send request to peer 71aa3578fd924765ab9ac0729c8d1483. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:30.642900 30119 consensus_peers.cc:597] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Couldn't send request to peer 71aa3578fd924765ab9ac0729c8d1483. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:30.643615 28234 raft_consensus.cc:2243] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 LEADER]: Raft consensus shutting down.
W20260709 13:15:30.645498 29495 consensus_peers.cc:597] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:15:30.646291 28234 raft_consensus.cc:2272] T 4962756209e1496ca6cb92e47ee866b3 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.651631 28234 tablet_replica.cc:333] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.652557 28234 raft_consensus.cc:2243] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Raft consensus shutting down.
W20260709 13:15:30.656878 30119 consensus_peers.cc:597] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Couldn't send request to peer 71aa3578fd924765ab9ac0729c8d1483. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:30.658248 30119 consensus_peers.cc:597] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Couldn't send request to peer 71aa3578fd924765ab9ac0729c8d1483. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:30.663803 30119 consensus_peers.cc:597] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Couldn't send request to peer 71aa3578fd924765ab9ac0729c8d1483. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:30.669514 30119 consensus_peers.cc:597] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Couldn't send request to peer 71aa3578fd924765ab9ac0729c8d1483. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:30.670261 30119 consensus_peers.cc:597] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Couldn't send request to peer 71aa3578fd924765ab9ac0729c8d1483. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:30.671767 29495 consensus_peers.cc:597] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:15:30.674237 28234 raft_consensus.cc:2272] T 84bd3c1c6a8b4dd19afbdd78dae37427 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.678066 28234 tablet_replica.cc:333] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.680311 28234 raft_consensus.cc:2243] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:30.681504 28234 raft_consensus.cc:2272] T cbdb7b3723ea4c6ea492ee857ca224d6 P 71aa3578fd924765ab9ac0729c8d1483 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.688010 28234 tablet_replica.cc:333] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.689340 28234 raft_consensus.cc:2243] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:30.691200 28234 raft_consensus.cc:2272] T 47da517282ee462792de545e40119636 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.695391 28234 tablet_replica.cc:333] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
W20260709 13:15:30.696273 30119 consensus_peers.cc:597] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Couldn't send request to peer 71aa3578fd924765ab9ac0729c8d1483. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:30.697124 28234 raft_consensus.cc:2243] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:30.699906 28234 raft_consensus.cc:2272] T 132eb7648165463b83338075a7b2e683 P 71aa3578fd924765ab9ac0729c8d1483 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.703832 28234 tablet_replica.cc:333] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.705207 28234 raft_consensus.cc:2243] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:30.706364 28234 raft_consensus.cc:2272] T f645a08329404baabcc745299ee2efd3 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:30.708218 30119 consensus_peers.cc:597] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Couldn't send request to peer 71aa3578fd924765ab9ac0729c8d1483. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:30.710669 28234 tablet_replica.cc:333] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.712553 28234 raft_consensus.cc:2243] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:30.713893 28234 raft_consensus.cc:2272] T 7184e7b71b434f6fa4689f1d12f276f2 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:30.719288 30119 consensus_peers.cc:597] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Couldn't send request to peer 71aa3578fd924765ab9ac0729c8d1483. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:30.724650 28234 tablet_replica.cc:333] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.725987 28234 raft_consensus.cc:2243] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:15:30.728358 28234 raft_consensus.cc:2272] T 3cece22da76441f5a3d309c5cb454c42 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.731803 28234 tablet_replica.cc:333] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.732796 28234 raft_consensus.cc:2243] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:15:30.734493 28234 raft_consensus.cc:2272] T 74cf9b558ac94704b5cb527efdc594ca P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.737095 28234 tablet_replica.cc:333] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.737908 28234 raft_consensus.cc:2243] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:30.738870 28234 raft_consensus.cc:2272] T f3ea78f0332644d3b941842ae07c5d95 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.741945 28234 tablet_replica.cc:333] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.743281 28234 raft_consensus.cc:2243] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:30.744323 28234 raft_consensus.cc:2272] T ab0baf9ea21a4fe78401601893e7ff66 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.748006 28234 tablet_replica.cc:333] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.750090 28234 raft_consensus.cc:2243] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 33 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:30.752543 28234 raft_consensus.cc:2272] T dc82f5f689ca4adaa719b36a68dc3531 P 71aa3578fd924765ab9ac0729c8d1483 [term 33 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.757004 28234 tablet_replica.cc:333] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.757963 28234 raft_consensus.cc:2243] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:30.759829 28234 raft_consensus.cc:2272] T 93659d173b6a4dbe9938c612cc5f14e0 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.764022 28234 tablet_replica.cc:333] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.765373 28234 raft_consensus.cc:2243] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:30.769271 28234 raft_consensus.cc:2272] T 66ee3283bb6d4ef28061d053b1bde164 P 71aa3578fd924765ab9ac0729c8d1483 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.773211 28234 tablet_replica.cc:333] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.774273 28234 raft_consensus.cc:2243] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:30.775712 28234 raft_consensus.cc:2272] T f06f688759cd438a95541a7639513cec P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.779655 28234 tablet_replica.cc:333] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.780790 28234 raft_consensus.cc:2243] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:30.782486 28234 raft_consensus.cc:2272] T 86d17089efa841fb8a1c4bfae4950ef6 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.787189 28234 tablet_replica.cc:333] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.788286 28234 raft_consensus.cc:2243] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:15:30.790130 28234 raft_consensus.cc:2272] T f8f882eb054d4655a776901e6e22c617 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.793727 28234 tablet_replica.cc:333] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.794983 28234 raft_consensus.cc:2243] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:30.798418 28234 raft_consensus.cc:2272] T c2aced39aead4259aa7f2a9995ec3ea5 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.802515 28234 tablet_replica.cc:333] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.803673 28234 raft_consensus.cc:2243] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:30.805274 28234 raft_consensus.cc:2272] T eea24afe5d794a069e28297bbb74cf5a P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.809204 28234 tablet_replica.cc:333] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.810286 28234 raft_consensus.cc:2243] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:30.811447 28234 raft_consensus.cc:2272] T abd2ad92265844ca9eb9012eb76e7789 P 71aa3578fd924765ab9ac0729c8d1483 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.815465 28234 tablet_replica.cc:333] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.816493 28234 raft_consensus.cc:2243] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:15:30.818209 28234 raft_consensus.cc:2272] T c7f35dbd870d4883ac2ca7cf62f3cd06 P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.822808 28234 tablet_replica.cc:333] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.823823 28234 raft_consensus.cc:2243] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:30.825021 28234 raft_consensus.cc:2272] T 26f8335857fe499492a3115b9258c1a4 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.829062 28234 tablet_replica.cc:333] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.829948 28234 raft_consensus.cc:2243] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:30.830986 28234 raft_consensus.cc:2272] T 9890585c37da4d4fb7b4a3bfa21d48d7 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.835026 28234 tablet_replica.cc:333] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.835966 28234 raft_consensus.cc:2243] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:15:30.837872 28234 raft_consensus.cc:2272] T 1e3b77a777d14f819c6bc72128621f93 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.842417 28234 tablet_replica.cc:333] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.843341 28234 raft_consensus.cc:2243] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:15:30.845032 28234 raft_consensus.cc:2272] T f05e651bcfb64af6a9b5e97f9e40229f P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.848817 28234 tablet_replica.cc:333] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.849716 28234 raft_consensus.cc:2243] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:15:30.851477 28234 raft_consensus.cc:2272] T f5f9acbb73364212a42eaa5004f5aba9 P 71aa3578fd924765ab9ac0729c8d1483 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.855455 28234 tablet_replica.cc:333] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.856510 28234 raft_consensus.cc:2243] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:30.858353 28234 raft_consensus.cc:2272] T 6b7b1911380a4f0e9a8d9584662a3dce P 71aa3578fd924765ab9ac0729c8d1483 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.862246 28234 tablet_replica.cc:333] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.863322 28234 raft_consensus.cc:2243] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:30.864831 28234 raft_consensus.cc:2272] T 6847a37cf6234a13a2fb53ac3cefaa64 P 71aa3578fd924765ab9ac0729c8d1483 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.868690 28234 tablet_replica.cc:333] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.869697 28234 raft_consensus.cc:2243] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:15:30.871753 28234 raft_consensus.cc:2272] T f343c91124ea4cd5b19e26f3530e1247 P 71aa3578fd924765ab9ac0729c8d1483 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.875361 28234 tablet_replica.cc:333] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.876302 28234 raft_consensus.cc:2243] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:30.877200 28234 raft_consensus.cc:2272] T b3604a2976f84b96882e8983ba5b3fd7 P 71aa3578fd924765ab9ac0729c8d1483 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.880352 28234 tablet_replica.cc:333] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.881182 28234 raft_consensus.cc:2243] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:15:30.882797 28234 raft_consensus.cc:2272] T e66f47d21a0c4572ac5357c6cf623284 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.886066 28234 tablet_replica.cc:333] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.887091 28234 raft_consensus.cc:2243] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:30.888077 28234 raft_consensus.cc:2272] T 77157470a53245d7b1b307fba4d73aad P 71aa3578fd924765ab9ac0729c8d1483 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.892086 28234 tablet_replica.cc:333] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.892967 28234 raft_consensus.cc:2243] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Raft consensus shutting down.
W20260709 13:15:30.893746 29310 debug-util.cc:398] Leaking SignalData structure 0x7b0800175820 after lost signal to thread 28237
I20260709 13:15:30.893926 28234 raft_consensus.cc:2272] T b0e9dda7e26f4762beef2df7e4b8b8b2 P 71aa3578fd924765ab9ac0729c8d1483 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:30.896095 29310 debug-util.cc:398] Leaking SignalData structure 0x7b0800341460 after lost signal to thread 29313
I20260709 13:15:30.897763 28234 tablet_replica.cc:333] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.898770 28234 raft_consensus.cc:2243] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Raft consensus shutting down.
W20260709 13:15:30.898779 29310 debug-util.cc:398] Leaking SignalData structure 0x7b0800110f80 after lost signal to thread 29554
W20260709 13:15:30.901659 29310 debug-util.cc:398] Leaking SignalData structure 0x7b08000be6c0 after lost signal to thread 30182
I20260709 13:15:30.901798 28234 raft_consensus.cc:2272] T 40c0d06e6f284af29109e961ff953c5f P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.905732 28234 tablet_replica.cc:333] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.906622 28234 raft_consensus.cc:2243] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:30.907624 28234 raft_consensus.cc:2272] T d7c3c09667374b9aa86861c27221f6d3 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.910831 28234 tablet_replica.cc:333] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.911746 28234 raft_consensus.cc:2243] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:15:30.913579 28234 raft_consensus.cc:2272] T ee77cbd588da45af9d5274a642fd28a5 P 71aa3578fd924765ab9ac0729c8d1483 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.917505 28234 tablet_replica.cc:333] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.918397 28234 raft_consensus.cc:2243] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:15:30.920360 28234 raft_consensus.cc:2272] T f0059c790a85426c96a8b0fe40c16532 P 71aa3578fd924765ab9ac0729c8d1483 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.923655 28234 tablet_replica.cc:333] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.924526 28234 raft_consensus.cc:2243] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:15:30.926131 28234 raft_consensus.cc:2272] T 74a1f9233b9e4fcb989ab4963d6a7ad1 P 71aa3578fd924765ab9ac0729c8d1483 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:30.927013 28239 debug-util.cc:398] Leaking SignalData structure 0x7b080000f320 after lost signal to thread 30121
I20260709 13:15:30.931149 28234 tablet_replica.cc:333] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.932109 28234 raft_consensus.cc:2243] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:30.934767 28234 raft_consensus.cc:2272] T 95122b0f733946aba19edf1d98467467 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.938333 28234 tablet_replica.cc:333] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.939216 28234 raft_consensus.cc:2243] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:15:30.941329 28234 raft_consensus.cc:2272] T 5a13b0d97aec4ead9f25e62f8dcb36cf P 71aa3578fd924765ab9ac0729c8d1483 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.944756 28234 tablet_replica.cc:333] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.945575 28234 raft_consensus.cc:2243] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:15:30.947178 28234 raft_consensus.cc:2272] T 5d440001d38e4a58becc5e57e767a12f P 71aa3578fd924765ab9ac0729c8d1483 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.950665 28234 tablet_replica.cc:333] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.951385 28234 raft_consensus.cc:2243] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:30.952337 28234 raft_consensus.cc:2272] T b5c4a6169e564566927a70e27f4af6f6 P 71aa3578fd924765ab9ac0729c8d1483 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:30.955364 28234 tablet_replica.cc:333] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483: stopping tablet replica
I20260709 13:15:30.956107 28234 raft_consensus.cc:2243] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:30.957317 28234 raft_consensus.cc:2272] T ae9322ad5c2448f5bbe70c893b323d98 P 71aa3578fd924765ab9ac0729c8d1483 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:31.088814 29493 connection.cc:466] server connection from 127.0.0.1:53428 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53428 (request call id 2232) could send its response
W20260709 13:15:31.091383 28234 connection.cc:466] server connection from 127.0.0.1:53428 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53428 (request call id 2231) could send its response
W20260709 13:15:31.094815 30119 connection.cc:769] client connection to 127.27.146.131:35367 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 13:15:31.138445 30121 consensus_peers.cc:597] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:15:31.399324  5098 raft_consensus.cc:493] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:31.400195  5098 raft_consensus.cc:515] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:31.404070  5098 leader_election.cc:290] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551)
W20260709 13:15:31.414494 30121 leader_election.cc:336] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:31.415369 30121 leader_election.cc:336] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:31.415843 30121 leader_election.cc:304] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:31.416729  5098 raft_consensus.cc:2749] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:15:31.431419 30121 consensus_peers.cc:597] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:31.441041 30121 consensus_peers.cc:597] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:31.537925 30121 consensus_peers.cc:597] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:15:31.682958  5098 raft_consensus.cc:493] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:15:31.683866  5098 raft_consensus.cc:515] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
I20260709 13:15:31.686583  5098 leader_election.cc:290] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:15:31.697789 30119 leader_election.cc:336] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Network error: Client connection negotiation failed: client connection to 127.27.146.131:35367: connect: Connection refused (error 111)
W20260709 13:15:31.714530 30121 consensus_peers.cc:597] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:31.715137 30121 leader_election.cc:336] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:31.715844 30121 leader_election.cc:304] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:15:31.716861  5098 raft_consensus.cc:2749] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:15:31.718262 30121 consensus_peers.cc:597] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:15:31.833076  5098 raft_consensus.cc:493] T f07124b3443042c0b07f5833ed54ce53 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 183db85c071f489fbc8de63a9edd8a3a)
I20260709 13:15:31.833954  5098 raft_consensus.cc:515] T f07124b3443042c0b07f5833ed54ce53 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "429e58eb058349e3bf72b5a870c8f6e5" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 42127 } } peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } attrs { replace: true } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:15:31.852592 30121 leader_election.cc:336] T f07124b3443042c0b07f5833ed54ce53 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
W20260709 13:15:31.853394 30121 leader_election.cc:336] T f07124b3443042c0b07f5833ed54ce53 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:31.853792 30121 leader_election.cc:304] T f07124b3443042c0b07f5833ed54ce53 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 429e58eb058349e3bf72b5a870c8f6e5
I20260709 13:15:31.855468  5098 leader_election.cc:290] T f07124b3443042c0b07f5833ed54ce53 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127), 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
I20260709 13:15:31.857177  5098 raft_consensus.cc:2749] T f07124b3443042c0b07f5833ed54ce53 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:15:31.865043 30119 leader_election.cc:336] T f07124b3443042c0b07f5833ed54ce53 P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Network error: Client connection negotiation failed: client connection to 127.27.146.131:35367: connect: Connection refused (error 111)
W20260709 13:15:31.940596 30121 consensus_peers.cc:597] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:15:31.952440 30121 consensus_peers.cc:597] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:15:32.083976  5113 raft_consensus.cc:493] T 5d440001d38e4a58becc5e57e767a12f P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 71aa3578fd924765ab9ac0729c8d1483)
I20260709 13:15:32.084843  5113 raft_consensus.cc:515] T 5d440001d38e4a58becc5e57e767a12f P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "183db85c071f489fbc8de63a9edd8a3a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 40551 } } peers { permanent_uuid: "71aa3578fd924765ab9ac0729c8d1483" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 35367 } } peers { permanent_uuid: "ca041dab9b2f44409ed7bf4c6cf66ab2" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 44671 } attrs { promote: false } }
W20260709 13:15:32.093978 30119 leader_election.cc:336] T 5d440001d38e4a58becc5e57e767a12f P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Network error: Client connection negotiation failed: client connection to 127.27.146.131:35367: connect: Connection refused (error 111)
I20260709 13:15:32.095278  5113 leader_election.cc:290] T 5d440001d38e4a58becc5e57e767a12f P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551), 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367)
W20260709 13:15:32.103927 30121 leader_election.cc:336] T 5d440001d38e4a58becc5e57e767a12f P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111)
I20260709 13:15:32.104812 30121 leader_election.cc:304] T 5d440001d38e4a58becc5e57e767a12f P ca041dab9b2f44409ed7bf4c6cf66ab2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca041dab9b2f44409ed7bf4c6cf66ab2; no voters: 183db85c071f489fbc8de63a9edd8a3a, 71aa3578fd924765ab9ac0729c8d1483
I20260709 13:15:32.105731  5113 raft_consensus.cc:2749] T 5d440001d38e4a58becc5e57e767a12f P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:15:32.242852 30121 consensus_peers.cc:597] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:32.290413 30121 consensus_peers.cc:597] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:15:32.459682 30121 consensus_peers.cc:597] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:15:32.472587 30121 consensus_peers.cc:597] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:15:32.497462 30121 consensus_peers.cc:597] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:15:32.499691 30121 consensus_peers.cc:597] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 183db85c071f489fbc8de63a9edd8a3a (127.27.146.130:40551): Couldn't send request to peer 183db85c071f489fbc8de63a9edd8a3a. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:40551: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:15:32.559528 30121 consensus_peers.cc:597] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:15:32.610476 30121 consensus_peers.cc:597] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:15:32.661631 30121 consensus_peers.cc:597] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): Couldn't send request to peer 429e58eb058349e3bf72b5a870c8f6e5. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:15:32.958794 30119 consensus_peers.cc:597] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Couldn't send request to peer 71aa3578fd924765ab9ac0729c8d1483. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.131:35367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:32.962823 28234 tablet_server.cc:196] TabletServer@127.27.146.131:0 shutdown complete.
W20260709 13:15:32.974047 30119 consensus_peers.cc:597] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Couldn't send request to peer 71aa3578fd924765ab9ac0729c8d1483. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.131:35367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:32.982722 30119 consensus_peers.cc:597] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Couldn't send request to peer 71aa3578fd924765ab9ac0729c8d1483. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.131:35367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:32.996994 30119 consensus_peers.cc:597] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Couldn't send request to peer 71aa3578fd924765ab9ac0729c8d1483. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.131:35367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:33.026620 30119 consensus_peers.cc:597] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Couldn't send request to peer 71aa3578fd924765ab9ac0729c8d1483. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.131:35367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:33.104522 28234 tablet_server.cc:179] TabletServer@127.27.146.132:0 shutting down...
W20260709 13:15:33.130842 30119 consensus_peers.cc:597] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Couldn't send request to peer 71aa3578fd924765ab9ac0729c8d1483. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.131:35367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:33.134689 30119 consensus_peers.cc:597] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Couldn't send request to peer 71aa3578fd924765ab9ac0729c8d1483. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.131:35367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:33.164341 28234 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:33.165632 28234 tablet_replica.cc:333] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2: stopping tablet replica
I20260709 13:15:33.166990 28234 raft_consensus.cc:2243] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:33.167865 28234 raft_consensus.cc:2272] T f352c5b8ac3f411ba5fc4901bc7e66a5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:33.172163 28234 tablet_replica.cc:333] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2: stopping tablet replica
I20260709 13:15:33.173336 28234 raft_consensus.cc:2243] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:15:33.175154 28234 raft_consensus.cc:2272] T 66ee3283bb6d4ef28061d053b1bde164 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:33.179049 28234 tablet_replica.cc:333] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2: stopping tablet replica
I20260709 13:15:33.180027 28234 raft_consensus.cc:2243] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:15:33.181456 28234 raft_consensus.cc:2272] T 829dc08ee0ca4212a3b2c870b0ea1b35 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:33.185423 28234 tablet_replica.cc:333] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2: stopping tablet replica
I20260709 13:15:33.186327 28234 raft_consensus.cc:2243] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:15:33.187719 28234 raft_consensus.cc:2272] T 95122b0f733946aba19edf1d98467467 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:33.191215 28234 tablet_replica.cc:333] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2: stopping tablet replica
I20260709 13:15:33.192126 28234 raft_consensus.cc:2243] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:15:33.193497 28234 raft_consensus.cc:2272] T b5c4a6169e564566927a70e27f4af6f6 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:33.196692 28234 tablet_replica.cc:333] T f07124b3443042c0b07f5833ed54ce53 P ca041dab9b2f44409ed7bf4c6cf66ab2: stopping tablet replica
I20260709 13:15:33.197556 28234 raft_consensus.cc:2243] T f07124b3443042c0b07f5833ed54ce53 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:33.198519 28234 raft_consensus.cc:2272] T f07124b3443042c0b07f5833ed54ce53 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:33.202200 28234 tablet_replica.cc:333] T 5d440001d38e4a58becc5e57e767a12f P ca041dab9b2f44409ed7bf4c6cf66ab2: stopping tablet replica
I20260709 13:15:33.203130 28234 raft_consensus.cc:2243] T 5d440001d38e4a58becc5e57e767a12f P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:33.204269 28234 raft_consensus.cc:2272] T 5d440001d38e4a58becc5e57e767a12f P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:33.208102 28234 tablet_replica.cc:333] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2: stopping tablet replica
I20260709 13:15:33.209035 28234 raft_consensus.cc:2243] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:15:33.210436 28234 raft_consensus.cc:2272] T 4cced75430d1485689f4eff61c816af0 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:33.213804 28234 tablet_replica.cc:333] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2: stopping tablet replica
I20260709 13:15:33.214682 28234 raft_consensus.cc:2243] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:15:33.216040 28234 raft_consensus.cc:2272] T abd2ad92265844ca9eb9012eb76e7789 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:33.219344 28234 tablet_replica.cc:333] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2: stopping tablet replica
I20260709 13:15:33.220146 28234 raft_consensus.cc:2243] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:15:33.221356 28234 raft_consensus.cc:2272] T 6b7b1911380a4f0e9a8d9584662a3dce P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:33.224646 28234 tablet_replica.cc:333] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2: stopping tablet replica
I20260709 13:15:33.225528 28234 raft_consensus.cc:2243] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:15:33.226822 28234 raft_consensus.cc:2272] T 8e9b44184de046118890bc6cd6e1dc18 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:33.230142 28234 tablet_replica.cc:333] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2: stopping tablet replica
I20260709 13:15:33.231014 28234 raft_consensus.cc:2243] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:33.232059 28234 raft_consensus.cc:2272] T 84bd3c1c6a8b4dd19afbdd78dae37427 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:33.233245 30119 consensus_peers.cc:597] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Couldn't send request to peer 71aa3578fd924765ab9ac0729c8d1483. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.131:35367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:33.233830 30119 consensus_peers.cc:597] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 -> Peer 71aa3578fd924765ab9ac0729c8d1483 (127.27.146.131:35367): Couldn't send request to peer 71aa3578fd924765ab9ac0729c8d1483. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.131:35367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:33.235755 28234 tablet_replica.cc:333] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2: stopping tablet replica
I20260709 13:15:33.236621 28234 raft_consensus.cc:2243] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:15:33.237923 28234 raft_consensus.cc:2272] T 4195dd8da2fa4e9a9a0f134c2d81f95a P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:33.241123 28234 tablet_replica.cc:333] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2: stopping tablet replica
I20260709 13:15:33.242036 28234 raft_consensus.cc:2243] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:33.242738 28234 raft_consensus.cc:2272] T 3eb760d2a128422684c16e20d11a9e82 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:33.246984 28234 tablet_replica.cc:333] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2: stopping tablet replica
I20260709 13:15:33.247864 28234 raft_consensus.cc:2243] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:15:33.249240 28234 raft_consensus.cc:2272] T eb6a9a102eba49209ddf2bdf286077e8 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:33.252517 28234 tablet_replica.cc:333] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2: stopping tablet replica
I20260709 13:15:33.253314 28234 raft_consensus.cc:2243] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:15:33.254558 28234 raft_consensus.cc:2272] T 77157470a53245d7b1b307fba4d73aad P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:33.257496 28234 tablet_replica.cc:333] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2: stopping tablet replica
I20260709 13:15:33.258347 28234 raft_consensus.cc:2243] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:15:33.259732 28234 raft_consensus.cc:2272] T 40c0d06e6f284af29109e961ff953c5f P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:33.263689 28234 tablet_replica.cc:333] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2: stopping tablet replica
I20260709 13:15:33.264523 28234 raft_consensus.cc:2243] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:33.265208 28234 raft_consensus.cc:2272] T bf5703156380472bb793863fd4fd7544 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:33.268410 28234 tablet_replica.cc:333] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2: stopping tablet replica
I20260709 13:15:33.269174 28234 raft_consensus.cc:2243] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:15:33.270860 28234 raft_consensus.cc:2272] T c2aced39aead4259aa7f2a9995ec3ea5 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:33.274592 28234 tablet_replica.cc:333] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2: stopping tablet replica
I20260709 13:15:33.275319 28234 raft_consensus.cc:2243] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:15:33.276549 28234 raft_consensus.cc:2272] T 132eb7648165463b83338075a7b2e683 P ca041dab9b2f44409ed7bf4c6cf66ab2 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:33.518043 28234 tablet_server.cc:196] TabletServer@127.27.146.132:0 shutdown complete.
I20260709 13:15:33.577263 28234 master.cc:562] Master@127.27.146.190:37499 shutting down...
W20260709 13:15:33.626734 29327 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:15:33.627214 29327 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:15:33.627481 29327 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:15:37.493384 29265 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111) [suppressed 195 similar messages]
W20260709 13:15:37.497061 29265 catalog_manager.cc:4755] TS 429e58eb058349e3bf72b5a870c8f6e5 (127.27.146.129:42127): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 5d440001d38e4a58becc5e57e767a12f: Network error: Client connection negotiation failed: client connection to 127.27.146.129:42127: connect: Connection refused (error 111)
I20260709 13:15:38.117841 28234 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:38.118713 28234 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:38.119122 28234 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4fe079bd41744b15a21e1f8c8d83890b: stopping tablet replica
I20260709 13:15:38.321322 28234 master.cc:584] Master@127.27.146.190:37499 shutdown complete.
I20260709 13:15:38.373008 28234 test_util.cc:182] -----------------------------------------------
I20260709 13:15:38.373275 28234 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602648606606-28234-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (263971 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:15:38.377368 28234 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.27.146.190:43479
I20260709 13:15:38.378700 28234 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:38.385546  5120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:38.385712  5119 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:38.386478  5122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:38.388299 28234 server_base.cc:1061] running on GCE node
I20260709 13:15:38.392431 28234 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:38.392683 28234 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:38.392804 28234 hybrid_clock.cc:648] HybridClock initialized: now 1783602938392791 us; error 0 us; skew 500 ppm
I20260709 13:15:38.393458 28234 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:38.396533 28234 webserver.cc:533] Webserver started at http://127.27.146.190:36001/ using document root <none> and password file <none>
I20260709 13:15:38.397043 28234 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:38.397223 28234 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:38.397483 28234 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:38.398912 28234 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602648606606-28234-0/minicluster-data/master-0-root/instance:
uuid: "dd92c4932f4e45ca9198ce72bd2b2a95"
format_stamp: "Formatted at 2026-07-09 13:15:38 on dist-test-slave-clfv"
I20260709 13:15:38.404690 28234 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:15:38.408838  5127 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:38.409878 28234 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:15:38.410528 28234 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602648606606-28234-0/minicluster-data/master-0-root
uuid: "dd92c4932f4e45ca9198ce72bd2b2a95"
format_stamp: "Formatted at 2026-07-09 13:15:38 on dist-test-slave-clfv"
I20260709 13:15:38.410907 28234 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602648606606-28234-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602648606606-28234-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602648606606-28234-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:38.452067 28234 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:38.453755 28234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:38.506419 28234 rpc_server.cc:307] RPC server started. Bound to: 127.27.146.190:43479
I20260709 13:15:38.506508  5178 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.146.190:43479 every 8 connection(s)
I20260709 13:15:38.511703  5179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:38.523299  5179 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd92c4932f4e45ca9198ce72bd2b2a95: Bootstrap starting.
I20260709 13:15:38.528599  5179 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dd92c4932f4e45ca9198ce72bd2b2a95: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.533496  5179 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd92c4932f4e45ca9198ce72bd2b2a95: No bootstrap required, opened a new log
I20260709 13:15:38.535813  5179 raft_consensus.cc:359] T 00000000000000000000000000000000 P dd92c4932f4e45ca9198ce72bd2b2a95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd92c4932f4e45ca9198ce72bd2b2a95" member_type: VOTER }
I20260709 13:15:38.536202  5179 raft_consensus.cc:385] T 00000000000000000000000000000000 P dd92c4932f4e45ca9198ce72bd2b2a95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.536406  5179 raft_consensus.cc:740] T 00000000000000000000000000000000 P dd92c4932f4e45ca9198ce72bd2b2a95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd92c4932f4e45ca9198ce72bd2b2a95, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.536943  5179 consensus_queue.cc:260] T 00000000000000000000000000000000 P dd92c4932f4e45ca9198ce72bd2b2a95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd92c4932f4e45ca9198ce72bd2b2a95" member_type: VOTER }
I20260709 13:15:38.537403  5179 raft_consensus.cc:399] T 00000000000000000000000000000000 P dd92c4932f4e45ca9198ce72bd2b2a95 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:15:38.537604  5179 raft_consensus.cc:493] T 00000000000000000000000000000000 P dd92c4932f4e45ca9198ce72bd2b2a95 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:15:38.537809  5179 raft_consensus.cc:3060] T 00000000000000000000000000000000 P dd92c4932f4e45ca9198ce72bd2b2a95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.542547  5179 raft_consensus.cc:515] T 00000000000000000000000000000000 P dd92c4932f4e45ca9198ce72bd2b2a95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd92c4932f4e45ca9198ce72bd2b2a95" member_type: VOTER }
I20260709 13:15:38.543030  5179 leader_election.cc:304] T 00000000000000000000000000000000 P dd92c4932f4e45ca9198ce72bd2b2a95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dd92c4932f4e45ca9198ce72bd2b2a95; no voters: 
I20260709 13:15:38.544358  5179 leader_election.cc:290] T 00000000000000000000000000000000 P dd92c4932f4e45ca9198ce72bd2b2a95 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:15:38.545081  5182 raft_consensus.cc:2804] T 00000000000000000000000000000000 P dd92c4932f4e45ca9198ce72bd2b2a95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:38.547274  5182 raft_consensus.cc:697] T 00000000000000000000000000000000 P dd92c4932f4e45ca9198ce72bd2b2a95 [term 1 LEADER]: Becoming Leader. State: Replica: dd92c4932f4e45ca9198ce72bd2b2a95, State: Running, Role: LEADER
I20260709 13:15:38.548192  5179 sys_catalog.cc:565] T 00000000000000000000000000000000 P dd92c4932f4e45ca9198ce72bd2b2a95 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:15:38.548208  5182 consensus_queue.cc:237] T 00000000000000000000000000000000 P dd92c4932f4e45ca9198ce72bd2b2a95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd92c4932f4e45ca9198ce72bd2b2a95" member_type: VOTER }
I20260709 13:15:38.556099  5183 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd92c4932f4e45ca9198ce72bd2b2a95 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dd92c4932f4e45ca9198ce72bd2b2a95" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd92c4932f4e45ca9198ce72bd2b2a95" member_type: VOTER } }
I20260709 13:15:38.556310  5184 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd92c4932f4e45ca9198ce72bd2b2a95 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dd92c4932f4e45ca9198ce72bd2b2a95. Latest consensus state: current_term: 1 leader_uuid: "dd92c4932f4e45ca9198ce72bd2b2a95" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd92c4932f4e45ca9198ce72bd2b2a95" member_type: VOTER } }
I20260709 13:15:38.557134  5183 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd92c4932f4e45ca9198ce72bd2b2a95 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:38.557325  5184 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd92c4932f4e45ca9198ce72bd2b2a95 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:38.560797  5190 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:15:38.568235  5190 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:15:38.570849 28234 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:15:38.579667  5190 catalog_manager.cc:1383] Generated new cluster ID: ce88d1116a3442e8ac0fcaca6e3c0831
I20260709 13:15:38.580117  5190 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:15:38.599469  5190 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:15:38.601193  5190 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:15:38.620851  5190 catalog_manager.cc:6070] T 00000000000000000000000000000000 P dd92c4932f4e45ca9198ce72bd2b2a95: Generated new TSK 0
I20260709 13:15:38.621630  5190 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:15:38.638800 28234 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:38.646956  5200 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:38.648571  5201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:38.651044  5203 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:38.653481 28234 server_base.cc:1061] running on GCE node
I20260709 13:15:38.656826 28234 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:38.657100 28234 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:38.657245 28234 hybrid_clock.cc:648] HybridClock initialized: now 1783602938657225 us; error 0 us; skew 500 ppm
I20260709 13:15:38.657809 28234 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:38.660982 28234 webserver.cc:533] Webserver started at http://127.27.146.129:38789/ using document root <none> and password file <none>
I20260709 13:15:38.661504 28234 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:38.661676 28234 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:38.661933 28234 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:38.663594 28234 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602648606606-28234-0/minicluster-data/ts-0-root/instance:
uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
format_stamp: "Formatted at 2026-07-09 13:15:38 on dist-test-slave-clfv"
I20260709 13:15:38.669621 28234 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:15:38.674767  5208 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:38.676098 28234 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
I20260709 13:15:38.676729 28234 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602648606606-28234-0/minicluster-data/ts-0-root
uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
format_stamp: "Formatted at 2026-07-09 13:15:38 on dist-test-slave-clfv"
I20260709 13:15:38.677109 28234 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602648606606-28234-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602648606606-28234-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602648606606-28234-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:38.703809 28234 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:38.705453 28234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:38.707476 28234 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:38.710897 28234 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:38.711119 28234 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:38.711344 28234 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:38.711608 28234 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.001s
I20260709 13:15:38.774920 28234 rpc_server.cc:307] RPC server started. Bound to: 127.27.146.129:41357
I20260709 13:15:38.775045  5270 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.146.129:41357 every 8 connection(s)
I20260709 13:15:38.781045 28234 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:38.790738  5275 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:38.792299  5276 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:38.796430 28234 server_base.cc:1061] running on GCE node
W20260709 13:15:38.796694  5278 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:38.800141 28234 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:38.800484 28234 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:38.800767 28234 hybrid_clock.cc:648] HybridClock initialized: now 1783602938800745 us; error 0 us; skew 500 ppm
I20260709 13:15:38.801812 28234 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:38.804358  5271 heartbeater.cc:344] Connected to a master server at 127.27.146.190:43479
I20260709 13:15:38.804792  5271 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:38.805696  5271 heartbeater.cc:507] Master 127.27.146.190:43479 requested a full tablet report, sending...
I20260709 13:15:38.806182 28234 webserver.cc:533] Webserver started at http://127.27.146.130:44921/ using document root <none> and password file <none>
I20260709 13:15:38.807152 28234 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:38.807665 28234 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:38.808066 28234 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:38.808877  5144 ts_manager.cc:194] Registered new tserver with Master: 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:38.809805 28234 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602648606606-28234-0/minicluster-data/ts-1-root/instance:
uuid: "2f45532f94a34efcb68a82db3dd69372"
format_stamp: "Formatted at 2026-07-09 13:15:38 on dist-test-slave-clfv"
I20260709 13:15:38.811357  5144 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55084
I20260709 13:15:38.815927 28234 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.003s
I20260709 13:15:38.820704  5283 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:38.821851 28234 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.001s
I20260709 13:15:38.822150 28234 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602648606606-28234-0/minicluster-data/ts-1-root
uuid: "2f45532f94a34efcb68a82db3dd69372"
format_stamp: "Formatted at 2026-07-09 13:15:38 on dist-test-slave-clfv"
I20260709 13:15:38.822417 28234 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602648606606-28234-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602648606606-28234-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602648606606-28234-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:38.831817 28234 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:38.833034 28234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:38.834614 28234 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:38.837080 28234 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:38.837270 28234 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:38.837532 28234 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:38.837721 28234 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:38.893291 28234 rpc_server.cc:307] RPC server started. Bound to: 127.27.146.130:43623
I20260709 13:15:38.893528  5345 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.146.130:43623 every 8 connection(s)
I20260709 13:15:38.898470 28234 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:38.907322  5349 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:38.909049  5350 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:38.912395 28234 server_base.cc:1061] running on GCE node
W20260709 13:15:38.914579  5352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:38.915460  5346 heartbeater.cc:344] Connected to a master server at 127.27.146.190:43479
I20260709 13:15:38.915975  5346 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:38.916703 28234 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:15:38.916859  5346 heartbeater.cc:507] Master 127.27.146.190:43479 requested a full tablet report, sending...
W20260709 13:15:38.917275 28234 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:38.917579 28234 hybrid_clock.cc:648] HybridClock initialized: now 1783602938917559 us; error 0 us; skew 500 ppm
I20260709 13:15:38.918411 28234 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:38.919724  5144 ts_manager.cc:194] Registered new tserver with Master: 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:38.921504  5144 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55086
I20260709 13:15:38.921828 28234 webserver.cc:533] Webserver started at http://127.27.146.131:37745/ using document root <none> and password file <none>
I20260709 13:15:38.922667 28234 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:38.922945 28234 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:38.923273 28234 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:38.925259 28234 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602648606606-28234-0/minicluster-data/ts-2-root/instance:
uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
format_stamp: "Formatted at 2026-07-09 13:15:38 on dist-test-slave-clfv"
I20260709 13:15:38.931104 28234 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:15:38.936386  5357 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:38.937603 28234 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:15:38.938037 28234 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602648606606-28234-0/minicluster-data/ts-2-root
uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
format_stamp: "Formatted at 2026-07-09 13:15:38 on dist-test-slave-clfv"
I20260709 13:15:38.938403 28234 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602648606606-28234-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602648606606-28234-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602648606606-28234-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:38.952471 28234 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:38.954051 28234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:38.956612 28234 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:38.961474 28234 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:38.961887 28234 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:38.962250 28234 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:38.962476 28234 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:39.028036 28234 rpc_server.cc:307] RPC server started. Bound to: 127.27.146.131:40847
I20260709 13:15:39.028182  5419 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.146.131:40847 every 8 connection(s)
I20260709 13:15:39.034878 28234 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:39.045842  5423 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:39.046069  5424 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:39.050036  5426 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:39.050622  5420 heartbeater.cc:344] Connected to a master server at 127.27.146.190:43479
I20260709 13:15:39.051163  5420 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:39.052259  5420 heartbeater.cc:507] Master 127.27.146.190:43479 requested a full tablet report, sending...
I20260709 13:15:39.052981 28234 server_base.cc:1061] running on GCE node
I20260709 13:15:39.055270 28234 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:39.055809 28234 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:39.056238 28234 hybrid_clock.cc:648] HybridClock initialized: now 1783602939056205 us; error 0 us; skew 500 ppm
I20260709 13:15:39.056805  5144 ts_manager.cc:194] Registered new tserver with Master: c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:39.056906 28234 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:39.060043  5144 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55088
I20260709 13:15:39.062906 28234 webserver.cc:533] Webserver started at http://127.27.146.132:43931/ using document root <none> and password file <none>
I20260709 13:15:39.063720 28234 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:39.064073 28234 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:39.064522 28234 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:39.066004 28234 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602648606606-28234-0/minicluster-data/ts-3-root/instance:
uuid: "77789aa45dc5463c82b73504fef4b4e0"
format_stamp: "Formatted at 2026-07-09 13:15:39 on dist-test-slave-clfv"
I20260709 13:15:39.071437 28234 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:15:39.076061  5431 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:39.076992 28234 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:15:39.077471 28234 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602648606606-28234-0/minicluster-data/ts-3-root
uuid: "77789aa45dc5463c82b73504fef4b4e0"
format_stamp: "Formatted at 2026-07-09 13:15:39 on dist-test-slave-clfv"
I20260709 13:15:39.077867 28234 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602648606606-28234-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602648606606-28234-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602648606606-28234-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:39.114895 28234 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:39.116611 28234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:39.118455 28234 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:39.121287 28234 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:39.121582 28234 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:39.121850 28234 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:39.122083 28234 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:39.181782 28234 rpc_server.cc:307] RPC server started. Bound to: 127.27.146.132:41391
I20260709 13:15:39.181947  5493 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.146.132:41391 every 8 connection(s)
I20260709 13:15:39.201826  5494 heartbeater.cc:344] Connected to a master server at 127.27.146.190:43479
I20260709 13:15:39.202407  5494 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:39.203732  5494 heartbeater.cc:507] Master 127.27.146.190:43479 requested a full tablet report, sending...
I20260709 13:15:39.206272  5144 ts_manager.cc:194] Registered new tserver with Master: 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:39.206918 28234 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.021075764s
I20260709 13:15:39.208711  5144 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55092
I20260709 13:15:39.243085  5144 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55094:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:15:39.522921  5236 tablet_service.cc:1511] Processing CreateTablet for tablet 29f5415006bb4218b579d580f0b9ff68 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:15:39.524173  5459 tablet_service.cc:1511] Processing CreateTablet for tablet 29f5415006bb4218b579d580f0b9ff68 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:15:39.524823  5236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29f5415006bb4218b579d580f0b9ff68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.525758  5459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29f5415006bb4218b579d580f0b9ff68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.534312  5235 tablet_service.cc:1511] Processing CreateTablet for tablet 60775d8dc53c4243a0d744fd843c5cd5 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:15:39.535981  5235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60775d8dc53c4243a0d744fd843c5cd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.535910  5458 tablet_service.cc:1511] Processing CreateTablet for tablet 3ba8874bed41499cadc73289e5bb4ad3 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:15:39.537483  5458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ba8874bed41499cadc73289e5bb4ad3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.540764  5385 tablet_service.cc:1511] Processing CreateTablet for tablet 60775d8dc53c4243a0d744fd843c5cd5 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:15:39.542402  5385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60775d8dc53c4243a0d744fd843c5cd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.543859  5311 tablet_service.cc:1511] Processing CreateTablet for tablet 29f5415006bb4218b579d580f0b9ff68 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:15:39.544643  5384 tablet_service.cc:1511] Processing CreateTablet for tablet 3ba8874bed41499cadc73289e5bb4ad3 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:15:39.545393  5311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29f5415006bb4218b579d580f0b9ff68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.546196  5384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ba8874bed41499cadc73289e5bb4ad3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.549185  5457 tablet_service.cc:1511] Processing CreateTablet for tablet f6cbde4ed3d14db5a1826609542ec5a4 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:15:39.550875  5234 tablet_service.cc:1511] Processing CreateTablet for tablet 3ba8874bed41499cadc73289e5bb4ad3 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:15:39.552362  5234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ba8874bed41499cadc73289e5bb4ad3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.556766  5233 tablet_service.cc:1511] Processing CreateTablet for tablet 56fc1bf8741446b6ba1d4bb0c8fcb5ed (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:15:39.557307  5456 tablet_service.cc:1511] Processing CreateTablet for tablet d443132476914cd1958f499f68f8acd5 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:15:39.558372  5233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56fc1bf8741446b6ba1d4bb0c8fcb5ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.561869  5383 tablet_service.cc:1511] Processing CreateTablet for tablet f6cbde4ed3d14db5a1826609542ec5a4 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:15:39.563174  5455 tablet_service.cc:1511] Processing CreateTablet for tablet 436bb2869b55478b9c1cc99b5f83f981 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
W20260709 13:15:39.566152  5192 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:39.568492  5454 tablet_service.cc:1511] Processing CreateTablet for tablet 57bbe622c9794d6fa61dd5f39cb3d306 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:15:39.571328  5232 tablet_service.cc:1511] Processing CreateTablet for tablet d443132476914cd1958f499f68f8acd5 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:15:39.573005  5232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d443132476914cd1958f499f68f8acd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.576534  5231 tablet_service.cc:1511] Processing CreateTablet for tablet 436bb2869b55478b9c1cc99b5f83f981 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:15:39.578271  5231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 436bb2869b55478b9c1cc99b5f83f981. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.580822  5230 tablet_service.cc:1511] Processing CreateTablet for tablet 7541727e0e0944a6b184ac464bcc6eee (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:15:39.581612  5452 tablet_service.cc:1511] Processing CreateTablet for tablet 0fde317f3ec547c3840e2fe1e07ec228 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:15:39.582490  5230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7541727e0e0944a6b184ac464bcc6eee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.578277  5453 tablet_service.cc:1511] Processing CreateTablet for tablet 480c812524814775bbf2823e53a996ed (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:15:39.551249  5457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6cbde4ed3d14db5a1826609542ec5a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.588016  5453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 480c812524814775bbf2823e53a996ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.592119  5452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fde317f3ec547c3840e2fe1e07ec228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.592635  5382 tablet_service.cc:1511] Processing CreateTablet for tablet 56fc1bf8741446b6ba1d4bb0c8fcb5ed (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:15:39.596210  5381 tablet_service.cc:1511] Processing CreateTablet for tablet 436bb2869b55478b9c1cc99b5f83f981 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:15:39.597702  5454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57bbe622c9794d6fa61dd5f39cb3d306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.599850  5380 tablet_service.cc:1511] Processing CreateTablet for tablet 57bbe622c9794d6fa61dd5f39cb3d306 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:15:39.601249  5455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 436bb2869b55478b9c1cc99b5f83f981. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.604341  5380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57bbe622c9794d6fa61dd5f39cb3d306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.606150  5381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 436bb2869b55478b9c1cc99b5f83f981. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.607908  5383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6cbde4ed3d14db5a1826609542ec5a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.607937  5310 tablet_service.cc:1511] Processing CreateTablet for tablet 60775d8dc53c4243a0d744fd843c5cd5 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:15:39.610497  5309 tablet_service.cc:1511] Processing CreateTablet for tablet f6cbde4ed3d14db5a1826609542ec5a4 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:15:39.612027  5382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56fc1bf8741446b6ba1d4bb0c8fcb5ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.613545  5456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d443132476914cd1958f499f68f8acd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.614719  5310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60775d8dc53c4243a0d744fd843c5cd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.620555  5451 tablet_service.cc:1511] Processing CreateTablet for tablet 4791d524d10e495fb14f6fd27fcc2218 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:15:39.623478  5451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4791d524d10e495fb14f6fd27fcc2218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.623253  5229 tablet_service.cc:1511] Processing CreateTablet for tablet 480c812524814775bbf2823e53a996ed (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:15:39.625881  5309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6cbde4ed3d14db5a1826609542ec5a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.625880  5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 480c812524814775bbf2823e53a996ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.639555  5228 tablet_service.cc:1511] Processing CreateTablet for tablet 0fde317f3ec547c3840e2fe1e07ec228 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:15:39.642096  5228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fde317f3ec547c3840e2fe1e07ec228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.652415  5308 tablet_service.cc:1511] Processing CreateTablet for tablet 56fc1bf8741446b6ba1d4bb0c8fcb5ed (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:15:39.654955  5308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56fc1bf8741446b6ba1d4bb0c8fcb5ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.661424  5307 tablet_service.cc:1511] Processing CreateTablet for tablet d443132476914cd1958f499f68f8acd5 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:15:39.663995  5307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d443132476914cd1958f499f68f8acd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.669415  5379 tablet_service.cc:1511] Processing CreateTablet for tablet 7541727e0e0944a6b184ac464bcc6eee (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:15:39.671281  5379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7541727e0e0944a6b184ac464bcc6eee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.677660  5378 tablet_service.cc:1511] Processing CreateTablet for tablet 0fde317f3ec547c3840e2fe1e07ec228 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:15:39.679771  5378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fde317f3ec547c3840e2fe1e07ec228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.680771  5450 tablet_service.cc:1511] Processing CreateTablet for tablet 5d841937b5db4e7fa656db32b84b9ca2 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:15:39.682981  5450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d841937b5db4e7fa656db32b84b9ca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.702539  5377 tablet_service.cc:1511] Processing CreateTablet for tablet 4791d524d10e495fb14f6fd27fcc2218 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:15:39.705542  5377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4791d524d10e495fb14f6fd27fcc2218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.706225  5306 tablet_service.cc:1511] Processing CreateTablet for tablet 57bbe622c9794d6fa61dd5f39cb3d306 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:15:39.708897  5306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57bbe622c9794d6fa61dd5f39cb3d306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.727370  5305 tablet_service.cc:1511] Processing CreateTablet for tablet 7541727e0e0944a6b184ac464bcc6eee (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:15:39.730195  5305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7541727e0e0944a6b184ac464bcc6eee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.750775  5227 tablet_service.cc:1511] Processing CreateTablet for tablet 8e80c7aca57e4dc6bdd366ef7501749f (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:15:39.752606  5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e80c7aca57e4dc6bdd366ef7501749f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.815231  5271 heartbeater.cc:499] Master 127.27.146.190:43479 was elected leader, sending a full tablet report...
I20260709 13:15:39.829408  5376 tablet_service.cc:1511] Processing CreateTablet for tablet 8e80c7aca57e4dc6bdd366ef7501749f (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:15:39.831174  5376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e80c7aca57e4dc6bdd366ef7501749f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.849438  5304 tablet_service.cc:1511] Processing CreateTablet for tablet 480c812524814775bbf2823e53a996ed (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:15:39.851367  5304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 480c812524814775bbf2823e53a996ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.857270  5303 tablet_service.cc:1511] Processing CreateTablet for tablet 4791d524d10e495fb14f6fd27fcc2218 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:15:39.859165  5303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4791d524d10e495fb14f6fd27fcc2218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.899864  5459 tablet_service.cc:1511] Processing CreateTablet for tablet 7c0e035a21aa4d43857f541259fa71b9 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:15:39.901729  5459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c0e035a21aa4d43857f541259fa71b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.917515  5302 tablet_service.cc:1511] Processing CreateTablet for tablet 8e80c7aca57e4dc6bdd366ef7501749f (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:15:39.921042  5459 tablet_service.cc:1511] Processing CreateTablet for tablet 8c46fa9b6c00424a8697f4536d1a3b0e (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:15:39.925755  5346 heartbeater.cc:499] Master 127.27.146.190:43479 was elected leader, sending a full tablet report...
I20260709 13:15:39.926034  5459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c46fa9b6c00424a8697f4536d1a3b0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.961814  5515 tablet_bootstrap.cc:492] T 0fde317f3ec547c3840e2fe1e07ec228 P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
I20260709 13:15:39.962327  5378 tablet_service.cc:1511] Processing CreateTablet for tablet 7c0e035a21aa4d43857f541259fa71b9 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:15:39.963933  5378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c0e035a21aa4d43857f541259fa71b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.977604  5302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e80c7aca57e4dc6bdd366ef7501749f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:39.998383  5228 tablet_service.cc:1511] Processing CreateTablet for tablet 5d841937b5db4e7fa656db32b84b9ca2 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:15:40.005661  5228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d841937b5db4e7fa656db32b84b9ca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.006336  5514 tablet_bootstrap.cc:492] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
I20260709 13:15:40.040709  5517 tablet_bootstrap.cc:492] T 0fde317f3ec547c3840e2fe1e07ec228 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:39.995538  5452 tablet_service.cc:1511] Processing CreateTablet for tablet bdbcf0a951c24340ba91509df11fc4c7 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:15:40.044677  5306 tablet_service.cc:1511] Processing CreateTablet for tablet bd6573fdc5bd411e8b0cbd3316ecaede (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:15:40.050841  5514 tablet_bootstrap.cc:654] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.057596  5516 tablet_bootstrap.cc:492] T 57bbe622c9794d6fa61dd5f39cb3d306 P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
I20260709 13:15:40.064942  5420 heartbeater.cc:499] Master 127.27.146.190:43479 was elected leader, sending a full tablet report...
I20260709 13:15:40.075081  5516 tablet_bootstrap.cc:654] T 57bbe622c9794d6fa61dd5f39cb3d306 P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.084398  5515 tablet_bootstrap.cc:654] T 0fde317f3ec547c3840e2fe1e07ec228 P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.088294  5377 tablet_service.cc:1511] Processing CreateTablet for tablet 8c46fa9b6c00424a8697f4536d1a3b0e (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:15:40.088366  5310 tablet_service.cc:1511] Processing CreateTablet for tablet 8c46fa9b6c00424a8697f4536d1a3b0e (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:15:40.089800  5377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c46fa9b6c00424a8697f4536d1a3b0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.090008  5310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c46fa9b6c00424a8697f4536d1a3b0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.097445  5385 tablet_service.cc:1511] Processing CreateTablet for tablet bd6573fdc5bd411e8b0cbd3316ecaede (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:15:40.096007  5306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd6573fdc5bd411e8b0cbd3316ecaede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.097512  5376 tablet_service.cc:1511] Processing CreateTablet for tablet fce0170182474e7dbe46361f5bf0eae9 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:15:40.101806  5235 tablet_service.cc:1511] Processing CreateTablet for tablet 7c0e035a21aa4d43857f541259fa71b9 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:15:40.104135  5235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c0e035a21aa4d43857f541259fa71b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.098939  5385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd6573fdc5bd411e8b0cbd3316ecaede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.104492  5303 tablet_service.cc:1511] Processing CreateTablet for tablet 5d841937b5db4e7fa656db32b84b9ca2 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:15:40.108083  5452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdbcf0a951c24340ba91509df11fc4c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.136775  5376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fce0170182474e7dbe46361f5bf0eae9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.115084  5229 tablet_service.cc:1511] Processing CreateTablet for tablet bd6573fdc5bd411e8b0cbd3316ecaede (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:15:40.142189  5236 tablet_service.cc:1511] Processing CreateTablet for tablet bdbcf0a951c24340ba91509df11fc4c7 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:15:40.143725  5236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdbcf0a951c24340ba91509df11fc4c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.131853  5517 tablet_bootstrap.cc:654] T 0fde317f3ec547c3840e2fe1e07ec228 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.156186  5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd6573fdc5bd411e8b0cbd3316ecaede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.157204  5304 tablet_service.cc:1511] Processing CreateTablet for tablet c01a087c57254cf0822d574602320ab5 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:15:40.159710  5304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c01a087c57254cf0822d574602320ab5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.161808  5233 tablet_service.cc:1511] Processing CreateTablet for tablet fce0170182474e7dbe46361f5bf0eae9 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:15:40.163458  5233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fce0170182474e7dbe46361f5bf0eae9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.163851  5232 tablet_service.cc:1511] Processing CreateTablet for tablet e78312bda196492eae76f2673c979fee (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:15:40.167260  5514 tablet_bootstrap.cc:492] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:40.167953  5303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d841937b5db4e7fa656db32b84b9ca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.220877  5234 tablet_service.cc:1511] Processing CreateTablet for tablet 71b75232471f416bb2d0ec813f32558e (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:15:40.173731  5307 tablet_service.cc:1511] Processing CreateTablet for tablet e78312bda196492eae76f2673c979fee (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:15:40.224468  5307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e78312bda196492eae76f2673c979fee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.231004  5516 tablet_bootstrap.cc:492] T 57bbe622c9794d6fa61dd5f39cb3d306 P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:40.231751  5516 ts_tablet_manager.cc:1403] T 57bbe622c9794d6fa61dd5f39cb3d306 P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.194s	user 0.021s	sys 0.006s
I20260709 13:15:40.233417  5381 tablet_service.cc:1511] Processing CreateTablet for tablet 654fdf03209d4a3cbf17055c56ae2c9d (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:15:40.235540  5516 raft_consensus.cc:359] T 57bbe622c9794d6fa61dd5f39cb3d306 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:40.236498  5516 raft_consensus.cc:385] T 57bbe622c9794d6fa61dd5f39cb3d306 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.236747  5378 tablet_service.cc:1511] Processing CreateTablet for tablet 4bc60d69f29e47689fd8fdf2b6aa836a (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:15:40.236872  5516 raft_consensus.cc:740] T 57bbe622c9794d6fa61dd5f39cb3d306 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.238853  5516 consensus_queue.cc:260] T 57bbe622c9794d6fa61dd5f39cb3d306 P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:40.178434  5231 tablet_service.cc:1511] Processing CreateTablet for tablet 654fdf03209d4a3cbf17055c56ae2c9d (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:15:40.186172  5305 tablet_service.cc:1511] Processing CreateTablet for tablet 71b75232471f416bb2d0ec813f32558e (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:15:40.188408  5453 tablet_service.cc:1511] Processing CreateTablet for tablet fce0170182474e7dbe46361f5bf0eae9 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:15:40.191866  5309 tablet_service.cc:1511] Processing CreateTablet for tablet f18f7cc1557b43b9adbf357e50e292a0 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:15:40.103153  5383 tablet_service.cc:1511] Processing CreateTablet for tablet f18f7cc1557b43b9adbf357e50e292a0 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:15:40.242369  5453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fce0170182474e7dbe46361f5bf0eae9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.195885  5455 tablet_service.cc:1511] Processing CreateTablet for tablet 8aac85b71e404ee1bcfb748bfb0376fb (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:15:40.199131  5458 tablet_service.cc:1511] Processing CreateTablet for tablet 4bc60d69f29e47689fd8fdf2b6aa836a (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:15:40.144855  5457 tablet_service.cc:1511] Processing CreateTablet for tablet c01a087c57254cf0822d574602320ab5 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:15:40.204588  5385 tablet_service.cc:1511] Processing CreateTablet for tablet e78312bda196492eae76f2673c979fee (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:15:40.204608  5311 tablet_service.cc:1511] Processing CreateTablet for tablet bdbcf0a951c24340ba91509df11fc4c7 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:15:40.204608  5450 tablet_service.cc:1511] Processing CreateTablet for tablet 068e5bd8f3ef45fc8a4a122e51537764 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:15:40.250877  5455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8aac85b71e404ee1bcfb748bfb0376fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.251714  5450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 068e5bd8f3ef45fc8a4a122e51537764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.253443  5457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c01a087c57254cf0822d574602320ab5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.256080  5458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bc60d69f29e47689fd8fdf2b6aa836a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.257133  5377 tablet_service.cc:1511] Processing CreateTablet for tablet 1db09971a25441c68427b8bea7e9c379 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:15:40.258270  5232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e78312bda196492eae76f2673c979fee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.258733  5377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1db09971a25441c68427b8bea7e9c379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.206501  5515 tablet_bootstrap.cc:492] T 0fde317f3ec547c3840e2fe1e07ec228 P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
I20260709 13:15:40.210721  5308 tablet_service.cc:1511] Processing CreateTablet for tablet 654fdf03209d4a3cbf17055c56ae2c9d (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:15:40.262125  5231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 654fdf03209d4a3cbf17055c56ae2c9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.262512  5383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f18f7cc1557b43b9adbf357e50e292a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.210341  5376 tablet_service.cc:1511] Processing CreateTablet for tablet 068e5bd8f3ef45fc8a4a122e51537764 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:15:40.265362  5376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 068e5bd8f3ef45fc8a4a122e51537764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.265231  5379 tablet_service.cc:1511] Processing CreateTablet for tablet c01a087c57254cf0822d574602320ab5 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:15:40.268082  5385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e78312bda196492eae76f2673c979fee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.211916  5304 tablet_service.cc:1511] Processing CreateTablet for tablet 8aac85b71e404ee1bcfb748bfb0376fb (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:15:40.272061  5381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 654fdf03209d4a3cbf17055c56ae2c9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.273584  5380 tablet_service.cc:1511] Processing CreateTablet for tablet 99cdbf6d16c64a949df77a003bb7f7e4 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:15:40.275027  5380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99cdbf6d16c64a949df77a003bb7f7e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.263383  5515 ts_tablet_manager.cc:1403] T 0fde317f3ec547c3840e2fe1e07ec228 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.302s	user 0.015s	sys 0.005s
I20260709 13:15:40.279150  5234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71b75232471f416bb2d0ec813f32558e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.213140  5494 heartbeater.cc:499] Master 127.27.146.190:43479 was elected leader, sending a full tablet report...
I20260709 13:15:40.213477  5230 tablet_service.cc:1511] Processing CreateTablet for tablet 8aac85b71e404ee1bcfb748bfb0376fb (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:15:40.217100  5514 ts_tablet_manager.cc:1403] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.232s	user 0.011s	sys 0.005s
I20260709 13:15:40.169565  5456 tablet_service.cc:1511] Processing CreateTablet for tablet f18f7cc1557b43b9adbf357e50e292a0 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:15:40.241506  5305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71b75232471f416bb2d0ec813f32558e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.241456  5384 tablet_service.cc:1511] Processing CreateTablet for tablet 34ed89f0e9a64fd3ab95b7e83cd4b03a (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:15:40.212533  5459 tablet_service.cc:1511] Processing CreateTablet for tablet 71b75232471f416bb2d0ec813f32558e (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:15:40.159857  5227 tablet_service.cc:1511] Processing CreateTablet for tablet 068e5bd8f3ef45fc8a4a122e51537764 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:15:40.289742  5456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f18f7cc1557b43b9adbf357e50e292a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.303361  5384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34ed89f0e9a64fd3ab95b7e83cd4b03a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.280244  5382 tablet_service.cc:1511] Processing CreateTablet for tablet 15d005f85bf54ebfb870b326ef3e18ed (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:15:40.305236  5382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15d005f85bf54ebfb870b326ef3e18ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.292222  5230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8aac85b71e404ee1bcfb748bfb0376fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.308004  5459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71b75232471f416bb2d0ec813f32558e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.312306  5514 raft_consensus.cc:359] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:40.313253  5514 raft_consensus.cc:385] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.313627  5514 raft_consensus.cc:740] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.336503  5514 consensus_queue.cc:260] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:40.319921  5379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c01a087c57254cf0822d574602320ab5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.320439  5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 068e5bd8f3ef45fc8a4a122e51537764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.322500  5302 tablet_service.cc:1511] Processing CreateTablet for tablet 34ed89f0e9a64fd3ab95b7e83cd4b03a (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:15:40.292361  5304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8aac85b71e404ee1bcfb748bfb0376fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.337066  5516 ts_tablet_manager.cc:1434] T 57bbe622c9794d6fa61dd5f39cb3d306 P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.105s	user 0.008s	sys 0.003s
I20260709 13:15:40.338442  5515 raft_consensus.cc:359] T 0fde317f3ec547c3840e2fe1e07ec228 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:40.316313  5228 tablet_service.cc:1511] Processing CreateTablet for tablet 4bc60d69f29e47689fd8fdf2b6aa836a (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:15:40.294569  5451 tablet_service.cc:1511] Processing CreateTablet for tablet 34ed89f0e9a64fd3ab95b7e83cd4b03a (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:15:40.376609  5451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34ed89f0e9a64fd3ab95b7e83cd4b03a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.381824  5517 tablet_bootstrap.cc:492] T 0fde317f3ec547c3840e2fe1e07ec228 P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:40.382496  5517 ts_tablet_manager.cc:1403] T 0fde317f3ec547c3840e2fe1e07ec228 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.345s	user 0.019s	sys 0.000s
I20260709 13:15:40.370023  5516 tablet_bootstrap.cc:492] T 4791d524d10e495fb14f6fd27fcc2218 P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
I20260709 13:15:40.373879  5521 raft_consensus.cc:493] T 57bbe622c9794d6fa61dd5f39cb3d306 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.374660  5378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bc60d69f29e47689fd8fdf2b6aa836a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.388645  5302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34ed89f0e9a64fd3ab95b7e83cd4b03a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.391361  5311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdbcf0a951c24340ba91509df11fc4c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.387020  5521 raft_consensus.cc:515] T 57bbe622c9794d6fa61dd5f39cb3d306 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:40.354417  5515 raft_consensus.cc:385] T 0fde317f3ec547c3840e2fe1e07ec228 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.398222  5515 raft_consensus.cc:740] T 0fde317f3ec547c3840e2fe1e07ec228 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.399518  5515 consensus_queue.cc:260] T 0fde317f3ec547c3840e2fe1e07ec228 P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
W20260709 13:15:40.414815  5347 tablet.cc:2406] T 57bbe622c9794d6fa61dd5f39cb3d306 P 2f45532f94a34efcb68a82db3dd69372: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:15:40.416728  5450 tablet_service.cc:1511] Processing CreateTablet for tablet 15d005f85bf54ebfb870b326ef3e18ed (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:15:40.418171  5450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15d005f85bf54ebfb870b326ef3e18ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.425089  5307 tablet_service.cc:1511] Processing CreateTablet for tablet 63267e5ca2594b41844fd758ca603a34 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:15:40.285475  5454 tablet_service.cc:1511] Processing CreateTablet for tablet 63267e5ca2594b41844fd758ca603a34 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:15:40.387753  5453 tablet_service.cc:1511] Processing CreateTablet for tablet 99cdbf6d16c64a949df77a003bb7f7e4 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:15:40.420440  5309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f18f7cc1557b43b9adbf357e50e292a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.456748  5307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63267e5ca2594b41844fd758ca603a34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.461144  5228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bc60d69f29e47689fd8fdf2b6aa836a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.464186  5521 leader_election.cc:290] T 57bbe622c9794d6fa61dd5f39cb3d306 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:40.476402  5310 tablet_service.cc:1511] Processing CreateTablet for tablet 15d005f85bf54ebfb870b326ef3e18ed (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:15:40.480592  5383 tablet_service.cc:1511] Processing CreateTablet for tablet 4d479dd9f8c04491bb1e78273726187f (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:15:40.502413  5383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d479dd9f8c04491bb1e78273726187f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.514375  5454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63267e5ca2594b41844fd758ca603a34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.519243  5516 tablet_bootstrap.cc:654] T 4791d524d10e495fb14f6fd27fcc2218 P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.476147  5517 raft_consensus.cc:359] T 0fde317f3ec547c3840e2fe1e07ec228 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:40.536475  5306 tablet_service.cc:1511] Processing CreateTablet for tablet 1db09971a25441c68427b8bea7e9c379 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:15:40.550631  5234 tablet_service.cc:1511] Processing CreateTablet for tablet 99cdbf6d16c64a949df77a003bb7f7e4 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:15:40.553788  5517 raft_consensus.cc:385] T 0fde317f3ec547c3840e2fe1e07ec228 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.555209  5236 tablet_service.cc:1511] Processing CreateTablet for tablet 4d479dd9f8c04491bb1e78273726187f (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:15:40.540843  5232 tablet_service.cc:1511] Processing CreateTablet for tablet 63267e5ca2594b41844fd758ca603a34 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:15:40.560312  5514 ts_tablet_manager.cc:1434] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.271s	user 0.006s	sys 0.013s
I20260709 13:15:40.560631  5395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bbe622c9794d6fa61dd5f39cb3d306" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:40.558348  5229 tablet_service.cc:1511] Processing CreateTablet for tablet 309fb72c5b374642bb05a78b0b5ca308 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:15:40.569583  5517 raft_consensus.cc:740] T 0fde317f3ec547c3840e2fe1e07ec228 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.563699  5385 tablet_service.cc:1511] Processing CreateTablet for tablet 34516de894fc408b8e355aba3402489c (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:15:40.546990  5308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 654fdf03209d4a3cbf17055c56ae2c9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.562814  5302 tablet_service.cc:1511] Processing CreateTablet for tablet 4d479dd9f8c04491bb1e78273726187f (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:15:40.593379  5453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99cdbf6d16c64a949df77a003bb7f7e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.594010  5306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1db09971a25441c68427b8bea7e9c379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.595038  5385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34516de894fc408b8e355aba3402489c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.595865  5310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15d005f85bf54ebfb870b326ef3e18ed. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:40.596779  5192 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:40.598850  5235 tablet_service.cc:1511] Processing CreateTablet for tablet 1db09971a25441c68427b8bea7e9c379 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
W20260709 13:15:40.604527  5286 leader_election.cc:343] T 57bbe622c9794d6fa61dd5f39cb3d306 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.608085  5456 tablet_service.cc:1511] Processing CreateTablet for tablet 43d23c7f276f4df1acd8124ed4940f1b (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:15:40.608568  5517 consensus_queue.cc:260] T 0fde317f3ec547c3840e2fe1e07ec228 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:40.609596  5456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43d23c7f276f4df1acd8124ed4940f1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.562674  5458 tablet_service.cc:1511] Processing CreateTablet for tablet 34516de894fc408b8e355aba3402489c (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:15:40.622879  5515 ts_tablet_manager.cc:1434] T 0fde317f3ec547c3840e2fe1e07ec228 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.345s	user 0.014s	sys 0.000s
I20260709 13:15:40.623545  5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 309fb72c5b374642bb05a78b0b5ca308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.622910  5458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34516de894fc408b8e355aba3402489c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.642611  5235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1db09971a25441c68427b8bea7e9c379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.642668  5514 tablet_bootstrap.cc:492] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
I20260709 13:15:40.645632  5236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d479dd9f8c04491bb1e78273726187f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.646821  5234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99cdbf6d16c64a949df77a003bb7f7e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.648254  5515 tablet_bootstrap.cc:492] T 4791d524d10e495fb14f6fd27fcc2218 P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
I20260709 13:15:40.648095  5233 tablet_service.cc:1511] Processing CreateTablet for tablet 34516de894fc408b8e355aba3402489c (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:15:40.649516  5233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34516de894fc408b8e355aba3402489c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.639294  5302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d479dd9f8c04491bb1e78273726187f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.652189  5232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63267e5ca2594b41844fd758ca603a34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.682729  5457 tablet_service.cc:1511] Processing CreateTablet for tablet cb26053fad7244cd88a5182d9cfc2109 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:15:40.684351  5457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb26053fad7244cd88a5182d9cfc2109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.662910  5230 tablet_service.cc:1511] Processing CreateTablet for tablet 22ee19164403428187e72d7a7c868457 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:15:40.691402  5230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22ee19164403428187e72d7a7c868457. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.678772  5231 tablet_service.cc:1511] Processing CreateTablet for tablet cb26053fad7244cd88a5182d9cfc2109 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:15:40.712278  5524 raft_consensus.cc:493] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.713032  5524 raft_consensus.cc:515] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:40.715209  5383 tablet_service.cc:1511] Processing CreateTablet for tablet 22ee19164403428187e72d7a7c868457 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:15:40.715446  5379 tablet_service.cc:1511] Processing CreateTablet for tablet 0796f5098e2a48c992868bbffce02505 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:15:40.716898  5383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22ee19164403428187e72d7a7c868457. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.717819  5379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0796f5098e2a48c992868bbffce02505. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.717470  5380 tablet_service.cc:1511] Processing CreateTablet for tablet 03ad7844466b46548e4e9600220710f0 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:15:40.671293  5377 tablet_service.cc:1511] Processing CreateTablet for tablet 43d23c7f276f4df1acd8124ed4940f1b (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:15:40.721570  5309 tablet_service.cc:1511] Processing CreateTablet for tablet 309fb72c5b374642bb05a78b0b5ca308 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:15:40.723102  5309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 309fb72c5b374642bb05a78b0b5ca308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.723934  5380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03ad7844466b46548e4e9600220710f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.635921  5452 tablet_service.cc:1511] Processing CreateTablet for tablet 309fb72c5b374642bb05a78b0b5ca308 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:15:40.712664  5514 tablet_bootstrap.cc:654] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:40.737032  5303 consensus_meta.cc:287] T 5d841937b5db4e7fa656db32b84b9ca2 P 2f45532f94a34efcb68a82db3dd69372: Time spent flushing consensus metadata: real 0.502s	user 0.016s	sys 0.000s
I20260709 13:15:40.737637  5452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 309fb72c5b374642bb05a78b0b5ca308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.740432  5377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43d23c7f276f4df1acd8124ed4940f1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.740307  5303 tablet_service.cc:1511] Processing CreateTablet for tablet 43d23c7f276f4df1acd8124ed4940f1b (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:15:40.742550  5303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43d23c7f276f4df1acd8124ed4940f1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.744257  5530 raft_consensus.cc:493] T 0fde317f3ec547c3840e2fe1e07ec228 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.744911  5530 raft_consensus.cc:515] T 0fde317f3ec547c3840e2fe1e07ec228 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:40.734710  5515 tablet_bootstrap.cc:654] T 4791d524d10e495fb14f6fd27fcc2218 P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.737069  5455 tablet_service.cc:1511] Processing CreateTablet for tablet 0796f5098e2a48c992868bbffce02505 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:15:40.768424  5455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0796f5098e2a48c992868bbffce02505. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.771342  5524 leader_election.cc:290] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:40.775254  5459 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49794 (request call id 15) took 1084 ms. Trace:
I20260709 13:15:40.775764  5459 rpcz_store.cc:276] 0709 13:15:39.690737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.139152 (+448415us) service_pool.cc:224] Handling call
0709 13:15:40.291708 (+152556us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:40.291808 (+   100us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:40.379210 (+ 87402us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:40.774645 (+395435us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:40.775189 (+   544us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7183}
I20260709 13:15:40.779850  5517 ts_tablet_manager.cc:1434] T 0fde317f3ec547c3840e2fe1e07ec228 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.397s	user 0.008s	sys 0.054s
I20260709 13:15:40.809399  5514 tablet_bootstrap.cc:492] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:40.810190  5514 ts_tablet_manager.cc:1403] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.190s	user 0.018s	sys 0.001s
I20260709 13:15:40.814771  5514 raft_consensus.cc:359] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:40.815809  5514 raft_consensus.cc:385] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.816203  5514 raft_consensus.cc:740] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.817240  5514 consensus_queue.cc:260] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:40.820247  5514 ts_tablet_manager.cc:1434] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.010s	user 0.011s	sys 0.001s
I20260709 13:15:40.821306  5514 tablet_bootstrap.cc:492] T 0fde317f3ec547c3840e2fe1e07ec228 P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
I20260709 13:15:40.834870  5514 tablet_bootstrap.cc:654] T 0fde317f3ec547c3840e2fe1e07ec228 P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.839377  5516 tablet_bootstrap.cc:492] T 4791d524d10e495fb14f6fd27fcc2218 P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:40.840194  5516 ts_tablet_manager.cc:1403] T 4791d524d10e495fb14f6fd27fcc2218 P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.470s	user 0.019s	sys 0.024s
I20260709 13:15:40.841073  5515 tablet_bootstrap.cc:492] T 4791d524d10e495fb14f6fd27fcc2218 P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
I20260709 13:15:40.842053  5515 ts_tablet_manager.cc:1403] T 4791d524d10e495fb14f6fd27fcc2218 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.194s	user 0.023s	sys 0.002s
I20260709 13:15:40.916567  5231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb26053fad7244cd88a5182d9cfc2109. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:40.925544  5130 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.27.146.131:40847, user_credentials={real_user=slave}} blocked reactor thread for 45049.3us
I20260709 13:15:40.947568  5305 tablet_service.cc:1511] Processing CreateTablet for tablet cb26053fad7244cd88a5182d9cfc2109 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:15:40.949831  5305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb26053fad7244cd88a5182d9cfc2109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.956451  5306 tablet_service.cc:1511] Processing CreateTablet for tablet 22ee19164403428187e72d7a7c868457 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:15:40.959776  5310 tablet_service.cc:1511] Processing CreateTablet for tablet 03ad7844466b46548e4e9600220710f0 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:15:40.961026  5227 tablet_service.cc:1511] Processing CreateTablet for tablet 0796f5098e2a48c992868bbffce02505 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:15:40.962091  5310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03ad7844466b46548e4e9600220710f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.970955  5227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0796f5098e2a48c992868bbffce02505. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:40.978840  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bbe622c9794d6fa61dd5f39cb3d306" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
W20260709 13:15:40.972204  5130 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.27.146.131:40847, user_credentials={real_user=slave}} blocked reactor thread for 45001.8us
I20260709 13:15:40.999325  5515 raft_consensus.cc:359] T 4791d524d10e495fb14f6fd27fcc2218 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:41.000887  5528 raft_consensus.cc:493] T 0fde317f3ec547c3840e2fe1e07ec228 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.001196  5515 raft_consensus.cc:385] T 4791d524d10e495fb14f6fd27fcc2218 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.002302  5306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22ee19164403428187e72d7a7c868457. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:41.002872  5284 leader_election.cc:343] T 57bbe622c9794d6fa61dd5f39cb3d306 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.003748  5284 leader_election.cc:304] T 57bbe622c9794d6fa61dd5f39cb3d306 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372; no voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:41.001755  5528 raft_consensus.cc:515] T 0fde317f3ec547c3840e2fe1e07ec228 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:41.001776  5515 raft_consensus.cc:740] T 4791d524d10e495fb14f6fd27fcc2218 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.038228  5528 leader_election.cc:290] T 0fde317f3ec547c3840e2fe1e07ec228 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
W20260709 13:15:41.075742  5128 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.27.146.132:41391, user_credentials={real_user=slave}} blocked reactor thread for 117603us
I20260709 13:15:41.088572  5308 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37734 (request call id 18) took 1126 ms. Trace:
I20260709 13:15:41.035511  5516 raft_consensus.cc:359] T 4791d524d10e495fb14f6fd27fcc2218 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:41.091913  5516 raft_consensus.cc:385] T 4791d524d10e495fb14f6fd27fcc2218 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.092442  5516 raft_consensus.cc:740] T 4791d524d10e495fb14f6fd27fcc2218 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.093726  5516 consensus_queue.cc:260] T 4791d524d10e495fb14f6fd27fcc2218 P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:41.095955  5308 rpcz_store.cc:276] 0709 13:15:39.962286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.209750 (+247464us) service_pool.cc:224] Handling call
0709 13:15:40.260596 (+ 50846us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:40.260700 (+   104us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:40.730046 (+469346us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:41.087122 (+357076us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:41.088275 (+  1153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:41.102941  5541 raft_consensus.cc:2749] T 57bbe622c9794d6fa61dd5f39cb3d306 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:41.103613  5515 consensus_queue.cc:260] T 4791d524d10e495fb14f6fd27fcc2218 P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:41.106823  5530 leader_election.cc:290] T 0fde317f3ec547c3840e2fe1e07ec228 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:41.107868  5515 ts_tablet_manager.cc:1434] T 4791d524d10e495fb14f6fd27fcc2218 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.265s	user 0.009s	sys 0.005s
I20260709 13:15:41.103039  5514 tablet_bootstrap.cc:492] T 0fde317f3ec547c3840e2fe1e07ec228 P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:41.110224  5514 ts_tablet_manager.cc:1403] T 0fde317f3ec547c3840e2fe1e07ec228 P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.289s	user 0.033s	sys 0.030s
I20260709 13:15:41.114570  5514 raft_consensus.cc:359] T 0fde317f3ec547c3840e2fe1e07ec228 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:41.115844  5515 tablet_bootstrap.cc:492] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
I20260709 13:15:41.115782  5381 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44318 (request call id 18) took 1075 ms. Trace:
I20260709 13:15:41.117844  5381 rpcz_store.cc:276] 0709 13:15:39.986904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.232282 (+245378us) service_pool.cc:224] Handling call
0709 13:15:40.271547 (+ 39265us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:40.271664 (+   117us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:40.729673 (+458009us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:40.987746 (+258073us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:41.062269 (+ 74523us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12762,"spinlock_wait_cycles":12672}
I20260709 13:15:41.115408  5514 raft_consensus.cc:385] T 0fde317f3ec547c3840e2fe1e07ec228 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.124524  5514 raft_consensus.cc:740] T 0fde317f3ec547c3840e2fe1e07ec228 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.117448  5304 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37734 (request call id 19) took 1138 ms. Trace:
I20260709 13:15:41.131814  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f5415006bb4218b579d580f0b9ff68" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:41.136245  5517 tablet_bootstrap.cc:492] T 480c812524814775bbf2823e53a996ed P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:41.126511  5514 consensus_queue.cc:260] T 0fde317f3ec547c3840e2fe1e07ec228 P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:41.139708  5452 tablet_service.cc:1511] Processing CreateTablet for tablet 03ad7844466b46548e4e9600220710f0 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
W20260709 13:15:41.170459  5433 leader_election.cc:343] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.172688  5514 ts_tablet_manager.cc:1434] T 0fde317f3ec547c3840e2fe1e07ec228 P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.062s	user 0.013s	sys 0.000s
I20260709 13:15:41.174902  5514 tablet_bootstrap.cc:492] T 480c812524814775bbf2823e53a996ed P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
W20260709 13:15:41.175972  5284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.132:41391, user_credentials={real_user=slave}} blocked reactor thread for 193936us
I20260709 13:15:41.177981  5234 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34492 (request call id 23) took 1059 ms. Trace:
I20260709 13:15:41.189970  5541 raft_consensus.cc:493] T 4791d524d10e495fb14f6fd27fcc2218 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.192058  5541 raft_consensus.cc:515] T 4791d524d10e495fb14f6fd27fcc2218 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:41.188292  5515 tablet_bootstrap.cc:654] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.178032  5516 ts_tablet_manager.cc:1434] T 4791d524d10e495fb14f6fd27fcc2218 P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.337s	user 0.018s	sys 0.005s
W20260709 13:15:41.178959  5129 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.27.146.130:43623, user_credentials={real_user=slave}} blocked reactor thread for 255047us
I20260709 13:15:41.204058  5541 leader_election.cc:290] T 4791d524d10e495fb14f6fd27fcc2218 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
W20260709 13:15:41.179530  5130 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.27.146.131:40847, user_credentials={real_user=slave}} blocked reactor thread for 137068us
I20260709 13:15:41.206552  5395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4791d524d10e495fb14f6fd27fcc2218" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:41.208483  5395 raft_consensus.cc:2468] T 4791d524d10e495fb14f6fd27fcc2218 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 0.
I20260709 13:15:41.210706  5286 leader_election.cc:304] T 4791d524d10e495fb14f6fd27fcc2218 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:41.206466  5308 tablet_service.cc:1511] Processing CreateTablet for tablet 02dba91c167a418daee105670577c8aa (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:15:41.213356  5308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02dba91c167a418daee105670577c8aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.213869  5541 raft_consensus.cc:2804] T 4791d524d10e495fb14f6fd27fcc2218 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:41.219821  5541 raft_consensus.cc:493] T 4791d524d10e495fb14f6fd27fcc2218 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.220580  5541 raft_consensus.cc:3060] T 4791d524d10e495fb14f6fd27fcc2218 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.221099  5516 tablet_bootstrap.cc:492] T 60775d8dc53c4243a0d744fd843c5cd5 P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
I20260709 13:15:41.128162  5304 rpcz_store.cc:276] 0709 13:15:39.962716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.210869 (+248153us) service_pool.cc:224] Handling call
0709 13:15:40.270712 (+ 59843us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:40.270831 (+   119us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:40.707243 (+436412us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:41.079340 (+372097us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:41.101447 (+ 22107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:41.228031  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4791d524d10e495fb14f6fd27fcc2218" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:41.229507  5468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde317f3ec547c3840e2fe1e07ec228" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:41.233333  5468 raft_consensus.cc:2468] T 0fde317f3ec547c3840e2fe1e07ec228 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 0.
W20260709 13:15:41.234127  5284 leader_election.cc:343] T 4791d524d10e495fb14f6fd27fcc2218 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.235110  5358 leader_election.cc:304] T 0fde317f3ec547c3840e2fe1e07ec228 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:41.236195  5528 raft_consensus.cc:2804] T 0fde317f3ec547c3840e2fe1e07ec228 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:41.236694  5528 raft_consensus.cc:493] T 0fde317f3ec547c3840e2fe1e07ec228 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.237106  5528 raft_consensus.cc:3060] T 0fde317f3ec547c3840e2fe1e07ec228 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:41.233283  5128 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.27.146.132:41391, user_credentials={real_user=slave}} blocked reactor thread for 156334us
I20260709 13:15:41.247608  5517 tablet_bootstrap.cc:654] T 480c812524814775bbf2823e53a996ed P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:41.263981  5307 consensus_meta.cc:287] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372: Time spent flushing consensus metadata: real 0.579s	user 0.009s	sys 0.014s
I20260709 13:15:41.268150  5468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde317f3ec547c3840e2fe1e07ec228" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:41.268781  5307 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37734 (request call id 22) took 1161 ms. Trace:
I20260709 13:15:41.269027  5468 raft_consensus.cc:2468] T 0fde317f3ec547c3840e2fe1e07ec228 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 0.
I20260709 13:15:41.269277  5307 rpcz_store.cc:276] 0709 13:15:40.106984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.423983 (+316999us) service_pool.cc:224] Handling call
0709 13:15:40.426173 (+  2190us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:40.426272 (+    99us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:40.684723 (+258451us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:41.267992 (+583269us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:41.268630 (+   638us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:41.288592  5514 tablet_bootstrap.cc:654] T 480c812524814775bbf2823e53a996ed P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.302876  5452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03ad7844466b46548e4e9600220710f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.270556  5516 tablet_bootstrap.cc:654] T 60775d8dc53c4243a0d744fd843c5cd5 P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.270829  5209 leader_election.cc:304] T 0fde317f3ec547c3840e2fe1e07ec228 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, 77789aa45dc5463c82b73504fef4b4e0; no voters: 
I20260709 13:15:41.178726  5234 rpcz_store.cc:276] 0709 13:15:40.119620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.549643 (+430023us) service_pool.cc:224] Handling call
0709 13:15:40.593254 (+ 43611us) spinlock_profiling.cc:243] Waited 3.29 ms on lock 0x7b5800005198. stack: 00007f6a78c67343 00007f6a78c67240 00007f6a785f61d4 00007f6a82334304 00007f6a82334299 00007f6a78b21db1 00007f6a78c61b71 00007f6a78c621a2 00007f6a81ba3bb9 00007f6a80cd4d88 00007f6a80d97b80 00007f6a80d46400 00007f6a7a1cbaf4 00007f6a7a1cba82 00007f6a7a1cb9b1 00007f6a7a1cb92c
0709 13:15:40.611073 (+ 17819us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:40.618300 (+  7227us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:41.021138 (+402838us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:41.162624 (+141486us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:41.177692 (+ 15068us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7559936}
W20260709 13:15:41.316442  5209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.132:41391, user_credentials={real_user=slave}} blocked reactor thread for 45769.1us
I20260709 13:15:41.317505  5530 raft_consensus.cc:2804] T 0fde317f3ec547c3840e2fe1e07ec228 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:41.317974  5530 raft_consensus.cc:493] T 0fde317f3ec547c3840e2fe1e07ec228 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.318281  5530 raft_consensus.cc:3060] T 0fde317f3ec547c3840e2fe1e07ec228 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:41.319974  5129 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.27.146.130:43623, user_credentials={real_user=slave}} blocked reactor thread for 49615.7us
W20260709 13:15:41.310125  5128 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.27.146.132:41391, user_credentials={real_user=slave}} blocked reactor thread for 55443.6us
I20260709 13:15:41.337136  5235 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34492 (request call id 21) took 1241 ms. Trace:
I20260709 13:15:41.327557  5528 raft_consensus.cc:515] T 0fde317f3ec547c3840e2fe1e07ec228 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:41.337709  5235 rpcz_store.cc:276] 0709 13:15:40.064071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.535129 (+471058us) service_pool.cc:224] Handling call
0709 13:15:40.619696 (+ 84567us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:40.627779 (+  8083us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:41.154526 (+526747us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:41.262970 (+108444us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:41.305248 (+ 42278us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:41.342886  5130 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.27.146.131:40847, user_credentials={real_user=slave}} blocked reactor thread for 85889us
I20260709 13:15:41.344763  5302 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37734 (request call id 24) took 1150 ms. Trace:
I20260709 13:15:41.345289  5302 rpcz_store.cc:276] 0709 13:15:40.194598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.561825 (+367227us) service_pool.cc:224] Handling call
0709 13:15:40.593124 (+ 31299us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:40.593373 (+   249us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:41.148329 (+554956us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:41.343874 (+195545us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:41.344547 (+   673us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:41.350776  5395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde317f3ec547c3840e2fe1e07ec228" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:41.351742  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f5415006bb4218b579d580f0b9ff68" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:41.352797  5395 raft_consensus.cc:2393] T 0fde317f3ec547c3840e2fe1e07ec228 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in current term 1: Already voted for candidate c4b52f14f9154b5a86f76fe58e4c235e in this term.
W20260709 13:15:41.354610  5434 leader_election.cc:343] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.355243  5434 leader_election.cc:304] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0; no voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:41.357300  5524 raft_consensus.cc:2749] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:41.359176  5231 tablet_service.cc:1511] Processing CreateTablet for tablet 02dba91c167a418daee105670577c8aa (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:15:41.361892  5515 tablet_bootstrap.cc:492] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
I20260709 13:15:41.363168  5515 ts_tablet_manager.cc:1403] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.254s	user 0.030s	sys 0.008s
I20260709 13:15:41.363946  5231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02dba91c167a418daee105670577c8aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.363816  5233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34492 (request call id 26) took 1080 ms. Trace:
I20260709 13:15:41.364841  5233 rpcz_store.cc:276] 0709 13:15:40.283782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.647111 (+363329us) service_pool.cc:224] Handling call
0709 13:15:40.649015 (+  1904us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:40.649130 (+   115us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:41.143205 (+494075us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:41.310739 (+167534us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:41.363616 (+ 52877us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:41.367027  5515 raft_consensus.cc:359] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:41.367893  5515 raft_consensus.cc:385] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.368230  5515 raft_consensus.cc:740] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.368960  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde317f3ec547c3840e2fe1e07ec228" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:41.369082  5515 consensus_queue.cc:260] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:41.370959  5528 leader_election.cc:290] T 0fde317f3ec547c3840e2fe1e07ec228 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 election: Requested vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:41.372356  5468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde317f3ec547c3840e2fe1e07ec228" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:15:41.373016  5468 raft_consensus.cc:3060] T 0fde317f3ec547c3840e2fe1e07ec228 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.377173  5541 raft_consensus.cc:515] T 4791d524d10e495fb14f6fd27fcc2218 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:41.380921  5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde317f3ec547c3840e2fe1e07ec228" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
I20260709 13:15:41.381933  5524 raft_consensus.cc:493] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.382498  5524 raft_consensus.cc:515] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:41.385368  5524 leader_election.cc:290] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:41.386305  5468 raft_consensus.cc:2468] T 0fde317f3ec547c3840e2fe1e07ec228 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 1.
I20260709 13:15:41.387987  5358 leader_election.cc:304] T 0fde317f3ec547c3840e2fe1e07ec228 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:41.390056  5395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4791d524d10e495fb14f6fd27fcc2218" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:15:41.390727  5395 raft_consensus.cc:3060] T 4791d524d10e495fb14f6fd27fcc2218 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.397333  5528 raft_consensus.cc:2804] T 0fde317f3ec547c3840e2fe1e07ec228 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:15:41.398720  5128 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.27.146.132:41391, user_credentials={real_user=slave}} blocked reactor thread for 43511.9us
I20260709 13:15:41.404316  5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e035a21aa4d43857f541259fa71b9" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
W20260709 13:15:41.408648  5434 leader_election.cc:343] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.410434  5515 ts_tablet_manager.cc:1434] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.004s
I20260709 13:15:41.411460  5530 raft_consensus.cc:515] T 0fde317f3ec547c3840e2fe1e07ec228 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:41.413106  5468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4791d524d10e495fb14f6fd27fcc2218" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:15:41.414691  5395 raft_consensus.cc:2468] T 4791d524d10e495fb14f6fd27fcc2218 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 1.
W20260709 13:15:41.414768  5284 leader_election.cc:343] T 4791d524d10e495fb14f6fd27fcc2218 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.416109  5380 tablet_service.cc:1511] Processing CreateTablet for tablet 02dba91c167a418daee105670577c8aa (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:15:41.417841  5380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02dba91c167a418daee105670577c8aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.403524  5528 raft_consensus.cc:697] T 0fde317f3ec547c3840e2fe1e07ec228 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 LEADER]: Becoming Leader. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Running, Role: LEADER
I20260709 13:15:41.419113  5541 leader_election.cc:290] T 4791d524d10e495fb14f6fd27fcc2218 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Requested vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:41.419687  5528 consensus_queue.cc:237] T 0fde317f3ec547c3840e2fe1e07ec228 P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:41.425951  5514 tablet_bootstrap.cc:492] T 480c812524814775bbf2823e53a996ed P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:41.427438  5455 tablet_service.cc:1511] Processing CreateTablet for tablet 5b17eb476da34f05b466923d9c48cc2d (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:15:41.429813  5455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b17eb476da34f05b466923d9c48cc2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.430328  5246 raft_consensus.cc:2393] T 0fde317f3ec547c3840e2fe1e07ec228 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c4b52f14f9154b5a86f76fe58e4c235e in current term 1: Already voted for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in this term.
I20260709 13:15:41.429503  5286 leader_election.cc:304] T 4791d524d10e495fb14f6fd27fcc2218 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 77789aa45dc5463c82b73504fef4b4e0
I20260709 13:15:41.432476  5514 ts_tablet_manager.cc:1403] T 480c812524814775bbf2823e53a996ed P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.258s	user 0.019s	sys 0.023s
I20260709 13:15:41.438388  5395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e035a21aa4d43857f541259fa71b9" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:41.439724  5541 raft_consensus.cc:2804] T 4791d524d10e495fb14f6fd27fcc2218 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:41.440599  5541 raft_consensus.cc:697] T 4791d524d10e495fb14f6fd27fcc2218 P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Becoming Leader. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Running, Role: LEADER
W20260709 13:15:41.441118  5434 leader_election.cc:343] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.441529  5541 consensus_queue.cc:237] T 4791d524d10e495fb14f6fd27fcc2218 P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:41.442255  5468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde317f3ec547c3840e2fe1e07ec228" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:15:41.443189  5468 raft_consensus.cc:2393] T 0fde317f3ec547c3840e2fe1e07ec228 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in current term 1: Already voted for candidate c4b52f14f9154b5a86f76fe58e4c235e in this term.
I20260709 13:15:41.443681  5515 tablet_bootstrap.cc:492] T 60775d8dc53c4243a0d744fd843c5cd5 P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
I20260709 13:15:41.441623  5434 leader_election.cc:304] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:41.444756  5530 leader_election.cc:290] T 0fde317f3ec547c3840e2fe1e07ec228 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 election: Requested vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:41.445645  5524 raft_consensus.cc:2749] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:41.447525  5395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fde317f3ec547c3840e2fe1e07ec228" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:15:41.448027  5517 tablet_bootstrap.cc:492] T 480c812524814775bbf2823e53a996ed P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:41.457198  5517 ts_tablet_manager.cc:1403] T 480c812524814775bbf2823e53a996ed P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.321s	user 0.015s	sys 0.011s
I20260709 13:15:41.452598  5231 tablet_service.cc:1511] Processing CreateTablet for tablet 5b17eb476da34f05b466923d9c48cc2d (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:15:41.459833  5231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b17eb476da34f05b466923d9c48cc2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.460054  5211 leader_election.cc:304] T 0fde317f3ec547c3840e2fe1e07ec228 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:41.461020  5530 raft_consensus.cc:2749] T 0fde317f3ec547c3840e2fe1e07ec228 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:41.470798  5514 raft_consensus.cc:359] T 480c812524814775bbf2823e53a996ed P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:41.476428  5514 raft_consensus.cc:385] T 480c812524814775bbf2823e53a996ed P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.476871  5514 raft_consensus.cc:740] T 480c812524814775bbf2823e53a996ed P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.478008  5514 consensus_queue.cc:260] T 480c812524814775bbf2823e53a996ed P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:41.475445  5308 tablet_service.cc:1511] Processing CreateTablet for tablet 5b17eb476da34f05b466923d9c48cc2d (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:15:41.481145  5308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b17eb476da34f05b466923d9c48cc2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.472672  5517 raft_consensus.cc:359] T 480c812524814775bbf2823e53a996ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:41.483139  5517 raft_consensus.cc:385] T 480c812524814775bbf2823e53a996ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.483525  5517 raft_consensus.cc:740] T 480c812524814775bbf2823e53a996ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.485528  5517 consensus_queue.cc:260] T 480c812524814775bbf2823e53a996ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:41.484874  5142 catalog_manager.cc:5697] T 0fde317f3ec547c3840e2fe1e07ec228 P c4b52f14f9154b5a86f76fe58e4c235e reported cstate change: term changed from 0 to 1, leader changed from <none> to c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131). New cstate: current_term: 1 leader_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:41.481261  5516 tablet_bootstrap.cc:492] T 60775d8dc53c4243a0d744fd843c5cd5 P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:41.487016  5516 ts_tablet_manager.cc:1403] T 60775d8dc53c4243a0d744fd843c5cd5 P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.266s	user 0.015s	sys 0.017s
I20260709 13:15:41.491173  5516 raft_consensus.cc:359] T 60775d8dc53c4243a0d744fd843c5cd5 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:41.492023  5516 raft_consensus.cc:385] T 60775d8dc53c4243a0d744fd843c5cd5 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.492340  5516 raft_consensus.cc:740] T 60775d8dc53c4243a0d744fd843c5cd5 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.499322  5514 ts_tablet_manager.cc:1434] T 480c812524814775bbf2823e53a996ed P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.066s	user 0.008s	sys 0.000s
I20260709 13:15:41.500852  5514 tablet_bootstrap.cc:492] T 8c46fa9b6c00424a8697f4536d1a3b0e P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
I20260709 13:15:41.504076  5515 tablet_bootstrap.cc:654] T 60775d8dc53c4243a0d744fd843c5cd5 P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.509122  5381 tablet_service.cc:1511] Processing CreateTablet for tablet 58438f196e6d42cc8780742faa222dc8 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:15:41.514232  5381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58438f196e6d42cc8780742faa222dc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.525110  5141 catalog_manager.cc:5697] T 4791d524d10e495fb14f6fd27fcc2218 P 2f45532f94a34efcb68a82db3dd69372 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130). New cstate: current_term: 1 leader_uuid: "2f45532f94a34efcb68a82db3dd69372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:41.528195  5452 tablet_service.cc:1511] Processing CreateTablet for tablet 58438f196e6d42cc8780742faa222dc8 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:15:41.529769  5452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58438f196e6d42cc8780742faa222dc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.531013  5517 ts_tablet_manager.cc:1434] T 480c812524814775bbf2823e53a996ed P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.073s	user 0.012s	sys 0.005s
I20260709 13:15:41.525242  5516 consensus_queue.cc:260] T 60775d8dc53c4243a0d744fd843c5cd5 P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:41.534986  5516 ts_tablet_manager.cc:1434] T 60775d8dc53c4243a0d744fd843c5cd5 P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.005s
I20260709 13:15:41.538605  5517 tablet_bootstrap.cc:492] T 60775d8dc53c4243a0d744fd843c5cd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:41.543973  5516 tablet_bootstrap.cc:492] T 29f5415006bb4218b579d580f0b9ff68 P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
I20260709 13:15:41.545017  5231 tablet_service.cc:1511] Processing CreateTablet for tablet 58438f196e6d42cc8780742faa222dc8 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:15:41.546756  5231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58438f196e6d42cc8780742faa222dc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.552529  5302 tablet_service.cc:1511] Processing CreateTablet for tablet 073bb9d9d62f462db20229a4924564e1 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:15:41.554462  5302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 073bb9d9d62f462db20229a4924564e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.561735  5514 tablet_bootstrap.cc:654] T 8c46fa9b6c00424a8697f4536d1a3b0e P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.565608  5516 tablet_bootstrap.cc:654] T 29f5415006bb4218b579d580f0b9ff68 P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.567201  5380 tablet_service.cc:1511] Processing CreateTablet for tablet 073bb9d9d62f462db20229a4924564e1 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:15:41.568581  5515 tablet_bootstrap.cc:492] T 60775d8dc53c4243a0d744fd843c5cd5 P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
I20260709 13:15:41.570701  5457 tablet_service.cc:1511] Processing CreateTablet for tablet 073bb9d9d62f462db20229a4924564e1 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:15:41.569144  5517 tablet_bootstrap.cc:654] T 60775d8dc53c4243a0d744fd843c5cd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.573681  5233 tablet_service.cc:1511] Processing CreateTablet for tablet 29ec9fd2ee334861a956e4d70d348b6d (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:15:41.572263  5457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 073bb9d9d62f462db20229a4924564e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.568799  5380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 073bb9d9d62f462db20229a4924564e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.579041  5310 tablet_service.cc:1511] Processing CreateTablet for tablet 29ec9fd2ee334861a956e4d70d348b6d (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:15:41.576800  5515 ts_tablet_manager.cc:1403] T 60775d8dc53c4243a0d744fd843c5cd5 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.148s	user 0.011s	sys 0.008s
I20260709 13:15:41.584264  5233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29ec9fd2ee334861a956e4d70d348b6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.589653  5377 tablet_service.cc:1511] Processing CreateTablet for tablet 29ec9fd2ee334861a956e4d70d348b6d (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:15:41.596129  5307 tablet_service.cc:1511] Processing CreateTablet for tablet c6bbe6dd572c4ea4aaf323c36eb05467 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:15:41.585901  5310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29ec9fd2ee334861a956e4d70d348b6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.607643  5454 tablet_service.cc:1511] Processing CreateTablet for tablet 39d465e757b14de1842d55d52271bceb (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:15:41.615126  5377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29ec9fd2ee334861a956e4d70d348b6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.613742  5379 tablet_service.cc:1511] Processing CreateTablet for tablet 39d465e757b14de1842d55d52271bceb (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:15:41.621905  5307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6bbe6dd572c4ea4aaf323c36eb05467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.623778  5455 tablet_service.cc:1511] Processing CreateTablet for tablet c6bbe6dd572c4ea4aaf323c36eb05467 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:15:41.611335  5235 tablet_service.cc:1511] Processing CreateTablet for tablet c6bbe6dd572c4ea4aaf323c36eb05467 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:15:41.626350  5235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6bbe6dd572c4ea4aaf323c36eb05467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.626410  5234 tablet_service.cc:1511] Processing CreateTablet for tablet 39d465e757b14de1842d55d52271bceb (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:15:41.627914  5234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39d465e757b14de1842d55d52271bceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.623975  5454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39d465e757b14de1842d55d52271bceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.633579  5379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39d465e757b14de1842d55d52271bceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.633965  5455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6bbe6dd572c4ea4aaf323c36eb05467. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:41.635360  5192 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:41.649832  5517 tablet_bootstrap.cc:492] T 60775d8dc53c4243a0d744fd843c5cd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:41.599483  5515 raft_consensus.cc:359] T 60775d8dc53c4243a0d744fd843c5cd5 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:41.650555  5517 ts_tablet_manager.cc:1403] T 60775d8dc53c4243a0d744fd843c5cd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.112s	user 0.033s	sys 0.018s
I20260709 13:15:41.650756  5515 raft_consensus.cc:385] T 60775d8dc53c4243a0d744fd843c5cd5 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.651108  5515 raft_consensus.cc:740] T 60775d8dc53c4243a0d744fd843c5cd5 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.652143  5515 consensus_queue.cc:260] T 60775d8dc53c4243a0d744fd843c5cd5 P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:41.654501  5517 raft_consensus.cc:359] T 60775d8dc53c4243a0d744fd843c5cd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:41.655380  5517 raft_consensus.cc:385] T 60775d8dc53c4243a0d744fd843c5cd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.655750  5517 raft_consensus.cc:740] T 60775d8dc53c4243a0d744fd843c5cd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.664860  5514 tablet_bootstrap.cc:492] T 8c46fa9b6c00424a8697f4536d1a3b0e P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:41.664301  5517 consensus_queue.cc:260] T 60775d8dc53c4243a0d744fd843c5cd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:41.664412  5308 tablet_service.cc:1511] Processing CreateTablet for tablet 3e48fc9e60214121991b0bb473d174da (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:15:41.665522  5514 ts_tablet_manager.cc:1403] T 8c46fa9b6c00424a8697f4536d1a3b0e P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.165s	user 0.021s	sys 0.016s
I20260709 13:15:41.666502  5308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e48fc9e60214121991b0bb473d174da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.667156  5517 ts_tablet_manager.cc:1434] T 60775d8dc53c4243a0d744fd843c5cd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.004s
I20260709 13:15:41.668538  5541 raft_consensus.cc:493] T 60775d8dc53c4243a0d744fd843c5cd5 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.669212  5514 raft_consensus.cc:359] T 8c46fa9b6c00424a8697f4536d1a3b0e P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:41.670047  5514 raft_consensus.cc:385] T 8c46fa9b6c00424a8697f4536d1a3b0e P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.669703  5541 raft_consensus.cc:515] T 60775d8dc53c4243a0d744fd843c5cd5 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:41.672940  5515 ts_tablet_manager.cc:1434] T 60775d8dc53c4243a0d744fd843c5cd5 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.093s	user 0.009s	sys 0.000s
I20260709 13:15:41.674532  5515 tablet_bootstrap.cc:492] T f6cbde4ed3d14db5a1826609542ec5a4 P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
I20260709 13:15:41.679636  5384 tablet_service.cc:1511] Processing CreateTablet for tablet 3e48fc9e60214121991b0bb473d174da (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:15:41.681311  5384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e48fc9e60214121991b0bb473d174da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.681514  5452 tablet_service.cc:1511] Processing CreateTablet for tablet 3e48fc9e60214121991b0bb473d174da (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:15:41.683122  5452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e48fc9e60214121991b0bb473d174da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.686921  5395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60775d8dc53c4243a0d744fd843c5cd5" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:41.687029  5516 tablet_bootstrap.cc:492] T 29f5415006bb4218b579d580f0b9ff68 P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:41.687911  5395 raft_consensus.cc:2468] T 60775d8dc53c4243a0d744fd843c5cd5 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 0.
I20260709 13:15:41.688161  5516 ts_tablet_manager.cc:1403] T 29f5415006bb4218b579d580f0b9ff68 P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.145s	user 0.017s	sys 0.000s
I20260709 13:15:41.691642  5541 leader_election.cc:290] T 60775d8dc53c4243a0d744fd843c5cd5 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:41.696646  5517 tablet_bootstrap.cc:492] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:41.670403  5514 raft_consensus.cc:740] T 8c46fa9b6c00424a8697f4536d1a3b0e P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.700280  5516 raft_consensus.cc:359] T 29f5415006bb4218b579d580f0b9ff68 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:41.708309  5516 raft_consensus.cc:385] T 29f5415006bb4218b579d580f0b9ff68 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.708665  5516 raft_consensus.cc:740] T 29f5415006bb4218b579d580f0b9ff68 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.709715  5516 consensus_queue.cc:260] T 29f5415006bb4218b579d580f0b9ff68 P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:41.711701  5231 tablet_service.cc:1511] Processing CreateTablet for tablet b1ab7b32db51471796738b38f71b64df (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:15:41.711827  5514 consensus_queue.cc:260] T 8c46fa9b6c00424a8697f4536d1a3b0e P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:41.725474  5303 tablet_service.cc:1511] Processing CreateTablet for tablet b1ab7b32db51471796738b38f71b64df (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:15:41.728411  5516 ts_tablet_manager.cc:1434] T 29f5415006bb4218b579d580f0b9ff68 P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.040s	user 0.009s	sys 0.000s
I20260709 13:15:41.738273  5515 tablet_bootstrap.cc:654] T f6cbde4ed3d14db5a1826609542ec5a4 P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.738358  5303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1ab7b32db51471796738b38f71b64df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.739328  5381 tablet_service.cc:1511] Processing CreateTablet for tablet b1ab7b32db51471796738b38f71b64df (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:15:41.741573  5231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1ab7b32db51471796738b38f71b64df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.742514  5516 tablet_bootstrap.cc:492] T 480c812524814775bbf2823e53a996ed P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
I20260709 13:15:41.757879  5528 raft_consensus.cc:493] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.758556  5528 raft_consensus.cc:515] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:41.761317  5528 leader_election.cc:290] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:41.762755  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e80c7aca57e4dc6bdd366ef7501749f" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:41.751307  5514 ts_tablet_manager.cc:1434] T 8c46fa9b6c00424a8697f4536d1a3b0e P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.085s	user 0.006s	sys 0.004s
W20260709 13:15:41.767971  5360 leader_election.cc:343] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.788312  5234 tablet_service.cc:1511] Processing CreateTablet for tablet 6a1e233f50be40f78b9208537916e93c (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:15:41.799036  5234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a1e233f50be40f78b9208537916e93c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.800460  5514 tablet_bootstrap.cc:492] T f6cbde4ed3d14db5a1826609542ec5a4 P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
I20260709 13:15:41.779665  5381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1ab7b32db51471796738b38f71b64df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.805744  5307 tablet_service.cc:1511] Processing CreateTablet for tablet 6a1e233f50be40f78b9208537916e93c (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:15:41.807315  5307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a1e233f50be40f78b9208537916e93c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.807964  5377 tablet_service.cc:1511] Processing CreateTablet for tablet 73c339ffbbca40c78c31d33aa9bb9e38 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:15:41.809489  5377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73c339ffbbca40c78c31d33aa9bb9e38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.834859  5455 tablet_service.cc:1511] Processing CreateTablet for tablet 73c339ffbbca40c78c31d33aa9bb9e38 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:15:41.836830  5455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73c339ffbbca40c78c31d33aa9bb9e38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.790731  5517 tablet_bootstrap.cc:654] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.791556  5454 tablet_service.cc:1511] Processing CreateTablet for tablet 6a1e233f50be40f78b9208537916e93c (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:15:41.838809  5235 tablet_service.cc:1511] Processing CreateTablet for tablet 73c339ffbbca40c78c31d33aa9bb9e38 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:15:41.797318  5286 leader_election.cc:304] T 60775d8dc53c4243a0d744fd843c5cd5 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:41.840649  5235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73c339ffbbca40c78c31d33aa9bb9e38. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:41.840868  5286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:40847, user_credentials={real_user=slave}} blocked reactor thread for 43673.3us
I20260709 13:15:41.840994  5541 raft_consensus.cc:2804] T 60775d8dc53c4243a0d744fd843c5cd5 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:41.841612  5541 raft_consensus.cc:493] T 60775d8dc53c4243a0d744fd843c5cd5 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.842051  5541 raft_consensus.cc:3060] T 60775d8dc53c4243a0d744fd843c5cd5 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.842540  5454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a1e233f50be40f78b9208537916e93c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.847435  5515 tablet_bootstrap.cc:492] T f6cbde4ed3d14db5a1826609542ec5a4 P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
I20260709 13:15:41.847163  5528 consensus_queue.cc:1048] T 0fde317f3ec547c3840e2fe1e07ec228 P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:41.848174  5515 ts_tablet_manager.cc:1403] T f6cbde4ed3d14db5a1826609542ec5a4 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.174s	user 0.014s	sys 0.015s
I20260709 13:15:41.848822  5307 tablet_service.cc:1511] Processing CreateTablet for tablet 104c92d196fa45818108b633cbfaea4b (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:15:41.850510  5307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 104c92d196fa45818108b633cbfaea4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.855475  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60775d8dc53c4243a0d744fd843c5cd5" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:41.856252  5514 tablet_bootstrap.cc:654] T f6cbde4ed3d14db5a1826609542ec5a4 P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.856364  5246 raft_consensus.cc:2468] T 60775d8dc53c4243a0d744fd843c5cd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 0.
I20260709 13:15:41.858300  5524 raft_consensus.cc:493] T 480c812524814775bbf2823e53a996ed P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.858879  5524 raft_consensus.cc:515] T 480c812524814775bbf2823e53a996ed P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:41.860229  5516 tablet_bootstrap.cc:654] T 480c812524814775bbf2823e53a996ed P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.864470  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480c812524814775bbf2823e53a996ed" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:41.865960  5524 leader_election.cc:290] T 480c812524814775bbf2823e53a996ed P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
W20260709 13:15:41.868235  5433 leader_election.cc:343] T 480c812524814775bbf2823e53a996ed P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.872486  5546 raft_consensus.cc:493] T 29f5415006bb4218b579d580f0b9ff68 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.874349  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480c812524814775bbf2823e53a996ed" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:41.875157  5246 raft_consensus.cc:2468] T 480c812524814775bbf2823e53a996ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 0.
I20260709 13:15:41.877168  5434 leader_election.cc:304] T 480c812524814775bbf2823e53a996ed P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, 77789aa45dc5463c82b73504fef4b4e0; no voters: 2f45532f94a34efcb68a82db3dd69372
I20260709 13:15:41.871013  5541 raft_consensus.cc:515] T 60775d8dc53c4243a0d744fd843c5cd5 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:41.883680  5546 raft_consensus.cc:515] T 29f5415006bb4218b579d580f0b9ff68 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:41.884513  5395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60775d8dc53c4243a0d744fd843c5cd5" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:15:41.885316  5395 raft_consensus.cc:3060] T 60775d8dc53c4243a0d744fd843c5cd5 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.889410  5541 leader_election.cc:290] T 60775d8dc53c4243a0d744fd843c5cd5 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Requested vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:41.890488  5524 raft_consensus.cc:2804] T 480c812524814775bbf2823e53a996ed P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:41.890954  5524 raft_consensus.cc:493] T 480c812524814775bbf2823e53a996ed P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.891427  5524 raft_consensus.cc:3060] T 480c812524814775bbf2823e53a996ed P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.896456  5546 leader_election.cc:290] T 29f5415006bb4218b579d580f0b9ff68 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:41.904959  5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f5415006bb4218b579d580f0b9ff68" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:41.905141  5384 tablet_service.cc:1511] Processing CreateTablet for tablet 104c92d196fa45818108b633cbfaea4b (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:15:41.906751  5384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 104c92d196fa45818108b633cbfaea4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.911617  5457 tablet_service.cc:1511] Processing CreateTablet for tablet 104c92d196fa45818108b633cbfaea4b (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:15:41.912129  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60775d8dc53c4243a0d744fd843c5cd5" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
I20260709 13:15:41.912900  5246 raft_consensus.cc:3060] T 60775d8dc53c4243a0d744fd843c5cd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.913321  5457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 104c92d196fa45818108b633cbfaea4b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:41.907328  5286 leader_election.cc:343] T 29f5415006bb4218b579d580f0b9ff68 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.940131  5517 tablet_bootstrap.cc:492] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:41.940851  5517 ts_tablet_manager.cc:1403] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.245s	user 0.012s	sys 0.013s
I20260709 13:15:41.945387  5517 raft_consensus.cc:359] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:41.947520  5231 tablet_service.cc:1511] Processing CreateTablet for tablet f3f19e79faea4bdbae72383e79104b37 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:15:41.947671  5515 raft_consensus.cc:359] T f6cbde4ed3d14db5a1826609542ec5a4 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
W20260709 13:15:41.928155  5434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:41357, user_credentials={real_user=slave}} blocked reactor thread for 51079.2us
I20260709 13:15:41.949777  5570 raft_consensus.cc:493] T 8c46fa9b6c00424a8697f4536d1a3b0e P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.951287  5515 raft_consensus.cc:385] T f6cbde4ed3d14db5a1826609542ec5a4 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.948619  5517 raft_consensus.cc:385] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.956120  5231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3f19e79faea4bdbae72383e79104b37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.952677  5303 tablet_service.cc:1511] Processing CreateTablet for tablet f3f19e79faea4bdbae72383e79104b37 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:15:41.957578  5303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3f19e79faea4bdbae72383e79104b37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.957616  5452 tablet_service.cc:1511] Processing CreateTablet for tablet 3b01a00074004ddb87b1710a6555353b (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:15:41.959103  5452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b01a00074004ddb87b1710a6555353b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:41.952674  5381 tablet_service.cc:1511] Processing CreateTablet for tablet f3f19e79faea4bdbae72383e79104b37 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:15:41.960666  5381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3f19e79faea4bdbae72383e79104b37. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:41.961647  5284 consensus_peers.cc:597] T 4791d524d10e495fb14f6fd27fcc2218 P 2f45532f94a34efcb68a82db3dd69372 -> Peer 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391): Couldn't send request to peer 77789aa45dc5463c82b73504fef4b4e0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:41.962024  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e80c7aca57e4dc6bdd366ef7501749f" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:41.963701  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f5415006bb4218b579d580f0b9ff68" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:41.964428  5469 raft_consensus.cc:2468] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 0.
I20260709 13:15:41.953992  5515 raft_consensus.cc:740] T f6cbde4ed3d14db5a1826609542ec5a4 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.973562  5395 raft_consensus.cc:2468] T 60775d8dc53c4243a0d744fd843c5cd5 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 1.
I20260709 13:15:41.954686  5570 raft_consensus.cc:515] T 8c46fa9b6c00424a8697f4536d1a3b0e P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:41.942817  5524 raft_consensus.cc:515] T 480c812524814775bbf2823e53a996ed P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
W20260709 13:15:41.984162  5359 leader_election.cc:343] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.985092  5359 leader_election.cc:304] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b52f14f9154b5a86f76fe58e4c235e; no voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:41.986941  5528 raft_consensus.cc:2749] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:41.990224  5570 leader_election.cc:290] T 8c46fa9b6c00424a8697f4536d1a3b0e P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:41.991130  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c46fa9b6c00424a8697f4536d1a3b0e" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:41.993388  5524 leader_election.cc:290] T 480c812524814775bbf2823e53a996ed P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 election: Requested vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
W20260709 13:15:41.994385  5433 leader_election.cc:343] T 8c46fa9b6c00424a8697f4536d1a3b0e P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.968595  5515 consensus_queue.cc:260] T f6cbde4ed3d14db5a1826609542ec5a4 P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:41.955106  5517 raft_consensus.cc:740] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.996258  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480c812524814775bbf2823e53a996ed" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:15:41.996358  5286 leader_election.cc:304] T 60775d8dc53c4243a0d744fd843c5cd5 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:41.996551  5517 consensus_queue.cc:260] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:41.998036  5546 raft_consensus.cc:2804] T 60775d8dc53c4243a0d744fd843c5cd5 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:41.998569  5546 raft_consensus.cc:697] T 60775d8dc53c4243a0d744fd843c5cd5 P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Becoming Leader. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Running, Role: LEADER
W20260709 13:15:41.998591  5433 leader_election.cc:343] T 480c812524814775bbf2823e53a996ed P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.999668  5546 consensus_queue.cc:237] T 60775d8dc53c4243a0d744fd843c5cd5 P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:42.012914  5514 tablet_bootstrap.cc:492] T f6cbde4ed3d14db5a1826609542ec5a4 P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:42.013645  5514 ts_tablet_manager.cc:1403] T f6cbde4ed3d14db5a1826609542ec5a4 P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.214s	user 0.023s	sys 0.003s
I20260709 13:15:42.017287  5514 raft_consensus.cc:359] T f6cbde4ed3d14db5a1826609542ec5a4 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:42.018556  5234 tablet_service.cc:1511] Processing CreateTablet for tablet 3b01a00074004ddb87b1710a6555353b (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:15:42.025703  5517 ts_tablet_manager.cc:1434] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.084s	user 0.007s	sys 0.002s
I20260709 13:15:42.025871  5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480c812524814775bbf2823e53a996ed" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
I20260709 13:15:42.027102  5541 consensus_queue.cc:1048] T 4791d524d10e495fb14f6fd27fcc2218 P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:42.032159  5528 consensus_queue.cc:1048] T 0fde317f3ec547c3840e2fe1e07ec228 P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Connected to new peer: Peer: permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:42.035586  5517 tablet_bootstrap.cc:492] T d443132476914cd1958f499f68f8acd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:42.026559  5245 raft_consensus.cc:3060] T 480c812524814775bbf2823e53a996ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.045262  5395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c46fa9b6c00424a8697f4536d1a3b0e" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:42.045993  5515 ts_tablet_manager.cc:1434] T f6cbde4ed3d14db5a1826609542ec5a4 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.197s	user 0.005s	sys 0.004s
W20260709 13:15:42.051425  5434 leader_election.cc:343] T 8c46fa9b6c00424a8697f4536d1a3b0e P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.052194  5434 leader_election.cc:304] T 8c46fa9b6c00424a8697f4536d1a3b0e P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0; no voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:42.053299  5524 raft_consensus.cc:2749] T 8c46fa9b6c00424a8697f4536d1a3b0e P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:42.053891  5307 tablet_service.cc:1511] Processing CreateTablet for tablet 3b01a00074004ddb87b1710a6555353b (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:15:42.055801  5307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b01a00074004ddb87b1710a6555353b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.055626  5377 tablet_service.cc:1511] Processing CreateTablet for tablet c520b1f4431848d1967291be272086c5 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:15:42.057159  5377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c520b1f4431848d1967291be272086c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.058736  5516 tablet_bootstrap.cc:492] T 480c812524814775bbf2823e53a996ed P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:42.023603  5234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b01a00074004ddb87b1710a6555353b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.063210  5455 tablet_service.cc:1511] Processing CreateTablet for tablet c520b1f4431848d1967291be272086c5 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:15:42.063956  5530 raft_consensus.cc:493] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.064762  5455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c520b1f4431848d1967291be272086c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.064906  5530 raft_consensus.cc:515] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:42.021345  5514 raft_consensus.cc:385] T f6cbde4ed3d14db5a1826609542ec5a4 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.069327  5514 raft_consensus.cc:740] T f6cbde4ed3d14db5a1826609542ec5a4 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.070407  5514 consensus_queue.cc:260] T f6cbde4ed3d14db5a1826609542ec5a4 P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:42.073766  5530 leader_election.cc:290] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:42.017681  5246 raft_consensus.cc:2468] T 60775d8dc53c4243a0d744fd843c5cd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 1.
I20260709 13:15:42.075729  5516 ts_tablet_manager.cc:1403] T 480c812524814775bbf2823e53a996ed P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.317s	user 0.016s	sys 0.004s
I20260709 13:15:42.094794  5284 leader_election.cc:304] T 29f5415006bb4218b579d580f0b9ff68 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:42.098904  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f5415006bb4218b579d580f0b9ff68" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:42.099895  5469 raft_consensus.cc:2468] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 0.
I20260709 13:15:42.101436  5235 tablet_service.cc:1511] Processing CreateTablet for tablet c520b1f4431848d1967291be272086c5 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:15:42.103636  5235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c520b1f4431848d1967291be272086c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.106618  5575 raft_consensus.cc:2804] T 29f5415006bb4218b579d580f0b9ff68 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:42.107199  5575 raft_consensus.cc:493] T 29f5415006bb4218b579d580f0b9ff68 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.107597  5575 raft_consensus.cc:3060] T 29f5415006bb4218b579d580f0b9ff68 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.108270  5209 leader_election.cc:304] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, 77789aa45dc5463c82b73504fef4b4e0; no voters: 
I20260709 13:15:42.109519  5530 raft_consensus.cc:2804] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:42.110041  5530 raft_consensus.cc:493] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.110500  5530 raft_consensus.cc:3060] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.114769  5515 tablet_bootstrap.cc:492] T 7541727e0e0944a6b184ac464bcc6eee P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
I20260709 13:15:42.120903  5141 catalog_manager.cc:5697] T 60775d8dc53c4243a0d744fd843c5cd5 P 2f45532f94a34efcb68a82db3dd69372 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130). New cstate: current_term: 1 leader_uuid: "2f45532f94a34efcb68a82db3dd69372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:42.124306  5245 raft_consensus.cc:2468] T 480c812524814775bbf2823e53a996ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 1.
I20260709 13:15:42.128682  5516 raft_consensus.cc:359] T 480c812524814775bbf2823e53a996ed P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:42.152485  5516 raft_consensus.cc:385] T 480c812524814775bbf2823e53a996ed P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.151973  5530 raft_consensus.cc:515] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:42.152925  5516 raft_consensus.cc:740] T 480c812524814775bbf2823e53a996ed P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.153967  5516 consensus_queue.cc:260] T 480c812524814775bbf2823e53a996ed P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:42.155428  5530 leader_election.cc:290] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 election: Requested vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:42.130887  5514 ts_tablet_manager.cc:1434] T f6cbde4ed3d14db5a1826609542ec5a4 P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.117s	user 0.008s	sys 0.000s
I20260709 13:15:42.135367  5308 tablet_service.cc:1511] Processing CreateTablet for tablet 9c7fcfa184e1425c86c784dd9db4423e (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:15:42.156562  5434 leader_election.cc:304] T 480c812524814775bbf2823e53a996ed P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, 77789aa45dc5463c82b73504fef4b4e0; no voters: 2f45532f94a34efcb68a82db3dd69372
I20260709 13:15:42.157006  5308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c7fcfa184e1425c86c784dd9db4423e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.157294  5514 tablet_bootstrap.cc:492] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
I20260709 13:15:42.158273  5468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f5415006bb4218b579d580f0b9ff68" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:15:42.158985  5468 raft_consensus.cc:3060] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.160995  5524 raft_consensus.cc:2804] T 480c812524814775bbf2823e53a996ed P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:42.161553  5524 raft_consensus.cc:697] T 480c812524814775bbf2823e53a996ed P 77789aa45dc5463c82b73504fef4b4e0 [term 1 LEADER]: Becoming Leader. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Running, Role: LEADER
I20260709 13:15:42.162456  5524 consensus_queue.cc:237] T 480c812524814775bbf2823e53a996ed P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:42.165007  5546 raft_consensus.cc:493] T 480c812524814775bbf2823e53a996ed P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.165666  5546 raft_consensus.cc:515] T 480c812524814775bbf2823e53a996ed P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:42.166487  5517 tablet_bootstrap.cc:654] T d443132476914cd1958f499f68f8acd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.138077  5384 tablet_service.cc:1511] Processing CreateTablet for tablet 9c7fcfa184e1425c86c784dd9db4423e (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:15:42.134650  5575 raft_consensus.cc:515] T 29f5415006bb4218b579d580f0b9ff68 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:42.170938  5515 tablet_bootstrap.cc:654] T 7541727e0e0944a6b184ac464bcc6eee P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.171881  5575 leader_election.cc:290] T 29f5415006bb4218b579d580f0b9ff68 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Requested vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:42.175583  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480c812524814775bbf2823e53a996ed" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:42.176548  5546 leader_election.cc:290] T 480c812524814775bbf2823e53a996ed P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:42.177505  5570 raft_consensus.cc:493] T f6cbde4ed3d14db5a1826609542ec5a4 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.177619  5467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f5415006bb4218b579d580f0b9ff68" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:15:42.178186  5570 raft_consensus.cc:515] T f6cbde4ed3d14db5a1826609542ec5a4 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:42.179073  5516 ts_tablet_manager.cc:1434] T 480c812524814775bbf2823e53a996ed P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.087s	user 0.008s	sys 0.000s
I20260709 13:15:42.223984  5570 leader_election.cc:290] T f6cbde4ed3d14db5a1826609542ec5a4 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:42.224457  5457 tablet_service.cc:1511] Processing CreateTablet for tablet 9c7fcfa184e1425c86c784dd9db4423e (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:15:42.226132  5457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c7fcfa184e1425c86c784dd9db4423e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.229977  5395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6cbde4ed3d14db5a1826609542ec5a4" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:42.230960  5395 raft_consensus.cc:2468] T f6cbde4ed3d14db5a1826609542ec5a4 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 0.
I20260709 13:15:42.222074  5384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c7fcfa184e1425c86c784dd9db4423e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.229976  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6cbde4ed3d14db5a1826609542ec5a4" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:42.233773  5303 tablet_service.cc:1511] Processing CreateTablet for tablet 3e101cf4ae084c74af284008876e474e (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:15:42.238504  5381 tablet_service.cc:1511] Processing CreateTablet for tablet 3e101cf4ae084c74af284008876e474e (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:15:42.239564  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480c812524814775bbf2823e53a996ed" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:42.240003  5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f5415006bb4218b579d580f0b9ff68" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
I20260709 13:15:42.240527  5246 raft_consensus.cc:2393] T 480c812524814775bbf2823e53a996ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f45532f94a34efcb68a82db3dd69372 in current term 1: Already voted for candidate 77789aa45dc5463c82b73504fef4b4e0 in this term.
I20260709 13:15:42.240839  5245 raft_consensus.cc:2393] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f45532f94a34efcb68a82db3dd69372 in current term 1: Already voted for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in this term.
I20260709 13:15:42.241674  5514 tablet_bootstrap.cc:654] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.242430  5286 leader_election.cc:304] T 480c812524814775bbf2823e53a996ed P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, 77789aa45dc5463c82b73504fef4b4e0
W20260709 13:15:42.242874  5433 leader_election.cc:343] T f6cbde4ed3d14db5a1826609542ec5a4 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.243613  5546 raft_consensus.cc:3060] T 480c812524814775bbf2823e53a996ed P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.244158  5286 leader_election.cc:304] T 29f5415006bb4218b579d580f0b9ff68 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, 77789aa45dc5463c82b73504fef4b4e0
I20260709 13:15:42.245497  5575 raft_consensus.cc:2749] T 29f5415006bb4218b579d580f0b9ff68 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:42.236248  5303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e101cf4ae084c74af284008876e474e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.247807  5434 leader_election.cc:304] T f6cbde4ed3d14db5a1826609542ec5a4 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 2f45532f94a34efcb68a82db3dd69372
I20260709 13:15:42.251709  5516 tablet_bootstrap.cc:492] T d443132476914cd1958f499f68f8acd5 P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
I20260709 13:15:42.257280  5524 raft_consensus.cc:2804] T f6cbde4ed3d14db5a1826609542ec5a4 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:42.257784  5381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e101cf4ae084c74af284008876e474e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.257889  5524 raft_consensus.cc:493] T f6cbde4ed3d14db5a1826609542ec5a4 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.258538  5524 raft_consensus.cc:3060] T f6cbde4ed3d14db5a1826609542ec5a4 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.282272  5231 tablet_service.cc:1511] Processing CreateTablet for tablet 3e101cf4ae084c74af284008876e474e (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:15:42.285034  5231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e101cf4ae084c74af284008876e474e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.319044  5452 tablet_service.cc:1511] Processing CreateTablet for tablet 09e39d6f01a0444bb1aa42b5403943c8 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:15:42.336700  5468 raft_consensus.cc:2468] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 1.
I20260709 13:15:42.338960  5209 leader_election.cc:304] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, 77789aa45dc5463c82b73504fef4b4e0; no voters: 
I20260709 13:15:42.339860  5310 tablet_service.cc:1511] Processing CreateTablet for tablet 09e39d6f01a0444bb1aa42b5403943c8 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:15:42.340409  5530 raft_consensus.cc:2804] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:42.353286  5234 tablet_service.cc:1511] Processing CreateTablet for tablet 09e39d6f01a0444bb1aa42b5403943c8 (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:15:42.355119  5234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09e39d6f01a0444bb1aa42b5403943c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.355784  5310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09e39d6f01a0444bb1aa42b5403943c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.343008  5546 raft_consensus.cc:2749] T 480c812524814775bbf2823e53a996ed P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:42.408970  5524 raft_consensus.cc:515] T f6cbde4ed3d14db5a1826609542ec5a4 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:42.397120  5452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09e39d6f01a0444bb1aa42b5403943c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.427001  5515 tablet_bootstrap.cc:492] T 7541727e0e0944a6b184ac464bcc6eee P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
I20260709 13:15:42.435745  5380 tablet_service.cc:1511] Processing CreateTablet for tablet 3d6bcda036934682b5075c20b786026d (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:15:42.437309  5380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d6bcda036934682b5075c20b786026d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.431104  5515 ts_tablet_manager.cc:1403] T 7541727e0e0944a6b184ac464bcc6eee P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.317s	user 0.022s	sys 0.005s
I20260709 13:15:42.444559  5516 tablet_bootstrap.cc:654] T d443132476914cd1958f499f68f8acd5 P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.445518  5140 catalog_manager.cc:5697] T 480c812524814775bbf2823e53a996ed P 77789aa45dc5463c82b73504fef4b4e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132). New cstate: current_term: 1 leader_uuid: "77789aa45dc5463c82b73504fef4b4e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:42.449806  5454 tablet_service.cc:1511] Processing CreateTablet for tablet 3d6bcda036934682b5075c20b786026d (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:15:42.451382  5454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d6bcda036934682b5075c20b786026d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.416829  5530 raft_consensus.cc:697] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 LEADER]: Becoming Leader. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Running, Role: LEADER
I20260709 13:15:42.455377  5231 tablet_service.cc:1511] Processing CreateTablet for tablet 3d6bcda036934682b5075c20b786026d (DEFAULT_TABLE table=test-workload [id=93a59c4f548d40f89ba2879a507be648]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:15:42.456982  5231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d6bcda036934682b5075c20b786026d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:42.456485  5530 consensus_queue.cc:237] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:42.461964  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f5415006bb4218b579d580f0b9ff68" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:42.462940  5321 raft_consensus.cc:2393] T 29f5415006bb4218b579d580f0b9ff68 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in current term 1: Already voted for candidate 2f45532f94a34efcb68a82db3dd69372 in this term.
I20260709 13:15:42.464165  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f5415006bb4218b579d580f0b9ff68" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:15:42.465381  5320 raft_consensus.cc:2393] T 29f5415006bb4218b579d580f0b9ff68 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in current term 1: Already voted for candidate 2f45532f94a34efcb68a82db3dd69372 in this term.
I20260709 13:15:42.473670  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6cbde4ed3d14db5a1826609542ec5a4" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:15:42.442903  5515 raft_consensus.cc:359] T 7541727e0e0944a6b184ac464bcc6eee P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
W20260709 13:15:42.475626  5433 leader_election.cc:343] T f6cbde4ed3d14db5a1826609542ec5a4 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.475903  5515 raft_consensus.cc:385] T 7541727e0e0944a6b184ac464bcc6eee P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.476284  5515 raft_consensus.cc:740] T 7541727e0e0944a6b184ac464bcc6eee P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.477221  5515 consensus_queue.cc:260] T 7541727e0e0944a6b184ac464bcc6eee P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:42.483677  5395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6cbde4ed3d14db5a1826609542ec5a4" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:15:42.484422  5395 raft_consensus.cc:3060] T f6cbde4ed3d14db5a1826609542ec5a4 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.496820  5590 consensus_queue.cc:1048] T 60775d8dc53c4243a0d744fd843c5cd5 P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:42.500864  5524 leader_election.cc:290] T f6cbde4ed3d14db5a1826609542ec5a4 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 election: Requested vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:42.503068  5395 raft_consensus.cc:2468] T f6cbde4ed3d14db5a1826609542ec5a4 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 1.
I20260709 13:15:42.504695  5434 leader_election.cc:304] T f6cbde4ed3d14db5a1826609542ec5a4 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 2f45532f94a34efcb68a82db3dd69372
I20260709 13:15:42.516320  5514 tablet_bootstrap.cc:492] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:42.517488  5514 ts_tablet_manager.cc:1403] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.361s	user 0.030s	sys 0.028s
I20260709 13:15:42.508829  5524 raft_consensus.cc:2804] T f6cbde4ed3d14db5a1826609542ec5a4 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:42.534818  5516 tablet_bootstrap.cc:492] T d443132476914cd1958f499f68f8acd5 P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:42.535545  5516 ts_tablet_manager.cc:1403] T d443132476914cd1958f499f68f8acd5 P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.316s	user 0.018s	sys 0.005s
I20260709 13:15:42.536818  5517 tablet_bootstrap.cc:492] T d443132476914cd1958f499f68f8acd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:42.537412  5517 ts_tablet_manager.cc:1403] T d443132476914cd1958f499f68f8acd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.502s	user 0.018s	sys 0.021s
I20260709 13:15:42.537283  5590 consensus_queue.cc:1048] T 60775d8dc53c4243a0d744fd843c5cd5 P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:42.528347  5524 raft_consensus.cc:697] T f6cbde4ed3d14db5a1826609542ec5a4 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 LEADER]: Becoming Leader. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Running, Role: LEADER
I20260709 13:15:42.540506  5524 consensus_queue.cc:237] T f6cbde4ed3d14db5a1826609542ec5a4 P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:42.542901  5516 raft_consensus.cc:359] T d443132476914cd1958f499f68f8acd5 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:42.549638  5516 raft_consensus.cc:385] T d443132476914cd1958f499f68f8acd5 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.550017  5516 raft_consensus.cc:740] T d443132476914cd1958f499f68f8acd5 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.544330  5515 ts_tablet_manager.cc:1434] T 7541727e0e0944a6b184ac464bcc6eee P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.105s	user 0.009s	sys 0.000s
I20260709 13:15:42.552856  5570 consensus_queue.cc:1048] T 480c812524814775bbf2823e53a996ed P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:42.554437  5517 raft_consensus.cc:359] T d443132476914cd1958f499f68f8acd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:42.555394  5517 raft_consensus.cc:385] T d443132476914cd1958f499f68f8acd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.555739  5517 raft_consensus.cc:740] T d443132476914cd1958f499f68f8acd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.550869  5516 consensus_queue.cc:260] T d443132476914cd1958f499f68f8acd5 P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:42.556571  5517 consensus_queue.cc:260] T d443132476914cd1958f499f68f8acd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:42.558262  5515 tablet_bootstrap.cc:492] T bd6573fdc5bd411e8b0cbd3316ecaede P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
I20260709 13:15:42.558693  5516 ts_tablet_manager.cc:1434] T d443132476914cd1958f499f68f8acd5 P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:15:42.559029  5517 ts_tablet_manager.cc:1434] T d443132476914cd1958f499f68f8acd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.001s
I20260709 13:15:42.569340  5517 tablet_bootstrap.cc:492] T 8e80c7aca57e4dc6bdd366ef7501749f P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:42.551288  5514 raft_consensus.cc:359] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:42.583009  5514 raft_consensus.cc:385] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.583401  5514 raft_consensus.cc:740] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.584398  5514 consensus_queue.cc:260] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:42.587996  5514 ts_tablet_manager.cc:1434] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.068s	user 0.008s	sys 0.000s
I20260709 13:15:42.589373  5514 tablet_bootstrap.cc:492] T d443132476914cd1958f499f68f8acd5 P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
I20260709 13:15:42.594663  5517 tablet_bootstrap.cc:654] T 8e80c7aca57e4dc6bdd366ef7501749f P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.597144  5514 tablet_bootstrap.cc:654] T d443132476914cd1958f499f68f8acd5 P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.605826  5515 tablet_bootstrap.cc:654] T bd6573fdc5bd411e8b0cbd3316ecaede P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.616739  5516 tablet_bootstrap.cc:492] T 7541727e0e0944a6b184ac464bcc6eee P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
I20260709 13:15:42.630429  5524 consensus_queue.cc:1048] T 480c812524814775bbf2823e53a996ed P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:15:42.633319  5140 catalog_manager.cc:5697] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129). New cstate: current_term: 1 leader_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:42.640259  5192 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:42.642328  5517 tablet_bootstrap.cc:492] T 8e80c7aca57e4dc6bdd366ef7501749f P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:42.643091  5517 ts_tablet_manager.cc:1403] T 8e80c7aca57e4dc6bdd366ef7501749f P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.074s	user 0.007s	sys 0.007s
I20260709 13:15:42.664577  5143 catalog_manager.cc:5697] T f6cbde4ed3d14db5a1826609542ec5a4 P 77789aa45dc5463c82b73504fef4b4e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132). New cstate: current_term: 1 leader_uuid: "77789aa45dc5463c82b73504fef4b4e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:42.669814  5597 raft_consensus.cc:493] T d443132476914cd1958f499f68f8acd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.670651  5597 raft_consensus.cc:515] T d443132476914cd1958f499f68f8acd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:42.675347  5468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d443132476914cd1958f499f68f8acd5" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
W20260709 13:15:42.677878  5209 leader_election.cc:343] T d443132476914cd1958f499f68f8acd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.681301  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d443132476914cd1958f499f68f8acd5" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:42.682394  5321 raft_consensus.cc:2468] T d443132476914cd1958f499f68f8acd5 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 0.
I20260709 13:15:42.684863  5210 leader_election.cc:304] T d443132476914cd1958f499f68f8acd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 77789aa45dc5463c82b73504fef4b4e0
I20260709 13:15:42.686630  5598 raft_consensus.cc:2804] T d443132476914cd1958f499f68f8acd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:42.687211  5598 raft_consensus.cc:493] T d443132476914cd1958f499f68f8acd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.687726  5598 raft_consensus.cc:3060] T d443132476914cd1958f499f68f8acd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.688609  5528 raft_consensus.cc:493] T 7541727e0e0944a6b184ac464bcc6eee P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.689299  5528 raft_consensus.cc:515] T 7541727e0e0944a6b184ac464bcc6eee P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:42.692507  5528 leader_election.cc:290] T 7541727e0e0944a6b184ac464bcc6eee P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:42.693226  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7541727e0e0944a6b184ac464bcc6eee" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
W20260709 13:15:42.694653  5359 leader_election.cc:343] T 7541727e0e0944a6b184ac464bcc6eee P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.692768  5517 raft_consensus.cc:359] T 8e80c7aca57e4dc6bdd366ef7501749f P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:42.704224  5517 raft_consensus.cc:385] T 8e80c7aca57e4dc6bdd366ef7501749f P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.705585  5517 raft_consensus.cc:740] T 8e80c7aca57e4dc6bdd366ef7501749f P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.708268  5517 consensus_queue.cc:260] T 8e80c7aca57e4dc6bdd366ef7501749f P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:42.712178  5597 leader_election.cc:290] T d443132476914cd1958f499f68f8acd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:42.713794  5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7541727e0e0944a6b184ac464bcc6eee" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
W20260709 13:15:42.716287  5360 leader_election.cc:343] T 7541727e0e0944a6b184ac464bcc6eee P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.717048  5360 leader_election.cc:304] T 7541727e0e0944a6b184ac464bcc6eee P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b52f14f9154b5a86f76fe58e4c235e; no voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:42.720875  5517 ts_tablet_manager.cc:1434] T 8e80c7aca57e4dc6bdd366ef7501749f P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.077s	user 0.008s	sys 0.004s
I20260709 13:15:42.721360  5528 raft_consensus.cc:2749] T 7541727e0e0944a6b184ac464bcc6eee P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:42.723130  5517 tablet_bootstrap.cc:492] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:42.726907  5516 tablet_bootstrap.cc:654] T 7541727e0e0944a6b184ac464bcc6eee P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.730576  5515 tablet_bootstrap.cc:492] T bd6573fdc5bd411e8b0cbd3316ecaede P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
I20260709 13:15:42.733639  5598 raft_consensus.cc:515] T d443132476914cd1958f499f68f8acd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:42.742563  5514 tablet_bootstrap.cc:492] T d443132476914cd1958f499f68f8acd5 P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:42.743083  5514 ts_tablet_manager.cc:1403] T d443132476914cd1958f499f68f8acd5 P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.154s	user 0.017s	sys 0.004s
I20260709 13:15:42.738595  5515 ts_tablet_manager.cc:1403] T bd6573fdc5bd411e8b0cbd3316ecaede P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.181s	user 0.048s	sys 0.052s
I20260709 13:15:42.748082  5468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d443132476914cd1958f499f68f8acd5" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:15:42.749127  5515 raft_consensus.cc:359] T bd6573fdc5bd411e8b0cbd3316ecaede P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
W20260709 13:15:42.749758  5209 leader_election.cc:343] T d443132476914cd1958f499f68f8acd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.750036  5515 raft_consensus.cc:385] T bd6573fdc5bd411e8b0cbd3316ecaede P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.749971  5514 raft_consensus.cc:359] T d443132476914cd1958f499f68f8acd5 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:42.750703  5514 raft_consensus.cc:385] T d443132476914cd1958f499f68f8acd5 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.751123  5514 raft_consensus.cc:740] T d443132476914cd1958f499f68f8acd5 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.750566  5515 raft_consensus.cc:740] T bd6573fdc5bd411e8b0cbd3316ecaede P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.757169  5514 consensus_queue.cc:260] T d443132476914cd1958f499f68f8acd5 P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:42.750852  5598 leader_election.cc:290] T d443132476914cd1958f499f68f8acd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 election: Requested vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:42.761637  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d443132476914cd1958f499f68f8acd5" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:15:42.762272  5320 raft_consensus.cc:3060] T d443132476914cd1958f499f68f8acd5 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.764588  5514 ts_tablet_manager.cc:1434] T d443132476914cd1958f499f68f8acd5 P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.003s
I20260709 13:15:42.765864  5514 tablet_bootstrap.cc:492] T 436bb2869b55478b9c1cc99b5f83f981 P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
I20260709 13:15:42.772542  5515 consensus_queue.cc:260] T bd6573fdc5bd411e8b0cbd3316ecaede P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:42.771353  5320 raft_consensus.cc:2468] T d443132476914cd1958f499f68f8acd5 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 1.
I20260709 13:15:42.775780  5515 ts_tablet_manager.cc:1434] T bd6573fdc5bd411e8b0cbd3316ecaede P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.004s
I20260709 13:15:42.775604  5210 leader_election.cc:304] T d443132476914cd1958f499f68f8acd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 77789aa45dc5463c82b73504fef4b4e0
I20260709 13:15:42.777143  5515 tablet_bootstrap.cc:492] T fce0170182474e7dbe46361f5bf0eae9 P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
I20260709 13:15:42.778483  5598 raft_consensus.cc:2804] T d443132476914cd1958f499f68f8acd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:42.779227  5598 raft_consensus.cc:697] T d443132476914cd1958f499f68f8acd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 LEADER]: Becoming Leader. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Running, Role: LEADER
I20260709 13:15:42.780860  5598 consensus_queue.cc:237] T d443132476914cd1958f499f68f8acd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:42.782125  5514 tablet_bootstrap.cc:654] T 436bb2869b55478b9c1cc99b5f83f981 P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.788654  5514 tablet_bootstrap.cc:492] T 436bb2869b55478b9c1cc99b5f83f981 P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:42.789354  5514 ts_tablet_manager.cc:1403] T 436bb2869b55478b9c1cc99b5f83f981 P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.000s
I20260709 13:15:42.790504  5516 tablet_bootstrap.cc:492] T 7541727e0e0944a6b184ac464bcc6eee P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:42.791111  5516 ts_tablet_manager.cc:1403] T 7541727e0e0944a6b184ac464bcc6eee P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.175s	user 0.020s	sys 0.006s
I20260709 13:15:42.792795  5514 raft_consensus.cc:359] T 436bb2869b55478b9c1cc99b5f83f981 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:42.793757  5514 raft_consensus.cc:385] T 436bb2869b55478b9c1cc99b5f83f981 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.794121  5514 raft_consensus.cc:740] T 436bb2869b55478b9c1cc99b5f83f981 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.794975  5514 consensus_queue.cc:260] T 436bb2869b55478b9c1cc99b5f83f981 P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:42.797947  5514 ts_tablet_manager.cc:1434] T 436bb2869b55478b9c1cc99b5f83f981 P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:15:42.800189  5514 tablet_bootstrap.cc:492] T 3ba8874bed41499cadc73289e5bb4ad3 P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
I20260709 13:15:42.800806  5517 tablet_bootstrap.cc:654] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.794519  5516 raft_consensus.cc:359] T 7541727e0e0944a6b184ac464bcc6eee P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:42.801764  5516 raft_consensus.cc:385] T 7541727e0e0944a6b184ac464bcc6eee P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.802088  5516 raft_consensus.cc:740] T 7541727e0e0944a6b184ac464bcc6eee P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.806874  5516 consensus_queue.cc:260] T 7541727e0e0944a6b184ac464bcc6eee P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:42.812239  5514 tablet_bootstrap.cc:654] T 3ba8874bed41499cadc73289e5bb4ad3 P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.819108  5516 ts_tablet_manager.cc:1434] T 7541727e0e0944a6b184ac464bcc6eee P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:15:42.823366  5515 tablet_bootstrap.cc:654] T fce0170182474e7dbe46361f5bf0eae9 P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.830914  5143 catalog_manager.cc:5697] T d443132476914cd1958f499f68f8acd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129). New cstate: current_term: 1 leader_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:42.833545  5517 tablet_bootstrap.cc:492] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:42.834465  5517 ts_tablet_manager.cc:1403] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.112s	user 0.011s	sys 0.003s
I20260709 13:15:42.846994  5514 tablet_bootstrap.cc:492] T 3ba8874bed41499cadc73289e5bb4ad3 P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:42.847988  5514 ts_tablet_manager.cc:1403] T 3ba8874bed41499cadc73289e5bb4ad3 P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.048s	user 0.024s	sys 0.017s
I20260709 13:15:42.849857  5516 tablet_bootstrap.cc:492] T f6cbde4ed3d14db5a1826609542ec5a4 P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
I20260709 13:15:42.852064  5514 raft_consensus.cc:359] T 3ba8874bed41499cadc73289e5bb4ad3 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:42.853052  5514 raft_consensus.cc:385] T 3ba8874bed41499cadc73289e5bb4ad3 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.853415  5514 raft_consensus.cc:740] T 3ba8874bed41499cadc73289e5bb4ad3 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.854439  5514 consensus_queue.cc:260] T 3ba8874bed41499cadc73289e5bb4ad3 P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:42.858101  5517 raft_consensus.cc:359] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:42.858974  5517 raft_consensus.cc:385] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.859261  5517 raft_consensus.cc:740] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.860030  5524 raft_consensus.cc:493] T d443132476914cd1958f499f68f8acd5 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.860673  5524 raft_consensus.cc:515] T d443132476914cd1958f499f68f8acd5 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:42.860973  5517 consensus_queue.cc:260] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:42.863137  5524 leader_election.cc:290] T d443132476914cd1958f499f68f8acd5 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:42.866055  5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d443132476914cd1958f499f68f8acd5" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:42.866254  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d443132476914cd1958f499f68f8acd5" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:42.867152  5320 raft_consensus.cc:2393] T d443132476914cd1958f499f68f8acd5 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77789aa45dc5463c82b73504fef4b4e0 in current term 1: Already voted for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in this term.
I20260709 13:15:42.867229  5517 ts_tablet_manager.cc:1434] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.003s
I20260709 13:15:42.868852  5433 leader_election.cc:304] T d443132476914cd1958f499f68f8acd5 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0; no voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:42.869207  5517 tablet_bootstrap.cc:492] T 3ba8874bed41499cadc73289e5bb4ad3 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:42.870550  5524 raft_consensus.cc:3060] T d443132476914cd1958f499f68f8acd5 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.871424  5516 tablet_bootstrap.cc:654] T f6cbde4ed3d14db5a1826609542ec5a4 P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.877067  5517 tablet_bootstrap.cc:654] T 3ba8874bed41499cadc73289e5bb4ad3 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.881034  5514 ts_tablet_manager.cc:1434] T 3ba8874bed41499cadc73289e5bb4ad3 P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.001s
I20260709 13:15:42.881217  5515 tablet_bootstrap.cc:492] T fce0170182474e7dbe46361f5bf0eae9 P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
I20260709 13:15:42.882025  5515 ts_tablet_manager.cc:1403] T fce0170182474e7dbe46361f5bf0eae9 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.105s	user 0.020s	sys 0.022s
I20260709 13:15:42.882370  5514 tablet_bootstrap.cc:492] T 4791d524d10e495fb14f6fd27fcc2218 P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
I20260709 13:15:42.885600  5515 raft_consensus.cc:359] T fce0170182474e7dbe46361f5bf0eae9 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:42.886428  5515 raft_consensus.cc:385] T fce0170182474e7dbe46361f5bf0eae9 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.886484  5524 raft_consensus.cc:2749] T d443132476914cd1958f499f68f8acd5 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:42.886996  5515 raft_consensus.cc:740] T fce0170182474e7dbe46361f5bf0eae9 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.887568  5516 tablet_bootstrap.cc:492] T f6cbde4ed3d14db5a1826609542ec5a4 P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:42.888199  5516 ts_tablet_manager.cc:1403] T f6cbde4ed3d14db5a1826609542ec5a4 P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.039s	user 0.016s	sys 0.000s
I20260709 13:15:42.891722  5514 tablet_bootstrap.cc:654] T 4791d524d10e495fb14f6fd27fcc2218 P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.887974  5515 consensus_queue.cc:260] T fce0170182474e7dbe46361f5bf0eae9 P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:42.895540  5598 raft_consensus.cc:493] T 8e80c7aca57e4dc6bdd366ef7501749f P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.896116  5598 raft_consensus.cc:515] T 8e80c7aca57e4dc6bdd366ef7501749f P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:42.898095  5516 raft_consensus.cc:359] T f6cbde4ed3d14db5a1826609542ec5a4 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:42.899127  5516 raft_consensus.cc:385] T f6cbde4ed3d14db5a1826609542ec5a4 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.899462  5516 raft_consensus.cc:740] T f6cbde4ed3d14db5a1826609542ec5a4 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.901093  5394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e80c7aca57e4dc6bdd366ef7501749f" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:42.900620  5516 consensus_queue.cc:260] T f6cbde4ed3d14db5a1826609542ec5a4 P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:42.901898  5394 raft_consensus.cc:2468] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 0.
I20260709 13:15:42.907408  5515 ts_tablet_manager.cc:1434] T fce0170182474e7dbe46361f5bf0eae9 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:15:42.902667  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e80c7aca57e4dc6bdd366ef7501749f" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:42.910332  5516 ts_tablet_manager.cc:1434] T f6cbde4ed3d14db5a1826609542ec5a4 P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:15:42.903213  5598 leader_election.cc:290] T 8e80c7aca57e4dc6bdd366ef7501749f P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:42.912132  5516 tablet_bootstrap.cc:492] T c01a087c57254cf0822d574602320ab5 P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
I20260709 13:15:42.912479  5211 leader_election.cc:304] T 8e80c7aca57e4dc6bdd366ef7501749f P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
W20260709 13:15:42.913743  5210 leader_election.cc:343] T 8e80c7aca57e4dc6bdd366ef7501749f P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.914992  5598 raft_consensus.cc:2804] T 8e80c7aca57e4dc6bdd366ef7501749f P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:42.915459  5598 raft_consensus.cc:493] T 8e80c7aca57e4dc6bdd366ef7501749f P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.915870  5598 raft_consensus.cc:3060] T 8e80c7aca57e4dc6bdd366ef7501749f P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.918958  5515 tablet_bootstrap.cc:492] T 3ba8874bed41499cadc73289e5bb4ad3 P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
I20260709 13:15:42.905597  5514 tablet_bootstrap.cc:492] T 4791d524d10e495fb14f6fd27fcc2218 P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:42.922839  5514 ts_tablet_manager.cc:1403] T 4791d524d10e495fb14f6fd27fcc2218 P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.041s	user 0.007s	sys 0.013s
I20260709 13:15:42.923046  5516 tablet_bootstrap.cc:654] T c01a087c57254cf0822d574602320ab5 P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.924376  5320 raft_consensus.cc:3060] T f6cbde4ed3d14db5a1826609542ec5a4 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.926127  5514 raft_consensus.cc:359] T 4791d524d10e495fb14f6fd27fcc2218 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:42.926905  5514 raft_consensus.cc:385] T 4791d524d10e495fb14f6fd27fcc2218 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.927174  5514 raft_consensus.cc:740] T 4791d524d10e495fb14f6fd27fcc2218 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.933501  5598 raft_consensus.cc:515] T 8e80c7aca57e4dc6bdd366ef7501749f P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:42.939400  5524 consensus_queue.cc:1048] T f6cbde4ed3d14db5a1826609542ec5a4 P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:42.936940  5514 consensus_queue.cc:260] T 4791d524d10e495fb14f6fd27fcc2218 P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:42.947793  5598 leader_election.cc:290] T 8e80c7aca57e4dc6bdd366ef7501749f P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 election: Requested vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:42.949113  5394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e80c7aca57e4dc6bdd366ef7501749f" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:15:42.949601  5514 ts_tablet_manager.cc:1434] T 4791d524d10e495fb14f6fd27fcc2218 P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.004s
I20260709 13:15:42.949911  5394 raft_consensus.cc:3060] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:42.950523  5514 tablet_bootstrap.cc:492] T 57bbe622c9794d6fa61dd5f39cb3d306 P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
I20260709 13:15:42.958395  5516 tablet_bootstrap.cc:492] T c01a087c57254cf0822d574602320ab5 P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:42.959095  5516 ts_tablet_manager.cc:1403] T c01a087c57254cf0822d574602320ab5 P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.047s	user 0.018s	sys 0.011s
I20260709 13:15:42.959229  5514 tablet_bootstrap.cc:654] T 57bbe622c9794d6fa61dd5f39cb3d306 P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.959255  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e80c7aca57e4dc6bdd366ef7501749f" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
W20260709 13:15:42.964181  5210 leader_election.cc:343] T 8e80c7aca57e4dc6bdd366ef7501749f P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:42.965342  5515 tablet_bootstrap.cc:654] T 3ba8874bed41499cadc73289e5bb4ad3 P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:42.966359  5516 raft_consensus.cc:359] T c01a087c57254cf0822d574602320ab5 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:42.971279  5516 raft_consensus.cc:385] T c01a087c57254cf0822d574602320ab5 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:42.971678  5516 raft_consensus.cc:740] T c01a087c57254cf0822d574602320ab5 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:42.972620  5516 consensus_queue.cc:260] T c01a087c57254cf0822d574602320ab5 P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:42.971848  5597 consensus_queue.cc:1048] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:15:42.975095  5516 ts_tablet_manager.cc:1434] T c01a087c57254cf0822d574602320ab5 P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.004s
I20260709 13:15:42.970670  5394 raft_consensus.cc:2468] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 1.
I20260709 13:15:42.984472  5517 tablet_bootstrap.cc:492] T 3ba8874bed41499cadc73289e5bb4ad3 P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:42.984874  5211 leader_election.cc:304] T 8e80c7aca57e4dc6bdd366ef7501749f P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 2f45532f94a34efcb68a82db3dd69372
I20260709 13:15:42.986325  5597 raft_consensus.cc:2804] T 8e80c7aca57e4dc6bdd366ef7501749f P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:42.990713  5597 raft_consensus.cc:697] T 8e80c7aca57e4dc6bdd366ef7501749f P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 LEADER]: Becoming Leader. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Running, Role: LEADER
I20260709 13:15:42.991634  5597 consensus_queue.cc:237] T 8e80c7aca57e4dc6bdd366ef7501749f P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:42.985476  5517 ts_tablet_manager.cc:1403] T 3ba8874bed41499cadc73289e5bb4ad3 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.117s	user 0.018s	sys 0.017s
I20260709 13:15:42.996766  5516 tablet_bootstrap.cc:492] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
I20260709 13:15:43.006770  5515 tablet_bootstrap.cc:492] T 3ba8874bed41499cadc73289e5bb4ad3 P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
I20260709 13:15:43.007676  5515 ts_tablet_manager.cc:1403] T 3ba8874bed41499cadc73289e5bb4ad3 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.089s	user 0.031s	sys 0.014s
I20260709 13:15:43.011888  5515 raft_consensus.cc:359] T 3ba8874bed41499cadc73289e5bb4ad3 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:43.012598  5517 raft_consensus.cc:359] T 3ba8874bed41499cadc73289e5bb4ad3 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:43.013358  5515 raft_consensus.cc:385] T 3ba8874bed41499cadc73289e5bb4ad3 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.013962  5591 consensus_queue.cc:1048] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:43.015437  5517 raft_consensus.cc:385] T 3ba8874bed41499cadc73289e5bb4ad3 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.016531  5517 raft_consensus.cc:740] T 3ba8874bed41499cadc73289e5bb4ad3 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.015439  5515 raft_consensus.cc:740] T 3ba8874bed41499cadc73289e5bb4ad3 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.018321  5517 consensus_queue.cc:260] T 3ba8874bed41499cadc73289e5bb4ad3 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:43.019124  5515 consensus_queue.cc:260] T 3ba8874bed41499cadc73289e5bb4ad3 P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:43.035526  5514 tablet_bootstrap.cc:492] T 57bbe622c9794d6fa61dd5f39cb3d306 P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:43.036725  5515 ts_tablet_manager.cc:1434] T 3ba8874bed41499cadc73289e5bb4ad3 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.000s
I20260709 13:15:43.036846  5517 ts_tablet_manager.cc:1434] T 3ba8874bed41499cadc73289e5bb4ad3 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.040s	user 0.003s	sys 0.006s
I20260709 13:15:43.036806  5514 ts_tablet_manager.cc:1403] T 57bbe622c9794d6fa61dd5f39cb3d306 P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.086s	user 0.023s	sys 0.012s
I20260709 13:15:43.038719  5515 tablet_bootstrap.cc:492] T 436bb2869b55478b9c1cc99b5f83f981 P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
I20260709 13:15:43.041181  5528 raft_consensus.cc:493] T fce0170182474e7dbe46361f5bf0eae9 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.043816  5528 raft_consensus.cc:515] T fce0170182474e7dbe46361f5bf0eae9 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:43.044930  5575 raft_consensus.cc:493] T 7541727e0e0944a6b184ac464bcc6eee P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.046514  5517 tablet_bootstrap.cc:492] T 436bb2869b55478b9c1cc99b5f83f981 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:43.039676  5604 consensus_queue.cc:1048] T f6cbde4ed3d14db5a1826609542ec5a4 P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:15:43.046542  5575 raft_consensus.cc:515] T 7541727e0e0944a6b184ac464bcc6eee P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:43.052196  5528 leader_election.cc:290] T fce0170182474e7dbe46361f5bf0eae9 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:43.053099  5467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce0170182474e7dbe46361f5bf0eae9" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:43.054767  5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce0170182474e7dbe46361f5bf0eae9" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:43.055421  5515 tablet_bootstrap.cc:654] T 436bb2869b55478b9c1cc99b5f83f981 P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.056396  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7541727e0e0944a6b184ac464bcc6eee" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:43.054224  5575 leader_election.cc:290] T 7541727e0e0944a6b184ac464bcc6eee P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
W20260709 13:15:43.056730  5360 leader_election.cc:343] T fce0170182474e7dbe46361f5bf0eae9 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.057785  5395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7541727e0e0944a6b184ac464bcc6eee" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
W20260709 13:15:43.058040  5358 leader_election.cc:343] T fce0170182474e7dbe46361f5bf0eae9 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.058486  5395 raft_consensus.cc:2468] T 7541727e0e0944a6b184ac464bcc6eee P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 0.
W20260709 13:15:43.060488  5286 leader_election.cc:343] T 7541727e0e0944a6b184ac464bcc6eee P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.060700  5358 leader_election.cc:304] T fce0170182474e7dbe46361f5bf0eae9 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b52f14f9154b5a86f76fe58e4c235e; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, 77789aa45dc5463c82b73504fef4b4e0
I20260709 13:15:43.068135  5517 tablet_bootstrap.cc:654] T 436bb2869b55478b9c1cc99b5f83f981 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.068400  5516 tablet_bootstrap.cc:654] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.061372  5514 raft_consensus.cc:359] T 57bbe622c9794d6fa61dd5f39cb3d306 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:43.069557  5514 raft_consensus.cc:385] T 57bbe622c9794d6fa61dd5f39cb3d306 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.069649  5286 leader_election.cc:304] T 7541727e0e0944a6b184ac464bcc6eee P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:43.072167  5575 raft_consensus.cc:2804] T 7541727e0e0944a6b184ac464bcc6eee P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:43.072573  5575 raft_consensus.cc:493] T 7541727e0e0944a6b184ac464bcc6eee P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.072954  5575 raft_consensus.cc:3060] T 7541727e0e0944a6b184ac464bcc6eee P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.061573  5528 raft_consensus.cc:2749] T fce0170182474e7dbe46361f5bf0eae9 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:43.078686  5604 raft_consensus.cc:493] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.070675  5514 raft_consensus.cc:740] T 57bbe622c9794d6fa61dd5f39cb3d306 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.079330  5604 raft_consensus.cc:515] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:43.082226  5514 consensus_queue.cc:260] T 57bbe622c9794d6fa61dd5f39cb3d306 P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:43.086796  5514 ts_tablet_manager.cc:1434] T 57bbe622c9794d6fa61dd5f39cb3d306 P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 13:15:43.089972  5604 leader_election.cc:290] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:43.091423  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d841937b5db4e7fa656db32b84b9ca2" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:43.091943  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d841937b5db4e7fa656db32b84b9ca2" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
W20260709 13:15:43.093513  5433 leader_election.cc:343] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:43.095923  5434 leader_election.cc:343] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.096009  5142 catalog_manager.cc:5697] T 8e80c7aca57e4dc6bdd366ef7501749f P 538ff4bfbd0c4f04bcd800c4ee4845ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129). New cstate: current_term: 1 leader_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:43.097595  5434 leader_election.cc:304] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0; no voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:43.098985  5604 raft_consensus.cc:2749] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:43.095288  5575 raft_consensus.cc:515] T 7541727e0e0944a6b184ac464bcc6eee P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:43.103569  5575 leader_election.cc:290] T 7541727e0e0944a6b184ac464bcc6eee P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Requested vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:43.104476  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7541727e0e0944a6b184ac464bcc6eee" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
W20260709 13:15:43.107789  5286 leader_election.cc:343] T 7541727e0e0944a6b184ac464bcc6eee P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.107861  5395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7541727e0e0944a6b184ac464bcc6eee" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:15:43.109118  5395 raft_consensus.cc:3060] T 7541727e0e0944a6b184ac464bcc6eee P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.126196  5514 tablet_bootstrap.cc:492] T fce0170182474e7dbe46361f5bf0eae9 P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
I20260709 13:15:43.140851  5604 raft_consensus.cc:493] T 436bb2869b55478b9c1cc99b5f83f981 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.141440  5604 raft_consensus.cc:515] T 436bb2869b55478b9c1cc99b5f83f981 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:43.142139  5516 tablet_bootstrap.cc:492] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:43.142730  5516 ts_tablet_manager.cc:1403] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.152s	user 0.008s	sys 0.007s
I20260709 13:15:43.145211  5591 raft_consensus.cc:493] T 3ba8874bed41499cadc73289e5bb4ad3 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.145946  5591 raft_consensus.cc:515] T 3ba8874bed41499cadc73289e5bb4ad3 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:43.146484  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "436bb2869b55478b9c1cc99b5f83f981" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
W20260709 13:15:43.148262  5434 leader_election.cc:343] T 436bb2869b55478b9c1cc99b5f83f981 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.149665  5468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8874bed41499cadc73289e5bb4ad3" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:43.150363  5468 raft_consensus.cc:2468] T 3ba8874bed41499cadc73289e5bb4ad3 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 0.
I20260709 13:15:43.150658  5514 tablet_bootstrap.cc:654] T fce0170182474e7dbe46361f5bf0eae9 P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.152763  5209 leader_election.cc:304] T 3ba8874bed41499cadc73289e5bb4ad3 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, 77789aa45dc5463c82b73504fef4b4e0; no voters: 
I20260709 13:15:43.153700  5591 leader_election.cc:290] T 3ba8874bed41499cadc73289e5bb4ad3 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:43.154273  5591 raft_consensus.cc:2804] T 3ba8874bed41499cadc73289e5bb4ad3 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:43.146876  5516 raft_consensus.cc:359] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:43.154608  5591 raft_consensus.cc:493] T 3ba8874bed41499cadc73289e5bb4ad3 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.154968  5516 raft_consensus.cc:385] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.155048  5591 raft_consensus.cc:3060] T 3ba8874bed41499cadc73289e5bb4ad3 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.155303  5516 raft_consensus.cc:740] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.156150  5516 consensus_queue.cc:260] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:43.157048  5604 leader_election.cc:290] T 436bb2869b55478b9c1cc99b5f83f981 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:43.158946  5516 ts_tablet_manager.cc:1434] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.003s
I20260709 13:15:43.162323  5517 tablet_bootstrap.cc:492] T 436bb2869b55478b9c1cc99b5f83f981 P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:43.163213  5517 ts_tablet_manager.cc:1403] T 436bb2869b55478b9c1cc99b5f83f981 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.117s	user 0.017s	sys 0.010s
I20260709 13:15:43.164958  5515 tablet_bootstrap.cc:492] T 436bb2869b55478b9c1cc99b5f83f981 P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
I20260709 13:15:43.163224  5393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8874bed41499cadc73289e5bb4ad3" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:43.167588  5517 raft_consensus.cc:359] T 436bb2869b55478b9c1cc99b5f83f981 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:43.168541  5393 raft_consensus.cc:2468] T 3ba8874bed41499cadc73289e5bb4ad3 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 0.
I20260709 13:15:43.168655  5515 ts_tablet_manager.cc:1403] T 436bb2869b55478b9c1cc99b5f83f981 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.130s	user 0.016s	sys 0.004s
I20260709 13:15:43.168762  5517 raft_consensus.cc:385] T 436bb2869b55478b9c1cc99b5f83f981 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.169332  5517 raft_consensus.cc:740] T 436bb2869b55478b9c1cc99b5f83f981 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.170393  5517 consensus_queue.cc:260] T 436bb2869b55478b9c1cc99b5f83f981 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:43.170989  5394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "436bb2869b55478b9c1cc99b5f83f981" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:43.174127  5517 ts_tablet_manager.cc:1434] T 436bb2869b55478b9c1cc99b5f83f981 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:15:43.175702  5517 tablet_bootstrap.cc:492] T 7541727e0e0944a6b184ac464bcc6eee P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:43.176779  5591 raft_consensus.cc:515] T 3ba8874bed41499cadc73289e5bb4ad3 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
W20260709 13:15:43.179992  5434 leader_election.cc:343] T 436bb2869b55478b9c1cc99b5f83f981 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.180446  5394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8874bed41499cadc73289e5bb4ad3" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:15:43.181193  5394 raft_consensus.cc:3060] T 3ba8874bed41499cadc73289e5bb4ad3 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.167394  5395 raft_consensus.cc:2468] T 7541727e0e0944a6b184ac464bcc6eee P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 1.
I20260709 13:15:43.183271  5516 tablet_bootstrap.cc:492] T 8e80c7aca57e4dc6bdd366ef7501749f P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
I20260709 13:15:43.180505  5434 leader_election.cc:304] T 436bb2869b55478b9c1cc99b5f83f981 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:43.185647  5570 raft_consensus.cc:2749] T 436bb2869b55478b9c1cc99b5f83f981 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:43.187443  5286 leader_election.cc:304] T 7541727e0e0944a6b184ac464bcc6eee P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:43.189411  5598 consensus_queue.cc:1048] T d443132476914cd1958f499f68f8acd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:43.190816  5591 leader_election.cc:290] T 3ba8874bed41499cadc73289e5bb4ad3 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 election: Requested vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:43.191138  5546 raft_consensus.cc:2804] T 7541727e0e0944a6b184ac464bcc6eee P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:43.191709  5546 raft_consensus.cc:697] T 7541727e0e0944a6b184ac464bcc6eee P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Becoming Leader. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Running, Role: LEADER
I20260709 13:15:43.192698  5546 consensus_queue.cc:237] T 7541727e0e0944a6b184ac464bcc6eee P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:43.193331  5394 raft_consensus.cc:2468] T 3ba8874bed41499cadc73289e5bb4ad3 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 1.
I20260709 13:15:43.194752  5211 leader_election.cc:304] T 3ba8874bed41499cadc73289e5bb4ad3 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:43.195734  5591 raft_consensus.cc:2804] T 3ba8874bed41499cadc73289e5bb4ad3 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:43.196491  5591 raft_consensus.cc:697] T 3ba8874bed41499cadc73289e5bb4ad3 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 LEADER]: Becoming Leader. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Running, Role: LEADER
I20260709 13:15:43.191550  5516 tablet_bootstrap.cc:654] T 8e80c7aca57e4dc6bdd366ef7501749f P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.197386  5591 consensus_queue.cc:237] T 3ba8874bed41499cadc73289e5bb4ad3 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:43.206750  5517 tablet_bootstrap.cc:654] T 7541727e0e0944a6b184ac464bcc6eee P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.208578  5515 raft_consensus.cc:359] T 436bb2869b55478b9c1cc99b5f83f981 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:43.209374  5515 raft_consensus.cc:385] T 436bb2869b55478b9c1cc99b5f83f981 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.209672  5515 raft_consensus.cc:740] T 436bb2869b55478b9c1cc99b5f83f981 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.210412  5515 consensus_queue.cc:260] T 436bb2869b55478b9c1cc99b5f83f981 P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:43.214648  5515 ts_tablet_manager.cc:1434] T 436bb2869b55478b9c1cc99b5f83f981 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.000s
I20260709 13:15:43.215929  5515 tablet_bootstrap.cc:492] T 7c0e035a21aa4d43857f541259fa71b9 P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
I20260709 13:15:43.219573  5517 tablet_bootstrap.cc:492] T 7541727e0e0944a6b184ac464bcc6eee P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:43.220187  5517 ts_tablet_manager.cc:1403] T 7541727e0e0944a6b184ac464bcc6eee P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.045s	user 0.016s	sys 0.001s
I20260709 13:15:43.221889  5142 catalog_manager.cc:5697] T 7541727e0e0944a6b184ac464bcc6eee P 2f45532f94a34efcb68a82db3dd69372 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130). New cstate: current_term: 1 leader_uuid: "2f45532f94a34efcb68a82db3dd69372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:43.224030  5515 tablet_bootstrap.cc:654] T 7c0e035a21aa4d43857f541259fa71b9 P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.223795  5517 raft_consensus.cc:359] T 7541727e0e0944a6b184ac464bcc6eee P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:43.224547  5517 raft_consensus.cc:385] T 7541727e0e0944a6b184ac464bcc6eee P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.224825  5517 raft_consensus.cc:740] T 7541727e0e0944a6b184ac464bcc6eee P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.227289  5514 tablet_bootstrap.cc:492] T fce0170182474e7dbe46361f5bf0eae9 P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:43.227852  5514 ts_tablet_manager.cc:1403] T fce0170182474e7dbe46361f5bf0eae9 P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.121s	user 0.027s	sys 0.022s
I20260709 13:15:43.236522  5515 tablet_bootstrap.cc:492] T 7c0e035a21aa4d43857f541259fa71b9 P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
I20260709 13:15:43.237202  5515 ts_tablet_manager.cc:1403] T 7c0e035a21aa4d43857f541259fa71b9 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.022s	user 0.005s	sys 0.012s
I20260709 13:15:43.237372  5516 tablet_bootstrap.cc:492] T 8e80c7aca57e4dc6bdd366ef7501749f P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:43.237886  5516 ts_tablet_manager.cc:1403] T 8e80c7aca57e4dc6bdd366ef7501749f P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.006s
I20260709 13:15:43.231194  5514 raft_consensus.cc:359] T fce0170182474e7dbe46361f5bf0eae9 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:43.240446  5514 raft_consensus.cc:385] T fce0170182474e7dbe46361f5bf0eae9 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.240803  5514 raft_consensus.cc:740] T fce0170182474e7dbe46361f5bf0eae9 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.241709  5514 consensus_queue.cc:260] T fce0170182474e7dbe46361f5bf0eae9 P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:43.241854  5517 consensus_queue.cc:260] T 7541727e0e0944a6b184ac464bcc6eee P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:43.244053  5468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8874bed41499cadc73289e5bb4ad3" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:15:43.244680  5468 raft_consensus.cc:3060] T 3ba8874bed41499cadc73289e5bb4ad3 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.248911  5530 consensus_queue.cc:1048] T d443132476914cd1958f499f68f8acd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:43.253712  5517 ts_tablet_manager.cc:1434] T 7541727e0e0944a6b184ac464bcc6eee P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.033s	user 0.011s	sys 0.000s
I20260709 13:15:43.254992  5517 tablet_bootstrap.cc:492] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:43.256287  5515 raft_consensus.cc:359] T 7c0e035a21aa4d43857f541259fa71b9 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:43.257135  5515 raft_consensus.cc:385] T 7c0e035a21aa4d43857f541259fa71b9 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.257494  5515 raft_consensus.cc:740] T 7c0e035a21aa4d43857f541259fa71b9 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.258388  5515 consensus_queue.cc:260] T 7c0e035a21aa4d43857f541259fa71b9 P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:43.260830  5516 raft_consensus.cc:359] T 8e80c7aca57e4dc6bdd366ef7501749f P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:43.261790  5516 raft_consensus.cc:385] T 8e80c7aca57e4dc6bdd366ef7501749f P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.262156  5516 raft_consensus.cc:740] T 8e80c7aca57e4dc6bdd366ef7501749f P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.262641  5517 tablet_bootstrap.cc:654] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.263075  5516 consensus_queue.cc:260] T 8e80c7aca57e4dc6bdd366ef7501749f P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:43.254755  5468 raft_consensus.cc:2468] T 3ba8874bed41499cadc73289e5bb4ad3 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 1.
I20260709 13:15:43.263803  5143 catalog_manager.cc:5697] T 3ba8874bed41499cadc73289e5bb4ad3 P 538ff4bfbd0c4f04bcd800c4ee4845ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129). New cstate: current_term: 1 leader_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:43.266716  5514 ts_tablet_manager.cc:1434] T fce0170182474e7dbe46361f5bf0eae9 P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.003s
I20260709 13:15:43.270393  5516 ts_tablet_manager.cc:1434] T 8e80c7aca57e4dc6bdd366ef7501749f P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.000s
I20260709 13:15:43.271664  5516 tablet_bootstrap.cc:492] T bd6573fdc5bd411e8b0cbd3316ecaede P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
I20260709 13:15:43.271994  5514 tablet_bootstrap.cc:492] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
I20260709 13:15:43.275843  5604 raft_consensus.cc:493] T 4791d524d10e495fb14f6fd27fcc2218 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.276435  5604 raft_consensus.cc:515] T 4791d524d10e495fb14f6fd27fcc2218 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:43.278443  5528 raft_consensus.cc:493] T bd6573fdc5bd411e8b0cbd3316ecaede P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.278752  5604 leader_election.cc:290] T 4791d524d10e495fb14f6fd27fcc2218 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:43.279891  5515 ts_tablet_manager.cc:1434] T 7c0e035a21aa4d43857f541259fa71b9 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.002s
I20260709 13:15:43.280265  5394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4791d524d10e495fb14f6fd27fcc2218" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:43.280615  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4791d524d10e495fb14f6fd27fcc2218" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:43.283274  5515 tablet_bootstrap.cc:492] T 8c46fa9b6c00424a8697f4536d1a3b0e P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
I20260709 13:15:43.283594  5528 raft_consensus.cc:515] T bd6573fdc5bd411e8b0cbd3316ecaede P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:43.289096  5516 tablet_bootstrap.cc:654] T bd6573fdc5bd411e8b0cbd3316ecaede P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.290848  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6573fdc5bd411e8b0cbd3316ecaede" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:43.291683  5434 leader_election.cc:304] T 4791d524d10e495fb14f6fd27fcc2218 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0; no voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e
W20260709 13:15:43.292626  5360 leader_election.cc:343] T bd6573fdc5bd411e8b0cbd3316ecaede P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.292646  5604 raft_consensus.cc:2749] T 4791d524d10e495fb14f6fd27fcc2218 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:43.293341  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6573fdc5bd411e8b0cbd3316ecaede" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:43.286289  5528 leader_election.cc:290] T bd6573fdc5bd411e8b0cbd3316ecaede P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
W20260709 13:15:43.294978  5359 leader_election.cc:343] T bd6573fdc5bd411e8b0cbd3316ecaede P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.295485  5359 leader_election.cc:304] T bd6573fdc5bd411e8b0cbd3316ecaede P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b52f14f9154b5a86f76fe58e4c235e; no voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:43.296818  5528 raft_consensus.cc:2749] T bd6573fdc5bd411e8b0cbd3316ecaede P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:43.301086  5514 tablet_bootstrap.cc:654] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.307863  5515 tablet_bootstrap.cc:654] T 8c46fa9b6c00424a8697f4536d1a3b0e P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.310525  5517 tablet_bootstrap.cc:492] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:43.311542  5517 ts_tablet_manager.cc:1403] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.011s
I20260709 13:15:43.316421  5517 raft_consensus.cc:359] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:43.324743  5517 raft_consensus.cc:385] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.325280  5517 raft_consensus.cc:740] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.326615  5517 consensus_queue.cc:260] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:43.330335  5517 ts_tablet_manager.cc:1434] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:15:43.331280  5514 tablet_bootstrap.cc:492] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:43.331969  5514 ts_tablet_manager.cc:1403] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.061s	user 0.016s	sys 0.015s
I20260709 13:15:43.332432  5517 tablet_bootstrap.cc:492] T bdbcf0a951c24340ba91509df11fc4c7 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:43.335274  5514 raft_consensus.cc:359] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:43.336280  5514 raft_consensus.cc:385] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.336690  5514 raft_consensus.cc:740] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.338577  5591 raft_consensus.cc:493] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.339207  5591 raft_consensus.cc:515] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:43.339707  5546 raft_consensus.cc:493] T 57bbe622c9794d6fa61dd5f39cb3d306 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.340531  5546 raft_consensus.cc:515] T 57bbe622c9794d6fa61dd5f39cb3d306 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:43.341251  5517 tablet_bootstrap.cc:654] T bdbcf0a951c24340ba91509df11fc4c7 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.343462  5394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56fc1bf8741446b6ba1d4bb0c8fcb5ed" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:43.345331  5395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bbe622c9794d6fa61dd5f39cb3d306" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:43.348349  5546 leader_election.cc:290] T 57bbe622c9794d6fa61dd5f39cb3d306 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:43.349341  5546 raft_consensus.cc:493] T c01a087c57254cf0822d574602320ab5 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.349484  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56fc1bf8741446b6ba1d4bb0c8fcb5ed" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:43.350078  5546 raft_consensus.cc:515] T c01a087c57254cf0822d574602320ab5 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:43.350550  5321 raft_consensus.cc:2468] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 0.
I20260709 13:15:43.351723  5575 raft_consensus.cc:493] T 8e80c7aca57e4dc6bdd366ef7501749f P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.352610  5467 raft_consensus.cc:3060] T 4791d524d10e495fb14f6fd27fcc2218 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.352552  5575 raft_consensus.cc:515] T 8e80c7aca57e4dc6bdd366ef7501749f P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
W20260709 13:15:43.360970  5286 leader_election.cc:343] T 57bbe622c9794d6fa61dd5f39cb3d306 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.362629  5575 leader_election.cc:290] T 8e80c7aca57e4dc6bdd366ef7501749f P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
W20260709 13:15:43.365054  5211 leader_election.cc:343] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.367479  5394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e80c7aca57e4dc6bdd366ef7501749f" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:43.368814  5394 raft_consensus.cc:2393] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f45532f94a34efcb68a82db3dd69372 in current term 1: Already voted for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in this term.
I20260709 13:15:43.370712  5516 tablet_bootstrap.cc:492] T bd6573fdc5bd411e8b0cbd3316ecaede P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:43.371349  5516 ts_tablet_manager.cc:1403] T bd6573fdc5bd411e8b0cbd3316ecaede P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.100s	user 0.016s	sys 0.013s
I20260709 13:15:43.337672  5514 consensus_queue.cc:260] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:43.371656  5591 leader_election.cc:290] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:43.371382  5546 leader_election.cc:290] T c01a087c57254cf0822d574602320ab5 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:43.372776  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e80c7aca57e4dc6bdd366ef7501749f" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:43.374966  5516 raft_consensus.cc:359] T bd6573fdc5bd411e8b0cbd3316ecaede P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:43.375769  5516 raft_consensus.cc:385] T bd6573fdc5bd411e8b0cbd3316ecaede P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.376080  5516 raft_consensus.cc:740] T bd6573fdc5bd411e8b0cbd3316ecaede P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.376802  5516 consensus_queue.cc:260] T bd6573fdc5bd411e8b0cbd3316ecaede P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:43.379132  5516 ts_tablet_manager.cc:1434] T bd6573fdc5bd411e8b0cbd3316ecaede P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:15:43.370723  5515 tablet_bootstrap.cc:492] T 8c46fa9b6c00424a8697f4536d1a3b0e P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
I20260709 13:15:43.379897  5515 ts_tablet_manager.cc:1403] T 8c46fa9b6c00424a8697f4536d1a3b0e P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.099s	user 0.022s	sys 0.041s
I20260709 13:15:43.380321  5514 ts_tablet_manager.cc:1434] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.000s
I20260709 13:15:43.381659  5514 tablet_bootstrap.cc:492] T bdbcf0a951c24340ba91509df11fc4c7 P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
I20260709 13:15:43.383330  5515 raft_consensus.cc:359] T 8c46fa9b6c00424a8697f4536d1a3b0e P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:43.384148  5515 raft_consensus.cc:385] T 8c46fa9b6c00424a8697f4536d1a3b0e P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.384407  5515 raft_consensus.cc:740] T 8c46fa9b6c00424a8697f4536d1a3b0e P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.385149  5515 consensus_queue.cc:260] T 8c46fa9b6c00424a8697f4536d1a3b0e P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:43.387120  5210 leader_election.cc:304] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:43.391276  5516 tablet_bootstrap.cc:492] T e78312bda196492eae76f2673c979fee P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
I20260709 13:15:43.392376  5591 raft_consensus.cc:2804] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:43.392882  5591 raft_consensus.cc:493] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.393350  5591 raft_consensus.cc:3060] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.387684  5515 ts_tablet_manager.cc:1434] T 8c46fa9b6c00424a8697f4536d1a3b0e P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:15:43.395406  5515 tablet_bootstrap.cc:492] T 57bbe622c9794d6fa61dd5f39cb3d306 P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
I20260709 13:15:43.399957  5528 raft_consensus.cc:493] T 436bb2869b55478b9c1cc99b5f83f981 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.400743  5528 raft_consensus.cc:515] T 436bb2869b55478b9c1cc99b5f83f981 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:43.402928  5468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bbe622c9794d6fa61dd5f39cb3d306" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:43.403779  5468 raft_consensus.cc:2468] T 57bbe622c9794d6fa61dd5f39cb3d306 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 0.
I20260709 13:15:43.404413  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "436bb2869b55478b9c1cc99b5f83f981" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:43.405107  5469 raft_consensus.cc:2468] T 436bb2869b55478b9c1cc99b5f83f981 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 0.
I20260709 13:15:43.406008  5468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01a087c57254cf0822d574602320ab5" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:43.406452  5358 leader_election.cc:304] T 436bb2869b55478b9c1cc99b5f83f981 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:43.407459  5624 raft_consensus.cc:2804] T 436bb2869b55478b9c1cc99b5f83f981 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:43.407861  5624 raft_consensus.cc:493] T 436bb2869b55478b9c1cc99b5f83f981 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.408242  5284 leader_election.cc:304] T 57bbe622c9794d6fa61dd5f39cb3d306 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0; no voters: c4b52f14f9154b5a86f76fe58e4c235e
W20260709 13:15:43.409713  5284 leader_election.cc:343] T c01a087c57254cf0822d574602320ab5 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.389894  5394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01a087c57254cf0822d574602320ab5" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:43.408267  5624 raft_consensus.cc:3060] T 436bb2869b55478b9c1cc99b5f83f981 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.410647  5644 raft_consensus.cc:2804] T 57bbe622c9794d6fa61dd5f39cb3d306 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:43.411248  5644 raft_consensus.cc:493] T 57bbe622c9794d6fa61dd5f39cb3d306 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.411689  5644 raft_consensus.cc:3060] T 57bbe622c9794d6fa61dd5f39cb3d306 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.413193  5515 tablet_bootstrap.cc:654] T 57bbe622c9794d6fa61dd5f39cb3d306 P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.410650  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "436bb2869b55478b9c1cc99b5f83f981" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:43.416469  5246 raft_consensus.cc:2468] T 436bb2869b55478b9c1cc99b5f83f981 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 0.
I20260709 13:15:43.421090  5530 consensus_queue.cc:1048] T 8e80c7aca57e4dc6bdd366ef7501749f P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:43.423909  5644 raft_consensus.cc:515] T 57bbe622c9794d6fa61dd5f39cb3d306 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:43.388830  5286 leader_election.cc:304] T 8e80c7aca57e4dc6bdd366ef7501749f P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:43.425591  5546 raft_consensus.cc:3060] T 8e80c7aca57e4dc6bdd366ef7501749f P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.428166  5468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bbe622c9794d6fa61dd5f39cb3d306" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:15:43.428881  5468 raft_consensus.cc:3060] T 57bbe622c9794d6fa61dd5f39cb3d306 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.433205  5604 raft_consensus.cc:493] T fce0170182474e7dbe46361f5bf0eae9 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.433193  5517 tablet_bootstrap.cc:492] T bdbcf0a951c24340ba91509df11fc4c7 P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:43.434221  5517 ts_tablet_manager.cc:1403] T bdbcf0a951c24340ba91509df11fc4c7 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.102s	user 0.030s	sys 0.018s
I20260709 13:15:43.433818  5604 raft_consensus.cc:515] T fce0170182474e7dbe46361f5bf0eae9 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:43.437115  5516 tablet_bootstrap.cc:654] T e78312bda196492eae76f2673c979fee P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.437318  5604 leader_election.cc:290] T fce0170182474e7dbe46361f5bf0eae9 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:43.440184  5517 raft_consensus.cc:359] T bdbcf0a951c24340ba91509df11fc4c7 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:43.441114  5517 raft_consensus.cc:385] T bdbcf0a951c24340ba91509df11fc4c7 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.443603  5517 raft_consensus.cc:740] T bdbcf0a951c24340ba91509df11fc4c7 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.449410  5517 consensus_queue.cc:260] T bdbcf0a951c24340ba91509df11fc4c7 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:43.450019  5393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce0170182474e7dbe46361f5bf0eae9" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:43.450767  5393 raft_consensus.cc:2468] T fce0170182474e7dbe46361f5bf0eae9 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 0.
I20260709 13:15:43.443595  5515 tablet_bootstrap.cc:492] T 57bbe622c9794d6fa61dd5f39cb3d306 P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
I20260709 13:15:43.451591  5515 ts_tablet_manager.cc:1403] T 57bbe622c9794d6fa61dd5f39cb3d306 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.026s
I20260709 13:15:43.454873  5528 leader_election.cc:290] T 436bb2869b55478b9c1cc99b5f83f981 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:43.456637  5515 raft_consensus.cc:359] T 57bbe622c9794d6fa61dd5f39cb3d306 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:43.457628  5515 raft_consensus.cc:385] T 57bbe622c9794d6fa61dd5f39cb3d306 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.457998  5515 raft_consensus.cc:740] T 57bbe622c9794d6fa61dd5f39cb3d306 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.458618  5598 raft_consensus.cc:493] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.458783  5515 consensus_queue.cc:260] T 57bbe622c9794d6fa61dd5f39cb3d306 P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:43.460089  5434 leader_election.cc:304] T fce0170182474e7dbe46361f5bf0eae9 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:43.448323  5468 raft_consensus.cc:2468] T 57bbe622c9794d6fa61dd5f39cb3d306 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 1.
I20260709 13:15:43.452941  5517 ts_tablet_manager.cc:1434] T bdbcf0a951c24340ba91509df11fc4c7 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.004s
I20260709 13:15:43.461323  5515 ts_tablet_manager.cc:1434] T 57bbe622c9794d6fa61dd5f39cb3d306 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:15:43.460971  5604 raft_consensus.cc:2804] T fce0170182474e7dbe46361f5bf0eae9 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:43.462220  5604 raft_consensus.cc:493] T fce0170182474e7dbe46361f5bf0eae9 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.462556  5515 tablet_bootstrap.cc:492] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
I20260709 13:15:43.462633  5604 raft_consensus.cc:3060] T fce0170182474e7dbe46361f5bf0eae9 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.462991  5517 tablet_bootstrap.cc:492] T 7c0e035a21aa4d43857f541259fa71b9 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:43.459182  5598 raft_consensus.cc:515] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:43.468732  5284 leader_election.cc:304] T 57bbe622c9794d6fa61dd5f39cb3d306 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0; no voters: 
I20260709 13:15:43.469712  5575 raft_consensus.cc:2804] T 57bbe622c9794d6fa61dd5f39cb3d306 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:43.469954  5644 leader_election.cc:290] T 57bbe622c9794d6fa61dd5f39cb3d306 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Requested vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:43.477327  5546 raft_consensus.cc:2749] T 8e80c7aca57e4dc6bdd366ef7501749f P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:43.487188  5575 raft_consensus.cc:697] T 57bbe622c9794d6fa61dd5f39cb3d306 P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Becoming Leader. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Running, Role: LEADER
I20260709 13:15:43.488533  5575 consensus_queue.cc:237] T 57bbe622c9794d6fa61dd5f39cb3d306 P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:43.488821  5591 raft_consensus.cc:515] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:43.485839  5515 tablet_bootstrap.cc:654] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.494098  5624 raft_consensus.cc:515] T 436bb2869b55478b9c1cc99b5f83f981 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:43.496930  5524 raft_consensus.cc:493] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.503974  5524 raft_consensus.cc:515] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:43.504563  5140 catalog_manager.cc:5697] T 57bbe622c9794d6fa61dd5f39cb3d306 P 2f45532f94a34efcb68a82db3dd69372 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130). New cstate: current_term: 1 leader_uuid: "2f45532f94a34efcb68a82db3dd69372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:43.506280  5524 leader_election.cc:290] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:43.507136  5393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "068e5bd8f3ef45fc8a4a122e51537764" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:43.509685  5598 leader_election.cc:290] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:43.510691  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d841937b5db4e7fa656db32b84b9ca2" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
W20260709 13:15:43.512545  5210 leader_election.cc:343] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.507157  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "436bb2869b55478b9c1cc99b5f83f981" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:15:43.514333  5469 raft_consensus.cc:3060] T 436bb2869b55478b9c1cc99b5f83f981 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.516117  5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "068e5bd8f3ef45fc8a4a122e51537764" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
W20260709 13:15:43.516683  5286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:40847, user_credentials={real_user=slave}} blocked reactor thread for 127933us
I20260709 13:15:43.518507  5393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bbe622c9794d6fa61dd5f39cb3d306" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:15:43.519197  5393 raft_consensus.cc:3060] T 57bbe622c9794d6fa61dd5f39cb3d306 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.519894  5466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d841937b5db4e7fa656db32b84b9ca2" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:43.520905  5466 raft_consensus.cc:2468] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 0.
I20260709 13:15:43.389629  5514 tablet_bootstrap.cc:654] T bdbcf0a951c24340ba91509df11fc4c7 P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:43.524991  5434 leader_election.cc:343] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.503252  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce0170182474e7dbe46361f5bf0eae9" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
W20260709 13:15:43.527305  5286 leader_election.cc:343] T c01a087c57254cf0822d574602320ab5 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.527935  5286 leader_election.cc:304] T c01a087c57254cf0822d574602320ab5 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372; no voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:43.528290  5209 leader_election.cc:304] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, 77789aa45dc5463c82b73504fef4b4e0; no voters: 2f45532f94a34efcb68a82db3dd69372
I20260709 13:15:43.530079  5598 raft_consensus.cc:2804] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:43.530714  5598 raft_consensus.cc:493] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.530849  5648 raft_consensus.cc:2749] T c01a087c57254cf0822d574602320ab5 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:43.532132  5434 leader_election.cc:343] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.532856  5434 leader_election.cc:304] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:43.531234  5598 raft_consensus.cc:3060] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.537811  5393 raft_consensus.cc:2468] T 57bbe622c9794d6fa61dd5f39cb3d306 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 1.
I20260709 13:15:43.539141  5469 raft_consensus.cc:2468] T 436bb2869b55478b9c1cc99b5f83f981 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 1.
I20260709 13:15:43.539968  5570 raft_consensus.cc:2749] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:43.541399  5434 leader_election.cc:343] T fce0170182474e7dbe46361f5bf0eae9 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.540174  5604 raft_consensus.cc:515] T fce0170182474e7dbe46361f5bf0eae9 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:43.498731  5517 tablet_bootstrap.cc:654] T 7c0e035a21aa4d43857f541259fa71b9 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.548190  5515 tablet_bootstrap.cc:492] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
I20260709 13:15:43.549763  5515 ts_tablet_manager.cc:1403] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.088s	user 0.015s	sys 0.002s
I20260709 13:15:43.550570  5604 leader_election.cc:290] T fce0170182474e7dbe46361f5bf0eae9 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 election: Requested vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:43.548277  5514 tablet_bootstrap.cc:492] T bdbcf0a951c24340ba91509df11fc4c7 P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:43.552520  5514 ts_tablet_manager.cc:1403] T bdbcf0a951c24340ba91509df11fc4c7 P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.171s	user 0.014s	sys 0.001s
I20260709 13:15:43.556368  5358 leader_election.cc:304] T 436bb2869b55478b9c1cc99b5f83f981 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:43.556977  5515 raft_consensus.cc:359] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:43.557806  5515 raft_consensus.cc:385] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.558084  5515 raft_consensus.cc:740] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.558292  5646 raft_consensus.cc:2804] T 436bb2869b55478b9c1cc99b5f83f981 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:43.558880  5515 consensus_queue.cc:260] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:43.559211  5646 raft_consensus.cc:697] T 436bb2869b55478b9c1cc99b5f83f981 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 LEADER]: Becoming Leader. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Running, Role: LEADER
I20260709 13:15:43.560950  5514 raft_consensus.cc:359] T bdbcf0a951c24340ba91509df11fc4c7 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:43.561662  5514 raft_consensus.cc:385] T bdbcf0a951c24340ba91509df11fc4c7 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.560727  5646 consensus_queue.cc:237] T 436bb2869b55478b9c1cc99b5f83f981 P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:43.561940  5514 raft_consensus.cc:740] T bdbcf0a951c24340ba91509df11fc4c7 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.562670  5514 consensus_queue.cc:260] T bdbcf0a951c24340ba91509df11fc4c7 P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:43.565019  5514 ts_tablet_manager.cc:1434] T bdbcf0a951c24340ba91509df11fc4c7 P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:15:43.566056  5515 ts_tablet_manager.cc:1434] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:15:43.566365  5516 tablet_bootstrap.cc:492] T e78312bda196492eae76f2673c979fee P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:43.566092  5514 tablet_bootstrap.cc:492] T 4bc60d69f29e47689fd8fdf2b6aa836a P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
I20260709 13:15:43.567277  5515 tablet_bootstrap.cc:492] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
I20260709 13:15:43.567358  5516 ts_tablet_manager.cc:1403] T e78312bda196492eae76f2673c979fee P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.176s	user 0.035s	sys 0.070s
I20260709 13:15:43.571338  5516 raft_consensus.cc:359] T e78312bda196492eae76f2673c979fee P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:43.572189  5516 raft_consensus.cc:385] T e78312bda196492eae76f2673c979fee P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.572496  5516 raft_consensus.cc:740] T e78312bda196492eae76f2673c979fee P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.572829  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56fc1bf8741446b6ba1d4bb0c8fcb5ed" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:15:43.573547  5321 raft_consensus.cc:3060] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.573364  5516 consensus_queue.cc:260] T e78312bda196492eae76f2673c979fee P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:43.575285  5515 tablet_bootstrap.cc:654] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.579548  5530 consensus_queue.cc:1048] T 8e80c7aca57e4dc6bdd366ef7501749f P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:43.589046  5516 ts_tablet_manager.cc:1434] T e78312bda196492eae76f2673c979fee P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.002s
I20260709 13:15:43.590471  5516 tablet_bootstrap.cc:492] T 8c46fa9b6c00424a8697f4536d1a3b0e P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
I20260709 13:15:43.593113  5393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce0170182474e7dbe46361f5bf0eae9" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:15:43.593971  5393 raft_consensus.cc:3060] T fce0170182474e7dbe46361f5bf0eae9 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.597877  5516 tablet_bootstrap.cc:654] T 8c46fa9b6c00424a8697f4536d1a3b0e P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.600828  5514 tablet_bootstrap.cc:654] T 4bc60d69f29e47689fd8fdf2b6aa836a P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.605628  5515 tablet_bootstrap.cc:492] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
I20260709 13:15:43.606287  5515 ts_tablet_manager.cc:1403] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.039s	user 0.021s	sys 0.014s
I20260709 13:15:43.610774  5321 raft_consensus.cc:2468] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 1.
I20260709 13:15:43.611835  5515 raft_consensus.cc:359] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:43.612659  5515 raft_consensus.cc:385] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.613004  5515 raft_consensus.cc:740] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.613372  5210 leader_election.cc:304] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 
I20260709 13:15:43.613830  5515 consensus_queue.cc:260] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:43.615782  5530 raft_consensus.cc:2804] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:43.616318  5530 raft_consensus.cc:697] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 LEADER]: Becoming Leader. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Running, Role: LEADER
I20260709 13:15:43.616901  5515 ts_tablet_manager.cc:1434] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 13:15:43.617364  5530 consensus_queue.cc:237] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:43.617988  5624 leader_election.cc:290] T 436bb2869b55478b9c1cc99b5f83f981 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 election: Requested vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:43.619450  5515 tablet_bootstrap.cc:492] T f18f7cc1557b43b9adbf357e50e292a0 P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
I20260709 13:15:43.616348  5528 raft_consensus.cc:493] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.620958  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "436bb2869b55478b9c1cc99b5f83f981" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
I20260709 13:15:43.621086  5528 raft_consensus.cc:515] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:43.621707  5246 raft_consensus.cc:3060] T 436bb2869b55478b9c1cc99b5f83f981 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.624366  5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78312bda196492eae76f2673c979fee" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:43.625339  5591 leader_election.cc:290] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 election: Requested vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
W20260709 13:15:43.626036  5360 leader_election.cc:343] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.629256  5319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78312bda196492eae76f2673c979fee" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:43.630108  5319 raft_consensus.cc:2468] T e78312bda196492eae76f2673c979fee P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 0.
I20260709 13:15:43.630600  5394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56fc1bf8741446b6ba1d4bb0c8fcb5ed" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:15:43.631219  5394 raft_consensus.cc:3060] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.631412  5359 leader_election.cc:304] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:43.632704  5393 raft_consensus.cc:2468] T fce0170182474e7dbe46361f5bf0eae9 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 1.
I20260709 13:15:43.636484  5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce0170182474e7dbe46361f5bf0eae9" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
I20260709 13:15:43.640589  5604 raft_consensus.cc:493] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.642032  5604 raft_consensus.cc:515] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:43.644356  5604 leader_election.cc:290] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:43.645011  5655 raft_consensus.cc:2804] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:43.645520  5655 raft_consensus.cc:493] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.639112  5624 raft_consensus.cc:493] T 8c46fa9b6c00424a8697f4536d1a3b0e P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.645871  5655 raft_consensus.cc:3060] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.639779  5528 leader_election.cc:290] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
W20260709 13:15:43.654181  5192 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:43.658574  5246 raft_consensus.cc:2468] T 436bb2869b55478b9c1cc99b5f83f981 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 1.
I20260709 13:15:43.640586  5591 consensus_queue.cc:1048] T 3ba8874bed41499cadc73289e5bb4ad3 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 13:15:43.665657  5624 raft_consensus.cc:515] T 8c46fa9b6c00424a8697f4536d1a3b0e P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
W20260709 13:15:43.667672  5434 leader_election.cc:343] T fce0170182474e7dbe46361f5bf0eae9 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.668659  5434 leader_election.cc:304] T fce0170182474e7dbe46361f5bf0eae9 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:43.671335  5393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e035a21aa4d43857f541259fa71b9" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:43.671729  5604 raft_consensus.cc:2804] T fce0170182474e7dbe46361f5bf0eae9 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:43.672155  5393 raft_consensus.cc:2468] T 7c0e035a21aa4d43857f541259fa71b9 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 0.
I20260709 13:15:43.672345  5604 raft_consensus.cc:697] T fce0170182474e7dbe46361f5bf0eae9 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 LEADER]: Becoming Leader. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Running, Role: LEADER
I20260709 13:15:43.673349  5604 consensus_queue.cc:237] T fce0170182474e7dbe46361f5bf0eae9 P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:43.676388  5394 raft_consensus.cc:2468] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 1.
I20260709 13:15:43.678263  5624 leader_election.cc:290] T 8c46fa9b6c00424a8697f4536d1a3b0e P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:43.630376  5598 raft_consensus.cc:515] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:43.679100  5319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c46fa9b6c00424a8697f4536d1a3b0e" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
W20260709 13:15:43.680961  5359 leader_election.cc:343] T 8c46fa9b6c00424a8697f4536d1a3b0e P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.682302  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e035a21aa4d43857f541259fa71b9" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:43.683579  5319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d841937b5db4e7fa656db32b84b9ca2" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:15:43.684348  5515 tablet_bootstrap.cc:654] T f18f7cc1557b43b9adbf357e50e292a0 P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:43.685395  5210 leader_election.cc:343] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:43.691443  5434 leader_election.cc:343] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.693341  5598 leader_election.cc:290] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 election: Requested vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:43.695413  5546 raft_consensus.cc:493] T bd6573fdc5bd411e8b0cbd3316ecaede P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.742736  5591 raft_consensus.cc:493] T 7541727e0e0944a6b184ac464bcc6eee P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.744740  5546 raft_consensus.cc:515] T bd6573fdc5bd411e8b0cbd3316ecaede P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:43.747426  5517 tablet_bootstrap.cc:492] T 7c0e035a21aa4d43857f541259fa71b9 P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:43.748447  5517 ts_tablet_manager.cc:1403] T 7c0e035a21aa4d43857f541259fa71b9 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.286s	user 0.042s	sys 0.030s
I20260709 13:15:43.737643  5434 leader_election.cc:304] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:43.744833  5591 raft_consensus.cc:515] T 7541727e0e0944a6b184ac464bcc6eee P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:43.760304  5516 tablet_bootstrap.cc:492] T 8c46fa9b6c00424a8697f4536d1a3b0e P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:43.760888  5516 ts_tablet_manager.cc:1403] T 8c46fa9b6c00424a8697f4536d1a3b0e P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.171s	user 0.013s	sys 0.007s
I20260709 13:15:43.755295  5655 raft_consensus.cc:515] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:43.761924  5514 tablet_bootstrap.cc:492] T 4bc60d69f29e47689fd8fdf2b6aa836a P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:43.762493  5514 ts_tablet_manager.cc:1403] T 4bc60d69f29e47689fd8fdf2b6aa836a P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.197s	user 0.015s	sys 0.000s
I20260709 13:15:43.769693  5319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78312bda196492eae76f2673c979fee" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:15:43.770565  5319 raft_consensus.cc:3060] T e78312bda196492eae76f2673c979fee P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.771610  5604 raft_consensus.cc:2804] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:43.771968  5604 raft_consensus.cc:493] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.772198  5604 raft_consensus.cc:3060] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.774711  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78312bda196492eae76f2673c979fee" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
I20260709 13:15:43.775842  5395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6573fdc5bd411e8b0cbd3316ecaede" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:43.776551  5395 raft_consensus.cc:2468] T bd6573fdc5bd411e8b0cbd3316ecaede P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 0.
I20260709 13:15:43.778090  5286 leader_election.cc:304] T bd6573fdc5bd411e8b0cbd3316ecaede P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:43.779155  5575 raft_consensus.cc:2804] T bd6573fdc5bd411e8b0cbd3316ecaede P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:43.779552  5575 raft_consensus.cc:493] T bd6573fdc5bd411e8b0cbd3316ecaede P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:43.779858  5360 leader_election.cc:343] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.780933  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6573fdc5bd411e8b0cbd3316ecaede" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:43.779887  5575 raft_consensus.cc:3060] T bd6573fdc5bd411e8b0cbd3316ecaede P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.782048  5142 catalog_manager.cc:5697] T fce0170182474e7dbe46361f5bf0eae9 P 77789aa45dc5463c82b73504fef4b4e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132). New cstate: current_term: 1 leader_uuid: "77789aa45dc5463c82b73504fef4b4e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:43.783550  5648 consensus_queue.cc:1048] T 7541727e0e0944a6b184ac464bcc6eee P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:15:43.785182  5434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:40847, user_credentials={real_user=slave}} blocked reactor thread for 51463.9us
I20260709 13:15:43.786778  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d841937b5db4e7fa656db32b84b9ca2" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:15:43.787535  5469 raft_consensus.cc:3060] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.788139  5466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c46fa9b6c00424a8697f4536d1a3b0e" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:43.788233  5516 raft_consensus.cc:359] T 8c46fa9b6c00424a8697f4536d1a3b0e P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:43.789084  5516 raft_consensus.cc:385] T 8c46fa9b6c00424a8697f4536d1a3b0e P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.789520  5516 raft_consensus.cc:740] T 8c46fa9b6c00424a8697f4536d1a3b0e P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.789047  5466 raft_consensus.cc:2468] T 8c46fa9b6c00424a8697f4536d1a3b0e P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 0.
I20260709 13:15:43.794137  5598 raft_consensus.cc:493] T bdbcf0a951c24340ba91509df11fc4c7 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.794823  5598 raft_consensus.cc:515] T bdbcf0a951c24340ba91509df11fc4c7 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:43.766799  5546 leader_election.cc:290] T bd6573fdc5bd411e8b0cbd3316ecaede P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:43.766996  5655 leader_election.cc:290] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 election: Requested vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:43.798107  5598 leader_election.cc:290] T bdbcf0a951c24340ba91509df11fc4c7 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:43.797454  5140 catalog_manager.cc:5697] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 538ff4bfbd0c4f04bcd800c4ee4845ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129). New cstate: current_term: 1 leader_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:43.799201  5591 leader_election.cc:290] T 7541727e0e0944a6b184ac464bcc6eee P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:43.800006  5516 consensus_queue.cc:260] T 8c46fa9b6c00424a8697f4536d1a3b0e P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:43.800673  5591 consensus_queue.cc:1048] T 3ba8874bed41499cadc73289e5bb4ad3 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:43.800792  5358 leader_election.cc:304] T 8c46fa9b6c00424a8697f4536d1a3b0e P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 2f45532f94a34efcb68a82db3dd69372
I20260709 13:15:43.801438  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbcf0a951c24340ba91509df11fc4c7" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:43.801826  5516 ts_tablet_manager.cc:1434] T 8c46fa9b6c00424a8697f4536d1a3b0e P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 13:15:43.802294  5655 raft_consensus.cc:2804] T 8c46fa9b6c00424a8697f4536d1a3b0e P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:43.811105  5655 raft_consensus.cc:493] T 8c46fa9b6c00424a8697f4536d1a3b0e P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.811601  5655 raft_consensus.cc:3060] T 8c46fa9b6c00424a8697f4536d1a3b0e P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.820411  5466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbcf0a951c24340ba91509df11fc4c7" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:43.821290  5466 raft_consensus.cc:2468] T bdbcf0a951c24340ba91509df11fc4c7 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 0.
I20260709 13:15:43.827940  5209 leader_election.cc:304] T bdbcf0a951c24340ba91509df11fc4c7 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, 77789aa45dc5463c82b73504fef4b4e0; no voters: 
I20260709 13:15:43.807054  5517 raft_consensus.cc:359] T 7c0e035a21aa4d43857f541259fa71b9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:43.833431  5517 raft_consensus.cc:385] T 7c0e035a21aa4d43857f541259fa71b9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.833977  5517 raft_consensus.cc:740] T 7c0e035a21aa4d43857f541259fa71b9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.797503  5514 raft_consensus.cc:359] T 4bc60d69f29e47689fd8fdf2b6aa836a P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:43.834540  5514 raft_consensus.cc:385] T 4bc60d69f29e47689fd8fdf2b6aa836a P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.835660  5514 raft_consensus.cc:740] T 4bc60d69f29e47689fd8fdf2b6aa836a P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.814749  5575 raft_consensus.cc:515] T bd6573fdc5bd411e8b0cbd3316ecaede P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:43.803727  5395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7541727e0e0944a6b184ac464bcc6eee" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:43.802947  5516 tablet_bootstrap.cc:492] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
I20260709 13:15:43.841406  5515 tablet_bootstrap.cc:492] T f18f7cc1557b43b9adbf357e50e292a0 P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
W20260709 13:15:43.837934  5210 leader_election.cc:343] T bdbcf0a951c24340ba91509df11fc4c7 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.842211  5515 ts_tablet_manager.cc:1403] T f18f7cc1557b43b9adbf357e50e292a0 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.223s	user 0.009s	sys 0.010s
I20260709 13:15:43.832011  5604 raft_consensus.cc:515] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:43.845450  5604 leader_election.cc:290] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 election: Requested vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
W20260709 13:15:43.804435  5286 leader_election.cc:343] T bd6573fdc5bd411e8b0cbd3316ecaede P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:43.847937  5286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:41357, user_credentials={real_user=slave}} blocked reactor thread for 43547.8us
I20260709 13:15:43.850239  5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e035a21aa4d43857f541259fa71b9" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
I20260709 13:15:43.838517  5514 consensus_queue.cc:260] T 4bc60d69f29e47689fd8fdf2b6aa836a P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:43.803879  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7541727e0e0944a6b184ac464bcc6eee" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:43.852941  5514 ts_tablet_manager.cc:1434] T 4bc60d69f29e47689fd8fdf2b6aa836a P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.090s	user 0.009s	sys 0.000s
I20260709 13:15:43.853477  5210 leader_election.cc:304] T 7541727e0e0944a6b184ac464bcc6eee P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:43.854180  5514 tablet_bootstrap.cc:492] T f18f7cc1557b43b9adbf357e50e292a0 P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
I20260709 13:15:43.807668  5246 raft_consensus.cc:3060] T 7541727e0e0944a6b184ac464bcc6eee P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.864156  5517 consensus_queue.cc:260] T 7c0e035a21aa4d43857f541259fa71b9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:43.866847  5514 tablet_bootstrap.cc:654] T f18f7cc1557b43b9adbf357e50e292a0 P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.862277  5143 catalog_manager.cc:5697] T 436bb2869b55478b9c1cc99b5f83f981 P c4b52f14f9154b5a86f76fe58e4c235e reported cstate change: term changed from 0 to 1, leader changed from <none> to c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131). New cstate: current_term: 1 leader_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:43.838400  5530 raft_consensus.cc:2804] T bdbcf0a951c24340ba91509df11fc4c7 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:43.869536  5530 raft_consensus.cc:493] T bdbcf0a951c24340ba91509df11fc4c7 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.870087  5530 raft_consensus.cc:3060] T bdbcf0a951c24340ba91509df11fc4c7 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.868892  5245 raft_consensus.cc:3060] T 7c0e035a21aa4d43857f541259fa71b9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.872936  5394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e035a21aa4d43857f541259fa71b9" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:15:43.873674  5394 raft_consensus.cc:3060] T 7c0e035a21aa4d43857f541259fa71b9 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.877533  5515 raft_consensus.cc:359] T f18f7cc1557b43b9adbf357e50e292a0 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:43.878381  5515 raft_consensus.cc:385] T f18f7cc1557b43b9adbf357e50e292a0 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:43.878857  5515 raft_consensus.cc:740] T f18f7cc1557b43b9adbf357e50e292a0 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:43.879631  5515 consensus_queue.cc:260] T f18f7cc1557b43b9adbf357e50e292a0 P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:43.882052  5469 raft_consensus.cc:2468] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 1.
I20260709 13:15:43.886695  5244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6573fdc5bd411e8b0cbd3316ecaede" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
I20260709 13:15:43.885051  5575 leader_election.cc:290] T bd6573fdc5bd411e8b0cbd3316ecaede P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Requested vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:43.836443  5319 raft_consensus.cc:2468] T e78312bda196492eae76f2673c979fee P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 1.
I20260709 13:15:43.895650  5515 ts_tablet_manager.cc:1434] T f18f7cc1557b43b9adbf357e50e292a0 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.053s	user 0.009s	sys 0.002s
W20260709 13:15:43.895239  5286 leader_election.cc:343] T bd6573fdc5bd411e8b0cbd3316ecaede P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:43.896950  5515 tablet_bootstrap.cc:492] T 1db09971a25441c68427b8bea7e9c379 P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
I20260709 13:15:43.897131  5395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6573fdc5bd411e8b0cbd3316ecaede" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:15:43.897760  5209 leader_election.cc:304] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, 77789aa45dc5463c82b73504fef4b4e0; no voters: 2f45532f94a34efcb68a82db3dd69372
I20260709 13:15:43.899444  5598 raft_consensus.cc:2804] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:43.899895  5359 leader_election.cc:304] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:43.900301  5598 raft_consensus.cc:697] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 LEADER]: Becoming Leader. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Running, Role: LEADER
I20260709 13:15:43.900825  5624 raft_consensus.cc:2804] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:43.901326  5624 raft_consensus.cc:697] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e [term 1 LEADER]: Becoming Leader. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Running, Role: LEADER
I20260709 13:15:43.901369  5598 consensus_queue.cc:237] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:43.901844  5655 raft_consensus.cc:515] T 8c46fa9b6c00424a8697f4536d1a3b0e P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:43.902336  5624 consensus_queue.cc:237] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:43.904372  5515 tablet_bootstrap.cc:654] T 1db09971a25441c68427b8bea7e9c379 P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.897815  5395 raft_consensus.cc:3060] T bd6573fdc5bd411e8b0cbd3316ecaede P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.912441  5517 ts_tablet_manager.cc:1434] T 7c0e035a21aa4d43857f541259fa71b9 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.164s	user 0.006s	sys 0.003s
I20260709 13:15:43.913830  5517 tablet_bootstrap.cc:492] T e78312bda196492eae76f2673c979fee P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:43.914379  5516 tablet_bootstrap.cc:654] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:43.948077  5319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c46fa9b6c00424a8697f4536d1a3b0e" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:15:43.948949  5319 raft_consensus.cc:3060] T 8c46fa9b6c00424a8697f4536d1a3b0e P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.939224  5395 raft_consensus.cc:2468] T bd6573fdc5bd411e8b0cbd3316ecaede P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 1.
I20260709 13:15:43.957257  5286 leader_election.cc:304] T bd6573fdc5bd411e8b0cbd3316ecaede P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:43.959151  5648 raft_consensus.cc:2804] T bd6573fdc5bd411e8b0cbd3316ecaede P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:43.959847  5648 raft_consensus.cc:697] T bd6573fdc5bd411e8b0cbd3316ecaede P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Becoming Leader. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Running, Role: LEADER
I20260709 13:15:43.957545  5655 leader_election.cc:290] T 8c46fa9b6c00424a8697f4536d1a3b0e P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 election: Requested vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:43.960110  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c46fa9b6c00424a8697f4536d1a3b0e" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:15:43.960855  5469 raft_consensus.cc:3060] T 8c46fa9b6c00424a8697f4536d1a3b0e P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:43.963121  5646 consensus_queue.cc:1048] T 436bb2869b55478b9c1cc99b5f83f981 P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Connected to new peer: Peer: permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:43.960865  5648 consensus_queue.cc:237] T bd6573fdc5bd411e8b0cbd3316ecaede P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:43.968375  5591 raft_consensus.cc:2749] T 7541727e0e0944a6b184ac464bcc6eee P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:43.961899  5245 raft_consensus.cc:2468] T 7c0e035a21aa4d43857f541259fa71b9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 1.
I20260709 13:15:43.954680  5530 raft_consensus.cc:515] T bdbcf0a951c24340ba91509df11fc4c7 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:43.930399  5394 raft_consensus.cc:2468] T 7c0e035a21aa4d43857f541259fa71b9 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 1.
I20260709 13:15:43.984611  5575 consensus_queue.cc:1048] T 7541727e0e0944a6b184ac464bcc6eee P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:15:43.982805  5469 raft_consensus.cc:2468] T 8c46fa9b6c00424a8697f4536d1a3b0e P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 1.
I20260709 13:15:43.997850  5515 tablet_bootstrap.cc:492] T 1db09971a25441c68427b8bea7e9c379 P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
I20260709 13:15:43.994191  5434 leader_election.cc:304] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:43.998687  5515 ts_tablet_manager.cc:1403] T 1db09971a25441c68427b8bea7e9c379 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.102s	user 0.013s	sys 0.012s
I20260709 13:15:44.006630  5358 leader_election.cc:304] T 8c46fa9b6c00424a8697f4536d1a3b0e P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:44.007791  5516 tablet_bootstrap.cc:492] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:44.008459  5516 ts_tablet_manager.cc:1403] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.206s	user 0.020s	sys 0.011s
I20260709 13:15:44.008808  5655 raft_consensus.cc:2804] T 8c46fa9b6c00424a8697f4536d1a3b0e P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:44.009384  5655 raft_consensus.cc:697] T 8c46fa9b6c00424a8697f4536d1a3b0e P c4b52f14f9154b5a86f76fe58e4c235e [term 1 LEADER]: Becoming Leader. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Running, Role: LEADER
I20260709 13:15:44.009910  5530 leader_election.cc:290] T bdbcf0a951c24340ba91509df11fc4c7 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 election: Requested vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:44.010501  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbcf0a951c24340ba91509df11fc4c7" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:15:44.004822  5604 raft_consensus.cc:2804] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:44.011812  5604 raft_consensus.cc:697] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 LEADER]: Becoming Leader. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Running, Role: LEADER
I20260709 13:15:44.011974  5516 raft_consensus.cc:359] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
W20260709 13:15:44.012543  5210 leader_election.cc:343] T bdbcf0a951c24340ba91509df11fc4c7 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.012974  5516 raft_consensus.cc:385] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.013367  5516 raft_consensus.cc:740] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.010254  5655 consensus_queue.cc:237] T 8c46fa9b6c00424a8697f4536d1a3b0e P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:44.012862  5604 consensus_queue.cc:237] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:44.020417  5514 tablet_bootstrap.cc:492] T f18f7cc1557b43b9adbf357e50e292a0 P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:44.021171  5514 ts_tablet_manager.cc:1403] T f18f7cc1557b43b9adbf357e50e292a0 P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.167s	user 0.017s	sys 0.009s
I20260709 13:15:44.021798  5516 consensus_queue.cc:260] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:44.042066  5516 ts_tablet_manager.cc:1434] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.001s
I20260709 13:15:44.042491  5517 tablet_bootstrap.cc:654] T e78312bda196492eae76f2673c979fee P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.035748  5546 consensus_queue.cc:1048] T 57bbe622c9794d6fa61dd5f39cb3d306 P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:15:44.046327  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbcf0a951c24340ba91509df11fc4c7" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:15:44.051774  5469 raft_consensus.cc:3060] T bdbcf0a951c24340ba91509df11fc4c7 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.061990  5514 raft_consensus.cc:359] T f18f7cc1557b43b9adbf357e50e292a0 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:44.063167  5514 raft_consensus.cc:385] T f18f7cc1557b43b9adbf357e50e292a0 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.063608  5514 raft_consensus.cc:740] T f18f7cc1557b43b9adbf357e50e292a0 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.045167  5319 raft_consensus.cc:2468] T 8c46fa9b6c00424a8697f4536d1a3b0e P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 1.
I20260709 13:15:44.077067  5514 consensus_queue.cc:260] T f18f7cc1557b43b9adbf357e50e292a0 P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:44.078423  5516 tablet_bootstrap.cc:492] T f18f7cc1557b43b9adbf357e50e292a0 P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
I20260709 13:15:44.087301  5469 raft_consensus.cc:2468] T bdbcf0a951c24340ba91509df11fc4c7 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 1.
I20260709 13:15:44.089149  5209 leader_election.cc:304] T bdbcf0a951c24340ba91509df11fc4c7 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, 77789aa45dc5463c82b73504fef4b4e0; no voters: 2f45532f94a34efcb68a82db3dd69372
I20260709 13:15:44.090234  5663 raft_consensus.cc:2804] T bdbcf0a951c24340ba91509df11fc4c7 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:44.090951  5663 raft_consensus.cc:697] T bdbcf0a951c24340ba91509df11fc4c7 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 LEADER]: Becoming Leader. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Running, Role: LEADER
I20260709 13:15:44.092145  5663 consensus_queue.cc:237] T bdbcf0a951c24340ba91509df11fc4c7 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:44.107206  5570 raft_consensus.cc:493] T 4bc60d69f29e47689fd8fdf2b6aa836a P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.108130  5570 raft_consensus.cc:515] T 4bc60d69f29e47689fd8fdf2b6aa836a P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:44.110955  5570 leader_election.cc:290] T 4bc60d69f29e47689fd8fdf2b6aa836a P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:44.123229  5514 ts_tablet_manager.cc:1434] T f18f7cc1557b43b9adbf357e50e292a0 P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.102s	user 0.009s	sys 0.002s
I20260709 13:15:44.127483  5514 tablet_bootstrap.cc:492] T c01a087c57254cf0822d574602320ab5 P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
I20260709 13:15:44.135567  5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc60d69f29e47689fd8fdf2b6aa836a" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
W20260709 13:15:44.138288  5434 leader_election.cc:343] T 4bc60d69f29e47689fd8fdf2b6aa836a P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.146194  5515 raft_consensus.cc:359] T 1db09971a25441c68427b8bea7e9c379 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:44.147063  5515 raft_consensus.cc:385] T 1db09971a25441c68427b8bea7e9c379 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.147349  5515 raft_consensus.cc:740] T 1db09971a25441c68427b8bea7e9c379 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.150287  5515 consensus_queue.cc:260] T 1db09971a25441c68427b8bea7e9c379 P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:44.153968  5514 tablet_bootstrap.cc:654] T c01a087c57254cf0822d574602320ab5 P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.143138  5575 raft_consensus.cc:493] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.163414  5140 catalog_manager.cc:5697] T bd6573fdc5bd411e8b0cbd3316ecaede P 2f45532f94a34efcb68a82db3dd69372 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130). New cstate: current_term: 1 leader_uuid: "2f45532f94a34efcb68a82db3dd69372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:44.164565  5515 ts_tablet_manager.cc:1434] T 1db09971a25441c68427b8bea7e9c379 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.165s	user 0.010s	sys 0.000s
I20260709 13:15:44.168416  5546 consensus_queue.cc:1048] T 57bbe622c9794d6fa61dd5f39cb3d306 P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:15:44.176282  5517 tablet_bootstrap.cc:492] T e78312bda196492eae76f2673c979fee P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:44.177130  5517 ts_tablet_manager.cc:1403] T e78312bda196492eae76f2673c979fee P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.264s	user 0.014s	sys 0.004s
I20260709 13:15:44.163180  5575 raft_consensus.cc:515] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:44.179760  5655 consensus_queue.cc:1048] T 436bb2869b55478b9c1cc99b5f83f981 P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:15:44.182283  5675 log.cc:927] Time spent T 436bb2869b55478b9c1cc99b5f83f981 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:15:44.182214  5517 raft_consensus.cc:359] T e78312bda196492eae76f2673c979fee P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:44.188010  5517 raft_consensus.cc:385] T e78312bda196492eae76f2673c979fee P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.188473  5517 raft_consensus.cc:740] T e78312bda196492eae76f2673c979fee P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.171142  5663 consensus_queue.cc:1048] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:15:44.189626  5515 tablet_bootstrap.cc:492] T c01a087c57254cf0822d574602320ab5 P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
W20260709 13:15:44.190919  5677 log.cc:927] Time spent T 8c46fa9b6c00424a8697f4536d1a3b0e P c4b52f14f9154b5a86f76fe58e4c235e: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:15:44.189934  5517 consensus_queue.cc:260] T e78312bda196492eae76f2673c979fee P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:44.196041  5575 leader_election.cc:290] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:44.197649  5466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ed89f0e9a64fd3ab95b7e83cd4b03a" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
W20260709 13:15:44.199437  5284 leader_election.cc:343] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.200043  5393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ed89f0e9a64fd3ab95b7e83cd4b03a" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:44.204911  5517 ts_tablet_manager.cc:1434] T e78312bda196492eae76f2673c979fee P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.027s	user 0.013s	sys 0.000s
I20260709 13:15:44.206691  5517 tablet_bootstrap.cc:492] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:44.202772  5143 catalog_manager.cc:5697] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129). New cstate: current_term: 1 leader_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:44.213948  5392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc60d69f29e47689fd8fdf2b6aa836a" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
W20260709 13:15:44.204334  5286 leader_election.cc:343] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.219453  5286 leader_election.cc:304] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372; no voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:44.224946  5546 raft_consensus.cc:2749] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:44.238349  5655 raft_consensus.cc:493] T f18f7cc1557b43b9adbf357e50e292a0 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.239039  5655 raft_consensus.cc:515] T f18f7cc1557b43b9adbf357e50e292a0 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:44.246428  5516 tablet_bootstrap.cc:654] T f18f7cc1557b43b9adbf357e50e292a0 P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.247854  5530 consensus_queue.cc:1048] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
W20260709 13:15:44.251766  5434 leader_election.cc:343] T 4bc60d69f29e47689fd8fdf2b6aa836a P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.258298  5434 leader_election.cc:304] T 4bc60d69f29e47689fd8fdf2b6aa836a P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:44.263371  5683 raft_consensus.cc:2749] T 4bc60d69f29e47689fd8fdf2b6aa836a P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:44.261272  5143 catalog_manager.cc:5697] T bdbcf0a951c24340ba91509df11fc4c7 P 538ff4bfbd0c4f04bcd800c4ee4845ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129). New cstate: current_term: 1 leader_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:44.270095  5655 leader_election.cc:290] T f18f7cc1557b43b9adbf357e50e292a0 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:44.275116  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18f7cc1557b43b9adbf357e50e292a0" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
W20260709 13:15:44.277777  5359 leader_election.cc:343] T f18f7cc1557b43b9adbf357e50e292a0 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.285775  5517 tablet_bootstrap.cc:654] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.282047  5683 consensus_queue.cc:1048] T fce0170182474e7dbe46361f5bf0eae9 P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:15:44.289732  5141 catalog_manager.cc:5697] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132). New cstate: current_term: 1 leader_uuid: "77789aa45dc5463c82b73504fef4b4e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:44.291060  5434 consensus_peers.cc:597] T fce0170182474e7dbe46361f5bf0eae9 P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:44.292775  5467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18f7cc1557b43b9adbf357e50e292a0" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:44.293457  5467 raft_consensus.cc:2468] T f18f7cc1557b43b9adbf357e50e292a0 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 0.
I20260709 13:15:44.294481  5358 leader_election.cc:304] T f18f7cc1557b43b9adbf357e50e292a0 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 2f45532f94a34efcb68a82db3dd69372
I20260709 13:15:44.295507  5655 raft_consensus.cc:2804] T f18f7cc1557b43b9adbf357e50e292a0 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:44.295881  5655 raft_consensus.cc:493] T f18f7cc1557b43b9adbf357e50e292a0 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.296221  5655 raft_consensus.cc:3060] T f18f7cc1557b43b9adbf357e50e292a0 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.300969  5646 raft_consensus.cc:493] T 1db09971a25441c68427b8bea7e9c379 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.301585  5646 raft_consensus.cc:515] T 1db09971a25441c68427b8bea7e9c379 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:44.302115  5515 tablet_bootstrap.cc:654] T c01a087c57254cf0822d574602320ab5 P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.304926  5244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db09971a25441c68427b8bea7e9c379" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
W20260709 13:15:44.306445  5360 leader_election.cc:343] T 1db09971a25441c68427b8bea7e9c379 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.307838  5246 raft_consensus.cc:3060] T e78312bda196492eae76f2673c979fee P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.309199  5514 tablet_bootstrap.cc:492] T c01a087c57254cf0822d574602320ab5 P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:44.309777  5514 ts_tablet_manager.cc:1403] T c01a087c57254cf0822d574602320ab5 P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.183s	user 0.006s	sys 0.010s
I20260709 13:15:44.312475  5646 leader_election.cc:290] T 1db09971a25441c68427b8bea7e9c379 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:44.313932  5516 tablet_bootstrap.cc:492] T f18f7cc1557b43b9adbf357e50e292a0 P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:44.313938  5514 raft_consensus.cc:359] T c01a087c57254cf0822d574602320ab5 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:44.314994  5514 raft_consensus.cc:385] T c01a087c57254cf0822d574602320ab5 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.315320  5514 raft_consensus.cc:740] T c01a087c57254cf0822d574602320ab5 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.316177  5514 consensus_queue.cc:260] T c01a087c57254cf0822d574602320ab5 P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:44.314589  5516 ts_tablet_manager.cc:1403] T f18f7cc1557b43b9adbf357e50e292a0 P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.247s	user 0.015s	sys 0.008s
I20260709 13:15:44.317634  5142 catalog_manager.cc:5697] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e reported cstate change: term changed from 0 to 1, leader changed from <none> to c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131). New cstate: current_term: 1 leader_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:44.319931  5516 raft_consensus.cc:359] T f18f7cc1557b43b9adbf357e50e292a0 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:44.320631  5516 raft_consensus.cc:385] T f18f7cc1557b43b9adbf357e50e292a0 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.320909  5516 raft_consensus.cc:740] T f18f7cc1557b43b9adbf357e50e292a0 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.325150  5319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db09971a25441c68427b8bea7e9c379" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
W20260709 13:15:44.326725  5359 leader_election.cc:343] T 1db09971a25441c68427b8bea7e9c379 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.326792  5655 raft_consensus.cc:515] T f18f7cc1557b43b9adbf357e50e292a0 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:44.327304  5359 leader_election.cc:304] T 1db09971a25441c68427b8bea7e9c379 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b52f14f9154b5a86f76fe58e4c235e; no voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:44.328708  5646 raft_consensus.cc:2749] T 1db09971a25441c68427b8bea7e9c379 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:44.331817  5514 ts_tablet_manager.cc:1434] T c01a087c57254cf0822d574602320ab5 P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:15:44.332319  5319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18f7cc1557b43b9adbf357e50e292a0" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:15:44.333114  5514 tablet_bootstrap.cc:492] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
I20260709 13:15:44.330513  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f18f7cc1557b43b9adbf357e50e292a0" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:15:44.334242  5469 raft_consensus.cc:3060] T f18f7cc1557b43b9adbf357e50e292a0 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.321652  5516 consensus_queue.cc:260] T f18f7cc1557b43b9adbf357e50e292a0 P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:44.329236  5655 leader_election.cc:290] T f18f7cc1557b43b9adbf357e50e292a0 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 election: Requested vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:44.333096  5646 consensus_queue.cc:1048] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Connected to new peer: Peer: permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:44.333560  5515 tablet_bootstrap.cc:492] T c01a087c57254cf0822d574602320ab5 P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
I20260709 13:15:44.340602  5515 ts_tablet_manager.cc:1403] T c01a087c57254cf0822d574602320ab5 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.151s	user 0.013s	sys 0.002s
I20260709 13:15:44.342628  5514 tablet_bootstrap.cc:654] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.350171  5517 tablet_bootstrap.cc:492] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:44.351081  5517 ts_tablet_manager.cc:1403] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.145s	user 0.017s	sys 0.003s
I20260709 13:15:44.354779  5517 raft_consensus.cc:359] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:44.355590  5517 raft_consensus.cc:385] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.355881  5517 raft_consensus.cc:740] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.356706  5517 consensus_queue.cc:260] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:44.359368  5517 ts_tablet_manager.cc:1434] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:15:44.360627  5517 tablet_bootstrap.cc:492] T bd6573fdc5bd411e8b0cbd3316ecaede P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:44.366861  5469 raft_consensus.cc:2468] T f18f7cc1557b43b9adbf357e50e292a0 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 1.
I20260709 13:15:44.370689  5517 tablet_bootstrap.cc:654] T bd6573fdc5bd411e8b0cbd3316ecaede P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.362243  5515 raft_consensus.cc:359] T c01a087c57254cf0822d574602320ab5 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:44.371127  5319 raft_consensus.cc:3060] T f18f7cc1557b43b9adbf357e50e292a0 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.371299  5515 raft_consensus.cc:385] T c01a087c57254cf0822d574602320ab5 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.371737  5515 raft_consensus.cc:740] T c01a087c57254cf0822d574602320ab5 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.372560  5515 consensus_queue.cc:260] T c01a087c57254cf0822d574602320ab5 P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:44.375833  5515 ts_tablet_manager.cc:1434] T c01a087c57254cf0822d574602320ab5 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260709 13:15:44.376276  5358 leader_election.cc:304] T f18f7cc1557b43b9adbf357e50e292a0 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:44.380245  5646 raft_consensus.cc:2804] T f18f7cc1557b43b9adbf357e50e292a0 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:44.380275  5515 tablet_bootstrap.cc:492] T 4d479dd9f8c04491bb1e78273726187f P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
I20260709 13:15:44.381060  5624 consensus_queue.cc:1048] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:44.380890  5646 raft_consensus.cc:697] T f18f7cc1557b43b9adbf357e50e292a0 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 LEADER]: Becoming Leader. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Running, Role: LEADER
I20260709 13:15:44.386533  5646 consensus_queue.cc:237] T f18f7cc1557b43b9adbf357e50e292a0 P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:44.392691  5319 raft_consensus.cc:2468] T f18f7cc1557b43b9adbf357e50e292a0 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 1.
I20260709 13:15:44.401427  5530 consensus_queue.cc:1048] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:44.402886  5516 ts_tablet_manager.cc:1434] T f18f7cc1557b43b9adbf357e50e292a0 P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.086s	user 0.007s	sys 0.000s
I20260709 13:15:44.411324  5514 tablet_bootstrap.cc:492] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:44.411950  5516 tablet_bootstrap.cc:492] T 5d841937b5db4e7fa656db32b84b9ca2 P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
I20260709 13:15:44.412415  5514 ts_tablet_manager.cc:1403] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.080s	user 0.015s	sys 0.013s
I20260709 13:15:44.415629  5514 raft_consensus.cc:359] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:44.416682  5514 raft_consensus.cc:385] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.417057  5514 raft_consensus.cc:740] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.419801  5515 tablet_bootstrap.cc:654] T 4d479dd9f8c04491bb1e78273726187f P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.425295  5516 tablet_bootstrap.cc:654] T 5d841937b5db4e7fa656db32b84b9ca2 P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.426282  5514 consensus_queue.cc:260] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:44.430090  5517 tablet_bootstrap.cc:492] T bd6573fdc5bd411e8b0cbd3316ecaede P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:44.430795  5517 ts_tablet_manager.cc:1403] T bd6573fdc5bd411e8b0cbd3316ecaede P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.071s	user 0.018s	sys 0.025s
I20260709 13:15:44.430163  5514 ts_tablet_manager.cc:1434] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:15:44.432487  5514 tablet_bootstrap.cc:492] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
I20260709 13:15:44.434069  5517 raft_consensus.cc:359] T bd6573fdc5bd411e8b0cbd3316ecaede P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:44.434827  5517 raft_consensus.cc:385] T bd6573fdc5bd411e8b0cbd3316ecaede P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.435129  5517 raft_consensus.cc:740] T bd6573fdc5bd411e8b0cbd3316ecaede P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.436045  5517 consensus_queue.cc:260] T bd6573fdc5bd411e8b0cbd3316ecaede P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:44.439872  5515 tablet_bootstrap.cc:492] T 4d479dd9f8c04491bb1e78273726187f P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
I20260709 13:15:44.440328  5517 ts_tablet_manager.cc:1434] T bd6573fdc5bd411e8b0cbd3316ecaede P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:15:44.440407  5515 ts_tablet_manager.cc:1403] T 4d479dd9f8c04491bb1e78273726187f P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.062s	user 0.010s	sys 0.004s
I20260709 13:15:44.441663  5517 tablet_bootstrap.cc:492] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:44.443686  5515 raft_consensus.cc:359] T 4d479dd9f8c04491bb1e78273726187f P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:44.444367  5515 raft_consensus.cc:385] T 4d479dd9f8c04491bb1e78273726187f P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.444634  5515 raft_consensus.cc:740] T 4d479dd9f8c04491bb1e78273726187f P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.447958  5515 consensus_queue.cc:260] T 4d479dd9f8c04491bb1e78273726187f P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:44.448642  5517 tablet_bootstrap.cc:654] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.449398  5514 tablet_bootstrap.cc:654] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.453809  5515 ts_tablet_manager.cc:1434] T 4d479dd9f8c04491bb1e78273726187f P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:15:44.455400  5515 tablet_bootstrap.cc:492] T 99cdbf6d16c64a949df77a003bb7f7e4 P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
I20260709 13:15:44.457798  5648 consensus_queue.cc:1048] T bd6573fdc5bd411e8b0cbd3316ecaede P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:15:44.468966  5210 consensus_peers.cc:597] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba -> Peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Couldn't send request to peer 2f45532f94a34efcb68a82db3dd69372. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:44.475090  5516 tablet_bootstrap.cc:492] T 5d841937b5db4e7fa656db32b84b9ca2 P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:44.476040  5516 ts_tablet_manager.cc:1403] T 5d841937b5db4e7fa656db32b84b9ca2 P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.002s
I20260709 13:15:44.475251  5140 catalog_manager.cc:5697] T 8c46fa9b6c00424a8697f4536d1a3b0e P c4b52f14f9154b5a86f76fe58e4c235e reported cstate change: term changed from 0 to 1, leader changed from <none> to c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131). New cstate: current_term: 1 leader_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:44.479197  5516 raft_consensus.cc:359] T 5d841937b5db4e7fa656db32b84b9ca2 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:44.480125  5516 raft_consensus.cc:385] T 5d841937b5db4e7fa656db32b84b9ca2 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.480453  5516 raft_consensus.cc:740] T 5d841937b5db4e7fa656db32b84b9ca2 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.481369  5516 consensus_queue.cc:260] T 5d841937b5db4e7fa656db32b84b9ca2 P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:44.483737  5516 ts_tablet_manager.cc:1434] T 5d841937b5db4e7fa656db32b84b9ca2 P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:15:44.484731  5516 tablet_bootstrap.cc:492] T 1db09971a25441c68427b8bea7e9c379 P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
I20260709 13:15:44.484861  5514 tablet_bootstrap.cc:492] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:44.485370  5514 ts_tablet_manager.cc:1403] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.053s	user 0.013s	sys 0.000s
I20260709 13:15:44.488719  5514 raft_consensus.cc:359] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:44.489468  5514 raft_consensus.cc:385] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.489738  5514 raft_consensus.cc:740] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.489934  5517 tablet_bootstrap.cc:492] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:44.490527  5517 ts_tablet_manager.cc:1403] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.013s
I20260709 13:15:44.493126  5515 tablet_bootstrap.cc:654] T 99cdbf6d16c64a949df77a003bb7f7e4 P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.493005  5246 raft_consensus.cc:3060] T bd6573fdc5bd411e8b0cbd3316ecaede P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.493702  5517 raft_consensus.cc:359] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:44.494524  5517 raft_consensus.cc:385] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.494817  5517 raft_consensus.cc:740] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.496290  5517 consensus_queue.cc:260] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:44.497879  5140 catalog_manager.cc:5697] T f18f7cc1557b43b9adbf357e50e292a0 P c4b52f14f9154b5a86f76fe58e4c235e reported cstate change: term changed from 0 to 1, leader changed from <none> to c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131). New cstate: current_term: 1 leader_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:44.499203  5517 ts_tablet_manager.cc:1434] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.002s
I20260709 13:15:44.499785  5514 consensus_queue.cc:260] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:44.500393  5517 tablet_bootstrap.cc:492] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:44.501809  5514 ts_tablet_manager.cc:1434] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:15:44.503079  5514 tablet_bootstrap.cc:492] T 15d005f85bf54ebfb870b326ef3e18ed P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
I20260709 13:15:44.505905  5575 consensus_queue.cc:1048] T bd6573fdc5bd411e8b0cbd3316ecaede P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:44.509820  5516 tablet_bootstrap.cc:654] T 1db09971a25441c68427b8bea7e9c379 P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.518950  5528 consensus_queue.cc:1048] T 8c46fa9b6c00424a8697f4536d1a3b0e P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:44.520138  5517 tablet_bootstrap.cc:654] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.523037  5515 tablet_bootstrap.cc:492] T 99cdbf6d16c64a949df77a003bb7f7e4 P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
I20260709 13:15:44.524173  5515 ts_tablet_manager.cc:1403] T 99cdbf6d16c64a949df77a003bb7f7e4 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.069s	user 0.012s	sys 0.003s
I20260709 13:15:44.537786  5516 tablet_bootstrap.cc:492] T 1db09971a25441c68427b8bea7e9c379 P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:44.538411  5516 ts_tablet_manager.cc:1403] T 1db09971a25441c68427b8bea7e9c379 P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.054s	user 0.014s	sys 0.002s
I20260709 13:15:44.543304  5516 raft_consensus.cc:359] T 1db09971a25441c68427b8bea7e9c379 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:44.544109  5516 raft_consensus.cc:385] T 1db09971a25441c68427b8bea7e9c379 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.544349  5516 raft_consensus.cc:740] T 1db09971a25441c68427b8bea7e9c379 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.544942  5516 consensus_queue.cc:260] T 1db09971a25441c68427b8bea7e9c379 P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:44.546681  5516 ts_tablet_manager.cc:1434] T 1db09971a25441c68427b8bea7e9c379 P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:15:44.537851  5517 tablet_bootstrap.cc:492] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:44.548199  5517 ts_tablet_manager.cc:1403] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.048s	user 0.017s	sys 0.006s
I20260709 13:15:44.550316  5515 raft_consensus.cc:359] T 99cdbf6d16c64a949df77a003bb7f7e4 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:44.551057  5515 raft_consensus.cc:385] T 99cdbf6d16c64a949df77a003bb7f7e4 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.551215  5516 tablet_bootstrap.cc:492] T 71b75232471f416bb2d0ec813f32558e P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
I20260709 13:15:44.551064  5517 raft_consensus.cc:359] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:44.557286  5517 raft_consensus.cc:385] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.557612  5517 raft_consensus.cc:740] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.551342  5515 raft_consensus.cc:740] T 99cdbf6d16c64a949df77a003bb7f7e4 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.559068  5515 consensus_queue.cc:260] T 99cdbf6d16c64a949df77a003bb7f7e4 P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:44.563090  5514 tablet_bootstrap.cc:654] T 15d005f85bf54ebfb870b326ef3e18ed P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.560058  5517 consensus_queue.cc:260] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:44.573278  5517 ts_tablet_manager.cc:1434] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.025s	user 0.001s	sys 0.005s
I20260709 13:15:44.574493  5517 tablet_bootstrap.cc:492] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:44.566193  5515 ts_tablet_manager.cc:1434] T 99cdbf6d16c64a949df77a003bb7f7e4 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.001s
I20260709 13:15:44.570477  5516 tablet_bootstrap.cc:654] T 71b75232471f416bb2d0ec813f32558e P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.583269  5570 raft_consensus.cc:493] T c01a087c57254cf0822d574602320ab5 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.584286  5570 raft_consensus.cc:515] T c01a087c57254cf0822d574602320ab5 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:44.589221  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01a087c57254cf0822d574602320ab5" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:44.590375  5320 raft_consensus.cc:2468] T c01a087c57254cf0822d574602320ab5 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 0.
I20260709 13:15:44.592047  5517 tablet_bootstrap.cc:654] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.594894  5393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01a087c57254cf0822d574602320ab5" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:44.596050  5393 raft_consensus.cc:2468] T c01a087c57254cf0822d574602320ab5 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 0.
I20260709 13:15:44.601060  5433 leader_election.cc:304] T c01a087c57254cf0822d574602320ab5 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0; no voters: 
I20260709 13:15:44.602916  5682 raft_consensus.cc:2804] T c01a087c57254cf0822d574602320ab5 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:44.603827  5682 raft_consensus.cc:493] T c01a087c57254cf0822d574602320ab5 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.604614  5682 raft_consensus.cc:3060] T c01a087c57254cf0822d574602320ab5 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.610054  5570 leader_election.cc:290] T c01a087c57254cf0822d574602320ab5 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:44.617962  5624 raft_consensus.cc:493] T 99cdbf6d16c64a949df77a003bb7f7e4 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.626470  5515 tablet_bootstrap.cc:492] T 068e5bd8f3ef45fc8a4a122e51537764 P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
I20260709 13:15:44.634976  5515 tablet_bootstrap.cc:654] T 068e5bd8f3ef45fc8a4a122e51537764 P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.618826  5624 raft_consensus.cc:515] T 99cdbf6d16c64a949df77a003bb7f7e4 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:44.663975  5591 raft_consensus.cc:493] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.664884  5591 raft_consensus.cc:515] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:44.665858  5624 leader_election.cc:290] T 99cdbf6d16c64a949df77a003bb7f7e4 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:44.669405  5591 leader_election.cc:290] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:44.672948  5467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99cdbf6d16c64a949df77a003bb7f7e4" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:44.675101  5604 raft_consensus.cc:493] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.688251  5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99cdbf6d16c64a949df77a003bb7f7e4" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:44.689343  5604 raft_consensus.cc:515] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:44.691759  5624 consensus_queue.cc:1048] T 8c46fa9b6c00424a8697f4536d1a3b0e P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:15:44.692497  5360 leader_election.cc:343] T 99cdbf6d16c64a949df77a003bb7f7e4 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.693303  5604 leader_election.cc:290] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:44.696822  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aac85b71e404ee1bcfb748bfb0376fb" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:44.636968  5570 consensus_queue.cc:1048] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.061s
I20260709 13:15:44.708978  5514 tablet_bootstrap.cc:492] T 15d005f85bf54ebfb870b326ef3e18ed P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:44.710012  5514 ts_tablet_manager.cc:1403] T 15d005f85bf54ebfb870b326ef3e18ed P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.207s	user 0.048s	sys 0.071s
I20260709 13:15:44.705262  5682 raft_consensus.cc:515] T c01a087c57254cf0822d574602320ab5 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:44.723304  5682 leader_election.cc:290] T c01a087c57254cf0822d574602320ab5 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 election: Requested vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:44.709717  5683 consensus_queue.cc:1048] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:15:44.724888  5516 tablet_bootstrap.cc:492] T 71b75232471f416bb2d0ec813f32558e P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:44.725826  5516 ts_tablet_manager.cc:1403] T 71b75232471f416bb2d0ec813f32558e P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.178s	user 0.025s	sys 0.037s
W20260709 13:15:44.727442  5210 consensus_peers.cc:597] T bdbcf0a951c24340ba91509df11fc4c7 P 538ff4bfbd0c4f04bcd800c4ee4845ba -> Peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Couldn't send request to peer 2f45532f94a34efcb68a82db3dd69372. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:44.729602  5517 tablet_bootstrap.cc:492] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:44.730224  5517 ts_tablet_manager.cc:1403] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.156s	user 0.036s	sys 0.025s
I20260709 13:15:44.733469  5517 raft_consensus.cc:359] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:44.735353  5517 raft_consensus.cc:385] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:15:44.735276  5210 leader_election.cc:343] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.738739  5516 raft_consensus.cc:359] T 71b75232471f416bb2d0ec813f32558e P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:44.739542  5516 raft_consensus.cc:385] T 71b75232471f416bb2d0ec813f32558e P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.739843  5516 raft_consensus.cc:740] T 71b75232471f416bb2d0ec813f32558e P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.740128  5517 raft_consensus.cc:740] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.740630  5516 consensus_queue.cc:260] T 71b75232471f416bb2d0ec813f32558e P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:44.741922  5514 raft_consensus.cc:359] T 15d005f85bf54ebfb870b326ef3e18ed P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:44.742627  5514 raft_consensus.cc:385] T 15d005f85bf54ebfb870b326ef3e18ed P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.742931  5516 ts_tablet_manager.cc:1434] T 71b75232471f416bb2d0ec813f32558e P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:15:44.744138  5516 tablet_bootstrap.cc:492] T 15d005f85bf54ebfb870b326ef3e18ed P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
I20260709 13:15:44.742895  5514 raft_consensus.cc:740] T 15d005f85bf54ebfb870b326ef3e18ed P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.747782  5514 consensus_queue.cc:260] T 15d005f85bf54ebfb870b326ef3e18ed P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:44.750245  5514 ts_tablet_manager.cc:1434] T 15d005f85bf54ebfb870b326ef3e18ed P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.000s
I20260709 13:15:44.751128  5516 tablet_bootstrap.cc:654] T 15d005f85bf54ebfb870b326ef3e18ed P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.740902  5517 consensus_queue.cc:260] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:44.751431  5514 tablet_bootstrap.cc:492] T 71b75232471f416bb2d0ec813f32558e P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
I20260709 13:15:44.756408  5467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aac85b71e404ee1bcfb748bfb0376fb" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:44.757417  5598 consensus_queue.cc:1048] T bdbcf0a951c24340ba91509df11fc4c7 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:44.757481  5467 raft_consensus.cc:2468] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 0.
I20260709 13:15:44.765331  5706 raft_consensus.cc:493] T 1db09971a25441c68427b8bea7e9c379 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.765980  5706 raft_consensus.cc:515] T 1db09971a25441c68427b8bea7e9c379 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:44.774770  5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db09971a25441c68427b8bea7e9c379" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
W20260709 13:15:44.776315  5358 leader_election.cc:343] T 99cdbf6d16c64a949df77a003bb7f7e4 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.777189  5358 leader_election.cc:304] T 99cdbf6d16c64a949df77a003bb7f7e4 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b52f14f9154b5a86f76fe58e4c235e; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, 77789aa45dc5463c82b73504fef4b4e0
I20260709 13:15:44.778183  5624 raft_consensus.cc:2749] T 99cdbf6d16c64a949df77a003bb7f7e4 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:44.778469  5192 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:44.780035  5244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aac85b71e404ee1bcfb748bfb0376fb" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:44.780907  5244 raft_consensus.cc:2468] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 0.
I20260709 13:15:44.781562  5209 leader_election.cc:304] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, 77789aa45dc5463c82b73504fef4b4e0; no voters: 2f45532f94a34efcb68a82db3dd69372
I20260709 13:15:44.783145  5598 raft_consensus.cc:2804] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:44.783651  5598 raft_consensus.cc:493] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.784004  5598 raft_consensus.cc:3060] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.784821  5624 raft_consensus.cc:493] T 4d479dd9f8c04491bb1e78273726187f P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.785451  5624 raft_consensus.cc:515] T 4d479dd9f8c04491bb1e78273726187f P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:44.780180  5393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01a087c57254cf0822d574602320ab5" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:15:44.788525  5393 raft_consensus.cc:3060] T c01a087c57254cf0822d574602320ab5 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.790712  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d479dd9f8c04491bb1e78273726187f" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:44.792238  5706 leader_election.cc:290] T 1db09971a25441c68427b8bea7e9c379 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:44.793689  5394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db09971a25441c68427b8bea7e9c379" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:44.794463  5394 raft_consensus.cc:2468] T 1db09971a25441c68427b8bea7e9c379 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 0.
W20260709 13:15:44.795188  5360 leader_election.cc:343] T 4d479dd9f8c04491bb1e78273726187f P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.795981  5286 leader_election.cc:304] T 1db09971a25441c68427b8bea7e9c379 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
W20260709 13:15:44.797098  5286 leader_election.cc:343] T 1db09971a25441c68427b8bea7e9c379 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.800495  5624 leader_election.cc:290] T 4d479dd9f8c04491bb1e78273726187f P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:44.801702  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d479dd9f8c04491bb1e78273726187f" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:44.802899  5663 raft_consensus.cc:493] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.803534  5663 raft_consensus.cc:515] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:44.797426  5530 raft_consensus.cc:493] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.805578  5530 raft_consensus.cc:515] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:44.806413  5663 leader_election.cc:290] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:44.814657  5517 ts_tablet_manager.cc:1434] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.084s	user 0.008s	sys 0.002s
W20260709 13:15:44.821398  5359 leader_election.cc:343] T 4d479dd9f8c04491bb1e78273726187f P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.821568  5394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce0170182474e7dbe46361f5bf0eae9" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:44.810953  5706 raft_consensus.cc:2804] T 1db09971a25441c68427b8bea7e9c379 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:44.828039  5517 tablet_bootstrap.cc:492] T 068e5bd8f3ef45fc8a4a122e51537764 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:44.806304  5598 raft_consensus.cc:515] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:44.822065  5359 leader_election.cc:304] T 4d479dd9f8c04491bb1e78273726187f P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b52f14f9154b5a86f76fe58e4c235e; no voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:44.839255  5646 raft_consensus.cc:2749] T 4d479dd9f8c04491bb1e78273726187f P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:44.842526  5393 raft_consensus.cc:2468] T c01a087c57254cf0822d574602320ab5 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 1.
I20260709 13:15:44.843348  5663 raft_consensus.cc:493] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.829124  5706 raft_consensus.cc:493] T 1db09971a25441c68427b8bea7e9c379 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.856676  5467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce0170182474e7dbe46361f5bf0eae9" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:44.859589  5530 leader_election.cc:290] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:44.862388  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01a087c57254cf0822d574602320ab5" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:15:44.863426  5321 raft_consensus.cc:3060] T c01a087c57254cf0822d574602320ab5 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.867843  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aac85b71e404ee1bcfb748bfb0376fb" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:44.869158  5515 tablet_bootstrap.cc:492] T 068e5bd8f3ef45fc8a4a122e51537764 P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
I20260709 13:15:44.870042  5515 ts_tablet_manager.cc:1403] T 068e5bd8f3ef45fc8a4a122e51537764 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.244s	user 0.033s	sys 0.027s
I20260709 13:15:44.849399  5663 raft_consensus.cc:515] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:44.874516  5663 leader_election.cc:290] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
W20260709 13:15:44.887071  5715 log.cc:927] Time spent T 8c46fa9b6c00424a8697f4536d1a3b0e P 2f45532f94a34efcb68a82db3dd69372: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:15:44.849234  5706 raft_consensus.cc:3060] T 1db09971a25441c68427b8bea7e9c379 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.895632  5434 leader_election.cc:304] T c01a087c57254cf0822d574602320ab5 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:44.896924  5598 leader_election.cc:290] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 election: Requested vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
W20260709 13:15:44.897518  5433 leader_election.cc:343] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.897889  5714 raft_consensus.cc:2804] T c01a087c57254cf0822d574602320ab5 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:44.898460  5714 raft_consensus.cc:697] T c01a087c57254cf0822d574602320ab5 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 LEADER]: Becoming Leader. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Running, Role: LEADER
I20260709 13:15:44.888034  5624 consensus_queue.cc:1048] T f18f7cc1557b43b9adbf357e50e292a0 P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:15:44.904723  5714 consensus_queue.cc:237] T c01a087c57254cf0822d574602320ab5 P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:44.908598  5434 leader_election.cc:304] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, 77789aa45dc5463c82b73504fef4b4e0; no voters: 2f45532f94a34efcb68a82db3dd69372
I20260709 13:15:44.909754  5570 raft_consensus.cc:2804] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:44.910180  5570 raft_consensus.cc:493] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.910537  5570 raft_consensus.cc:3060] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:44.920372  5515 raft_consensus.cc:359] T 068e5bd8f3ef45fc8a4a122e51537764 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:44.923264  5515 raft_consensus.cc:385] T 068e5bd8f3ef45fc8a4a122e51537764 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:44.922817  5514 tablet_bootstrap.cc:654] T 71b75232471f416bb2d0ec813f32558e P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.915092  5321 raft_consensus.cc:2468] T c01a087c57254cf0822d574602320ab5 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 1.
I20260709 13:15:44.923666  5515 raft_consensus.cc:740] T 068e5bd8f3ef45fc8a4a122e51537764 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:44.928432  5515 consensus_queue.cc:260] T 068e5bd8f3ef45fc8a4a122e51537764 P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:44.932819  5467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b75232471f416bb2d0ec813f32558e" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:44.933038  5570 raft_consensus.cc:515] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:44.939543  5517 tablet_bootstrap.cc:654] T 068e5bd8f3ef45fc8a4a122e51537764 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:44.951707  5515 ts_tablet_manager.cc:1434] T 068e5bd8f3ef45fc8a4a122e51537764 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.081s	user 0.011s	sys 0.000s
I20260709 13:15:44.963003  5515 tablet_bootstrap.cc:492] T 4bc60d69f29e47689fd8fdf2b6aa836a P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
I20260709 13:15:44.963986  5575 raft_consensus.cc:493] T 71b75232471f416bb2d0ec813f32558e P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.964672  5575 raft_consensus.cc:515] T 71b75232471f416bb2d0ec813f32558e P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:44.965165  5393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654fdf03209d4a3cbf17055c56ae2c9d" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:44.964035  5684 raft_consensus.cc:493] T 5d841937b5db4e7fa656db32b84b9ca2 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.969835  5211 leader_election.cc:304] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:44.970176  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b75232471f416bb2d0ec813f32558e" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:44.970254  5684 raft_consensus.cc:515] T 5d841937b5db4e7fa656db32b84b9ca2 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:44.971220  5321 raft_consensus.cc:2468] T 71b75232471f416bb2d0ec813f32558e P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 0.
I20260709 13:15:44.971213  5466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b75232471f416bb2d0ec813f32558e" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
W20260709 13:15:44.974083  5284 leader_election.cc:343] T 71b75232471f416bb2d0ec813f32558e P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.974013  5598 raft_consensus.cc:2749] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:44.975159  5211 leader_election.cc:343] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:44.975769  5466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d841937b5db4e7fa656db32b84b9ca2" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:44.975927  5575 leader_election.cc:290] T 71b75232471f416bb2d0ec813f32558e P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:44.977313  5684 leader_election.cc:290] T 5d841937b5db4e7fa656db32b84b9ca2 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:44.980939  5570 leader_election.cc:290] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 election: Requested vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:44.974059  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654fdf03209d4a3cbf17055c56ae2c9d" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:44.994164  5466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aac85b71e404ee1bcfb748bfb0376fb" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:15:45.002480  5466 raft_consensus.cc:2393] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in current term 1: Already voted for candidate 77789aa45dc5463c82b73504fef4b4e0 in this term.
I20260709 13:15:45.002676  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aac85b71e404ee1bcfb748bfb0376fb" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:15:44.995997  5570 raft_consensus.cc:493] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.012244  5318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aac85b71e404ee1bcfb748bfb0376fb" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:15:45.012542  5570 raft_consensus.cc:515] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:45.015002  5570 leader_election.cc:290] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:45.014653  5140 catalog_manager.cc:5697] T c01a087c57254cf0822d574602320ab5 P 77789aa45dc5463c82b73504fef4b4e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132). New cstate: current_term: 1 leader_uuid: "77789aa45dc5463c82b73504fef4b4e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: HEALTHY } } }
W20260709 13:15:45.016887  5433 leader_election.cc:343] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.027590  5516 tablet_bootstrap.cc:492] T 15d005f85bf54ebfb870b326ef3e18ed P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:45.028227  5516 ts_tablet_manager.cc:1403] T 15d005f85bf54ebfb870b326ef3e18ed P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.284s	user 0.016s	sys 0.002s
W20260709 13:15:45.031242  5209 leader_election.cc:343] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.029191  5624 consensus_queue.cc:1048] T f18f7cc1557b43b9adbf357e50e292a0 P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:15:45.039673  5244 raft_consensus.cc:3060] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:45.045876  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d841937b5db4e7fa656db32b84b9ca2" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:45.047371  5210 leader_election.cc:304] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 77789aa45dc5463c82b73504fef4b4e0
I20260709 13:15:45.044200  5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b75232471f416bb2d0ec813f32558e" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:45.052237  5245 raft_consensus.cc:2468] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 0.
I20260709 13:15:45.042690  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ed89f0e9a64fd3ab95b7e83cd4b03a" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:45.056172  5319 raft_consensus.cc:3060] T 5d841937b5db4e7fa656db32b84b9ca2 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:45.056860  5320 raft_consensus.cc:2468] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 0.
I20260709 13:15:45.058178  5286 leader_election.cc:304] T 5d841937b5db4e7fa656db32b84b9ca2 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, 77789aa45dc5463c82b73504fef4b4e0
I20260709 13:15:45.055296  5516 raft_consensus.cc:359] T 15d005f85bf54ebfb870b326ef3e18ed P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:45.059612  5516 raft_consensus.cc:385] T 15d005f85bf54ebfb870b326ef3e18ed P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.060289  5286 leader_election.cc:304] T 71b75232471f416bb2d0ec813f32558e P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 77789aa45dc5463c82b73504fef4b4e0
I20260709 13:15:45.061048  5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aac85b71e404ee1bcfb748bfb0376fb" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
I20260709 13:15:45.061244  5575 raft_consensus.cc:2804] T 71b75232471f416bb2d0ec813f32558e P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:45.061774  5575 raft_consensus.cc:493] T 71b75232471f416bb2d0ec813f32558e P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:45.061924  5245 raft_consensus.cc:2393] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 77789aa45dc5463c82b73504fef4b4e0 in current term 1: Already voted for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in this term.
I20260709 13:15:45.062167  5575 raft_consensus.cc:3060] T 71b75232471f416bb2d0ec813f32558e P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:45.064345  5721 raft_consensus.cc:2804] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:45.060297  5516 raft_consensus.cc:740] T 15d005f85bf54ebfb870b326ef3e18ed P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.068900  5516 consensus_queue.cc:260] T 15d005f85bf54ebfb870b326ef3e18ed P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:45.071159  5433 leader_election.cc:304] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0; no voters: 
I20260709 13:15:45.072238  5570 raft_consensus.cc:2804] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:45.072651  5570 raft_consensus.cc:493] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:45.072979  5570 raft_consensus.cc:3060] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:45.076894  5515 tablet_bootstrap.cc:654] T 4bc60d69f29e47689fd8fdf2b6aa836a P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.080993  5721 raft_consensus.cc:493] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:45.081564  5721 raft_consensus.cc:3060] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:45.082455  5434 leader_election.cc:304] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0; no voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:45.083392  5604 raft_consensus.cc:2749] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:45.087915  5514 tablet_bootstrap.cc:492] T 71b75232471f416bb2d0ec813f32558e P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:45.088769  5514 ts_tablet_manager.cc:1403] T 71b75232471f416bb2d0ec813f32558e P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.338s	user 0.021s	sys 0.000s
I20260709 13:15:45.095410  5706 raft_consensus.cc:515] T 1db09971a25441c68427b8bea7e9c379 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:45.102313  5516 ts_tablet_manager.cc:1434] T 15d005f85bf54ebfb870b326ef3e18ed P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.074s	user 0.007s	sys 0.002s
I20260709 13:15:45.102805  5514 raft_consensus.cc:359] T 71b75232471f416bb2d0ec813f32558e P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:45.113451  5514 raft_consensus.cc:385] T 71b75232471f416bb2d0ec813f32558e P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.113801  5514 raft_consensus.cc:740] T 71b75232471f416bb2d0ec813f32558e P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.114557  5514 consensus_queue.cc:260] T 71b75232471f416bb2d0ec813f32558e P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:45.103873  5516 tablet_bootstrap.cc:492] T bdbcf0a951c24340ba91509df11fc4c7 P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
I20260709 13:15:45.118515  5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db09971a25441c68427b8bea7e9c379" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
I20260709 13:15:45.106093  5575 raft_consensus.cc:515] T 71b75232471f416bb2d0ec813f32558e P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:45.107806  5706 leader_election.cc:290] T 1db09971a25441c68427b8bea7e9c379 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Requested vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:45.109961  5393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db09971a25441c68427b8bea7e9c379" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:15:45.112826  5517 tablet_bootstrap.cc:492] T 068e5bd8f3ef45fc8a4a122e51537764 P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:45.122669  5393 raft_consensus.cc:3060] T 1db09971a25441c68427b8bea7e9c379 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:45.123458  5517 ts_tablet_manager.cc:1403] T 068e5bd8f3ef45fc8a4a122e51537764 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.304s	user 0.018s	sys 0.001s
I20260709 13:15:45.123847  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b75232471f416bb2d0ec813f32558e" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:15:45.124831  5469 raft_consensus.cc:3060] T 71b75232471f416bb2d0ec813f32558e P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:45.127063  5517 raft_consensus.cc:359] T 068e5bd8f3ef45fc8a4a122e51537764 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:45.127897  5517 raft_consensus.cc:385] T 068e5bd8f3ef45fc8a4a122e51537764 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.128232  5517 raft_consensus.cc:740] T 068e5bd8f3ef45fc8a4a122e51537764 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.121553  5721 raft_consensus.cc:515] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:45.130817  5514 ts_tablet_manager.cc:1434] T 71b75232471f416bb2d0ec813f32558e P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.042s	user 0.003s	sys 0.004s
I20260709 13:15:45.131794  5721 leader_election.cc:290] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 election: Requested vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:45.133237  5517 consensus_queue.cc:260] T 068e5bd8f3ef45fc8a4a122e51537764 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:45.137763  5517 ts_tablet_manager.cc:1434] T 068e5bd8f3ef45fc8a4a122e51537764 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.003s
I20260709 13:15:45.140324  5514 tablet_bootstrap.cc:492] T 99cdbf6d16c64a949df77a003bb7f7e4 P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
W20260709 13:15:45.141419  5210 leader_election.cc:343] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.142146  5210 leader_election.cc:304] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:45.144136  5719 raft_consensus.cc:2749] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:45.145601  5517 tablet_bootstrap.cc:492] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
W20260709 13:15:45.145076  5210 leader_election.cc:343] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.161674  5516 tablet_bootstrap.cc:654] T bdbcf0a951c24340ba91509df11fc4c7 P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.137603  5575 leader_election.cc:290] T 71b75232471f416bb2d0ec813f32558e P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Requested vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:45.165547  5514 tablet_bootstrap.cc:654] T 99cdbf6d16c64a949df77a003bb7f7e4 P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.156484  5684 raft_consensus.cc:2749] T 5d841937b5db4e7fa656db32b84b9ca2 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:45.172327  5721 raft_consensus.cc:493] T 068e5bd8f3ef45fc8a4a122e51537764 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.172940  5721 raft_consensus.cc:515] T 068e5bd8f3ef45fc8a4a122e51537764 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:45.178627  5392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "068e5bd8f3ef45fc8a4a122e51537764" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:45.160573  5570 raft_consensus.cc:515] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:45.179867  5392 raft_consensus.cc:2468] T 068e5bd8f3ef45fc8a4a122e51537764 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 0.
I20260709 13:15:45.182155  5211 leader_election.cc:304] T 068e5bd8f3ef45fc8a4a122e51537764 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:45.183540  5719 raft_consensus.cc:2804] T 068e5bd8f3ef45fc8a4a122e51537764 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:45.184098  5719 raft_consensus.cc:493] T 068e5bd8f3ef45fc8a4a122e51537764 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:45.184422  5570 leader_election.cc:290] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 election: Requested vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:45.184541  5719 raft_consensus.cc:3060] T 068e5bd8f3ef45fc8a4a122e51537764 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:45.186348  5469 raft_consensus.cc:2468] T 71b75232471f416bb2d0ec813f32558e P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 1.
I20260709 13:15:45.187825  5284 leader_election.cc:304] T 71b75232471f416bb2d0ec813f32558e P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0; no voters: 
I20260709 13:15:45.188026  5721 leader_election.cc:290] T 068e5bd8f3ef45fc8a4a122e51537764 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:45.188441  5467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b75232471f416bb2d0ec813f32558e" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:15:45.188941  5684 raft_consensus.cc:2804] T 71b75232471f416bb2d0ec813f32558e P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:45.189358  5467 raft_consensus.cc:2393] T 71b75232471f416bb2d0ec813f32558e P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in current term 1: Already voted for candidate 2f45532f94a34efcb68a82db3dd69372 in this term.
I20260709 13:15:45.189486  5684 raft_consensus.cc:697] T 71b75232471f416bb2d0ec813f32558e P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Becoming Leader. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Running, Role: LEADER
I20260709 13:15:45.190492  5684 consensus_queue.cc:237] T 71b75232471f416bb2d0ec813f32558e P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:45.190853  5467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "068e5bd8f3ef45fc8a4a122e51537764" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:45.192068  5209 leader_election.cc:304] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0
I20260709 13:15:45.194325  5598 raft_consensus.cc:2749] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:45.193053  5467 raft_consensus.cc:2468] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 0.
I20260709 13:15:45.205024  5318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b75232471f416bb2d0ec813f32558e" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:15:45.205523  5394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ed89f0e9a64fd3ab95b7e83cd4b03a" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:15:45.206596  5392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ed89f0e9a64fd3ab95b7e83cd4b03a" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:45.182353  5319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ed89f0e9a64fd3ab95b7e83cd4b03a" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
W20260709 13:15:45.224642  5286 leader_election.cc:343] T 1db09971a25441c68427b8bea7e9c379 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.210207  5570 raft_consensus.cc:493] T 15d005f85bf54ebfb870b326ef3e18ed P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.237641  5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b75232471f416bb2d0ec813f32558e" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
I20260709 13:15:45.243592  5517 tablet_bootstrap.cc:654] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.240594  5393 raft_consensus.cc:2468] T 1db09971a25441c68427b8bea7e9c379 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 1.
I20260709 13:15:45.245311  5515 tablet_bootstrap.cc:492] T 4bc60d69f29e47689fd8fdf2b6aa836a P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
I20260709 13:15:45.240113  5319 raft_consensus.cc:3060] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:45.269603  5515 ts_tablet_manager.cc:1403] T 4bc60d69f29e47689fd8fdf2b6aa836a P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.314s	user 0.021s	sys 0.011s
I20260709 13:15:45.243852  5570 raft_consensus.cc:515] T 15d005f85bf54ebfb870b326ef3e18ed P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:45.242414  5209 leader_election.cc:304] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0
I20260709 13:15:45.279095  5245 raft_consensus.cc:2393] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f45532f94a34efcb68a82db3dd69372 in current term 1: Already voted for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in this term.
W20260709 13:15:45.282181  5434 leader_election.cc:343] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.292412  5663 raft_consensus.cc:2749] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:15:45.292763  5434 leader_election.cc:343] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.296512  5570 leader_election.cc:290] T 15d005f85bf54ebfb870b326ef3e18ed P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
W20260709 13:15:45.297869  5209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.132:41391, user_credentials={real_user=slave}} blocked reactor thread for 58366.1us
I20260709 13:15:45.299767  5286 leader_election.cc:304] T 1db09971a25441c68427b8bea7e9c379 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:45.301476  5706 raft_consensus.cc:2804] T 1db09971a25441c68427b8bea7e9c379 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:45.302017  5706 raft_consensus.cc:697] T 1db09971a25441c68427b8bea7e9c379 P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Becoming Leader. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Running, Role: LEADER
I20260709 13:15:45.302376  5318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15d005f85bf54ebfb870b326ef3e18ed" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:45.302598  5514 tablet_bootstrap.cc:492] T 99cdbf6d16c64a949df77a003bb7f7e4 P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:45.303133  5318 raft_consensus.cc:2468] T 15d005f85bf54ebfb870b326ef3e18ed P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 0.
I20260709 13:15:45.302917  5706 consensus_queue.cc:237] T 1db09971a25441c68427b8bea7e9c379 P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:45.303334  5514 ts_tablet_manager.cc:1403] T 99cdbf6d16c64a949df77a003bb7f7e4 P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.163s	user 0.023s	sys 0.048s
I20260709 13:15:45.317513  5516 tablet_bootstrap.cc:492] T bdbcf0a951c24340ba91509df11fc4c7 P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:45.318197  5516 ts_tablet_manager.cc:1403] T bdbcf0a951c24340ba91509df11fc4c7 P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.215s	user 0.029s	sys 0.010s
I20260709 13:15:45.320562  5140 catalog_manager.cc:5697] T 71b75232471f416bb2d0ec813f32558e P 2f45532f94a34efcb68a82db3dd69372 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130). New cstate: current_term: 1 leader_uuid: "2f45532f94a34efcb68a82db3dd69372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:45.323637  5516 raft_consensus.cc:359] T bdbcf0a951c24340ba91509df11fc4c7 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:45.324888  5516 raft_consensus.cc:385] T bdbcf0a951c24340ba91509df11fc4c7 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.324724  5515 raft_consensus.cc:359] T 4bc60d69f29e47689fd8fdf2b6aa836a P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:45.325330  5516 raft_consensus.cc:740] T bdbcf0a951c24340ba91509df11fc4c7 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.326327  5516 consensus_queue.cc:260] T bdbcf0a951c24340ba91509df11fc4c7 P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:45.325527  5515 raft_consensus.cc:385] T 4bc60d69f29e47689fd8fdf2b6aa836a P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.327544  5515 raft_consensus.cc:740] T 4bc60d69f29e47689fd8fdf2b6aa836a P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.328547  5515 consensus_queue.cc:260] T 4bc60d69f29e47689fd8fdf2b6aa836a P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:45.329928  5392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15d005f85bf54ebfb870b326ef3e18ed" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:45.327134  5719 raft_consensus.cc:515] T 068e5bd8f3ef45fc8a4a122e51537764 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:45.312588  5433 leader_election.cc:304] T 15d005f85bf54ebfb870b326ef3e18ed P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0; no voters: 
I20260709 13:15:45.336532  5604 raft_consensus.cc:2804] T 15d005f85bf54ebfb870b326ef3e18ed P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:45.336966  5604 raft_consensus.cc:493] T 15d005f85bf54ebfb870b326ef3e18ed P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:45.337323  5604 raft_consensus.cc:3060] T 15d005f85bf54ebfb870b326ef3e18ed P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:45.340018  5719 leader_election.cc:290] T 068e5bd8f3ef45fc8a4a122e51537764 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 election: Requested vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:45.343400  5319 raft_consensus.cc:2468] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 1.
I20260709 13:15:45.344413  5393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "068e5bd8f3ef45fc8a4a122e51537764" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:15:45.345180  5393 raft_consensus.cc:3060] T 068e5bd8f3ef45fc8a4a122e51537764 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:45.350163  5604 raft_consensus.cc:515] T 15d005f85bf54ebfb870b326ef3e18ed P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:45.350657  5514 raft_consensus.cc:359] T 99cdbf6d16c64a949df77a003bb7f7e4 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:45.351423  5514 raft_consensus.cc:385] T 99cdbf6d16c64a949df77a003bb7f7e4 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.352046  5514 raft_consensus.cc:740] T 99cdbf6d16c64a949df77a003bb7f7e4 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.352418  5515 ts_tablet_manager.cc:1434] T 4bc60d69f29e47689fd8fdf2b6aa836a P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.081s	user 0.008s	sys 0.000s
I20260709 13:15:45.352818  5514 consensus_queue.cc:260] T 99cdbf6d16c64a949df77a003bb7f7e4 P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
W20260709 13:15:45.351595  5434 leader_election.cc:343] T 15d005f85bf54ebfb870b326ef3e18ed P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.360862  5514 ts_tablet_manager.cc:1434] T 99cdbf6d16c64a949df77a003bb7f7e4 P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.054s	user 0.003s	sys 0.004s
I20260709 13:15:45.362246  5514 tablet_bootstrap.cc:492] T 43d23c7f276f4df1acd8124ed4940f1b P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
I20260709 13:15:45.369338  5514 tablet_bootstrap.cc:654] T 43d23c7f276f4df1acd8124ed4940f1b P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.369184  5433 leader_election.cc:304] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0; no voters: c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:45.370580  5570 raft_consensus.cc:2804] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:45.371125  5570 raft_consensus.cc:697] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 77789aa45dc5463c82b73504fef4b4e0 [term 1 LEADER]: Becoming Leader. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Running, Role: LEADER
I20260709 13:15:45.372082  5570 consensus_queue.cc:237] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
W20260709 13:15:45.380587  5434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:40847, user_credentials={real_user=slave}} blocked reactor thread for 46875.8us
I20260709 13:15:45.391001  5393 raft_consensus.cc:2468] T 068e5bd8f3ef45fc8a4a122e51537764 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 1.
I20260709 13:15:45.395565  5211 leader_election.cc:304] T 068e5bd8f3ef45fc8a4a122e51537764 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:45.396445  5719 raft_consensus.cc:2804] T 068e5bd8f3ef45fc8a4a122e51537764 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:45.397346  5516 ts_tablet_manager.cc:1434] T bdbcf0a951c24340ba91509df11fc4c7 P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.079s	user 0.004s	sys 0.004s
I20260709 13:15:45.398527  5516 tablet_bootstrap.cc:492] T cb26053fad7244cd88a5182d9cfc2109 P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
I20260709 13:15:45.398697  5514 tablet_bootstrap.cc:492] T 43d23c7f276f4df1acd8124ed4940f1b P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:45.399245  5514 ts_tablet_manager.cc:1403] T 43d23c7f276f4df1acd8124ed4940f1b P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.037s	user 0.017s	sys 0.013s
I20260709 13:15:45.401093  5140 catalog_manager.cc:5697] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 77789aa45dc5463c82b73504fef4b4e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132). New cstate: current_term: 1 leader_uuid: "77789aa45dc5463c82b73504fef4b4e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:45.402339  5514 raft_consensus.cc:359] T 43d23c7f276f4df1acd8124ed4940f1b P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:45.403023  5514 raft_consensus.cc:385] T 43d23c7f276f4df1acd8124ed4940f1b P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.403290  5514 raft_consensus.cc:740] T 43d23c7f276f4df1acd8124ed4940f1b P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.403759  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "068e5bd8f3ef45fc8a4a122e51537764" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:15:45.404204  5514 consensus_queue.cc:260] T 43d23c7f276f4df1acd8124ed4940f1b P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:45.404834  5469 raft_consensus.cc:3060] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:45.406966  5514 ts_tablet_manager.cc:1434] T 43d23c7f276f4df1acd8124ed4940f1b P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:45.408200  5514 tablet_bootstrap.cc:492] T 34516de894fc408b8e355aba3402489c P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
I20260709 13:15:45.411763  5575 raft_consensus.cc:493] T bdbcf0a951c24340ba91509df11fc4c7 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.412946  5575 raft_consensus.cc:515] T bdbcf0a951c24340ba91509df11fc4c7 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:45.415221  5514 tablet_bootstrap.cc:654] T 34516de894fc408b8e355aba3402489c P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.423158  5467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbcf0a951c24340ba91509df11fc4c7" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:45.425614  5719 raft_consensus.cc:697] T 068e5bd8f3ef45fc8a4a122e51537764 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 LEADER]: Becoming Leader. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Running, Role: LEADER
I20260709 13:15:45.426911  5719 consensus_queue.cc:237] T 068e5bd8f3ef45fc8a4a122e51537764 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:45.427783  5575 leader_election.cc:290] T bdbcf0a951c24340ba91509df11fc4c7 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:45.401085  5515 tablet_bootstrap.cc:492] T 22ee19164403428187e72d7a7c868457 P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
I20260709 13:15:45.433204  5514 tablet_bootstrap.cc:492] T 34516de894fc408b8e355aba3402489c P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:45.433871  5514 ts_tablet_manager.cc:1403] T 34516de894fc408b8e355aba3402489c P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.004s
I20260709 13:15:45.437660  5514 raft_consensus.cc:359] T 34516de894fc408b8e355aba3402489c P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:45.438437  5514 raft_consensus.cc:385] T 34516de894fc408b8e355aba3402489c P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.438735  5514 raft_consensus.cc:740] T 34516de894fc408b8e355aba3402489c P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.439538  5514 consensus_queue.cc:260] T 34516de894fc408b8e355aba3402489c P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:45.441082  5515 tablet_bootstrap.cc:654] T 22ee19164403428187e72d7a7c868457 P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.449213  5514 ts_tablet_manager.cc:1434] T 34516de894fc408b8e355aba3402489c P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:15:45.450424  5514 tablet_bootstrap.cc:492] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
I20260709 13:15:45.459915  5514 tablet_bootstrap.cc:654] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.445976  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbcf0a951c24340ba91509df11fc4c7" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:45.480221  5286 leader_election.cc:304] T bdbcf0a951c24340ba91509df11fc4c7 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, 77789aa45dc5463c82b73504fef4b4e0
I20260709 13:15:45.480819  5140 catalog_manager.cc:5697] T 068e5bd8f3ef45fc8a4a122e51537764 P 538ff4bfbd0c4f04bcd800c4ee4845ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129). New cstate: current_term: 1 leader_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:45.482851  5684 raft_consensus.cc:2749] T bdbcf0a951c24340ba91509df11fc4c7 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:45.488147  5570 raft_consensus.cc:493] T 99cdbf6d16c64a949df77a003bb7f7e4 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.489121  5570 raft_consensus.cc:515] T 99cdbf6d16c64a949df77a003bb7f7e4 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:45.492854  5570 leader_election.cc:290] T 99cdbf6d16c64a949df77a003bb7f7e4 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:45.494931  5515 tablet_bootstrap.cc:492] T 22ee19164403428187e72d7a7c868457 P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
I20260709 13:15:45.495862  5515 ts_tablet_manager.cc:1403] T 22ee19164403428187e72d7a7c868457 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.142s	user 0.015s	sys 0.000s
I20260709 13:15:45.498773  5604 leader_election.cc:290] T 15d005f85bf54ebfb870b326ef3e18ed P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 election: Requested vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:45.500104  5318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15d005f85bf54ebfb870b326ef3e18ed" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:15:45.507861  5318 raft_consensus.cc:3060] T 15d005f85bf54ebfb870b326ef3e18ed P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:45.501832  5143 catalog_manager.cc:5697] T 1db09971a25441c68427b8bea7e9c379 P 2f45532f94a34efcb68a82db3dd69372 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130). New cstate: current_term: 1 leader_uuid: "2f45532f94a34efcb68a82db3dd69372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:45.505163  5517 tablet_bootstrap.cc:492] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:45.512373  5517 ts_tablet_manager.cc:1403] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.367s	user 0.018s	sys 0.003s
I20260709 13:15:45.506987  5469 raft_consensus.cc:2468] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 1.
I20260709 13:15:45.529131  5393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99cdbf6d16c64a949df77a003bb7f7e4" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:45.530031  5393 raft_consensus.cc:2468] T 99cdbf6d16c64a949df77a003bb7f7e4 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 0.
I20260709 13:15:45.532179  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99cdbf6d16c64a949df77a003bb7f7e4" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:45.537156  5393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15d005f85bf54ebfb870b326ef3e18ed" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:15:45.537443  5515 raft_consensus.cc:359] T 22ee19164403428187e72d7a7c868457 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:45.538218  5515 raft_consensus.cc:385] T 22ee19164403428187e72d7a7c868457 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.538515  5515 raft_consensus.cc:740] T 22ee19164403428187e72d7a7c868457 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.539330  5434 leader_election.cc:304] T 99cdbf6d16c64a949df77a003bb7f7e4 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:45.539330  5515 consensus_queue.cc:260] T 22ee19164403428187e72d7a7c868457 P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:45.542284  5570 raft_consensus.cc:2804] T 99cdbf6d16c64a949df77a003bb7f7e4 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:45.542660  5570 raft_consensus.cc:493] T 99cdbf6d16c64a949df77a003bb7f7e4 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:45.543006  5570 raft_consensus.cc:3060] T 99cdbf6d16c64a949df77a003bb7f7e4 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:45.549844  5515 ts_tablet_manager.cc:1434] T 22ee19164403428187e72d7a7c868457 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.001s
I20260709 13:15:45.551205  5515 tablet_bootstrap.cc:492] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
I20260709 13:15:45.557374  5516 tablet_bootstrap.cc:654] T cb26053fad7244cd88a5182d9cfc2109 P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.562318  5570 raft_consensus.cc:515] T 99cdbf6d16c64a949df77a003bb7f7e4 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:45.560366  5515 tablet_bootstrap.cc:654] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.544449  5604 consensus_queue.cc:1048] T c01a087c57254cf0822d574602320ab5 P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:15:45.558094  5517 raft_consensus.cc:359] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:45.570717  5517 raft_consensus.cc:385] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.571164  5517 raft_consensus.cc:740] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.572458  5570 leader_election.cc:290] T 99cdbf6d16c64a949df77a003bb7f7e4 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 election: Requested vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:45.572250  5517 consensus_queue.cc:260] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:45.574239  5517 ts_tablet_manager.cc:1434] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.062s	user 0.004s	sys 0.003s
I20260709 13:15:45.575677  5517 tablet_bootstrap.cc:492] T 4bc60d69f29e47689fd8fdf2b6aa836a P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:45.576437  5318 raft_consensus.cc:2468] T 15d005f85bf54ebfb870b326ef3e18ed P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 1.
I20260709 13:15:45.591028  5517 tablet_bootstrap.cc:654] T 4bc60d69f29e47689fd8fdf2b6aa836a P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.604338  5514 tablet_bootstrap.cc:492] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:45.605253  5514 ts_tablet_manager.cc:1403] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.155s	user 0.033s	sys 0.035s
W20260709 13:15:45.564868  5434 leader_election.cc:343] T 15d005f85bf54ebfb870b326ef3e18ed P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.613600  5433 leader_election.cc:304] T 15d005f85bf54ebfb870b326ef3e18ed P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0; no voters: c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:45.615043  5604 raft_consensus.cc:2804] T 15d005f85bf54ebfb870b326ef3e18ed P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:45.615651  5604 raft_consensus.cc:697] T 15d005f85bf54ebfb870b326ef3e18ed P 77789aa45dc5463c82b73504fef4b4e0 [term 1 LEADER]: Becoming Leader. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Running, Role: LEADER
I20260709 13:15:45.616597  5604 consensus_queue.cc:237] T 15d005f85bf54ebfb870b326ef3e18ed P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:45.619659  5706 consensus_queue.cc:1048] T 71b75232471f416bb2d0ec813f32558e P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:45.622393  5514 raft_consensus.cc:359] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:45.623457  5514 raft_consensus.cc:385] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.623883  5514 raft_consensus.cc:740] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.624591  5514 consensus_queue.cc:260] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:45.628391  5514 ts_tablet_manager.cc:1434] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.023s	user 0.010s	sys 0.000s
I20260709 13:15:45.630316  5514 tablet_bootstrap.cc:492] T 309fb72c5b374642bb05a78b0b5ca308 P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
W20260709 13:15:45.625771  5434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:40847, user_credentials={real_user=slave}} blocked reactor thread for 76504.1us
W20260709 13:15:45.632834  5434 leader_election.cc:343] T 99cdbf6d16c64a949df77a003bb7f7e4 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.636973  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99cdbf6d16c64a949df77a003bb7f7e4" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
I20260709 13:15:45.638314  5393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99cdbf6d16c64a949df77a003bb7f7e4" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:15:45.639204  5393 raft_consensus.cc:3060] T 99cdbf6d16c64a949df77a003bb7f7e4 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:45.647850  5514 tablet_bootstrap.cc:654] T 309fb72c5b374642bb05a78b0b5ca308 P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.650169  5749 consensus_queue.cc:1048] T c01a087c57254cf0822d574602320ab5 P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:45.653007  5604 raft_consensus.cc:493] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.638247  5143 catalog_manager.cc:5697] T 15d005f85bf54ebfb870b326ef3e18ed P 77789aa45dc5463c82b73504fef4b4e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132). New cstate: current_term: 1 leader_uuid: "77789aa45dc5463c82b73504fef4b4e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:45.655155  5646 raft_consensus.cc:493] T 4bc60d69f29e47689fd8fdf2b6aa836a P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.666250  5646 raft_consensus.cc:515] T 4bc60d69f29e47689fd8fdf2b6aa836a P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:45.670152  5646 leader_election.cc:290] T 4bc60d69f29e47689fd8fdf2b6aa836a P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:45.671105  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc60d69f29e47689fd8fdf2b6aa836a" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
W20260709 13:15:45.672673  5360 leader_election.cc:343] T 4bc60d69f29e47689fd8fdf2b6aa836a P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.674118  5516 tablet_bootstrap.cc:492] T cb26053fad7244cd88a5182d9cfc2109 P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:45.674854  5516 ts_tablet_manager.cc:1403] T cb26053fad7244cd88a5182d9cfc2109 P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.277s	user 0.002s	sys 0.017s
I20260709 13:15:45.658108  5393 raft_consensus.cc:2468] T 99cdbf6d16c64a949df77a003bb7f7e4 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 1.
I20260709 13:15:45.670817  5604 raft_consensus.cc:515] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:45.683019  5604 leader_election.cc:290] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:45.684760  5318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63267e5ca2594b41844fd758ca603a34" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
W20260709 13:15:45.688429  5433 leader_election.cc:343] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.676872  5515 tablet_bootstrap.cc:492] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
I20260709 13:15:45.679330  5706 consensus_queue.cc:1048] T 71b75232471f416bb2d0ec813f32558e P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:45.689644  5515 ts_tablet_manager.cc:1403] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.139s	user 0.024s	sys 0.018s
I20260709 13:15:45.691351  5591 raft_consensus.cc:493] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.691975  5591 raft_consensus.cc:515] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:45.694542  5591 leader_election.cc:290] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:45.694219  5515 raft_consensus.cc:359] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:45.695101  5515 raft_consensus.cc:385] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.687952  5516 raft_consensus.cc:359] T cb26053fad7244cd88a5182d9cfc2109 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
W20260709 13:15:45.660534  5434 leader_election.cc:343] T 99cdbf6d16c64a949df77a003bb7f7e4 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.696161  5516 raft_consensus.cc:385] T cb26053fad7244cd88a5182d9cfc2109 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.696584  5516 raft_consensus.cc:740] T cb26053fad7244cd88a5182d9cfc2109 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.700083  5515 raft_consensus.cc:740] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.701223  5515 consensus_queue.cc:260] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:45.703926  5515 ts_tablet_manager.cc:1434] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.000s
W20260709 13:15:45.705466  5434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:41357, user_credentials={real_user=slave}} blocked reactor thread for 44979.3us
I20260709 13:15:45.706629  5516 consensus_queue.cc:260] T cb26053fad7244cd88a5182d9cfc2109 P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:45.709062  5516 ts_tablet_manager.cc:1434] T cb26053fad7244cd88a5182d9cfc2109 P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.034s	user 0.011s	sys 0.000s
I20260709 13:15:45.709100  5468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc60d69f29e47689fd8fdf2b6aa836a" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:45.709946  5468 raft_consensus.cc:2468] T 4bc60d69f29e47689fd8fdf2b6aa836a P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 0.
I20260709 13:15:45.710394  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63267e5ca2594b41844fd758ca603a34" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:45.710929  5467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63267e5ca2594b41844fd758ca603a34" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:45.711171  5246 raft_consensus.cc:2468] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 0.
I20260709 13:15:45.711687  5467 raft_consensus.cc:2468] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 0.
I20260709 13:15:45.713335  5434 leader_election.cc:304] T 99cdbf6d16c64a949df77a003bb7f7e4 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:45.695873  5318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63267e5ca2594b41844fd758ca603a34" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:45.717067  5516 tablet_bootstrap.cc:492] T 654fdf03209d4a3cbf17055c56ae2c9d P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
I20260709 13:15:45.719314  5570 raft_consensus.cc:2804] T 99cdbf6d16c64a949df77a003bb7f7e4 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:45.732883  5515 tablet_bootstrap.cc:492] T 34516de894fc408b8e355aba3402489c P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
I20260709 13:15:45.736521  5570 raft_consensus.cc:697] T 99cdbf6d16c64a949df77a003bb7f7e4 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 LEADER]: Becoming Leader. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Running, Role: LEADER
I20260709 13:15:45.737668  5570 consensus_queue.cc:237] T 99cdbf6d16c64a949df77a003bb7f7e4 P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
W20260709 13:15:45.725770  5210 leader_election.cc:343] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.725914  5749 raft_consensus.cc:493] T 34516de894fc408b8e355aba3402489c P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.745391  5749 raft_consensus.cc:515] T 34516de894fc408b8e355aba3402489c P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:45.746510  5358 leader_election.cc:304] T 4bc60d69f29e47689fd8fdf2b6aa836a P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:45.747737  5749 leader_election.cc:290] T 34516de894fc408b8e355aba3402489c P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:45.748345  5646 raft_consensus.cc:2804] T 4bc60d69f29e47689fd8fdf2b6aa836a P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:45.748754  5646 raft_consensus.cc:493] T 4bc60d69f29e47689fd8fdf2b6aa836a P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:45.749118  5646 raft_consensus.cc:3060] T 4bc60d69f29e47689fd8fdf2b6aa836a P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:45.751928  5516 tablet_bootstrap.cc:654] T 654fdf03209d4a3cbf17055c56ae2c9d P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.761650  5517 tablet_bootstrap.cc:492] T 4bc60d69f29e47689fd8fdf2b6aa836a P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:45.762280  5517 ts_tablet_manager.cc:1403] T 4bc60d69f29e47689fd8fdf2b6aa836a P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.187s	user 0.025s	sys 0.014s
I20260709 13:15:45.774070  5515 tablet_bootstrap.cc:654] T 34516de894fc408b8e355aba3402489c P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.773942  5318 raft_consensus.cc:3060] T bdbcf0a951c24340ba91509df11fc4c7 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:45.762701  5209 leader_election.cc:304] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, 77789aa45dc5463c82b73504fef4b4e0; no voters: 2f45532f94a34efcb68a82db3dd69372
I20260709 13:15:45.778246  5434 leader_election.cc:304] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, 77789aa45dc5463c82b73504fef4b4e0; no voters: 2f45532f94a34efcb68a82db3dd69372
I20260709 13:15:45.779479  5517 raft_consensus.cc:359] T 4bc60d69f29e47689fd8fdf2b6aa836a P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:45.781970  5517 raft_consensus.cc:385] T 4bc60d69f29e47689fd8fdf2b6aa836a P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.782248  5517 raft_consensus.cc:740] T 4bc60d69f29e47689fd8fdf2b6aa836a P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.783428  5683 raft_consensus.cc:2804] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:45.784251  5683 raft_consensus.cc:493] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:45.784605  5683 raft_consensus.cc:3060] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:45.788363  5392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34516de894fc408b8e355aba3402489c" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:45.788513  5591 raft_consensus.cc:2804] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:45.790639  5591 raft_consensus.cc:493] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:45.791028  5591 raft_consensus.cc:3060] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:45.783061  5517 consensus_queue.cc:260] T 4bc60d69f29e47689fd8fdf2b6aa836a P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:45.795182  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34516de894fc408b8e355aba3402489c" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:45.803612  5646 raft_consensus.cc:515] T 4bc60d69f29e47689fd8fdf2b6aa836a P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
W20260709 13:15:45.805569  5434 leader_election.cc:343] T 34516de894fc408b8e355aba3402489c P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.826362  5514 tablet_bootstrap.cc:492] T 309fb72c5b374642bb05a78b0b5ca308 P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:45.827286  5514 ts_tablet_manager.cc:1403] T 309fb72c5b374642bb05a78b0b5ca308 P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.197s	user 0.009s	sys 0.013s
I20260709 13:15:45.830951  5517 ts_tablet_manager.cc:1434] T 4bc60d69f29e47689fd8fdf2b6aa836a P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.068s	user 0.008s	sys 0.003s
I20260709 13:15:45.833966  5517 tablet_bootstrap.cc:492] T 0796f5098e2a48c992868bbffce02505 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:45.804034  5591 raft_consensus.cc:515] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
W20260709 13:15:45.832477  5434 leader_election.cc:343] T 34516de894fc408b8e355aba3402489c P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.844543  5516 tablet_bootstrap.cc:492] T 654fdf03209d4a3cbf17055c56ae2c9d P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:45.848109  5514 raft_consensus.cc:359] T 309fb72c5b374642bb05a78b0b5ca308 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:45.851751  5434 leader_election.cc:304] T 34516de894fc408b8e355aba3402489c P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:45.852916  5646 leader_election.cc:290] T 4bc60d69f29e47689fd8fdf2b6aa836a P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 election: Requested vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:45.856748  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc60d69f29e47689fd8fdf2b6aa836a" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
I20260709 13:15:45.857800  5243 raft_consensus.cc:3060] T 4bc60d69f29e47689fd8fdf2b6aa836a P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:45.861133  5570 raft_consensus.cc:2749] T 34516de894fc408b8e355aba3402489c P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:45.862025  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc60d69f29e47689fd8fdf2b6aa836a" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:15:45.862056  5141 catalog_manager.cc:5697] T 99cdbf6d16c64a949df77a003bb7f7e4 P 77789aa45dc5463c82b73504fef4b4e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132). New cstate: current_term: 1 leader_uuid: "77789aa45dc5463c82b73504fef4b4e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:45.864274  5469 raft_consensus.cc:3060] T 4bc60d69f29e47689fd8fdf2b6aa836a P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:45.863587  5516 ts_tablet_manager.cc:1403] T 654fdf03209d4a3cbf17055c56ae2c9d P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.147s	user 0.015s	sys 0.014s
I20260709 13:15:45.855794  5514 raft_consensus.cc:385] T 309fb72c5b374642bb05a78b0b5ca308 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.867624  5514 raft_consensus.cc:740] T 309fb72c5b374642bb05a78b0b5ca308 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.868454  5514 consensus_queue.cc:260] T 309fb72c5b374642bb05a78b0b5ca308 P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
W20260709 13:15:45.832171  5286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:41357, user_credentials={real_user=slave}} blocked reactor thread for 73847.6us
I20260709 13:15:45.873553  5467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63267e5ca2594b41844fd758ca603a34" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:15:45.874079  5243 raft_consensus.cc:2468] T 4bc60d69f29e47689fd8fdf2b6aa836a P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 1.
I20260709 13:15:45.875577  5360 leader_election.cc:304] T 4bc60d69f29e47689fd8fdf2b6aa836a P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:45.855794  5683 raft_consensus.cc:515] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:45.878310  5467 raft_consensus.cc:2393] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in current term 1: Already voted for candidate 77789aa45dc5463c82b73504fef4b4e0 in this term.
I20260709 13:15:45.883939  5646 raft_consensus.cc:2804] T 4bc60d69f29e47689fd8fdf2b6aa836a P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:45.884505  5646 raft_consensus.cc:697] T 4bc60d69f29e47689fd8fdf2b6aa836a P c4b52f14f9154b5a86f76fe58e4c235e [term 1 LEADER]: Becoming Leader. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Running, Role: LEADER
I20260709 13:15:45.885401  5319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63267e5ca2594b41844fd758ca603a34" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
W20260709 13:15:45.888031  5433 leader_election.cc:343] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.885438  5646 consensus_queue.cc:237] T 4bc60d69f29e47689fd8fdf2b6aa836a P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:45.890548  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63267e5ca2594b41844fd758ca603a34" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
I20260709 13:15:45.896633  5246 raft_consensus.cc:2393] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 77789aa45dc5463c82b73504fef4b4e0 in current term 1: Already voted for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in this term.
I20260709 13:15:45.899613  5683 leader_election.cc:290] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 election: Requested vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:45.900317  5319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63267e5ca2594b41844fd758ca603a34" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:15:45.899667  5434 leader_election.cc:304] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0; no voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:45.889835  5516 raft_consensus.cc:359] T 654fdf03209d4a3cbf17055c56ae2c9d P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:45.901283  5714 raft_consensus.cc:493] T 43d23c7f276f4df1acd8124ed4940f1b P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.901419  5516 raft_consensus.cc:385] T 654fdf03209d4a3cbf17055c56ae2c9d P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:45.895913  5591 leader_election.cc:290] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 election: Requested vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:45.908812  5516 raft_consensus.cc:740] T 654fdf03209d4a3cbf17055c56ae2c9d P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:45.916172  5517 tablet_bootstrap.cc:654] T 0796f5098e2a48c992868bbffce02505 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.916680  5514 ts_tablet_manager.cc:1434] T 309fb72c5b374642bb05a78b0b5ca308 P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.089s	user 0.009s	sys 0.000s
I20260709 13:15:45.918308  5514 tablet_bootstrap.cc:492] T cb26053fad7244cd88a5182d9cfc2109 P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
I20260709 13:15:45.925191  5516 consensus_queue.cc:260] T 654fdf03209d4a3cbf17055c56ae2c9d P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:45.913928  5570 raft_consensus.cc:2749] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:45.901908  5714 raft_consensus.cc:515] T 43d23c7f276f4df1acd8124ed4940f1b P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:45.945063  5516 ts_tablet_manager.cc:1434] T 654fdf03209d4a3cbf17055c56ae2c9d P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.077s	user 0.009s	sys 0.000s
I20260709 13:15:45.955579  5516 tablet_bootstrap.cc:492] T 8aac85b71e404ee1bcfb748bfb0376fb P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
W20260709 13:15:45.965806  5192 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:45.968763  5515 tablet_bootstrap.cc:492] T 34516de894fc408b8e355aba3402489c P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
I20260709 13:15:45.969406  5515 ts_tablet_manager.cc:1403] T 34516de894fc408b8e355aba3402489c P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.244s	user 0.031s	sys 0.007s
I20260709 13:15:45.972837  5604 raft_consensus.cc:493] T 309fb72c5b374642bb05a78b0b5ca308 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:45.940665  5210 leader_election.cc:343] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:45.940313  5469 raft_consensus.cc:2468] T 4bc60d69f29e47689fd8fdf2b6aa836a P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 1.
I20260709 13:15:45.980247  5683 consensus_queue.cc:1048] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:45.982295  5392 raft_consensus.cc:3060] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:45.984048  5514 tablet_bootstrap.cc:654] T cb26053fad7244cd88a5182d9cfc2109 P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:45.974298  5604 raft_consensus.cc:515] T 309fb72c5b374642bb05a78b0b5ca308 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:45.975862  5210 leader_election.cc:304] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0
I20260709 13:15:45.990974  5530 raft_consensus.cc:2749] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:45.993580  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309fb72c5b374642bb05a78b0b5ca308" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:45.993330  5143 catalog_manager.cc:5697] T 4bc60d69f29e47689fd8fdf2b6aa836a P c4b52f14f9154b5a86f76fe58e4c235e reported cstate change: term changed from 0 to 1, leader changed from <none> to c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131). New cstate: current_term: 1 leader_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:46.000372  5434 leader_election.cc:343] T 309fb72c5b374642bb05a78b0b5ca308 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:46.005669  5706 raft_consensus.cc:493] T 654fdf03209d4a3cbf17055c56ae2c9d P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.006273  5706 raft_consensus.cc:515] T 654fdf03209d4a3cbf17055c56ae2c9d P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
W20260709 13:15:46.002233  5286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:41357, user_credentials={real_user=slave}} blocked reactor thread for 86283us
I20260709 13:15:45.986063  5604 leader_election.cc:290] T 309fb72c5b374642bb05a78b0b5ca308 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
W20260709 13:15:45.991101  5210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:43623, user_credentials={real_user=slave}} blocked reactor thread for 52778.6us
I20260709 13:15:45.982319  5515 raft_consensus.cc:359] T 34516de894fc408b8e355aba3402489c P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:46.012857  5515 raft_consensus.cc:385] T 34516de894fc408b8e355aba3402489c P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.013410  5515 raft_consensus.cc:740] T 34516de894fc408b8e355aba3402489c P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.014199  5515 consensus_queue.cc:260] T 34516de894fc408b8e355aba3402489c P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:46.012629  5319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309fb72c5b374642bb05a78b0b5ca308" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:46.024665  5515 ts_tablet_manager.cc:1434] T 34516de894fc408b8e355aba3402489c P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.055s	user 0.009s	sys 0.000s
I20260709 13:15:46.025939  5515 tablet_bootstrap.cc:492] T 15d005f85bf54ebfb870b326ef3e18ed P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
I20260709 13:15:46.026947  5624 raft_consensus.cc:493] T 22ee19164403428187e72d7a7c868457 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.027585  5624 raft_consensus.cc:515] T 22ee19164403428187e72d7a7c868457 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:46.032696  5714 leader_election.cc:290] T 43d23c7f276f4df1acd8124ed4940f1b P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:46.032770  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ee19164403428187e72d7a7c868457" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:46.010036  5706 leader_election.cc:290] T 654fdf03209d4a3cbf17055c56ae2c9d P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:46.033151  5515 tablet_bootstrap.cc:654] T 15d005f85bf54ebfb870b326ef3e18ed P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.030026  5624 leader_election.cc:290] T 22ee19164403428187e72d7a7c868457 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:46.048503  5530 consensus_queue.cc:1048] T 068e5bd8f3ef45fc8a4a122e51537764 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:46.048790  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ee19164403428187e72d7a7c868457" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
W20260709 13:15:46.036725  5433 leader_election.cc:343] T 309fb72c5b374642bb05a78b0b5ca308 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:46.051604  5433 leader_election.cc:304] T 309fb72c5b374642bb05a78b0b5ca308 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0; no voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba
W20260709 13:15:46.051980  5360 leader_election.cc:343] T 22ee19164403428187e72d7a7c868457 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:46.054261  5683 raft_consensus.cc:2749] T 309fb72c5b374642bb05a78b0b5ca308 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:46.057526  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654fdf03209d4a3cbf17055c56ae2c9d" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:46.057611  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43d23c7f276f4df1acd8124ed4940f1b" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:46.058908  5243 raft_consensus.cc:2468] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 0.
I20260709 13:15:46.063145  5765 consensus_queue.cc:1048] T 1db09971a25441c68427b8bea7e9c379 P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:46.065239  5392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654fdf03209d4a3cbf17055c56ae2c9d" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:46.068006  5286 leader_election.cc:304] T 654fdf03209d4a3cbf17055c56ae2c9d P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 
I20260709 13:15:46.068050  5395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43d23c7f276f4df1acd8124ed4940f1b" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:46.069239  5765 raft_consensus.cc:2804] T 654fdf03209d4a3cbf17055c56ae2c9d P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:15:46.069543  5286 consensus_peers.cc:597] T 1db09971a25441c68427b8bea7e9c379 P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:46.069749  5765 raft_consensus.cc:493] T 654fdf03209d4a3cbf17055c56ae2c9d P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:46.070348  5765 raft_consensus.cc:3060] T 654fdf03209d4a3cbf17055c56ae2c9d P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:46.073541  5719 consensus_queue.cc:1048] T 068e5bd8f3ef45fc8a4a122e51537764 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:46.084270  5604 consensus_queue.cc:1048] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:46.086584  5765 raft_consensus.cc:515] T 654fdf03209d4a3cbf17055c56ae2c9d P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:46.092542  5765 leader_election.cc:290] T 654fdf03209d4a3cbf17055c56ae2c9d P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Requested vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:46.095016  5516 tablet_bootstrap.cc:654] T 8aac85b71e404ee1bcfb748bfb0376fb P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.103756  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654fdf03209d4a3cbf17055c56ae2c9d" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
I20260709 13:15:46.104588  5243 raft_consensus.cc:3060] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:46.117663  5433 leader_election.cc:343] T 43d23c7f276f4df1acd8124ed4940f1b P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:46.121958  5359 leader_election.cc:343] T 22ee19164403428187e72d7a7c868457 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:46.122732  5359 leader_election.cc:304] T 22ee19164403428187e72d7a7c868457 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b52f14f9154b5a86f76fe58e4c235e; no voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:46.123720  5624 raft_consensus.cc:2749] T 22ee19164403428187e72d7a7c868457 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:46.125598  5286 leader_election.cc:343] T 654fdf03209d4a3cbf17055c56ae2c9d P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:46.129558  5624 raft_consensus.cc:493] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.130373  5624 raft_consensus.cc:515] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:46.134773  5624 leader_election.cc:290] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:46.147683  5467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ed89f0e9a64fd3ab95b7e83cd4b03a" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:46.168478  5684 raft_consensus.cc:493] T cb26053fad7244cd88a5182d9cfc2109 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.169096  5684 raft_consensus.cc:515] T cb26053fad7244cd88a5182d9cfc2109 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:46.173030  5465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb26053fad7244cd88a5182d9cfc2109" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:46.173319  5684 leader_election.cc:290] T cb26053fad7244cd88a5182d9cfc2109 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
W20260709 13:15:46.176782  5284 leader_election.cc:343] T cb26053fad7244cd88a5182d9cfc2109 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:46.178413  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb26053fad7244cd88a5182d9cfc2109" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
W20260709 13:15:46.181531  5286 leader_election.cc:343] T cb26053fad7244cd88a5182d9cfc2109 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:46.182011  5286 leader_election.cc:304] T cb26053fad7244cd88a5182d9cfc2109 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, 77789aa45dc5463c82b73504fef4b4e0
I20260709 13:15:46.182751  5706 raft_consensus.cc:2749] T cb26053fad7244cd88a5182d9cfc2109 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:46.209396  5515 tablet_bootstrap.cc:492] T 15d005f85bf54ebfb870b326ef3e18ed P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
I20260709 13:15:46.210358  5515 ts_tablet_manager.cc:1403] T 15d005f85bf54ebfb870b326ef3e18ed P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.185s	user 0.031s	sys 0.007s
I20260709 13:15:46.209396  5516 tablet_bootstrap.cc:492] T 8aac85b71e404ee1bcfb748bfb0376fb P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:46.214445  5516 ts_tablet_manager.cc:1403] T 8aac85b71e404ee1bcfb748bfb0376fb P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.260s	user 0.021s	sys 0.002s
I20260709 13:15:46.215051  5514 tablet_bootstrap.cc:492] T cb26053fad7244cd88a5182d9cfc2109 P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:46.215659  5514 ts_tablet_manager.cc:1403] T cb26053fad7244cd88a5182d9cfc2109 P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.298s	user 0.014s	sys 0.002s
I20260709 13:15:46.215692  5515 raft_consensus.cc:359] T 15d005f85bf54ebfb870b326ef3e18ed P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:46.216740  5515 raft_consensus.cc:385] T 15d005f85bf54ebfb870b326ef3e18ed P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.217108  5515 raft_consensus.cc:740] T 15d005f85bf54ebfb870b326ef3e18ed P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.217840  5516 raft_consensus.cc:359] T 8aac85b71e404ee1bcfb748bfb0376fb P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:46.217939  5515 consensus_queue.cc:260] T 15d005f85bf54ebfb870b326ef3e18ed P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:46.218676  5516 raft_consensus.cc:385] T 8aac85b71e404ee1bcfb748bfb0376fb P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.219024  5516 raft_consensus.cc:740] T 8aac85b71e404ee1bcfb748bfb0376fb P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.220366  5515 ts_tablet_manager.cc:1434] T 15d005f85bf54ebfb870b326ef3e18ed P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:15:46.221055  5394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654fdf03209d4a3cbf17055c56ae2c9d" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:15:46.221400  5515 tablet_bootstrap.cc:492] T 0796f5098e2a48c992868bbffce02505 P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
I20260709 13:15:46.226329  5394 raft_consensus.cc:3060] T 15d005f85bf54ebfb870b326ef3e18ed P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:46.209601  5517 tablet_bootstrap.cc:492] T 0796f5098e2a48c992868bbffce02505 P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:46.232144  5517 ts_tablet_manager.cc:1403] T 0796f5098e2a48c992868bbffce02505 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.400s	user 0.027s	sys 0.018s
I20260709 13:15:46.232821  5515 tablet_bootstrap.cc:654] T 0796f5098e2a48c992868bbffce02505 P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.237042  5514 raft_consensus.cc:359] T cb26053fad7244cd88a5182d9cfc2109 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:46.237882  5514 raft_consensus.cc:385] T cb26053fad7244cd88a5182d9cfc2109 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.238149  5514 raft_consensus.cc:740] T cb26053fad7244cd88a5182d9cfc2109 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.238869  5514 consensus_queue.cc:260] T cb26053fad7244cd88a5182d9cfc2109 P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:46.244189  5514 ts_tablet_manager.cc:1434] T cb26053fad7244cd88a5182d9cfc2109 P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:15:46.245289  5514 tablet_bootstrap.cc:492] T 0796f5098e2a48c992868bbffce02505 P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
I20260709 13:15:46.250145  5714 consensus_queue.cc:1048] T 15d005f85bf54ebfb870b326ef3e18ed P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:46.254485  5516 consensus_queue.cc:260] T 8aac85b71e404ee1bcfb748bfb0376fb P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:46.259152  5243 raft_consensus.cc:2468] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 1.
I20260709 13:15:46.262708  5286 leader_election.cc:304] T 654fdf03209d4a3cbf17055c56ae2c9d P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 
I20260709 13:15:46.264791  5517 raft_consensus.cc:359] T 0796f5098e2a48c992868bbffce02505 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:46.265702  5517 raft_consensus.cc:385] T 0796f5098e2a48c992868bbffce02505 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.265996  5517 raft_consensus.cc:740] T 0796f5098e2a48c992868bbffce02505 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.267176  5517 consensus_queue.cc:260] T 0796f5098e2a48c992868bbffce02505 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:46.269527  5684 raft_consensus.cc:2804] T 654fdf03209d4a3cbf17055c56ae2c9d P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:46.270156  5684 raft_consensus.cc:697] T 654fdf03209d4a3cbf17055c56ae2c9d P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Becoming Leader. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Running, Role: LEADER
I20260709 13:15:46.274806  5517 ts_tablet_manager.cc:1434] T 0796f5098e2a48c992868bbffce02505 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.042s	user 0.004s	sys 0.004s
I20260709 13:15:46.276144  5517 tablet_bootstrap.cc:492] T 99cdbf6d16c64a949df77a003bb7f7e4 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:46.276849  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34ed89f0e9a64fd3ab95b7e83cd4b03a" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:46.271304  5684 consensus_queue.cc:237] T 654fdf03209d4a3cbf17055c56ae2c9d P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
W20260709 13:15:46.269345  5286 leader_election.cc:343] T 654fdf03209d4a3cbf17055c56ae2c9d P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:46.287582  5434 leader_election.cc:343] T 43d23c7f276f4df1acd8124ed4940f1b P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:46.291663  5517 tablet_bootstrap.cc:654] T 99cdbf6d16c64a949df77a003bb7f7e4 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.294114  5434 leader_election.cc:304] T 43d23c7f276f4df1acd8124ed4940f1b P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0; no voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:46.299219  5516 ts_tablet_manager.cc:1434] T 8aac85b71e404ee1bcfb748bfb0376fb P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.084s	user 0.010s	sys 0.000s
I20260709 13:15:46.301865  5515 tablet_bootstrap.cc:492] T 0796f5098e2a48c992868bbffce02505 P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
I20260709 13:15:46.302625  5515 ts_tablet_manager.cc:1403] T 0796f5098e2a48c992868bbffce02505 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.081s	user 0.016s	sys 0.009s
I20260709 13:15:46.294624  5624 raft_consensus.cc:493] T 15d005f85bf54ebfb870b326ef3e18ed P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.305011  5624 raft_consensus.cc:515] T 15d005f85bf54ebfb870b326ef3e18ed P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:46.308529  5515 raft_consensus.cc:359] T 0796f5098e2a48c992868bbffce02505 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:46.309587  5515 raft_consensus.cc:385] T 0796f5098e2a48c992868bbffce02505 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.309948  5515 raft_consensus.cc:740] T 0796f5098e2a48c992868bbffce02505 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.311173  5515 consensus_queue.cc:260] T 0796f5098e2a48c992868bbffce02505 P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:46.303733  5359 leader_election.cc:304] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b52f14f9154b5a86f76fe58e4c235e; no voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0
I20260709 13:15:46.315994  5514 tablet_bootstrap.cc:654] T 0796f5098e2a48c992868bbffce02505 P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.315994  5624 leader_election.cc:290] T 15d005f85bf54ebfb870b326ef3e18ed P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:46.317229  5714 raft_consensus.cc:2749] T 43d23c7f276f4df1acd8124ed4940f1b P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:46.318323  5516 tablet_bootstrap.cc:492] T 309fb72c5b374642bb05a78b0b5ca308 P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
I20260709 13:15:46.322479  5714 consensus_queue.cc:1048] T 15d005f85bf54ebfb870b326ef3e18ed P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:46.327005  5646 raft_consensus.cc:493] T 34516de894fc408b8e355aba3402489c P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.328456  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15d005f85bf54ebfb870b326ef3e18ed" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:46.327788  5646 raft_consensus.cc:515] T 34516de894fc408b8e355aba3402489c P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:46.329542  5515 ts_tablet_manager.cc:1434] T 0796f5098e2a48c992868bbffce02505 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.001s
I20260709 13:15:46.330801  5515 tablet_bootstrap.cc:492] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
I20260709 13:15:46.334118  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34516de894fc408b8e355aba3402489c" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
W20260709 13:15:46.337613  5360 leader_election.cc:343] T 34516de894fc408b8e355aba3402489c P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:46.340099  5646 leader_election.cc:290] T 34516de894fc408b8e355aba3402489c P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:46.349606  5624 raft_consensus.cc:2749] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:46.363394  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15d005f85bf54ebfb870b326ef3e18ed" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:46.362982  5141 catalog_manager.cc:5697] T 654fdf03209d4a3cbf17055c56ae2c9d P 2f45532f94a34efcb68a82db3dd69372 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130). New cstate: current_term: 1 leader_uuid: "2f45532f94a34efcb68a82db3dd69372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:46.371057  5514 tablet_bootstrap.cc:492] T 0796f5098e2a48c992868bbffce02505 P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:46.371785  5514 ts_tablet_manager.cc:1403] T 0796f5098e2a48c992868bbffce02505 P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.127s	user 0.015s	sys 0.001s
I20260709 13:15:46.372447  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34516de894fc408b8e355aba3402489c" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:46.373520  5469 raft_consensus.cc:2468] T 34516de894fc408b8e355aba3402489c P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 0.
I20260709 13:15:46.375139  5514 raft_consensus.cc:359] T 0796f5098e2a48c992868bbffce02505 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:46.375955  5514 raft_consensus.cc:385] T 0796f5098e2a48c992868bbffce02505 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.376217  5514 raft_consensus.cc:740] T 0796f5098e2a48c992868bbffce02505 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.380873  5514 consensus_queue.cc:260] T 0796f5098e2a48c992868bbffce02505 P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:46.382781  5514 ts_tablet_manager.cc:1434] T 0796f5098e2a48c992868bbffce02505 P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:15:46.383890  5514 tablet_bootstrap.cc:492] T 03ad7844466b46548e4e9600220710f0 P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
I20260709 13:15:46.392457  5514 tablet_bootstrap.cc:654] T 03ad7844466b46548e4e9600220710f0 P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.393291  5358 leader_election.cc:304] T 15d005f85bf54ebfb870b326ef3e18ed P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b52f14f9154b5a86f76fe58e4c235e; no voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0
I20260709 13:15:46.394075  5516 tablet_bootstrap.cc:654] T 309fb72c5b374642bb05a78b0b5ca308 P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.393741  5515 tablet_bootstrap.cc:654] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.400954  5570 consensus_queue.cc:1048] T 99cdbf6d16c64a949df77a003bb7f7e4 P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:46.396693  5655 raft_consensus.cc:2749] T 15d005f85bf54ebfb870b326ef3e18ed P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:46.400969  5624 consensus_queue.cc:1048] T 4bc60d69f29e47689fd8fdf2b6aa836a P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:15:46.421495  5517 tablet_bootstrap.cc:492] T 99cdbf6d16c64a949df77a003bb7f7e4 P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:46.422183  5517 ts_tablet_manager.cc:1403] T 99cdbf6d16c64a949df77a003bb7f7e4 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.146s	user 0.019s	sys 0.020s
W20260709 13:15:46.426919  5434 consensus_peers.cc:597] T 99cdbf6d16c64a949df77a003bb7f7e4 P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:46.452894  5358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:41391, user_credentials={real_user=slave}} blocked reactor thread for 58066.6us
I20260709 13:15:46.451021  5517 raft_consensus.cc:359] T 99cdbf6d16c64a949df77a003bb7f7e4 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:46.456725  5517 raft_consensus.cc:385] T 99cdbf6d16c64a949df77a003bb7f7e4 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.457049  5517 raft_consensus.cc:740] T 99cdbf6d16c64a949df77a003bb7f7e4 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.453956  5358 leader_election.cc:304] T 34516de894fc408b8e355aba3402489c P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:46.473102  5646 raft_consensus.cc:2804] T 34516de894fc408b8e355aba3402489c P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:46.473595  5646 raft_consensus.cc:493] T 34516de894fc408b8e355aba3402489c P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:46.473953  5646 raft_consensus.cc:3060] T 34516de894fc408b8e355aba3402489c P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:46.477857  5517 consensus_queue.cc:260] T 99cdbf6d16c64a949df77a003bb7f7e4 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:46.480151  5517 ts_tablet_manager.cc:1434] T 99cdbf6d16c64a949df77a003bb7f7e4 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.058s	user 0.009s	sys 0.000s
I20260709 13:15:46.481349  5517 tablet_bootstrap.cc:492] T 309fb72c5b374642bb05a78b0b5ca308 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:46.490926  5517 tablet_bootstrap.cc:654] T 309fb72c5b374642bb05a78b0b5ca308 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.497390  5624 consensus_queue.cc:1048] T 4bc60d69f29e47689fd8fdf2b6aa836a P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Connected to new peer: Peer: permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:46.507203  5516 tablet_bootstrap.cc:492] T 309fb72c5b374642bb05a78b0b5ca308 P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:46.507884  5516 ts_tablet_manager.cc:1403] T 309fb72c5b374642bb05a78b0b5ca308 P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.207s	user 0.019s	sys 0.011s
I20260709 13:15:46.515120  5516 raft_consensus.cc:359] T 309fb72c5b374642bb05a78b0b5ca308 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:46.515937  5516 raft_consensus.cc:385] T 309fb72c5b374642bb05a78b0b5ca308 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.516239  5516 raft_consensus.cc:740] T 309fb72c5b374642bb05a78b0b5ca308 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.517208  5516 consensus_queue.cc:260] T 309fb72c5b374642bb05a78b0b5ca308 P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:46.520186  5516 ts_tablet_manager.cc:1434] T 309fb72c5b374642bb05a78b0b5ca308 P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
I20260709 13:15:46.525532  5515 tablet_bootstrap.cc:492] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
I20260709 13:15:46.526177  5515 ts_tablet_manager.cc:1403] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.196s	user 0.011s	sys 0.052s
I20260709 13:15:46.521327  5516 tablet_bootstrap.cc:492] T 43d23c7f276f4df1acd8124ed4940f1b P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
I20260709 13:15:46.529731  5514 tablet_bootstrap.cc:492] T 03ad7844466b46548e4e9600220710f0 P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:46.529148  5646 raft_consensus.cc:515] T 34516de894fc408b8e355aba3402489c P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:46.530409  5514 ts_tablet_manager.cc:1403] T 03ad7844466b46548e4e9600220710f0 P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.147s	user 0.025s	sys 0.041s
I20260709 13:15:46.536303  5514 raft_consensus.cc:359] T 03ad7844466b46548e4e9600220710f0 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:46.537019  5514 raft_consensus.cc:385] T 03ad7844466b46548e4e9600220710f0 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.537328  5514 raft_consensus.cc:740] T 03ad7844466b46548e4e9600220710f0 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.538110  5514 consensus_queue.cc:260] T 03ad7844466b46548e4e9600220710f0 P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:46.544109  5515 raft_consensus.cc:359] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:46.544934  5515 raft_consensus.cc:385] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.545306  5515 raft_consensus.cc:740] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.546097  5515 consensus_queue.cc:260] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:46.548764  5515 ts_tablet_manager.cc:1434] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 13:15:46.549715  5515 tablet_bootstrap.cc:492] T 43d23c7f276f4df1acd8124ed4940f1b P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
I20260709 13:15:46.556941  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34516de894fc408b8e355aba3402489c" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
I20260709 13:15:46.557657  5515 tablet_bootstrap.cc:654] T 43d23c7f276f4df1acd8124ed4940f1b P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:46.559564  5360 leader_election.cc:343] T 34516de894fc408b8e355aba3402489c P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:46.561434  5514 ts_tablet_manager.cc:1434] T 03ad7844466b46548e4e9600220710f0 P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.001s
I20260709 13:15:46.563045  5514 tablet_bootstrap.cc:492] T 5b17eb476da34f05b466923d9c48cc2d P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
I20260709 13:15:46.566224  5516 tablet_bootstrap.cc:654] T 43d23c7f276f4df1acd8124ed4940f1b P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.567116  5771 raft_consensus.cc:493] T 8aac85b71e404ee1bcfb748bfb0376fb P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.567708  5771 raft_consensus.cc:515] T 8aac85b71e404ee1bcfb748bfb0376fb P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:46.570128  5514 tablet_bootstrap.cc:654] T 5b17eb476da34f05b466923d9c48cc2d P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.571082  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aac85b71e404ee1bcfb748bfb0376fb" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:46.572042  5469 raft_consensus.cc:2393] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f45532f94a34efcb68a82db3dd69372 in current term 1: Already voted for candidate 77789aa45dc5463c82b73504fef4b4e0 in this term.
I20260709 13:15:46.574965  5714 raft_consensus.cc:493] T 03ad7844466b46548e4e9600220710f0 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.575762  5714 raft_consensus.cc:515] T 03ad7844466b46548e4e9600220710f0 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:46.578742  5714 leader_election.cc:290] T 03ad7844466b46548e4e9600220710f0 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:46.584666  5517 tablet_bootstrap.cc:492] T 309fb72c5b374642bb05a78b0b5ca308 P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:46.586989  5514 tablet_bootstrap.cc:492] T 5b17eb476da34f05b466923d9c48cc2d P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:46.590842  5514 ts_tablet_manager.cc:1403] T 5b17eb476da34f05b466923d9c48cc2d P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.004s
I20260709 13:15:46.589762  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aac85b71e404ee1bcfb748bfb0376fb" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:46.592795  5246 raft_consensus.cc:2393] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f45532f94a34efcb68a82db3dd69372 in current term 1: Already voted for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in this term.
I20260709 13:15:46.589337  5517 ts_tablet_manager.cc:1403] T 309fb72c5b374642bb05a78b0b5ca308 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.108s	user 0.014s	sys 0.005s
I20260709 13:15:46.595731  5771 leader_election.cc:290] T 8aac85b71e404ee1bcfb748bfb0376fb P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:46.597672  5517 raft_consensus.cc:359] T 309fb72c5b374642bb05a78b0b5ca308 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:46.598495  5517 raft_consensus.cc:385] T 309fb72c5b374642bb05a78b0b5ca308 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.598776  5517 raft_consensus.cc:740] T 309fb72c5b374642bb05a78b0b5ca308 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.599092  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34516de894fc408b8e355aba3402489c" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:15:46.590019  5515 tablet_bootstrap.cc:492] T 43d23c7f276f4df1acd8124ed4940f1b P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
I20260709 13:15:46.603626  5515 ts_tablet_manager.cc:1403] T 43d23c7f276f4df1acd8124ed4940f1b P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.054s	user 0.015s	sys 0.003s
I20260709 13:15:46.599776  5469 raft_consensus.cc:3060] T 34516de894fc408b8e355aba3402489c P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:46.606639  5515 raft_consensus.cc:359] T 43d23c7f276f4df1acd8124ed4940f1b P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:46.607357  5515 raft_consensus.cc:385] T 43d23c7f276f4df1acd8124ed4940f1b P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.607642  5515 raft_consensus.cc:740] T 43d23c7f276f4df1acd8124ed4940f1b P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.608381  5515 consensus_queue.cc:260] T 43d23c7f276f4df1acd8124ed4940f1b P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:46.610560  5515 ts_tablet_manager.cc:1434] T 43d23c7f276f4df1acd8124ed4940f1b P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:15:46.611598  5515 tablet_bootstrap.cc:492] T 03ad7844466b46548e4e9600220710f0 P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
I20260709 13:15:46.614102  5469 raft_consensus.cc:2468] T 34516de894fc408b8e355aba3402489c P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 1.
I20260709 13:15:46.602128  5514 raft_consensus.cc:359] T 5b17eb476da34f05b466923d9c48cc2d P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:46.615803  5286 leader_election.cc:304] T 8aac85b71e404ee1bcfb748bfb0376fb P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, 77789aa45dc5463c82b73504fef4b4e0
I20260709 13:15:46.616115  5514 raft_consensus.cc:385] T 5b17eb476da34f05b466923d9c48cc2d P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.616572  5514 raft_consensus.cc:740] T 5b17eb476da34f05b466923d9c48cc2d P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.617228  5765 raft_consensus.cc:3060] T 8aac85b71e404ee1bcfb748bfb0376fb P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:46.617535  5514 consensus_queue.cc:260] T 5b17eb476da34f05b466923d9c48cc2d P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:46.618676  5515 tablet_bootstrap.cc:654] T 03ad7844466b46548e4e9600220710f0 P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.599476  5517 consensus_queue.cc:260] T 309fb72c5b374642bb05a78b0b5ca308 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:46.620607  5514 ts_tablet_manager.cc:1434] T 5b17eb476da34f05b466923d9c48cc2d P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.001s
I20260709 13:15:46.621711  5514 tablet_bootstrap.cc:492] T 58438f196e6d42cc8780742faa222dc8 P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
I20260709 13:15:46.622653  5516 tablet_bootstrap.cc:492] T 43d23c7f276f4df1acd8124ed4940f1b P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:46.622450  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ad7844466b46548e4e9600220710f0" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:46.623183  5516 ts_tablet_manager.cc:1403] T 43d23c7f276f4df1acd8124ed4940f1b P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.102s	user 0.025s	sys 0.012s
I20260709 13:15:46.626235  5516 raft_consensus.cc:359] T 43d23c7f276f4df1acd8124ed4940f1b P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:46.626902  5516 raft_consensus.cc:385] T 43d23c7f276f4df1acd8124ed4940f1b P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.627162  5516 raft_consensus.cc:740] T 43d23c7f276f4df1acd8124ed4940f1b P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.627931  5516 consensus_queue.cc:260] T 43d23c7f276f4df1acd8124ed4940f1b P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:46.628949  5514 tablet_bootstrap.cc:654] T 58438f196e6d42cc8780742faa222dc8 P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.630106  5516 ts_tablet_manager.cc:1434] T 43d23c7f276f4df1acd8124ed4940f1b P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:15:46.631170  5516 tablet_bootstrap.cc:492] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
W20260709 13:15:46.631990  5433 leader_election.cc:343] T 03ad7844466b46548e4e9600220710f0 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:46.635519  5646 leader_election.cc:290] T 34516de894fc408b8e355aba3402489c P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 election: Requested vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:46.632915  5797 raft_consensus.cc:493] T 0796f5098e2a48c992868bbffce02505 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.637539  5797 raft_consensus.cc:515] T 0796f5098e2a48c992868bbffce02505 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:46.642257  5516 tablet_bootstrap.cc:654] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.645442  5394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ad7844466b46548e4e9600220710f0" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:46.646790  5517 ts_tablet_manager.cc:1434] T 309fb72c5b374642bb05a78b0b5ca308 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.053s	user 0.009s	sys 0.000s
I20260709 13:15:46.649310  5797 leader_election.cc:290] T 0796f5098e2a48c992868bbffce02505 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:46.655321  5358 leader_election.cc:304] T 34516de894fc408b8e355aba3402489c P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:46.656471  5394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0796f5098e2a48c992868bbffce02505" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:46.659197  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0796f5098e2a48c992868bbffce02505" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:46.661950  5246 raft_consensus.cc:2468] T 0796f5098e2a48c992868bbffce02505 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 0.
I20260709 13:15:46.663051  5514 tablet_bootstrap.cc:492] T 58438f196e6d42cc8780742faa222dc8 P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:46.663620  5514 ts_tablet_manager.cc:1403] T 58438f196e6d42cc8780742faa222dc8 P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.001s
I20260709 13:15:46.662134  5394 raft_consensus.cc:2468] T 0796f5098e2a48c992868bbffce02505 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 0.
I20260709 13:15:46.664474  5517 tablet_bootstrap.cc:492] T 4d479dd9f8c04491bb1e78273726187f P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:46.666747  5514 raft_consensus.cc:359] T 58438f196e6d42cc8780742faa222dc8 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:46.667479  5514 raft_consensus.cc:385] T 58438f196e6d42cc8780742faa222dc8 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.669693  5514 raft_consensus.cc:740] T 58438f196e6d42cc8780742faa222dc8 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.670457  5514 consensus_queue.cc:260] T 58438f196e6d42cc8780742faa222dc8 P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:46.668339  5646 raft_consensus.cc:2804] T 34516de894fc408b8e355aba3402489c P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:46.672936  5514 ts_tablet_manager.cc:1434] T 58438f196e6d42cc8780742faa222dc8 P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:15:46.673961  5514 tablet_bootstrap.cc:492] T c6bbe6dd572c4ea4aaf323c36eb05467 P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
W20260709 13:15:46.674958  5434 leader_election.cc:343] T 03ad7844466b46548e4e9600220710f0 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:46.677021  5434 leader_election.cc:304] T 03ad7844466b46548e4e9600220710f0 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0; no voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:46.681408  5514 tablet_bootstrap.cc:654] T c6bbe6dd572c4ea4aaf323c36eb05467 P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.682186  5797 raft_consensus.cc:2749] T 03ad7844466b46548e4e9600220710f0 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:46.669346  5516 tablet_bootstrap.cc:492] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:46.683785  5516 ts_tablet_manager.cc:1403] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.053s	user 0.014s	sys 0.006s
I20260709 13:15:46.676331  5765 raft_consensus.cc:2749] T 8aac85b71e404ee1bcfb748bfb0376fb P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:46.688510  5516 raft_consensus.cc:359] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:46.689908  5516 raft_consensus.cc:385] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.675815  5646 raft_consensus.cc:697] T 34516de894fc408b8e355aba3402489c P c4b52f14f9154b5a86f76fe58e4c235e [term 1 LEADER]: Becoming Leader. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Running, Role: LEADER
I20260709 13:15:46.690994  5434 leader_election.cc:304] T 0796f5098e2a48c992868bbffce02505 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:46.690296  5516 raft_consensus.cc:740] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.698691  5516 consensus_queue.cc:260] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:46.702368  5516 ts_tablet_manager.cc:1434] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.004s
I20260709 13:15:46.704034  5516 tablet_bootstrap.cc:492] T 22ee19164403428187e72d7a7c868457 P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
I20260709 13:15:46.708132  5797 raft_consensus.cc:2804] T 0796f5098e2a48c992868bbffce02505 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:46.708571  5797 raft_consensus.cc:493] T 0796f5098e2a48c992868bbffce02505 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:46.708940  5797 raft_consensus.cc:3060] T 0796f5098e2a48c992868bbffce02505 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:46.710012  5719 raft_consensus.cc:493] T 309fb72c5b374642bb05a78b0b5ca308 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.710690  5719 raft_consensus.cc:515] T 309fb72c5b374642bb05a78b0b5ca308 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:46.711941  5798 raft_consensus.cc:493] T cb26053fad7244cd88a5182d9cfc2109 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.712536  5798 raft_consensus.cc:515] T cb26053fad7244cd88a5182d9cfc2109 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:46.716285  5780 raft_consensus.cc:493] T 99cdbf6d16c64a949df77a003bb7f7e4 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.719687  5765 raft_consensus.cc:493] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.720227  5765 raft_consensus.cc:515] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:46.722615  5765 leader_election.cc:290] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:46.720161  5780 raft_consensus.cc:515] T 99cdbf6d16c64a949df77a003bb7f7e4 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:46.726328  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb26053fad7244cd88a5182d9cfc2109" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:46.726867  5719 leader_election.cc:290] T 309fb72c5b374642bb05a78b0b5ca308 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
W20260709 13:15:46.727993  5434 leader_election.cc:343] T cb26053fad7244cd88a5182d9cfc2109 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:46.728461  5394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99cdbf6d16c64a949df77a003bb7f7e4" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:46.728879  5780 leader_election.cc:290] T 99cdbf6d16c64a949df77a003bb7f7e4 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:46.719687  5646 consensus_queue.cc:237] T 34516de894fc408b8e355aba3402489c P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:46.733669  5466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309fb72c5b374642bb05a78b0b5ca308" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:46.734661  5466 raft_consensus.cc:2468] T 309fb72c5b374642bb05a78b0b5ca308 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 0.
I20260709 13:15:46.734871  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309fb72c5b374642bb05a78b0b5ca308" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:46.735158  5468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63267e5ca2594b41844fd758ca603a34" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:46.735689  5320 raft_consensus.cc:2468] T 309fb72c5b374642bb05a78b0b5ca308 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 0.
I20260709 13:15:46.736023  5468 raft_consensus.cc:2393] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f45532f94a34efcb68a82db3dd69372 in current term 1: Already voted for candidate 77789aa45dc5463c82b73504fef4b4e0 in this term.
I20260709 13:15:46.738662  5464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99cdbf6d16c64a949df77a003bb7f7e4" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:46.740677  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63267e5ca2594b41844fd758ca603a34" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:46.741535  5246 raft_consensus.cc:2393] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f45532f94a34efcb68a82db3dd69372 in current term 1: Already voted for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in this term.
I20260709 13:15:46.742992  5210 leader_election.cc:304] T 309fb72c5b374642bb05a78b0b5ca308 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 
I20260709 13:15:46.744385  5286 leader_election.cc:304] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, 77789aa45dc5463c82b73504fef4b4e0
I20260709 13:15:46.744580  5780 raft_consensus.cc:2804] T 309fb72c5b374642bb05a78b0b5ca308 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:46.744971  5780 raft_consensus.cc:493] T 309fb72c5b374642bb05a78b0b5ca308 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:46.745306  5780 raft_consensus.cc:3060] T 309fb72c5b374642bb05a78b0b5ca308 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:46.745930  5517 tablet_bootstrap.cc:654] T 4d479dd9f8c04491bb1e78273726187f P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.746405  5765 raft_consensus.cc:3060] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:46.759927  5209 leader_election.cc:304] T 99cdbf6d16c64a949df77a003bb7f7e4 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:46.761847  5394 raft_consensus.cc:3060] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:46.764976  5591 raft_consensus.cc:2749] T 99cdbf6d16c64a949df77a003bb7f7e4 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:46.766191  5798 leader_election.cc:290] T cb26053fad7244cd88a5182d9cfc2109 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:46.795341  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb26053fad7244cd88a5182d9cfc2109" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:46.796201  5320 raft_consensus.cc:2468] T cb26053fad7244cd88a5182d9cfc2109 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 0.
I20260709 13:15:46.857873  5714 raft_consensus.cc:493] T 58438f196e6d42cc8780742faa222dc8 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.834054  5246 raft_consensus.cc:3060] T 99cdbf6d16c64a949df77a003bb7f7e4 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:46.850786  5646 raft_consensus.cc:493] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.822407  5514 tablet_bootstrap.cc:492] T c6bbe6dd572c4ea4aaf323c36eb05467 P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:46.862524  5714 raft_consensus.cc:515] T 58438f196e6d42cc8780742faa222dc8 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:46.863209  5514 ts_tablet_manager.cc:1403] T c6bbe6dd572c4ea4aaf323c36eb05467 P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.189s	user 0.033s	sys 0.024s
I20260709 13:15:46.862852  5646 raft_consensus.cc:515] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:46.865281  5714 leader_election.cc:290] T 58438f196e6d42cc8780742faa222dc8 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:46.800984  5797 raft_consensus.cc:515] T 0796f5098e2a48c992868bbffce02505 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:46.866576  5394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58438f196e6d42cc8780742faa222dc8" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:46.866853  5646 leader_election.cc:290] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:46.802834  5515 tablet_bootstrap.cc:492] T 03ad7844466b46548e4e9600220710f0 P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
W20260709 13:15:46.841261  5209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:41391, user_credentials={real_user=slave}} blocked reactor thread for 51129.4us
I20260709 13:15:46.867748  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654fdf03209d4a3cbf17055c56ae2c9d" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:46.868113  5515 ts_tablet_manager.cc:1403] T 03ad7844466b46548e4e9600220710f0 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.257s	user 0.030s	sys 0.049s
W20260709 13:15:46.868467  5434 leader_election.cc:343] T 58438f196e6d42cc8780742faa222dc8 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:46.845889  5719 raft_consensus.cc:493] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.837997  5765 raft_consensus.cc:2749] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:46.866737  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58438f196e6d42cc8780742faa222dc8" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:46.803639  5433 leader_election.cc:304] T cb26053fad7244cd88a5182d9cfc2109 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:46.872534  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654fdf03209d4a3cbf17055c56ae2c9d" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
W20260709 13:15:46.872663  5434 leader_election.cc:343] T 58438f196e6d42cc8780742faa222dc8 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:46.873253  5243 raft_consensus.cc:2468] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 1.
W20260709 13:15:46.873359  5433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:43623, user_credentials={real_user=slave}} blocked reactor thread for 69898.6us
I20260709 13:15:46.873625  5434 leader_election.cc:304] T 58438f196e6d42cc8780742faa222dc8 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:46.872637  5714 raft_consensus.cc:2804] T cb26053fad7244cd88a5182d9cfc2109 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:46.875017  5683 raft_consensus.cc:2749] T 58438f196e6d42cc8780742faa222dc8 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:46.875135  5714 raft_consensus.cc:493] T cb26053fad7244cd88a5182d9cfc2109 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:46.829623  5684 consensus_queue.cc:1048] T 654fdf03209d4a3cbf17055c56ae2c9d P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.046s
I20260709 13:15:46.875735  5714 raft_consensus.cc:3060] T cb26053fad7244cd88a5182d9cfc2109 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:46.808187  5771 raft_consensus.cc:493] T 43d23c7f276f4df1acd8124ed4940f1b P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.877328  5771 raft_consensus.cc:515] T 43d23c7f276f4df1acd8124ed4940f1b P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:46.880558  5395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43d23c7f276f4df1acd8124ed4940f1b" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:46.881213  5395 raft_consensus.cc:2468] T 43d23c7f276f4df1acd8124ed4940f1b P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 0.
I20260709 13:15:46.882620  5286 leader_election.cc:304] T 43d23c7f276f4df1acd8124ed4940f1b P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:46.833428  5141 catalog_manager.cc:5697] T 34516de894fc408b8e355aba3402489c P c4b52f14f9154b5a86f76fe58e4c235e reported cstate change: term changed from 0 to 1, leader changed from <none> to c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131). New cstate: current_term: 1 leader_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:46.886303  5765 raft_consensus.cc:2804] T 43d23c7f276f4df1acd8124ed4940f1b P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:46.886730  5765 raft_consensus.cc:493] T 43d23c7f276f4df1acd8124ed4940f1b P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:46.875509  5719 raft_consensus.cc:515] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:46.887135  5765 raft_consensus.cc:3060] T 43d23c7f276f4df1acd8124ed4940f1b P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:46.837621  5517 tablet_bootstrap.cc:492] T 4d479dd9f8c04491bb1e78273726187f P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:46.887925  5517 ts_tablet_manager.cc:1403] T 4d479dd9f8c04491bb1e78273726187f P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.224s	user 0.013s	sys 0.022s
I20260709 13:15:46.889585  5360 leader_election.cc:304] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 2f45532f94a34efcb68a82db3dd69372
I20260709 13:15:46.801455  5516 tablet_bootstrap.cc:654] T 22ee19164403428187e72d7a7c868457 P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:46.892513  5797 leader_election.cc:290] T 0796f5098e2a48c992868bbffce02505 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 election: Requested vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:46.895129  5464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aac85b71e404ee1bcfb748bfb0376fb" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:46.920183  5464 raft_consensus.cc:2468] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 1.
I20260709 13:15:46.920938  5780 raft_consensus.cc:515] T 309fb72c5b374642bb05a78b0b5ca308 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:46.893463  5395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0796f5098e2a48c992868bbffce02505" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:15:46.914049  5765 raft_consensus.cc:515] T 43d23c7f276f4df1acd8124ed4940f1b P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:47.042505  5395 raft_consensus.cc:3060] T 0796f5098e2a48c992868bbffce02505 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.044055  5765 leader_election.cc:290] T 43d23c7f276f4df1acd8124ed4940f1b P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Requested vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:46.906693  5771 leader_election.cc:290] T 43d23c7f276f4df1acd8124ed4940f1b P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:46.918748  5515 raft_consensus.cc:359] T 03ad7844466b46548e4e9600220710f0 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:47.048271  5515 raft_consensus.cc:385] T 03ad7844466b46548e4e9600220710f0 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.048537  5797 raft_consensus.cc:493] T 5b17eb476da34f05b466923d9c48cc2d P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.048594  5515 raft_consensus.cc:740] T 03ad7844466b46548e4e9600220710f0 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.891099  5517 raft_consensus.cc:359] T 4d479dd9f8c04491bb1e78273726187f P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:47.049979  5517 raft_consensus.cc:385] T 4d479dd9f8c04491bb1e78273726187f P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.050472  5517 raft_consensus.cc:740] T 4d479dd9f8c04491bb1e78273726187f P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.911031  5514 raft_consensus.cc:359] T c6bbe6dd572c4ea4aaf323c36eb05467 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:47.051095  5514 raft_consensus.cc:385] T c6bbe6dd572c4ea4aaf323c36eb05467 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:46.909971  5811 consensus_queue.cc:1048] T 654fdf03209d4a3cbf17055c56ae2c9d P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.142s
I20260709 13:15:47.051522  5517 consensus_queue.cc:260] T 4d479dd9f8c04491bb1e78273726187f P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:47.049166  5797 raft_consensus.cc:515] T 5b17eb476da34f05b466923d9c48cc2d P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:46.894342  5465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43d23c7f276f4df1acd8124ed4940f1b" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:47.057761  5465 raft_consensus.cc:2468] T 43d23c7f276f4df1acd8124ed4940f1b P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 0.
I20260709 13:15:46.895947  5719 leader_election.cc:290] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:46.893962  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0796f5098e2a48c992868bbffce02505" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
I20260709 13:15:46.959473  5714 raft_consensus.cc:515] T cb26053fad7244cd88a5182d9cfc2109 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:47.060209  5243 raft_consensus.cc:3060] T 0796f5098e2a48c992868bbffce02505 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.062613  5714 leader_election.cc:290] T cb26053fad7244cd88a5182d9cfc2109 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 election: Requested vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:46.894400  5646 raft_consensus.cc:2804] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:47.065486  5646 raft_consensus.cc:493] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2f45532f94a34efcb68a82db3dd69372)
I20260709 13:15:47.066009  5646 raft_consensus.cc:3060] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:47.051558  5514 raft_consensus.cc:740] T c6bbe6dd572c4ea4aaf323c36eb05467 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:46.926970  5209 leader_election.cc:304] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, 77789aa45dc5463c82b73504fef4b4e0; no voters: 
I20260709 13:15:47.118218  5591 raft_consensus.cc:2804] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:47.118738  5591 raft_consensus.cc:493] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.119170  5591 raft_consensus.cc:3060] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:47.078001  5655 raft_consensus.cc:493] T 4d479dd9f8c04491bb1e78273726187f P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.121731  5655 raft_consensus.cc:515] T 4d479dd9f8c04491bb1e78273726187f P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
W20260709 13:15:47.120652  5209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.132:41391, user_credentials={real_user=slave}} blocked reactor thread for 193847us
I20260709 13:15:47.089421  5780 leader_election.cc:290] T 309fb72c5b374642bb05a78b0b5ca308 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 election: Requested vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:47.115613  5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb26053fad7244cd88a5182d9cfc2109" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
W20260709 13:15:47.151122  5434 leader_election.cc:343] T cb26053fad7244cd88a5182d9cfc2109 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.178406  5515 consensus_queue.cc:260] T 03ad7844466b46548e4e9600220710f0 P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:47.182233  5517 ts_tablet_manager.cc:1434] T 4d479dd9f8c04491bb1e78273726187f P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.294s	user 0.013s	sys 0.038s
I20260709 13:15:47.182636  5655 leader_election.cc:290] T 4d479dd9f8c04491bb1e78273726187f P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:47.183553  5517 tablet_bootstrap.cc:492] T 1db09971a25441c68427b8bea7e9c379 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:47.183554  5514 consensus_queue.cc:260] T c6bbe6dd572c4ea4aaf323c36eb05467 P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:47.198091  5516 tablet_bootstrap.cc:492] T 22ee19164403428187e72d7a7c868457 P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:47.199059  5516 ts_tablet_manager.cc:1403] T 22ee19164403428187e72d7a7c868457 P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.495s	user 0.021s	sys 0.016s
I20260709 13:15:47.130540  5464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309fb72c5b374642bb05a78b0b5ca308" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:15:47.201309  5514 ts_tablet_manager.cc:1434] T c6bbe6dd572c4ea4aaf323c36eb05467 P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.338s	user 0.015s	sys 0.004s
I20260709 13:15:47.203079  5514 tablet_bootstrap.cc:492] T 39d465e757b14de1842d55d52271bceb P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
I20260709 13:15:47.206732  5515 ts_tablet_manager.cc:1434] T 03ad7844466b46548e4e9600220710f0 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.338s	user 0.015s	sys 0.041s
I20260709 13:15:47.208979  5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b17eb476da34f05b466923d9c48cc2d" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:47.210517  5515 tablet_bootstrap.cc:492] T 02dba91c167a418daee105670577c8aa P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
W20260709 13:15:47.211764  5434 leader_election.cc:343] T 5b17eb476da34f05b466923d9c48cc2d P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.215142  5797 leader_election.cc:290] T 5b17eb476da34f05b466923d9c48cc2d P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:47.216001  5464 raft_consensus.cc:3060] T 309fb72c5b374642bb05a78b0b5ca308 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.229916  5465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43d23c7f276f4df1acd8124ed4940f1b" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:15:47.230664  5465 raft_consensus.cc:3060] T 43d23c7f276f4df1acd8124ed4940f1b P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.234764  5395 raft_consensus.cc:2468] T 0796f5098e2a48c992868bbffce02505 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 1.
I20260709 13:15:47.237244  5434 leader_election.cc:304] T 0796f5098e2a48c992868bbffce02505 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:47.239656  5714 raft_consensus.cc:2804] T 0796f5098e2a48c992868bbffce02505 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:47.240970  5714 raft_consensus.cc:697] T 0796f5098e2a48c992868bbffce02505 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 LEADER]: Becoming Leader. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Running, Role: LEADER
I20260709 13:15:47.241889  5714 consensus_queue.cc:237] T 0796f5098e2a48c992868bbffce02505 P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:47.248718  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aac85b71e404ee1bcfb748bfb0376fb" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:47.249533  5320 raft_consensus.cc:2468] T 8aac85b71e404ee1bcfb748bfb0376fb P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 1.
I20260709 13:15:47.223217  5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d479dd9f8c04491bb1e78273726187f" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:47.251370  5245 raft_consensus.cc:2468] T 4d479dd9f8c04491bb1e78273726187f P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 0.
I20260709 13:15:47.260427  5655 consensus_queue.cc:1048] T 34516de894fc408b8e355aba3402489c P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:47.261426  5515 tablet_bootstrap.cc:654] T 02dba91c167a418daee105670577c8aa P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:47.264145  5209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:41391, user_credentials={real_user=slave}} blocked reactor thread for 51839.9us
I20260709 13:15:47.271226  5516 raft_consensus.cc:359] T 22ee19164403428187e72d7a7c868457 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:47.272035  5516 raft_consensus.cc:385] T 22ee19164403428187e72d7a7c868457 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.272307  5516 raft_consensus.cc:740] T 22ee19164403428187e72d7a7c868457 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.273384  5516 consensus_queue.cc:260] T 22ee19164403428187e72d7a7c868457 P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:47.273023  5360 leader_election.cc:304] T 4d479dd9f8c04491bb1e78273726187f P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:47.275386  5788 raft_consensus.cc:2804] T 4d479dd9f8c04491bb1e78273726187f P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:47.275866  5788 raft_consensus.cc:493] T 4d479dd9f8c04491bb1e78273726187f P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.276258  5788 raft_consensus.cc:3060] T 4d479dd9f8c04491bb1e78273726187f P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.277496  5319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d479dd9f8c04491bb1e78273726187f" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:47.270511  5395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43d23c7f276f4df1acd8124ed4940f1b" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:15:47.278731  5395 raft_consensus.cc:3060] T 43d23c7f276f4df1acd8124ed4940f1b P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.287324  5516 ts_tablet_manager.cc:1434] T 22ee19164403428187e72d7a7c868457 P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.088s	user 0.008s	sys 0.000s
W20260709 13:15:47.295750  5360 consensus_peers.cc:597] T 34516de894fc408b8e355aba3402489c P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:47.298444  5655 raft_consensus.cc:493] T 03ad7844466b46548e4e9600220710f0 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.310321  5319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309fb72c5b374642bb05a78b0b5ca308" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:15:47.311079  5319 raft_consensus.cc:3060] T 309fb72c5b374642bb05a78b0b5ca308 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.313313  5465 raft_consensus.cc:2468] T 43d23c7f276f4df1acd8124ed4940f1b P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 1.
I20260709 13:15:47.314870  5284 leader_election.cc:304] T 43d23c7f276f4df1acd8124ed4940f1b P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0; no voters: 
I20260709 13:15:47.315867  5815 raft_consensus.cc:2804] T 43d23c7f276f4df1acd8124ed4940f1b P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:47.316444  5815 raft_consensus.cc:697] T 43d23c7f276f4df1acd8124ed4940f1b P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Becoming Leader. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Running, Role: LEADER
I20260709 13:15:47.317589  5815 consensus_queue.cc:237] T 43d23c7f276f4df1acd8124ed4940f1b P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:47.322165  5516 tablet_bootstrap.cc:492] T 03ad7844466b46548e4e9600220710f0 P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
I20260709 13:15:47.330355  5464 raft_consensus.cc:2468] T 309fb72c5b374642bb05a78b0b5ca308 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 1.
I20260709 13:15:47.331423  5517 tablet_bootstrap.cc:654] T 1db09971a25441c68427b8bea7e9c379 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:47.336860  5514 tablet_bootstrap.cc:654] T 39d465e757b14de1842d55d52271bceb P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:47.331977  5209 leader_election.cc:304] T 309fb72c5b374642bb05a78b0b5ca308 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, 77789aa45dc5463c82b73504fef4b4e0; no voters: 
I20260709 13:15:47.320024  5655 raft_consensus.cc:515] T 03ad7844466b46548e4e9600220710f0 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:47.358589  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb26053fad7244cd88a5182d9cfc2109" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:15:47.359377  5320 raft_consensus.cc:3060] T cb26053fad7244cd88a5182d9cfc2109 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.360627  5314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b17eb476da34f05b466923d9c48cc2d" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:47.365573  5655 leader_election.cc:290] T 03ad7844466b46548e4e9600220710f0 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:47.367136  5719 raft_consensus.cc:2804] T 309fb72c5b374642bb05a78b0b5ca308 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:47.368852  5719 raft_consensus.cc:697] T 309fb72c5b374642bb05a78b0b5ca308 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 LEADER]: Becoming Leader. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Running, Role: LEADER
I20260709 13:15:47.369812  5719 consensus_queue.cc:237] T 309fb72c5b374642bb05a78b0b5ca308 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:47.370744  5319 raft_consensus.cc:2468] T 309fb72c5b374642bb05a78b0b5ca308 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 1.
I20260709 13:15:47.369807  5320 raft_consensus.cc:2468] T cb26053fad7244cd88a5182d9cfc2109 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 1.
W20260709 13:15:47.384235  5433 leader_election.cc:343] T 5b17eb476da34f05b466923d9c48cc2d P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.384928  5433 leader_election.cc:304] T 5b17eb476da34f05b466923d9c48cc2d P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0; no voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:47.386668  5714 raft_consensus.cc:2749] T 5b17eb476da34f05b466923d9c48cc2d P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:47.392251  5433 leader_election.cc:304] T cb26053fad7244cd88a5182d9cfc2109 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:47.393924  5714 raft_consensus.cc:2804] T cb26053fad7244cd88a5182d9cfc2109 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:47.394603  5714 raft_consensus.cc:697] T cb26053fad7244cd88a5182d9cfc2109 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 LEADER]: Becoming Leader. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Running, Role: LEADER
I20260709 13:15:47.396736  5714 consensus_queue.cc:237] T cb26053fad7244cd88a5182d9cfc2109 P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:47.373188  5143 catalog_manager.cc:5697] T 0796f5098e2a48c992868bbffce02505 P 77789aa45dc5463c82b73504fef4b4e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132). New cstate: current_term: 1 leader_uuid: "77789aa45dc5463c82b73504fef4b4e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:47.428088  5192 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:47.429383  5243 raft_consensus.cc:2468] T 0796f5098e2a48c992868bbffce02505 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 1.
I20260709 13:15:47.436921  5514 tablet_bootstrap.cc:492] T 39d465e757b14de1842d55d52271bceb P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:47.437127  5515 tablet_bootstrap.cc:492] T 02dba91c167a418daee105670577c8aa P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
I20260709 13:15:47.437968  5514 ts_tablet_manager.cc:1403] T 39d465e757b14de1842d55d52271bceb P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.235s	user 0.018s	sys 0.003s
I20260709 13:15:47.438166  5515 ts_tablet_manager.cc:1403] T 02dba91c167a418daee105670577c8aa P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.230s	user 0.026s	sys 0.026s
W20260709 13:15:47.417727  5359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:43623, user_credentials={real_user=slave}} blocked reactor thread for 124090us
W20260709 13:15:47.440339  5359 leader_election.cc:343] T 4d479dd9f8c04491bb1e78273726187f P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.419708  5788 raft_consensus.cc:515] T 4d479dd9f8c04491bb1e78273726187f P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:47.442086  5515 raft_consensus.cc:359] T 02dba91c167a418daee105670577c8aa P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:47.442816  5515 raft_consensus.cc:385] T 02dba91c167a418daee105670577c8aa P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.443177  5515 raft_consensus.cc:740] T 02dba91c167a418daee105670577c8aa P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.444937  5515 consensus_queue.cc:260] T 02dba91c167a418daee105670577c8aa P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:47.453189  5515 ts_tablet_manager.cc:1434] T 02dba91c167a418daee105670577c8aa P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.005s
I20260709 13:15:47.456055  5515 tablet_bootstrap.cc:492] T 58438f196e6d42cc8780742faa222dc8 P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
W20260709 13:15:47.452726  5210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:43623, user_credentials={real_user=slave}} blocked reactor thread for 76493.1us
I20260709 13:15:47.478132  5465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ad7844466b46548e4e9600220710f0" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:47.478993  5465 raft_consensus.cc:2468] T 03ad7844466b46548e4e9600220710f0 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 0.
I20260709 13:15:47.490924  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ad7844466b46548e4e9600220710f0" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:47.492462  5788 leader_election.cc:290] T 4d479dd9f8c04491bb1e78273726187f P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 election: Requested vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:47.497457  5591 raft_consensus.cc:515] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:47.500751  5464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aac85b71e404ee1bcfb748bfb0376fb" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:15:47.500622  5141 catalog_manager.cc:5697] T 43d23c7f276f4df1acd8124ed4940f1b P 2f45532f94a34efcb68a82db3dd69372 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130). New cstate: current_term: 1 leader_uuid: "2f45532f94a34efcb68a82db3dd69372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:47.484213  5815 raft_consensus.cc:493] T 22ee19164403428187e72d7a7c868457 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.503156  5815 raft_consensus.cc:515] T 22ee19164403428187e72d7a7c868457 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:47.505478  5517 tablet_bootstrap.cc:492] T 1db09971a25441c68427b8bea7e9c379 P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:47.506038  5517 ts_tablet_manager.cc:1403] T 1db09971a25441c68427b8bea7e9c379 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.323s	user 0.021s	sys 0.016s
I20260709 13:15:47.501475  5464 raft_consensus.cc:3060] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:47.508090  5591 leader_election.cc:290] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 election: Requested vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:47.510936  5815 leader_election.cc:290] T 22ee19164403428187e72d7a7c868457 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:47.512571  5358 leader_election.cc:304] T 03ad7844466b46548e4e9600220710f0 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:47.511332  5516 tablet_bootstrap.cc:654] T 03ad7844466b46548e4e9600220710f0 P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:47.519356  5395 raft_consensus.cc:2468] T 43d23c7f276f4df1acd8124ed4940f1b P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 1.
I20260709 13:15:47.521637  5517 raft_consensus.cc:359] T 1db09971a25441c68427b8bea7e9c379 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:47.533010  5517 raft_consensus.cc:385] T 1db09971a25441c68427b8bea7e9c379 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.533304  5517 raft_consensus.cc:740] T 1db09971a25441c68427b8bea7e9c379 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.534049  5517 consensus_queue.cc:260] T 1db09971a25441c68427b8bea7e9c379 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:47.522293  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d479dd9f8c04491bb1e78273726187f" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
I20260709 13:15:47.531984  5788 raft_consensus.cc:2804] T 03ad7844466b46548e4e9600220710f0 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:47.535971  5246 raft_consensus.cc:3060] T 4d479dd9f8c04491bb1e78273726187f P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.536267  5788 raft_consensus.cc:493] T 03ad7844466b46548e4e9600220710f0 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.536864  5788 raft_consensus.cc:3060] T 03ad7844466b46548e4e9600220710f0 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.542811  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d479dd9f8c04491bb1e78273726187f" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:15:47.526571  5514 raft_consensus.cc:359] T 39d465e757b14de1842d55d52271bceb P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:47.515305  5646 raft_consensus.cc:515] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:47.547674  5514 raft_consensus.cc:385] T 39d465e757b14de1842d55d52271bceb P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.548146  5514 raft_consensus.cc:740] T 39d465e757b14de1842d55d52271bceb P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.527988  5464 raft_consensus.cc:2468] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 2.
I20260709 13:15:47.530431  5714 raft_consensus.cc:493] T c6bbe6dd572c4ea4aaf323c36eb05467 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.549037  5514 consensus_queue.cc:260] T 39d465e757b14de1842d55d52271bceb P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:47.551177  5517 ts_tablet_manager.cc:1434] T 1db09971a25441c68427b8bea7e9c379 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.001s
I20260709 13:15:47.553289  5714 raft_consensus.cc:515] T c6bbe6dd572c4ea4aaf323c36eb05467 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:47.556891  5517 tablet_bootstrap.cc:492] T 22ee19164403428187e72d7a7c868457 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:47.570382  5646 leader_election.cc:290] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 2 election: Requested vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:47.565580  5392 raft_consensus.cc:1240] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Rejecting Update request from peer 2f45532f94a34efcb68a82db3dd69372 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:47.572659  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbe6dd572c4ea4aaf323c36eb05467" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
W20260709 13:15:47.574605  5434 leader_election.cc:343] T c6bbe6dd572c4ea4aaf323c36eb05467 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.575830  5209 leader_election.cc:304] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, 77789aa45dc5463c82b73504fef4b4e0; no voters: 
I20260709 13:15:47.577047  5719 raft_consensus.cc:2804] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:47.577559  5719 raft_consensus.cc:697] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 LEADER]: Becoming Leader. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Running, Role: LEADER
I20260709 13:15:47.578450  5719 consensus_queue.cc:237] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:47.582199  5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654fdf03209d4a3cbf17055c56ae2c9d" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
I20260709 13:15:47.585364  5714 leader_election.cc:290] T c6bbe6dd572c4ea4aaf323c36eb05467 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:47.586716  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbe6dd572c4ea4aaf323c36eb05467" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
W20260709 13:15:47.588629  5433 leader_election.cc:343] T c6bbe6dd572c4ea4aaf323c36eb05467 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.589154  5433 leader_election.cc:304] T c6bbe6dd572c4ea4aaf323c36eb05467 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0; no voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:47.590626  5683 raft_consensus.cc:2749] T c6bbe6dd572c4ea4aaf323c36eb05467 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:47.591249  5788 raft_consensus.cc:515] T 03ad7844466b46548e4e9600220710f0 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:47.596887  5464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ad7844466b46548e4e9600220710f0" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:15:47.597649  5464 raft_consensus.cc:3060] T 03ad7844466b46548e4e9600220710f0 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:47.598469  5359 leader_election.cc:343] T 03ad7844466b46548e4e9600220710f0 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.601329  5395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ee19164403428187e72d7a7c868457" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:47.603574  5514 ts_tablet_manager.cc:1434] T 39d465e757b14de1842d55d52271bceb P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.165s	user 0.005s	sys 0.004s
W20260709 13:15:47.606752  5359 leader_election.cc:343] T 4d479dd9f8c04491bb1e78273726187f P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.623602  5395 raft_consensus.cc:2468] T 22ee19164403428187e72d7a7c868457 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 0.
I20260709 13:15:47.629767  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ad7844466b46548e4e9600220710f0" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:15:47.631093  5319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654fdf03209d4a3cbf17055c56ae2c9d" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:15:47.609908  5246 raft_consensus.cc:2468] T 4d479dd9f8c04491bb1e78273726187f P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 1.
I20260709 13:15:47.612002  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aac85b71e404ee1bcfb748bfb0376fb" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:15:47.614894  5517 tablet_bootstrap.cc:654] T 22ee19164403428187e72d7a7c868457 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:47.633639  5320 raft_consensus.cc:3060] T 8aac85b71e404ee1bcfb748bfb0376fb P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:47.616222  5515 tablet_bootstrap.cc:654] T 58438f196e6d42cc8780742faa222dc8 P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:47.620842  5514 tablet_bootstrap.cc:492] T 073bb9d9d62f462db20229a4924564e1 P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
I20260709 13:15:47.635277  5788 leader_election.cc:290] T 03ad7844466b46548e4e9600220710f0 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 election: Requested vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
W20260709 13:15:47.636081  5359 leader_election.cc:343] T 03ad7844466b46548e4e9600220710f0 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.632965  5242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ee19164403428187e72d7a7c868457" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:47.647738  5360 leader_election.cc:304] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b52f14f9154b5a86f76fe58e4c235e; no voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:47.663758  5684 consensus_queue.cc:1059] T 654fdf03209d4a3cbf17055c56ae2c9d P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:15:47.666347  5821 raft_consensus.cc:3055] T 654fdf03209d4a3cbf17055c56ae2c9d P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:47.666765  5821 raft_consensus.cc:740] T 654fdf03209d4a3cbf17055c56ae2c9d P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Running, Role: LEADER
I20260709 13:15:47.667732  5821 consensus_queue.cc:260] T 654fdf03209d4a3cbf17055c56ae2c9d P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:47.673259  5821 raft_consensus.cc:3060] T 654fdf03209d4a3cbf17055c56ae2c9d P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:47.670584  5788 raft_consensus.cc:2749] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.671842  5286 leader_election.cc:304] T 22ee19164403428187e72d7a7c868457 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:47.677287  5684 raft_consensus.cc:2804] T 22ee19164403428187e72d7a7c868457 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:47.677767  5684 raft_consensus.cc:493] T 22ee19164403428187e72d7a7c868457 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.678139  5684 raft_consensus.cc:3060] T 22ee19164403428187e72d7a7c868457 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.677143  5360 leader_election.cc:304] T 4d479dd9f8c04491bb1e78273726187f P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 2f45532f94a34efcb68a82db3dd69372
I20260709 13:15:47.684243  5516 tablet_bootstrap.cc:492] T 03ad7844466b46548e4e9600220710f0 P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:47.684974  5516 ts_tablet_manager.cc:1403] T 03ad7844466b46548e4e9600220710f0 P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.392s	user 0.037s	sys 0.044s
I20260709 13:15:47.687077  5141 catalog_manager.cc:5697] T cb26053fad7244cd88a5182d9cfc2109 P 77789aa45dc5463c82b73504fef4b4e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132). New cstate: current_term: 1 leader_uuid: "77789aa45dc5463c82b73504fef4b4e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:47.695967  5514 tablet_bootstrap.cc:654] T 073bb9d9d62f462db20229a4924564e1 P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:47.699833  5516 raft_consensus.cc:359] T 03ad7844466b46548e4e9600220710f0 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:47.704521  5516 raft_consensus.cc:385] T 03ad7844466b46548e4e9600220710f0 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.705085  5516 raft_consensus.cc:740] T 03ad7844466b46548e4e9600220710f0 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.688732  5143 catalog_manager.cc:5697] T 309fb72c5b374642bb05a78b0b5ca308 P 538ff4bfbd0c4f04bcd800c4ee4845ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129). New cstate: current_term: 1 leader_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:47.700018  5788 raft_consensus.cc:2804] T 4d479dd9f8c04491bb1e78273726187f P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:47.712230  5788 raft_consensus.cc:697] T 4d479dd9f8c04491bb1e78273726187f P c4b52f14f9154b5a86f76fe58e4c235e [term 1 LEADER]: Becoming Leader. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Running, Role: LEADER
I20260709 13:15:47.712555  5143 catalog_manager.cc:5697] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba reported cstate change: term changed from 0 to 2, leader changed from <none> to 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129). New cstate: current_term: 2 leader_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:47.713606  5788 consensus_queue.cc:237] T 4d479dd9f8c04491bb1e78273726187f P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:47.707278  5516 consensus_queue.cc:260] T 03ad7844466b46548e4e9600220710f0 P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:47.703856  5320 raft_consensus.cc:2468] T 8aac85b71e404ee1bcfb748bfb0376fb P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 2.
W20260709 13:15:47.707289  5286 leader_election.cc:343] T 22ee19164403428187e72d7a7c868457 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.755044  5464 raft_consensus.cc:2468] T 03ad7844466b46548e4e9600220710f0 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 1.
I20260709 13:15:47.761824  5358 leader_election.cc:304] T 03ad7844466b46548e4e9600220710f0 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 2f45532f94a34efcb68a82db3dd69372
I20260709 13:15:47.780294  5827 raft_consensus.cc:2804] T 03ad7844466b46548e4e9600220710f0 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:47.781515  5242 raft_consensus.cc:3060] T 1db09971a25441c68427b8bea7e9c379 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.786990  5714 consensus_queue.cc:1048] T 0796f5098e2a48c992868bbffce02505 P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:47.766010  5516 ts_tablet_manager.cc:1434] T 03ad7844466b46548e4e9600220710f0 P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.081s	user 0.009s	sys 0.002s
I20260709 13:15:47.792904  5516 tablet_bootstrap.cc:492] T 4d479dd9f8c04491bb1e78273726187f P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
I20260709 13:15:47.793349  5514 tablet_bootstrap.cc:492] T 073bb9d9d62f462db20229a4924564e1 P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:47.793974  5514 ts_tablet_manager.cc:1403] T 073bb9d9d62f462db20229a4924564e1 P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.173s	user 0.014s	sys 0.013s
I20260709 13:15:47.802966  5646 raft_consensus.cc:493] T 02dba91c167a418daee105670577c8aa P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.803614  5646 raft_consensus.cc:515] T 02dba91c167a418daee105670577c8aa P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:47.805891  5646 leader_election.cc:290] T 02dba91c167a418daee105670577c8aa P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:47.806586  5514 raft_consensus.cc:359] T 073bb9d9d62f462db20229a4924564e1 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:47.812341  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dba91c167a418daee105670577c8aa" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:47.826051  5714 consensus_queue.cc:1048] T 0796f5098e2a48c992868bbffce02505 P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:15:47.813014  5719 raft_consensus.cc:493] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:47.837039  5360 leader_election.cc:343] T 02dba91c167a418daee105670577c8aa P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.837221  5719 raft_consensus.cc:515] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:47.807389  5319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dba91c167a418daee105670577c8aa" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
W20260709 13:15:47.840163  5359 leader_election.cc:343] T 02dba91c167a418daee105670577c8aa P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.841843  5719 leader_election.cc:290] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:47.841707  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63267e5ca2594b41844fd758ca603a34" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:47.856244  5469 raft_consensus.cc:2468] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 1.
I20260709 13:15:47.840889  5359 leader_election.cc:304] T 02dba91c167a418daee105670577c8aa P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b52f14f9154b5a86f76fe58e4c235e; no voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:47.857697  5209 leader_election.cc:304] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, 77789aa45dc5463c82b73504fef4b4e0; no voters: 
I20260709 13:15:47.858716  5832 raft_consensus.cc:2804] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:47.858004  5719 consensus_queue.cc:1048] T 309fb72c5b374642bb05a78b0b5ca308 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:47.859320  5832 raft_consensus.cc:493] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.859788  5832 raft_consensus.cc:3060] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:47.807351  5514 raft_consensus.cc:385] T 073bb9d9d62f462db20229a4924564e1 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.832480  5846 consensus_queue.cc:1048] T 43d23c7f276f4df1acd8124ed4940f1b P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:15:47.843254  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63267e5ca2594b41844fd758ca603a34" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:47.861850  5320 raft_consensus.cc:2468] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 1.
I20260709 13:15:47.854321  5515 tablet_bootstrap.cc:492] T 58438f196e6d42cc8780742faa222dc8 P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
I20260709 13:15:47.867453  5515 ts_tablet_manager.cc:1403] T 58438f196e6d42cc8780742faa222dc8 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.413s	user 0.024s	sys 0.018s
I20260709 13:15:47.870088  5714 consensus_queue.cc:1048] T cb26053fad7244cd88a5182d9cfc2109 P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:47.873791  5655 raft_consensus.cc:2749] T 02dba91c167a418daee105670577c8aa P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:47.874922  5514 raft_consensus.cc:740] T 073bb9d9d62f462db20229a4924564e1 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.877370  5514 consensus_queue.cc:260] T 073bb9d9d62f462db20229a4924564e1 P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:47.879734  5815 consensus_queue.cc:1048] T 43d23c7f276f4df1acd8124ed4940f1b P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:47.876024  5515 raft_consensus.cc:359] T 58438f196e6d42cc8780742faa222dc8 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:47.880825  5515 raft_consensus.cc:385] T 58438f196e6d42cc8780742faa222dc8 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:47.883107  5515 raft_consensus.cc:740] T 58438f196e6d42cc8780742faa222dc8 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.885113  5515 consensus_queue.cc:260] T 58438f196e6d42cc8780742faa222dc8 P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:47.888062  5515 ts_tablet_manager.cc:1434] T 58438f196e6d42cc8780742faa222dc8 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.020s	user 0.000s	sys 0.007s
I20260709 13:15:47.882717  5514 ts_tablet_manager.cc:1434] T 073bb9d9d62f462db20229a4924564e1 P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.088s	user 0.008s	sys 0.000s
I20260709 13:15:47.896469  5514 tablet_bootstrap.cc:492] T 3e48fc9e60214121991b0bb473d174da P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
I20260709 13:15:47.812141  5827 raft_consensus.cc:697] T 03ad7844466b46548e4e9600220710f0 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 LEADER]: Becoming Leader. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Running, Role: LEADER
W20260709 13:15:47.881893  5434 consensus_peers.cc:597] T cb26053fad7244cd88a5182d9cfc2109 P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:47.798355  5684 raft_consensus.cc:515] T 22ee19164403428187e72d7a7c868457 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:47.904390  5827 consensus_queue.cc:237] T 03ad7844466b46548e4e9600220710f0 P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:47.906945  5684 leader_election.cc:290] T 22ee19164403428187e72d7a7c868457 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Requested vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:47.817960  5516 tablet_bootstrap.cc:654] T 4d479dd9f8c04491bb1e78273726187f P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:47.908849  5714 raft_consensus.cc:493] T 39d465e757b14de1842d55d52271bceb P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.909570  5714 raft_consensus.cc:515] T 39d465e757b14de1842d55d52271bceb P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:47.904238  5646 raft_consensus.cc:493] T 58438f196e6d42cc8780742faa222dc8 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.913494  5646 raft_consensus.cc:515] T 58438f196e6d42cc8780742faa222dc8 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:47.913233  5515 tablet_bootstrap.cc:492] T 29ec9fd2ee334861a956e4d70d348b6d P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
I20260709 13:15:47.925334  5392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d465e757b14de1842d55d52271bceb" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:47.855216  5517 tablet_bootstrap.cc:492] T 22ee19164403428187e72d7a7c868457 P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:47.913595  5714 leader_election.cc:290] T 39d465e757b14de1842d55d52271bceb P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:47.928557  5517 ts_tablet_manager.cc:1403] T 22ee19164403428187e72d7a7c868457 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.376s	user 0.026s	sys 0.016s
I20260709 13:15:47.929567  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d465e757b14de1842d55d52271bceb" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:47.933288  5646 leader_election.cc:290] T 58438f196e6d42cc8780742faa222dc8 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:47.941439  5832 raft_consensus.cc:515] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:47.950963  5514 tablet_bootstrap.cc:654] T 3e48fc9e60214121991b0bb473d174da P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:47.955075  5832 leader_election.cc:290] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 election: Requested vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:47.956775  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63267e5ca2594b41844fd758ca603a34" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:15:47.972112  5321 raft_consensus.cc:3060] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:47.972544  5515 tablet_bootstrap.cc:654] T 29ec9fd2ee334861a956e4d70d348b6d P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:47.971263  5144 catalog_manager.cc:5697] T 4d479dd9f8c04491bb1e78273726187f P c4b52f14f9154b5a86f76fe58e4c235e reported cstate change: term changed from 0 to 1, leader changed from <none> to c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131). New cstate: current_term: 1 leader_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: HEALTHY } } }
W20260709 13:15:47.959789  5434 leader_election.cc:343] T 39d465e757b14de1842d55d52271bceb P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:47.961534  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ee19164403428187e72d7a7c868457" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
I20260709 13:15:47.961304  5517 raft_consensus.cc:359] T 22ee19164403428187e72d7a7c868457 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:47.976814  5517 raft_consensus.cc:385] T 22ee19164403428187e72d7a7c868457 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:15:47.977036  5434 leader_election.cc:343] T 39d465e757b14de1842d55d52271bceb P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:47.977533  5209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:41391, user_credentials={real_user=slave}} blocked reactor thread for 68884.7us
I20260709 13:15:47.977175  5517 raft_consensus.cc:740] T 22ee19164403428187e72d7a7c868457 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:47.979868  5517 consensus_queue.cc:260] T 22ee19164403428187e72d7a7c868457 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:47.980746  5243 raft_consensus.cc:3060] T 22ee19164403428187e72d7a7c868457 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:47.961862  5392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ee19164403428187e72d7a7c868457" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:15:47.985630  5392 raft_consensus.cc:3060] T 22ee19164403428187e72d7a7c868457 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:48.009634  5714 raft_consensus.cc:493] T 073bb9d9d62f462db20229a4924564e1 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.010376  5714 raft_consensus.cc:515] T 073bb9d9d62f462db20229a4924564e1 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:47.989529  5243 raft_consensus.cc:2468] T 22ee19164403428187e72d7a7c868457 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 1.
I20260709 13:15:48.012681  5714 leader_election.cc:290] T 073bb9d9d62f462db20229a4924564e1 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:48.015420  5286 leader_election.cc:304] T 22ee19164403428187e72d7a7c868457 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 
I20260709 13:15:48.019752  5815 raft_consensus.cc:2804] T 22ee19164403428187e72d7a7c868457 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:47.996042  5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58438f196e6d42cc8780742faa222dc8" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:48.020486  5815 raft_consensus.cc:697] T 22ee19164403428187e72d7a7c868457 P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Becoming Leader. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Running, Role: LEADER
I20260709 13:15:47.977567  5434 leader_election.cc:304] T 39d465e757b14de1842d55d52271bceb P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:48.016435  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073bb9d9d62f462db20229a4924564e1" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:48.021520  5815 consensus_queue.cc:237] T 22ee19164403428187e72d7a7c868457 P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
W20260709 13:15:48.021972  5434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:41357, user_credentials={real_user=slave}} blocked reactor thread for 44976.3us
W20260709 13:15:48.022507  5360 leader_election.cc:343] T 58438f196e6d42cc8780742faa222dc8 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:48.022773  5433 leader_election.cc:343] T 073bb9d9d62f462db20229a4924564e1 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:48.023298  5683 raft_consensus.cc:2749] T 39d465e757b14de1842d55d52271bceb P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:48.025156  5517 ts_tablet_manager.cc:1434] T 22ee19164403428187e72d7a7c868457 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.096s	user 0.009s	sys 0.002s
I20260709 13:15:48.026458  5517 tablet_bootstrap.cc:492] T 34516de894fc408b8e355aba3402489c P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:48.027204  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58438f196e6d42cc8780742faa222dc8" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:48.027990  5469 raft_consensus.cc:2468] T 58438f196e6d42cc8780742faa222dc8 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 0.
I20260709 13:15:48.028000  5516 tablet_bootstrap.cc:492] T 4d479dd9f8c04491bb1e78273726187f P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:48.029904  5395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073bb9d9d62f462db20229a4924564e1" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:48.030552  5516 ts_tablet_manager.cc:1403] T 4d479dd9f8c04491bb1e78273726187f P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.238s	user 0.010s	sys 0.011s
I20260709 13:15:48.036548  5517 tablet_bootstrap.cc:654] T 34516de894fc408b8e355aba3402489c P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:48.036943  5516 raft_consensus.cc:359] T 4d479dd9f8c04491bb1e78273726187f P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:48.037850  5516 raft_consensus.cc:385] T 4d479dd9f8c04491bb1e78273726187f P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:48.038179  5516 raft_consensus.cc:740] T 4d479dd9f8c04491bb1e78273726187f P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:48.039407  5516 consensus_queue.cc:260] T 4d479dd9f8c04491bb1e78273726187f P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:48.043195  5516 ts_tablet_manager.cc:1434] T 4d479dd9f8c04491bb1e78273726187f P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:15:48.046646  5516 tablet_bootstrap.cc:492] T 02dba91c167a418daee105670577c8aa P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
I20260709 13:15:48.050841  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63267e5ca2594b41844fd758ca603a34" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:15:48.051877  5469 raft_consensus.cc:3060] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:48.073531  5434 leader_election.cc:343] T 073bb9d9d62f462db20229a4924564e1 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:48.074174  5434 leader_election.cc:304] T 073bb9d9d62f462db20229a4924564e1 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0; no voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:47.982430  5321 raft_consensus.cc:2468] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 2.
I20260709 13:15:48.077018  5683 raft_consensus.cc:2749] T 073bb9d9d62f462db20229a4924564e1 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:48.085805  5210 leader_election.cc:304] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 
I20260709 13:15:48.089610  5469 raft_consensus.cc:2468] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 2.
I20260709 13:15:48.077762  5358 leader_election.cc:304] T 58438f196e6d42cc8780742faa222dc8 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:48.090829  5860 raft_consensus.cc:2804] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:48.080170  5824 consensus_queue.cc:1048] T 309fb72c5b374642bb05a78b0b5ca308 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:15:48.107263  5392 raft_consensus.cc:2468] T 22ee19164403428187e72d7a7c868457 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 1.
I20260709 13:15:48.103570  5860 raft_consensus.cc:697] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 LEADER]: Becoming Leader. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Running, Role: LEADER
I20260709 13:15:48.113415  5860 consensus_queue.cc:237] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:48.119395  5321 raft_consensus.cc:1275] T 8aac85b71e404ee1bcfb748bfb0376fb P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Refusing update from remote peer 538ff4bfbd0c4f04bcd800c4ee4845ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:15:48.137604  5515 tablet_bootstrap.cc:492] T 29ec9fd2ee334861a956e4d70d348b6d P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
I20260709 13:15:48.138466  5515 ts_tablet_manager.cc:1403] T 29ec9fd2ee334861a956e4d70d348b6d P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.225s	user 0.016s	sys 0.014s
I20260709 13:15:48.105515  5827 raft_consensus.cc:2804] T 58438f196e6d42cc8780742faa222dc8 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:15:48.142212  5434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:40847, user_credentials={real_user=slave}} blocked reactor thread for 64965.6us
I20260709 13:15:48.130596  5140 catalog_manager.cc:5697] T 22ee19164403428187e72d7a7c868457 P 2f45532f94a34efcb68a82db3dd69372 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130). New cstate: current_term: 1 leader_uuid: "2f45532f94a34efcb68a82db3dd69372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:48.142484  5141 catalog_manager.cc:5697] T 03ad7844466b46548e4e9600220710f0 P c4b52f14f9154b5a86f76fe58e4c235e reported cstate change: term changed from 0 to 1, leader changed from <none> to c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131). New cstate: current_term: 1 leader_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:48.155148  5859 log.cc:927] Time spent T 03ad7844466b46548e4e9600220710f0 P c4b52f14f9154b5a86f76fe58e4c235e: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:15:48.127287  5832 consensus_queue.cc:1048] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.032s
I20260709 13:15:48.166044  5515 raft_consensus.cc:359] T 29ec9fd2ee334861a956e4d70d348b6d P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:48.166836  5515 raft_consensus.cc:385] T 29ec9fd2ee334861a956e4d70d348b6d P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:48.167127  5515 raft_consensus.cc:740] T 29ec9fd2ee334861a956e4d70d348b6d P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:48.143040  5827 raft_consensus.cc:493] T 58438f196e6d42cc8780742faa222dc8 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:48.169626  5827 raft_consensus.cc:3060] T 58438f196e6d42cc8780742faa222dc8 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:48.170902  5514 tablet_bootstrap.cc:492] T 3e48fc9e60214121991b0bb473d174da P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:48.171555  5514 ts_tablet_manager.cc:1403] T 3e48fc9e60214121991b0bb473d174da P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.275s	user 0.020s	sys 0.023s
I20260709 13:15:48.175130  5515 consensus_queue.cc:260] T 29ec9fd2ee334861a956e4d70d348b6d P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:48.177889  5516 tablet_bootstrap.cc:654] T 02dba91c167a418daee105670577c8aa P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:48.178783  5515 ts_tablet_manager.cc:1434] T 29ec9fd2ee334861a956e4d70d348b6d P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.040s	user 0.004s	sys 0.004s
I20260709 13:15:48.179984  5515 tablet_bootstrap.cc:492] T 39d465e757b14de1842d55d52271bceb P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
I20260709 13:15:48.188374  5464 raft_consensus.cc:1275] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Refusing update from remote peer 538ff4bfbd0c4f04bcd800c4ee4845ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:15:48.188376  5517 tablet_bootstrap.cc:492] T 34516de894fc408b8e355aba3402489c P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:48.192425  5517 ts_tablet_manager.cc:1403] T 34516de894fc408b8e355aba3402489c P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.166s	user 0.022s	sys 0.008s
I20260709 13:15:48.192526  5514 raft_consensus.cc:359] T 3e48fc9e60214121991b0bb473d174da P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:48.193300  5514 raft_consensus.cc:385] T 3e48fc9e60214121991b0bb473d174da P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:48.193611  5514 raft_consensus.cc:740] T 3e48fc9e60214121991b0bb473d174da P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:48.199542  5514 consensus_queue.cc:260] T 3e48fc9e60214121991b0bb473d174da P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:48.227026  5514 ts_tablet_manager.cc:1434] T 3e48fc9e60214121991b0bb473d174da P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.055s	user 0.005s	sys 0.003s
I20260709 13:15:48.228392  5514 tablet_bootstrap.cc:492] T 73c339ffbbca40c78c31d33aa9bb9e38 P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
I20260709 13:15:48.236346  5317 raft_consensus.cc:3060] T 4d479dd9f8c04491bb1e78273726187f P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:48.237634  5141 catalog_manager.cc:5697] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba reported cstate change: term changed from 0 to 2, leader changed from <none> to 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129). New cstate: current_term: 2 leader_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:48.224879  5846 raft_consensus.cc:493] T 03ad7844466b46548e4e9600220710f0 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.263161  5846 raft_consensus.cc:515] T 03ad7844466b46548e4e9600220710f0 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:48.244832  5824 consensus_queue.cc:1048] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:48.249212  5517 raft_consensus.cc:359] T 34516de894fc408b8e355aba3402489c P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:48.267627  5517 raft_consensus.cc:385] T 34516de894fc408b8e355aba3402489c P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:48.262137  5827 raft_consensus.cc:515] T 58438f196e6d42cc8780742faa222dc8 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:48.268446  5517 raft_consensus.cc:740] T 34516de894fc408b8e355aba3402489c P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:48.272435  5517 consensus_queue.cc:260] T 34516de894fc408b8e355aba3402489c P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:48.277014  5392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ad7844466b46548e4e9600220710f0" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:48.282238  5464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ad7844466b46548e4e9600220710f0" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:48.283222  5464 raft_consensus.cc:2393] T 03ad7844466b46548e4e9600220710f0 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f45532f94a34efcb68a82db3dd69372 in current term 1: Already voted for candidate c4b52f14f9154b5a86f76fe58e4c235e in this term.
I20260709 13:15:48.286612  5284 leader_election.cc:304] T 03ad7844466b46548e4e9600220710f0 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372; no voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:48.287622  5684 raft_consensus.cc:3060] T 03ad7844466b46548e4e9600220710f0 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:48.288807  5517 ts_tablet_manager.cc:1434] T 34516de894fc408b8e355aba3402489c P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.096s	user 0.010s	sys 0.000s
I20260709 13:15:48.290596  5827 leader_election.cc:290] T 58438f196e6d42cc8780742faa222dc8 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 election: Requested vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:48.268639  5846 leader_election.cc:290] T 03ad7844466b46548e4e9600220710f0 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:48.297041  5515 tablet_bootstrap.cc:654] T 39d465e757b14de1842d55d52271bceb P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:48.297571  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58438f196e6d42cc8780742faa222dc8" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:15:48.298164  5469 raft_consensus.cc:3060] T 58438f196e6d42cc8780742faa222dc8 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:48.298754  5516 tablet_bootstrap.cc:492] T 02dba91c167a418daee105670577c8aa P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:48.292128  5517 tablet_bootstrap.cc:492] T cb26053fad7244cd88a5182d9cfc2109 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:48.299248  5655 consensus_queue.cc:1048] T 4d479dd9f8c04491bb1e78273726187f P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:48.300197  5514 tablet_bootstrap.cc:654] T 73c339ffbbca40c78c31d33aa9bb9e38 P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:48.309856  5517 tablet_bootstrap.cc:654] T cb26053fad7244cd88a5182d9cfc2109 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:48.299283  5516 ts_tablet_manager.cc:1403] T 02dba91c167a418daee105670577c8aa P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.255s	user 0.037s	sys 0.009s
W20260709 13:15:48.327702  5209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:41391, user_credentials={real_user=slave}} blocked reactor thread for 93653.1us
I20260709 13:15:48.343842  5684 raft_consensus.cc:2749] T 03ad7844466b46548e4e9600220710f0 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:48.346822  5517 tablet_bootstrap.cc:492] T cb26053fad7244cd88a5182d9cfc2109 P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:48.347126  5242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58438f196e6d42cc8780742faa222dc8" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
I20260709 13:15:48.347712  5517 ts_tablet_manager.cc:1403] T cb26053fad7244cd88a5182d9cfc2109 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.058s	user 0.016s	sys 0.009s
I20260709 13:15:48.346771  5516 raft_consensus.cc:359] T 02dba91c167a418daee105670577c8aa P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:48.350256  5516 raft_consensus.cc:385] T 02dba91c167a418daee105670577c8aa P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:48.351560  5516 raft_consensus.cc:740] T 02dba91c167a418daee105670577c8aa P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:48.352833  5516 consensus_queue.cc:260] T 02dba91c167a418daee105670577c8aa P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:48.356601  5516 ts_tablet_manager.cc:1434] T 02dba91c167a418daee105670577c8aa P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.001s
I20260709 13:15:48.358289  5516 tablet_bootstrap.cc:492] T 5b17eb476da34f05b466923d9c48cc2d P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
I20260709 13:15:48.363701  5655 consensus_queue.cc:1048] T 03ad7844466b46548e4e9600220710f0 P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:48.369890  5514 tablet_bootstrap.cc:492] T 73c339ffbbca40c78c31d33aa9bb9e38 P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:48.370661  5514 ts_tablet_manager.cc:1403] T 73c339ffbbca40c78c31d33aa9bb9e38 P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.142s	user 0.016s	sys 0.007s
W20260709 13:15:48.374104  5360 leader_election.cc:343] T 58438f196e6d42cc8780742faa222dc8 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:48.375101  5655 consensus_queue.cc:1048] T 4d479dd9f8c04491bb1e78273726187f P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Connected to new peer: Peer: permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:48.380259  5469 raft_consensus.cc:2468] T 58438f196e6d42cc8780742faa222dc8 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 1.
I20260709 13:15:48.382468  5517 raft_consensus.cc:359] T cb26053fad7244cd88a5182d9cfc2109 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:48.383351  5517 raft_consensus.cc:385] T cb26053fad7244cd88a5182d9cfc2109 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:48.383736  5517 raft_consensus.cc:740] T cb26053fad7244cd88a5182d9cfc2109 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:48.384654  5517 consensus_queue.cc:260] T cb26053fad7244cd88a5182d9cfc2109 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:48.389365  5714 raft_consensus.cc:493] T 3e48fc9e60214121991b0bb473d174da P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.390105  5714 raft_consensus.cc:515] T 3e48fc9e60214121991b0bb473d174da P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:48.390607  5358 leader_election.cc:304] T 58438f196e6d42cc8780742faa222dc8 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:48.393924  5516 tablet_bootstrap.cc:654] T 5b17eb476da34f05b466923d9c48cc2d P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:48.395684  5827 raft_consensus.cc:2804] T 58438f196e6d42cc8780742faa222dc8 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:48.395907  5319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e48fc9e60214121991b0bb473d174da" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:48.396291  5827 raft_consensus.cc:697] T 58438f196e6d42cc8780742faa222dc8 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 LEADER]: Becoming Leader. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Running, Role: LEADER
I20260709 13:15:48.397279  5827 consensus_queue.cc:237] T 58438f196e6d42cc8780742faa222dc8 P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:48.398234  5517 ts_tablet_manager.cc:1434] T cb26053fad7244cd88a5182d9cfc2109 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 13:15:48.395227  5392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e48fc9e60214121991b0bb473d174da" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:48.399988  5514 raft_consensus.cc:359] T 73c339ffbbca40c78c31d33aa9bb9e38 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:48.400724  5514 raft_consensus.cc:385] T 73c339ffbbca40c78c31d33aa9bb9e38 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:15:48.399353  5433 leader_election.cc:343] T 3e48fc9e60214121991b0bb473d174da P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:48.401063  5514 raft_consensus.cc:740] T 73c339ffbbca40c78c31d33aa9bb9e38 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:48.401826  5514 consensus_queue.cc:260] T 73c339ffbbca40c78c31d33aa9bb9e38 P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:48.402371  5714 leader_election.cc:290] T 3e48fc9e60214121991b0bb473d174da P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
W20260709 13:15:48.403232  5434 leader_election.cc:343] T 3e48fc9e60214121991b0bb473d174da P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:48.399382  5517 tablet_bootstrap.cc:492] T 02dba91c167a418daee105670577c8aa P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:48.403730  5434 leader_election.cc:304] T 3e48fc9e60214121991b0bb473d174da P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0; no voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:48.410651  5839 raft_consensus.cc:2749] T 3e48fc9e60214121991b0bb473d174da P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:48.413385  5515 tablet_bootstrap.cc:492] T 39d465e757b14de1842d55d52271bceb P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
I20260709 13:15:48.413977  5515 ts_tablet_manager.cc:1403] T 39d465e757b14de1842d55d52271bceb P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.234s	user 0.015s	sys 0.025s
I20260709 13:15:48.415855  5517 tablet_bootstrap.cc:654] T 02dba91c167a418daee105670577c8aa P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:48.417832  5514 ts_tablet_manager.cc:1434] T 73c339ffbbca40c78c31d33aa9bb9e38 P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.047s	user 0.003s	sys 0.005s
I20260709 13:15:48.419003  5514 tablet_bootstrap.cc:492] T 6a1e233f50be40f78b9208537916e93c P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
I20260709 13:15:48.419059  5788 consensus_queue.cc:1048] T 03ad7844466b46548e4e9600220710f0 P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:48.437155  5515 raft_consensus.cc:359] T 39d465e757b14de1842d55d52271bceb P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:48.438030  5515 raft_consensus.cc:385] T 39d465e757b14de1842d55d52271bceb P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:48.438302  5515 raft_consensus.cc:740] T 39d465e757b14de1842d55d52271bceb P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:48.439170  5515 consensus_queue.cc:260] T 39d465e757b14de1842d55d52271bceb P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:48.435712  5684 consensus_queue.cc:1048] T 22ee19164403428187e72d7a7c868457 P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:15:48.484263  5516 tablet_bootstrap.cc:492] T 5b17eb476da34f05b466923d9c48cc2d P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:48.485997  5516 ts_tablet_manager.cc:1403] T 5b17eb476da34f05b466923d9c48cc2d P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.128s	user 0.018s	sys 0.033s
I20260709 13:15:48.498616  5515 ts_tablet_manager.cc:1434] T 39d465e757b14de1842d55d52271bceb P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.084s	user 0.009s	sys 0.000s
I20260709 13:15:48.502700  5515 tablet_bootstrap.cc:492] T 073bb9d9d62f462db20229a4924564e1 P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
I20260709 13:15:48.511571  5516 raft_consensus.cc:359] T 5b17eb476da34f05b466923d9c48cc2d P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:48.512511  5516 raft_consensus.cc:385] T 5b17eb476da34f05b466923d9c48cc2d P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:48.512811  5516 raft_consensus.cc:740] T 5b17eb476da34f05b466923d9c48cc2d P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:48.515524  5516 consensus_queue.cc:260] T 5b17eb476da34f05b466923d9c48cc2d P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:48.518276  5871 raft_consensus.cc:493] T cb26053fad7244cd88a5182d9cfc2109 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.519311  5516 ts_tablet_manager.cc:1434] T 5b17eb476da34f05b466923d9c48cc2d P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:15:48.519124  5871 raft_consensus.cc:515] T cb26053fad7244cd88a5182d9cfc2109 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:48.520440  5516 tablet_bootstrap.cc:492] T 073bb9d9d62f462db20229a4924564e1 P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
I20260709 13:15:48.521907  5871 leader_election.cc:290] T cb26053fad7244cd88a5182d9cfc2109 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:48.523064  5684 consensus_queue.cc:1048] T 22ee19164403428187e72d7a7c868457 P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:48.527362  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb26053fad7244cd88a5182d9cfc2109" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:48.573458  5141 catalog_manager.cc:5697] T 58438f196e6d42cc8780742faa222dc8 P c4b52f14f9154b5a86f76fe58e4c235e reported cstate change: term changed from 0 to 1, leader changed from <none> to c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131). New cstate: current_term: 1 leader_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:48.590721  5514 tablet_bootstrap.cc:654] T 6a1e233f50be40f78b9208537916e93c P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:48.599876  5515 tablet_bootstrap.cc:654] T 073bb9d9d62f462db20229a4924564e1 P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:48.619904  5246 raft_consensus.cc:3060] T 34516de894fc408b8e355aba3402489c P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:48.604696  5846 raft_consensus.cc:493] T 02dba91c167a418daee105670577c8aa P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.627923  5846 raft_consensus.cc:515] T 02dba91c167a418daee105670577c8aa P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:48.643751  5846 leader_election.cc:290] T 02dba91c167a418daee105670577c8aa P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
W20260709 13:15:48.646384  5192 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:48.657824  5516 tablet_bootstrap.cc:654] T 073bb9d9d62f462db20229a4924564e1 P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:48.661578  5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dba91c167a418daee105670577c8aa" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
W20260709 13:15:48.672438  5286 leader_election.cc:343] T 02dba91c167a418daee105670577c8aa P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:48.692446  5359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:43623, user_credentials={real_user=slave}} blocked reactor thread for 106741us
I20260709 13:15:48.700753  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb26053fad7244cd88a5182d9cfc2109" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:48.714551  5517 tablet_bootstrap.cc:492] T 02dba91c167a418daee105670577c8aa P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:48.715258  5517 ts_tablet_manager.cc:1403] T 02dba91c167a418daee105670577c8aa P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.316s	user 0.012s	sys 0.014s
I20260709 13:15:48.719861  5517 raft_consensus.cc:359] T 02dba91c167a418daee105670577c8aa P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:48.720640  5517 raft_consensus.cc:385] T 02dba91c167a418daee105670577c8aa P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:48.720932  5517 raft_consensus.cc:740] T 02dba91c167a418daee105670577c8aa P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:48.721856  5517 consensus_queue.cc:260] T 02dba91c167a418daee105670577c8aa P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:48.730916  5517 ts_tablet_manager.cc:1434] T 02dba91c167a418daee105670577c8aa P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:15:48.733464  5391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dba91c167a418daee105670577c8aa" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:48.739312  5892 raft_consensus.cc:493] T 39d465e757b14de1842d55d52271bceb P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.740020  5892 raft_consensus.cc:515] T 39d465e757b14de1842d55d52271bceb P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:48.740350  5465 raft_consensus.cc:1275] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Refusing update from remote peer 538ff4bfbd0c4f04bcd800c4ee4845ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:15:48.731968  5714 raft_consensus.cc:493] T 73c339ffbbca40c78c31d33aa9bb9e38 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.743670  5714 raft_consensus.cc:515] T 73c339ffbbca40c78c31d33aa9bb9e38 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:48.755868  5517 tablet_bootstrap.cc:492] T 5b17eb476da34f05b466923d9c48cc2d P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:48.758320  5832 raft_consensus.cc:493] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2f45532f94a34efcb68a82db3dd69372)
I20260709 13:15:48.759613  5465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d465e757b14de1842d55d52271bceb" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:48.760320  5465 raft_consensus.cc:2468] T 39d465e757b14de1842d55d52271bceb P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 0.
I20260709 13:15:48.758960  5832 raft_consensus.cc:515] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:48.740032  5391 raft_consensus.cc:2468] T 02dba91c167a418daee105670577c8aa P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 0.
I20260709 13:15:48.776501  5517 tablet_bootstrap.cc:654] T 5b17eb476da34f05b466923d9c48cc2d P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:48.756824  5892 leader_election.cc:290] T 39d465e757b14de1842d55d52271bceb P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:48.779224  5832 leader_election.cc:290] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:48.782420  5892 raft_consensus.cc:493] T 29ec9fd2ee334861a956e4d70d348b6d P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.782630  5714 leader_election.cc:290] T 73c339ffbbca40c78c31d33aa9bb9e38 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:48.782980  5892 raft_consensus.cc:515] T 29ec9fd2ee334861a956e4d70d348b6d P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
W20260709 13:15:48.783687  5890 log.cc:927] Time spent T 4d479dd9f8c04491bb1e78273726187f P 538ff4bfbd0c4f04bcd800c4ee4845ba: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:15:48.785885  5892 leader_election.cc:290] T 29ec9fd2ee334861a956e4d70d348b6d P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:48.787461  5515 tablet_bootstrap.cc:492] T 073bb9d9d62f462db20229a4924564e1 P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
I20260709 13:15:48.803803  5515 ts_tablet_manager.cc:1403] T 073bb9d9d62f462db20229a4924564e1 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.304s	user 0.019s	sys 0.021s
I20260709 13:15:48.791356  5358 leader_election.cc:304] T 39d465e757b14de1842d55d52271bceb P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:48.793004  5286 leader_election.cc:304] T 02dba91c167a418daee105670577c8aa P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:48.796103  5242 raft_consensus.cc:3060] T cb26053fad7244cd88a5182d9cfc2109 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:48.807341  5517 tablet_bootstrap.cc:492] T 5b17eb476da34f05b466923d9c48cc2d P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:48.808183  5517 ts_tablet_manager.cc:1403] T 5b17eb476da34f05b466923d9c48cc2d P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.055s	user 0.015s	sys 0.020s
I20260709 13:15:48.797317  5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c339ffbbca40c78c31d33aa9bb9e38" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:48.808085  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d465e757b14de1842d55d52271bceb" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:48.799407  5392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654fdf03209d4a3cbf17055c56ae2c9d" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:48.809607  5392 raft_consensus.cc:2393] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in current term 2: Already voted for candidate c4b52f14f9154b5a86f76fe58e4c235e in this term.
I20260709 13:15:48.797416  5514 tablet_bootstrap.cc:492] T 6a1e233f50be40f78b9208537916e93c P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:48.807454  5889 raft_consensus.cc:2804] T 02dba91c167a418daee105670577c8aa P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:48.810561  5514 ts_tablet_manager.cc:1403] T 6a1e233f50be40f78b9208537916e93c P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.392s	user 0.021s	sys 0.003s
I20260709 13:15:48.811473  5517 raft_consensus.cc:359] T 5b17eb476da34f05b466923d9c48cc2d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:48.812433  5517 raft_consensus.cc:385] T 5b17eb476da34f05b466923d9c48cc2d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:48.812530  5516 tablet_bootstrap.cc:492] T 073bb9d9d62f462db20229a4924564e1 P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:48.805974  5241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ec9fd2ee334861a956e4d70d348b6d" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:48.812740  5517 raft_consensus.cc:740] T 5b17eb476da34f05b466923d9c48cc2d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:48.815795  5516 ts_tablet_manager.cc:1403] T 073bb9d9d62f462db20229a4924564e1 P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.296s	user 0.007s	sys 0.010s
I20260709 13:15:48.810572  5889 raft_consensus.cc:493] T 02dba91c167a418daee105670577c8aa P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:48.816468  5889 raft_consensus.cc:3060] T 02dba91c167a418daee105670577c8aa P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:48.816550  5517 consensus_queue.cc:260] T 5b17eb476da34f05b466923d9c48cc2d P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:48.819183  5517 ts_tablet_manager.cc:1434] T 5b17eb476da34f05b466923d9c48cc2d P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:15:48.819331  5209 leader_election.cc:304] T cb26053fad7244cd88a5182d9cfc2109 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0
I20260709 13:15:48.820338  5517 tablet_bootstrap.cc:492] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:48.820907  5319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ec9fd2ee334861a956e4d70d348b6d" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:48.821744  5824 consensus_queue.cc:1048] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:48.822717  5646 raft_consensus.cc:2804] T 39d465e757b14de1842d55d52271bceb P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:48.823189  5646 raft_consensus.cc:493] T 39d465e757b14de1842d55d52271bceb P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:48.823534  5646 raft_consensus.cc:3060] T 39d465e757b14de1842d55d52271bceb P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:48.828271  5517 tablet_bootstrap.cc:654] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:48.830822  5359 leader_election.cc:343] T 29ec9fd2ee334861a956e4d70d348b6d P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:48.830705  5392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c339ffbbca40c78c31d33aa9bb9e38" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
W20260709 13:15:48.833539  5360 leader_election.cc:343] T 39d465e757b14de1842d55d52271bceb P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:48.835026  5516 raft_consensus.cc:359] T 073bb9d9d62f462db20229a4924564e1 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:48.836148  5516 raft_consensus.cc:385] T 073bb9d9d62f462db20229a4924564e1 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:48.836541  5516 raft_consensus.cc:740] T 073bb9d9d62f462db20229a4924564e1 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:48.837507  5516 consensus_queue.cc:260] T 073bb9d9d62f462db20229a4924564e1 P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:48.881776  5516 ts_tablet_manager.cc:1434] T 073bb9d9d62f462db20229a4924564e1 P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.066s	user 0.006s	sys 0.004s
W20260709 13:15:48.883993  5360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:41357, user_credentials={real_user=slave}} blocked reactor thread for 50524.4us
I20260709 13:15:48.813723  5514 raft_consensus.cc:359] T 6a1e233f50be40f78b9208537916e93c P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
W20260709 13:15:48.885598  5360 leader_election.cc:343] T 29ec9fd2ee334861a956e4d70d348b6d P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:48.885968  5514 raft_consensus.cc:385] T 6a1e233f50be40f78b9208537916e93c P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:48.886485  5514 raft_consensus.cc:740] T 6a1e233f50be40f78b9208537916e93c P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:48.886281  5360 leader_election.cc:304] T 29ec9fd2ee334861a956e4d70d348b6d P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b52f14f9154b5a86f76fe58e4c235e; no voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:48.887131  5317 raft_consensus.cc:1275] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Refusing update from remote peer 538ff4bfbd0c4f04bcd800c4ee4845ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:15:48.888096  5514 consensus_queue.cc:260] T 6a1e233f50be40f78b9208537916e93c P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:48.888774  5891 raft_consensus.cc:2749] T 29ec9fd2ee334861a956e4d70d348b6d P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:48.883306  5516 tablet_bootstrap.cc:492] T 29ec9fd2ee334861a956e4d70d348b6d P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
I20260709 13:15:48.894870  5514 ts_tablet_manager.cc:1434] T 6a1e233f50be40f78b9208537916e93c P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.084s	user 0.008s	sys 0.002s
I20260709 13:15:48.898283  5317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654fdf03209d4a3cbf17055c56ae2c9d" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
W20260709 13:15:48.876622  5434 leader_election.cc:343] T 73c339ffbbca40c78c31d33aa9bb9e38 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:48.891625  5515 raft_consensus.cc:359] T 073bb9d9d62f462db20229a4924564e1 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:48.904589  5515 raft_consensus.cc:385] T 073bb9d9d62f462db20229a4924564e1 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:48.904953  5515 raft_consensus.cc:740] T 073bb9d9d62f462db20229a4924564e1 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:48.901675  5514 tablet_bootstrap.cc:492] T 3b01a00074004ddb87b1710a6555353b P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
I20260709 13:15:48.898957  5889 raft_consensus.cc:515] T 02dba91c167a418daee105670577c8aa P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
W20260709 13:15:48.903971  5434 leader_election.cc:343] T 73c339ffbbca40c78c31d33aa9bb9e38 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:48.909060  5434 leader_election.cc:304] T 73c339ffbbca40c78c31d33aa9bb9e38 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:48.909653  5515 consensus_queue.cc:260] T 073bb9d9d62f462db20229a4924564e1 P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:48.931154  5515 ts_tablet_manager.cc:1434] T 073bb9d9d62f462db20229a4924564e1 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.127s	user 0.009s	sys 0.000s
I20260709 13:15:48.920341  5714 raft_consensus.cc:2749] T 73c339ffbbca40c78c31d33aa9bb9e38 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:48.957970  5515 tablet_bootstrap.cc:492] T 3e48fc9e60214121991b0bb473d174da P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
I20260709 13:15:48.920747  5317 raft_consensus.cc:2468] T 654fdf03209d4a3cbf17055c56ae2c9d P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 2.
I20260709 13:15:48.969530  5646 raft_consensus.cc:515] T 39d465e757b14de1842d55d52271bceb P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:48.977053  5889 leader_election.cc:290] T 02dba91c167a418daee105670577c8aa P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Requested vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:48.979983  5865 raft_consensus.cc:493] T 6a1e233f50be40f78b9208537916e93c P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.002410  5516 tablet_bootstrap.cc:654] T 29ec9fd2ee334861a956e4d70d348b6d P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:49.015929  5394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dba91c167a418daee105670577c8aa" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:15:49.017004  5394 raft_consensus.cc:3060] T 02dba91c167a418daee105670577c8aa P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:49.027081  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dba91c167a418daee105670577c8aa" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
I20260709 13:15:49.041083  5394 raft_consensus.cc:2468] T 02dba91c167a418daee105670577c8aa P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 1.
I20260709 13:15:49.042918  5514 tablet_bootstrap.cc:654] T 3b01a00074004ddb87b1710a6555353b P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:49.026783  5865 raft_consensus.cc:515] T 6a1e233f50be40f78b9208537916e93c P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:49.046986  5865 leader_election.cc:290] T 6a1e233f50be40f78b9208537916e93c P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:49.047607  5591 raft_consensus.cc:2749] T cb26053fad7244cd88a5182d9cfc2109 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:49.048451  5243 raft_consensus.cc:3060] T 02dba91c167a418daee105670577c8aa P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:49.049064  5832 raft_consensus.cc:493] T 5b17eb476da34f05b466923d9c48cc2d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.049672  5832 raft_consensus.cc:515] T 5b17eb476da34f05b466923d9c48cc2d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:49.050261  5646 leader_election.cc:290] T 39d465e757b14de1842d55d52271bceb P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 election: Requested vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:49.052062  5832 leader_election.cc:290] T 5b17eb476da34f05b466923d9c48cc2d P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:49.052392  5815 raft_consensus.cc:493] T 073bb9d9d62f462db20229a4924564e1 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.052896  5815 raft_consensus.cc:515] T 073bb9d9d62f462db20229a4924564e1 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:49.054926  5815 leader_election.cc:290] T 073bb9d9d62f462db20229a4924564e1 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:49.030328  5889 raft_consensus.cc:493] T 5b17eb476da34f05b466923d9c48cc2d P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.060353  5286 leader_election.cc:304] T 02dba91c167a418daee105670577c8aa P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:49.075385  5517 tablet_bootstrap.cc:492] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:49.076435  5517 ts_tablet_manager.cc:1403] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.256s	user 0.033s	sys 0.065s
I20260709 13:15:49.077554  5889 raft_consensus.cc:515] T 5b17eb476da34f05b466923d9c48cc2d P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:49.082501  5870 consensus_queue.cc:1048] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.076s
I20260709 13:15:49.084721  5889 leader_election.cc:290] T 5b17eb476da34f05b466923d9c48cc2d P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:49.093080  5517 raft_consensus.cc:359] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:49.095659  5464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d465e757b14de1842d55d52271bceb" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:15:49.096621  5464 raft_consensus.cc:3060] T 39d465e757b14de1842d55d52271bceb P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:49.085423  5395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073bb9d9d62f462db20229a4924564e1" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:49.101154  5395 raft_consensus.cc:2468] T 073bb9d9d62f462db20229a4924564e1 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 0.
I20260709 13:15:49.108945  5465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b17eb476da34f05b466923d9c48cc2d" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:49.109714  5465 raft_consensus.cc:2468] T 5b17eb476da34f05b466923d9c48cc2d P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 0.
I20260709 13:15:49.077803  5815 raft_consensus.cc:2804] T 02dba91c167a418daee105670577c8aa P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:49.113687  5517 raft_consensus.cc:385] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:49.114491  5517 raft_consensus.cc:740] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:49.111873  5286 leader_election.cc:304] T 073bb9d9d62f462db20229a4924564e1 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
W20260709 13:15:49.118104  5360 consensus_peers.cc:597] T 58438f196e6d42cc8780742faa222dc8 P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:49.118644  5886 raft_consensus.cc:2804] T 073bb9d9d62f462db20229a4924564e1 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:49.119081  5886 raft_consensus.cc:493] T 073bb9d9d62f462db20229a4924564e1 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:49.119422  5886 raft_consensus.cc:3060] T 073bb9d9d62f462db20229a4924564e1 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:49.120666  5646 consensus_queue.cc:1048] T 58438f196e6d42cc8780742faa222dc8 P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:49.122531  5815 raft_consensus.cc:697] T 02dba91c167a418daee105670577c8aa P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Becoming Leader. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Running, Role: LEADER
I20260709 13:15:49.123595  5815 consensus_queue.cc:237] T 02dba91c167a418daee105670577c8aa P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:49.124656  5241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d465e757b14de1842d55d52271bceb" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
I20260709 13:15:49.106406  5317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1e233f50be40f78b9208537916e93c" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:49.129106  5517 consensus_queue.cc:260] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
W20260709 13:15:49.139369  5903 log.cc:927] Time spent T cb26053fad7244cd88a5182d9cfc2109 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Append to log took a long time: real 0.118s	user 0.002s	sys 0.000s
I20260709 13:15:49.147739  5515 tablet_bootstrap.cc:654] T 3e48fc9e60214121991b0bb473d174da P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:49.150207  5433 leader_election.cc:343] T 6a1e233f50be40f78b9208537916e93c P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:49.154399  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b17eb476da34f05b466923d9c48cc2d" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:49.164881  5320 raft_consensus.cc:2468] T 5b17eb476da34f05b466923d9c48cc2d P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 0.
I20260709 13:15:49.143132  5243 raft_consensus.cc:2468] T 02dba91c167a418daee105670577c8aa P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 1.
I20260709 13:15:49.173343  5209 leader_election.cc:304] T 5b17eb476da34f05b466923d9c48cc2d P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, 77789aa45dc5463c82b73504fef4b4e0; no voters: 
I20260709 13:15:49.176143  5832 raft_consensus.cc:2804] T 5b17eb476da34f05b466923d9c48cc2d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:49.176591  5832 raft_consensus.cc:493] T 5b17eb476da34f05b466923d9c48cc2d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:49.176901  5832 raft_consensus.cc:3060] T 5b17eb476da34f05b466923d9c48cc2d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:49.155978  5517 ts_tablet_manager.cc:1434] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.079s	user 0.010s	sys 0.000s
W20260709 13:15:49.158298  5360 leader_election.cc:343] T 39d465e757b14de1842d55d52271bceb P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:49.162719  5464 raft_consensus.cc:2468] T 39d465e757b14de1842d55d52271bceb P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 1.
I20260709 13:15:49.185071  5517 tablet_bootstrap.cc:492] T 58438f196e6d42cc8780742faa222dc8 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:49.218654  5210 leader_election.cc:304] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:49.217134  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b17eb476da34f05b466923d9c48cc2d" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:49.226320  5591 raft_consensus.cc:2804] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:49.245165  5591 raft_consensus.cc:493] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2f45532f94a34efcb68a82db3dd69372)
I20260709 13:15:49.245321  5244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1e233f50be40f78b9208537916e93c" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:49.245699  5591 raft_consensus.cc:3060] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:49.259943  5517 tablet_bootstrap.cc:654] T 58438f196e6d42cc8780742faa222dc8 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:49.252856  5358 leader_election.cc:304] T 39d465e757b14de1842d55d52271bceb P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:49.264624  5895 raft_consensus.cc:2804] T 39d465e757b14de1842d55d52271bceb P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:49.265169  5895 raft_consensus.cc:697] T 39d465e757b14de1842d55d52271bceb P c4b52f14f9154b5a86f76fe58e4c235e [term 1 LEADER]: Becoming Leader. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Running, Role: LEADER
I20260709 13:15:49.266072  5895 consensus_queue.cc:237] T 39d465e757b14de1842d55d52271bceb P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:49.271180  5591 raft_consensus.cc:515] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:49.294739  5591 leader_election.cc:290] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 election: Requested vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:49.343658  5683 raft_consensus.cc:493] T c6bbe6dd572c4ea4aaf323c36eb05467 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.344547  5683 raft_consensus.cc:515] T c6bbe6dd572c4ea4aaf323c36eb05467 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:49.347297  5463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073bb9d9d62f462db20229a4924564e1" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:49.347399  5683 leader_election.cc:290] T c6bbe6dd572c4ea4aaf323c36eb05467 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:49.348228  5463 raft_consensus.cc:2468] T 073bb9d9d62f462db20229a4924564e1 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 0.
W20260709 13:15:49.355136  5434 leader_election.cc:343] T 6a1e233f50be40f78b9208537916e93c P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:49.355814  5434 leader_election.cc:304] T 6a1e233f50be40f78b9208537916e93c P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0; no voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:49.360527  5392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654fdf03209d4a3cbf17055c56ae2c9d" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:15:49.361627  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b17eb476da34f05b466923d9c48cc2d" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:49.362308  5469 raft_consensus.cc:2468] T 5b17eb476da34f05b466923d9c48cc2d P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 0.
I20260709 13:15:49.358062  5865 raft_consensus.cc:2749] T 6a1e233f50be40f78b9208537916e93c P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:49.363555  5516 tablet_bootstrap.cc:492] T 29ec9fd2ee334861a956e4d70d348b6d P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:49.364102  5516 ts_tablet_manager.cc:1403] T 29ec9fd2ee334861a956e4d70d348b6d P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.481s	user 0.035s	sys 0.066s
I20260709 13:15:49.366143  5883 raft_consensus.cc:493] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.366683  5883 raft_consensus.cc:515] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:49.368140  5392 raft_consensus.cc:2393] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in current term 2: Already voted for candidate c4b52f14f9154b5a86f76fe58e4c235e in this term.
I20260709 13:15:49.370868  5883 leader_election.cc:290] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:49.237679  5886 raft_consensus.cc:515] T 073bb9d9d62f462db20229a4924564e1 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:49.371861  5242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbe6dd572c4ea4aaf323c36eb05467" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:49.374009  5515 tablet_bootstrap.cc:492] T 3e48fc9e60214121991b0bb473d174da P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
I20260709 13:15:49.374666  5515 ts_tablet_manager.cc:1403] T 3e48fc9e60214121991b0bb473d174da P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.417s	user 0.021s	sys 0.006s
W20260709 13:15:49.377326  5210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:43623, user_credentials={real_user=slave}} blocked reactor thread for 143964us
I20260709 13:15:49.387729  5516 raft_consensus.cc:359] T 29ec9fd2ee334861a956e4d70d348b6d P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:49.388890  5516 raft_consensus.cc:385] T 29ec9fd2ee334861a956e4d70d348b6d P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:49.389256  5516 raft_consensus.cc:740] T 29ec9fd2ee334861a956e4d70d348b6d P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
W20260709 13:15:49.394291  5434 leader_election.cc:343] T c6bbe6dd572c4ea4aaf323c36eb05467 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:49.317555  5832 raft_consensus.cc:515] T 5b17eb476da34f05b466923d9c48cc2d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:49.405791  5516 consensus_queue.cc:260] T 29ec9fd2ee334861a956e4d70d348b6d P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:49.407771  5886 leader_election.cc:290] T 073bb9d9d62f462db20229a4924564e1 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Requested vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:49.410122  5515 raft_consensus.cc:359] T 3e48fc9e60214121991b0bb473d174da P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:49.410925  5515 raft_consensus.cc:385] T 3e48fc9e60214121991b0bb473d174da P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:49.411176  5515 raft_consensus.cc:740] T 3e48fc9e60214121991b0bb473d174da P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:49.411846  5243 raft_consensus.cc:2393] T 5b17eb476da34f05b466923d9c48cc2d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f45532f94a34efcb68a82db3dd69372 in current term 1: Already voted for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in this term.
I20260709 13:15:49.418114  5515 consensus_queue.cc:260] T 3e48fc9e60214121991b0bb473d174da P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:49.433044  5515 ts_tablet_manager.cc:1434] T 3e48fc9e60214121991b0bb473d174da P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.002s
I20260709 13:15:49.438087  5516 ts_tablet_manager.cc:1434] T 29ec9fd2ee334861a956e4d70d348b6d P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.074s	user 0.009s	sys 0.001s
I20260709 13:15:49.440316  5516 tablet_bootstrap.cc:492] T c6bbe6dd572c4ea4aaf323c36eb05467 P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
I20260709 13:15:49.431838  5391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073bb9d9d62f462db20229a4924564e1" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:15:49.444742  5517 tablet_bootstrap.cc:492] T 58438f196e6d42cc8780742faa222dc8 P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:49.445267  5517 ts_tablet_manager.cc:1403] T 58438f196e6d42cc8780742faa222dc8 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.261s	user 0.019s	sys 0.013s
I20260709 13:15:49.450162  5832 leader_election.cc:290] T 5b17eb476da34f05b466923d9c48cc2d P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 election: Requested vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:49.450424  5514 tablet_bootstrap.cc:492] T 3b01a00074004ddb87b1710a6555353b P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:49.450964  5514 ts_tablet_manager.cc:1403] T 3b01a00074004ddb87b1710a6555353b P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.550s	user 0.034s	sys 0.036s
I20260709 13:15:49.434458  5284 leader_election.cc:304] T 5b17eb476da34f05b466923d9c48cc2d P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0; no voters: 
I20260709 13:15:49.453400  5314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbe6dd572c4ea4aaf323c36eb05467" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:49.454761  5514 raft_consensus.cc:359] T 3b01a00074004ddb87b1710a6555353b P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:49.455410  5391 raft_consensus.cc:3060] T 073bb9d9d62f462db20229a4924564e1 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:49.455610  5514 raft_consensus.cc:385] T 3b01a00074004ddb87b1710a6555353b P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:49.456009  5514 raft_consensus.cc:740] T 3b01a00074004ddb87b1710a6555353b P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:49.456871  5514 consensus_queue.cc:260] T 3b01a00074004ddb87b1710a6555353b P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:49.458791  5514 ts_tablet_manager.cc:1434] T 3b01a00074004ddb87b1710a6555353b P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:15:49.453612  5882 raft_consensus.cc:2804] T 5b17eb476da34f05b466923d9c48cc2d P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:49.459868  5319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654fdf03209d4a3cbf17055c56ae2c9d" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:49.460649  5319 raft_consensus.cc:2468] T 654fdf03209d4a3cbf17055c56ae2c9d P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 2.
I20260709 13:15:49.459867  5514 tablet_bootstrap.cc:492] T 104c92d196fa45818108b633cbfaea4b P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
I20260709 13:15:49.462457  5517 raft_consensus.cc:359] T 58438f196e6d42cc8780742faa222dc8 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:49.463181  5517 raft_consensus.cc:385] T 58438f196e6d42cc8780742faa222dc8 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:49.459436  5882 raft_consensus.cc:493] T 5b17eb476da34f05b466923d9c48cc2d P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:49.463888  5882 raft_consensus.cc:3060] T 5b17eb476da34f05b466923d9c48cc2d P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:49.470178  5514 tablet_bootstrap.cc:654] T 104c92d196fa45818108b633cbfaea4b P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:49.471132  5464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "073bb9d9d62f462db20229a4924564e1" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:15:49.471807  5464 raft_consensus.cc:3060] T 073bb9d9d62f462db20229a4924564e1 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:49.480085  5317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654fdf03209d4a3cbf17055c56ae2c9d" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:15:49.480441  5359 leader_election.cc:304] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:49.481940  5646 raft_consensus.cc:2804] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:49.482324  5646 raft_consensus.cc:493] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:49.482650  5646 raft_consensus.cc:3060] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:49.463433  5517 raft_consensus.cc:740] T 58438f196e6d42cc8780742faa222dc8 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:49.485718  5517 consensus_queue.cc:260] T 58438f196e6d42cc8780742faa222dc8 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:49.490907  5140 catalog_manager.cc:5697] T 02dba91c167a418daee105670577c8aa P 2f45532f94a34efcb68a82db3dd69372 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130). New cstate: current_term: 1 leader_uuid: "2f45532f94a34efcb68a82db3dd69372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:49.496344  5515 tablet_bootstrap.cc:492] T b1ab7b32db51471796738b38f71b64df P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
I20260709 13:15:49.498021  5517 ts_tablet_manager.cc:1434] T 58438f196e6d42cc8780742faa222dc8 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.002s
I20260709 13:15:49.499236  5517 tablet_bootstrap.cc:492] T 39d465e757b14de1842d55d52271bceb P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:49.507555  5143 catalog_manager.cc:5697] T 39d465e757b14de1842d55d52271bceb P c4b52f14f9154b5a86f76fe58e4c235e reported cstate change: term changed from 0 to 1, leader changed from <none> to c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131). New cstate: current_term: 1 leader_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:49.519790  5891 raft_consensus.cc:493] T 3e48fc9e60214121991b0bb473d174da P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.520443  5891 raft_consensus.cc:515] T 3e48fc9e60214121991b0bb473d174da P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:49.527874  5315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b17eb476da34f05b466923d9c48cc2d" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:15:49.528524  5466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e48fc9e60214121991b0bb473d174da" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:49.529309  5466 raft_consensus.cc:2468] T 3e48fc9e60214121991b0bb473d174da P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 0.
I20260709 13:15:49.532485  5358 leader_election.cc:304] T 3e48fc9e60214121991b0bb473d174da P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:49.533484  5515 tablet_bootstrap.cc:654] T b1ab7b32db51471796738b38f71b64df P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:49.534013  5895 raft_consensus.cc:2804] T 3e48fc9e60214121991b0bb473d174da P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:49.534448  5895 raft_consensus.cc:493] T 3e48fc9e60214121991b0bb473d174da P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:49.534806  5895 raft_consensus.cc:3060] T 3e48fc9e60214121991b0bb473d174da P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:49.513157  5317 raft_consensus.cc:2468] T 654fdf03209d4a3cbf17055c56ae2c9d P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 2.
I20260709 13:15:49.544936  5516 tablet_bootstrap.cc:654] T c6bbe6dd572c4ea4aaf323c36eb05467 P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:49.547221  5210 leader_election.cc:304] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:49.536501  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654fdf03209d4a3cbf17055c56ae2c9d" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:49.536237  5319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e48fc9e60214121991b0bb473d174da" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:49.536154  5242 raft_consensus.cc:3060] T 58438f196e6d42cc8780742faa222dc8 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:49.555663  5646 raft_consensus.cc:515] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:49.550909  5824 raft_consensus.cc:2804] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:49.539249  5882 raft_consensus.cc:515] T 5b17eb476da34f05b466923d9c48cc2d P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:49.559887  5315 raft_consensus.cc:2393] T 5b17eb476da34f05b466923d9c48cc2d P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in current term 1: Already voted for candidate 2f45532f94a34efcb68a82db3dd69372 in this term.
I20260709 13:15:49.559222  5824 raft_consensus.cc:697] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 LEADER]: Becoming Leader. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Running, Role: LEADER
I20260709 13:15:49.561025  5824 consensus_queue.cc:237] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:49.569525  5517 tablet_bootstrap.cc:654] T 39d465e757b14de1842d55d52271bceb P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:49.549746  5891 leader_election.cc:290] T 3e48fc9e60214121991b0bb473d174da P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:49.542936  5464 raft_consensus.cc:2468] T 073bb9d9d62f462db20229a4924564e1 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 1.
W20260709 13:15:49.557817  5433 leader_election.cc:343] T c6bbe6dd572c4ea4aaf323c36eb05467 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:49.576649  5433 leader_election.cc:304] T c6bbe6dd572c4ea4aaf323c36eb05467 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0; no voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba
W20260709 13:15:49.558681  5359 leader_election.cc:343] T 3e48fc9e60214121991b0bb473d174da P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:49.538082  5391 raft_consensus.cc:2468] T 073bb9d9d62f462db20229a4924564e1 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 1.
I20260709 13:15:49.585458  5882 leader_election.cc:290] T 5b17eb476da34f05b466923d9c48cc2d P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Requested vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:49.588950  5244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b17eb476da34f05b466923d9c48cc2d" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
I20260709 13:15:49.589947  5244 raft_consensus.cc:2393] T 5b17eb476da34f05b466923d9c48cc2d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2f45532f94a34efcb68a82db3dd69372 in current term 1: Already voted for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in this term.
I20260709 13:15:49.590839  5646 leader_election.cc:290] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 3 election: Requested vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:49.595947  5466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b17eb476da34f05b466923d9c48cc2d" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:15:49.581053  5839 raft_consensus.cc:2749] T c6bbe6dd572c4ea4aaf323c36eb05467 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:49.597374  5466 raft_consensus.cc:3060] T 5b17eb476da34f05b466923d9c48cc2d P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:49.602432  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b17eb476da34f05b466923d9c48cc2d" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:15:49.604595  5319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654fdf03209d4a3cbf17055c56ae2c9d" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:15:49.605365  5319 raft_consensus.cc:3060] T 654fdf03209d4a3cbf17055c56ae2c9d P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:49.615617  5286 leader_election.cc:304] T 073bb9d9d62f462db20229a4924564e1 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:49.623929  5514 tablet_bootstrap.cc:492] T 104c92d196fa45818108b633cbfaea4b P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:49.624619  5514 ts_tablet_manager.cc:1403] T 104c92d196fa45818108b633cbfaea4b P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.165s	user 0.023s	sys 0.003s
I20260709 13:15:49.632371  5515 tablet_bootstrap.cc:492] T b1ab7b32db51471796738b38f71b64df P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
I20260709 13:15:49.633167  5515 ts_tablet_manager.cc:1403] T b1ab7b32db51471796738b38f71b64df P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.143s	user 0.021s	sys 0.019s
I20260709 13:15:49.634099  5887 raft_consensus.cc:2804] T 073bb9d9d62f462db20229a4924564e1 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:49.634725  5887 raft_consensus.cc:697] T 073bb9d9d62f462db20229a4924564e1 P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Becoming Leader. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Running, Role: LEADER
I20260709 13:15:49.635699  5887 consensus_queue.cc:237] T 073bb9d9d62f462db20229a4924564e1 P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:49.636742  5515 raft_consensus.cc:359] T b1ab7b32db51471796738b38f71b64df P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:49.637708  5515 raft_consensus.cc:385] T b1ab7b32db51471796738b38f71b64df P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:49.637989  5515 raft_consensus.cc:740] T b1ab7b32db51471796738b38f71b64df P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:49.635612  5683 raft_consensus.cc:493] T 3b01a00074004ddb87b1710a6555353b P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.638757  5683 raft_consensus.cc:515] T 3b01a00074004ddb87b1710a6555353b P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:49.641494  5683 leader_election.cc:290] T 3b01a00074004ddb87b1710a6555353b P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:49.642534  5244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b01a00074004ddb87b1710a6555353b" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
W20260709 13:15:49.644702  5434 leader_election.cc:343] T 3b01a00074004ddb87b1710a6555353b P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:49.638720  5515 consensus_queue.cc:260] T b1ab7b32db51471796738b38f71b64df P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:49.648329  5515 ts_tablet_manager.cc:1434] T b1ab7b32db51471796738b38f71b64df P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:15:49.649415  5515 tablet_bootstrap.cc:492] T 73c339ffbbca40c78c31d33aa9bb9e38 P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
I20260709 13:15:49.654487  5319 raft_consensus.cc:2468] T 654fdf03209d4a3cbf17055c56ae2c9d P 2f45532f94a34efcb68a82db3dd69372 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 3.
I20260709 13:15:49.657406  5314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b01a00074004ddb87b1710a6555353b" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
W20260709 13:15:49.661250  5284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.132:41391, user_credentials={real_user=slave}} blocked reactor thread for 45007.4us
I20260709 13:15:49.662824  5515 tablet_bootstrap.cc:654] T 73c339ffbbca40c78c31d33aa9bb9e38 P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:49.663307  5359 leader_election.cc:304] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:49.665390  5646 raft_consensus.cc:2804] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:49.666026  5646 raft_consensus.cc:697] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e [term 3 LEADER]: Becoming Leader. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Running, Role: LEADER
I20260709 13:15:49.667232  5646 consensus_queue.cc:237] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
W20260709 13:15:49.673832  5209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:41391, user_credentials={real_user=slave}} blocked reactor thread for 48582.3us
I20260709 13:15:49.675665  5209 leader_election.cc:304] T 5b17eb476da34f05b466923d9c48cc2d P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0
W20260709 13:15:49.677205  5433 leader_election.cc:343] T 3b01a00074004ddb87b1710a6555353b P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:49.677866  5433 leader_election.cc:304] T 3b01a00074004ddb87b1710a6555353b P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0; no voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:49.689033  5909 raft_consensus.cc:2749] T 3b01a00074004ddb87b1710a6555353b P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:49.690187  5514 raft_consensus.cc:359] T 104c92d196fa45818108b633cbfaea4b P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:49.696377  5514 raft_consensus.cc:385] T 104c92d196fa45818108b633cbfaea4b P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:49.697203  5514 raft_consensus.cc:740] T 104c92d196fa45818108b633cbfaea4b P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:49.698005  5514 consensus_queue.cc:260] T 104c92d196fa45818108b633cbfaea4b P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:49.704962  5895 raft_consensus.cc:515] T 3e48fc9e60214121991b0bb473d174da P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:49.699836  5870 raft_consensus.cc:2749] T 5b17eb476da34f05b466923d9c48cc2d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:49.699443  5244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654fdf03209d4a3cbf17055c56ae2c9d" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
I20260709 13:15:49.720386  5514 ts_tablet_manager.cc:1434] T 104c92d196fa45818108b633cbfaea4b P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.095s	user 0.009s	sys 0.000s
I20260709 13:15:49.722010  5514 tablet_bootstrap.cc:492] T c520b1f4431848d1967291be272086c5 P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
I20260709 13:15:49.725960  5846 raft_consensus.cc:493] T 29ec9fd2ee334861a956e4d70d348b6d P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.717903  5815 consensus_queue.cc:1048] T 02dba91c167a418daee105670577c8aa P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:15:49.736728  5846 raft_consensus.cc:515] T 29ec9fd2ee334861a956e4d70d348b6d P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:49.743017  5846 leader_election.cc:290] T 29ec9fd2ee334861a956e4d70d348b6d P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:49.744589  5918 raft_consensus.cc:493] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.746995  5395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ec9fd2ee334861a956e4d70d348b6d" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:49.747879  5395 raft_consensus.cc:2468] T 29ec9fd2ee334861a956e4d70d348b6d P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 0.
I20260709 13:15:49.747951  5918 raft_consensus.cc:515] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:49.749821  5286 leader_election.cc:304] T 29ec9fd2ee334861a956e4d70d348b6d P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:49.750372  5918 leader_election.cc:290] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:49.751189  5815 raft_consensus.cc:2804] T 29ec9fd2ee334861a956e4d70d348b6d P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:49.751645  5815 raft_consensus.cc:493] T 29ec9fd2ee334861a956e4d70d348b6d P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:49.751981  5815 raft_consensus.cc:3060] T 29ec9fd2ee334861a956e4d70d348b6d P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:49.752404  5395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ec9fd2ee334861a956e4d70d348b6d" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:49.753145  5395 raft_consensus.cc:2468] T 29ec9fd2ee334861a956e4d70d348b6d P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 0.
I20260709 13:15:49.753865  5517 tablet_bootstrap.cc:492] T 39d465e757b14de1842d55d52271bceb P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:49.754377  5517 ts_tablet_manager.cc:1403] T 39d465e757b14de1842d55d52271bceb P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.255s	user 0.023s	sys 0.014s
I20260709 13:15:49.754436  5211 leader_election.cc:304] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:49.756698  5832 raft_consensus.cc:2804] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:49.757086  5832 raft_consensus.cc:493] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:49.757427  5832 raft_consensus.cc:3060] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:49.770352  5464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e48fc9e60214121991b0bb473d174da" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:15:49.771270  5464 raft_consensus.cc:3060] T 3e48fc9e60214121991b0bb473d174da P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:49.775890  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ec9fd2ee334861a956e4d70d348b6d" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:49.777679  5514 tablet_bootstrap.cc:654] T c520b1f4431848d1967291be272086c5 P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:49.778155  5910 consensus_queue.cc:1048] T 02dba91c167a418daee105670577c8aa P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:49.780347  5319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e48fc9e60214121991b0bb473d174da" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:15:49.784386  5314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ec9fd2ee334861a956e4d70d348b6d" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
W20260709 13:15:49.788139  5359 leader_election.cc:343] T 3e48fc9e60214121991b0bb473d174da P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:49.788960  5517 raft_consensus.cc:359] T 39d465e757b14de1842d55d52271bceb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:49.789767  5517 raft_consensus.cc:385] T 39d465e757b14de1842d55d52271bceb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:49.790164  5517 raft_consensus.cc:740] T 39d465e757b14de1842d55d52271bceb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:49.795854  5516 tablet_bootstrap.cc:492] T c6bbe6dd572c4ea4aaf323c36eb05467 P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:49.796586  5516 ts_tablet_manager.cc:1403] T c6bbe6dd572c4ea4aaf323c36eb05467 P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.358s	user 0.034s	sys 0.016s
I20260709 13:15:49.791177  5517 consensus_queue.cc:260] T 39d465e757b14de1842d55d52271bceb P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
W20260709 13:15:49.797228  5930 log.cc:927] Time spent T 073bb9d9d62f462db20229a4924564e1 P 2f45532f94a34efcb68a82db3dd69372: Append to log took a long time: real 0.067s	user 0.000s	sys 0.003s
W20260709 13:15:49.797200  5360 consensus_peers.cc:597] T 39d465e757b14de1842d55d52271bceb P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:49.809677  5516 raft_consensus.cc:359] T c6bbe6dd572c4ea4aaf323c36eb05467 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:49.810715  5516 raft_consensus.cc:385] T c6bbe6dd572c4ea4aaf323c36eb05467 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:49.811035  5516 raft_consensus.cc:740] T c6bbe6dd572c4ea4aaf323c36eb05467 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:49.811800  5516 consensus_queue.cc:260] T c6bbe6dd572c4ea4aaf323c36eb05467 P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:49.812650  5815 raft_consensus.cc:515] T 29ec9fd2ee334861a956e4d70d348b6d P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:49.814196  5314 raft_consensus.cc:2393] T 29ec9fd2ee334861a956e4d70d348b6d P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in current term 1: Already voted for candidate 2f45532f94a34efcb68a82db3dd69372 in this term.
I20260709 13:15:49.782311  5895 leader_election.cc:290] T 3e48fc9e60214121991b0bb473d174da P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 election: Requested vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:49.797488  5466 raft_consensus.cc:2468] T 5b17eb476da34f05b466923d9c48cc2d P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 1.
I20260709 13:15:49.816507  5284 leader_election.cc:304] T 5b17eb476da34f05b466923d9c48cc2d P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:49.817914  5910 raft_consensus.cc:2804] T 5b17eb476da34f05b466923d9c48cc2d P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:49.818482  5910 raft_consensus.cc:697] T 5b17eb476da34f05b466923d9c48cc2d P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Becoming Leader. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Running, Role: LEADER
I20260709 13:15:49.819422  5910 consensus_queue.cc:237] T 5b17eb476da34f05b466923d9c48cc2d P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:49.820147  5241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ec9fd2ee334861a956e4d70d348b6d" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
I20260709 13:15:49.836247  5517 ts_tablet_manager.cc:1434] T 39d465e757b14de1842d55d52271bceb P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.082s	user 0.008s	sys 0.003s
I20260709 13:15:49.844187  5516 ts_tablet_manager.cc:1434] T c6bbe6dd572c4ea4aaf323c36eb05467 P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.047s	user 0.009s	sys 0.000s
I20260709 13:15:49.847570  5517 tablet_bootstrap.cc:492] T c6bbe6dd572c4ea4aaf323c36eb05467 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:49.848588  5516 tablet_bootstrap.cc:492] T 6a1e233f50be40f78b9208537916e93c P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
I20260709 13:15:49.852628  5515 tablet_bootstrap.cc:492] T 73c339ffbbca40c78c31d33aa9bb9e38 P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
I20260709 13:15:49.853367  5515 ts_tablet_manager.cc:1403] T 73c339ffbbca40c78c31d33aa9bb9e38 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.204s	user 0.009s	sys 0.012s
I20260709 13:15:49.822907  5464 raft_consensus.cc:2468] T 3e48fc9e60214121991b0bb473d174da P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 1.
I20260709 13:15:49.868181  5815 leader_election.cc:290] T 29ec9fd2ee334861a956e4d70d348b6d P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Requested vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:49.878209  5358 leader_election.cc:304] T 3e48fc9e60214121991b0bb473d174da P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 2f45532f94a34efcb68a82db3dd69372
I20260709 13:15:49.879150  5646 raft_consensus.cc:2804] T 3e48fc9e60214121991b0bb473d174da P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:15:49.879920  5192 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:49.880528  5832 raft_consensus.cc:515] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:49.873624  5391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ec9fd2ee334861a956e4d70d348b6d" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:15:49.881788  5391 raft_consensus.cc:3060] T 29ec9fd2ee334861a956e4d70d348b6d P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:49.883862  5243 raft_consensus.cc:2393] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f45532f94a34efcb68a82db3dd69372 in current term 1: Already voted for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in this term.
I20260709 13:15:49.885797  5646 raft_consensus.cc:697] T 3e48fc9e60214121991b0bb473d174da P c4b52f14f9154b5a86f76fe58e4c235e [term 1 LEADER]: Becoming Leader. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Running, Role: LEADER
I20260709 13:15:49.886897  5646 consensus_queue.cc:237] T 3e48fc9e60214121991b0bb473d174da P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:49.888298  5314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ec9fd2ee334861a956e4d70d348b6d" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:15:49.889184  5314 raft_consensus.cc:2393] T 29ec9fd2ee334861a956e4d70d348b6d P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in current term 1: Already voted for candidate 2f45532f94a34efcb68a82db3dd69372 in this term.
I20260709 13:15:49.890650  5788 consensus_queue.cc:1048] T 39d465e757b14de1842d55d52271bceb P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:49.895409  5395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ec9fd2ee334861a956e4d70d348b6d" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:15:49.895744  5832 leader_election.cc:290] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 election: Requested vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:49.899812  5210 leader_election.cc:304] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:49.898782  5515 raft_consensus.cc:359] T 73c339ffbbca40c78c31d33aa9bb9e38 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:49.901716  5515 raft_consensus.cc:385] T 73c339ffbbca40c78c31d33aa9bb9e38 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:49.902019  5515 raft_consensus.cc:740] T 73c339ffbbca40c78c31d33aa9bb9e38 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:49.908505  5517 tablet_bootstrap.cc:654] T c6bbe6dd572c4ea4aaf323c36eb05467 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:49.909966  5515 consensus_queue.cc:260] T 73c339ffbbca40c78c31d33aa9bb9e38 P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:49.903755  5719 raft_consensus.cc:2749] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:49.917742  5515 ts_tablet_manager.cc:1434] T 73c339ffbbca40c78c31d33aa9bb9e38 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.064s	user 0.004s	sys 0.004s
I20260709 13:15:49.926384  5515 tablet_bootstrap.cc:492] T f3f19e79faea4bdbae72383e79104b37 P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
I20260709 13:15:49.928372  5391 raft_consensus.cc:2468] T 29ec9fd2ee334861a956e4d70d348b6d P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 1.
I20260709 13:15:49.936092  5515 tablet_bootstrap.cc:654] T f3f19e79faea4bdbae72383e79104b37 P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:49.937216  5516 tablet_bootstrap.cc:654] T 6a1e233f50be40f78b9208537916e93c P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:49.939014  5286 leader_election.cc:304] T 29ec9fd2ee334861a956e4d70d348b6d P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:49.949467  5846 raft_consensus.cc:2804] T 29ec9fd2ee334861a956e4d70d348b6d P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:49.952977  5846 raft_consensus.cc:697] T 29ec9fd2ee334861a956e4d70d348b6d P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Becoming Leader. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Running, Role: LEADER
I20260709 13:15:49.954440  5846 consensus_queue.cc:237] T 29ec9fd2ee334861a956e4d70d348b6d P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:49.980716  5514 tablet_bootstrap.cc:492] T c520b1f4431848d1967291be272086c5 P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:49.981664  5514 ts_tablet_manager.cc:1403] T c520b1f4431848d1967291be272086c5 P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.260s	user 0.024s	sys 0.035s
I20260709 13:15:49.983388  5517 tablet_bootstrap.cc:492] T c6bbe6dd572c4ea4aaf323c36eb05467 P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:49.983979  5517 ts_tablet_manager.cc:1403] T c6bbe6dd572c4ea4aaf323c36eb05467 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.146s	user 0.024s	sys 0.013s
I20260709 13:15:49.989445  5517 raft_consensus.cc:359] T c6bbe6dd572c4ea4aaf323c36eb05467 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:49.990312  5517 raft_consensus.cc:385] T c6bbe6dd572c4ea4aaf323c36eb05467 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:49.990850  5517 raft_consensus.cc:740] T c6bbe6dd572c4ea4aaf323c36eb05467 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:49.992065  5517 consensus_queue.cc:260] T c6bbe6dd572c4ea4aaf323c36eb05467 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:49.999724  5319 raft_consensus.cc:1240] T 654fdf03209d4a3cbf17055c56ae2c9d P 2f45532f94a34efcb68a82db3dd69372 [term 3 FOLLOWER]: Rejecting Update request from peer 538ff4bfbd0c4f04bcd800c4ee4845ba for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:50.010083  5719 consensus_queue.cc:1059] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:50.011080  5719 raft_consensus.cc:3055] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:50.011444  5719 raft_consensus.cc:740] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Running, Role: LEADER
I20260709 13:15:50.012337  5719 consensus_queue.cc:260] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:50.015952  5517 ts_tablet_manager.cc:1434] T c6bbe6dd572c4ea4aaf323c36eb05467 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 13:15:50.017565  5517 tablet_bootstrap.cc:492] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:50.014942  5883 raft_consensus.cc:493] T b1ab7b32db51471796738b38f71b64df P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.021061  5719 raft_consensus.cc:3060] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:50.024827  5883 raft_consensus.cc:515] T b1ab7b32db51471796738b38f71b64df P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
W20260709 13:15:50.031466  5941 log.cc:927] Time spent T 39d465e757b14de1842d55d52271bceb P 77789aa45dc5463c82b73504fef4b4e0: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:15:50.032606  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ab7b32db51471796738b38f71b64df" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:50.034576  5883 leader_election.cc:290] T b1ab7b32db51471796738b38f71b64df P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:50.039041  5319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ab7b32db51471796738b38f71b64df" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
W20260709 13:15:50.040693  5360 leader_election.cc:343] T b1ab7b32db51471796738b38f71b64df P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:50.043675  5359 leader_election.cc:343] T b1ab7b32db51471796738b38f71b64df P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:50.044152  5359 leader_election.cc:304] T b1ab7b32db51471796738b38f71b64df P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b52f14f9154b5a86f76fe58e4c235e; no voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:50.045058  5895 raft_consensus.cc:2749] T b1ab7b32db51471796738b38f71b64df P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:50.057888  5514 raft_consensus.cc:359] T c520b1f4431848d1967291be272086c5 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:50.058964  5514 raft_consensus.cc:385] T c520b1f4431848d1967291be272086c5 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:50.059473  5514 raft_consensus.cc:740] T c520b1f4431848d1967291be272086c5 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:50.062531  5887 raft_consensus.cc:493] T c6bbe6dd572c4ea4aaf323c36eb05467 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.070163  5887 raft_consensus.cc:515] T c6bbe6dd572c4ea4aaf323c36eb05467 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:50.070973  5514 consensus_queue.cc:260] T c520b1f4431848d1967291be272086c5 P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:50.063194  5895 raft_consensus.cc:493] T 73c339ffbbca40c78c31d33aa9bb9e38 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.073143  5515 tablet_bootstrap.cc:492] T f3f19e79faea4bdbae72383e79104b37 P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
I20260709 13:15:50.073050  5895 raft_consensus.cc:515] T 73c339ffbbca40c78c31d33aa9bb9e38 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:50.073585  5514 ts_tablet_manager.cc:1434] T c520b1f4431848d1967291be272086c5 P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.092s	user 0.007s	sys 0.000s
I20260709 13:15:50.074697  5514 tablet_bootstrap.cc:492] T 9c7fcfa184e1425c86c784dd9db4423e P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
I20260709 13:15:50.079341  5242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbe6dd572c4ea4aaf323c36eb05467" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:50.079531  5466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c339ffbbca40c78c31d33aa9bb9e38" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:50.080160  5242 raft_consensus.cc:2468] T c6bbe6dd572c4ea4aaf323c36eb05467 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 0.
I20260709 13:15:50.080236  5466 raft_consensus.cc:2468] T 73c339ffbbca40c78c31d33aa9bb9e38 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 0.
I20260709 13:15:50.081624  5517 tablet_bootstrap.cc:654] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:50.063707  5516 tablet_bootstrap.cc:492] T 6a1e233f50be40f78b9208537916e93c P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:50.081859  5358 leader_election.cc:304] T 73c339ffbbca40c78c31d33aa9bb9e38 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:50.082396  5516 ts_tablet_manager.cc:1403] T 6a1e233f50be40f78b9208537916e93c P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.234s	user 0.021s	sys 0.007s
I20260709 13:15:50.083204  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c339ffbbca40c78c31d33aa9bb9e38" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:50.086311  5464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbe6dd572c4ea4aaf323c36eb05467" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:50.073707  5515 ts_tablet_manager.cc:1403] T f3f19e79faea4bdbae72383e79104b37 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.148s	user 0.019s	sys 0.019s
I20260709 13:15:50.087088  5464 raft_consensus.cc:2468] T c6bbe6dd572c4ea4aaf323c36eb05467 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 0.
I20260709 13:15:50.087363  5891 raft_consensus.cc:2804] T 73c339ffbbca40c78c31d33aa9bb9e38 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:50.087253  5514 tablet_bootstrap.cc:654] T 9c7fcfa184e1425c86c784dd9db4423e P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:50.086912  5360 leader_election.cc:343] T 73c339ffbbca40c78c31d33aa9bb9e38 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:50.075321  5895 leader_election.cc:290] T 73c339ffbbca40c78c31d33aa9bb9e38 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:50.092705  5887 leader_election.cc:290] T c6bbe6dd572c4ea4aaf323c36eb05467 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:50.089299  5284 leader_election.cc:304] T c6bbe6dd572c4ea4aaf323c36eb05467 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0; no voters: 
I20260709 13:15:50.095067  5515 raft_consensus.cc:359] T f3f19e79faea4bdbae72383e79104b37 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:50.089207  5891 raft_consensus.cc:493] T 73c339ffbbca40c78c31d33aa9bb9e38 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.095937  5515 raft_consensus.cc:385] T f3f19e79faea4bdbae72383e79104b37 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:50.096036  5891 raft_consensus.cc:3060] T 73c339ffbbca40c78c31d33aa9bb9e38 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:50.096256  5515 raft_consensus.cc:740] T f3f19e79faea4bdbae72383e79104b37 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:50.097252  5515 consensus_queue.cc:260] T f3f19e79faea4bdbae72383e79104b37 P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:50.099511  5515 ts_tablet_manager.cc:1434] T f3f19e79faea4bdbae72383e79104b37 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:15:50.100553  5515 tablet_bootstrap.cc:492] T 104c92d196fa45818108b633cbfaea4b P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
I20260709 13:15:50.103786  5516 raft_consensus.cc:359] T 6a1e233f50be40f78b9208537916e93c P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:50.104611  5516 raft_consensus.cc:385] T 6a1e233f50be40f78b9208537916e93c P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:50.104890  5516 raft_consensus.cc:740] T 6a1e233f50be40f78b9208537916e93c P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:50.105607  5516 consensus_queue.cc:260] T 6a1e233f50be40f78b9208537916e93c P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:50.108435  5515 tablet_bootstrap.cc:654] T 104c92d196fa45818108b633cbfaea4b P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:50.121507  5815 raft_consensus.cc:2804] T c6bbe6dd572c4ea4aaf323c36eb05467 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:50.122123  5815 raft_consensus.cc:493] T c6bbe6dd572c4ea4aaf323c36eb05467 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.122560  5815 raft_consensus.cc:3060] T c6bbe6dd572c4ea4aaf323c36eb05467 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:50.123298  5515 tablet_bootstrap.cc:492] T 104c92d196fa45818108b633cbfaea4b P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
I20260709 13:15:50.123984  5515 ts_tablet_manager.cc:1403] T 104c92d196fa45818108b633cbfaea4b P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.004s
I20260709 13:15:50.134960  5515 raft_consensus.cc:359] T 104c92d196fa45818108b633cbfaea4b P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:50.135766  5515 raft_consensus.cc:385] T 104c92d196fa45818108b633cbfaea4b P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:50.136070  5515 raft_consensus.cc:740] T 104c92d196fa45818108b633cbfaea4b P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:50.136869  5515 consensus_queue.cc:260] T 104c92d196fa45818108b633cbfaea4b P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:50.142077  5515 ts_tablet_manager.cc:1434] T 104c92d196fa45818108b633cbfaea4b P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 13:15:50.143326  5515 tablet_bootstrap.cc:492] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
I20260709 13:15:50.147941  5516 ts_tablet_manager.cc:1434] T 6a1e233f50be40f78b9208537916e93c P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.001s
I20260709 13:15:50.160960  5515 tablet_bootstrap.cc:654] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:50.174074  5516 tablet_bootstrap.cc:492] T 3e48fc9e60214121991b0bb473d174da P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
I20260709 13:15:50.176316  5515 tablet_bootstrap.cc:492] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
I20260709 13:15:50.180925  5683 raft_consensus.cc:493] T 104c92d196fa45818108b633cbfaea4b P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.181950  5515 ts_tablet_manager.cc:1403] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.009s
I20260709 13:15:50.177126  5891 raft_consensus.cc:515] T 73c339ffbbca40c78c31d33aa9bb9e38 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:50.194439  5846 consensus_queue.cc:1048] T 073bb9d9d62f462db20229a4924564e1 P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:50.181994  5683 raft_consensus.cc:515] T 104c92d196fa45818108b633cbfaea4b P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:50.206373  5788 raft_consensus.cc:493] T 104c92d196fa45818108b633cbfaea4b P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.206646  5846 raft_consensus.cc:493] T 6a1e233f50be40f78b9208537916e93c P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.209472  5916 raft_consensus.cc:493] T 39d465e757b14de1842d55d52271bceb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.217514  5916 raft_consensus.cc:515] T 39d465e757b14de1842d55d52271bceb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:50.218233  5140 catalog_manager.cc:5697] T 073bb9d9d62f462db20229a4924564e1 P 2f45532f94a34efcb68a82db3dd69372 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130). New cstate: current_term: 1 leader_uuid: "2f45532f94a34efcb68a82db3dd69372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:50.211630  5319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104c92d196fa45818108b633cbfaea4b" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
W20260709 13:15:50.272938  5433 leader_election.cc:343] T 104c92d196fa45818108b633cbfaea4b P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:50.217213  5788 raft_consensus.cc:515] T 104c92d196fa45818108b633cbfaea4b P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:50.225584  5314 raft_consensus.cc:1275] T 654fdf03209d4a3cbf17055c56ae2c9d P 2f45532f94a34efcb68a82db3dd69372 [term 3 FOLLOWER]: Refusing update from remote peer c4b52f14f9154b5a86f76fe58e4c235e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:50.279664  5646 consensus_queue.cc:1048] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:50.232246  5846 raft_consensus.cc:515] T 6a1e233f50be40f78b9208537916e93c P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:50.295397  5140 catalog_manager.cc:5697] T 29ec9fd2ee334861a956e4d70d348b6d P 2f45532f94a34efcb68a82db3dd69372 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130). New cstate: current_term: 1 leader_uuid: "2f45532f94a34efcb68a82db3dd69372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:50.301151  5466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1e233f50be40f78b9208537916e93c" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:50.305891  5395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104c92d196fa45818108b633cbfaea4b" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:50.308049  5395 raft_consensus.cc:2468] T 104c92d196fa45818108b633cbfaea4b P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 0.
I20260709 13:15:50.304163  5466 raft_consensus.cc:2468] T 6a1e233f50be40f78b9208537916e93c P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 0.
I20260709 13:15:50.310052  5788 leader_election.cc:290] T 104c92d196fa45818108b633cbfaea4b P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:50.310967  5284 leader_election.cc:304] T 6a1e233f50be40f78b9208537916e93c P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0; no voters: 
I20260709 13:15:50.312124  5887 raft_consensus.cc:2804] T 6a1e233f50be40f78b9208537916e93c P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:50.312536  5887 raft_consensus.cc:493] T 6a1e233f50be40f78b9208537916e93c P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.312867  5887 raft_consensus.cc:3060] T 6a1e233f50be40f78b9208537916e93c P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:50.315894  5244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c339ffbbca40c78c31d33aa9bb9e38" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
W20260709 13:15:50.317643  5360 leader_election.cc:343] T 73c339ffbbca40c78c31d33aa9bb9e38 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:50.319386  5517 tablet_bootstrap.cc:492] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:50.320009  5517 ts_tablet_manager.cc:1403] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.303s	user 0.036s	sys 0.041s
I20260709 13:15:50.297909  5140 catalog_manager.cc:5697] T 5b17eb476da34f05b466923d9c48cc2d P 2f45532f94a34efcb68a82db3dd69372 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130). New cstate: current_term: 1 leader_uuid: "2f45532f94a34efcb68a82db3dd69372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:50.191753  5515 raft_consensus.cc:359] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:50.306056  5242 raft_consensus.cc:1275] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 3 FOLLOWER]: Refusing update from remote peer c4b52f14f9154b5a86f76fe58e4c235e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:15:50.306970  5514 tablet_bootstrap.cc:492] T 9c7fcfa184e1425c86c784dd9db4423e P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:50.326709  5514 ts_tablet_manager.cc:1403] T 9c7fcfa184e1425c86c784dd9db4423e P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.252s	user 0.027s	sys 0.025s
W20260709 13:15:50.306885  5434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:40847, user_credentials={real_user=slave}} blocked reactor thread for 86685.8us
I20260709 13:15:50.325095  5515 raft_consensus.cc:385] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:50.328611  5515 raft_consensus.cc:740] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:50.210451  5683 leader_election.cc:290] T 104c92d196fa45818108b633cbfaea4b P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:50.261691  5891 leader_election.cc:290] T 73c339ffbbca40c78c31d33aa9bb9e38 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 election: Requested vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:50.326243  5242 pending_rounds.cc:85] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba: Aborting all ops after (but not including) 1
I20260709 13:15:50.332620  5515 consensus_queue.cc:260] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:50.344367  5515 ts_tablet_manager.cc:1434] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.162s	user 0.007s	sys 0.002s
I20260709 13:15:50.340891  5517 raft_consensus.cc:359] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:50.345613  5517 raft_consensus.cc:385] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:50.346248  5517 raft_consensus.cc:740] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:50.347939  5517 consensus_queue.cc:260] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:50.330044  5815 raft_consensus.cc:515] T c6bbe6dd572c4ea4aaf323c36eb05467 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:50.335825  5242 pending_rounds.cc:107] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:15:50.384044  5434 leader_election.cc:304] T 104c92d196fa45818108b633cbfaea4b P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 2f45532f94a34efcb68a82db3dd69372
I20260709 13:15:50.393112  5517 ts_tablet_manager.cc:1434] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.073s	user 0.009s	sys 0.018s
I20260709 13:15:50.394517  5515 tablet_bootstrap.cc:492] T 3d6bcda036934682b5075c20b786026d P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
I20260709 13:15:50.386474  5846 leader_election.cc:290] T 6a1e233f50be40f78b9208537916e93c P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:50.387733  5242 raft_consensus.cc:2889] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:50.388345  5683 raft_consensus.cc:493] T c520b1f4431848d1967291be272086c5 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.385363  5465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104c92d196fa45818108b633cbfaea4b" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:50.416416  5839 raft_consensus.cc:2804] T 104c92d196fa45818108b633cbfaea4b P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:50.421082  5839 raft_consensus.cc:493] T 104c92d196fa45818108b633cbfaea4b P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.421450  5839 raft_consensus.cc:3060] T 104c92d196fa45818108b633cbfaea4b P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:50.422503  5815 leader_election.cc:290] T c6bbe6dd572c4ea4aaf323c36eb05467 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Requested vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:50.409937  5887 raft_consensus.cc:515] T 6a1e233f50be40f78b9208537916e93c P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:50.407974  5314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104c92d196fa45818108b633cbfaea4b" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:50.427515  5887 leader_election.cc:290] T 6a1e233f50be40f78b9208537916e93c P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Requested vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:50.427589  5392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d465e757b14de1842d55d52271bceb" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:50.414677  5846 consensus_queue.cc:1048] T 073bb9d9d62f462db20229a4924564e1 P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:15:50.414196  5683 raft_consensus.cc:515] T c520b1f4431848d1967291be272086c5 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:50.434445  5514 raft_consensus.cc:359] T 9c7fcfa184e1425c86c784dd9db4423e P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:50.435901  5514 raft_consensus.cc:385] T 9c7fcfa184e1425c86c784dd9db4423e P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:50.436213  5514 raft_consensus.cc:740] T 9c7fcfa184e1425c86c784dd9db4423e P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:50.436021  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d465e757b14de1842d55d52271bceb" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:50.437115  5514 consensus_queue.cc:260] T 9c7fcfa184e1425c86c784dd9db4423e P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:50.416532  5916 leader_election.cc:290] T 39d465e757b14de1842d55d52271bceb P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
W20260709 13:15:50.403441  5284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:41391, user_credentials={real_user=slave}} blocked reactor thread for 63015.4us
I20260709 13:15:50.459522  5242 raft_consensus.cc:3060] T 39d465e757b14de1842d55d52271bceb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:50.469117  5516 tablet_bootstrap.cc:654] T 3e48fc9e60214121991b0bb473d174da P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:50.473214  5466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c339ffbbca40c78c31d33aa9bb9e38" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:15:50.473951  5466 raft_consensus.cc:3060] T 73c339ffbbca40c78c31d33aa9bb9e38 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:50.478319  5515 tablet_bootstrap.cc:654] T 3d6bcda036934682b5075c20b786026d P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:50.466739  5788 consensus_queue.cc:1048] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Connected to new peer: Peer: permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:15:50.503772  5839 raft_consensus.cc:515] T 104c92d196fa45818108b633cbfaea4b P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:50.543692  5514 ts_tablet_manager.cc:1434] T 9c7fcfa184e1425c86c784dd9db4423e P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.216s	user 0.008s	sys 0.009s
I20260709 13:15:50.544994  5514 tablet_bootstrap.cc:492] T 09e39d6f01a0444bb1aa42b5403943c8 P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
W20260709 13:15:50.550221  5359 leader_election.cc:343] T 104c92d196fa45818108b633cbfaea4b P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:50.549985  5434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:41357, user_credentials={real_user=slave}} blocked reactor thread for 100491us
I20260709 13:15:50.548034  5465 raft_consensus.cc:2393] T 104c92d196fa45818108b633cbfaea4b P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c4b52f14f9154b5a86f76fe58e4c235e in current term 1: Already voted for candidate 77789aa45dc5463c82b73504fef4b4e0 in this term.
I20260709 13:15:50.553946  5209 leader_election.cc:304] T 39d465e757b14de1842d55d52271bceb P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:50.554632  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbe6dd572c4ea4aaf323c36eb05467" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:15:50.556201  5469 raft_consensus.cc:3060] T c6bbe6dd572c4ea4aaf323c36eb05467 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:50.559108  5839 leader_election.cc:290] T 104c92d196fa45818108b633cbfaea4b P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 election: Requested vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:50.559953  5395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c520b1f4431848d1967291be272086c5" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
W20260709 13:15:50.585392  5434 leader_election.cc:343] T c520b1f4431848d1967291be272086c5 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:50.555945  5466 raft_consensus.cc:2468] T 73c339ffbbca40c78c31d33aa9bb9e38 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 1.
W20260709 13:15:50.591380  5210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:43623, user_credentials={real_user=slave}} blocked reactor thread for 209979us
I20260709 13:15:50.594869  5683 leader_election.cc:290] T c520b1f4431848d1967291be272086c5 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:50.597327  5515 tablet_bootstrap.cc:492] T 3d6bcda036934682b5075c20b786026d P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
I20260709 13:15:50.597922  5517 tablet_bootstrap.cc:492] T 73c339ffbbca40c78c31d33aa9bb9e38 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:50.598326  5395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104c92d196fa45818108b633cbfaea4b" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:15:50.599026  5395 raft_consensus.cc:3060] T 104c92d196fa45818108b633cbfaea4b P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:50.600489  5469 raft_consensus.cc:2468] T c6bbe6dd572c4ea4aaf323c36eb05467 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 1.
I20260709 13:15:50.604396  5891 raft_consensus.cc:493] T f3f19e79faea4bdbae72383e79104b37 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.604694  5358 leader_election.cc:304] T 73c339ffbbca40c78c31d33aa9bb9e38 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:50.605331  5891 raft_consensus.cc:515] T f3f19e79faea4bdbae72383e79104b37 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:50.597949  5515 ts_tablet_manager.cc:1403] T 3d6bcda036934682b5075c20b786026d P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.204s	user 0.017s	sys 0.009s
I20260709 13:15:50.608052  5646 raft_consensus.cc:2804] T 73c339ffbbca40c78c31d33aa9bb9e38 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:50.618381  5514 tablet_bootstrap.cc:654] T 09e39d6f01a0444bb1aa42b5403943c8 P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:50.621038  5891 leader_election.cc:290] T f3f19e79faea4bdbae72383e79104b37 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:50.624887  5315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104c92d196fa45818108b633cbfaea4b" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:15:50.635398  5395 raft_consensus.cc:2468] T 104c92d196fa45818108b633cbfaea4b P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 1.
I20260709 13:15:50.648458  5515 raft_consensus.cc:359] T 3d6bcda036934682b5075c20b786026d P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:50.649358  5515 raft_consensus.cc:385] T 3d6bcda036934682b5075c20b786026d P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:50.649642  5515 raft_consensus.cc:740] T 3d6bcda036934682b5075c20b786026d P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:50.650337  5515 consensus_queue.cc:260] T 3d6bcda036934682b5075c20b786026d P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:50.637668  5466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1e233f50be40f78b9208537916e93c" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:15:50.652879  5466 raft_consensus.cc:3060] T 6a1e233f50be40f78b9208537916e93c P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:50.663218  5517 tablet_bootstrap.cc:654] T 73c339ffbbca40c78c31d33aa9bb9e38 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:50.644745  5141 catalog_manager.cc:5697] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e reported cstate change: term changed from 1 to 3, leader changed from 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130) to c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131). New cstate: current_term: 3 leader_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:50.662235  5646 raft_consensus.cc:697] T 73c339ffbbca40c78c31d33aa9bb9e38 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 LEADER]: Becoming Leader. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Running, Role: LEADER
I20260709 13:15:50.668418  5141 catalog_manager.cc:5697] T 3e48fc9e60214121991b0bb473d174da P c4b52f14f9154b5a86f76fe58e4c235e reported cstate change: term changed from 0 to 1, leader changed from <none> to c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131). New cstate: current_term: 1 leader_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:50.639210  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1e233f50be40f78b9208537916e93c" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:50.675230  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1e233f50be40f78b9208537916e93c" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
W20260709 13:15:50.688892  5433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:43623, user_credentials={real_user=slave}} blocked reactor thread for 84925.5us
I20260709 13:15:50.671144  5646 consensus_queue.cc:237] T 73c339ffbbca40c78c31d33aa9bb9e38 P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:50.673692  5515 ts_tablet_manager.cc:1434] T 3d6bcda036934682b5075c20b786026d P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.065s	user 0.008s	sys 0.000s
I20260709 13:15:50.691202  5515 tablet_bootstrap.cc:492] T c520b1f4431848d1967291be272086c5 P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
I20260709 13:15:50.702814  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f19e79faea4bdbae72383e79104b37" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:50.722049  5516 tablet_bootstrap.cc:492] T 3e48fc9e60214121991b0bb473d174da P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:50.722853  5516 ts_tablet_manager.cc:1403] T 3e48fc9e60214121991b0bb473d174da P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.549s	user 0.019s	sys 0.010s
W20260709 13:15:50.725267  5433 leader_election.cc:343] T 104c92d196fa45818108b633cbfaea4b P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:50.721025  5358 leader_election.cc:304] T 104c92d196fa45818108b633cbfaea4b P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b52f14f9154b5a86f76fe58e4c235e; no voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0
I20260709 13:15:50.698149  5241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bbe6dd572c4ea4aaf323c36eb05467" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
W20260709 13:15:50.739677  5286 leader_election.cc:343] T 6a1e233f50be40f78b9208537916e93c P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:50.768996  5434 leader_election.cc:304] T 104c92d196fa45818108b633cbfaea4b P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 2f45532f94a34efcb68a82db3dd69372
I20260709 13:15:50.721015  5979 raft_consensus.cc:493] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:50.765769  5286 leader_election.cc:343] T 6a1e233f50be40f78b9208537916e93c P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:50.762682  5241 raft_consensus.cc:3060] T c6bbe6dd572c4ea4aaf323c36eb05467 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:50.778544  5980 raft_consensus.cc:2804] T 104c92d196fa45818108b633cbfaea4b P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:50.781034  5979 raft_consensus.cc:515] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:50.776981  5883 raft_consensus.cc:2749] T 104c92d196fa45818108b633cbfaea4b P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:50.788260  5514 tablet_bootstrap.cc:492] T 09e39d6f01a0444bb1aa42b5403943c8 P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:50.743896  5966 raft_consensus.cc:2749] T 39d465e757b14de1842d55d52271bceb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:50.801406  5514 ts_tablet_manager.cc:1403] T 09e39d6f01a0444bb1aa42b5403943c8 P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.257s	user 0.036s	sys 0.025s
W20260709 13:15:50.788502  5360 leader_election.cc:343] T f3f19e79faea4bdbae72383e79104b37 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:50.816819  5515 tablet_bootstrap.cc:654] T c520b1f4431848d1967291be272086c5 P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:50.817860  5466 raft_consensus.cc:2468] T 6a1e233f50be40f78b9208537916e93c P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 1.
I20260709 13:15:50.823901  5317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f19e79faea4bdbae72383e79104b37" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:50.802726  5963 raft_consensus.cc:493] T 9c7fcfa184e1425c86c784dd9db4423e P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.803956  5980 raft_consensus.cc:697] T 104c92d196fa45818108b633cbfaea4b P 77789aa45dc5463c82b73504fef4b4e0 [term 1 LEADER]: Becoming Leader. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Running, Role: LEADER
W20260709 13:15:50.847397  5360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:41357, user_credentials={real_user=slave}} blocked reactor thread for 58944.1us
I20260709 13:15:50.855432  5516 raft_consensus.cc:359] T 3e48fc9e60214121991b0bb473d174da P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:50.867594  5963 raft_consensus.cc:515] T 9c7fcfa184e1425c86c784dd9db4423e P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:50.868359  5516 raft_consensus.cc:385] T 3e48fc9e60214121991b0bb473d174da P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:50.868741  5516 raft_consensus.cc:740] T 3e48fc9e60214121991b0bb473d174da P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:50.856315  5980 consensus_queue.cc:237] T 104c92d196fa45818108b633cbfaea4b P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:50.870098  5963 leader_election.cc:290] T 9c7fcfa184e1425c86c784dd9db4423e P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:50.872642  5516 consensus_queue.cc:260] T 3e48fc9e60214121991b0bb473d174da P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:50.884948  5516 ts_tablet_manager.cc:1434] T 3e48fc9e60214121991b0bb473d174da P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.162s	user 0.007s	sys 0.003s
W20260709 13:15:50.887300  5209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:41391, user_credentials={real_user=slave}} blocked reactor thread for 112419us
I20260709 13:15:50.898237  5981 raft_consensus.cc:493] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.867138  5284 leader_election.cc:304] T c6bbe6dd572c4ea4aaf323c36eb05467 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0; no voters: 
W20260709 13:15:50.892185  5358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.132:41391, user_credentials={real_user=slave}} blocked reactor thread for 185378us
I20260709 13:15:50.925750  5241 raft_consensus.cc:2468] T c6bbe6dd572c4ea4aaf323c36eb05467 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 1.
I20260709 13:15:50.927395  5388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c7fcfa184e1425c86c784dd9db4423e" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:50.933037  5315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c7fcfa184e1425c86c784dd9db4423e" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:50.936687  5979 leader_election.cc:290] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:50.922354  5981 raft_consensus.cc:515] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:50.957065  5514 raft_consensus.cc:359] T 09e39d6f01a0444bb1aa42b5403943c8 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
W20260709 13:15:50.938951  5284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.132:41391, user_credentials={real_user=slave}} blocked reactor thread for 71929.4us
I20260709 13:15:50.951607  5975 raft_consensus.cc:2804] T c6bbe6dd572c4ea4aaf323c36eb05467 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:50.958168  5514 raft_consensus.cc:385] T 09e39d6f01a0444bb1aa42b5403943c8 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:50.959079  5514 raft_consensus.cc:740] T 09e39d6f01a0444bb1aa42b5403943c8 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:50.960145  5514 consensus_queue.cc:260] T 09e39d6f01a0444bb1aa42b5403943c8 P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:50.954833  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c520b1f4431848d1967291be272086c5" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
W20260709 13:15:50.960986  5210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:43623, user_credentials={real_user=slave}} blocked reactor thread for 61481.7us
W20260709 13:15:50.966822  5433 leader_election.cc:343] T 9c7fcfa184e1425c86c784dd9db4423e P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:50.968097  5514 ts_tablet_manager.cc:1434] T 09e39d6f01a0444bb1aa42b5403943c8 P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.161s	user 0.008s	sys 0.000s
I20260709 13:15:50.969566  5514 tablet_bootstrap.cc:492] T 3d6bcda036934682b5075c20b786026d P 77789aa45dc5463c82b73504fef4b4e0: Bootstrap starting.
W20260709 13:15:50.968046  5434 leader_election.cc:343] T 9c7fcfa184e1425c86c784dd9db4423e P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:50.970574  5434 leader_election.cc:304] T 9c7fcfa184e1425c86c784dd9db4423e P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0; no voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e
W20260709 13:15:50.975469  5209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:41391, user_credentials={real_user=slave}} blocked reactor thread for 68050.2us
I20260709 13:15:50.958199  5981 leader_election.cc:290] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:50.972245  5980 raft_consensus.cc:2749] T 9c7fcfa184e1425c86c784dd9db4423e P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:50.975142  5975 raft_consensus.cc:697] T c6bbe6dd572c4ea4aaf323c36eb05467 P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Becoming Leader. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Running, Role: LEADER
I20260709 13:15:50.987700  5959 consensus_queue.cc:1048] T 5b17eb476da34f05b466923d9c48cc2d P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:50.997682  5284 leader_election.cc:304] T 6a1e233f50be40f78b9208537916e93c P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:50.998805  5315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ab7b32db51471796738b38f71b64df" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:51.004297  5388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ab7b32db51471796738b38f71b64df" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:51.005640  5388 raft_consensus.cc:2468] T b1ab7b32db51471796738b38f71b64df P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 0.
W20260709 13:15:51.011073  5210 leader_election.cc:343] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:51.011554  5434 leader_election.cc:343] T c520b1f4431848d1967291be272086c5 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:51.012017  5434 leader_election.cc:304] T c520b1f4431848d1967291be272086c5 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:51.019749  5965 raft_consensus.cc:2804] T 6a1e233f50be40f78b9208537916e93c P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:51.010458  5979 consensus_queue.cc:1048] T 3e48fc9e60214121991b0bb473d174da P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:15:51.024195  5965 raft_consensus.cc:697] T 6a1e233f50be40f78b9208537916e93c P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Becoming Leader. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Running, Role: LEADER
I20260709 13:15:51.025280  5965 consensus_queue.cc:237] T 6a1e233f50be40f78b9208537916e93c P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:51.028816  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e101cf4ae084c74af284008876e474e" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:51.029285  5972 raft_consensus.cc:2749] T c520b1f4431848d1967291be272086c5 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:51.030737  5360 leader_election.cc:343] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:51.019676  5514 tablet_bootstrap.cc:654] T 3d6bcda036934682b5075c20b786026d P 77789aa45dc5463c82b73504fef4b4e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:51.036131  5517 tablet_bootstrap.cc:492] T 73c339ffbbca40c78c31d33aa9bb9e38 P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:51.036654  5517 ts_tablet_manager.cc:1403] T 73c339ffbbca40c78c31d33aa9bb9e38 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.439s	user 0.023s	sys 0.008s
I20260709 13:15:50.982676  5975 consensus_queue.cc:237] T c6bbe6dd572c4ea4aaf323c36eb05467 P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:51.046518  5516 tablet_bootstrap.cc:492] T b1ab7b32db51471796738b38f71b64df P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
I20260709 13:15:51.060829  5887 consensus_queue.cc:1048] T 29ec9fd2ee334861a956e4d70d348b6d P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:51.061187  5976 consensus_queue.cc:1048] T 5b17eb476da34f05b466923d9c48cc2d P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:15:51.073563  5359 leader_election.cc:343] T f3f19e79faea4bdbae72383e79104b37 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:51.074748  5359 leader_election.cc:304] T f3f19e79faea4bdbae72383e79104b37 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b52f14f9154b5a86f76fe58e4c235e; no voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:51.076848  5976 consensus_queue.cc:1048] T 29ec9fd2ee334861a956e4d70d348b6d P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:15:51.118247  5359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:43623, user_credentials={real_user=slave}} blocked reactor thread for 43967.3us
I20260709 13:15:51.118757  5516 tablet_bootstrap.cc:654] T b1ab7b32db51471796738b38f71b64df P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:51.121753  5359 consensus_peers.cc:597] T 3e48fc9e60214121991b0bb473d174da P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Couldn't send request to peer 2f45532f94a34efcb68a82db3dd69372. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:51.119838  5989 raft_consensus.cc:2749] T f3f19e79faea4bdbae72383e79104b37 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:51.121218  5883 raft_consensus.cc:493] T 3d6bcda036934682b5075c20b786026d P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.125839  5883 raft_consensus.cc:515] T 3d6bcda036934682b5075c20b786026d P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:51.126576  5865 raft_consensus.cc:493] T 09e39d6f01a0444bb1aa42b5403943c8 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.127266  5865 raft_consensus.cc:515] T 09e39d6f01a0444bb1aa42b5403943c8 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:51.145725  5317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e101cf4ae084c74af284008876e474e" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:51.169770  5865 leader_election.cc:290] T 09e39d6f01a0444bb1aa42b5403943c8 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:51.171907  5317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09e39d6f01a0444bb1aa42b5403943c8" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
W20260709 13:15:51.174986  5993 log.cc:927] Time spent T 73c339ffbbca40c78c31d33aa9bb9e38 P c4b52f14f9154b5a86f76fe58e4c235e: Append to log took a long time: real 0.180s	user 0.005s	sys 0.000s
I20260709 13:15:51.176221  5514 tablet_bootstrap.cc:492] T 3d6bcda036934682b5075c20b786026d P 77789aa45dc5463c82b73504fef4b4e0: No bootstrap required, opened a new log
I20260709 13:15:51.176928  5514 ts_tablet_manager.cc:1403] T 3d6bcda036934682b5075c20b786026d P 77789aa45dc5463c82b73504fef4b4e0: Time spent bootstrapping tablet: real 0.208s	user 0.003s	sys 0.030s
W20260709 13:15:51.178743  5433 leader_election.cc:343] T 09e39d6f01a0444bb1aa42b5403943c8 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:51.181452  5883 leader_election.cc:290] T 3d6bcda036934682b5075c20b786026d P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:51.195891  5517 raft_consensus.cc:359] T 73c339ffbbca40c78c31d33aa9bb9e38 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:51.196839  5517 raft_consensus.cc:385] T 73c339ffbbca40c78c31d33aa9bb9e38 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:51.197166  5517 raft_consensus.cc:740] T 73c339ffbbca40c78c31d33aa9bb9e38 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:51.197907  5517 consensus_queue.cc:260] T 73c339ffbbca40c78c31d33aa9bb9e38 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:51.198700  5515 tablet_bootstrap.cc:492] T c520b1f4431848d1967291be272086c5 P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
I20260709 13:15:51.199409  5515 ts_tablet_manager.cc:1403] T c520b1f4431848d1967291be272086c5 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.509s	user 0.028s	sys 0.017s
W20260709 13:15:51.200699  5359 leader_election.cc:343] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:51.201006  5463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d6bcda036934682b5075c20b786026d" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:51.201243  5359 leader_election.cc:304] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b52f14f9154b5a86f76fe58e4c235e; no voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:51.202484  5646 raft_consensus.cc:2749] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:51.206177  5358 leader_election.cc:343] T 3d6bcda036934682b5075c20b786026d P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:51.207787  5514 raft_consensus.cc:359] T 3d6bcda036934682b5075c20b786026d P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:51.208599  5514 raft_consensus.cc:385] T 3d6bcda036934682b5075c20b786026d P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:51.208916  5514 raft_consensus.cc:740] T 3d6bcda036934682b5075c20b786026d P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Initialized, Role: FOLLOWER
I20260709 13:15:51.209679  5514 consensus_queue.cc:260] T 3d6bcda036934682b5075c20b786026d P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:51.202490  5515 raft_consensus.cc:359] T c520b1f4431848d1967291be272086c5 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:51.211822  5515 raft_consensus.cc:385] T c520b1f4431848d1967291be272086c5 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:51.212136  5515 raft_consensus.cc:740] T c520b1f4431848d1967291be272086c5 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
I20260709 13:15:51.212872  5515 consensus_queue.cc:260] T c520b1f4431848d1967291be272086c5 P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:51.215832  5517 ts_tablet_manager.cc:1434] T 73c339ffbbca40c78c31d33aa9bb9e38 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.179s	user 0.008s	sys 0.002s
I20260709 13:15:51.217238  5515 ts_tablet_manager.cc:1434] T c520b1f4431848d1967291be272086c5 P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 13:15:51.218336  5515 tablet_bootstrap.cc:492] T 9c7fcfa184e1425c86c784dd9db4423e P c4b52f14f9154b5a86f76fe58e4c235e: Bootstrap starting.
I20260709 13:15:51.220356  5514 ts_tablet_manager.cc:1434] T 3d6bcda036934682b5075c20b786026d P 77789aa45dc5463c82b73504fef4b4e0: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.001s
I20260709 13:15:51.223564  5516 tablet_bootstrap.cc:492] T b1ab7b32db51471796738b38f71b64df P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:51.224149  5516 ts_tablet_manager.cc:1403] T b1ab7b32db51471796738b38f71b64df P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.178s	user 0.012s	sys 0.005s
I20260709 13:15:51.224929  5515 tablet_bootstrap.cc:654] T 9c7fcfa184e1425c86c784dd9db4423e P c4b52f14f9154b5a86f76fe58e4c235e: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:51.227483  5516 raft_consensus.cc:359] T b1ab7b32db51471796738b38f71b64df P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:51.228308  5516 raft_consensus.cc:385] T b1ab7b32db51471796738b38f71b64df P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:15:51.281477  5211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:40847, user_credentials={real_user=slave}} blocked reactor thread for 138948us
I20260709 13:15:51.283613  5211 leader_election.cc:304] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 2f45532f94a34efcb68a82db3dd69372
I20260709 13:15:51.324682  5815 raft_consensus.cc:493] T 3e48fc9e60214121991b0bb473d174da P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.340461  5916 raft_consensus.cc:2804] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:51.341225  5916 raft_consensus.cc:493] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:51.341763  5916 raft_consensus.cc:3060] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:51.340811  5515 tablet_bootstrap.cc:492] T 9c7fcfa184e1425c86c784dd9db4423e P c4b52f14f9154b5a86f76fe58e4c235e: No bootstrap required, opened a new log
I20260709 13:15:51.344718  5515 ts_tablet_manager.cc:1403] T 9c7fcfa184e1425c86c784dd9db4423e P c4b52f14f9154b5a86f76fe58e4c235e: Time spent bootstrapping tablet: real 0.127s	user 0.015s	sys 0.000s
I20260709 13:15:51.349054  5242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d6bcda036934682b5075c20b786026d" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:51.326228  5815 raft_consensus.cc:515] T 3e48fc9e60214121991b0bb473d174da P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:51.352481  5515 raft_consensus.cc:359] T 9c7fcfa184e1425c86c784dd9db4423e P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:51.353760  5515 raft_consensus.cc:385] T 9c7fcfa184e1425c86c784dd9db4423e P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:51.362701  5515 raft_consensus.cc:740] T 9c7fcfa184e1425c86c784dd9db4423e P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Initialized, Role: FOLLOWER
W20260709 13:15:51.374414  5360 leader_election.cc:343] T 3d6bcda036934682b5075c20b786026d P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:51.375451  5360 leader_election.cc:304] T 3d6bcda036934682b5075c20b786026d P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b52f14f9154b5a86f76fe58e4c235e; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, 77789aa45dc5463c82b73504fef4b4e0
I20260709 13:15:51.228638  5516 raft_consensus.cc:740] T b1ab7b32db51471796738b38f71b64df P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:51.390617  5815 leader_election.cc:290] T 3e48fc9e60214121991b0bb473d174da P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:51.408794  5788 consensus_queue.cc:1048] T 73c339ffbbca40c78c31d33aa9bb9e38 P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:51.411859  5987 raft_consensus.cc:2749] T 3d6bcda036934682b5075c20b786026d P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:51.382469  5516 consensus_queue.cc:260] T b1ab7b32db51471796738b38f71b64df P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:51.428807  5243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09e39d6f01a0444bb1aa42b5403943c8" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:51.429183  5980 consensus_queue.cc:1048] T 104c92d196fa45818108b633cbfaea4b P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:15:51.441272  5434 leader_election.cc:343] T 09e39d6f01a0444bb1aa42b5403943c8 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:51.442029  5434 leader_election.cc:304] T 09e39d6f01a0444bb1aa42b5403943c8 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0; no voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:51.443638  5980 raft_consensus.cc:2749] T 09e39d6f01a0444bb1aa42b5403943c8 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:51.446801  5284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:41391, user_credentials={real_user=slave}} blocked reactor thread for 104853us
I20260709 13:15:51.407296  5517 tablet_bootstrap.cc:492] T 6a1e233f50be40f78b9208537916e93c P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:51.465427  5515 consensus_queue.cc:260] T 9c7fcfa184e1425c86c784dd9db4423e P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:51.488577  5463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e48fc9e60214121991b0bb473d174da" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:51.497820  5515 ts_tablet_manager.cc:1434] T 9c7fcfa184e1425c86c784dd9db4423e P c4b52f14f9154b5a86f76fe58e4c235e: Time spent starting tablet: real 0.153s	user 0.008s	sys 0.004s
I20260709 13:15:51.515964  5516 ts_tablet_manager.cc:1434] T b1ab7b32db51471796738b38f71b64df P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.291s	user 0.010s	sys 0.000s
I20260709 13:15:51.518168  5516 tablet_bootstrap.cc:492] T 104c92d196fa45818108b633cbfaea4b P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
I20260709 13:15:51.519588  5242 raft_consensus.cc:3060] T 73c339ffbbca40c78c31d33aa9bb9e38 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:51.520358  5433 consensus_peers.cc:597] T 104c92d196fa45818108b633cbfaea4b P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Couldn't send request to peer 2f45532f94a34efcb68a82db3dd69372. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:51.539775  5434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:41357, user_credentials={real_user=slave}} blocked reactor thread for 98887.8us
I20260709 13:15:51.546746  5962 consensus_queue.cc:1048] T 6a1e233f50be40f78b9208537916e93c P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:51.552111  5958 raft_consensus.cc:493] T 3d6bcda036934682b5075c20b786026d P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.552809  5958 raft_consensus.cc:515] T 3d6bcda036934682b5075c20b786026d P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:51.561399  5895 raft_consensus.cc:493] T c520b1f4431848d1967291be272086c5 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.562553  5895 raft_consensus.cc:515] T c520b1f4431848d1967291be272086c5 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:51.562984  5958 leader_election.cc:290] T 3d6bcda036934682b5075c20b786026d P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:51.573716  5895 leader_election.cc:290] T c520b1f4431848d1967291be272086c5 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:51.577913  5517 tablet_bootstrap.cc:654] T 6a1e233f50be40f78b9208537916e93c P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:51.581393  5910 consensus_queue.cc:1048] T c6bbe6dd572c4ea4aaf323c36eb05467 P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:15:51.588896  5142 catalog_manager.cc:5697] T 73c339ffbbca40c78c31d33aa9bb9e38 P c4b52f14f9154b5a86f76fe58e4c235e reported cstate change: term changed from 0 to 1, leader changed from <none> to c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131). New cstate: current_term: 1 leader_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:51.597016  5192 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:51.602151  5240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d6bcda036934682b5075c20b786026d" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:51.604233  5980 raft_consensus.cc:493] T 3b01a00074004ddb87b1710a6555353b P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:51.587090  5286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:41357, user_credentials={real_user=slave}} blocked reactor thread for 149294us
I20260709 13:15:51.605418  5980 raft_consensus.cc:515] T 3b01a00074004ddb87b1710a6555353b P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:51.607560  5391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d6bcda036934682b5075c20b786026d" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:51.608240  5318 raft_consensus.cc:3060] T 3e48fc9e60214121991b0bb473d174da P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:51.608453  5391 raft_consensus.cc:2468] T 3d6bcda036934682b5075c20b786026d P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 0.
I20260709 13:15:51.610209  5980 leader_election.cc:290] T 3b01a00074004ddb87b1710a6555353b P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:51.620817  5314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b01a00074004ddb87b1710a6555353b" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
W20260709 13:15:51.624874  5433 leader_election.cc:343] T 3b01a00074004ddb87b1710a6555353b P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:51.631561  5391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e48fc9e60214121991b0bb473d174da" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:51.640482  5434 leader_election.cc:304] T 3d6bcda036934682b5075c20b786026d P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:51.652135  5683 raft_consensus.cc:2804] T 3d6bcda036934682b5075c20b786026d P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:51.652652  5683 raft_consensus.cc:493] T 3d6bcda036934682b5075c20b786026d P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:51.653049  5683 raft_consensus.cc:3060] T 3d6bcda036934682b5075c20b786026d P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:51.653198  5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b01a00074004ddb87b1710a6555353b" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:51.655036  5463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c520b1f4431848d1967291be272086c5" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:51.655938  5463 raft_consensus.cc:2468] T c520b1f4431848d1967291be272086c5 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 0.
I20260709 13:15:51.655970  5241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c520b1f4431848d1967291be272086c5" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:51.658057  5916 raft_consensus.cc:515] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:51.662139  5388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ab7b32db51471796738b38f71b64df" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:15:51.662879  5388 raft_consensus.cc:3060] T b1ab7b32db51471796738b38f71b64df P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:51.664005  5315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ab7b32db51471796738b38f71b64df" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:15:51.664779  5315 raft_consensus.cc:3060] T b1ab7b32db51471796738b38f71b64df P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:51.673012  5434 leader_election.cc:343] T 3d6bcda036934682b5075c20b786026d P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:51.675067  5434 leader_election.cc:343] T 3b01a00074004ddb87b1710a6555353b P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:51.675539  5434 leader_election.cc:304] T 3b01a00074004ddb87b1710a6555353b P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0; no voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:51.676889  5865 raft_consensus.cc:2749] T 3b01a00074004ddb87b1710a6555353b P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:51.678541  5358 leader_election.cc:304] T c520b1f4431848d1967291be272086c5 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:51.680593  5895 raft_consensus.cc:2804] T c520b1f4431848d1967291be272086c5 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:51.681041  5895 raft_consensus.cc:493] T c520b1f4431848d1967291be272086c5 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:51.681442  5895 raft_consensus.cc:3060] T c520b1f4431848d1967291be272086c5 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:51.697238  5360 leader_election.cc:343] T c520b1f4431848d1967291be272086c5 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:51.713294  5891 raft_consensus.cc:493] T 9c7fcfa184e1425c86c784dd9db4423e P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.713953  5891 raft_consensus.cc:515] T 9c7fcfa184e1425c86c784dd9db4423e P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:51.673004  5916 leader_election.cc:290] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 election: Requested vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:51.738332  5646 consensus_queue.cc:1048] T 73c339ffbbca40c78c31d33aa9bb9e38 P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Connected to new peer: Peer: permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:51.739068  5891 leader_election.cc:290] T 9c7fcfa184e1425c86c784dd9db4423e P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:51.746204  5683 raft_consensus.cc:515] T 3d6bcda036934682b5075c20b786026d P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:51.750660  5895 raft_consensus.cc:515] T c520b1f4431848d1967291be272086c5 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:51.755362  5286 leader_election.cc:304] T 3e48fc9e60214121991b0bb473d174da P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372; no voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:51.760139  5464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c7fcfa184e1425c86c784dd9db4423e" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:51.760488  5962 raft_consensus.cc:2749] T 3e48fc9e60214121991b0bb473d174da P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:51.761124  5464 raft_consensus.cc:2468] T 9c7fcfa184e1425c86c784dd9db4423e P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 0.
I20260709 13:15:51.761178  5468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c520b1f4431848d1967291be272086c5" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:15:51.762001  5468 raft_consensus.cc:3060] T c520b1f4431848d1967291be272086c5 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:51.763445  5391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d6bcda036934682b5075c20b786026d" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:15:51.764139  5391 raft_consensus.cc:3060] T 3d6bcda036934682b5075c20b786026d P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:51.765972  5315 raft_consensus.cc:2468] T b1ab7b32db51471796738b38f71b64df P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 1.
I20260709 13:15:51.767944  5210 leader_election.cc:304] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 
I20260709 13:15:51.768420  5683 leader_election.cc:290] T 3d6bcda036934682b5075c20b786026d P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 election: Requested vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:51.769192  5908 raft_consensus.cc:2804] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:51.769801  5908 raft_consensus.cc:697] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 LEADER]: Becoming Leader. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Running, Role: LEADER
I20260709 13:15:51.767896  5516 tablet_bootstrap.cc:654] T 104c92d196fa45818108b633cbfaea4b P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:51.771919  5358 leader_election.cc:304] T 9c7fcfa184e1425c86c784dd9db4423e P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:51.773135  5891 raft_consensus.cc:2804] T 9c7fcfa184e1425c86c784dd9db4423e P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:51.773550  5891 raft_consensus.cc:493] T 9c7fcfa184e1425c86c784dd9db4423e P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:51.773934  5891 raft_consensus.cc:3060] T 9c7fcfa184e1425c86c784dd9db4423e P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:51.775153  5895 leader_election.cc:290] T c520b1f4431848d1967291be272086c5 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 election: Requested vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:51.775349  5391 raft_consensus.cc:2468] T 3d6bcda036934682b5075c20b786026d P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 1.
I20260709 13:15:51.776561  5240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c520b1f4431848d1967291be272086c5" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
I20260709 13:15:51.771131  5908 consensus_queue.cc:237] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
W20260709 13:15:51.778257  5360 leader_election.cc:343] T c520b1f4431848d1967291be272086c5 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:51.791325  5240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d6bcda036934682b5075c20b786026d" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
I20260709 13:15:51.795855  5434 leader_election.cc:304] T 3d6bcda036934682b5075c20b786026d P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:51.797319  5980 raft_consensus.cc:2804] T 3d6bcda036934682b5075c20b786026d P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:51.797901  5980 raft_consensus.cc:697] T 3d6bcda036934682b5075c20b786026d P 77789aa45dc5463c82b73504fef4b4e0 [term 1 LEADER]: Becoming Leader. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Running, Role: LEADER
I20260709 13:15:51.799015  5980 consensus_queue.cc:237] T 3d6bcda036934682b5075c20b786026d P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
W20260709 13:15:51.810185  5434 leader_election.cc:343] T 3d6bcda036934682b5075c20b786026d P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:51.809952  5286 consensus_peers.cc:597] T 6a1e233f50be40f78b9208537916e93c P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:51.786818  5891 raft_consensus.cc:515] T 9c7fcfa184e1425c86c784dd9db4423e P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:51.844991  5314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c7fcfa184e1425c86c784dd9db4423e" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:51.849421  5388 raft_consensus.cc:2468] T b1ab7b32db51471796738b38f71b64df P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 1.
W20260709 13:15:51.886071  5359 leader_election.cc:343] T 9c7fcfa184e1425c86c784dd9db4423e P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:51.950039  5468 raft_consensus.cc:2468] T c520b1f4431848d1967291be272086c5 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 1.
I20260709 13:15:51.952607  5516 tablet_bootstrap.cc:492] T 104c92d196fa45818108b633cbfaea4b P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:51.955862  5846 consensus_queue.cc:1048] T c6bbe6dd572c4ea4aaf323c36eb05467 P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:15:51.959697  5516 ts_tablet_manager.cc:1403] T 104c92d196fa45818108b633cbfaea4b P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.442s	user 0.021s	sys 0.004s
I20260709 13:15:51.968924  5517 tablet_bootstrap.cc:492] T 6a1e233f50be40f78b9208537916e93c P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:51.969573  5517 ts_tablet_manager.cc:1403] T 6a1e233f50be40f78b9208537916e93c P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.563s	user 0.033s	sys 0.019s
I20260709 13:15:51.981902  5891 leader_election.cc:290] T 9c7fcfa184e1425c86c784dd9db4423e P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 election: Requested vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:51.976560  5358 leader_election.cc:304] T c520b1f4431848d1967291be272086c5 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:51.990824  5317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c7fcfa184e1425c86c784dd9db4423e" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
W20260709 13:15:51.993291  6020 log.cc:927] Time spent T 3e48fc9e60214121991b0bb473d174da P 2f45532f94a34efcb68a82db3dd69372: Append to log took a long time: real 0.092s	user 0.000s	sys 0.003s
I20260709 13:15:51.999092  5516 raft_consensus.cc:359] T 104c92d196fa45818108b633cbfaea4b P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:52.000102  5516 raft_consensus.cc:385] T 104c92d196fa45818108b633cbfaea4b P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:52.000422  5516 raft_consensus.cc:740] T 104c92d196fa45818108b633cbfaea4b P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:52.001124  5516 consensus_queue.cc:260] T 104c92d196fa45818108b633cbfaea4b P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:52.002871  5516 ts_tablet_manager.cc:1434] T 104c92d196fa45818108b633cbfaea4b P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.042s	user 0.004s	sys 0.000s
I20260709 13:15:51.993291  5517 raft_consensus.cc:359] T 6a1e233f50be40f78b9208537916e93c P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:52.004317  5517 raft_consensus.cc:385] T 6a1e233f50be40f78b9208537916e93c P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:52.004573  5517 raft_consensus.cc:740] T 6a1e233f50be40f78b9208537916e93c P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:52.005322  5517 consensus_queue.cc:260] T 6a1e233f50be40f78b9208537916e93c P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
W20260709 13:15:52.010283  5359 leader_election.cc:343] T 9c7fcfa184e1425c86c784dd9db4423e P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:51.991094  5891 raft_consensus.cc:2804] T c520b1f4431848d1967291be272086c5 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:52.017377  5516 tablet_bootstrap.cc:492] T f3f19e79faea4bdbae72383e79104b37 P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
I20260709 13:15:52.024922  5464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c7fcfa184e1425c86c784dd9db4423e" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:15:52.025784  5464 raft_consensus.cc:3060] T 9c7fcfa184e1425c86c784dd9db4423e P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:52.026304  5516 tablet_bootstrap.cc:654] T f3f19e79faea4bdbae72383e79104b37 P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:52.032171  5517 ts_tablet_manager.cc:1434] T 6a1e233f50be40f78b9208537916e93c P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.062s	user 0.005s	sys 0.005s
I20260709 13:15:52.033923  5891 raft_consensus.cc:697] T c520b1f4431848d1967291be272086c5 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 LEADER]: Becoming Leader. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Running, Role: LEADER
I20260709 13:15:52.035110  5891 consensus_queue.cc:237] T c520b1f4431848d1967291be272086c5 P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:52.053735  5517 tablet_bootstrap.cc:492] T f3f19e79faea4bdbae72383e79104b37 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:52.056036  5142 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55088 (request call id 68) took 1039 ms. Trace:
I20260709 13:15:52.065248  5142 rpcz_store.cc:276] 0709 13:15:51.016294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.016462 (+   168us) service_pool.cc:224] Handling call
0709 13:15:52.055942 (+1039480us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:51.748391 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:51.749122 (+   731us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:51.749172 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:15:51.749210 (+    38us) tablet.cc:662] Decoding operations
0709 13:15:51.749678 (+   468us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:51.749765 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:51.749796 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:15:51.750126 (+   330us) tablet.cc:701] Row locks acquired
0709 13:15:51.750160 (+    34us) write_op.cc:260] PREPARE: finished
0709 13:15:51.750347 (+   187us) write_op.cc:270] Start()
0709 13:15:51.750503 (+   156us) write_op.cc:276] Timestamp: P: 1783602951750287 usec, L: 0
0709 13:15:51.750539 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:15:51.753706 (+  3167us) log.cc:844] Serialized 543 byte log entry
0709 13:15:51.902014 (+148308us) op_driver.cc:464] REPLICATION: finished
0709 13:15:51.981349 (+ 79335us) write_op.cc:301] APPLY: starting
0709 13:15:51.981492 (+   143us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:51.981649 (+   157us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:51.981835 (+   186us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:51.982295 (+   460us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:51.982619 (+   324us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:15:51.982703 (+    84us) write_op.cc:312] APPLY: finished
0709 13:15:51.983066 (+   363us) log.cc:844] Serialized 22 byte log entry
0709 13:15:51.983323 (+   257us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:51.983455 (+   132us) write_op.cc:454] Released schema lock
0709 13:15:52.011775 (+ 28320us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:52.042006 (+ 30231us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:52.042053 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":275526,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":78918,"apply.run_cpu_time_us":2736,"apply.run_wall_time_us":60622,"num_ops":1,"prepare.queue_time_us":113452,"prepare.run_cpu_time_us":3667,"prepare.run_wall_time_us":75612,"replication_time_us":151205,"thread_start_us":85646,"threads_started":2}]]}
I20260709 13:15:52.065634  5464 raft_consensus.cc:2468] T 9c7fcfa184e1425c86c784dd9db4423e P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 1.
I20260709 13:15:52.070721  5358 leader_election.cc:304] T 9c7fcfa184e1425c86c784dd9db4423e P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 2f45532f94a34efcb68a82db3dd69372
I20260709 13:15:52.078954  5979 raft_consensus.cc:2804] T 9c7fcfa184e1425c86c784dd9db4423e P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:52.079823  5979 raft_consensus.cc:697] T 9c7fcfa184e1425c86c784dd9db4423e P c4b52f14f9154b5a86f76fe58e4c235e [term 1 LEADER]: Becoming Leader. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Running, Role: LEADER
I20260709 13:15:52.081205  5979 consensus_queue.cc:237] T 9c7fcfa184e1425c86c784dd9db4423e P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:52.067605  5144 catalog_manager.cc:5697] T 6a1e233f50be40f78b9208537916e93c P 2f45532f94a34efcb68a82db3dd69372 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130). New cstate: current_term: 1 leader_uuid: "2f45532f94a34efcb68a82db3dd69372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:52.096118  5240 raft_consensus.cc:3060] T 6a1e233f50be40f78b9208537916e93c P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:52.088223  5144 catalog_manager.cc:5697] T c6bbe6dd572c4ea4aaf323c36eb05467 P 2f45532f94a34efcb68a82db3dd69372 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130). New cstate: current_term: 1 leader_uuid: "2f45532f94a34efcb68a82db3dd69372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:52.129156  5140 catalog_manager.cc:5697] T 104c92d196fa45818108b633cbfaea4b P 77789aa45dc5463c82b73504fef4b4e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132). New cstate: current_term: 1 leader_uuid: "77789aa45dc5463c82b73504fef4b4e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:52.142614  5516 tablet_bootstrap.cc:492] T f3f19e79faea4bdbae72383e79104b37 P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:52.143271  5516 ts_tablet_manager.cc:1403] T f3f19e79faea4bdbae72383e79104b37 P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.126s	user 0.016s	sys 0.012s
I20260709 13:15:52.146713  5516 raft_consensus.cc:359] T f3f19e79faea4bdbae72383e79104b37 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:52.147465  5516 raft_consensus.cc:385] T f3f19e79faea4bdbae72383e79104b37 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:52.147785  5516 raft_consensus.cc:740] T f3f19e79faea4bdbae72383e79104b37 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:52.148577  5516 consensus_queue.cc:260] T f3f19e79faea4bdbae72383e79104b37 P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:52.149212  5517 tablet_bootstrap.cc:654] T f3f19e79faea4bdbae72383e79104b37 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:52.159312  5516 ts_tablet_manager.cc:1434] T f3f19e79faea4bdbae72383e79104b37 P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.004s
I20260709 13:15:52.160679  5516 tablet_bootstrap.cc:492] T 9c7fcfa184e1425c86c784dd9db4423e P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
I20260709 13:15:52.166016  5143 catalog_manager.cc:5697] T c520b1f4431848d1967291be272086c5 P c4b52f14f9154b5a86f76fe58e4c235e reported cstate change: term changed from 0 to 1, leader changed from <none> to c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131). New cstate: current_term: 1 leader_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:52.183743  5144 catalog_manager.cc:5697] T 3d6bcda036934682b5075c20b786026d P 77789aa45dc5463c82b73504fef4b4e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132). New cstate: current_term: 1 leader_uuid: "77789aa45dc5463c82b73504fef4b4e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:52.186596  5517 tablet_bootstrap.cc:492] T f3f19e79faea4bdbae72383e79104b37 P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:52.187199  5517 ts_tablet_manager.cc:1403] T f3f19e79faea4bdbae72383e79104b37 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.134s	user 0.012s	sys 0.008s
I20260709 13:15:52.194641  5517 raft_consensus.cc:359] T f3f19e79faea4bdbae72383e79104b37 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:52.195576  5517 raft_consensus.cc:385] T f3f19e79faea4bdbae72383e79104b37 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:52.196072  5517 raft_consensus.cc:740] T f3f19e79faea4bdbae72383e79104b37 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:52.197045  5517 consensus_queue.cc:260] T f3f19e79faea4bdbae72383e79104b37 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:52.213903  5517 ts_tablet_manager.cc:1434] T f3f19e79faea4bdbae72383e79104b37 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.001s
I20260709 13:15:52.217309  5516 tablet_bootstrap.cc:654] T 9c7fcfa184e1425c86c784dd9db4423e P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:52.251287  5517 tablet_bootstrap.cc:492] T 3b01a00074004ddb87b1710a6555353b P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:52.266705  5517 tablet_bootstrap.cc:654] T 3b01a00074004ddb87b1710a6555353b P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:52.276950  5434 consensus_peers.cc:597] T 3d6bcda036934682b5075c20b786026d P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:52.282194  5916 consensus_queue.cc:1048] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:52.291178  5143 catalog_manager.cc:5697] T 9c7fcfa184e1425c86c784dd9db4423e P c4b52f14f9154b5a86f76fe58e4c235e reported cstate change: term changed from 0 to 1, leader changed from <none> to c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131). New cstate: current_term: 1 leader_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:52.306948  5142 catalog_manager.cc:5697] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129). New cstate: current_term: 1 leader_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:52.327829  5516 tablet_bootstrap.cc:492] T 9c7fcfa184e1425c86c784dd9db4423e P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:52.330812  5516 ts_tablet_manager.cc:1403] T 9c7fcfa184e1425c86c784dd9db4423e P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.171s	user 0.014s	sys 0.019s
I20260709 13:15:52.334247  5516 raft_consensus.cc:359] T 9c7fcfa184e1425c86c784dd9db4423e P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:52.335009  5516 raft_consensus.cc:385] T 9c7fcfa184e1425c86c784dd9db4423e P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:52.335278  5516 raft_consensus.cc:740] T 9c7fcfa184e1425c86c784dd9db4423e P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:52.336016  5516 consensus_queue.cc:260] T 9c7fcfa184e1425c86c784dd9db4423e P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:52.337927  5516 ts_tablet_manager.cc:1434] T 9c7fcfa184e1425c86c784dd9db4423e P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.002s
I20260709 13:15:52.339107  5516 tablet_bootstrap.cc:492] T 3b01a00074004ddb87b1710a6555353b P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
I20260709 13:15:52.342375  5916 consensus_queue.cc:1048] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:52.344800  5517 tablet_bootstrap.cc:492] T 3b01a00074004ddb87b1710a6555353b P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:52.346029  5517 ts_tablet_manager.cc:1403] T 3b01a00074004ddb87b1710a6555353b P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.094s	user 0.027s	sys 0.037s
I20260709 13:15:52.347234  5980 consensus_queue.cc:1048] T 3d6bcda036934682b5075c20b786026d P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:52.347977  5516 tablet_bootstrap.cc:654] T 3b01a00074004ddb87b1710a6555353b P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:52.360875  5962 raft_consensus.cc:493] T 104c92d196fa45818108b633cbfaea4b P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.362052  5962 raft_consensus.cc:515] T 104c92d196fa45818108b633cbfaea4b P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:52.364588  5962 leader_election.cc:290] T 104c92d196fa45818108b633cbfaea4b P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:52.369174  5517 raft_consensus.cc:359] T 3b01a00074004ddb87b1710a6555353b P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:52.370040  5517 raft_consensus.cc:385] T 3b01a00074004ddb87b1710a6555353b P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:52.377009  5517 raft_consensus.cc:740] T 3b01a00074004ddb87b1710a6555353b P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:52.377871  5517 consensus_queue.cc:260] T 3b01a00074004ddb87b1710a6555353b P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:52.383163  5517 ts_tablet_manager.cc:1434] T 3b01a00074004ddb87b1710a6555353b P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.036s	user 0.004s	sys 0.003s
I20260709 13:15:52.383360  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104c92d196fa45818108b633cbfaea4b" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:52.384637  5517 tablet_bootstrap.cc:492] T 3e101cf4ae084c74af284008876e474e P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:52.397285  5517 tablet_bootstrap.cc:654] T 3e101cf4ae084c74af284008876e474e P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:52.400120  5516 tablet_bootstrap.cc:492] T 3b01a00074004ddb87b1710a6555353b P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:52.400841  5516 ts_tablet_manager.cc:1403] T 3b01a00074004ddb87b1710a6555353b P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.062s	user 0.017s	sys 0.011s
I20260709 13:15:52.403368  5315 raft_consensus.cc:3060] T 104c92d196fa45818108b633cbfaea4b P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:52.418859  5516 raft_consensus.cc:359] T 3b01a00074004ddb87b1710a6555353b P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:52.419744  5516 raft_consensus.cc:385] T 3b01a00074004ddb87b1710a6555353b P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:52.420030  5516 raft_consensus.cc:740] T 3b01a00074004ddb87b1710a6555353b P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:52.420800  5516 consensus_queue.cc:260] T 3b01a00074004ddb87b1710a6555353b P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:52.422822  5516 ts_tablet_manager.cc:1434] T 3b01a00074004ddb87b1710a6555353b P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:15:52.446959  5516 tablet_bootstrap.cc:492] T 3e101cf4ae084c74af284008876e474e P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
I20260709 13:15:52.451040  5393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104c92d196fa45818108b633cbfaea4b" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:52.468518  5286 leader_election.cc:304] T 104c92d196fa45818108b633cbfaea4b P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372; no voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e
W20260709 13:15:52.493506  5360 consensus_peers.cc:597] T c520b1f4431848d1967291be272086c5 P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:52.503546  5966 raft_consensus.cc:493] T 3b01a00074004ddb87b1710a6555353b P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.504267  5966 raft_consensus.cc:515] T 3b01a00074004ddb87b1710a6555353b P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:52.509927  5464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b01a00074004ddb87b1710a6555353b" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:52.510131  5318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b01a00074004ddb87b1710a6555353b" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:52.510874  5464 raft_consensus.cc:2468] T 3b01a00074004ddb87b1710a6555353b P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 0.
I20260709 13:15:52.510928  5318 raft_consensus.cc:2468] T 3b01a00074004ddb87b1710a6555353b P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 0.
I20260709 13:15:52.512789  5210 leader_election.cc:304] T 3b01a00074004ddb87b1710a6555353b P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 
I20260709 13:15:52.506750  5966 leader_election.cc:290] T 3b01a00074004ddb87b1710a6555353b P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:52.514233  5916 raft_consensus.cc:2804] T 3b01a00074004ddb87b1710a6555353b P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:52.514870  5916 raft_consensus.cc:493] T 3b01a00074004ddb87b1710a6555353b P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.515422  5916 raft_consensus.cc:3060] T 3b01a00074004ddb87b1710a6555353b P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:52.527300  5516 tablet_bootstrap.cc:654] T 3e101cf4ae084c74af284008876e474e P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:52.534902  6011 raft_consensus.cc:2749] T 104c92d196fa45818108b633cbfaea4b P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:52.544691  5517 tablet_bootstrap.cc:492] T 3e101cf4ae084c74af284008876e474e P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:52.550735  5516 tablet_bootstrap.cc:492] T 3e101cf4ae084c74af284008876e474e P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:52.552906  5517 ts_tablet_manager.cc:1403] T 3e101cf4ae084c74af284008876e474e P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.169s	user 0.027s	sys 0.019s
I20260709 13:15:52.552721  5916 raft_consensus.cc:515] T 3b01a00074004ddb87b1710a6555353b P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:52.553009  5516 ts_tablet_manager.cc:1403] T 3e101cf4ae084c74af284008876e474e P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.122s	user 0.020s	sys 0.006s
I20260709 13:15:52.557273  5516 raft_consensus.cc:359] T 3e101cf4ae084c74af284008876e474e P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:52.558172  5516 raft_consensus.cc:385] T 3e101cf4ae084c74af284008876e474e P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:52.558522  5516 raft_consensus.cc:740] T 3e101cf4ae084c74af284008876e474e P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:52.559333  5516 consensus_queue.cc:260] T 3e101cf4ae084c74af284008876e474e P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:52.560818  5517 raft_consensus.cc:359] T 3e101cf4ae084c74af284008876e474e P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:52.561605  5517 raft_consensus.cc:385] T 3e101cf4ae084c74af284008876e474e P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:52.562466  5516 ts_tablet_manager.cc:1434] T 3e101cf4ae084c74af284008876e474e P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:15:52.561884  5517 raft_consensus.cc:740] T 3e101cf4ae084c74af284008876e474e P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:52.563719  5318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b01a00074004ddb87b1710a6555353b" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:15:52.564345  5318 raft_consensus.cc:3060] T 3b01a00074004ddb87b1710a6555353b P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:52.564431  5517 consensus_queue.cc:260] T 3e101cf4ae084c74af284008876e474e P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:52.565375  5916 leader_election.cc:290] T 3b01a00074004ddb87b1710a6555353b P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 election: Requested vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:52.567276  5517 ts_tablet_manager.cc:1434] T 3e101cf4ae084c74af284008876e474e P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.005s
I20260709 13:15:52.567915  5516 tablet_bootstrap.cc:492] T 09e39d6f01a0444bb1aa42b5403943c8 P 2f45532f94a34efcb68a82db3dd69372: Bootstrap starting.
I20260709 13:15:52.568747  5464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b01a00074004ddb87b1710a6555353b" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:15:52.575392  5464 raft_consensus.cc:3060] T 3b01a00074004ddb87b1710a6555353b P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:52.582316  5895 consensus_queue.cc:1048] T c520b1f4431848d1967291be272086c5 P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:52.583523  5516 tablet_bootstrap.cc:654] T 09e39d6f01a0444bb1aa42b5403943c8 P 2f45532f94a34efcb68a82db3dd69372: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:52.569286  5517 tablet_bootstrap.cc:492] T c520b1f4431848d1967291be272086c5 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:52.608709  5989 consensus_queue.cc:1048] T 9c7fcfa184e1425c86c784dd9db4423e P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:52.620288  5517 tablet_bootstrap.cc:654] T c520b1f4431848d1967291be272086c5 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:52.632225  5962 raft_consensus.cc:493] T f3f19e79faea4bdbae72383e79104b37 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.633092  5962 raft_consensus.cc:515] T f3f19e79faea4bdbae72383e79104b37 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:52.636912  5241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f19e79faea4bdbae72383e79104b37" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:52.637748  5241 raft_consensus.cc:2468] T f3f19e79faea4bdbae72383e79104b37 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 0.
I20260709 13:15:52.636921  5962 leader_election.cc:290] T f3f19e79faea4bdbae72383e79104b37 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:52.639108  5286 leader_election.cc:304] T f3f19e79faea4bdbae72383e79104b37 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 
I20260709 13:15:52.640313  5962 raft_consensus.cc:2804] T f3f19e79faea4bdbae72383e79104b37 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:52.640805  5962 raft_consensus.cc:493] T f3f19e79faea4bdbae72383e79104b37 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.641198  5962 raft_consensus.cc:3060] T f3f19e79faea4bdbae72383e79104b37 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:52.663985  5916 raft_consensus.cc:493] T 3e101cf4ae084c74af284008876e474e P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.664664  5916 raft_consensus.cc:515] T 3e101cf4ae084c74af284008876e474e P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:52.666306  5516 tablet_bootstrap.cc:492] T 09e39d6f01a0444bb1aa42b5403943c8 P 2f45532f94a34efcb68a82db3dd69372: No bootstrap required, opened a new log
I20260709 13:15:52.668300  5516 ts_tablet_manager.cc:1403] T 09e39d6f01a0444bb1aa42b5403943c8 P 2f45532f94a34efcb68a82db3dd69372: Time spent bootstrapping tablet: real 0.101s	user 0.012s	sys 0.026s
I20260709 13:15:52.671406  5516 raft_consensus.cc:359] T 09e39d6f01a0444bb1aa42b5403943c8 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:52.672152  5516 raft_consensus.cc:385] T 09e39d6f01a0444bb1aa42b5403943c8 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:52.672411  5516 raft_consensus.cc:740] T 09e39d6f01a0444bb1aa42b5403943c8 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Initialized, Role: FOLLOWER
I20260709 13:15:52.673895  5392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e101cf4ae084c74af284008876e474e" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:52.674703  5317 raft_consensus.cc:3060] T 9c7fcfa184e1425c86c784dd9db4423e P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:52.675951  5388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f19e79faea4bdbae72383e79104b37" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:52.676702  5388 raft_consensus.cc:2468] T f3f19e79faea4bdbae72383e79104b37 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 0.
I20260709 13:15:52.673134  5516 consensus_queue.cc:260] T 09e39d6f01a0444bb1aa42b5403943c8 P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:52.675143  5315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e101cf4ae084c74af284008876e474e" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:52.674737  5392 raft_consensus.cc:2468] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 0.
I20260709 13:15:52.666293  5318 raft_consensus.cc:2468] T 3b01a00074004ddb87b1710a6555353b P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 1.
I20260709 13:15:52.692081  5210 leader_election.cc:304] T 3b01a00074004ddb87b1710a6555353b P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 
I20260709 13:15:52.658680  5464 raft_consensus.cc:2468] T 3b01a00074004ddb87b1710a6555353b P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 1.
I20260709 13:15:52.687837  5916 leader_election.cc:290] T 3e101cf4ae084c74af284008876e474e P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:52.717123  5916 raft_consensus.cc:2804] T 3b01a00074004ddb87b1710a6555353b P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:52.717700  5916 raft_consensus.cc:697] T 3b01a00074004ddb87b1710a6555353b P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 LEADER]: Becoming Leader. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Running, Role: LEADER
I20260709 13:15:52.718520  5516 ts_tablet_manager.cc:1434] T 09e39d6f01a0444bb1aa42b5403943c8 P 2f45532f94a34efcb68a82db3dd69372: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.001s
W20260709 13:15:52.719928  5192 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:52.686934  5989 raft_consensus.cc:493] T f3f19e79faea4bdbae72383e79104b37 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.691047  5315 raft_consensus.cc:2468] T 3e101cf4ae084c74af284008876e474e P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 0.
I20260709 13:15:52.723124  5916 consensus_queue.cc:237] T 3b01a00074004ddb87b1710a6555353b P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:52.725329  5962 raft_consensus.cc:515] T f3f19e79faea4bdbae72383e79104b37 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:52.744135  5211 leader_election.cc:304] T 3e101cf4ae084c74af284008876e474e P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:52.772255  5962 leader_election.cc:290] T f3f19e79faea4bdbae72383e79104b37 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Requested vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:52.753949  5966 raft_consensus.cc:2804] T 3e101cf4ae084c74af284008876e474e P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:52.776953  5391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f19e79faea4bdbae72383e79104b37" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:15:52.776237  5966 raft_consensus.cc:493] T 3e101cf4ae084c74af284008876e474e P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.789590  5966 raft_consensus.cc:3060] T 3e101cf4ae084c74af284008876e474e P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:52.751045  5989 raft_consensus.cc:515] T f3f19e79faea4bdbae72383e79104b37 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:52.791172  5391 raft_consensus.cc:3060] T f3f19e79faea4bdbae72383e79104b37 P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:52.793035  5517 tablet_bootstrap.cc:492] T c520b1f4431848d1967291be272086c5 P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:52.793676  5517 ts_tablet_manager.cc:1403] T c520b1f4431848d1967291be272086c5 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.225s	user 0.045s	sys 0.034s
W20260709 13:15:52.807942  5210 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:43623, user_credentials={real_user=slave}} blocked reactor thread for 117115us
I20260709 13:15:52.878844  5887 raft_consensus.cc:493] T 9c7fcfa184e1425c86c784dd9db4423e P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.879451  5887 raft_consensus.cc:515] T 9c7fcfa184e1425c86c784dd9db4423e P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:15:52.882588  5989 leader_election.cc:290] T f3f19e79faea4bdbae72383e79104b37 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:52.889637  5391 raft_consensus.cc:2468] T f3f19e79faea4bdbae72383e79104b37 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 1.
I20260709 13:15:52.894354  5517 raft_consensus.cc:359] T c520b1f4431848d1967291be272086c5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:52.895193  5517 raft_consensus.cc:385] T c520b1f4431848d1967291be272086c5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:52.895462  5517 raft_consensus.cc:740] T c520b1f4431848d1967291be272086c5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:52.896184  5517 consensus_queue.cc:260] T c520b1f4431848d1967291be272086c5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:52.897812  5517 ts_tablet_manager.cc:1434] T c520b1f4431848d1967291be272086c5 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.104s	user 0.008s	sys 0.000s
I20260709 13:15:52.899014  5517 tablet_bootstrap.cc:492] T 3d6bcda036934682b5075c20b786026d P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:52.891615  5962 raft_consensus.cc:493] T 09e39d6f01a0444bb1aa42b5403943c8 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.901068  5962 raft_consensus.cc:515] T 09e39d6f01a0444bb1aa42b5403943c8 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:52.906111  5317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f19e79faea4bdbae72383e79104b37" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:52.907330  5317 raft_consensus.cc:2393] T f3f19e79faea4bdbae72383e79104b37 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c4b52f14f9154b5a86f76fe58e4c235e in current term 1: Already voted for candidate 2f45532f94a34efcb68a82db3dd69372 in this term.
W20260709 13:15:52.927268  5434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:40847, user_credentials={real_user=slave}} blocked reactor thread for 79010us
I20260709 13:15:52.910483  5962 leader_election.cc:290] T 09e39d6f01a0444bb1aa42b5403943c8 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:52.917191  5895 consensus_queue.cc:1048] T 9c7fcfa184e1425c86c784dd9db4423e P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 13:15:52.940550  5242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f19e79faea4bdbae72383e79104b37" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
I20260709 13:15:52.961863  5239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09e39d6f01a0444bb1aa42b5403943c8" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:52.966185  5242 raft_consensus.cc:3060] T f3f19e79faea4bdbae72383e79104b37 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:52.994591  5286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:40847, user_credentials={real_user=slave}} blocked reactor thread for 64307.7us
W20260709 13:15:52.999482  5286 leader_election.cc:343] T 09e39d6f01a0444bb1aa42b5403943c8 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:53.016484  5286 leader_election.cc:304] T f3f19e79faea4bdbae72383e79104b37 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
W20260709 13:15:53.041631  5434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:40847, user_credentials={real_user=slave}} blocked reactor thread for 99628.3us
I20260709 13:15:53.065977  5962 raft_consensus.cc:2804] T f3f19e79faea4bdbae72383e79104b37 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:53.093993  5962 raft_consensus.cc:697] T f3f19e79faea4bdbae72383e79104b37 P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Becoming Leader. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Running, Role: LEADER
I20260709 13:15:53.095120  5962 consensus_queue.cc:237] T f3f19e79faea4bdbae72383e79104b37 P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
W20260709 13:15:53.095669  5209 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:41391, user_credentials={real_user=slave}} blocked reactor thread for 81753.1us
I20260709 13:15:53.097877  5966 raft_consensus.cc:515] T 3e101cf4ae084c74af284008876e474e P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:53.099893  5241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f19e79faea4bdbae72383e79104b37" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
I20260709 13:15:53.100241  5966 leader_election.cc:290] T 3e101cf4ae084c74af284008876e474e P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 election: Requested vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
W20260709 13:15:53.105752  6061 log.cc:927] Time spent T 3b01a00074004ddb87b1710a6555353b P 538ff4bfbd0c4f04bcd800c4ee4845ba: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:15:53.100168  5245 raft_consensus.cc:3060] T c520b1f4431848d1967291be272086c5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:53.125602  5360 leader_election.cc:304] T f3f19e79faea4bdbae72383e79104b37 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b52f14f9154b5a86f76fe58e4c235e; no voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:53.160346  5392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e101cf4ae084c74af284008876e474e" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:15:53.161309  5392 raft_consensus.cc:3060] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:53.162494  5517 tablet_bootstrap.cc:654] T 3d6bcda036934682b5075c20b786026d P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:53.152496  6060 raft_consensus.cc:2749] T f3f19e79faea4bdbae72383e79104b37 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:53.192081  5284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:41391, user_credentials={real_user=slave}} blocked reactor thread for 75466.3us
I20260709 13:15:53.248929  5465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c7fcfa184e1425c86c784dd9db4423e" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:53.251314  5468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09e39d6f01a0444bb1aa42b5403943c8" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:53.252243  5468 raft_consensus.cc:2468] T 09e39d6f01a0444bb1aa42b5403943c8 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 0.
I20260709 13:15:53.257367  5284 leader_election.cc:304] T 09e39d6f01a0444bb1aa42b5403943c8 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:53.258929  6072 raft_consensus.cc:2804] T 09e39d6f01a0444bb1aa42b5403943c8 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:53.259353  6072 raft_consensus.cc:493] T 09e39d6f01a0444bb1aa42b5403943c8 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.259734  6072 raft_consensus.cc:3060] T 09e39d6f01a0444bb1aa42b5403943c8 P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:53.263515  5242 raft_consensus.cc:2468] T f3f19e79faea4bdbae72383e79104b37 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 1.
I20260709 13:15:53.291517  5388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c7fcfa184e1425c86c784dd9db4423e" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:53.292018  5392 raft_consensus.cc:2468] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 1.
I20260709 13:15:53.313130  5317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e101cf4ae084c74af284008876e474e" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:15:53.320636  5317 raft_consensus.cc:3060] T 3e101cf4ae084c74af284008876e474e P 2f45532f94a34efcb68a82db3dd69372 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:53.330260  5211 leader_election.cc:304] T 3e101cf4ae084c74af284008876e474e P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:53.331485  6059 raft_consensus.cc:2804] T 3e101cf4ae084c74af284008876e474e P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:53.332056  6059 raft_consensus.cc:697] T 3e101cf4ae084c74af284008876e474e P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 LEADER]: Becoming Leader. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Running, Role: LEADER
I20260709 13:15:53.333006  6059 consensus_queue.cc:237] T 3e101cf4ae084c74af284008876e474e P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:53.361572  5517 tablet_bootstrap.cc:492] T 3d6bcda036934682b5075c20b786026d P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:53.362157  5517 ts_tablet_manager.cc:1403] T 3d6bcda036934682b5075c20b786026d P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.463s	user 0.021s	sys 0.026s
I20260709 13:15:53.365923  5517 raft_consensus.cc:359] T 3d6bcda036934682b5075c20b786026d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:53.366886  5517 raft_consensus.cc:385] T 3d6bcda036934682b5075c20b786026d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:53.367214  5517 raft_consensus.cc:740] T 3d6bcda036934682b5075c20b786026d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:53.374619  5517 consensus_queue.cc:260] T 3d6bcda036934682b5075c20b786026d P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:53.382251  6072 raft_consensus.cc:515] T 09e39d6f01a0444bb1aa42b5403943c8 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:53.386797  6072 leader_election.cc:290] T 09e39d6f01a0444bb1aa42b5403943c8 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Requested vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:53.389245  5317 raft_consensus.cc:2468] T 3e101cf4ae084c74af284008876e474e P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 1.
I20260709 13:15:53.398341  5887 leader_election.cc:290] T 9c7fcfa184e1425c86c784dd9db4423e P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:53.405179  5140 catalog_manager.cc:5697] T 3b01a00074004ddb87b1710a6555353b P 538ff4bfbd0c4f04bcd800c4ee4845ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129). New cstate: current_term: 1 leader_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:53.416621  5464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09e39d6f01a0444bb1aa42b5403943c8" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:15:53.417723  5464 raft_consensus.cc:3060] T 09e39d6f01a0444bb1aa42b5403943c8 P 77789aa45dc5463c82b73504fef4b4e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:53.420387  5286 leader_election.cc:304] T 9c7fcfa184e1425c86c784dd9db4423e P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372; no voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:53.431608  5965 raft_consensus.cc:2749] T 9c7fcfa184e1425c86c784dd9db4423e P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:53.440191  5517 ts_tablet_manager.cc:1434] T 3d6bcda036934682b5075c20b786026d P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.078s	user 0.009s	sys 0.001s
I20260709 13:15:53.454248  6055 consensus_queue.cc:1048] T 3b01a00074004ddb87b1710a6555353b P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:53.472460  5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09e39d6f01a0444bb1aa42b5403943c8" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
I20260709 13:15:53.484618  5517 tablet_bootstrap.cc:492] T 09e39d6f01a0444bb1aa42b5403943c8 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
W20260709 13:15:53.480580  5286 leader_election.cc:343] T 09e39d6f01a0444bb1aa42b5403943c8 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:53.501643  5464 raft_consensus.cc:2468] T 09e39d6f01a0444bb1aa42b5403943c8 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 1.
I20260709 13:15:53.516897  5284 leader_election.cc:304] T 09e39d6f01a0444bb1aa42b5403943c8 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:53.518200  5965 raft_consensus.cc:2804] T 09e39d6f01a0444bb1aa42b5403943c8 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:53.518739  5965 raft_consensus.cc:697] T 09e39d6f01a0444bb1aa42b5403943c8 P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Becoming Leader. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Running, Role: LEADER
I20260709 13:15:53.521060  5965 consensus_queue.cc:237] T 09e39d6f01a0444bb1aa42b5403943c8 P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:53.614494  6057 consensus_queue.cc:1048] T 3b01a00074004ddb87b1710a6555353b P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:53.620975  5517 tablet_bootstrap.cc:654] T 09e39d6f01a0444bb1aa42b5403943c8 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:53.584764  6055 raft_consensus.cc:493] T 3d6bcda036934682b5075c20b786026d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.659548  6055 raft_consensus.cc:515] T 3d6bcda036934682b5075c20b786026d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:53.674594  6055 leader_election.cc:290] T 3d6bcda036934682b5075c20b786026d P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:53.686522  5392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d6bcda036934682b5075c20b786026d" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:53.696184  5464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d6bcda036934682b5075c20b786026d" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:53.721138  5209 leader_election.cc:304] T 3d6bcda036934682b5075c20b786026d P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:53.722460  6055 raft_consensus.cc:2749] T 3d6bcda036934682b5075c20b786026d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:53.756219  6056 consensus_queue.cc:1048] T 3e101cf4ae084c74af284008876e474e P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:53.797365  5962 consensus_queue.cc:1048] T f3f19e79faea4bdbae72383e79104b37 P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:53.814865  5143 catalog_manager.cc:5697] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e reported cstate change: term changed from 0 to 1, leader changed from <none> to 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129). New cstate: current_term: 1 leader_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } }
I20260709 13:15:53.826625  5517 tablet_bootstrap.cc:492] T 09e39d6f01a0444bb1aa42b5403943c8 P 538ff4bfbd0c4f04bcd800c4ee4845ba: No bootstrap required, opened a new log
I20260709 13:15:53.827268  5517 ts_tablet_manager.cc:1403] T 09e39d6f01a0444bb1aa42b5403943c8 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.345s	user 0.032s	sys 0.021s
I20260709 13:15:53.837248  6055 consensus_queue.cc:1048] T 3e101cf4ae084c74af284008876e474e P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:53.845419  5965 consensus_queue.cc:1048] T f3f19e79faea4bdbae72383e79104b37 P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:53.877745  5517 raft_consensus.cc:359] T 09e39d6f01a0444bb1aa42b5403943c8 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:53.878628  5517 raft_consensus.cc:385] T 09e39d6f01a0444bb1aa42b5403943c8 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:53.878916  5517 raft_consensus.cc:740] T 09e39d6f01a0444bb1aa42b5403943c8 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:53.881166  5517 consensus_queue.cc:260] T 09e39d6f01a0444bb1aa42b5403943c8 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:53.891563  5517 ts_tablet_manager.cc:1434] T 09e39d6f01a0444bb1aa42b5403943c8 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.064s	user 0.003s	sys 0.005s
I20260709 13:15:53.944388  5240 raft_consensus.cc:3060] T 3d6bcda036934682b5075c20b786026d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:53.992774  5144 catalog_manager.cc:5697] T 09e39d6f01a0444bb1aa42b5403943c8 P 2f45532f94a34efcb68a82db3dd69372 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130). New cstate: current_term: 1 leader_uuid: "2f45532f94a34efcb68a82db3dd69372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:53.999212  5245 raft_consensus.cc:3060] T 09e39d6f01a0444bb1aa42b5403943c8 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:53.996212  5144 catalog_manager.cc:5697] T f3f19e79faea4bdbae72383e79104b37 P 2f45532f94a34efcb68a82db3dd69372 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130). New cstate: current_term: 1 leader_uuid: "2f45532f94a34efcb68a82db3dd69372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:54.027647  6065 consensus_queue.cc:1048] T 09e39d6f01a0444bb1aa42b5403943c8 P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:15:54.088519  5962 consensus_queue.cc:1048] T 09e39d6f01a0444bb1aa42b5403943c8 P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:55.432965 28234 tablet_server.cc:179] TabletServer@127.27.146.129:0 shutting down...
W20260709 13:15:55.436193  5360 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:15:55.445179  5360 consensus_peers.cc:597] T 73c339ffbbca40c78c31d33aa9bb9e38 P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:55.456605  5286 consensus_peers.cc:597] T 60775d8dc53c4243a0d744fd843c5cd5 P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:55.520962  5286 consensus_peers.cc:597] T c6bbe6dd572c4ea4aaf323c36eb05467 P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:55.526666 28234 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:15:55.526858  5286 consensus_peers.cc:597] T 22ee19164403428187e72d7a7c868457 P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:55.528141 28234 tablet_replica.cc:333] T 3d6bcda036934682b5075c20b786026d P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
I20260709 13:15:55.529132 28234 raft_consensus.cc:2243] T 3d6bcda036934682b5075c20b786026d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.529737 28234 raft_consensus.cc:2272] T 3d6bcda036934682b5075c20b786026d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.532433 28234 tablet_replica.cc:333] T 3e101cf4ae084c74af284008876e474e P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
I20260709 13:15:55.533372 28234 raft_consensus.cc:2243] T 3e101cf4ae084c74af284008876e474e P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:55.534372 28234 raft_consensus.cc:2272] T 3e101cf4ae084c74af284008876e474e P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.536701 28234 tablet_replica.cc:333] T 3b01a00074004ddb87b1710a6555353b P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
I20260709 13:15:55.537509 28234 raft_consensus.cc:2243] T 3b01a00074004ddb87b1710a6555353b P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:55.538563 28234 raft_consensus.cc:2272] T 3b01a00074004ddb87b1710a6555353b P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.540997 28234 tablet_replica.cc:333] T 6a1e233f50be40f78b9208537916e93c P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
I20260709 13:15:55.541958 28234 raft_consensus.cc:2243] T 6a1e233f50be40f78b9208537916e93c P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.542868 28234 raft_consensus.cc:2272] T 6a1e233f50be40f78b9208537916e93c P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.546070 28234 tablet_replica.cc:333] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
I20260709 13:15:55.547048 28234 raft_consensus.cc:2243] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:55.548272 28234 raft_consensus.cc:2272] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:55.548542  5434 consensus_peers.cc:597] T fce0170182474e7dbe46361f5bf0eae9 P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:55.551072  5434 consensus_peers.cc:597] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:55.551301 28234 tablet_replica.cc:333] T 39d465e757b14de1842d55d52271bceb P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
I20260709 13:15:55.552488 28234 raft_consensus.cc:2243] T 39d465e757b14de1842d55d52271bceb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.553197 28234 raft_consensus.cc:2272] T 39d465e757b14de1842d55d52271bceb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.556658 28234 tablet_replica.cc:333] T c520b1f4431848d1967291be272086c5 P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
W20260709 13:15:55.557920  5286 consensus_peers.cc:597] T 02dba91c167a418daee105670577c8aa P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:55.559000 28234 raft_consensus.cc:2243] T c520b1f4431848d1967291be272086c5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.559638 28234 raft_consensus.cc:2272] T c520b1f4431848d1967291be272086c5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.563172 28234 tablet_replica.cc:333] T 58438f196e6d42cc8780742faa222dc8 P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
I20260709 13:15:55.564488 28234 raft_consensus.cc:2243] T 58438f196e6d42cc8780742faa222dc8 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.564942 28234 raft_consensus.cc:2272] T 58438f196e6d42cc8780742faa222dc8 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.570130 28234 tablet_replica.cc:333] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
W20260709 13:15:55.570907  5286 consensus_peers.cc:597] T 5b17eb476da34f05b466923d9c48cc2d P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:55.571095 28234 raft_consensus.cc:2243] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.572222 28234 raft_consensus.cc:2272] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:55.572782  5434 consensus_peers.cc:597] T 3d6bcda036934682b5075c20b786026d P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:55.574764 28234 tablet_replica.cc:333] T 73c339ffbbca40c78c31d33aa9bb9e38 P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
I20260709 13:15:55.575843 28234 raft_consensus.cc:2243] T 73c339ffbbca40c78c31d33aa9bb9e38 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.576440 28234 raft_consensus.cc:2272] T 73c339ffbbca40c78c31d33aa9bb9e38 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.579660 28234 tablet_replica.cc:333] T 5b17eb476da34f05b466923d9c48cc2d P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
I20260709 13:15:55.581369 28234 raft_consensus.cc:2243] T 5b17eb476da34f05b466923d9c48cc2d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.581977 28234 raft_consensus.cc:2272] T 5b17eb476da34f05b466923d9c48cc2d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.584874 28234 tablet_replica.cc:333] T c6bbe6dd572c4ea4aaf323c36eb05467 P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
I20260709 13:15:55.585824 28234 raft_consensus.cc:2243] T c6bbe6dd572c4ea4aaf323c36eb05467 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.586357 28234 raft_consensus.cc:2272] T c6bbe6dd572c4ea4aaf323c36eb05467 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.588934 28234 tablet_replica.cc:333] T cb26053fad7244cd88a5182d9cfc2109 P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
I20260709 13:15:55.589628 28234 raft_consensus.cc:2243] T cb26053fad7244cd88a5182d9cfc2109 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.590112 28234 raft_consensus.cc:2272] T cb26053fad7244cd88a5182d9cfc2109 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.592547 28234 tablet_replica.cc:333] T 09e39d6f01a0444bb1aa42b5403943c8 P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
I20260709 13:15:55.593283 28234 raft_consensus.cc:2243] T 09e39d6f01a0444bb1aa42b5403943c8 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.593837 28234 raft_consensus.cc:2272] T 09e39d6f01a0444bb1aa42b5403943c8 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.596225 28234 tablet_replica.cc:333] T 22ee19164403428187e72d7a7c868457 P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
I20260709 13:15:55.596930 28234 raft_consensus.cc:2243] T 22ee19164403428187e72d7a7c868457 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.597447 28234 raft_consensus.cc:2272] T 22ee19164403428187e72d7a7c868457 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.600281 28234 tablet_replica.cc:333] T 34516de894fc408b8e355aba3402489c P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
I20260709 13:15:55.600986 28234 raft_consensus.cc:2243] T 34516de894fc408b8e355aba3402489c P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.601541 28234 raft_consensus.cc:2272] T 34516de894fc408b8e355aba3402489c P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.604417 28234 tablet_replica.cc:333] T 1db09971a25441c68427b8bea7e9c379 P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
I20260709 13:15:55.605358 28234 raft_consensus.cc:2243] T 1db09971a25441c68427b8bea7e9c379 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.605892 28234 raft_consensus.cc:2272] T 1db09971a25441c68427b8bea7e9c379 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.608649 28234 tablet_replica.cc:333] T 99cdbf6d16c64a949df77a003bb7f7e4 P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
I20260709 13:15:55.609337 28234 raft_consensus.cc:2243] T 99cdbf6d16c64a949df77a003bb7f7e4 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.609884 28234 raft_consensus.cc:2272] T 99cdbf6d16c64a949df77a003bb7f7e4 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.613029 28234 tablet_replica.cc:333] T 0796f5098e2a48c992868bbffce02505 P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
I20260709 13:15:55.613958 28234 raft_consensus.cc:2243] T 0796f5098e2a48c992868bbffce02505 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.614595 28234 raft_consensus.cc:2272] T 0796f5098e2a48c992868bbffce02505 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:55.616820  5434 consensus_peers.cc:597] T 480c812524814775bbf2823e53a996ed P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:55.617928 28234 tablet_replica.cc:333] T 4bc60d69f29e47689fd8fdf2b6aa836a P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
I20260709 13:15:55.618786 28234 raft_consensus.cc:2243] T 4bc60d69f29e47689fd8fdf2b6aa836a P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.619328 28234 raft_consensus.cc:2272] T 4bc60d69f29e47689fd8fdf2b6aa836a P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.622262 28234 tablet_replica.cc:333] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
I20260709 13:15:55.623031 28234 raft_consensus.cc:2243] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:55.624171 28234 raft_consensus.cc:2272] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.627162 28234 tablet_replica.cc:333] T 068e5bd8f3ef45fc8a4a122e51537764 P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
I20260709 13:15:55.627954 28234 raft_consensus.cc:2243] T 068e5bd8f3ef45fc8a4a122e51537764 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:55.628937 28234 raft_consensus.cc:2272] T 068e5bd8f3ef45fc8a4a122e51537764 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.632133 28234 tablet_replica.cc:333] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
I20260709 13:15:55.632997 28234 raft_consensus.cc:2243] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.633692 28234 raft_consensus.cc:2272] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.637106 28234 tablet_replica.cc:333] T 02dba91c167a418daee105670577c8aa P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
I20260709 13:15:55.638008 28234 raft_consensus.cc:2243] T 02dba91c167a418daee105670577c8aa P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.638808 28234 raft_consensus.cc:2272] T 02dba91c167a418daee105670577c8aa P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:55.640586  5360 consensus_peers.cc:597] T 58438f196e6d42cc8780742faa222dc8 P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:55.641711 28234 tablet_replica.cc:333] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
I20260709 13:15:55.642508 28234 raft_consensus.cc:2243] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.643036 28234 raft_consensus.cc:2272] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.646016 28234 tablet_replica.cc:333] T 309fb72c5b374642bb05a78b0b5ca308 P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
I20260709 13:15:55.646929 28234 raft_consensus.cc:2243] T 309fb72c5b374642bb05a78b0b5ca308 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:55.647980 28234 raft_consensus.cc:2272] T 309fb72c5b374642bb05a78b0b5ca308 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.650638 28234 tablet_replica.cc:333] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
I20260709 13:15:55.651481 28234 raft_consensus.cc:2243] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.652153 28234 raft_consensus.cc:2272] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.655241 28234 tablet_replica.cc:333] T e78312bda196492eae76f2673c979fee P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
W20260709 13:15:55.655547  5360 consensus_peers.cc:597] T 4bc60d69f29e47689fd8fdf2b6aa836a P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:55.655686  5286 consensus_peers.cc:597] T 7541727e0e0944a6b184ac464bcc6eee P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:55.656188 28234 raft_consensus.cc:2243] T e78312bda196492eae76f2673c979fee P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.656806 28234 raft_consensus.cc:2272] T e78312bda196492eae76f2673c979fee P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.659168 28234 tablet_replica.cc:333] T bdbcf0a951c24340ba91509df11fc4c7 P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
I20260709 13:15:55.659924 28234 raft_consensus.cc:2243] T bdbcf0a951c24340ba91509df11fc4c7 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:55.661355 28234 raft_consensus.cc:2272] T bdbcf0a951c24340ba91509df11fc4c7 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.663911 28234 tablet_replica.cc:333] T 4d479dd9f8c04491bb1e78273726187f P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
I20260709 13:15:55.664629 28234 raft_consensus.cc:2243] T 4d479dd9f8c04491bb1e78273726187f P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.665148 28234 raft_consensus.cc:2272] T 4d479dd9f8c04491bb1e78273726187f P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.667558 28234 tablet_replica.cc:333] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
I20260709 13:15:55.668217 28234 raft_consensus.cc:2243] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:55.669111 28234 raft_consensus.cc:2272] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.671867 28234 tablet_replica.cc:333] T 3ba8874bed41499cadc73289e5bb4ad3 P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
I20260709 13:15:55.672494 28234 raft_consensus.cc:2243] T 3ba8874bed41499cadc73289e5bb4ad3 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:55.673612 28234 raft_consensus.cc:2272] T 3ba8874bed41499cadc73289e5bb4ad3 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.676288 28234 tablet_replica.cc:333] T 7c0e035a21aa4d43857f541259fa71b9 P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
I20260709 13:15:55.676999 28234 raft_consensus.cc:2243] T 7c0e035a21aa4d43857f541259fa71b9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.677548 28234 raft_consensus.cc:2272] T 7c0e035a21aa4d43857f541259fa71b9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.681268 28234 tablet_replica.cc:333] T 436bb2869b55478b9c1cc99b5f83f981 P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
I20260709 13:15:55.682250 28234 raft_consensus.cc:2243] T 436bb2869b55478b9c1cc99b5f83f981 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.683019 28234 raft_consensus.cc:2272] T 436bb2869b55478b9c1cc99b5f83f981 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.686659 28234 tablet_replica.cc:333] T 7541727e0e0944a6b184ac464bcc6eee P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
I20260709 13:15:55.687805 28234 raft_consensus.cc:2243] T 7541727e0e0944a6b184ac464bcc6eee P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.688524 28234 raft_consensus.cc:2272] T 7541727e0e0944a6b184ac464bcc6eee P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.691892 28234 tablet_replica.cc:333] T 0fde317f3ec547c3840e2fe1e07ec228 P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
I20260709 13:15:55.692883 28234 raft_consensus.cc:2243] T 0fde317f3ec547c3840e2fe1e07ec228 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.693552 28234 raft_consensus.cc:2272] T 0fde317f3ec547c3840e2fe1e07ec228 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:55.693751  5286 consensus_peers.cc:597] T 1db09971a25441c68427b8bea7e9c379 P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:55.696897 28234 tablet_replica.cc:333] T d443132476914cd1958f499f68f8acd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
I20260709 13:15:55.697664 28234 raft_consensus.cc:2243] T d443132476914cd1958f499f68f8acd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:55.699182 28234 raft_consensus.cc:2272] T d443132476914cd1958f499f68f8acd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.702229 28234 tablet_replica.cc:333] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
I20260709 13:15:55.702884 28234 raft_consensus.cc:2243] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:55.704151 28234 raft_consensus.cc:2272] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.706769 28234 tablet_replica.cc:333] T 8e80c7aca57e4dc6bdd366ef7501749f P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
I20260709 13:15:55.707585 28234 raft_consensus.cc:2243] T 8e80c7aca57e4dc6bdd366ef7501749f P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:55.708580 28234 raft_consensus.cc:2272] T 8e80c7aca57e4dc6bdd366ef7501749f P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:55.711144  5434 consensus_peers.cc:597] T 0796f5098e2a48c992868bbffce02505 P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:55.711863 28234 tablet_replica.cc:333] T 60775d8dc53c4243a0d744fd843c5cd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
I20260709 13:15:55.712697 28234 raft_consensus.cc:2243] T 60775d8dc53c4243a0d744fd843c5cd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.713207 28234 raft_consensus.cc:2272] T 60775d8dc53c4243a0d744fd843c5cd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.716020 28234 tablet_replica.cc:333] T f3f19e79faea4bdbae72383e79104b37 P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
I20260709 13:15:55.717032 28234 raft_consensus.cc:2243] T f3f19e79faea4bdbae72383e79104b37 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.717870 28234 raft_consensus.cc:2272] T f3f19e79faea4bdbae72383e79104b37 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.720263 28234 tablet_replica.cc:333] T 480c812524814775bbf2823e53a996ed P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
I20260709 13:15:55.721128 28234 raft_consensus.cc:2243] T 480c812524814775bbf2823e53a996ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.721822 28234 raft_consensus.cc:2272] T 480c812524814775bbf2823e53a996ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:55.721752  5360 consensus_peers.cc:597] T c520b1f4431848d1967291be272086c5 P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:55.724682 28234 tablet_replica.cc:333] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
I20260709 13:15:55.725287 28234 raft_consensus.cc:2243] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:55.726150 28234 raft_consensus.cc:2272] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.728446 28234 tablet_replica.cc:333] T bd6573fdc5bd411e8b0cbd3316ecaede P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
I20260709 13:15:55.728994 28234 raft_consensus.cc:2243] T bd6573fdc5bd411e8b0cbd3316ecaede P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:55.729532 28234 raft_consensus.cc:2272] T bd6573fdc5bd411e8b0cbd3316ecaede P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:55.732009 28234 tablet_replica.cc:333] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba: stopping tablet replica
I20260709 13:15:55.732574 28234 raft_consensus.cc:2243] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:55.733672 28234 raft_consensus.cc:2272] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:55.743325  5360 consensus_peers.cc:597] T 436bb2869b55478b9c1cc99b5f83f981 P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:55.749908  5360 consensus_peers.cc:597] T 39d465e757b14de1842d55d52271bceb P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:55.750777  5360 consensus_peers.cc:597] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:55.765853  5286 consensus_peers.cc:597] T 6a1e233f50be40f78b9208537916e93c P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:55.774833  5360 consensus_peers.cc:597] T 0fde317f3ec547c3840e2fe1e07ec228 P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:55.781237  5360 consensus_peers.cc:597] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:55.781474  5286 consensus_peers.cc:597] T 09e39d6f01a0444bb1aa42b5403943c8 P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:55.829859 28234 tablet_server.cc:196] TabletServer@127.27.146.129:0 shutdown complete.
W20260709 13:15:55.859213  5286 consensus_peers.cc:597] T 71b75232471f416bb2d0ec813f32558e P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:55.859853  5286 consensus_peers.cc:597] T 29ec9fd2ee334861a956e4d70d348b6d P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:55.873399  5286 consensus_peers.cc:597] T f3f19e79faea4bdbae72383e79104b37 P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:55.906333  5434 consensus_peers.cc:597] T 99cdbf6d16c64a949df77a003bb7f7e4 P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:55.912488  5360 consensus_peers.cc:597] T 4d479dd9f8c04491bb1e78273726187f P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:55.950644 28234 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:55.960219  6116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:55.963202  6117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:55.965166  5360 consensus_peers.cc:597] T 34516de894fc408b8e355aba3402489c P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:55.969281  6119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:55.969424 28234 server_base.cc:1061] running on GCE node
I20260709 13:15:55.973016 28234 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:55.973389 28234 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:55.973647 28234 hybrid_clock.cc:648] HybridClock initialized: now 1783602955973626 us; error 0 us; skew 500 ppm
I20260709 13:15:55.974608 28234 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:55.983630 28234 webserver.cc:533] Webserver started at http://127.27.146.129:38789/ using document root <none> and password file <none>
I20260709 13:15:55.985522 28234 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:55.985850 28234 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:15:55.991417 28234 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:15:56.003880  6124 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:56.006870 28234 fs_manager.cc:730] Time spent opening block manager: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:15:56.007393 28234 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602648606606-28234-0/minicluster-data/ts-0-root
uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
format_stamp: "Formatted at 2026-07-09 13:15:38 on dist-test-slave-clfv"
I20260709 13:15:56.007987 28234 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602648606606-28234-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602648606606-28234-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602648606606-28234-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:15:56.009482  5434 consensus_peers.cc:597] T cb26053fad7244cd88a5182d9cfc2109 P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:56.012951  5286 consensus_peers.cc:597] T bd6573fdc5bd411e8b0cbd3316ecaede P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:56.043469 28234 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:56.045441 28234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:56.047379 28234 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:56.055596  6132 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:15:56.441006 28234 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:15:56.441447 28234 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.390s	user 0.009s	sys 0.003s
I20260709 13:15:56.441824 28234 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:15:56.451946  6132 tablet_bootstrap.cc:492] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:56.478013  6132 tablet_bootstrap.cc:492] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:56.479185  6132 tablet_bootstrap.cc:492] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:15:56.479930  6132 ts_tablet_manager.cc:1403] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.004s
I20260709 13:15:56.482720  6132 raft_consensus.cc:359] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:56.483609  6132 raft_consensus.cc:740] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:56.484588  6132 consensus_queue.cc:260] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:56.497833  6132 ts_tablet_manager.cc:1434] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.008s
I20260709 13:15:56.498754  6132 tablet_bootstrap.cc:492] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:56.515527  6132 tablet_bootstrap.cc:492] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:56.516692  6132 tablet_bootstrap.cc:492] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:15:56.517398  6132 ts_tablet_manager.cc:1403] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:15:56.519557  6132 raft_consensus.cc:359] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:56.520287  6132 raft_consensus.cc:740] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:56.520952  6132 consensus_queue.cc:260] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:56.522557  6132 ts_tablet_manager.cc:1434] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:15:56.523423  6132 tablet_bootstrap.cc:492] T 4bc60d69f29e47689fd8fdf2b6aa836a P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:56.549933  6132 tablet_bootstrap.cc:492] T 4bc60d69f29e47689fd8fdf2b6aa836a P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:56.551015  6132 tablet_bootstrap.cc:492] T 4bc60d69f29e47689fd8fdf2b6aa836a P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:15:56.551775  6132 ts_tablet_manager.cc:1403] T 4bc60d69f29e47689fd8fdf2b6aa836a P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.008s
I20260709 13:15:56.554723  6132 raft_consensus.cc:359] T 4bc60d69f29e47689fd8fdf2b6aa836a P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:56.555467  6132 raft_consensus.cc:740] T 4bc60d69f29e47689fd8fdf2b6aa836a P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:56.556209  6132 consensus_queue.cc:260] T 4bc60d69f29e47689fd8fdf2b6aa836a P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:56.558319  6132 ts_tablet_manager.cc:1434] T 4bc60d69f29e47689fd8fdf2b6aa836a P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 13:15:56.559250  6132 tablet_bootstrap.cc:492] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:56.578377  6132 tablet_bootstrap.cc:492] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=1 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:56.579418  6132 tablet_bootstrap.cc:492] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:15:56.580154  6132 ts_tablet_manager.cc:1403] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.004s
I20260709 13:15:56.582813  6132 raft_consensus.cc:359] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:56.583540  6132 raft_consensus.cc:740] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:56.584173  6132 consensus_queue.cc:260] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:56.586220  6132 ts_tablet_manager.cc:1434] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:15:56.587093  6132 tablet_bootstrap.cc:492] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:56.604785  6132 tablet_bootstrap.cc:492] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:56.605839  6132 tablet_bootstrap.cc:492] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:15:56.606745  6132 ts_tablet_manager.cc:1403] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:15:56.609560  6132 raft_consensus.cc:359] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:56.610340  6132 raft_consensus.cc:740] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:56.611096  6132 consensus_queue.cc:260] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:56.613245  6132 ts_tablet_manager.cc:1434] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.006s	user 0.009s	sys 0.000s
I20260709 13:15:56.614257  6132 tablet_bootstrap.cc:492] T 22ee19164403428187e72d7a7c868457 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:56.635774  6115 raft_consensus.cc:493] T b1ab7b32db51471796738b38f71b64df P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:15:56.636452  6115 raft_consensus.cc:515] T b1ab7b32db51471796738b38f71b64df P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:56.643342  6132 tablet_bootstrap.cc:492] T 22ee19164403428187e72d7a7c868457 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:56.644665  6132 tablet_bootstrap.cc:492] T 22ee19164403428187e72d7a7c868457 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:15:56.645493  6132 ts_tablet_manager.cc:1403] T 22ee19164403428187e72d7a7c868457 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.000s
I20260709 13:15:56.648604  6132 raft_consensus.cc:359] T 22ee19164403428187e72d7a7c868457 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:56.649466  6132 raft_consensus.cc:740] T 22ee19164403428187e72d7a7c868457 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:56.651767  6132 consensus_queue.cc:260] T 22ee19164403428187e72d7a7c868457 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:56.654186  6132 ts_tablet_manager.cc:1434] T 22ee19164403428187e72d7a7c868457 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:15:56.654332  6060 raft_consensus.cc:493] T 3ba8874bed41499cadc73289e5bb4ad3 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:15:56.655207  6132 tablet_bootstrap.cc:492] T 7c0e035a21aa4d43857f541259fa71b9 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:56.654958  6060 raft_consensus.cc:515] T 3ba8874bed41499cadc73289e5bb4ad3 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:56.659392  5317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ab7b32db51471796738b38f71b64df" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:56.660503  5465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8874bed41499cadc73289e5bb4ad3" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:56.662400  6115 leader_election.cc:290] T b1ab7b32db51471796738b38f71b64df P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
W20260709 13:15:56.669006  5360 leader_election.cc:336] T b1ab7b32db51471796738b38f71b64df P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
I20260709 13:15:56.669816  5360 leader_election.cc:304] T b1ab7b32db51471796738b38f71b64df P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b52f14f9154b5a86f76fe58e4c235e; no voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:56.671900  5979 raft_consensus.cc:2749] T b1ab7b32db51471796738b38f71b64df P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.680330  6060 leader_election.cc:290] T 3ba8874bed41499cadc73289e5bb4ad3 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:56.683290  6132 tablet_bootstrap.cc:492] T 7c0e035a21aa4d43857f541259fa71b9 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:56.684744  6132 tablet_bootstrap.cc:492] T 7c0e035a21aa4d43857f541259fa71b9 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:15:56.685581  6132 ts_tablet_manager.cc:1403] T 7c0e035a21aa4d43857f541259fa71b9 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.031s	user 0.025s	sys 0.003s
W20260709 13:15:56.685936  5360 leader_election.cc:336] T 3ba8874bed41499cadc73289e5bb4ad3 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
I20260709 13:15:56.686487  5360 leader_election.cc:304] T 3ba8874bed41499cadc73289e5bb4ad3 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b52f14f9154b5a86f76fe58e4c235e; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, 77789aa45dc5463c82b73504fef4b4e0
I20260709 13:15:56.687587  6060 raft_consensus.cc:2749] T 3ba8874bed41499cadc73289e5bb4ad3 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.688796  6132 raft_consensus.cc:359] T 7c0e035a21aa4d43857f541259fa71b9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:56.689630  6132 raft_consensus.cc:740] T 7c0e035a21aa4d43857f541259fa71b9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:56.690512  6132 consensus_queue.cc:260] T 7c0e035a21aa4d43857f541259fa71b9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:56.692649  6132 ts_tablet_manager.cc:1434] T 7c0e035a21aa4d43857f541259fa71b9 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:56.693511  6132 tablet_bootstrap.cc:492] T f3f19e79faea4bdbae72383e79104b37 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:56.725216  6132 tablet_bootstrap.cc:492] T f3f19e79faea4bdbae72383e79104b37 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:56.726439  6132 tablet_bootstrap.cc:492] T f3f19e79faea4bdbae72383e79104b37 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:15:56.727460  6132 ts_tablet_manager.cc:1403] T f3f19e79faea4bdbae72383e79104b37 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.004s
I20260709 13:15:56.730208  6132 raft_consensus.cc:359] T f3f19e79faea4bdbae72383e79104b37 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:56.730937  6132 raft_consensus.cc:740] T f3f19e79faea4bdbae72383e79104b37 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:56.731688  6132 consensus_queue.cc:260] T f3f19e79faea4bdbae72383e79104b37 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:56.734156  6132 ts_tablet_manager.cc:1434] T f3f19e79faea4bdbae72383e79104b37 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:56.735011  6132 tablet_bootstrap.cc:492] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:56.735615  6133 raft_consensus.cc:493] T bdbcf0a951c24340ba91509df11fc4c7 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:15:56.736239  6133 raft_consensus.cc:515] T bdbcf0a951c24340ba91509df11fc4c7 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:56.738792  6133 leader_election.cc:290] T bdbcf0a951c24340ba91509df11fc4c7 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:56.740756  5465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbcf0a951c24340ba91509df11fc4c7" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
W20260709 13:15:56.745728  5286 leader_election.cc:336] T bdbcf0a951c24340ba91509df11fc4c7 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
I20260709 13:15:56.746269  5286 leader_election.cc:304] T bdbcf0a951c24340ba91509df11fc4c7 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, 77789aa45dc5463c82b73504fef4b4e0
I20260709 13:15:56.748373  6134 raft_consensus.cc:2749] T bdbcf0a951c24340ba91509df11fc4c7 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.753397  6132 tablet_bootstrap.cc:492] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:56.755617  6132 tablet_bootstrap.cc:492] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:15:56.756347  6132 ts_tablet_manager.cc:1403] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.000s
I20260709 13:15:56.759428  6132 raft_consensus.cc:359] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:56.760210  6132 raft_consensus.cc:740] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:56.760931  6132 consensus_queue.cc:260] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:56.763088  6132 ts_tablet_manager.cc:1434] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:56.764043  6132 tablet_bootstrap.cc:492] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:56.770556 28234 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:15:56.771028 28234 ts_tablet_manager.cc:595] Time spent register tablets: real 0.329s	user 0.306s	sys 0.016s
I20260709 13:15:56.777567  6143 raft_consensus.cc:493] T bdbcf0a951c24340ba91509df11fc4c7 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:15:56.778251  6143 raft_consensus.cc:515] T bdbcf0a951c24340ba91509df11fc4c7 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:56.779938  6110 raft_consensus.cc:493] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:15:56.780594  6110 raft_consensus.cc:515] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:56.785725  5317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63267e5ca2594b41844fd758ca603a34" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:56.785249  6132 tablet_bootstrap.cc:492] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:56.787654  6129 raft_consensus.cc:493] T 3b01a00074004ddb87b1710a6555353b P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:15:56.788327  6129 raft_consensus.cc:515] T 3b01a00074004ddb87b1710a6555353b P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:56.790663  6129 leader_election.cc:290] T 3b01a00074004ddb87b1710a6555353b P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:56.791723  6132 tablet_bootstrap.cc:492] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:15:56.792680  6132 ts_tablet_manager.cc:1403] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.006s
I20260709 13:15:56.792740  5317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b01a00074004ddb87b1710a6555353b" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:56.796494  6132 raft_consensus.cc:359] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:56.797708  6132 raft_consensus.cc:740] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:56.798411  6132 consensus_queue.cc:260] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:56.800407  6132 ts_tablet_manager.cc:1434] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:15:56.801318  6132 tablet_bootstrap.cc:492] T 480c812524814775bbf2823e53a996ed P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
W20260709 13:15:56.802135  5434 leader_election.cc:336] T bdbcf0a951c24340ba91509df11fc4c7 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
I20260709 13:15:56.802399  6134 raft_consensus.cc:493] T 8aac85b71e404ee1bcfb748bfb0376fb P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:15:56.803103  6134 raft_consensus.cc:515] T 8aac85b71e404ee1bcfb748bfb0376fb P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:56.805467  6134 leader_election.cc:290] T 8aac85b71e404ee1bcfb748bfb0376fb P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:56.808393  5465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aac85b71e404ee1bcfb748bfb0376fb" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
W20260709 13:15:56.803128  5434 leader_election.cc:336] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
I20260709 13:15:56.812549  6143 leader_election.cc:290] T bdbcf0a951c24340ba91509df11fc4c7 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:56.814713  5317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbcf0a951c24340ba91509df11fc4c7" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:56.811735  5434 leader_election.cc:304] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0; no voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:56.817765  5317 raft_consensus.cc:2468] T bdbcf0a951c24340ba91509df11fc4c7 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 1.
I20260709 13:15:56.818086  6143 raft_consensus.cc:2749] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:15:56.814554  5286 leader_election.cc:336] T 8aac85b71e404ee1bcfb748bfb0376fb P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
I20260709 13:15:56.815431  6110 leader_election.cc:290] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:56.819533  5433 leader_election.cc:304] T bdbcf0a951c24340ba91509df11fc4c7 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:56.820909  6110 raft_consensus.cc:2804] T bdbcf0a951c24340ba91509df11fc4c7 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:56.821419  6110 raft_consensus.cc:493] T bdbcf0a951c24340ba91509df11fc4c7 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:15:56.821907  6110 raft_consensus.cc:3060] T bdbcf0a951c24340ba91509df11fc4c7 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.826339  5286 leader_election.cc:304] T 8aac85b71e404ee1bcfb748bfb0376fb P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, 77789aa45dc5463c82b73504fef4b4e0
I20260709 13:15:56.831751  6133 raft_consensus.cc:2749] T 8aac85b71e404ee1bcfb748bfb0376fb P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:56.832613  6133 raft_consensus.cc:493] T 3e101cf4ae084c74af284008876e474e P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:15:56.832898  6132 tablet_bootstrap.cc:492] T 480c812524814775bbf2823e53a996ed P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:56.833127  6133 raft_consensus.cc:515] T 3e101cf4ae084c74af284008876e474e P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
W20260709 13:15:56.833621  5434 leader_election.cc:336] T 3b01a00074004ddb87b1710a6555353b P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
I20260709 13:15:56.834276  6132 tablet_bootstrap.cc:492] T 480c812524814775bbf2823e53a996ed P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:15:56.835096  6132 ts_tablet_manager.cc:1403] T 480c812524814775bbf2823e53a996ed P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.034s	user 0.023s	sys 0.004s
I20260709 13:15:56.836935  6133 leader_election.cc:290] T 3e101cf4ae084c74af284008876e474e P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:56.838387  6132 raft_consensus.cc:359] T 480c812524814775bbf2823e53a996ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:56.839656  6132 raft_consensus.cc:740] T 480c812524814775bbf2823e53a996ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:56.840322  5434 leader_election.cc:304] T 3b01a00074004ddb87b1710a6555353b P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0; no voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:56.840550  6132 consensus_queue.cc:260] T 480c812524814775bbf2823e53a996ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:56.843416  6132 ts_tablet_manager.cc:1434] T 480c812524814775bbf2823e53a996ed P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:15:56.843603  6134 raft_consensus.cc:493] T 3b01a00074004ddb87b1710a6555353b P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:15:56.844499  6132 tablet_bootstrap.cc:492] T 6a1e233f50be40f78b9208537916e93c P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:56.844195  6143 raft_consensus.cc:2749] T 3b01a00074004ddb87b1710a6555353b P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.844173  6134 raft_consensus.cc:515] T 3b01a00074004ddb87b1710a6555353b P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:56.845206  6129 raft_consensus.cc:493] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:15:56.845745  6129 raft_consensus.cc:515] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:56.847275  6134 leader_election.cc:290] T 3b01a00074004ddb87b1710a6555353b P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:56.847836  6129 leader_election.cc:290] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:56.850533  5465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b01a00074004ddb87b1710a6555353b" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:56.850558  5317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f5415006bb4218b579d580f0b9ff68" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:56.855049  5317 raft_consensus.cc:2468] T 29f5415006bb4218b579d580f0b9ff68 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 1.
I20260709 13:15:56.857519  5433 leader_election.cc:304] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0; no voters: 
I20260709 13:15:56.859076  5392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e101cf4ae084c74af284008876e474e" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:56.862848  6129 raft_consensus.cc:2804] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:56.863556  6129 raft_consensus.cc:493] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:15:56.864362  6129 raft_consensus.cc:3060] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.874970  6132 tablet_bootstrap.cc:492] T 6a1e233f50be40f78b9208537916e93c P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:56.875566  5465 raft_consensus.cc:2468] T 3b01a00074004ddb87b1710a6555353b P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 1.
I20260709 13:15:56.876663  6132 tablet_bootstrap.cc:492] T 6a1e233f50be40f78b9208537916e93c P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:15:56.877471  6132 ts_tablet_manager.cc:1403] T 6a1e233f50be40f78b9208537916e93c P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.008s
I20260709 13:15:56.877199  6110 raft_consensus.cc:515] T bdbcf0a951c24340ba91509df11fc4c7 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:56.880616  5315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdbcf0a951c24340ba91509df11fc4c7" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
W20260709 13:15:56.880896  5434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:41357, user_credentials={real_user=slave}} blocked reactor thread for 47325.1us
I20260709 13:15:56.881258  5315 raft_consensus.cc:3060] T bdbcf0a951c24340ba91509df11fc4c7 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:56.881688  5286 leader_election.cc:336] T 3e101cf4ae084c74af284008876e474e P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
I20260709 13:15:56.882143  5286 leader_election.cc:304] T 3e101cf4ae084c74af284008876e474e P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, c4b52f14f9154b5a86f76fe58e4c235e
W20260709 13:15:56.883064  5286 leader_election.cc:336] T 3b01a00074004ddb87b1710a6555353b P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
I20260709 13:15:56.883929  6133 raft_consensus.cc:2749] T 3e101cf4ae084c74af284008876e474e P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.884752  6110 leader_election.cc:290] T bdbcf0a951c24340ba91509df11fc4c7 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 2 election: Requested vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:56.886437  5284 leader_election.cc:304] T 3b01a00074004ddb87b1710a6555353b P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:56.887338  6133 raft_consensus.cc:2804] T 3b01a00074004ddb87b1710a6555353b P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:56.887745  6133 raft_consensus.cc:493] T 3b01a00074004ddb87b1710a6555353b P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:15:56.889365  6133 raft_consensus.cc:3060] T 3b01a00074004ddb87b1710a6555353b P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.894078  6132 raft_consensus.cc:359] T 6a1e233f50be40f78b9208537916e93c P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:56.894953  6132 raft_consensus.cc:740] T 6a1e233f50be40f78b9208537916e93c P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:56.895133  6143 raft_consensus.cc:493] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:15:56.895706  6143 raft_consensus.cc:515] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:56.895793  6132 consensus_queue.cc:260] T 6a1e233f50be40f78b9208537916e93c P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:56.898188  6132 ts_tablet_manager.cc:1434] T 6a1e233f50be40f78b9208537916e93c P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.006s
I20260709 13:15:56.899152  6132 tablet_bootstrap.cc:492] T 99cdbf6d16c64a949df77a003bb7f7e4 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:56.897961  6143 leader_election.cc:290] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:56.905933  5317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aac85b71e404ee1bcfb748bfb0376fb" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:56.906054  6133 raft_consensus.cc:515] T 3b01a00074004ddb87b1710a6555353b P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:56.906402  5315 raft_consensus.cc:2468] T bdbcf0a951c24340ba91509df11fc4c7 P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 2.
I20260709 13:15:56.907326  5317 raft_consensus.cc:2468] T 8aac85b71e404ee1bcfb748bfb0376fb P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 2.
I20260709 13:15:56.910101  6065 raft_consensus.cc:493] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:15:56.916589  6065 raft_consensus.cc:515] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
W20260709 13:15:56.917055  5286 leader_election.cc:336] T 3b01a00074004ddb87b1710a6555353b P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
I20260709 13:15:56.917927  5433 leader_election.cc:304] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0; no voters: 
I20260709 13:15:56.918823  6143 raft_consensus.cc:2804] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:56.919199  6143 raft_consensus.cc:493] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:15:56.911194  6133 leader_election.cc:290] T 3b01a00074004ddb87b1710a6555353b P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 election: Requested vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:56.919708  6143 raft_consensus.cc:3060] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:56.921113  6065 leader_election.cc:290] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:56.921618  5433 leader_election.cc:304] T bdbcf0a951c24340ba91509df11fc4c7 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0; no voters: 
I20260709 13:15:56.922755  5464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63267e5ca2594b41844fd758ca603a34" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
W20260709 13:15:56.913371  5434 leader_election.cc:336] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
I20260709 13:15:56.915042  5465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b01a00074004ddb87b1710a6555353b" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:15:56.923606  5464 raft_consensus.cc:2468] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 2.
I20260709 13:15:56.924034  5465 raft_consensus.cc:3060] T 3b01a00074004ddb87b1710a6555353b P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.924531  6110 raft_consensus.cc:2804] T bdbcf0a951c24340ba91509df11fc4c7 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:56.924882  5865 raft_consensus.cc:493] T 309fb72c5b374642bb05a78b0b5ca308 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:15:56.925088  5284 leader_election.cc:304] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0; no voters: 
I20260709 13:15:56.921654  6065 raft_consensus.cc:493] T 8e80c7aca57e4dc6bdd366ef7501749f P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
W20260709 13:15:56.926966  5434 leader_election.cc:336] T bdbcf0a951c24340ba91509df11fc4c7 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
I20260709 13:15:56.930264  5962 raft_consensus.cc:2804] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:56.936995  5962 raft_consensus.cc:493] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:15:56.937386  5962 raft_consensus.cc:3060] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:56.929141  5865 raft_consensus.cc:515] T 309fb72c5b374642bb05a78b0b5ca308 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:56.941872  5865 leader_election.cc:290] T 309fb72c5b374642bb05a78b0b5ca308 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:56.943720  5865 raft_consensus.cc:493] T 3ba8874bed41499cadc73289e5bb4ad3 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:15:56.944182  5865 raft_consensus.cc:515] T 3ba8874bed41499cadc73289e5bb4ad3 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:56.954412  5979 raft_consensus.cc:493] T 068e5bd8f3ef45fc8a4a122e51537764 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:15:56.955365  5979 raft_consensus.cc:515] T 068e5bd8f3ef45fc8a4a122e51537764 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:56.957749  5979 leader_election.cc:290] T 068e5bd8f3ef45fc8a4a122e51537764 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:56.958478  5979 raft_consensus.cc:493] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:15:56.961095  5979 raft_consensus.cc:515] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:56.958490  6111 raft_consensus.cc:493] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:15:56.966104  5865 leader_election.cc:290] T 3ba8874bed41499cadc73289e5bb4ad3 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:56.965811  6111 raft_consensus.cc:515] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:56.936582  6065 raft_consensus.cc:515] T 8e80c7aca57e4dc6bdd366ef7501749f P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:56.972409  6065 leader_election.cc:290] T 8e80c7aca57e4dc6bdd366ef7501749f P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:56.973786  5865 raft_consensus.cc:493] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:15:56.975786  5865 raft_consensus.cc:515] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:56.982415  6110 raft_consensus.cc:697] T bdbcf0a951c24340ba91509df11fc4c7 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 LEADER]: Becoming Leader. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Running, Role: LEADER
I20260709 13:15:56.984247  6110 consensus_queue.cc:237] T bdbcf0a951c24340ba91509df11fc4c7 P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:56.998597  5391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e80c7aca57e4dc6bdd366ef7501749f" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:57.000068  6111 leader_election.cc:290] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:56.965845  5317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309fb72c5b374642bb05a78b0b5ca308" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
W20260709 13:15:57.010200  5286 leader_election.cc:336] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
I20260709 13:15:56.996869  6135 raft_consensus.cc:493] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:15:57.029670  5979 leader_election.cc:290] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:57.025305  5962 raft_consensus.cc:515] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
W20260709 13:15:57.032119  5360 leader_election.cc:336] T 068e5bd8f3ef45fc8a4a122e51537764 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
I20260709 13:15:57.034977  5865 leader_election.cc:290] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:57.035812  5865 raft_consensus.cc:493] T d443132476914cd1958f499f68f8acd5 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:15:57.036401  5865 raft_consensus.cc:515] T d443132476914cd1958f499f68f8acd5 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:57.039309  5391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56fc1bf8741446b6ba1d4bb0c8fcb5ed" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:57.045393  5391 raft_consensus.cc:2468] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 1.
W20260709 13:15:57.045861  5286 leader_election.cc:336] T 8e80c7aca57e4dc6bdd366ef7501749f P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
I20260709 13:15:57.046360  5286 leader_election.cc:304] T 8e80c7aca57e4dc6bdd366ef7501749f P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:57.046679  6065 raft_consensus.cc:493] T 5d841937b5db4e7fa656db32b84b9ca2 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:15:57.047170  6134 raft_consensus.cc:2749] T 8e80c7aca57e4dc6bdd366ef7501749f P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:57.047227  6065 raft_consensus.cc:515] T 5d841937b5db4e7fa656db32b84b9ca2 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:57.049576  6065 leader_election.cc:290] T 5d841937b5db4e7fa656db32b84b9ca2 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:57.013952  6129 raft_consensus.cc:515] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
W20260709 13:15:57.053120  5360 leader_election.cc:336] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
I20260709 13:15:57.053284  6129 leader_election.cc:290] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 2 election: Requested vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:57.034515  6111 raft_consensus.cc:493] T d443132476914cd1958f499f68f8acd5 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:15:57.054479  6111 raft_consensus.cc:515] T d443132476914cd1958f499f68f8acd5 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:57.055321  5317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f5415006bb4218b579d580f0b9ff68" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:15:57.038079  6135 raft_consensus.cc:515] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:57.058106  6111 leader_election.cc:290] T d443132476914cd1958f499f68f8acd5 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:57.058653  5865 leader_election.cc:290] T d443132476914cd1958f499f68f8acd5 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:57.060240  6132 tablet_bootstrap.cc:492] T 99cdbf6d16c64a949df77a003bb7f7e4 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:57.061299  5962 leader_election.cc:290] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 3 election: Requested vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:57.041826  6143 raft_consensus.cc:515] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:57.064200  5286 leader_election.cc:304] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:57.065732  6143 leader_election.cc:290] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 3 election: Requested vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:57.056252  5317 raft_consensus.cc:3060] T 29f5415006bb4218b579d580f0b9ff68 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:57.075335  5465 raft_consensus.cc:2468] T 3b01a00074004ddb87b1710a6555353b P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 2.
I20260709 13:15:57.082078  5315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d443132476914cd1958f499f68f8acd5" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:57.083063  5315 raft_consensus.cc:2468] T d443132476914cd1958f499f68f8acd5 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 1.
I20260709 13:15:57.076076  6132 tablet_bootstrap.cc:492] T 99cdbf6d16c64a949df77a003bb7f7e4 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:15:57.086206  6132 ts_tablet_manager.cc:1403] T 99cdbf6d16c64a949df77a003bb7f7e4 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.187s	user 0.026s	sys 0.006s
I20260709 13:15:57.089169  5315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56fc1bf8741446b6ba1d4bb0c8fcb5ed" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:57.099807  5319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aac85b71e404ee1bcfb748bfb0376fb" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:15:57.100575  5319 raft_consensus.cc:3060] T 8aac85b71e404ee1bcfb748bfb0376fb P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:57.068164  6134 raft_consensus.cc:493] T b1ab7b32db51471796738b38f71b64df P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:15:57.101781  6134 raft_consensus.cc:515] T b1ab7b32db51471796738b38f71b64df P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:57.104110  6134 leader_election.cc:290] T b1ab7b32db51471796738b38f71b64df P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:57.103608  6132 raft_consensus.cc:359] T 99cdbf6d16c64a949df77a003bb7f7e4 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:57.087890  6111 raft_consensus.cc:2804] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:15:57.105957  5360 leader_election.cc:336] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
I20260709 13:15:57.107553  6132 raft_consensus.cc:740] T 99cdbf6d16c64a949df77a003bb7f7e4 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:57.108796  5433 leader_election.cc:304] T d443132476914cd1958f499f68f8acd5 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0; no voters: 
I20260709 13:15:57.076896  6135 leader_election.cc:290] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
W20260709 13:15:57.091625  5286 leader_election.cc:336] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
I20260709 13:15:57.134542  5284 leader_election.cc:304] T 3b01a00074004ddb87b1710a6555353b P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba
W20260709 13:15:57.158732  5286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:41357, user_credentials={real_user=slave}} blocked reactor thread for 67159.2us
I20260709 13:15:57.148391  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63267e5ca2594b41844fd758ca603a34" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:15:57.160156  5469 raft_consensus.cc:3060] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:57.160838  5433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:43623, user_credentials={real_user=slave}} blocked reactor thread for 52178.1us
I20260709 13:15:57.161890  5465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d841937b5db4e7fa656db32b84b9ca2" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:57.159760  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e101cf4ae084c74af284008876e474e" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:57.134749  5464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d443132476914cd1958f499f68f8acd5" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:57.111399  6132 consensus_queue.cc:260] T 99cdbf6d16c64a949df77a003bb7f7e4 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:57.164353  5962 raft_consensus.cc:2804] T 3b01a00074004ddb87b1710a6555353b P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:57.166153  5962 raft_consensus.cc:697] T 3b01a00074004ddb87b1710a6555353b P 2f45532f94a34efcb68a82db3dd69372 [term 2 LEADER]: Becoming Leader. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Running, Role: LEADER
I20260709 13:15:57.164989  5320 raft_consensus.cc:2468] T 3e101cf4ae084c74af284008876e474e P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 1.
I20260709 13:15:57.167341  5962 consensus_queue.cc:237] T 3b01a00074004ddb87b1710a6555353b P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:57.169880  5359 leader_election.cc:304] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:57.110651  6111 raft_consensus.cc:493] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:15:57.223192  5865 raft_consensus.cc:493] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:15:57.220050  5319 raft_consensus.cc:2468] T 8aac85b71e404ee1bcfb748bfb0376fb P 2f45532f94a34efcb68a82db3dd69372 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 3.
I20260709 13:15:57.162859  6143 raft_consensus.cc:2804] T d443132476914cd1958f499f68f8acd5 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:15:57.226001  5359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:43623, user_credentials={real_user=slave}} blocked reactor thread for 56242us
I20260709 13:15:57.225762  5979 raft_consensus.cc:493] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:15:57.228875  5865 raft_consensus.cc:515] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:57.228309  5979 raft_consensus.cc:515] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:57.246893  6132 ts_tablet_manager.cc:1434] T 99cdbf6d16c64a949df77a003bb7f7e4 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.160s	user 0.013s	sys 0.013s
I20260709 13:15:57.247985  6132 tablet_bootstrap.cc:492] T 58438f196e6d42cc8780742faa222dc8 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:57.168922  6162 raft_consensus.cc:493] T 309fb72c5b374642bb05a78b0b5ca308 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:15:57.226665  6111 raft_consensus.cc:3060] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:57.226454  6143 raft_consensus.cc:493] T d443132476914cd1958f499f68f8acd5 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:15:57.256577  5979 leader_election.cc:290] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:57.245333  6060 raft_consensus.cc:2804] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:57.255417  5391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ab7b32db51471796738b38f71b64df" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:57.282650  5865 leader_election.cc:290] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:57.259723  6143 raft_consensus.cc:3060] T d443132476914cd1958f499f68f8acd5 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:57.268632  6060 raft_consensus.cc:493] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
W20260709 13:15:57.297712  5434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:40847, user_credentials={real_user=slave}} blocked reactor thread for 359021us
I20260709 13:15:57.300827  5433 leader_election.cc:304] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0; no voters: 
I20260709 13:15:57.302651  6060 raft_consensus.cc:3060] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:57.254594  6162 raft_consensus.cc:515] T 309fb72c5b374642bb05a78b0b5ca308 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:57.300184  5391 raft_consensus.cc:2468] T b1ab7b32db51471796738b38f71b64df P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 1.
I20260709 13:15:57.310786  6165 raft_consensus.cc:2804] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:57.335327  5393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "068e5bd8f3ef45fc8a4a122e51537764" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:57.336145  5393 raft_consensus.cc:2468] T 068e5bd8f3ef45fc8a4a122e51537764 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 1.
I20260709 13:15:57.338445  6165 raft_consensus.cc:697] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 [term 3 LEADER]: Becoming Leader. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Running, Role: LEADER
I20260709 13:15:57.344794  6165 consensus_queue.cc:237] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:57.348922  6162 leader_election.cc:290] T 309fb72c5b374642bb05a78b0b5ca308 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:57.341312  5317 raft_consensus.cc:2468] T 29f5415006bb4218b579d580f0b9ff68 P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 2.
I20260709 13:15:57.350601  5433 leader_election.cc:304] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0; no voters: 
I20260709 13:15:57.351445  6175 raft_consensus.cc:2804] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:57.351991  6175 raft_consensus.cc:697] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 LEADER]: Becoming Leader. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Running, Role: LEADER
I20260709 13:15:57.355862  6175 consensus_queue.cc:237] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:57.369644  5394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8874bed41499cadc73289e5bb4ad3" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:57.370482  5394 raft_consensus.cc:2468] T 3ba8874bed41499cadc73289e5bb4ad3 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 1.
I20260709 13:15:57.374702  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e80c7aca57e4dc6bdd366ef7501749f" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:57.375631  5320 raft_consensus.cc:2468] T 8e80c7aca57e4dc6bdd366ef7501749f P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 1.
I20260709 13:15:57.374584  5469 raft_consensus.cc:2468] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 3.
I20260709 13:15:57.380177  5466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309fb72c5b374642bb05a78b0b5ca308" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:57.380981  5466 raft_consensus.cc:2468] T 309fb72c5b374642bb05a78b0b5ca308 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 1.
I20260709 13:15:57.382030  6111 raft_consensus.cc:515] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:57.383296  5315 raft_consensus.cc:2393] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c4b52f14f9154b5a86f76fe58e4c235e in current term 2: Already voted for candidate 2f45532f94a34efcb68a82db3dd69372 in this term.
I20260709 13:15:57.394999  5319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d841937b5db4e7fa656db32b84b9ca2" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:57.395959  5319 raft_consensus.cc:2468] T 5d841937b5db4e7fa656db32b84b9ca2 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 1.
I20260709 13:15:57.399402  5433 leader_election.cc:304] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0; no voters: 
I20260709 13:15:57.401682  6172 raft_consensus.cc:2804] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:57.402233  6172 raft_consensus.cc:493] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:15:57.402608  6172 raft_consensus.cc:3060] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:57.402930  5463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "068e5bd8f3ef45fc8a4a122e51537764" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:57.409734  5463 raft_consensus.cc:2468] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 1.
W20260709 13:15:57.415241  5434 leader_election.cc:336] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
W20260709 13:15:57.416550  5434 leader_election.cc:336] T 309fb72c5b374642bb05a78b0b5ca308 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
I20260709 13:15:57.417295  5144 catalog_manager.cc:5697] T bdbcf0a951c24340ba91509df11fc4c7 P 77789aa45dc5463c82b73504fef4b4e0 reported cstate change: term changed from 1 to 2, leader changed from 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129) to 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132). New cstate: current_term: 2 leader_uuid: "77789aa45dc5463c82b73504fef4b4e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:57.417039  5434 leader_election.cc:304] T 309fb72c5b374642bb05a78b0b5ca308 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0; no voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba
W20260709 13:15:57.425129  5360 leader_election.cc:336] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
W20260709 13:15:57.428884  5286 leader_election.cc:336] T 5d841937b5db4e7fa656db32b84b9ca2 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
I20260709 13:15:57.429651  5286 leader_election.cc:304] T 5d841937b5db4e7fa656db32b84b9ca2 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, 77789aa45dc5463c82b73504fef4b4e0
W20260709 13:15:57.429780  5359 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:43623, user_credentials={real_user=slave}} blocked reactor thread for 90197.5us
I20260709 13:15:57.432598  6060 raft_consensus.cc:515] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:57.431512  5359 leader_election.cc:304] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:57.454607  5979 raft_consensus.cc:2804] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:57.455192  5979 raft_consensus.cc:493] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:15:57.455658  5979 raft_consensus.cc:3060] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:57.462105  5359 leader_election.cc:304] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b52f14f9154b5a86f76fe58e4c235e; no voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:57.463699  6060 leader_election.cc:290] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 2 election: Requested vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:57.469091  5434 leader_election.cc:304] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:57.431942  6157 raft_consensus.cc:2749] T 309fb72c5b374642bb05a78b0b5ca308 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:57.467195  6134 raft_consensus.cc:2749] T 5d841937b5db4e7fa656db32b84b9ca2 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:57.484711  6060 raft_consensus.cc:3060] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:57.495579  6179 raft_consensus.cc:2804] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:57.496491  6179 raft_consensus.cc:493] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:15:57.495432  5142 catalog_manager.cc:5697] T 3b01a00074004ddb87b1710a6555353b P 2f45532f94a34efcb68a82db3dd69372 reported cstate change: term changed from 1 to 2, leader changed from 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129) to 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130). New cstate: current_term: 2 leader_uuid: "2f45532f94a34efcb68a82db3dd69372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:57.496838  6179 raft_consensus.cc:3060] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:57.496861  6111 leader_election.cc:290] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 election: Requested vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
W20260709 13:15:57.508823  5286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:41357, user_credentials={real_user=slave}} blocked reactor thread for 79969.6us
W20260709 13:15:57.511487  5286 leader_election.cc:336] T d443132476914cd1958f499f68f8acd5 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
I20260709 13:15:57.517578  5979 raft_consensus.cc:515] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:57.532562  5979 leader_election.cc:290] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 2 election: Requested vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
W20260709 13:15:57.543884  5286 leader_election.cc:336] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
W20260709 13:15:57.549593  5284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:41391, user_credentials={real_user=slave}} blocked reactor thread for 120399us
W20260709 13:15:57.554800  5434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:40847, user_credentials={real_user=slave}} blocked reactor thread for 83977.8us
I20260709 13:15:57.551014  5284 leader_election.cc:304] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:57.561051  5393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56fc1bf8741446b6ba1d4bb0c8fcb5ed" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:15:57.564770  5286 leader_election.cc:304] T b1ab7b32db51471796738b38f71b64df P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:57.542872  6060 raft_consensus.cc:2749] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:57.570259  5284 leader_election.cc:304] T 309fb72c5b374642bb05a78b0b5ca308 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0; no voters: 
I20260709 13:15:57.567647  5434 leader_election.cc:304] T 3ba8874bed41499cadc73289e5bb4ad3 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:57.582831  6134 raft_consensus.cc:2804] T 309fb72c5b374642bb05a78b0b5ca308 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:57.583385  6134 raft_consensus.cc:493] T 309fb72c5b374642bb05a78b0b5ca308 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:15:57.583921  6134 raft_consensus.cc:3060] T 309fb72c5b374642bb05a78b0b5ca308 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:57.586658  5360 leader_election.cc:336] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
I20260709 13:15:57.588330  6160 raft_consensus.cc:2804] T b1ab7b32db51471796738b38f71b64df P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:57.589003  6160 raft_consensus.cc:493] T b1ab7b32db51471796738b38f71b64df P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:15:57.589519  6160 raft_consensus.cc:3060] T b1ab7b32db51471796738b38f71b64df P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:57.591703  6170 raft_consensus.cc:2804] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:57.592634  6170 raft_consensus.cc:697] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372 [term 3 LEADER]: Becoming Leader. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Running, Role: LEADER
I20260709 13:15:57.593997  6170 consensus_queue.cc:237] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:57.598554  6179 raft_consensus.cc:515] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
W20260709 13:15:57.599687  5286 leader_election.cc:336] T b1ab7b32db51471796738b38f71b64df P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
I20260709 13:15:57.516165  6143 raft_consensus.cc:515] T d443132476914cd1958f499f68f8acd5 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:57.607103  6143 leader_election.cc:290] T d443132476914cd1958f499f68f8acd5 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 2 election: Requested vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:57.608487  5464 raft_consensus.cc:2393] T d443132476914cd1958f499f68f8acd5 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2f45532f94a34efcb68a82db3dd69372 in current term 2: Already voted for candidate 77789aa45dc5463c82b73504fef4b4e0 in this term.
I20260709 13:15:57.609421  5315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d443132476914cd1958f499f68f8acd5" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:15:57.610134  5315 raft_consensus.cc:3060] T d443132476914cd1958f499f68f8acd5 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:57.617676  5360 leader_election.cc:336] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
I20260709 13:15:57.619017  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e101cf4ae084c74af284008876e474e" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:15:57.619778  5320 raft_consensus.cc:3060] T 3e101cf4ae084c74af284008876e474e P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:57.625147  5319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e80c7aca57e4dc6bdd366ef7501749f" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:15:57.626122  5319 raft_consensus.cc:3060] T 8e80c7aca57e4dc6bdd366ef7501749f P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:57.624145  5434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:40847, user_credentials={real_user=slave}} blocked reactor thread for 56608.9us
I20260709 13:15:57.605782  6179 leader_election.cc:290] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 2 election: Requested vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:57.639567  6143 raft_consensus.cc:2804] T 3ba8874bed41499cadc73289e5bb4ad3 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:57.647073  6143 raft_consensus.cc:493] T 3ba8874bed41499cadc73289e5bb4ad3 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:15:57.647562  6143 raft_consensus.cc:3060] T 3ba8874bed41499cadc73289e5bb4ad3 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:57.647141  5320 raft_consensus.cc:2468] T 3e101cf4ae084c74af284008876e474e P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 2.
I20260709 13:15:57.660597  5359 leader_election.cc:304] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:57.662880  5284 leader_election.cc:304] T d443132476914cd1958f499f68f8acd5 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, 77789aa45dc5463c82b73504fef4b4e0
I20260709 13:15:57.663866  6174 raft_consensus.cc:2804] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:57.664466  6174 raft_consensus.cc:697] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e [term 2 LEADER]: Becoming Leader. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Running, Role: LEADER
I20260709 13:15:57.645398  6172 raft_consensus.cc:515] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:57.673168  5393 raft_consensus.cc:2468] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 2.
I20260709 13:15:57.672763  5315 raft_consensus.cc:2468] T d443132476914cd1958f499f68f8acd5 P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 2.
I20260709 13:15:57.675396  6174 consensus_queue.cc:237] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:57.678638  6172 leader_election.cc:290] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 2 election: Requested vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
W20260709 13:15:57.678671  5434 leader_election.cc:336] T 3ba8874bed41499cadc73289e5bb4ad3 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
W20260709 13:15:57.667948  5286 leader_election.cc:336] T 309fb72c5b374642bb05a78b0b5ca308 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
W20260709 13:15:57.687392  5434 leader_election.cc:336] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
W20260709 13:15:57.688309  5434 leader_election.cc:336] T d443132476914cd1958f499f68f8acd5 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
W20260709 13:15:57.688457  5286 leader_election.cc:336] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
W20260709 13:15:57.689191  5434 leader_election.cc:336] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
W20260709 13:15:57.690408  5434 leader_election.cc:336] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
W20260709 13:15:57.691373  5434 leader_election.cc:336] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
I20260709 13:15:57.682405  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d841937b5db4e7fa656db32b84b9ca2" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:15:57.694624  5320 raft_consensus.cc:3060] T 5d841937b5db4e7fa656db32b84b9ca2 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:57.682835  5319 raft_consensus.cc:2468] T 8e80c7aca57e4dc6bdd366ef7501749f P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 2.
I20260709 13:15:57.682549  6134 raft_consensus.cc:515] T 309fb72c5b374642bb05a78b0b5ca308 P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:57.684667  6191 raft_consensus.cc:2749] T d443132476914cd1958f499f68f8acd5 P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:57.684392  5358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:41391, user_credentials={real_user=slave}} blocked reactor thread for 117873us
I20260709 13:15:57.699002  5358 leader_election.cc:304] T 068e5bd8f3ef45fc8a4a122e51537764 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:57.700659  6134 leader_election.cc:290] T 309fb72c5b374642bb05a78b0b5ca308 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 election: Requested vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:57.701993  5464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309fb72c5b374642bb05a78b0b5ca308" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:15:57.702750  5464 raft_consensus.cc:3060] T 309fb72c5b374642bb05a78b0b5ca308 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:57.703869  6143 raft_consensus.cc:515] T 3ba8874bed41499cadc73289e5bb4ad3 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:57.686167  5433 leader_election.cc:304] T d443132476914cd1958f499f68f8acd5 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0; no voters: 
I20260709 13:15:57.706178  6143 leader_election.cc:290] T 3ba8874bed41499cadc73289e5bb4ad3 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 2 election: Requested vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:57.706833  6143 raft_consensus.cc:2804] T d443132476914cd1958f499f68f8acd5 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:57.702097  6188 raft_consensus.cc:2804] T 068e5bd8f3ef45fc8a4a122e51537764 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:57.708089  6188 raft_consensus.cc:493] T 068e5bd8f3ef45fc8a4a122e51537764 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:15:57.708464  6188 raft_consensus.cc:3060] T 068e5bd8f3ef45fc8a4a122e51537764 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:57.708473  5359 leader_election.cc:304] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba
W20260709 13:15:57.713408  5434 consensus_peers.cc:597] T bdbcf0a951c24340ba91509df11fc4c7 P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:57.715430  5286 leader_election.cc:304] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:57.715575  6060 raft_consensus.cc:2804] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:57.718645  6132 tablet_bootstrap.cc:492] T 58438f196e6d42cc8780742faa222dc8 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:57.707320  6143 raft_consensus.cc:697] T d443132476914cd1958f499f68f8acd5 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 LEADER]: Becoming Leader. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Running, Role: LEADER
W20260709 13:15:57.735816  5434 leader_election.cc:336] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
W20260709 13:15:57.736755  5434 leader_election.cc:336] T d443132476914cd1958f499f68f8acd5 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
W20260709 13:15:57.737623  5434 leader_election.cc:336] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
I20260709 13:15:57.738204  5315 raft_consensus.cc:1275] T bdbcf0a951c24340ba91509df11fc4c7 P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Refusing update from remote peer 77789aa45dc5463c82b73504fef4b4e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:57.740406  5393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "068e5bd8f3ef45fc8a4a122e51537764" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:15:57.741993  5464 raft_consensus.cc:2468] T 309fb72c5b374642bb05a78b0b5ca308 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 2.
I20260709 13:15:57.746062  6132 tablet_bootstrap.cc:492] T 58438f196e6d42cc8780742faa222dc8 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:15:57.746930  6111 raft_consensus.cc:2804] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:57.747797  6111 raft_consensus.cc:697] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 2f45532f94a34efcb68a82db3dd69372 [term 2 LEADER]: Becoming Leader. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Running, Role: LEADER
I20260709 13:15:57.749318  6111 consensus_queue.cc:237] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:57.750659  6060 raft_consensus.cc:697] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e [term 2 LEADER]: Becoming Leader. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Running, Role: LEADER
I20260709 13:15:57.747699  5388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8874bed41499cadc73289e5bb4ad3" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:15:57.751814  6060 consensus_queue.cc:237] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:57.752542  6143 consensus_queue.cc:237] T d443132476914cd1958f499f68f8acd5 P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:57.747246  6132 ts_tablet_manager.cc:1403] T 58438f196e6d42cc8780742faa222dc8 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.499s	user 0.027s	sys 0.028s
I20260709 13:15:57.744269  5284 leader_election.cc:304] T 309fb72c5b374642bb05a78b0b5ca308 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0; no voters: 
I20260709 13:15:57.751832  5388 raft_consensus.cc:3060] T 3ba8874bed41499cadc73289e5bb4ad3 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:57.771968  6191 raft_consensus.cc:2804] T 309fb72c5b374642bb05a78b0b5ca308 P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:57.780735  6187 consensus_queue.cc:1048] T bdbcf0a951c24340ba91509df11fc4c7 P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:15:57.710332  6160 raft_consensus.cc:515] T b1ab7b32db51471796738b38f71b64df P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:57.792311  6191 raft_consensus.cc:697] T 309fb72c5b374642bb05a78b0b5ca308 P 2f45532f94a34efcb68a82db3dd69372 [term 2 LEADER]: Becoming Leader. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Running, Role: LEADER
I20260709 13:15:57.807569  6191 consensus_queue.cc:237] T 309fb72c5b374642bb05a78b0b5ca308 P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:57.809670  5315 raft_consensus.cc:1275] T 29f5415006bb4218b579d580f0b9ff68 P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Refusing update from remote peer 77789aa45dc5463c82b73504fef4b4e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:57.813287  6172 consensus_queue.cc:1048] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:57.818660  5143 catalog_manager.cc:5697] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e reported cstate change: term changed from 1 to 2, leader changed from 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129) to c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131). New cstate: current_term: 2 leader_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:57.827342  5320 raft_consensus.cc:2468] T 5d841937b5db4e7fa656db32b84b9ca2 P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 2.
W20260709 13:15:57.842078  5434 leader_election.cc:336] T 3ba8874bed41499cadc73289e5bb4ad3 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
I20260709 13:15:57.843611  5464 raft_consensus.cc:1275] T 3b01a00074004ddb87b1710a6555353b P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Refusing update from remote peer 2f45532f94a34efcb68a82db3dd69372: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:57.837085  5433 leader_election.cc:304] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:57.847072  5319 raft_consensus.cc:1275] T 8aac85b71e404ee1bcfb748bfb0376fb P 2f45532f94a34efcb68a82db3dd69372 [term 3 FOLLOWER]: Refusing update from remote peer 77789aa45dc5463c82b73504fef4b4e0: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:57.848381  6172 raft_consensus.cc:2804] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:15:57.853025  5286 leader_election.cc:336] T 309fb72c5b374642bb05a78b0b5ca308 P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
I20260709 13:15:57.868690  6179 consensus_queue.cc:1048] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:57.870139  5389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ab7b32db51471796738b38f71b64df" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:15:57.870961  5389 raft_consensus.cc:3060] T b1ab7b32db51471796738b38f71b64df P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:57.851001  6160 leader_election.cc:290] T b1ab7b32db51471796738b38f71b64df P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 election: Requested vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:57.877681  6132 raft_consensus.cc:359] T 58438f196e6d42cc8780742faa222dc8 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:57.880997  6132 raft_consensus.cc:740] T 58438f196e6d42cc8780742faa222dc8 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:57.882114  6132 consensus_queue.cc:260] T 58438f196e6d42cc8780742faa222dc8 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:57.876829  6172 raft_consensus.cc:697] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 LEADER]: Becoming Leader. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Running, Role: LEADER
I20260709 13:15:57.888131  6133 consensus_queue.cc:1048] T 3b01a00074004ddb87b1710a6555353b P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:15:57.918406  5388 raft_consensus.cc:2468] T 3ba8874bed41499cadc73289e5bb4ad3 P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 2.
W20260709 13:15:57.952883  6196 log.cc:927] Time spent T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:15:57.952989  5389 raft_consensus.cc:2468] T b1ab7b32db51471796738b38f71b64df P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 2.
I20260709 13:15:57.955615  6188 raft_consensus.cc:515] T 068e5bd8f3ef45fc8a4a122e51537764 P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
W20260709 13:15:57.957962  5286 consensus_peers.cc:597] T 3b01a00074004ddb87b1710a6555353b P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:57.958482  6188 leader_election.cc:290] T 068e5bd8f3ef45fc8a4a122e51537764 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 2 election: Requested vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:57.961246  6172 consensus_queue.cc:237] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:57.962118  5393 raft_consensus.cc:2393] T 068e5bd8f3ef45fc8a4a122e51537764 P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 77789aa45dc5463c82b73504fef4b4e0 in current term 2: Already voted for candidate c4b52f14f9154b5a86f76fe58e4c235e in this term.
I20260709 13:15:57.967526  5286 leader_election.cc:304] T b1ab7b32db51471796738b38f71b64df P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:15:57.971589  5434 leader_election.cc:304] T 3ba8874bed41499cadc73289e5bb4ad3 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:15:57.973380  6213 raft_consensus.cc:493] T 4bc60d69f29e47689fd8fdf2b6aa836a P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.974030  6132 ts_tablet_manager.cc:1434] T 58438f196e6d42cc8780742faa222dc8 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.218s	user 0.007s	sys 0.009s
I20260709 13:15:57.974020  6213 raft_consensus.cc:515] T 4bc60d69f29e47689fd8fdf2b6aa836a P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:57.975234  6132 tablet_bootstrap.cc:492] T 60775d8dc53c4243a0d744fd843c5cd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
W20260709 13:15:57.980819  5286 leader_election.cc:336] T b1ab7b32db51471796738b38f71b64df P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
W20260709 13:15:57.981844  5286 consensus_peers.cc:597] T 60775d8dc53c4243a0d744fd843c5cd5 P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:57.982543  6173 raft_consensus.cc:2804] T b1ab7b32db51471796738b38f71b64df P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:57.997799  5143 catalog_manager.cc:5697] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e reported cstate change: term changed from 1 to 2, leader changed from 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129) to c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131). New cstate: current_term: 2 leader_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:58.006806  5434 leader_election.cc:304] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:58.001866  5142 catalog_manager.cc:5697] T 309fb72c5b374642bb05a78b0b5ca308 P 2f45532f94a34efcb68a82db3dd69372 reported cstate change: term changed from 1 to 2, leader changed from 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129) to 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130). New cstate: current_term: 2 leader_uuid: "2f45532f94a34efcb68a82db3dd69372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:58.010185  5142 catalog_manager.cc:5697] T 29f5415006bb4218b579d580f0b9ff68 P 2f45532f94a34efcb68a82db3dd69372 reported cstate change: term changed from 1 to 2, leader changed from 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129) to 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132). New cstate: current_term: 2 leader_uuid: "77789aa45dc5463c82b73504fef4b4e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } }
I20260709 13:15:58.012746  5142 catalog_manager.cc:5697] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 2f45532f94a34efcb68a82db3dd69372 reported cstate change: term changed from 1 to 2, leader changed from 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129) to 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130). New cstate: current_term: 2 leader_uuid: "2f45532f94a34efcb68a82db3dd69372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:58.014705  5142 catalog_manager.cc:5697] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372 reported cstate change: term changed from 2 to 3, leader changed from 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129) to 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130). New cstate: current_term: 3 leader_uuid: "2f45532f94a34efcb68a82db3dd69372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:58.065376  5463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "068e5bd8f3ef45fc8a4a122e51537764" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:15:58.066845  6208 raft_consensus.cc:493] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.056856  6213 leader_election.cc:290] T 4bc60d69f29e47689fd8fdf2b6aa836a P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:58.067569  6208 raft_consensus.cc:515] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:58.070329  6208 leader_election.cc:290] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:57.995630  6173 raft_consensus.cc:697] T b1ab7b32db51471796738b38f71b64df P 2f45532f94a34efcb68a82db3dd69372 [term 2 LEADER]: Becoming Leader. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Running, Role: LEADER
I20260709 13:15:58.007323  6165 raft_consensus.cc:2804] T 3ba8874bed41499cadc73289e5bb4ad3 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:58.050499  6175 raft_consensus.cc:2749] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:58.107452  5463 raft_consensus.cc:2393] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c4b52f14f9154b5a86f76fe58e4c235e in current term 2: Already voted for candidate 77789aa45dc5463c82b73504fef4b4e0 in this term.
W20260709 13:15:58.111078  5360 leader_election.cc:336] T 068e5bd8f3ef45fc8a4a122e51537764 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
W20260709 13:15:58.112475  5360 consensus_peers.cc:597] T 39d465e757b14de1842d55d52271bceb P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:58.113034  5360 consensus_peers.cc:597] T 73c339ffbbca40c78c31d33aa9bb9e38 P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:58.117514  5315 raft_consensus.cc:1275] T 3e101cf4ae084c74af284008876e474e P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Refusing update from remote peer c4b52f14f9154b5a86f76fe58e4c235e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:58.118098  5461 raft_consensus.cc:1275] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [term 3 FOLLOWER]: Refusing update from remote peer 2f45532f94a34efcb68a82db3dd69372: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:15:58.124159  5286 consensus_peers.cc:597] T 22ee19164403428187e72d7a7c868457 P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:58.120579  6133 consensus_queue.cc:1048] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:58.123688  6165 raft_consensus.cc:697] T 3ba8874bed41499cadc73289e5bb4ad3 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 LEADER]: Becoming Leader. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Running, Role: LEADER
W20260709 13:15:58.131102  5360 consensus_peers.cc:597] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:58.131728  5360 consensus_peers.cc:597] T 4bc60d69f29e47689fd8fdf2b6aa836a P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:58.130539  6165 consensus_queue.cc:237] T 3ba8874bed41499cadc73289e5bb4ad3 P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:58.073050  6173 consensus_queue.cc:237] T b1ab7b32db51471796738b38f71b64df P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:58.161252  6208 raft_consensus.cc:493] T 6a1e233f50be40f78b9208537916e93c P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.161928  6208 raft_consensus.cc:515] T 6a1e233f50be40f78b9208537916e93c P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:58.166440  6208 leader_election.cc:290] T 6a1e233f50be40f78b9208537916e93c P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:58.172976  5358 leader_election.cc:304] T 068e5bd8f3ef45fc8a4a122e51537764 P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b52f14f9154b5a86f76fe58e4c235e; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, 77789aa45dc5463c82b73504fef4b4e0
W20260709 13:15:58.169567  5286 consensus_peers.cc:597] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:58.124837  6189 consensus_queue.cc:1048] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:15:58.184799  6135 raft_consensus.cc:2749] T 068e5bd8f3ef45fc8a4a122e51537764 P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:58.200235  6208 raft_consensus.cc:493] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.204392  6213 raft_consensus.cc:493] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:58.220327  5358 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.132:41391, user_credentials={real_user=slave}} blocked reactor thread for 45370.9us
W20260709 13:15:58.229779  5434 consensus_peers.cc:597] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:58.230549  5434 consensus_peers.cc:597] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:58.219024  6208 raft_consensus.cc:515] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:58.260779  6214 raft_consensus.cc:493] T 22ee19164403428187e72d7a7c868457 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.268352  5389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc60d69f29e47689fd8fdf2b6aa836a" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:58.269577  6214 raft_consensus.cc:515] T 22ee19164403428187e72d7a7c868457 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:58.270689  5388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce0170182474e7dbe46361f5bf0eae9" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:58.273165  6208 leader_election.cc:290] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:58.220031  6213 raft_consensus.cc:515] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:58.281080  5319 raft_consensus.cc:1275] T d443132476914cd1958f499f68f8acd5 P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Refusing update from remote peer 77789aa45dc5463c82b73504fef4b4e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:58.286741  6172 consensus_queue.cc:1048] T d443132476914cd1958f499f68f8acd5 P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:15:58.293398  6208 raft_consensus.cc:493] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.316860  6208 raft_consensus.cc:515] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
W20260709 13:15:58.333922  5286 consensus_peers.cc:597] T 71b75232471f416bb2d0ec813f32558e P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:58.336426  5144 catalog_manager.cc:5697] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 reported cstate change: term changed from 2 to 3, leader changed from 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129) to 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132). New cstate: current_term: 3 leader_uuid: "77789aa45dc5463c82b73504fef4b4e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:58.338569  5144 catalog_manager.cc:5697] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 reported cstate change: term changed from 1 to 2, leader changed from 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129) to 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132). New cstate: current_term: 2 leader_uuid: "77789aa45dc5463c82b73504fef4b4e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:58.340302  6214 leader_election.cc:290] T 22ee19164403428187e72d7a7c868457 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:58.341034  6214 raft_consensus.cc:493] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.340688  5144 catalog_manager.cc:5697] T d443132476914cd1958f499f68f8acd5 P 77789aa45dc5463c82b73504fef4b4e0 reported cstate change: term changed from 1 to 2, leader changed from 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129) to 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132). New cstate: current_term: 2 leader_uuid: "77789aa45dc5463c82b73504fef4b4e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:58.341526  6214 raft_consensus.cc:515] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:58.342383  6213 leader_election.cc:290] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:58.353044  6208 leader_election.cc:290] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:58.363605  5392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ee19164403428187e72d7a7c868457" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:58.365114  6214 leader_election.cc:290] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:58.380496  6239 raft_consensus.cc:493] T 7c0e035a21aa4d43857f541259fa71b9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.381229  6239 raft_consensus.cc:515] T 7c0e035a21aa4d43857f541259fa71b9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:58.382215  5388 raft_consensus.cc:1275] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Refusing update from remote peer 2f45532f94a34efcb68a82db3dd69372: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:58.385191  5320 raft_consensus.cc:1275] T 8e80c7aca57e4dc6bdd366ef7501749f P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Refusing update from remote peer c4b52f14f9154b5a86f76fe58e4c235e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:58.387106  5388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ec9fd2ee334861a956e4d70d348b6d" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:58.388737  6132 tablet_bootstrap.cc:492] T 60775d8dc53c4243a0d744fd843c5cd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:58.389808  6132 tablet_bootstrap.cc:492] T 60775d8dc53c4243a0d744fd843c5cd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:15:58.388425  5142 catalog_manager.cc:5697] T b1ab7b32db51471796738b38f71b64df P 2f45532f94a34efcb68a82db3dd69372 reported cstate change: term changed from 1 to 2, leader changed from 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129) to 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130). New cstate: current_term: 2 leader_uuid: "2f45532f94a34efcb68a82db3dd69372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:58.390573  6132 ts_tablet_manager.cc:1403] T 60775d8dc53c4243a0d744fd843c5cd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.416s	user 0.012s	sys 0.012s
I20260709 13:15:58.392688  6188 consensus_queue.cc:1048] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:15:58.393996  5360 consensus_peers.cc:597] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:58.394469  5360 consensus_peers.cc:597] T 436bb2869b55478b9c1cc99b5f83f981 P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:58.394919  5360 consensus_peers.cc:597] T 58438f196e6d42cc8780742faa222dc8 P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:58.397502  6214 raft_consensus.cc:493] T 480c812524814775bbf2823e53a996ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.398065  6214 raft_consensus.cc:515] T 480c812524814775bbf2823e53a996ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:58.405485  6214 leader_election.cc:290] T 480c812524814775bbf2823e53a996ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
W20260709 13:15:58.406411  5434 consensus_peers.cc:597] T 480c812524814775bbf2823e53a996ed P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:58.407383  5463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63267e5ca2594b41844fd758ca603a34" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:58.407871  5466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480c812524814775bbf2823e53a996ed" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:58.407852  5461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1e233f50be40f78b9208537916e93c" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:58.408981  5465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aac85b71e404ee1bcfb748bfb0376fb" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:58.410409  5464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc60d69f29e47689fd8fdf2b6aa836a" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:58.411012  5388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654fdf03209d4a3cbf17055c56ae2c9d" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:58.412148  5462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce0170182474e7dbe46361f5bf0eae9" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:58.413793  5388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e035a21aa4d43857f541259fa71b9" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:58.416752  6125 leader_election.cc:304] T 4bc60d69f29e47689fd8fdf2b6aa836a P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:58.426689  6214 raft_consensus.cc:2749] T 4bc60d69f29e47689fd8fdf2b6aa836a P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:58.426286  5434 consensus_peers.cc:597] T 3d6bcda036934682b5075c20b786026d P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:58.427655  5313 raft_consensus.cc:1275] T 5d841937b5db4e7fa656db32b84b9ca2 P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Refusing update from remote peer 77789aa45dc5463c82b73504fef4b4e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:58.421223  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22ee19164403428187e72d7a7c868457" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:58.421716  5316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "654fdf03209d4a3cbf17055c56ae2c9d" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:58.422012  5317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ec9fd2ee334861a956e4d70d348b6d" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
W20260709 13:15:58.427925  5434 consensus_peers.cc:597] T d443132476914cd1958f499f68f8acd5 P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:58.422817  5314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aac85b71e404ee1bcfb748bfb0376fb" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:58.424068  5318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480c812524814775bbf2823e53a996ed" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:58.430831  6165 consensus_queue.cc:1048] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:58.427251  6125 leader_election.cc:304] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:58.431982  6214 raft_consensus.cc:2749] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:58.432627  6126 leader_election.cc:304] T 22ee19164403428187e72d7a7c868457 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:58.433544  6214 raft_consensus.cc:2749] T 22ee19164403428187e72d7a7c868457 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:58.420768  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63267e5ca2594b41844fd758ca603a34" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:58.435902  6126 leader_election.cc:304] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:58.436662  5462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e035a21aa4d43857f541259fa71b9" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:58.433005  6239 leader_election.cc:290] T 7c0e035a21aa4d43857f541259fa71b9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:58.437574  6208 raft_consensus.cc:2749] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:58.437986  6239 raft_consensus.cc:493] T f3f19e79faea4bdbae72383e79104b37 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.440234  6125 leader_election.cc:304] T 7c0e035a21aa4d43857f541259fa71b9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:58.442253  6214 raft_consensus.cc:2749] T 7c0e035a21aa4d43857f541259fa71b9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:58.443110  5360 consensus_peers.cc:597] T 0fde317f3ec547c3840e2fe1e07ec228 P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:58.437309  6126 leader_election.cc:304] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:58.440585  6239 raft_consensus.cc:515] T f3f19e79faea4bdbae72383e79104b37 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:58.464329  6126 leader_election.cc:304] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0
I20260709 13:15:58.465456  6208 raft_consensus.cc:2749] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:58.466233  6208 raft_consensus.cc:2749] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:58.468897  5388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f19e79faea4bdbae72383e79104b37" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:58.464557  6239 leader_election.cc:290] T f3f19e79faea4bdbae72383e79104b37 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:15:58.443913  5144 catalog_manager.cc:5697] T 3ba8874bed41499cadc73289e5bb4ad3 P 77789aa45dc5463c82b73504fef4b4e0 reported cstate change: term changed from 1 to 2, leader changed from 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129) to 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132). New cstate: current_term: 2 leader_uuid: "77789aa45dc5463c82b73504fef4b4e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:58.478475  6132 raft_consensus.cc:359] T 60775d8dc53c4243a0d744fd843c5cd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:58.481287  6132 raft_consensus.cc:740] T 60775d8dc53c4243a0d744fd843c5cd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:58.482331  6132 consensus_queue.cc:260] T 60775d8dc53c4243a0d744fd843c5cd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:58.489969  6239 raft_consensus.cc:493] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.490578  6239 raft_consensus.cc:515] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:58.494102  6126 leader_election.cc:304] T 480c812524814775bbf2823e53a996ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0
I20260709 13:15:58.494233  5464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d841937b5db4e7fa656db32b84b9ca2" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:58.497386  6239 leader_election.cc:290] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:15:58.499313  6132 ts_tablet_manager.cc:1434] T 60775d8dc53c4243a0d744fd843c5cd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.108s	user 0.009s	sys 0.000s
I20260709 13:15:58.501772  6132 tablet_bootstrap.cc:492] T 8e80c7aca57e4dc6bdd366ef7501749f P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:58.504348  5319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a1e233f50be40f78b9208537916e93c" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:58.505702  6214 raft_consensus.cc:2749] T 480c812524814775bbf2823e53a996ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:58.507345  6126 leader_election.cc:304] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0
I20260709 13:15:58.528437  6214 raft_consensus.cc:2749] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:15:58.533784  5360 consensus_peers.cc:597] T c520b1f4431848d1967291be272086c5 P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:58.536408  5286 consensus_peers.cc:597] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:58.537441  5286 consensus_peers.cc:597] T 309fb72c5b374642bb05a78b0b5ca308 P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:58.538444  5962 consensus_queue.cc:1048] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:15:58.540239  5434 consensus_peers.cc:597] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:58.549088  6126 leader_election.cc:304] T 6a1e233f50be40f78b9208537916e93c P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0
W20260709 13:15:58.549615  5360 consensus_peers.cc:597] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:58.550133  6239 raft_consensus.cc:493] T 99cdbf6d16c64a949df77a003bb7f7e4 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:58.550426  5360 consensus_peers.cc:597] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:58.550724  6239 raft_consensus.cc:515] T 99cdbf6d16c64a949df77a003bb7f7e4 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:58.553771  6239 leader_election.cc:290] T 99cdbf6d16c64a949df77a003bb7f7e4 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:58.554282  6239 raft_consensus.cc:2749] T 6a1e233f50be40f78b9208537916e93c P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:58.559736  5391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99cdbf6d16c64a949df77a003bb7f7e4" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:58.563190  5464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99cdbf6d16c64a949df77a003bb7f7e4" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:58.565912  6125 leader_election.cc:304] T 99cdbf6d16c64a949df77a003bb7f7e4 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:58.567668  6239 raft_consensus.cc:2749] T 99cdbf6d16c64a949df77a003bb7f7e4 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:58.570315  5360 consensus_peers.cc:597] T 34516de894fc408b8e355aba3402489c P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:58.573561  5464 raft_consensus.cc:1275] T 309fb72c5b374642bb05a78b0b5ca308 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Refusing update from remote peer 2f45532f94a34efcb68a82db3dd69372: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:58.576648  5314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f19e79faea4bdbae72383e79104b37" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
W20260709 13:15:58.577356  5434 consensus_peers.cc:597] T 0796f5098e2a48c992868bbffce02505 P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:58.581518  5360 consensus_peers.cc:597] T 4d479dd9f8c04491bb1e78273726187f P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:58.585490  5314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d841937b5db4e7fa656db32b84b9ca2" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2f45532f94a34efcb68a82db3dd69372" is_pre_election: true
I20260709 13:15:58.589993  6126 leader_election.cc:304] T f3f19e79faea4bdbae72383e79104b37 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 2f45532f94a34efcb68a82db3dd69372, c4b52f14f9154b5a86f76fe58e4c235e
W20260709 13:15:58.593971  5434 consensus_peers.cc:597] T fce0170182474e7dbe46361f5bf0eae9 P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:58.607046  6132 tablet_bootstrap.cc:492] T 8e80c7aca57e4dc6bdd366ef7501749f P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:15:58.607303  5286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:41357, user_credentials={real_user=slave}} blocked reactor thread for 69899.7us
I20260709 13:15:58.608415  6214 raft_consensus.cc:2749] T f3f19e79faea4bdbae72383e79104b37 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:58.622093  6126 leader_election.cc:304] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0
I20260709 13:15:58.613710  6132 tablet_bootstrap.cc:492] T 8e80c7aca57e4dc6bdd366ef7501749f P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:15:58.629016  6132 ts_tablet_manager.cc:1403] T 8e80c7aca57e4dc6bdd366ef7501749f P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.127s	user 0.022s	sys 0.000s
I20260709 13:15:58.623051  6134 consensus_queue.cc:1048] T 309fb72c5b374642bb05a78b0b5ca308 P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:58.631430  6214 raft_consensus.cc:2749] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:58.626957  5434 consensus_peers.cc:597] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:58.634366  6132 raft_consensus.cc:359] T 8e80c7aca57e4dc6bdd366ef7501749f P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:58.635166  6132 raft_consensus.cc:740] T 8e80c7aca57e4dc6bdd366ef7501749f P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
W20260709 13:15:58.639047  5434 consensus_peers.cc:597] T 99cdbf6d16c64a949df77a003bb7f7e4 P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:58.644255  6132 consensus_queue.cc:260] T 8e80c7aca57e4dc6bdd366ef7501749f P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:58.647107  6132 ts_tablet_manager.cc:1434] T 8e80c7aca57e4dc6bdd366ef7501749f P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:15:58.648068  6132 tablet_bootstrap.cc:492] T 3e101cf4ae084c74af284008876e474e P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:58.686224  5391 raft_consensus.cc:1275] T b1ab7b32db51471796738b38f71b64df P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Refusing update from remote peer 2f45532f94a34efcb68a82db3dd69372: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:15:58.687389  5286 consensus_peers.cc:597] T 09e39d6f01a0444bb1aa42b5403943c8 P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:58.694531  5286 consensus_peers.cc:597] T 1db09971a25441c68427b8bea7e9c379 P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:58.694989  5286 consensus_peers.cc:597] T 5b17eb476da34f05b466923d9c48cc2d P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:58.713828  6132 tablet_bootstrap.cc:492] T 3e101cf4ae084c74af284008876e474e P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:58.715277  6132 tablet_bootstrap.cc:492] T 3e101cf4ae084c74af284008876e474e P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:15:58.716171  6132 ts_tablet_manager.cc:1403] T 3e101cf4ae084c74af284008876e474e P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.068s	user 0.023s	sys 0.000s
I20260709 13:15:58.727944  5962 consensus_queue.cc:1048] T b1ab7b32db51471796738b38f71b64df P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:58.750422  6132 raft_consensus.cc:359] T 3e101cf4ae084c74af284008876e474e P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:58.751328  6132 raft_consensus.cc:740] T 3e101cf4ae084c74af284008876e474e P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:58.754468  6132 consensus_queue.cc:260] T 3e101cf4ae084c74af284008876e474e P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:58.765748  6132 ts_tablet_manager.cc:1434] T 3e101cf4ae084c74af284008876e474e P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 13:15:58.767032  6132 tablet_bootstrap.cc:492] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
W20260709 13:15:58.790819  5286 consensus_peers.cc:597] T 6a1e233f50be40f78b9208537916e93c P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:58.806236  5286 consensus_peers.cc:597] T 29ec9fd2ee334861a956e4d70d348b6d P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:58.810668  5286 consensus_peers.cc:597] T bd6573fdc5bd411e8b0cbd3316ecaede P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:58.811421  5286 consensus_peers.cc:597] T c6bbe6dd572c4ea4aaf323c36eb05467 P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:58.812103  5286 consensus_peers.cc:597] T f3f19e79faea4bdbae72383e79104b37 P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:58.828929  5389 raft_consensus.cc:1275] T 3ba8874bed41499cadc73289e5bb4ad3 P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Refusing update from remote peer 77789aa45dc5463c82b73504fef4b4e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:15:58.833772  5286 consensus_peers.cc:597] T 7541727e0e0944a6b184ac464bcc6eee P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:15:58.835001  5286 consensus_peers.cc:597] T b1ab7b32db51471796738b38f71b64df P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:58.835650  5286 consensus_peers.cc:597] T 02dba91c167a418daee105670577c8aa P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:58.852677  6172 consensus_queue.cc:1048] T 3ba8874bed41499cadc73289e5bb4ad3 P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:15:58.864285  5434 consensus_peers.cc:597] T 3ba8874bed41499cadc73289e5bb4ad3 P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:58.977746  6132 tablet_bootstrap.cc:492] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:58.979213  6132 tablet_bootstrap.cc:492] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:15:58.980119  6132 ts_tablet_manager.cc:1403] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.213s	user 0.024s	sys 0.010s
I20260709 13:15:58.983215  6132 raft_consensus.cc:359] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:58.987095  6132 raft_consensus.cc:740] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:58.988365  6132 consensus_queue.cc:260] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:58.990973  6132 ts_tablet_manager.cc:1434] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:15:59.003039  6132 tablet_bootstrap.cc:492] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:59.030952  6132 tablet_bootstrap.cc:492] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:59.032177  6132 tablet_bootstrap.cc:492] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:15:59.033274  6132 ts_tablet_manager.cc:1403] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.042s	user 0.019s	sys 0.000s
I20260709 13:15:59.036171  6132 raft_consensus.cc:359] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:59.036953  6132 raft_consensus.cc:740] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:59.037954  6132 consensus_queue.cc:260] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:59.040549  6132 ts_tablet_manager.cc:1434] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:15:59.041535  6132 tablet_bootstrap.cc:492] T 3ba8874bed41499cadc73289e5bb4ad3 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:59.070966  6214 raft_consensus.cc:493] T 58438f196e6d42cc8780742faa222dc8 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.071748  6214 raft_consensus.cc:515] T 58438f196e6d42cc8780742faa222dc8 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:59.075903  6214 leader_election.cc:290] T 58438f196e6d42cc8780742faa222dc8 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:15:59.076784  5464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58438f196e6d42cc8780742faa222dc8" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77789aa45dc5463c82b73504fef4b4e0" is_pre_election: true
I20260709 13:15:59.077572  5392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58438f196e6d42cc8780742faa222dc8" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:15:59.079547  6132 tablet_bootstrap.cc:492] T 3ba8874bed41499cadc73289e5bb4ad3 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:59.079918  6127 leader_election.cc:304] T 58438f196e6d42cc8780742faa222dc8 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:15:59.080668  6132 tablet_bootstrap.cc:492] T 3ba8874bed41499cadc73289e5bb4ad3 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:15:59.081507  6132 ts_tablet_manager.cc:1403] T 3ba8874bed41499cadc73289e5bb4ad3 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.012s
I20260709 13:15:59.083639  6214 raft_consensus.cc:2749] T 58438f196e6d42cc8780742faa222dc8 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:59.084622  6132 raft_consensus.cc:359] T 3ba8874bed41499cadc73289e5bb4ad3 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:59.085652  6132 raft_consensus.cc:740] T 3ba8874bed41499cadc73289e5bb4ad3 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:59.086644  6132 consensus_queue.cc:260] T 3ba8874bed41499cadc73289e5bb4ad3 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:59.089118  6132 ts_tablet_manager.cc:1434] T 3ba8874bed41499cadc73289e5bb4ad3 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:15:59.090374  6132 tablet_bootstrap.cc:492] T 73c339ffbbca40c78c31d33aa9bb9e38 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
W20260709 13:15:59.085448  5286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:40847, user_credentials={real_user=slave}} blocked reactor thread for 88989.7us
W20260709 13:15:59.101135  5434 consensus_peers.cc:597] T cb26053fad7244cd88a5182d9cfc2109 P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:15:59.252380  6132 tablet_bootstrap.cc:492] T 73c339ffbbca40c78c31d33aa9bb9e38 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:59.253594  6132 tablet_bootstrap.cc:492] T 73c339ffbbca40c78c31d33aa9bb9e38 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:15:59.255671  6132 ts_tablet_manager.cc:1403] T 73c339ffbbca40c78c31d33aa9bb9e38 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.165s	user 0.054s	sys 0.064s
I20260709 13:15:59.259073  6132 raft_consensus.cc:359] T 73c339ffbbca40c78c31d33aa9bb9e38 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:59.259971  6132 raft_consensus.cc:740] T 73c339ffbbca40c78c31d33aa9bb9e38 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:59.260934  6132 consensus_queue.cc:260] T 73c339ffbbca40c78c31d33aa9bb9e38 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:59.264150  6132 ts_tablet_manager.cc:1434] T 73c339ffbbca40c78c31d33aa9bb9e38 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:15:59.265146  6132 tablet_bootstrap.cc:492] T 4d479dd9f8c04491bb1e78273726187f P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:59.440960  6132 tablet_bootstrap.cc:492] T 4d479dd9f8c04491bb1e78273726187f P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:59.442039  6132 tablet_bootstrap.cc:492] T 4d479dd9f8c04491bb1e78273726187f P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:15:59.442768  6132 ts_tablet_manager.cc:1403] T 4d479dd9f8c04491bb1e78273726187f P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.178s	user 0.049s	sys 0.106s
I20260709 13:15:59.446671 28234 rpc_server.cc:307] RPC server started. Bound to: 127.27.146.129:41357
I20260709 13:15:59.446808  6297 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.146.129:41357 every 8 connection(s)
I20260709 13:15:59.447963  6132 raft_consensus.cc:359] T 4d479dd9f8c04491bb1e78273726187f P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:59.448812  6132 raft_consensus.cc:740] T 4d479dd9f8c04491bb1e78273726187f P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:59.449589  6132 consensus_queue.cc:260] T 4d479dd9f8c04491bb1e78273726187f P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:59.451706  6132 ts_tablet_manager.cc:1434] T 4d479dd9f8c04491bb1e78273726187f P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:15:59.452601  6132 tablet_bootstrap.cc:492] T c520b1f4431848d1967291be272086c5 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:59.495434  6298 heartbeater.cc:344] Connected to a master server at 127.27.146.190:43479
I20260709 13:15:59.496043  6298 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:59.497049  6298 heartbeater.cc:507] Master 127.27.146.190:43479 requested a full tablet report, sending...
I20260709 13:15:59.498661  6132 tablet_bootstrap.cc:492] T c520b1f4431848d1967291be272086c5 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:59.499814  6132 tablet_bootstrap.cc:492] T c520b1f4431848d1967291be272086c5 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:15:59.500552  6132 ts_tablet_manager.cc:1403] T c520b1f4431848d1967291be272086c5 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.048s	user 0.018s	sys 0.004s
I20260709 13:15:59.507166  6132 raft_consensus.cc:359] T c520b1f4431848d1967291be272086c5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:59.508080  6132 raft_consensus.cc:740] T c520b1f4431848d1967291be272086c5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:59.508884  6132 consensus_queue.cc:260] T c520b1f4431848d1967291be272086c5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:59.510720  6132 ts_tablet_manager.cc:1434] T c520b1f4431848d1967291be272086c5 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:15:59.511648  6132 tablet_bootstrap.cc:492] T bd6573fdc5bd411e8b0cbd3316ecaede P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:59.536986  5144 ts_manager.cc:194] Re-registered known tserver with Master: 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:15:59.570799  6266 raft_consensus.cc:3060] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:59.577230  6132 tablet_bootstrap.cc:492] T bd6573fdc5bd411e8b0cbd3316ecaede P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:59.581751  6132 tablet_bootstrap.cc:492] T bd6573fdc5bd411e8b0cbd3316ecaede P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:15:59.582626  6132 ts_tablet_manager.cc:1403] T bd6573fdc5bd411e8b0cbd3316ecaede P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.071s	user 0.037s	sys 0.020s
I20260709 13:15:59.586901  6132 raft_consensus.cc:359] T bd6573fdc5bd411e8b0cbd3316ecaede P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:59.587823  6132 raft_consensus.cc:740] T bd6573fdc5bd411e8b0cbd3316ecaede P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:59.588828  6132 consensus_queue.cc:260] T bd6573fdc5bd411e8b0cbd3316ecaede P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:59.591265  6132 ts_tablet_manager.cc:1434] T bd6573fdc5bd411e8b0cbd3316ecaede P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:15:59.592587  6132 tablet_bootstrap.cc:492] T bdbcf0a951c24340ba91509df11fc4c7 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:59.603193  6266 raft_consensus.cc:3060] T 8e80c7aca57e4dc6bdd366ef7501749f P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:59.605597  5144 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47774
I20260709 13:15:59.613623  6298 heartbeater.cc:499] Master 127.27.146.190:43479 was elected leader, sending a full tablet report...
I20260709 13:15:59.616266  6132 tablet_bootstrap.cc:492] T bdbcf0a951c24340ba91509df11fc4c7 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:59.617336  6132 tablet_bootstrap.cc:492] T bdbcf0a951c24340ba91509df11fc4c7 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:15:59.618124  6132 ts_tablet_manager.cc:1403] T bdbcf0a951c24340ba91509df11fc4c7 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.004s
I20260709 13:15:59.620518  6132 raft_consensus.cc:359] T bdbcf0a951c24340ba91509df11fc4c7 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:59.621104  6132 raft_consensus.cc:740] T bdbcf0a951c24340ba91509df11fc4c7 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:59.621748  6132 consensus_queue.cc:260] T bdbcf0a951c24340ba91509df11fc4c7 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:59.623829  6132 ts_tablet_manager.cc:1434] T bdbcf0a951c24340ba91509df11fc4c7 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:15:59.626120  6132 tablet_bootstrap.cc:492] T 5b17eb476da34f05b466923d9c48cc2d P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:59.633520  6264 raft_consensus.cc:3060] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:59.637377  6266 raft_consensus.cc:3060] T bdbcf0a951c24340ba91509df11fc4c7 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:59.677409  6132 tablet_bootstrap.cc:492] T 5b17eb476da34f05b466923d9c48cc2d P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:59.678617  6132 tablet_bootstrap.cc:492] T 5b17eb476da34f05b466923d9c48cc2d P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:15:59.679361  6132 ts_tablet_manager.cc:1403] T 5b17eb476da34f05b466923d9c48cc2d P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.054s	user 0.024s	sys 0.020s
I20260709 13:15:59.682459  6132 raft_consensus.cc:359] T 5b17eb476da34f05b466923d9c48cc2d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:59.683233  6132 raft_consensus.cc:740] T 5b17eb476da34f05b466923d9c48cc2d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:59.684902  6132 consensus_queue.cc:260] T 5b17eb476da34f05b466923d9c48cc2d P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:59.688431  6132 ts_tablet_manager.cc:1434] T 5b17eb476da34f05b466923d9c48cc2d P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:15:59.689442  6132 tablet_bootstrap.cc:492] T 34516de894fc408b8e355aba3402489c P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:59.710646  6132 tablet_bootstrap.cc:492] T 34516de894fc408b8e355aba3402489c P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:59.711627  6132 tablet_bootstrap.cc:492] T 34516de894fc408b8e355aba3402489c P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:15:59.712299  6132 ts_tablet_manager.cc:1403] T 34516de894fc408b8e355aba3402489c P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.023s	user 0.020s	sys 0.000s
I20260709 13:15:59.714432  6132 raft_consensus.cc:359] T 34516de894fc408b8e355aba3402489c P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:59.715013  6132 raft_consensus.cc:740] T 34516de894fc408b8e355aba3402489c P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:59.715680  6132 consensus_queue.cc:260] T 34516de894fc408b8e355aba3402489c P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:59.717231  6132 ts_tablet_manager.cc:1434] T 34516de894fc408b8e355aba3402489c P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:15:59.718042  6132 tablet_bootstrap.cc:492] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:59.733863  6132 tablet_bootstrap.cc:492] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:59.734716  6132 tablet_bootstrap.cc:492] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:15:59.735383  6132 ts_tablet_manager.cc:1403] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.000s
I20260709 13:15:59.738050  6132 raft_consensus.cc:359] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:59.738734  6132 raft_consensus.cc:740] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:59.739423  6132 consensus_queue.cc:260] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:59.741649  6132 ts_tablet_manager.cc:1434] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:59.742470  6132 tablet_bootstrap.cc:492] T 39d465e757b14de1842d55d52271bceb P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:59.764562  6259 raft_consensus.cc:3060] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:59.777068  6132 tablet_bootstrap.cc:492] T 39d465e757b14de1842d55d52271bceb P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:59.778321  6132 tablet_bootstrap.cc:492] T 39d465e757b14de1842d55d52271bceb P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:15:59.779083  6132 ts_tablet_manager.cc:1403] T 39d465e757b14de1842d55d52271bceb P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.012s
I20260709 13:15:59.781980  6132 raft_consensus.cc:359] T 39d465e757b14de1842d55d52271bceb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:59.782738  6132 raft_consensus.cc:740] T 39d465e757b14de1842d55d52271bceb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:59.783532  6132 consensus_queue.cc:260] T 39d465e757b14de1842d55d52271bceb P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:59.786063  6132 ts_tablet_manager.cc:1434] T 39d465e757b14de1842d55d52271bceb P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.003s
I20260709 13:15:59.786999  6132 tablet_bootstrap.cc:492] T c6bbe6dd572c4ea4aaf323c36eb05467 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:59.805291  6266 raft_consensus.cc:3060] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:59.805543  6132 tablet_bootstrap.cc:492] T c6bbe6dd572c4ea4aaf323c36eb05467 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:59.806713  6132 tablet_bootstrap.cc:492] T c6bbe6dd572c4ea4aaf323c36eb05467 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:15:59.807672  6132 ts_tablet_manager.cc:1403] T c6bbe6dd572c4ea4aaf323c36eb05467 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.000s
I20260709 13:15:59.810670  6132 raft_consensus.cc:359] T c6bbe6dd572c4ea4aaf323c36eb05467 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:59.811430  6132 raft_consensus.cc:740] T c6bbe6dd572c4ea4aaf323c36eb05467 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:59.812208  6132 consensus_queue.cc:260] T c6bbe6dd572c4ea4aaf323c36eb05467 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:59.817580  6132 ts_tablet_manager.cc:1434] T c6bbe6dd572c4ea4aaf323c36eb05467 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:15:59.818538  6132 tablet_bootstrap.cc:492] T 09e39d6f01a0444bb1aa42b5403943c8 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:59.827594  6259 raft_consensus.cc:3060] T 3e101cf4ae084c74af284008876e474e P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:59.866194  6132 tablet_bootstrap.cc:492] T 09e39d6f01a0444bb1aa42b5403943c8 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:59.867293  6132 tablet_bootstrap.cc:492] T 09e39d6f01a0444bb1aa42b5403943c8 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:15:59.868208  6132 ts_tablet_manager.cc:1403] T 09e39d6f01a0444bb1aa42b5403943c8 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.050s	user 0.025s	sys 0.016s
I20260709 13:15:59.871531  6132 raft_consensus.cc:359] T 09e39d6f01a0444bb1aa42b5403943c8 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:59.872363  6132 raft_consensus.cc:740] T 09e39d6f01a0444bb1aa42b5403943c8 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:59.873096  6132 consensus_queue.cc:260] T 09e39d6f01a0444bb1aa42b5403943c8 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:59.874933  6132 ts_tablet_manager.cc:1434] T 09e39d6f01a0444bb1aa42b5403943c8 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:15:59.880221  6132 tablet_bootstrap.cc:492] T 0796f5098e2a48c992868bbffce02505 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:59.897404  6132 tablet_bootstrap.cc:492] T 0796f5098e2a48c992868bbffce02505 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:59.898521  6132 tablet_bootstrap.cc:492] T 0796f5098e2a48c992868bbffce02505 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:15:59.900300  6132 ts_tablet_manager.cc:1403] T 0796f5098e2a48c992868bbffce02505 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 13:15:59.903079  6132 raft_consensus.cc:359] T 0796f5098e2a48c992868bbffce02505 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:59.903803  6132 raft_consensus.cc:740] T 0796f5098e2a48c992868bbffce02505 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:59.904690  6132 consensus_queue.cc:260] T 0796f5098e2a48c992868bbffce02505 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:15:59.906844  6132 ts_tablet_manager.cc:1434] T 0796f5098e2a48c992868bbffce02505 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:59.907763  6132 tablet_bootstrap.cc:492] T 3b01a00074004ddb87b1710a6555353b P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:59.939318  6266 raft_consensus.cc:3060] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:59.951647  6132 tablet_bootstrap.cc:492] T 3b01a00074004ddb87b1710a6555353b P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:59.952663  6132 tablet_bootstrap.cc:492] T 3b01a00074004ddb87b1710a6555353b P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:15:59.953446  6132 ts_tablet_manager.cc:1403] T 3b01a00074004ddb87b1710a6555353b P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.046s	user 0.023s	sys 0.009s
I20260709 13:15:59.956179  6132 raft_consensus.cc:359] T 3b01a00074004ddb87b1710a6555353b P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:59.956947  6132 raft_consensus.cc:740] T 3b01a00074004ddb87b1710a6555353b P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:59.957666  6132 consensus_queue.cc:260] T 3b01a00074004ddb87b1710a6555353b P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:15:59.960088  6132 ts_tablet_manager.cc:1434] T 3b01a00074004ddb87b1710a6555353b P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:15:59.961007  6132 tablet_bootstrap.cc:492] T 1db09971a25441c68427b8bea7e9c379 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:59.978284  6132 tablet_bootstrap.cc:492] T 1db09971a25441c68427b8bea7e9c379 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:59.979470  6132 tablet_bootstrap.cc:492] T 1db09971a25441c68427b8bea7e9c379 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:15:59.979547  6266 raft_consensus.cc:3060] T 3ba8874bed41499cadc73289e5bb4ad3 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:59.980949  6132 ts_tablet_manager.cc:1403] T 1db09971a25441c68427b8bea7e9c379 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.003s
I20260709 13:15:59.984409  6132 raft_consensus.cc:359] T 1db09971a25441c68427b8bea7e9c379 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:59.985111  6132 raft_consensus.cc:740] T 1db09971a25441c68427b8bea7e9c379 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:15:59.985894  6132 consensus_queue.cc:260] T 1db09971a25441c68427b8bea7e9c379 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:15:59.988529  6132 ts_tablet_manager.cc:1434] T 1db09971a25441c68427b8bea7e9c379 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:15:59.990100  6132 tablet_bootstrap.cc:492] T e78312bda196492eae76f2673c979fee P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:15:59.993089  6259 raft_consensus.cc:3060] T 3b01a00074004ddb87b1710a6555353b P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:00.034283  6309 raft_consensus.cc:493] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.035076  6309 raft_consensus.cc:515] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:16:00.036772  6132 tablet_bootstrap.cc:492] T e78312bda196492eae76f2673c979fee P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:00.040583  6132 tablet_bootstrap.cc:492] T e78312bda196492eae76f2673c979fee P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:16:00.041113  5389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "068e5bd8f3ef45fc8a4a122e51537764" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" is_pre_election: true
I20260709 13:16:00.041527  6132 ts_tablet_manager.cc:1403] T e78312bda196492eae76f2673c979fee P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.052s	user 0.016s	sys 0.007s
I20260709 13:16:00.041878  6309 leader_election.cc:290] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:16:00.041970  5389 raft_consensus.cc:2468] T 068e5bd8f3ef45fc8a4a122e51537764 P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 2.
I20260709 13:16:00.043542  5434 leader_election.cc:304] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:16:00.044405  6309 raft_consensus.cc:2804] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:00.044780  6309 raft_consensus.cc:493] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.045218  6309 raft_consensus.cc:3060] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:00.044817  6132 raft_consensus.cc:359] T e78312bda196492eae76f2673c979fee P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:16:00.045717  6132 raft_consensus.cc:740] T e78312bda196492eae76f2673c979fee P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.047099  6259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "068e5bd8f3ef45fc8a4a122e51537764" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" is_pre_election: true
W20260709 13:16:00.052572  5434 leader_election.cc:343] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:00.055276  6132 consensus_queue.cc:260] T e78312bda196492eae76f2673c979fee P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:16:00.059248  6132 ts_tablet_manager.cc:1434] T e78312bda196492eae76f2673c979fee P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:16:00.060617  6132 tablet_bootstrap.cc:492] T 02dba91c167a418daee105670577c8aa P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:16:00.068311  6309 raft_consensus.cc:515] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:16:00.076337  5389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "068e5bd8f3ef45fc8a4a122e51537764" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:16:00.077041  5389 raft_consensus.cc:3060] T 068e5bd8f3ef45fc8a4a122e51537764 P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:00.082652  6309 leader_election.cc:290] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 3 election: Requested vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
I20260709 13:16:00.083343  6266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "068e5bd8f3ef45fc8a4a122e51537764" candidate_uuid: "77789aa45dc5463c82b73504fef4b4e0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
I20260709 13:16:00.101408  5389 raft_consensus.cc:2468] T 068e5bd8f3ef45fc8a4a122e51537764 P c4b52f14f9154b5a86f76fe58e4c235e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77789aa45dc5463c82b73504fef4b4e0 in term 3.
W20260709 13:16:00.106799  5434 leader_election.cc:343] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:00.107936  5434 leader_election.cc:304] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:16:00.125291  6261 raft_consensus.cc:2804] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:00.125950  6261 raft_consensus.cc:697] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [term 3 LEADER]: Becoming Leader. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Running, Role: LEADER
I20260709 13:16:00.126881  6261 consensus_queue.cc:237] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:16:00.227479  5142 catalog_manager.cc:5697] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 reported cstate change: term changed from 1 to 3, leader changed from 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129) to 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132). New cstate: current_term: 3 leader_uuid: "77789aa45dc5463c82b73504fef4b4e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:00.237501  5286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:41357, user_credentials={real_user=slave}} blocked reactor thread for 68550.9us
I20260709 13:16:00.257159  6132 tablet_bootstrap.cc:492] T 02dba91c167a418daee105670577c8aa P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:00.265925  6132 tablet_bootstrap.cc:492] T 02dba91c167a418daee105670577c8aa P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:16:00.266758  6132 ts_tablet_manager.cc:1403] T 02dba91c167a418daee105670577c8aa P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.206s	user 0.031s	sys 0.036s
I20260709 13:16:00.269758  6132 raft_consensus.cc:359] T 02dba91c167a418daee105670577c8aa P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:16:00.270475  6132 raft_consensus.cc:740] T 02dba91c167a418daee105670577c8aa P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.271139  6132 consensus_queue.cc:260] T 02dba91c167a418daee105670577c8aa P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:16:00.279395  6132 ts_tablet_manager.cc:1434] T 02dba91c167a418daee105670577c8aa P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:16:00.280416  6132 tablet_bootstrap.cc:492] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:16:00.308857  6132 tablet_bootstrap.cc:492] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:00.310496  6132 tablet_bootstrap.cc:492] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:16:00.311378  6132 ts_tablet_manager.cc:1403] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.031s	user 0.019s	sys 0.003s
I20260709 13:16:00.315548  6132 raft_consensus.cc:359] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:16:00.316388  6132 raft_consensus.cc:740] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.317221  6132 consensus_queue.cc:260] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:16:00.319530  6132 ts_tablet_manager.cc:1434] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:16:00.320437  6132 tablet_bootstrap.cc:492] T d443132476914cd1958f499f68f8acd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:16:00.345291  6132 tablet_bootstrap.cc:492] T d443132476914cd1958f499f68f8acd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:00.346432  6132 tablet_bootstrap.cc:492] T d443132476914cd1958f499f68f8acd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:16:00.347258  6132 ts_tablet_manager.cc:1403] T d443132476914cd1958f499f68f8acd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.000s
I20260709 13:16:00.350152  6132 raft_consensus.cc:359] T d443132476914cd1958f499f68f8acd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:16:00.352051  6132 raft_consensus.cc:740] T d443132476914cd1958f499f68f8acd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.352779  6132 consensus_queue.cc:260] T d443132476914cd1958f499f68f8acd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:16:00.354785  6132 ts_tablet_manager.cc:1434] T d443132476914cd1958f499f68f8acd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 13:16:00.355926  6132 tablet_bootstrap.cc:492] T 3d6bcda036934682b5075c20b786026d P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:16:00.373246  6132 tablet_bootstrap.cc:492] T 3d6bcda036934682b5075c20b786026d P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:00.374305  6132 tablet_bootstrap.cc:492] T 3d6bcda036934682b5075c20b786026d P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:16:00.375223  6132 ts_tablet_manager.cc:1403] T 3d6bcda036934682b5075c20b786026d P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.000s
I20260709 13:16:00.378060  6132 raft_consensus.cc:359] T 3d6bcda036934682b5075c20b786026d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:16:00.378778  6132 raft_consensus.cc:740] T 3d6bcda036934682b5075c20b786026d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.379561  6132 consensus_queue.cc:260] T 3d6bcda036934682b5075c20b786026d P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:16:00.381603  6132 ts_tablet_manager.cc:1434] T 3d6bcda036934682b5075c20b786026d P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:16:00.385151  6132 tablet_bootstrap.cc:492] T 436bb2869b55478b9c1cc99b5f83f981 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:16:00.400056  6132 tablet_bootstrap.cc:492] T 436bb2869b55478b9c1cc99b5f83f981 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:00.401006  6132 tablet_bootstrap.cc:492] T 436bb2869b55478b9c1cc99b5f83f981 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:16:00.401741  6132 ts_tablet_manager.cc:1403] T 436bb2869b55478b9c1cc99b5f83f981 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 13:16:00.404651  6132 raft_consensus.cc:359] T 436bb2869b55478b9c1cc99b5f83f981 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:16:00.405368  6132 raft_consensus.cc:740] T 436bb2869b55478b9c1cc99b5f83f981 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.406123  6132 consensus_queue.cc:260] T 436bb2869b55478b9c1cc99b5f83f981 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:16:00.409452  6132 ts_tablet_manager.cc:1434] T 436bb2869b55478b9c1cc99b5f83f981 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.004s
I20260709 13:16:00.410734  6132 tablet_bootstrap.cc:492] T 068e5bd8f3ef45fc8a4a122e51537764 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:16:00.420869  6259 raft_consensus.cc:3060] T d443132476914cd1958f499f68f8acd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:00.429301  6132 tablet_bootstrap.cc:492] T 068e5bd8f3ef45fc8a4a122e51537764 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:00.430459  6132 tablet_bootstrap.cc:492] T 068e5bd8f3ef45fc8a4a122e51537764 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:16:00.431227  6132 ts_tablet_manager.cc:1403] T 068e5bd8f3ef45fc8a4a122e51537764 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 13:16:00.434106  6132 raft_consensus.cc:359] T 068e5bd8f3ef45fc8a4a122e51537764 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:16:00.435168  6132 raft_consensus.cc:740] T 068e5bd8f3ef45fc8a4a122e51537764 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.436100  6132 consensus_queue.cc:260] T 068e5bd8f3ef45fc8a4a122e51537764 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:16:00.438715  6132 ts_tablet_manager.cc:1434] T 068e5bd8f3ef45fc8a4a122e51537764 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:16:00.441005  6132 tablet_bootstrap.cc:492] T 7541727e0e0944a6b184ac464bcc6eee P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:16:00.461319  6132 tablet_bootstrap.cc:492] T 7541727e0e0944a6b184ac464bcc6eee P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:00.464305  6132 tablet_bootstrap.cc:492] T 7541727e0e0944a6b184ac464bcc6eee P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:16:00.465217  6132 ts_tablet_manager.cc:1403] T 7541727e0e0944a6b184ac464bcc6eee P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.004s
I20260709 13:16:00.468096  6132 raft_consensus.cc:359] T 7541727e0e0944a6b184ac464bcc6eee P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:16:00.468806  6132 raft_consensus.cc:740] T 7541727e0e0944a6b184ac464bcc6eee P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.469496  6132 consensus_queue.cc:260] T 7541727e0e0944a6b184ac464bcc6eee P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:16:00.471745  6132 ts_tablet_manager.cc:1434] T 7541727e0e0944a6b184ac464bcc6eee P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:16:00.472922  6132 tablet_bootstrap.cc:492] T 309fb72c5b374642bb05a78b0b5ca308 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:16:00.492620  6132 tablet_bootstrap.cc:492] T 309fb72c5b374642bb05a78b0b5ca308 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:00.493857  6132 tablet_bootstrap.cc:492] T 309fb72c5b374642bb05a78b0b5ca308 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:16:00.494656  6132 ts_tablet_manager.cc:1403] T 309fb72c5b374642bb05a78b0b5ca308 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.004s
I20260709 13:16:00.497453  6132 raft_consensus.cc:359] T 309fb72c5b374642bb05a78b0b5ca308 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:16:00.498212  6132 raft_consensus.cc:740] T 309fb72c5b374642bb05a78b0b5ca308 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.498992  6132 consensus_queue.cc:260] T 309fb72c5b374642bb05a78b0b5ca308 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:16:00.500918  6132 ts_tablet_manager.cc:1434] T 309fb72c5b374642bb05a78b0b5ca308 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:16:00.501782  6132 tablet_bootstrap.cc:492] T cb26053fad7244cd88a5182d9cfc2109 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:16:00.513952  6260 raft_consensus.cc:3060] T 309fb72c5b374642bb05a78b0b5ca308 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:00.518368  6132 tablet_bootstrap.cc:492] T cb26053fad7244cd88a5182d9cfc2109 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:00.519661  6132 tablet_bootstrap.cc:492] T cb26053fad7244cd88a5182d9cfc2109 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:16:00.520452  6132 ts_tablet_manager.cc:1403] T cb26053fad7244cd88a5182d9cfc2109 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 13:16:00.521492  6264 raft_consensus.cc:3060] T 068e5bd8f3ef45fc8a4a122e51537764 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:16:00.523427  6132 raft_consensus.cc:359] T cb26053fad7244cd88a5182d9cfc2109 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:16:00.524392  6132 raft_consensus.cc:740] T cb26053fad7244cd88a5182d9cfc2109 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.525274  6132 consensus_queue.cc:260] T cb26053fad7244cd88a5182d9cfc2109 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:16:00.527297  6132 ts_tablet_manager.cc:1434] T cb26053fad7244cd88a5182d9cfc2109 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:16:00.528313  6132 tablet_bootstrap.cc:492] T 0fde317f3ec547c3840e2fe1e07ec228 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap starting.
I20260709 13:16:00.542974  6264 raft_consensus.cc:1275] T 068e5bd8f3ef45fc8a4a122e51537764 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 3 FOLLOWER]: Refusing update from remote peer 77789aa45dc5463c82b73504fef4b4e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:00.545373  6337 consensus_queue.cc:1048] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:00.572646  6132 tablet_bootstrap.cc:492] T 0fde317f3ec547c3840e2fe1e07ec228 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:00.573832  6132 tablet_bootstrap.cc:492] T 0fde317f3ec547c3840e2fe1e07ec228 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Bootstrap complete.
I20260709 13:16:00.574560  6132 ts_tablet_manager.cc:1403] T 0fde317f3ec547c3840e2fe1e07ec228 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent bootstrapping tablet: real 0.046s	user 0.026s	sys 0.016s
I20260709 13:16:00.578550  6132 raft_consensus.cc:359] T 0fde317f3ec547c3840e2fe1e07ec228 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:16:00.579483  6132 raft_consensus.cc:740] T 0fde317f3ec547c3840e2fe1e07ec228 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Initialized, Role: FOLLOWER
I20260709 13:16:00.580403  6132 consensus_queue.cc:260] T 0fde317f3ec547c3840e2fe1e07ec228 P 538ff4bfbd0c4f04bcd800c4ee4845ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:16:00.583242  6132 ts_tablet_manager.cc:1434] T 0fde317f3ec547c3840e2fe1e07ec228 P 538ff4bfbd0c4f04bcd800c4ee4845ba: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:16:00.598034  5389 raft_consensus.cc:1275] T 068e5bd8f3ef45fc8a4a122e51537764 P c4b52f14f9154b5a86f76fe58e4c235e [term 3 FOLLOWER]: Refusing update from remote peer 77789aa45dc5463c82b73504fef4b4e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:00.602475  6262 consensus_queue.cc:1048] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:00.679478  6259 raft_consensus.cc:3060] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.455061 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:09.519721  5319 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02dba91c167a418daee105670577c8aa"
dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
mode: GRACEFUL
new_leader_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
 from {username='slave'} at 127.0.0.1:53670
I20260709 13:16:09.520841  5319 raft_consensus.cc:606] T 02dba91c167a418daee105670577c8aa P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Received request to transfer leadership to TS 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:16:09.525164  5319 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "29ec9fd2ee334861a956e4d70d348b6d"
dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
mode: GRACEFUL
new_leader_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
 from {username='slave'} at 127.0.0.1:53670
I20260709 13:16:09.525871  5319 raft_consensus.cc:606] T 29ec9fd2ee334861a956e4d70d348b6d P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Received request to transfer leadership to TS 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:16:09.528770  5319 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43d23c7f276f4df1acd8124ed4940f1b"
dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
mode: GRACEFUL
new_leader_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
 from {username='slave'} at 127.0.0.1:53670
I20260709 13:16:09.529459  5319 raft_consensus.cc:606] T 43d23c7f276f4df1acd8124ed4940f1b P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Received request to transfer leadership to TS c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:16:09.532454  5319 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71b75232471f416bb2d0ec813f32558e"
dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
mode: GRACEFUL
new_leader_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
 from {username='slave'} at 127.0.0.1:53670
I20260709 13:16:09.533133  5319 raft_consensus.cc:606] T 71b75232471f416bb2d0ec813f32558e P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Received request to transfer leadership to TS 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:16:09.549093  5389 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73c339ffbbca40c78c31d33aa9bb9e38"
dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
mode: GRACEFUL
new_leader_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
 from {username='slave'} at 127.0.0.1:37196
I20260709 13:16:09.549651  5389 raft_consensus.cc:606] T 73c339ffbbca40c78c31d33aa9bb9e38 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 LEADER]: Received request to transfer leadership to TS 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:16:09.565073  5465 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c0e035a21aa4d43857f541259fa71b9"
dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
mode: GRACEFUL
new_leader_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
 from {username='slave'} at 127.0.0.1:46478
I20260709 13:16:09.565770  5465 raft_consensus.cc:606] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 LEADER]: Received request to transfer leadership to TS 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:16:09.568966  5319 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd6573fdc5bd411e8b0cbd3316ecaede"
dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
mode: GRACEFUL
new_leader_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
 from {username='slave'} at 127.0.0.1:53670
I20260709 13:16:09.569574  5319 raft_consensus.cc:606] T bd6573fdc5bd411e8b0cbd3316ecaede P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Received request to transfer leadership to TS 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:16:09.572570 28234 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:16:09.576200 28234 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:09.665287  6375 raft_consensus.cc:993] T bd6573fdc5bd411e8b0cbd3316ecaede P 2f45532f94a34efcb68a82db3dd69372: : Instructing follower 538ff4bfbd0c4f04bcd800c4ee4845ba to start an election
I20260709 13:16:09.666234  6376 raft_consensus.cc:1081] T bd6573fdc5bd411e8b0cbd3316ecaede P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Signalling peer 538ff4bfbd0c4f04bcd800c4ee4845ba to start an election
I20260709 13:16:09.667989  6259 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd6573fdc5bd411e8b0cbd3316ecaede"
dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
 from {username='slave'} at 127.0.0.1:49548
I20260709 13:16:09.668608  6259 raft_consensus.cc:493] T bd6573fdc5bd411e8b0cbd3316ecaede P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:09.668973  6259 raft_consensus.cc:3060] T bd6573fdc5bd411e8b0cbd3316ecaede P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.675741  6259 raft_consensus.cc:515] T bd6573fdc5bd411e8b0cbd3316ecaede P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:16:09.677701  6259 leader_election.cc:290] T bd6573fdc5bd411e8b0cbd3316ecaede P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 election: Requested vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:16:09.678885  5389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6573fdc5bd411e8b0cbd3316ecaede" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:16:09.678889  5319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd6573fdc5bd411e8b0cbd3316ecaede" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:16:09.679977  5389 raft_consensus.cc:3060] T bd6573fdc5bd411e8b0cbd3316ecaede P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.680006  5319 raft_consensus.cc:3055] T bd6573fdc5bd411e8b0cbd3316ecaede P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:09.680612  5319 raft_consensus.cc:740] T bd6573fdc5bd411e8b0cbd3316ecaede P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Running, Role: LEADER
I20260709 13:16:09.682169  5319 consensus_queue.cc:260] T bd6573fdc5bd411e8b0cbd3316ecaede P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:16:09.684263  5319 raft_consensus.cc:3060] T bd6573fdc5bd411e8b0cbd3316ecaede P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.686175  6370 raft_consensus.cc:993] T 73c339ffbbca40c78c31d33aa9bb9e38 P c4b52f14f9154b5a86f76fe58e4c235e: : Instructing follower 538ff4bfbd0c4f04bcd800c4ee4845ba to start an election
I20260709 13:16:09.694273  6369 raft_consensus.cc:1081] T 73c339ffbbca40c78c31d33aa9bb9e38 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 LEADER]: Signalling peer 538ff4bfbd0c4f04bcd800c4ee4845ba to start an election
I20260709 13:16:09.694514  5389 raft_consensus.cc:2468] T bd6573fdc5bd411e8b0cbd3316ecaede P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 2.
I20260709 13:16:09.697584  6127 leader_election.cc:304] T bd6573fdc5bd411e8b0cbd3316ecaede P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:16:09.701869  6259 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73c339ffbbca40c78c31d33aa9bb9e38"
dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
 from {username='slave'} at 127.0.0.1:49534
I20260709 13:16:09.702598  6259 raft_consensus.cc:493] T 73c339ffbbca40c78c31d33aa9bb9e38 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:09.702987  6259 raft_consensus.cc:3060] T 73c339ffbbca40c78c31d33aa9bb9e38 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.707647  5319 raft_consensus.cc:2468] T bd6573fdc5bd411e8b0cbd3316ecaede P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 2.
I20260709 13:16:09.710508  6383 raft_consensus.cc:2804] T bd6573fdc5bd411e8b0cbd3316ecaede P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:09.712312  6383 raft_consensus.cc:697] T bd6573fdc5bd411e8b0cbd3316ecaede P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 LEADER]: Becoming Leader. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Running, Role: LEADER
I20260709 13:16:09.713596  6259 raft_consensus.cc:515] T 73c339ffbbca40c78c31d33aa9bb9e38 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:16:09.713549  6383 consensus_queue.cc:237] T bd6573fdc5bd411e8b0cbd3316ecaede P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:16:09.716218  6259 leader_election.cc:290] T 73c339ffbbca40c78c31d33aa9bb9e38 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 election: Requested vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:16:09.717485  5389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c339ffbbca40c78c31d33aa9bb9e38" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:16:09.717620  5465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c339ffbbca40c78c31d33aa9bb9e38" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:16:09.718175  5389 raft_consensus.cc:3055] T 73c339ffbbca40c78c31d33aa9bb9e38 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:09.718609  5389 raft_consensus.cc:740] T 73c339ffbbca40c78c31d33aa9bb9e38 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Running, Role: LEADER
I20260709 13:16:09.718686  5465 raft_consensus.cc:3060] T 73c339ffbbca40c78c31d33aa9bb9e38 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.719561  5389 consensus_queue.cc:260] T 73c339ffbbca40c78c31d33aa9bb9e38 P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:16:09.722301  5389 raft_consensus.cc:3060] T 73c339ffbbca40c78c31d33aa9bb9e38 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.734360  5389 raft_consensus.cc:2468] T 73c339ffbbca40c78c31d33aa9bb9e38 P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 2.
I20260709 13:16:09.736608  6127 leader_election.cc:304] T 73c339ffbbca40c78c31d33aa9bb9e38 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:16:09.737650  6384 raft_consensus.cc:2804] T 73c339ffbbca40c78c31d33aa9bb9e38 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:09.741852  6384 raft_consensus.cc:697] T 73c339ffbbca40c78c31d33aa9bb9e38 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 LEADER]: Becoming Leader. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Running, Role: LEADER
I20260709 13:16:09.743254  6384 consensus_queue.cc:237] T 73c339ffbbca40c78c31d33aa9bb9e38 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:16:09.745522  5465 raft_consensus.cc:2468] T 73c339ffbbca40c78c31d33aa9bb9e38 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 2.
I20260709 13:16:09.757437  6375 raft_consensus.cc:993] T 71b75232471f416bb2d0ec813f32558e P 2f45532f94a34efcb68a82db3dd69372: : Instructing follower 538ff4bfbd0c4f04bcd800c4ee4845ba to start an election
I20260709 13:16:09.758013  6375 raft_consensus.cc:1081] T 71b75232471f416bb2d0ec813f32558e P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Signalling peer 538ff4bfbd0c4f04bcd800c4ee4845ba to start an election
I20260709 13:16:09.759792  6259 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71b75232471f416bb2d0ec813f32558e"
dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
 from {username='slave'} at 127.0.0.1:49548
I20260709 13:16:09.760562  6259 raft_consensus.cc:493] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:09.761305  6259 raft_consensus.cc:3060] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.764987  5142 catalog_manager.cc:5697] T bd6573fdc5bd411e8b0cbd3316ecaede P 538ff4bfbd0c4f04bcd800c4ee4845ba reported cstate change: term changed from 1 to 2, leader changed from 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130) to 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129). New cstate: current_term: 2 leader_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:09.770861  6259 raft_consensus.cc:515] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:16:09.773540  6259 leader_election.cc:290] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 election: Requested vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:16:09.774838  5319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b75232471f416bb2d0ec813f32558e" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:16:09.775067  5465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b75232471f416bb2d0ec813f32558e" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:16:09.775621  5319 raft_consensus.cc:3055] T 71b75232471f416bb2d0ec813f32558e P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:09.775807  5465 raft_consensus.cc:3060] T 71b75232471f416bb2d0ec813f32558e P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.775987  5319 raft_consensus.cc:740] T 71b75232471f416bb2d0ec813f32558e P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Running, Role: LEADER
I20260709 13:16:09.776924  5319 consensus_queue.cc:260] T 71b75232471f416bb2d0ec813f32558e P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:16:09.778128  5319 raft_consensus.cc:3060] T 71b75232471f416bb2d0ec813f32558e P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.784312  5465 raft_consensus.cc:2468] T 71b75232471f416bb2d0ec813f32558e P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 2.
I20260709 13:16:09.785496  5319 raft_consensus.cc:2468] T 71b75232471f416bb2d0ec813f32558e P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 2.
I20260709 13:16:09.786342  6125 leader_election.cc:304] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, 77789aa45dc5463c82b73504fef4b4e0; no voters: 
I20260709 13:16:09.787395  6383 raft_consensus.cc:2804] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:09.788268  6383 raft_consensus.cc:697] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 LEADER]: Becoming Leader. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Running, Role: LEADER
I20260709 13:16:09.789546  6383 consensus_queue.cc:237] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:16:09.801467  5142 catalog_manager.cc:5697] T 73c339ffbbca40c78c31d33aa9bb9e38 P 538ff4bfbd0c4f04bcd800c4ee4845ba reported cstate change: term changed from 1 to 2, leader changed from c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131) to 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129). New cstate: current_term: 2 leader_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:09.802814  5142 catalog_manager.cc:5697] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba reported cstate change: term changed from 1 to 2, leader changed from 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130) to 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129). New cstate: current_term: 2 leader_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:09.857393  6375 raft_consensus.cc:993] T 02dba91c167a418daee105670577c8aa P 2f45532f94a34efcb68a82db3dd69372: : Instructing follower 538ff4bfbd0c4f04bcd800c4ee4845ba to start an election
I20260709 13:16:09.857954  6375 raft_consensus.cc:1081] T 02dba91c167a418daee105670577c8aa P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Signalling peer 538ff4bfbd0c4f04bcd800c4ee4845ba to start an election
I20260709 13:16:09.860037  6264 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02dba91c167a418daee105670577c8aa"
dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
 from {username='slave'} at 127.0.0.1:49548
I20260709 13:16:09.860654  6264 raft_consensus.cc:493] T 02dba91c167a418daee105670577c8aa P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:09.860997  6264 raft_consensus.cc:3060] T 02dba91c167a418daee105670577c8aa P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.871348  6374 raft_consensus.cc:993] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0: : Instructing follower 538ff4bfbd0c4f04bcd800c4ee4845ba to start an election
I20260709 13:16:09.872210  6377 raft_consensus.cc:1081] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 LEADER]: Signalling peer 538ff4bfbd0c4f04bcd800c4ee4845ba to start an election
I20260709 13:16:09.872521  6264 raft_consensus.cc:515] T 02dba91c167a418daee105670577c8aa P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:16:09.874603  6259 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c0e035a21aa4d43857f541259fa71b9"
dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
 from {username='slave'} at 127.0.0.1:49560
I20260709 13:16:09.875324  6259 raft_consensus.cc:493] T 7c0e035a21aa4d43857f541259fa71b9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:09.875813  6259 raft_consensus.cc:3060] T 7c0e035a21aa4d43857f541259fa71b9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.875867  5319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dba91c167a418daee105670577c8aa" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:16:09.876567  5319 raft_consensus.cc:3055] T 02dba91c167a418daee105670577c8aa P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:09.876911  5319 raft_consensus.cc:740] T 02dba91c167a418daee105670577c8aa P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Running, Role: LEADER
I20260709 13:16:09.877830  5319 consensus_queue.cc:260] T 02dba91c167a418daee105670577c8aa P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:16:09.879562  5319 raft_consensus.cc:3060] T 02dba91c167a418daee105670577c8aa P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.888955  6264 leader_election.cc:290] T 02dba91c167a418daee105670577c8aa P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 election: Requested vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:16:09.889896  5389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dba91c167a418daee105670577c8aa" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:16:09.890564  5389 raft_consensus.cc:3060] T 02dba91c167a418daee105670577c8aa P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.892225  5319 raft_consensus.cc:2468] T 02dba91c167a418daee105670577c8aa P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 2.
I20260709 13:16:09.892282  6259 raft_consensus.cc:515] T 7c0e035a21aa4d43857f541259fa71b9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:16:09.894697  6126 leader_election.cc:304] T 02dba91c167a418daee105670577c8aa P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 
I20260709 13:16:09.895457  6375 raft_consensus.cc:993] T 43d23c7f276f4df1acd8124ed4940f1b P 2f45532f94a34efcb68a82db3dd69372: : Instructing follower c4b52f14f9154b5a86f76fe58e4c235e to start an election
I20260709 13:16:09.896011  6375 raft_consensus.cc:1081] T 43d23c7f276f4df1acd8124ed4940f1b P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Signalling peer c4b52f14f9154b5a86f76fe58e4c235e to start an election
I20260709 13:16:09.896014  6383 raft_consensus.cc:2804] T 02dba91c167a418daee105670577c8aa P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:09.897461  6383 raft_consensus.cc:697] T 02dba91c167a418daee105670577c8aa P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 LEADER]: Becoming Leader. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Running, Role: LEADER
I20260709 13:16:09.899186  5465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e035a21aa4d43857f541259fa71b9" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:16:09.899834  5465 raft_consensus.cc:3055] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:09.900146  5465 raft_consensus.cc:740] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Running, Role: LEADER
I20260709 13:16:09.900951  5465 consensus_queue.cc:260] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:16:09.898412  6383 consensus_queue.cc:237] T 02dba91c167a418daee105670577c8aa P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:16:09.902232  5465 raft_consensus.cc:3060] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.904134  5392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0e035a21aa4d43857f541259fa71b9" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:16:09.904961  5392 raft_consensus.cc:3060] T 7c0e035a21aa4d43857f541259fa71b9 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.911957  6259 leader_election.cc:290] T 7c0e035a21aa4d43857f541259fa71b9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 election: Requested vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:16:09.904242  5389 raft_consensus.cc:2468] T 02dba91c167a418daee105670577c8aa P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 2.
I20260709 13:16:09.912621  5391 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43d23c7f276f4df1acd8124ed4940f1b"
dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
 from {username='slave'} at 127.0.0.1:44330
I20260709 13:16:09.913427  5391 raft_consensus.cc:493] T 43d23c7f276f4df1acd8124ed4940f1b P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:09.913825  5391 raft_consensus.cc:3060] T 43d23c7f276f4df1acd8124ed4940f1b P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.915681  5465 raft_consensus.cc:2468] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 2.
I20260709 13:16:09.917135  6125 leader_election.cc:304] T 7c0e035a21aa4d43857f541259fa71b9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, 77789aa45dc5463c82b73504fef4b4e0; no voters: 
I20260709 13:16:09.918041  6384 raft_consensus.cc:2804] T 7c0e035a21aa4d43857f541259fa71b9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:09.918567  6384 raft_consensus.cc:697] T 7c0e035a21aa4d43857f541259fa71b9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 LEADER]: Becoming Leader. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Running, Role: LEADER
I20260709 13:16:09.919610  6384 consensus_queue.cc:237] T 7c0e035a21aa4d43857f541259fa71b9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:16:09.929445  5392 raft_consensus.cc:2468] T 7c0e035a21aa4d43857f541259fa71b9 P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 2.
I20260709 13:16:09.929699  5391 raft_consensus.cc:515] T 43d23c7f276f4df1acd8124ed4940f1b P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:16:09.933209  5465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43d23c7f276f4df1acd8124ed4940f1b" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:16:09.934198  5465 raft_consensus.cc:3060] T 43d23c7f276f4df1acd8124ed4940f1b P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.932659  5391 leader_election.cc:290] T 43d23c7f276f4df1acd8124ed4940f1b P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 2 election: Requested vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:16:09.936776  5319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43d23c7f276f4df1acd8124ed4940f1b" candidate_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:16:09.937601  5319 raft_consensus.cc:3055] T 43d23c7f276f4df1acd8124ed4940f1b P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:09.937935  5319 raft_consensus.cc:740] T 43d23c7f276f4df1acd8124ed4940f1b P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Running, Role: LEADER
I20260709 13:16:09.938859  5319 consensus_queue.cc:260] T 43d23c7f276f4df1acd8124ed4940f1b P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:16:09.940904  5319 raft_consensus.cc:3060] T 43d23c7f276f4df1acd8124ed4940f1b P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:09.944730  5465 raft_consensus.cc:2468] T 43d23c7f276f4df1acd8124ed4940f1b P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 2.
I20260709 13:16:09.944983  5142 catalog_manager.cc:5697] T 02dba91c167a418daee105670577c8aa P 538ff4bfbd0c4f04bcd800c4ee4845ba reported cstate change: term changed from 1 to 2, leader changed from 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130) to 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129). New cstate: current_term: 2 leader_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:09.946326  5358 leader_election.cc:304] T 43d23c7f276f4df1acd8124ed4940f1b P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:16:09.947355  6382 raft_consensus.cc:2804] T 43d23c7f276f4df1acd8124ed4940f1b P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:09.947888  6382 raft_consensus.cc:697] T 43d23c7f276f4df1acd8124ed4940f1b P c4b52f14f9154b5a86f76fe58e4c235e [term 2 LEADER]: Becoming Leader. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Running, Role: LEADER
I20260709 13:16:09.948426  5319 raft_consensus.cc:2468] T 43d23c7f276f4df1acd8124ed4940f1b P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4b52f14f9154b5a86f76fe58e4c235e in term 2.
I20260709 13:16:09.948895  6382 consensus_queue.cc:237] T 43d23c7f276f4df1acd8124ed4940f1b P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:16:09.964026  5142 catalog_manager.cc:5697] T 43d23c7f276f4df1acd8124ed4940f1b P c4b52f14f9154b5a86f76fe58e4c235e reported cstate change: term changed from 1 to 2, leader changed from 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130) to c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131). New cstate: current_term: 2 leader_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:09.968973  5143 catalog_manager.cc:5697] T 7c0e035a21aa4d43857f541259fa71b9 P 538ff4bfbd0c4f04bcd800c4ee4845ba reported cstate change: term changed from 1 to 2, leader changed from 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132) to 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129). New cstate: current_term: 2 leader_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:10.016312  6375 raft_consensus.cc:993] T 29ec9fd2ee334861a956e4d70d348b6d P 2f45532f94a34efcb68a82db3dd69372: : Instructing follower 538ff4bfbd0c4f04bcd800c4ee4845ba to start an election
I20260709 13:16:10.017130  6366 raft_consensus.cc:1081] T 29ec9fd2ee334861a956e4d70d348b6d P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Signalling peer 538ff4bfbd0c4f04bcd800c4ee4845ba to start an election
I20260709 13:16:10.018944  6259 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "29ec9fd2ee334861a956e4d70d348b6d"
dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
 from {username='slave'} at 127.0.0.1:49548
I20260709 13:16:10.019640  6259 raft_consensus.cc:493] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:10.020013  6259 raft_consensus.cc:3060] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:10.027391  6259 raft_consensus.cc:515] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:16:10.030478  6259 leader_election.cc:290] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 election: Requested vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:16:10.030392  5391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ec9fd2ee334861a956e4d70d348b6d" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:16:10.030846  5319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ec9fd2ee334861a956e4d70d348b6d" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:16:10.031315  5391 raft_consensus.cc:3060] T 29ec9fd2ee334861a956e4d70d348b6d P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:10.031719  5319 raft_consensus.cc:3055] T 29ec9fd2ee334861a956e4d70d348b6d P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:10.032130  5319 raft_consensus.cc:740] T 29ec9fd2ee334861a956e4d70d348b6d P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Running, Role: LEADER
I20260709 13:16:10.032950  5319 consensus_queue.cc:260] T 29ec9fd2ee334861a956e4d70d348b6d P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:16:10.034370  5319 raft_consensus.cc:3060] T 29ec9fd2ee334861a956e4d70d348b6d P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:10.038921  5391 raft_consensus.cc:2468] T 29ec9fd2ee334861a956e4d70d348b6d P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 2.
I20260709 13:16:10.040542  6127 leader_election.cc:304] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:16:10.041544  6383 raft_consensus.cc:2804] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:10.042053  6383 raft_consensus.cc:697] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 LEADER]: Becoming Leader. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Running, Role: LEADER
I20260709 13:16:10.043109  6383 consensus_queue.cc:237] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:16:10.045720  5319 raft_consensus.cc:2468] T 29ec9fd2ee334861a956e4d70d348b6d P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 2.
I20260709 13:16:10.061002  5143 catalog_manager.cc:5697] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba reported cstate change: term changed from 1 to 2, leader changed from 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130) to 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129). New cstate: current_term: 2 leader_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:10.106163  5388 raft_consensus.cc:1275] T bd6573fdc5bd411e8b0cbd3316ecaede P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Refusing update from remote peer 538ff4bfbd0c4f04bcd800c4ee4845ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:10.107657  6383 consensus_queue.cc:1048] T bd6573fdc5bd411e8b0cbd3316ecaede P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:10.124130  5315 raft_consensus.cc:1275] T bd6573fdc5bd411e8b0cbd3316ecaede P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Refusing update from remote peer 538ff4bfbd0c4f04bcd800c4ee4845ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:10.126006  6383 consensus_queue.cc:1048] T bd6573fdc5bd411e8b0cbd3316ecaede P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:10.184985  5315 raft_consensus.cc:1275] T 71b75232471f416bb2d0ec813f32558e P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Refusing update from remote peer 538ff4bfbd0c4f04bcd800c4ee4845ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:10.186443  6384 consensus_queue.cc:1048] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:10.197784  5465 raft_consensus.cc:1275] T 71b75232471f416bb2d0ec813f32558e P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Refusing update from remote peer 538ff4bfbd0c4f04bcd800c4ee4845ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:10.199905  6384 consensus_queue.cc:1048] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:10.218243  5462 raft_consensus.cc:1275] T 73c339ffbbca40c78c31d33aa9bb9e38 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Refusing update from remote peer 538ff4bfbd0c4f04bcd800c4ee4845ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:10.219971  6383 consensus_queue.cc:1048] T 73c339ffbbca40c78c31d33aa9bb9e38 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:10.254297  5388 raft_consensus.cc:1275] T 73c339ffbbca40c78c31d33aa9bb9e38 P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Refusing update from remote peer 538ff4bfbd0c4f04bcd800c4ee4845ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:10.256922  6386 consensus_queue.cc:1048] T 73c339ffbbca40c78c31d33aa9bb9e38 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:10.319335  5388 raft_consensus.cc:1275] T 02dba91c167a418daee105670577c8aa P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Refusing update from remote peer 538ff4bfbd0c4f04bcd800c4ee4845ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:10.320577  6383 consensus_queue.cc:1048] T 02dba91c167a418daee105670577c8aa P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:10.330583  5315 raft_consensus.cc:1275] T 02dba91c167a418daee105670577c8aa P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Refusing update from remote peer 538ff4bfbd0c4f04bcd800c4ee4845ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:10.332538  6386 consensus_queue.cc:1048] T 02dba91c167a418daee105670577c8aa P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:10.334478  5462 raft_consensus.cc:1275] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Refusing update from remote peer 538ff4bfbd0c4f04bcd800c4ee4845ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:10.336498  6384 consensus_queue.cc:1048] T 7c0e035a21aa4d43857f541259fa71b9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:10.361332  5388 raft_consensus.cc:1275] T 7c0e035a21aa4d43857f541259fa71b9 P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Refusing update from remote peer 538ff4bfbd0c4f04bcd800c4ee4845ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:10.363049  6386 consensus_queue.cc:1048] T 7c0e035a21aa4d43857f541259fa71b9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:10.397637  5462 raft_consensus.cc:1275] T 43d23c7f276f4df1acd8124ed4940f1b P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Refusing update from remote peer c4b52f14f9154b5a86f76fe58e4c235e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:10.399225  6404 consensus_queue.cc:1048] T 43d23c7f276f4df1acd8124ed4940f1b P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:10.414515  5319 raft_consensus.cc:1275] T 43d23c7f276f4df1acd8124ed4940f1b P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Refusing update from remote peer c4b52f14f9154b5a86f76fe58e4c235e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:10.416517  6382 consensus_queue.cc:1048] T 43d23c7f276f4df1acd8124ed4940f1b P c4b52f14f9154b5a86f76fe58e4c235e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:10.430438  5391 raft_consensus.cc:1275] T 29ec9fd2ee334861a956e4d70d348b6d P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Refusing update from remote peer 538ff4bfbd0c4f04bcd800c4ee4845ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:10.434206  6386 consensus_queue.cc:1048] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:10.471571  5315 raft_consensus.cc:1275] T 29ec9fd2ee334861a956e4d70d348b6d P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Refusing update from remote peer 538ff4bfbd0c4f04bcd800c4ee4845ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:10.475215  6383 consensus_queue.cc:1048] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:10.577807 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:10.644775 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:10.691241  5314 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1db09971a25441c68427b8bea7e9c379"
dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
mode: GRACEFUL
new_leader_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
 from {username='slave'} at 127.0.0.1:53670
I20260709 13:16:10.691866  5314 raft_consensus.cc:606] T 1db09971a25441c68427b8bea7e9c379 P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Received request to transfer leadership to TS 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:16:10.694787  5462 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "29f5415006bb4218b579d580f0b9ff68"
dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
mode: GRACEFUL
new_leader_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
 from {username='slave'} at 127.0.0.1:46478
I20260709 13:16:10.695420  5462 raft_consensus.cc:606] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 LEADER]: Received request to transfer leadership to TS 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:16:10.698434  5388 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e48fc9e60214121991b0bb473d174da"
dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
mode: GRACEFUL
new_leader_uuid: "2f45532f94a34efcb68a82db3dd69372"
 from {username='slave'} at 127.0.0.1:37196
I20260709 13:16:10.699000  5388 raft_consensus.cc:606] T 3e48fc9e60214121991b0bb473d174da P c4b52f14f9154b5a86f76fe58e4c235e [term 1 LEADER]: Received request to transfer leadership to TS 2f45532f94a34efcb68a82db3dd69372
I20260709 13:16:10.702185  5462 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d841937b5db4e7fa656db32b84b9ca2"
dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
mode: GRACEFUL
new_leader_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
 from {username='slave'} at 127.0.0.1:46478
I20260709 13:16:10.702696  5462 raft_consensus.cc:606] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 LEADER]: Received request to transfer leadership to TS 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:16:10.708143  5314 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1ab7b32db51471796738b38f71b64df"
dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
mode: GRACEFUL
new_leader_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
 from {username='slave'} at 127.0.0.1:53670
I20260709 13:16:10.708737  5314 raft_consensus.cc:606] T b1ab7b32db51471796738b38f71b64df P 2f45532f94a34efcb68a82db3dd69372 [term 2 LEADER]: Received request to transfer leadership to TS 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:16:10.724964  5462 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fce0170182474e7dbe46361f5bf0eae9"
dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
mode: GRACEFUL
new_leader_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
 from {username='slave'} at 127.0.0.1:46478
I20260709 13:16:10.728516  5462 raft_consensus.cc:606] T fce0170182474e7dbe46361f5bf0eae9 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 LEADER]: Received request to transfer leadership to TS 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:16:10.732761 28234 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:16:10.734587  6376 raft_consensus.cc:993] T b1ab7b32db51471796738b38f71b64df P 2f45532f94a34efcb68a82db3dd69372: : Instructing follower 538ff4bfbd0c4f04bcd800c4ee4845ba to start an election
I20260709 13:16:10.735291  6376 raft_consensus.cc:1081] T b1ab7b32db51471796738b38f71b64df P 2f45532f94a34efcb68a82db3dd69372 [term 2 LEADER]: Signalling peer 538ff4bfbd0c4f04bcd800c4ee4845ba to start an election
I20260709 13:16:10.734622 28234 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:10.737165  6264 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1ab7b32db51471796738b38f71b64df"
dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
 from {username='slave'} at 127.0.0.1:49548
I20260709 13:16:10.737818  6264 raft_consensus.cc:493] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:10.738154  6264 raft_consensus.cc:3060] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:10.749894  6264 raft_consensus.cc:515] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:16:10.752002  6264 leader_election.cc:290] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 3 election: Requested vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:16:10.753513  5388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ab7b32db51471796738b38f71b64df" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:16:10.754406  5388 raft_consensus.cc:3060] T b1ab7b32db51471796738b38f71b64df P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:10.755066  5315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1ab7b32db51471796738b38f71b64df" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:16:10.755806  5315 raft_consensus.cc:3055] T b1ab7b32db51471796738b38f71b64df P 2f45532f94a34efcb68a82db3dd69372 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:10.756124  5315 raft_consensus.cc:740] T b1ab7b32db51471796738b38f71b64df P 2f45532f94a34efcb68a82db3dd69372 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Running, Role: LEADER
I20260709 13:16:10.756877  5315 consensus_queue.cc:260] T b1ab7b32db51471796738b38f71b64df P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:16:10.757762  5315 raft_consensus.cc:3060] T b1ab7b32db51471796738b38f71b64df P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:10.764292  5388 raft_consensus.cc:2468] T b1ab7b32db51471796738b38f71b64df P c4b52f14f9154b5a86f76fe58e4c235e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 3.
I20260709 13:16:10.765616  5315 raft_consensus.cc:2468] T b1ab7b32db51471796738b38f71b64df P 2f45532f94a34efcb68a82db3dd69372 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 3.
I20260709 13:16:10.765820  6127 leader_election.cc:304] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:16:10.767037  6384 raft_consensus.cc:2804] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:10.767584  6384 raft_consensus.cc:697] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 3 LEADER]: Becoming Leader. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Running, Role: LEADER
I20260709 13:16:10.768559  6384 consensus_queue.cc:237] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:16:10.787668  5142 catalog_manager.cc:5697] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba reported cstate change: term changed from 2 to 3, leader changed from 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130) to 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129). New cstate: current_term: 3 leader_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:10.820725  6377 raft_consensus.cc:993] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0: : Instructing follower 538ff4bfbd0c4f04bcd800c4ee4845ba to start an election
I20260709 13:16:10.821769  6374 raft_consensus.cc:1081] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 LEADER]: Signalling peer 538ff4bfbd0c4f04bcd800c4ee4845ba to start an election
I20260709 13:16:10.824975  6259 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d841937b5db4e7fa656db32b84b9ca2"
dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
 from {username='slave'} at 127.0.0.1:49560
I20260709 13:16:10.825644  6259 raft_consensus.cc:493] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:10.826054  6259 raft_consensus.cc:3060] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:10.834828  6259 raft_consensus.cc:515] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:16:10.836606  6259 leader_election.cc:290] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 3 election: Requested vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:16:10.837581  5462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d841937b5db4e7fa656db32b84b9ca2" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:16:10.838073  5315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d841937b5db4e7fa656db32b84b9ca2" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:16:10.838368  5462 raft_consensus.cc:3055] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:10.838655  5315 raft_consensus.cc:3060] T 5d841937b5db4e7fa656db32b84b9ca2 P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:10.838709  5462 raft_consensus.cc:740] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Running, Role: LEADER
I20260709 13:16:10.839748  5462 consensus_queue.cc:260] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:16:10.841006  5462 raft_consensus.cc:3060] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:10.845960  5315 raft_consensus.cc:2468] T 5d841937b5db4e7fa656db32b84b9ca2 P 2f45532f94a34efcb68a82db3dd69372 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 3.
I20260709 13:16:10.848951  6126 leader_election.cc:304] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 
I20260709 13:16:10.849969  6384 raft_consensus.cc:2804] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:10.850482  6384 raft_consensus.cc:697] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 3 LEADER]: Becoming Leader. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Running, Role: LEADER
I20260709 13:16:10.851377  6384 consensus_queue.cc:237] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:16:10.853916  5462 raft_consensus.cc:2468] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 3.
I20260709 13:16:10.866462  5142 catalog_manager.cc:5697] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba reported cstate change: term changed from 2 to 3, leader changed from 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132) to 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129). New cstate: current_term: 3 leader_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:10.912676  6377 raft_consensus.cc:993] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0: : Instructing follower 538ff4bfbd0c4f04bcd800c4ee4845ba to start an election
I20260709 13:16:10.913249  6374 raft_consensus.cc:1081] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 LEADER]: Signalling peer 538ff4bfbd0c4f04bcd800c4ee4845ba to start an election
I20260709 13:16:10.915047  6264 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "29f5415006bb4218b579d580f0b9ff68"
dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
 from {username='slave'} at 127.0.0.1:49560
I20260709 13:16:10.915796  6264 raft_consensus.cc:493] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:10.916200  6264 raft_consensus.cc:3060] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:10.922067  6264 raft_consensus.cc:515] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:16:10.923833  6264 leader_election.cc:290] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 3 election: Requested vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:16:10.924837  5462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f5415006bb4218b579d580f0b9ff68" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:16:10.925153  5315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f5415006bb4218b579d580f0b9ff68" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:16:10.925637  5462 raft_consensus.cc:3055] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:10.925776  5315 raft_consensus.cc:3060] T 29f5415006bb4218b579d580f0b9ff68 P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:10.926038  5462 raft_consensus.cc:740] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Running, Role: LEADER
I20260709 13:16:10.926908  5462 consensus_queue.cc:260] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:16:10.928314  5462 raft_consensus.cc:3060] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:10.934818  5315 raft_consensus.cc:2468] T 29f5415006bb4218b579d580f0b9ff68 P 2f45532f94a34efcb68a82db3dd69372 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 3.
I20260709 13:16:10.936224  6126 leader_election.cc:304] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 
I20260709 13:16:10.937165  6384 raft_consensus.cc:2804] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:10.937774  6384 raft_consensus.cc:697] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 3 LEADER]: Becoming Leader. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Running, Role: LEADER
I20260709 13:16:10.938728  6384 consensus_queue.cc:237] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:16:10.939782  5462 raft_consensus.cc:2468] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 3.
I20260709 13:16:10.949944  5142 catalog_manager.cc:5697] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba reported cstate change: term changed from 2 to 3, leader changed from 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132) to 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129). New cstate: current_term: 3 leader_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:10.956535  6369 raft_consensus.cc:993] T 3e48fc9e60214121991b0bb473d174da P c4b52f14f9154b5a86f76fe58e4c235e: : Instructing follower 2f45532f94a34efcb68a82db3dd69372 to start an election
I20260709 13:16:10.957070  6382 raft_consensus.cc:1081] T 3e48fc9e60214121991b0bb473d174da P c4b52f14f9154b5a86f76fe58e4c235e [term 1 LEADER]: Signalling peer 2f45532f94a34efcb68a82db3dd69372 to start an election
I20260709 13:16:10.958915  5315 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e48fc9e60214121991b0bb473d174da"
dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
 from {username='slave'} at 127.0.0.1:37746
I20260709 13:16:10.959554  5315 raft_consensus.cc:493] T 3e48fc9e60214121991b0bb473d174da P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:10.959870  5315 raft_consensus.cc:3060] T 3e48fc9e60214121991b0bb473d174da P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:10.966001  5315 raft_consensus.cc:515] T 3e48fc9e60214121991b0bb473d174da P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:16:10.968338  5315 leader_election.cc:290] T 3e48fc9e60214121991b0bb473d174da P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 election: Requested vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:16:10.972299  5388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e48fc9e60214121991b0bb473d174da" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:16:10.973021  5388 raft_consensus.cc:3055] T 3e48fc9e60214121991b0bb473d174da P c4b52f14f9154b5a86f76fe58e4c235e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:10.973344  5388 raft_consensus.cc:740] T 3e48fc9e60214121991b0bb473d174da P c4b52f14f9154b5a86f76fe58e4c235e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Running, Role: LEADER
I20260709 13:16:10.974136  5388 consensus_queue.cc:260] T 3e48fc9e60214121991b0bb473d174da P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:16:10.970384  5462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e48fc9e60214121991b0bb473d174da" candidate_uuid: "2f45532f94a34efcb68a82db3dd69372" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:16:10.976487  5462 raft_consensus.cc:3060] T 3e48fc9e60214121991b0bb473d174da P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:10.978794  5388 raft_consensus.cc:3060] T 3e48fc9e60214121991b0bb473d174da P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:10.985610  5462 raft_consensus.cc:2468] T 3e48fc9e60214121991b0bb473d174da P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 2.
I20260709 13:16:10.991269  5284 leader_election.cc:304] T 3e48fc9e60214121991b0bb473d174da P 2f45532f94a34efcb68a82db3dd69372 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 77789aa45dc5463c82b73504fef4b4e0; no voters: 
I20260709 13:16:10.992481  6375 raft_consensus.cc:2804] T 3e48fc9e60214121991b0bb473d174da P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:10.995945  5388 raft_consensus.cc:2468] T 3e48fc9e60214121991b0bb473d174da P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f45532f94a34efcb68a82db3dd69372 in term 2.
I20260709 13:16:10.993249  6375 raft_consensus.cc:697] T 3e48fc9e60214121991b0bb473d174da P 2f45532f94a34efcb68a82db3dd69372 [term 2 LEADER]: Becoming Leader. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Running, Role: LEADER
I20260709 13:16:10.997845  6375 consensus_queue.cc:237] T 3e48fc9e60214121991b0bb473d174da P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } }
I20260709 13:16:11.015159  6366 raft_consensus.cc:993] T 1db09971a25441c68427b8bea7e9c379 P 2f45532f94a34efcb68a82db3dd69372: : Instructing follower 538ff4bfbd0c4f04bcd800c4ee4845ba to start an election
I20260709 13:16:11.015709  6366 raft_consensus.cc:1081] T 1db09971a25441c68427b8bea7e9c379 P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Signalling peer 538ff4bfbd0c4f04bcd800c4ee4845ba to start an election
I20260709 13:16:11.015563  5142 catalog_manager.cc:5697] T 3e48fc9e60214121991b0bb473d174da P 2f45532f94a34efcb68a82db3dd69372 reported cstate change: term changed from 1 to 2, leader changed from c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131) to 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130). New cstate: current_term: 2 leader_uuid: "2f45532f94a34efcb68a82db3dd69372" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:11.017683  6264 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1db09971a25441c68427b8bea7e9c379"
dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
 from {username='slave'} at 127.0.0.1:49548
I20260709 13:16:11.018282  6264 raft_consensus.cc:493] T 1db09971a25441c68427b8bea7e9c379 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:11.018679  6264 raft_consensus.cc:3060] T 1db09971a25441c68427b8bea7e9c379 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.028337  6264 raft_consensus.cc:515] T 1db09971a25441c68427b8bea7e9c379 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:16:11.031390  6264 leader_election.cc:290] T 1db09971a25441c68427b8bea7e9c379 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 election: Requested vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:16:11.032306  5315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db09971a25441c68427b8bea7e9c379" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:16:11.033039  5315 raft_consensus.cc:3055] T 1db09971a25441c68427b8bea7e9c379 P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:11.033355  5315 raft_consensus.cc:740] T 1db09971a25441c68427b8bea7e9c379 P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Running, Role: LEADER
I20260709 13:16:11.033427  5388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1db09971a25441c68427b8bea7e9c379" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:16:11.034020  5388 raft_consensus.cc:3060] T 1db09971a25441c68427b8bea7e9c379 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.034339  5315 consensus_queue.cc:260] T 1db09971a25441c68427b8bea7e9c379 P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:16:11.037587  5315 raft_consensus.cc:3060] T 1db09971a25441c68427b8bea7e9c379 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.043463  5388 raft_consensus.cc:2468] T 1db09971a25441c68427b8bea7e9c379 P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 2.
I20260709 13:16:11.044844  6127 leader_election.cc:304] T 1db09971a25441c68427b8bea7e9c379 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:16:11.045830  6384 raft_consensus.cc:2804] T 1db09971a25441c68427b8bea7e9c379 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:11.046357  6384 raft_consensus.cc:697] T 1db09971a25441c68427b8bea7e9c379 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 LEADER]: Becoming Leader. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Running, Role: LEADER
I20260709 13:16:11.046528  5315 raft_consensus.cc:2468] T 1db09971a25441c68427b8bea7e9c379 P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 2.
I20260709 13:16:11.047401  6384 consensus_queue.cc:237] T 1db09971a25441c68427b8bea7e9c379 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:16:11.061364  5142 catalog_manager.cc:5697] T 1db09971a25441c68427b8bea7e9c379 P 538ff4bfbd0c4f04bcd800c4ee4845ba reported cstate change: term changed from 1 to 2, leader changed from 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130) to 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129). New cstate: current_term: 2 leader_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:11.151428  6377 raft_consensus.cc:993] T fce0170182474e7dbe46361f5bf0eae9 P 77789aa45dc5463c82b73504fef4b4e0: : Instructing follower 538ff4bfbd0c4f04bcd800c4ee4845ba to start an election
I20260709 13:16:11.152071  6374 raft_consensus.cc:1081] T fce0170182474e7dbe46361f5bf0eae9 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 LEADER]: Signalling peer 538ff4bfbd0c4f04bcd800c4ee4845ba to start an election
I20260709 13:16:11.153915  6264 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fce0170182474e7dbe46361f5bf0eae9"
dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
 from {username='slave'} at 127.0.0.1:49560
I20260709 13:16:11.154486  6264 raft_consensus.cc:493] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:11.154807  6264 raft_consensus.cc:3060] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.160075  6264 raft_consensus.cc:515] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:16:11.161949  6264 leader_election.cc:290] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 election: Requested vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:16:11.163089  5465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce0170182474e7dbe46361f5bf0eae9" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:16:11.163079  5388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce0170182474e7dbe46361f5bf0eae9" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:16:11.164130  5465 raft_consensus.cc:3055] T fce0170182474e7dbe46361f5bf0eae9 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:11.164227  5388 raft_consensus.cc:3060] T fce0170182474e7dbe46361f5bf0eae9 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.164603  5465 raft_consensus.cc:740] T fce0170182474e7dbe46361f5bf0eae9 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 77789aa45dc5463c82b73504fef4b4e0, State: Running, Role: LEADER
I20260709 13:16:11.166582  5465 consensus_queue.cc:260] T fce0170182474e7dbe46361f5bf0eae9 P 77789aa45dc5463c82b73504fef4b4e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:16:11.167943  5465 raft_consensus.cc:3060] T fce0170182474e7dbe46361f5bf0eae9 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:11.171319  5388 raft_consensus.cc:2468] T fce0170182474e7dbe46361f5bf0eae9 P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 2.
I20260709 13:16:11.172643  6127 leader_election.cc:304] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:16:11.173554  6383 raft_consensus.cc:2804] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:11.174095  6383 raft_consensus.cc:697] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 LEADER]: Becoming Leader. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Running, Role: LEADER
I20260709 13:16:11.174126  5465 raft_consensus.cc:2468] T fce0170182474e7dbe46361f5bf0eae9 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 2.
I20260709 13:16:11.175271  6383 consensus_queue.cc:237] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:16:11.186426  5142 catalog_manager.cc:5697] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba reported cstate change: term changed from 1 to 2, leader changed from 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132) to 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129). New cstate: current_term: 2 leader_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:11.333030  5314 raft_consensus.cc:1275] T b1ab7b32db51471796738b38f71b64df P 2f45532f94a34efcb68a82db3dd69372 [term 3 FOLLOWER]: Refusing update from remote peer 538ff4bfbd0c4f04bcd800c4ee4845ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:11.334678  6384 consensus_queue.cc:1048] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:11.347133  5388 raft_consensus.cc:1275] T b1ab7b32db51471796738b38f71b64df P c4b52f14f9154b5a86f76fe58e4c235e [term 3 FOLLOWER]: Refusing update from remote peer 538ff4bfbd0c4f04bcd800c4ee4845ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:11.347767  5315 raft_consensus.cc:1275] T 5d841937b5db4e7fa656db32b84b9ca2 P 2f45532f94a34efcb68a82db3dd69372 [term 3 FOLLOWER]: Refusing update from remote peer 538ff4bfbd0c4f04bcd800c4ee4845ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:11.355769  6384 consensus_queue.cc:1048] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:11.356175  6386 consensus_queue.cc:1048] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:11.386067  5465 raft_consensus.cc:1275] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [term 3 FOLLOWER]: Refusing update from remote peer 538ff4bfbd0c4f04bcd800c4ee4845ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:11.393554  6386 consensus_queue.cc:1048] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:11.408915  5388 raft_consensus.cc:1275] T 3e48fc9e60214121991b0bb473d174da P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Refusing update from remote peer 2f45532f94a34efcb68a82db3dd69372: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:11.411669  6418 consensus_queue.cc:1048] T 3e48fc9e60214121991b0bb473d174da P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:11.430135  5462 raft_consensus.cc:1275] T 3e48fc9e60214121991b0bb473d174da P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Refusing update from remote peer 2f45532f94a34efcb68a82db3dd69372: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:11.432147  6418 consensus_queue.cc:1048] T 3e48fc9e60214121991b0bb473d174da P 2f45532f94a34efcb68a82db3dd69372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:11.565078  5315 raft_consensus.cc:1275] T 29f5415006bb4218b579d580f0b9ff68 P 2f45532f94a34efcb68a82db3dd69372 [term 3 FOLLOWER]: Refusing update from remote peer 538ff4bfbd0c4f04bcd800c4ee4845ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:11.567011  5465 raft_consensus.cc:1275] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [term 3 FOLLOWER]: Refusing update from remote peer 538ff4bfbd0c4f04bcd800c4ee4845ba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:11.579344  5464 raft_consensus.cc:1275] T fce0170182474e7dbe46361f5bf0eae9 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Refusing update from remote peer 538ff4bfbd0c4f04bcd800c4ee4845ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:11.601720  6386 consensus_queue.cc:1048] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:11.603273  6383 consensus_queue.cc:1048] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:11.647454  6383 consensus_queue.cc:1048] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:11.679854  5389 raft_consensus.cc:1275] T 1db09971a25441c68427b8bea7e9c379 P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Refusing update from remote peer 538ff4bfbd0c4f04bcd800c4ee4845ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:11.682224  6383 consensus_queue.cc:1048] T 1db09971a25441c68427b8bea7e9c379 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:11.684669  5315 raft_consensus.cc:1275] T 1db09971a25441c68427b8bea7e9c379 P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Refusing update from remote peer 538ff4bfbd0c4f04bcd800c4ee4845ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:11.700444  6383 consensus_queue.cc:1048] T 1db09971a25441c68427b8bea7e9c379 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:11.764711 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:16:11.820585  6443 log.cc:927] Time spent T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 13:16:11.824064  5434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:40847, user_credentials={real_user=slave}} blocked reactor thread for 79825.1us
I20260709 13:16:11.860667  5389 raft_consensus.cc:1275] T fce0170182474e7dbe46361f5bf0eae9 P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Refusing update from remote peer 538ff4bfbd0c4f04bcd800c4ee4845ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:11.864372  6416 consensus_queue.cc:1048] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:16:11.876359  6446 log.cc:927] Time spent T 29f5415006bb4218b579d580f0b9ff68 P 2f45532f94a34efcb68a82db3dd69372: Append to log took a long time: real 0.101s	user 0.004s	sys 0.000s
W20260709 13:16:11.893194  6444 log.cc:927] Time spent T fce0170182474e7dbe46361f5bf0eae9 P 77789aa45dc5463c82b73504fef4b4e0: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
W20260709 13:16:11.908020  6447 log.cc:927] Time spent T 1db09971a25441c68427b8bea7e9c379 P c4b52f14f9154b5a86f76fe58e4c235e: Append to log took a long time: real 0.116s	user 0.003s	sys 0.004s
I20260709 13:16:12.200480 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:12.248348  5389 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58438f196e6d42cc8780742faa222dc8"
dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
mode: GRACEFUL
new_leader_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
 from {username='slave'} at 127.0.0.1:37196
I20260709 13:16:12.249265  5389 raft_consensus.cc:606] T 58438f196e6d42cc8780742faa222dc8 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 LEADER]: Received request to transfer leadership to TS 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:16:12.252796  5315 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63267e5ca2594b41844fd758ca603a34"
dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
mode: GRACEFUL
new_leader_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
 from {username='slave'} at 127.0.0.1:53670
I20260709 13:16:12.253435  5315 raft_consensus.cc:606] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372 [term 3 LEADER]: Received request to transfer leadership to TS 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:16:12.256511  5389 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e78312bda196492eae76f2673c979fee"
dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
mode: GRACEFUL
new_leader_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
 from {username='slave'} at 127.0.0.1:37196
I20260709 13:16:12.257056  5389 raft_consensus.cc:606] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e [term 1 LEADER]: Received request to transfer leadership to TS 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:16:12.258260 28234 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:16:12.259990 28234 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:12.431757  6456 raft_consensus.cc:993] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e: : Instructing follower 538ff4bfbd0c4f04bcd800c4ee4845ba to start an election
I20260709 13:16:12.432780  6450 raft_consensus.cc:1081] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e [term 1 LEADER]: Signalling peer 538ff4bfbd0c4f04bcd800c4ee4845ba to start an election
I20260709 13:16:12.434921  6264 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e78312bda196492eae76f2673c979fee"
dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
 from {username='slave'} at 127.0.0.1:49534
I20260709 13:16:12.435628  6264 raft_consensus.cc:493] T e78312bda196492eae76f2673c979fee P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:12.436070  6264 raft_consensus.cc:3060] T e78312bda196492eae76f2673c979fee P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:12.448977  6264 raft_consensus.cc:515] T e78312bda196492eae76f2673c979fee P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:16:12.450875  6264 leader_election.cc:290] T e78312bda196492eae76f2673c979fee P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 election: Requested vote from peers 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623), c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847)
I20260709 13:16:12.452139  5319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78312bda196492eae76f2673c979fee" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:16:12.452031  5389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78312bda196492eae76f2673c979fee" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:16:12.453018  5319 raft_consensus.cc:3060] T e78312bda196492eae76f2673c979fee P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:12.453245  5389 raft_consensus.cc:3055] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:12.453610  5389 raft_consensus.cc:740] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Running, Role: LEADER
I20260709 13:16:12.454483  5389 consensus_queue.cc:260] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:16:12.457767  5389 raft_consensus.cc:3060] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:12.467165  5319 raft_consensus.cc:2468] T e78312bda196492eae76f2673c979fee P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 2.
I20260709 13:16:12.469421  6126 leader_election.cc:304] T e78312bda196492eae76f2673c979fee P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba; no voters: 
I20260709 13:16:12.470507  6383 raft_consensus.cc:2804] T e78312bda196492eae76f2673c979fee P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:12.471000  6383 raft_consensus.cc:697] T e78312bda196492eae76f2673c979fee P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 LEADER]: Becoming Leader. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Running, Role: LEADER
I20260709 13:16:12.472191  6383 consensus_queue.cc:237] T e78312bda196492eae76f2673c979fee P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:16:12.473839  5389 raft_consensus.cc:2468] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 2.
I20260709 13:16:12.490407  5142 catalog_manager.cc:5697] T e78312bda196492eae76f2673c979fee P 538ff4bfbd0c4f04bcd800c4ee4845ba reported cstate change: term changed from 1 to 2, leader changed from c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131) to 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129). New cstate: current_term: 2 leader_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:12.595443  6450 raft_consensus.cc:993] T 58438f196e6d42cc8780742faa222dc8 P c4b52f14f9154b5a86f76fe58e4c235e: : Instructing follower 538ff4bfbd0c4f04bcd800c4ee4845ba to start an election
I20260709 13:16:12.596096  6456 raft_consensus.cc:1081] T 58438f196e6d42cc8780742faa222dc8 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 LEADER]: Signalling peer 538ff4bfbd0c4f04bcd800c4ee4845ba to start an election
I20260709 13:16:12.597820  6457 raft_consensus.cc:993] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372: : Instructing follower 538ff4bfbd0c4f04bcd800c4ee4845ba to start an election
I20260709 13:16:12.597777  6264 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58438f196e6d42cc8780742faa222dc8"
dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
 from {username='slave'} at 127.0.0.1:49534
I20260709 13:16:12.598572  6458 raft_consensus.cc:1081] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372 [term 3 LEADER]: Signalling peer 538ff4bfbd0c4f04bcd800c4ee4845ba to start an election
I20260709 13:16:12.599001  6264 raft_consensus.cc:493] T 58438f196e6d42cc8780742faa222dc8 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:12.599424  6264 raft_consensus.cc:3060] T 58438f196e6d42cc8780742faa222dc8 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:12.600394  6258 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63267e5ca2594b41844fd758ca603a34"
dest_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba"
 from {username='slave'} at 127.0.0.1:49548
I20260709 13:16:12.601171  6258 raft_consensus.cc:493] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:12.601575  6258 raft_consensus.cc:3060] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:12.609620  6264 raft_consensus.cc:515] T 58438f196e6d42cc8780742faa222dc8 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:16:12.612097  6264 leader_election.cc:290] T 58438f196e6d42cc8780742faa222dc8 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 election: Requested vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391)
I20260709 13:16:12.612861  5388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58438f196e6d42cc8780742faa222dc8" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c4b52f14f9154b5a86f76fe58e4c235e"
I20260709 13:16:12.613562  5388 raft_consensus.cc:3055] T 58438f196e6d42cc8780742faa222dc8 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:12.613363  6258 raft_consensus.cc:515] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:16:12.613814  5461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58438f196e6d42cc8780742faa222dc8" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:16:12.614060  5388 raft_consensus.cc:740] T 58438f196e6d42cc8780742faa222dc8 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c4b52f14f9154b5a86f76fe58e4c235e, State: Running, Role: LEADER
I20260709 13:16:12.614519  5461 raft_consensus.cc:3060] T 58438f196e6d42cc8780742faa222dc8 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:12.615052  5388 consensus_queue.cc:260] T 58438f196e6d42cc8780742faa222dc8 P c4b52f14f9154b5a86f76fe58e4c235e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:16:12.616395  5464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63267e5ca2594b41844fd758ca603a34" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "77789aa45dc5463c82b73504fef4b4e0"
I20260709 13:16:12.616835  5388 raft_consensus.cc:3060] T 58438f196e6d42cc8780742faa222dc8 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:12.616981  5464 raft_consensus.cc:3060] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:12.621404  5319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63267e5ca2594b41844fd758ca603a34" candidate_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "2f45532f94a34efcb68a82db3dd69372"
I20260709 13:16:12.622290  5319 raft_consensus.cc:3055] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:12.622901  5319 raft_consensus.cc:740] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2f45532f94a34efcb68a82db3dd69372, State: Running, Role: LEADER
I20260709 13:16:12.624049  5319 consensus_queue.cc:260] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:16:12.625248  5319 raft_consensus.cc:3060] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:12.628636  5388 raft_consensus.cc:2468] T 58438f196e6d42cc8780742faa222dc8 P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 2.
I20260709 13:16:12.630430  6127 leader_election.cc:304] T 58438f196e6d42cc8780742faa222dc8 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, c4b52f14f9154b5a86f76fe58e4c235e; no voters: 
I20260709 13:16:12.630790  5464 raft_consensus.cc:2468] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 4.
I20260709 13:16:12.628636  5461 raft_consensus.cc:2468] T 58438f196e6d42cc8780742faa222dc8 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 2.
I20260709 13:16:12.631762  6258 leader_election.cc:290] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 4 election: Requested vote from peers 77789aa45dc5463c82b73504fef4b4e0 (127.27.146.132:41391), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:16:12.632390  6383 raft_consensus.cc:2804] T 58438f196e6d42cc8780742faa222dc8 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:12.632917  6383 raft_consensus.cc:697] T 58438f196e6d42cc8780742faa222dc8 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 LEADER]: Becoming Leader. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Running, Role: LEADER
I20260709 13:16:12.633322  6125 leader_election.cc:304] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, 77789aa45dc5463c82b73504fef4b4e0; no voters: 
I20260709 13:16:12.634054  6383 consensus_queue.cc:237] T 58438f196e6d42cc8780742faa222dc8 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:16:12.636196  6384 raft_consensus.cc:2804] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:12.637605  6384 raft_consensus.cc:697] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 4 LEADER]: Becoming Leader. State: Replica: 538ff4bfbd0c4f04bcd800c4ee4845ba, State: Running, Role: LEADER
I20260709 13:16:12.636687  5319 raft_consensus.cc:2468] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 538ff4bfbd0c4f04bcd800c4ee4845ba in term 4.
I20260709 13:16:12.640744  6384 consensus_queue.cc:237] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:16:12.658123  5142 catalog_manager.cc:5697] T 58438f196e6d42cc8780742faa222dc8 P 538ff4bfbd0c4f04bcd800c4ee4845ba reported cstate change: term changed from 1 to 2, leader changed from c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131) to 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129). New cstate: current_term: 2 leader_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:12.678089  5142 catalog_manager.cc:5697] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba reported cstate change: term changed from 3 to 4, leader changed from 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130) to 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129). New cstate: current_term: 4 leader_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:13.000483  5388 raft_consensus.cc:1275] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Refusing update from remote peer 538ff4bfbd0c4f04bcd800c4ee4845ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:13.001984  6467 consensus_queue.cc:1048] T e78312bda196492eae76f2673c979fee P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:13.031280  5461 raft_consensus.cc:1275] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [term 4 FOLLOWER]: Refusing update from remote peer 538ff4bfbd0c4f04bcd800c4ee4845ba: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:13.035055  6384 consensus_queue.cc:1048] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:13.044169  5315 raft_consensus.cc:1275] T e78312bda196492eae76f2673c979fee P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Refusing update from remote peer 538ff4bfbd0c4f04bcd800c4ee4845ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:13.046193  6383 consensus_queue.cc:1048] T e78312bda196492eae76f2673c979fee P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:13.100831  5315 raft_consensus.cc:1275] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372 [term 4 FOLLOWER]: Refusing update from remote peer 538ff4bfbd0c4f04bcd800c4ee4845ba: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:13.103051  6383 consensus_queue.cc:1048] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:13.129781  5388 raft_consensus.cc:1275] T 58438f196e6d42cc8780742faa222dc8 P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Refusing update from remote peer 538ff4bfbd0c4f04bcd800c4ee4845ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:13.131481  6383 consensus_queue.cc:1048] T 58438f196e6d42cc8780742faa222dc8 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:13.165735  5461 raft_consensus.cc:1275] T 58438f196e6d42cc8780742faa222dc8 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Refusing update from remote peer 538ff4bfbd0c4f04bcd800c4ee4845ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:13.167683  6467 consensus_queue.cc:1048] T 58438f196e6d42cc8780742faa222dc8 P 538ff4bfbd0c4f04bcd800c4ee4845ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:13.261109 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:13.300017 28234 tablet_server.cc:179] TabletServer@127.27.146.129:41357 shutting down...
W20260709 13:16:13.308852  5360 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 313 similar messages]
W20260709 13:16:13.323638  5360 consensus_peers.cc:597] T 4bc60d69f29e47689fd8fdf2b6aa836a P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:13.326805  5360 consensus_peers.cc:597] T 4d479dd9f8c04491bb1e78273726187f P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:13.328511  5286 consensus_peers.cc:597] T f3f19e79faea4bdbae72383e79104b37 P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:13.336898  5286 consensus_peers.cc:597] T c6bbe6dd572c4ea4aaf323c36eb05467 P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:13.368225  5360 consensus_peers.cc:597] T 39d465e757b14de1842d55d52271bceb P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:13.375241 28234 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:13.377131 28234 tablet_replica.cc:333] stopping tablet replica
W20260709 13:16:13.377879  5434 consensus_peers.cc:597] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:13.378163 28234 raft_consensus.cc:2243] T 7541727e0e0944a6b184ac464bcc6eee P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.378849 28234 raft_consensus.cc:2272] T 7541727e0e0944a6b184ac464bcc6eee P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.382110 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:13.383033 28234 raft_consensus.cc:2243] T 068e5bd8f3ef45fc8a4a122e51537764 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.383636 28234 raft_consensus.cc:2272] T 068e5bd8f3ef45fc8a4a122e51537764 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.387352 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:13.388856 28234 raft_consensus.cc:2243] T 436bb2869b55478b9c1cc99b5f83f981 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.389609 28234 raft_consensus.cc:2272] T 436bb2869b55478b9c1cc99b5f83f981 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.393769 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:13.394919 28234 raft_consensus.cc:2243] T 3d6bcda036934682b5075c20b786026d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.395602 28234 raft_consensus.cc:2272] T 3d6bcda036934682b5075c20b786026d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.398972 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:13.400137 28234 raft_consensus.cc:2243] T 0fde317f3ec547c3840e2fe1e07ec228 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.400700 28234 raft_consensus.cc:2272] T 0fde317f3ec547c3840e2fe1e07ec228 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.404130 28234 tablet_replica.cc:333] stopping tablet replica
W20260709 13:16:13.404459  5360 consensus_peers.cc:597] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:13.405071 28234 raft_consensus.cc:2243] T d443132476914cd1958f499f68f8acd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.405738 28234 raft_consensus.cc:2272] T d443132476914cd1958f499f68f8acd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.409762 28234 tablet_replica.cc:333] stopping tablet replica
W20260709 13:16:13.410727  5360 consensus_peers.cc:597] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:13.410768 28234 raft_consensus.cc:2243] T e78312bda196492eae76f2673c979fee P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:13.412492 28234 raft_consensus.cc:2272] T e78312bda196492eae76f2673c979fee P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.416267 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:13.417346 28234 raft_consensus.cc:2243] T 3b01a00074004ddb87b1710a6555353b P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.417991 28234 raft_consensus.cc:2272] T 3b01a00074004ddb87b1710a6555353b P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.421952 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:13.422781 28234 raft_consensus.cc:2243] T 0796f5098e2a48c992868bbffce02505 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.423373 28234 raft_consensus.cc:2272] T 0796f5098e2a48c992868bbffce02505 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.427466 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:13.428644 28234 raft_consensus.cc:2243] T cb26053fad7244cd88a5182d9cfc2109 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.429301 28234 raft_consensus.cc:2272] T cb26053fad7244cd88a5182d9cfc2109 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:13.432163  5360 consensus_peers.cc:597] T 0fde317f3ec547c3840e2fe1e07ec228 P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:13.433032 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:13.433979 28234 raft_consensus.cc:2243] T c6bbe6dd572c4ea4aaf323c36eb05467 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.434504 28234 raft_consensus.cc:2272] T c6bbe6dd572c4ea4aaf323c36eb05467 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.437376 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:13.438153 28234 raft_consensus.cc:2243] T 39d465e757b14de1842d55d52271bceb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.438675 28234 raft_consensus.cc:2272] T 39d465e757b14de1842d55d52271bceb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.441965 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:13.442725 28234 raft_consensus.cc:2243] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.443377 28234 raft_consensus.cc:2272] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.446184 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:13.447187 28234 raft_consensus.cc:2243] T bdbcf0a951c24340ba91509df11fc4c7 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.447849 28234 raft_consensus.cc:2272] T bdbcf0a951c24340ba91509df11fc4c7 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.450548 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:13.451217 28234 raft_consensus.cc:2243] T bd6573fdc5bd411e8b0cbd3316ecaede P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:13.452194 28234 raft_consensus.cc:2272] T bd6573fdc5bd411e8b0cbd3316ecaede P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.455384 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:13.456419 28234 raft_consensus.cc:2243] T 3e101cf4ae084c74af284008876e474e P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.456933 28234 raft_consensus.cc:2272] T 3e101cf4ae084c74af284008876e474e P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.460150 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:13.460963 28234 raft_consensus.cc:2243] T 58438f196e6d42cc8780742faa222dc8 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:13.462018 28234 raft_consensus.cc:2272] T 58438f196e6d42cc8780742faa222dc8 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:13.463006  5434 consensus_peers.cc:597] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:13.465858 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:13.466717 28234 raft_consensus.cc:2243] T c520b1f4431848d1967291be272086c5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.467186 28234 raft_consensus.cc:2272] T c520b1f4431848d1967291be272086c5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.469936 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:13.470621 28234 raft_consensus.cc:2243] T 8e80c7aca57e4dc6bdd366ef7501749f P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.471135 28234 raft_consensus.cc:2272] T 8e80c7aca57e4dc6bdd366ef7501749f P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.474304 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:13.475112 28234 raft_consensus.cc:2243] T 60775d8dc53c4243a0d744fd843c5cd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.475684 28234 raft_consensus.cc:2272] T 60775d8dc53c4243a0d744fd843c5cd5 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.478565 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:13.479262 28234 raft_consensus.cc:2243] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:16:13.479362  5360 consensus_peers.cc:597] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:13.480237 28234 raft_consensus.cc:2272] T b1ab7b32db51471796738b38f71b64df P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.483686 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:13.484375 28234 raft_consensus.cc:2243] T 6a1e233f50be40f78b9208537916e93c P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.484812 28234 raft_consensus.cc:2272] T 6a1e233f50be40f78b9208537916e93c P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.487278 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:13.487922 28234 raft_consensus.cc:2243] T 1db09971a25441c68427b8bea7e9c379 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:13.488847 28234 raft_consensus.cc:2272] T 1db09971a25441c68427b8bea7e9c379 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.491811 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:13.492488 28234 raft_consensus.cc:2243] T 34516de894fc408b8e355aba3402489c P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.493007 28234 raft_consensus.cc:2272] T 34516de894fc408b8e355aba3402489c P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.496948 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:13.497567 28234 raft_consensus.cc:2243] T 99cdbf6d16c64a949df77a003bb7f7e4 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.498081 28234 raft_consensus.cc:2272] T 99cdbf6d16c64a949df77a003bb7f7e4 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.501072 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:13.501727 28234 raft_consensus.cc:2243] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:16:13.502602 28234 raft_consensus.cc:2272] T 63267e5ca2594b41844fd758ca603a34 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.505810 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:13.506928 28234 raft_consensus.cc:2243] T 5b17eb476da34f05b466923d9c48cc2d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.507421 28234 raft_consensus.cc:2272] T 5b17eb476da34f05b466923d9c48cc2d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.510676 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:13.511296 28234 raft_consensus.cc:2243] T 73c339ffbbca40c78c31d33aa9bb9e38 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:13.512264 28234 raft_consensus.cc:2272] T 73c339ffbbca40c78c31d33aa9bb9e38 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.514849 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:13.515581 28234 raft_consensus.cc:2243] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:13.516705 28234 raft_consensus.cc:2272] T 5d841937b5db4e7fa656db32b84b9ca2 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.519549 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:13.520207 28234 raft_consensus.cc:2243] T 480c812524814775bbf2823e53a996ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.520670 28234 raft_consensus.cc:2272] T 480c812524814775bbf2823e53a996ed P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.524088 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:13.525004 28234 raft_consensus.cc:2243] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.525661 28234 raft_consensus.cc:2272] T 8aac85b71e404ee1bcfb748bfb0376fb P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.528419 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:13.529132 28234 raft_consensus.cc:2243] T f3f19e79faea4bdbae72383e79104b37 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.529655 28234 raft_consensus.cc:2272] T f3f19e79faea4bdbae72383e79104b37 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.532325 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:13.533211 28234 raft_consensus.cc:2243] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:13.534246 28234 raft_consensus.cc:2272] T 29f5415006bb4218b579d580f0b9ff68 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.537184 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:13.537771 28234 raft_consensus.cc:2243] T 4d479dd9f8c04491bb1e78273726187f P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.538234 28234 raft_consensus.cc:2272] T 4d479dd9f8c04491bb1e78273726187f P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.541733 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:13.542640 28234 raft_consensus.cc:2243] T 3ba8874bed41499cadc73289e5bb4ad3 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.543529 28234 raft_consensus.cc:2272] T 3ba8874bed41499cadc73289e5bb4ad3 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:13.545244  5360 consensus_peers.cc:597] T 34516de894fc408b8e355aba3402489c P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:13.546763 28234 tablet_replica.cc:333] stopping tablet replica
W20260709 13:16:13.546782  5434 consensus_peers.cc:597] T d443132476914cd1958f499f68f8acd5 P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:13.547725 28234 raft_consensus.cc:2243] T 7c0e035a21aa4d43857f541259fa71b9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:13.548708 28234 raft_consensus.cc:2272] T 7c0e035a21aa4d43857f541259fa71b9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.551177 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:13.551793 28234 raft_consensus.cc:2243] T 09e39d6f01a0444bb1aa42b5403943c8 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.552227 28234 raft_consensus.cc:2272] T 09e39d6f01a0444bb1aa42b5403943c8 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.554914 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:13.555747 28234 raft_consensus.cc:2243] T 22ee19164403428187e72d7a7c868457 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.556236 28234 raft_consensus.cc:2272] T 22ee19164403428187e72d7a7c868457 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:13.557732  5286 consensus_peers.cc:597] T 309fb72c5b374642bb05a78b0b5ca308 P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:13.559440 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:13.560389 28234 raft_consensus.cc:2243] T 309fb72c5b374642bb05a78b0b5ca308 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.560863 28234 raft_consensus.cc:2272] T 309fb72c5b374642bb05a78b0b5ca308 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.563886 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:13.564514 28234 raft_consensus.cc:2243] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:13.565390 28234 raft_consensus.cc:2272] T 71b75232471f416bb2d0ec813f32558e P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.568427 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:13.569229 28234 raft_consensus.cc:2243] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:13.570585 28234 raft_consensus.cc:2272] T 29ec9fd2ee334861a956e4d70d348b6d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:13.572549  5434 consensus_peers.cc:597] T 0796f5098e2a48c992868bbffce02505 P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:13.574160 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:13.575126 28234 raft_consensus.cc:2243] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.575719 28234 raft_consensus.cc:2272] T 654fdf03209d4a3cbf17055c56ae2c9d P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:13.576370  5286 consensus_peers.cc:597] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:13.579104 28234 tablet_replica.cc:333] stopping tablet replica
W20260709 13:16:13.579799  5434 consensus_peers.cc:597] T 480c812524814775bbf2823e53a996ed P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:13.579996 28234 raft_consensus.cc:2243] T 4bc60d69f29e47689fd8fdf2b6aa836a P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.580677 28234 raft_consensus.cc:2272] T 4bc60d69f29e47689fd8fdf2b6aa836a P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.583951 28234 tablet_replica.cc:333] stopping tablet replica
W20260709 13:16:13.584638  5286 consensus_peers.cc:597] T 7541727e0e0944a6b184ac464bcc6eee P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:13.584789 28234 raft_consensus.cc:2243] T 02dba91c167a418daee105670577c8aa P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:13.586313 28234 raft_consensus.cc:2272] T 02dba91c167a418daee105670577c8aa P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.590131 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:13.590932 28234 raft_consensus.cc:2243] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:16:13.591943  5286 consensus_peers.cc:597] T 22ee19164403428187e72d7a7c868457 P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:13.592154 28234 raft_consensus.cc:2272] T fce0170182474e7dbe46361f5bf0eae9 P 538ff4bfbd0c4f04bcd800c4ee4845ba [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:13.598984  5286 consensus_peers.cc:597] T 5b17eb476da34f05b466923d9c48cc2d P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:13.599315  5434 consensus_peers.cc:597] T 3ba8874bed41499cadc73289e5bb4ad3 P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:13.607666  5286 consensus_peers.cc:597] T 60775d8dc53c4243a0d744fd843c5cd5 P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:13.622658  5360 consensus_peers.cc:597] T 436bb2869b55478b9c1cc99b5f83f981 P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:13.636921  5286 consensus_peers.cc:597] T 6a1e233f50be40f78b9208537916e93c P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:13.671296  5434 consensus_peers.cc:597] T 99cdbf6d16c64a949df77a003bb7f7e4 P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:13.679298 28234 tablet_server.cc:196] TabletServer@127.27.146.129:41357 shutdown complete.
W20260709 13:16:13.745767  5434 consensus_peers.cc:597] T bdbcf0a951c24340ba91509df11fc4c7 P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:13.757043  5286 consensus_peers.cc:597] T 3b01a00074004ddb87b1710a6555353b P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:13.758414  5434 consensus_peers.cc:597] T cb26053fad7244cd88a5182d9cfc2109 P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:13.760618  5360 consensus_peers.cc:597] T c520b1f4431848d1967291be272086c5 P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:13.814981 28234 tablet_server.cc:179] TabletServer@127.27.146.130:0 shutting down...
W20260709 13:16:13.824896  5433 consensus_peers.cc:597] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Couldn't send request to peer 2f45532f94a34efcb68a82db3dd69372. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:13.825788  5359 consensus_peers.cc:597] T 4d479dd9f8c04491bb1e78273726187f P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Couldn't send request to peer 2f45532f94a34efcb68a82db3dd69372. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:13.828972  5434 consensus_peers.cc:597] T 3d6bcda036934682b5075c20b786026d P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:13.854781  5433 consensus_peers.cc:597] T 480c812524814775bbf2823e53a996ed P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Couldn't send request to peer 2f45532f94a34efcb68a82db3dd69372. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:13.856540  5433 consensus_peers.cc:597] T 15d005f85bf54ebfb870b326ef3e18ed P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Couldn't send request to peer 2f45532f94a34efcb68a82db3dd69372. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:13.866436  5286 consensus_peers.cc:597] T 09e39d6f01a0444bb1aa42b5403943c8 P 2f45532f94a34efcb68a82db3dd69372 -> Peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Couldn't send request to peer 538ff4bfbd0c4f04bcd800c4ee4845ba. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:13.872319  5433 consensus_peers.cc:597] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Couldn't send request to peer 2f45532f94a34efcb68a82db3dd69372. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:13.876308 28234 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:13.877418 28234 tablet_replica.cc:333] T 3e101cf4ae084c74af284008876e474e P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:13.878708 28234 raft_consensus.cc:2243] T 3e101cf4ae084c74af284008876e474e P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.879442 28234 raft_consensus.cc:2272] T 3e101cf4ae084c74af284008876e474e P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.882727 28234 tablet_replica.cc:333] T 3b01a00074004ddb87b1710a6555353b P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:13.883795 28234 raft_consensus.cc:2243] T 3b01a00074004ddb87b1710a6555353b P 2f45532f94a34efcb68a82db3dd69372 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:13.884949 28234 raft_consensus.cc:2272] T 3b01a00074004ddb87b1710a6555353b P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.888314 28234 tablet_replica.cc:333] T b1ab7b32db51471796738b38f71b64df P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:13.889262 28234 raft_consensus.cc:2243] T b1ab7b32db51471796738b38f71b64df P 2f45532f94a34efcb68a82db3dd69372 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.889859 28234 raft_consensus.cc:2272] T b1ab7b32db51471796738b38f71b64df P 2f45532f94a34efcb68a82db3dd69372 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.894761 28234 tablet_replica.cc:333] T 29ec9fd2ee334861a956e4d70d348b6d P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:13.896036 28234 raft_consensus.cc:2243] T 29ec9fd2ee334861a956e4d70d348b6d P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.896696 28234 raft_consensus.cc:2272] T 29ec9fd2ee334861a956e4d70d348b6d P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.900954 28234 tablet_replica.cc:333] T 5b17eb476da34f05b466923d9c48cc2d P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:13.901669 28234 raft_consensus.cc:2243] T 5b17eb476da34f05b466923d9c48cc2d P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:13.902580 28234 raft_consensus.cc:2272] T 5b17eb476da34f05b466923d9c48cc2d P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.905069 28234 tablet_replica.cc:333] T 02dba91c167a418daee105670577c8aa P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:13.906134 28234 raft_consensus.cc:2243] T 02dba91c167a418daee105670577c8aa P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.906714 28234 raft_consensus.cc:2272] T 02dba91c167a418daee105670577c8aa P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.910250 28234 tablet_replica.cc:333] T 6a1e233f50be40f78b9208537916e93c P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:13.911173 28234 raft_consensus.cc:2243] T 6a1e233f50be40f78b9208537916e93c P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:13.912623 28234 raft_consensus.cc:2272] T 6a1e233f50be40f78b9208537916e93c P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.915952 28234 tablet_replica.cc:333] T 03ad7844466b46548e4e9600220710f0 P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:13.917086 28234 raft_consensus.cc:2243] T 03ad7844466b46548e4e9600220710f0 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.917843 28234 raft_consensus.cc:2272] T 03ad7844466b46548e4e9600220710f0 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.921490 28234 tablet_replica.cc:333] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:13.922217 28234 raft_consensus.cc:2243] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.922716 28234 raft_consensus.cc:2272] T 63267e5ca2594b41844fd758ca603a34 P 2f45532f94a34efcb68a82db3dd69372 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.925729 28234 tablet_replica.cc:333] T 9c7fcfa184e1425c86c784dd9db4423e P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:13.926419 28234 raft_consensus.cc:2243] T 9c7fcfa184e1425c86c784dd9db4423e P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.926920 28234 raft_consensus.cc:2272] T 9c7fcfa184e1425c86c784dd9db4423e P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.929342 28234 tablet_replica.cc:333] T 073bb9d9d62f462db20229a4924564e1 P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:13.930086 28234 raft_consensus.cc:2243] T 073bb9d9d62f462db20229a4924564e1 P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:13.931344 28234 raft_consensus.cc:2272] T 073bb9d9d62f462db20229a4924564e1 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.934300 28234 tablet_replica.cc:333] T 654fdf03209d4a3cbf17055c56ae2c9d P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:13.935098 28234 raft_consensus.cc:2243] T 654fdf03209d4a3cbf17055c56ae2c9d P 2f45532f94a34efcb68a82db3dd69372 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.935756 28234 raft_consensus.cc:2272] T 654fdf03209d4a3cbf17055c56ae2c9d P 2f45532f94a34efcb68a82db3dd69372 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.939384 28234 tablet_replica.cc:333] T c6bbe6dd572c4ea4aaf323c36eb05467 P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:13.940371 28234 raft_consensus.cc:2243] T c6bbe6dd572c4ea4aaf323c36eb05467 P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:13.941583 28234 raft_consensus.cc:2272] T c6bbe6dd572c4ea4aaf323c36eb05467 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.944586 28234 tablet_replica.cc:333] T cb26053fad7244cd88a5182d9cfc2109 P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:13.945498 28234 raft_consensus.cc:2243] T cb26053fad7244cd88a5182d9cfc2109 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.946245 28234 raft_consensus.cc:2272] T cb26053fad7244cd88a5182d9cfc2109 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.949692 28234 tablet_replica.cc:333] T 15d005f85bf54ebfb870b326ef3e18ed P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:13.950605 28234 raft_consensus.cc:2243] T 15d005f85bf54ebfb870b326ef3e18ed P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:16:13.951294  5433 consensus_peers.cc:597] T d443132476914cd1958f499f68f8acd5 P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Couldn't send request to peer 2f45532f94a34efcb68a82db3dd69372. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:13.951483 28234 raft_consensus.cc:2272] T 15d005f85bf54ebfb870b326ef3e18ed P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:13.952107  5359 consensus_peers.cc:597] T f18f7cc1557b43b9adbf357e50e292a0 P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Couldn't send request to peer 2f45532f94a34efcb68a82db3dd69372. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:13.955673 28234 tablet_replica.cc:333] T 09e39d6f01a0444bb1aa42b5403943c8 P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:13.956689 28234 raft_consensus.cc:2243] T 09e39d6f01a0444bb1aa42b5403943c8 P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:13.957935 28234 raft_consensus.cc:2272] T 09e39d6f01a0444bb1aa42b5403943c8 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.961418 28234 tablet_replica.cc:333] T 22ee19164403428187e72d7a7c868457 P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:13.962500 28234 raft_consensus.cc:2243] T 22ee19164403428187e72d7a7c868457 P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:13.963806 28234 raft_consensus.cc:2272] T 22ee19164403428187e72d7a7c868457 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.967000 28234 tablet_replica.cc:333] T f6cbde4ed3d14db5a1826609542ec5a4 P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:13.968021 28234 raft_consensus.cc:2243] T f6cbde4ed3d14db5a1826609542ec5a4 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:16:13.968322  5359 consensus_peers.cc:597] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Couldn't send request to peer 2f45532f94a34efcb68a82db3dd69372. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:13.968623 28234 raft_consensus.cc:2272] T f6cbde4ed3d14db5a1826609542ec5a4 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.972467 28234 tablet_replica.cc:333] T f18f7cc1557b43b9adbf357e50e292a0 P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:13.973371 28234 raft_consensus.cc:2243] T f18f7cc1557b43b9adbf357e50e292a0 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.974102 28234 raft_consensus.cc:2272] T f18f7cc1557b43b9adbf357e50e292a0 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.977262 28234 tablet_replica.cc:333] T 104c92d196fa45818108b633cbfaea4b P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:13.978235 28234 raft_consensus.cc:2243] T 104c92d196fa45818108b633cbfaea4b P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.978869 28234 raft_consensus.cc:2272] T 104c92d196fa45818108b633cbfaea4b P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.981706 28234 tablet_replica.cc:333] T 309fb72c5b374642bb05a78b0b5ca308 P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:13.982443 28234 raft_consensus.cc:2243] T 309fb72c5b374642bb05a78b0b5ca308 P 2f45532f94a34efcb68a82db3dd69372 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:13.983371 28234 raft_consensus.cc:2272] T 309fb72c5b374642bb05a78b0b5ca308 P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.986070 28234 tablet_replica.cc:333] T 71b75232471f416bb2d0ec813f32558e P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:13.986806 28234 raft_consensus.cc:2243] T 71b75232471f416bb2d0ec813f32558e P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.987450 28234 raft_consensus.cc:2272] T 71b75232471f416bb2d0ec813f32558e P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:13.990259  5433 consensus_peers.cc:597] T 104c92d196fa45818108b633cbfaea4b P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Couldn't send request to peer 2f45532f94a34efcb68a82db3dd69372. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:13.990757 28234 tablet_replica.cc:333] T 8c46fa9b6c00424a8697f4536d1a3b0e P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:13.991714 28234 raft_consensus.cc:2243] T 8c46fa9b6c00424a8697f4536d1a3b0e P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:16:13.991811  5433 consensus_peers.cc:597] T cb26053fad7244cd88a5182d9cfc2109 P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Couldn't send request to peer 2f45532f94a34efcb68a82db3dd69372. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:13.992383 28234 raft_consensus.cc:2272] T 8c46fa9b6c00424a8697f4536d1a3b0e P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:13.995646 28234 tablet_replica.cc:333] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:13.996277 28234 raft_consensus.cc:2243] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:13.996850 28234 raft_consensus.cc:2272] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:13.998993  5433 consensus_peers.cc:597] T c01a087c57254cf0822d574602320ab5 P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Couldn't send request to peer 2f45532f94a34efcb68a82db3dd69372. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:13.999920 28234 tablet_replica.cc:333] T 5d841937b5db4e7fa656db32b84b9ca2 P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:14.000818 28234 raft_consensus.cc:2243] T 5d841937b5db4e7fa656db32b84b9ca2 P 2f45532f94a34efcb68a82db3dd69372 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.001353 28234 raft_consensus.cc:2272] T 5d841937b5db4e7fa656db32b84b9ca2 P 2f45532f94a34efcb68a82db3dd69372 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.003737 28234 tablet_replica.cc:333] T bd6573fdc5bd411e8b0cbd3316ecaede P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:14.004468 28234 raft_consensus.cc:2243] T bd6573fdc5bd411e8b0cbd3316ecaede P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.004938 28234 raft_consensus.cc:2272] T bd6573fdc5bd411e8b0cbd3316ecaede P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.007237 28234 tablet_replica.cc:333] T 1db09971a25441c68427b8bea7e9c379 P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:14.007987 28234 raft_consensus.cc:2243] T 1db09971a25441c68427b8bea7e9c379 P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.008586 28234 raft_consensus.cc:2272] T 1db09971a25441c68427b8bea7e9c379 P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.011725 28234 tablet_replica.cc:333] T c01a087c57254cf0822d574602320ab5 P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:14.012645 28234 raft_consensus.cc:2243] T c01a087c57254cf0822d574602320ab5 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.013249 28234 raft_consensus.cc:2272] T c01a087c57254cf0822d574602320ab5 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.016558 28234 tablet_replica.cc:333] T bdbcf0a951c24340ba91509df11fc4c7 P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:14.017378 28234 raft_consensus.cc:2243] T bdbcf0a951c24340ba91509df11fc4c7 P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.017982 28234 raft_consensus.cc:2272] T bdbcf0a951c24340ba91509df11fc4c7 P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.021152 28234 tablet_replica.cc:333] T e78312bda196492eae76f2673c979fee P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:14.022053 28234 raft_consensus.cc:2243] T e78312bda196492eae76f2673c979fee P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.022616 28234 raft_consensus.cc:2272] T e78312bda196492eae76f2673c979fee P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.026094 28234 tablet_replica.cc:333] T d443132476914cd1958f499f68f8acd5 P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:14.026688 28234 raft_consensus.cc:2243] T d443132476914cd1958f499f68f8acd5 P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.027185 28234 raft_consensus.cc:2272] T d443132476914cd1958f499f68f8acd5 P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.029663 28234 tablet_replica.cc:333] T 7541727e0e0944a6b184ac464bcc6eee P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:14.030349 28234 raft_consensus.cc:2243] T 7541727e0e0944a6b184ac464bcc6eee P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.031349 28234 raft_consensus.cc:2272] T 7541727e0e0944a6b184ac464bcc6eee P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.034390 28234 tablet_replica.cc:333] T 4791d524d10e495fb14f6fd27fcc2218 P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:14.035306 28234 raft_consensus.cc:2243] T 4791d524d10e495fb14f6fd27fcc2218 P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.036545 28234 raft_consensus.cc:2272] T 4791d524d10e495fb14f6fd27fcc2218 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.039762 28234 tablet_replica.cc:333] T f3f19e79faea4bdbae72383e79104b37 P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:14.040572 28234 raft_consensus.cc:2243] T f3f19e79faea4bdbae72383e79104b37 P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.041705 28234 raft_consensus.cc:2272] T f3f19e79faea4bdbae72383e79104b37 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.044564 28234 tablet_replica.cc:333] T 3e48fc9e60214121991b0bb473d174da P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:14.045133 28234 raft_consensus.cc:2243] T 3e48fc9e60214121991b0bb473d174da P 2f45532f94a34efcb68a82db3dd69372 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.046029 28234 raft_consensus.cc:2272] T 3e48fc9e60214121991b0bb473d174da P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.048534 28234 tablet_replica.cc:333] T 43d23c7f276f4df1acd8124ed4940f1b P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:14.049111 28234 raft_consensus.cc:2243] T 43d23c7f276f4df1acd8124ed4940f1b P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.049664 28234 raft_consensus.cc:2272] T 43d23c7f276f4df1acd8124ed4940f1b P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.051992 28234 tablet_replica.cc:333] T 8aac85b71e404ee1bcfb748bfb0376fb P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:14.052616 28234 raft_consensus.cc:2243] T 8aac85b71e404ee1bcfb748bfb0376fb P 2f45532f94a34efcb68a82db3dd69372 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.053110 28234 raft_consensus.cc:2272] T 8aac85b71e404ee1bcfb748bfb0376fb P 2f45532f94a34efcb68a82db3dd69372 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.055445 28234 tablet_replica.cc:333] T 480c812524814775bbf2823e53a996ed P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:14.056056 28234 raft_consensus.cc:2243] T 480c812524814775bbf2823e53a996ed P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.056556 28234 raft_consensus.cc:2272] T 480c812524814775bbf2823e53a996ed P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.058750 28234 tablet_replica.cc:333] T 60775d8dc53c4243a0d744fd843c5cd5 P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:14.059334 28234 raft_consensus.cc:2243] T 60775d8dc53c4243a0d744fd843c5cd5 P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.060256 28234 raft_consensus.cc:2272] T 60775d8dc53c4243a0d744fd843c5cd5 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.063558 28234 tablet_replica.cc:333] T 8e80c7aca57e4dc6bdd366ef7501749f P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:14.064309 28234 raft_consensus.cc:2243] T 8e80c7aca57e4dc6bdd366ef7501749f P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.064769 28234 raft_consensus.cc:2272] T 8e80c7aca57e4dc6bdd366ef7501749f P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:14.066612  5359 consensus_peers.cc:597] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Couldn't send request to peer 2f45532f94a34efcb68a82db3dd69372. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:14.067756 28234 tablet_replica.cc:333] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:14.068667 28234 raft_consensus.cc:2243] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 2f45532f94a34efcb68a82db3dd69372 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.070613 28234 raft_consensus.cc:2272] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P 2f45532f94a34efcb68a82db3dd69372 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.075410 28234 tablet_replica.cc:333] T 4d479dd9f8c04491bb1e78273726187f P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:14.076275 28234 raft_consensus.cc:2243] T 4d479dd9f8c04491bb1e78273726187f P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.076862 28234 raft_consensus.cc:2272] T 4d479dd9f8c04491bb1e78273726187f P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.079414 28234 tablet_replica.cc:333] T 29f5415006bb4218b579d580f0b9ff68 P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:14.080034 28234 raft_consensus.cc:2243] T 29f5415006bb4218b579d580f0b9ff68 P 2f45532f94a34efcb68a82db3dd69372 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.080694 28234 raft_consensus.cc:2272] T 29f5415006bb4218b579d580f0b9ff68 P 2f45532f94a34efcb68a82db3dd69372 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.082902 28234 tablet_replica.cc:333] T 57bbe622c9794d6fa61dd5f39cb3d306 P 2f45532f94a34efcb68a82db3dd69372: stopping tablet replica
I20260709 13:16:14.083403 28234 raft_consensus.cc:2243] T 57bbe622c9794d6fa61dd5f39cb3d306 P 2f45532f94a34efcb68a82db3dd69372 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.084383 28234 raft_consensus.cc:2272] T 57bbe622c9794d6fa61dd5f39cb3d306 P 2f45532f94a34efcb68a82db3dd69372 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.167223 28234 tablet_server.cc:196] TabletServer@127.27.146.130:0 shutdown complete.
W20260709 13:16:14.204399  5359 consensus_peers.cc:597] T 43d23c7f276f4df1acd8124ed4940f1b P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Couldn't send request to peer 2f45532f94a34efcb68a82db3dd69372. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:43623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:14.233744  5433 consensus_peers.cc:597] T bdbcf0a951c24340ba91509df11fc4c7 P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Couldn't send request to peer 2f45532f94a34efcb68a82db3dd69372. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:43623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:14.249166  5433 consensus_peers.cc:597] T f6cbde4ed3d14db5a1826609542ec5a4 P 77789aa45dc5463c82b73504fef4b4e0 -> Peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Couldn't send request to peer 2f45532f94a34efcb68a82db3dd69372. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:43623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:14.278177  5359 consensus_peers.cc:597] T 9c7fcfa184e1425c86c784dd9db4423e P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Couldn't send request to peer 2f45532f94a34efcb68a82db3dd69372. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:43623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:14.294498  5359 consensus_peers.cc:597] T 03ad7844466b46548e4e9600220710f0 P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Couldn't send request to peer 2f45532f94a34efcb68a82db3dd69372. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:43623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:14.298183 28234 tablet_server.cc:179] TabletServer@127.27.146.131:0 shutting down...
W20260709 13:16:14.328066  5434 consensus_peers.cc:597] T 0796f5098e2a48c992868bbffce02505 P 77789aa45dc5463c82b73504fef4b4e0 -> Peer c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847): Couldn't send request to peer c4b52f14f9154b5a86f76fe58e4c235e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:14.344448  5359 consensus_peers.cc:597] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Couldn't send request to peer 2f45532f94a34efcb68a82db3dd69372. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:43623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:14.370260 28234 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:14.371286 28234 tablet_replica.cc:333] T 3d6bcda036934682b5075c20b786026d P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.372463 28234 raft_consensus.cc:2243] T 3d6bcda036934682b5075c20b786026d P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.373186 28234 raft_consensus.cc:2272] T 3d6bcda036934682b5075c20b786026d P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.375742 28234 tablet_replica.cc:333] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.376363 28234 raft_consensus.cc:2243] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.377303 28234 raft_consensus.cc:2272] T 3e101cf4ae084c74af284008876e474e P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.380231 28234 tablet_replica.cc:333] T 104c92d196fa45818108b633cbfaea4b P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.380954 28234 raft_consensus.cc:2243] T 104c92d196fa45818108b633cbfaea4b P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.381531 28234 raft_consensus.cc:2272] T 104c92d196fa45818108b633cbfaea4b P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.384352 28234 tablet_replica.cc:333] T 73c339ffbbca40c78c31d33aa9bb9e38 P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.385361 28234 raft_consensus.cc:2243] T 73c339ffbbca40c78c31d33aa9bb9e38 P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.385970 28234 raft_consensus.cc:2272] T 73c339ffbbca40c78c31d33aa9bb9e38 P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.388494 28234 tablet_replica.cc:333] T b1ab7b32db51471796738b38f71b64df P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.389183 28234 raft_consensus.cc:2243] T b1ab7b32db51471796738b38f71b64df P c4b52f14f9154b5a86f76fe58e4c235e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.389680 28234 raft_consensus.cc:2272] T b1ab7b32db51471796738b38f71b64df P c4b52f14f9154b5a86f76fe58e4c235e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.392427 28234 tablet_replica.cc:333] T 29ec9fd2ee334861a956e4d70d348b6d P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.393069 28234 raft_consensus.cc:2243] T 29ec9fd2ee334861a956e4d70d348b6d P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.393630 28234 raft_consensus.cc:2272] T 29ec9fd2ee334861a956e4d70d348b6d P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.397316 28234 tablet_replica.cc:333] T c520b1f4431848d1967291be272086c5 P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.398063 28234 raft_consensus.cc:2243] T c520b1f4431848d1967291be272086c5 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.399119 28234 raft_consensus.cc:2272] T c520b1f4431848d1967291be272086c5 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:14.399271  5359 consensus_peers.cc:597] T 8c46fa9b6c00424a8697f4536d1a3b0e P c4b52f14f9154b5a86f76fe58e4c235e -> Peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Couldn't send request to peer 2f45532f94a34efcb68a82db3dd69372. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:43623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:14.401831 28234 tablet_replica.cc:333] T 58438f196e6d42cc8780742faa222dc8 P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.402582 28234 raft_consensus.cc:2243] T 58438f196e6d42cc8780742faa222dc8 P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.403221 28234 raft_consensus.cc:2272] T 58438f196e6d42cc8780742faa222dc8 P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.406317 28234 tablet_replica.cc:333] T 03ad7844466b46548e4e9600220710f0 P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.407269 28234 raft_consensus.cc:2243] T 03ad7844466b46548e4e9600220710f0 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.408768 28234 raft_consensus.cc:2272] T 03ad7844466b46548e4e9600220710f0 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.412528 28234 tablet_replica.cc:333] T f3f19e79faea4bdbae72383e79104b37 P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.413451 28234 raft_consensus.cc:2243] T f3f19e79faea4bdbae72383e79104b37 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.414152 28234 raft_consensus.cc:2272] T f3f19e79faea4bdbae72383e79104b37 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:14.416218  5434 consensus_peers.cc:597] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 77789aa45dc5463c82b73504fef4b4e0 -> Peer c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847): Couldn't send request to peer c4b52f14f9154b5a86f76fe58e4c235e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:14.417273 28234 tablet_replica.cc:333] T 3e48fc9e60214121991b0bb473d174da P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.418320 28234 raft_consensus.cc:2243] T 3e48fc9e60214121991b0bb473d174da P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.418980 28234 raft_consensus.cc:2272] T 3e48fc9e60214121991b0bb473d174da P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:14.419903  5434 consensus_peers.cc:597] T c01a087c57254cf0822d574602320ab5 P 77789aa45dc5463c82b73504fef4b4e0 -> Peer c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847): Couldn't send request to peer c4b52f14f9154b5a86f76fe58e4c235e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:14.422004 28234 tablet_replica.cc:333] T 43d23c7f276f4df1acd8124ed4940f1b P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
W20260709 13:16:14.422237  5434 consensus_peers.cc:597] T f6cbde4ed3d14db5a1826609542ec5a4 P 77789aa45dc5463c82b73504fef4b4e0 -> Peer c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847): Couldn't send request to peer c4b52f14f9154b5a86f76fe58e4c235e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:14.422801 28234 raft_consensus.cc:2243] T 43d23c7f276f4df1acd8124ed4940f1b P c4b52f14f9154b5a86f76fe58e4c235e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.423820 28234 raft_consensus.cc:2272] T 43d23c7f276f4df1acd8124ed4940f1b P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.426288 28234 tablet_replica.cc:333] T 9c7fcfa184e1425c86c784dd9db4423e P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.427192 28234 raft_consensus.cc:2243] T 9c7fcfa184e1425c86c784dd9db4423e P c4b52f14f9154b5a86f76fe58e4c235e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.428408 28234 raft_consensus.cc:2272] T 9c7fcfa184e1425c86c784dd9db4423e P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.431653 28234 tablet_replica.cc:333] T 073bb9d9d62f462db20229a4924564e1 P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.432590 28234 raft_consensus.cc:2243] T 073bb9d9d62f462db20229a4924564e1 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.433195 28234 raft_consensus.cc:2272] T 073bb9d9d62f462db20229a4924564e1 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:14.435200  5434 consensus_peers.cc:597] T 104c92d196fa45818108b633cbfaea4b P 77789aa45dc5463c82b73504fef4b4e0 -> Peer c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847): Couldn't send request to peer c4b52f14f9154b5a86f76fe58e4c235e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:14.436311 28234 tablet_replica.cc:333] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.437433 28234 raft_consensus.cc:2243] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.438514 28234 raft_consensus.cc:2272] T 654fdf03209d4a3cbf17055c56ae2c9d P c4b52f14f9154b5a86f76fe58e4c235e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.441890 28234 tablet_replica.cc:333] T 0796f5098e2a48c992868bbffce02505 P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.442751 28234 raft_consensus.cc:2243] T 0796f5098e2a48c992868bbffce02505 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.443342 28234 raft_consensus.cc:2272] T 0796f5098e2a48c992868bbffce02505 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.446139 28234 tablet_replica.cc:333] T 15d005f85bf54ebfb870b326ef3e18ed P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.446856 28234 raft_consensus.cc:2243] T 15d005f85bf54ebfb870b326ef3e18ed P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.447358 28234 raft_consensus.cc:2272] T 15d005f85bf54ebfb870b326ef3e18ed P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.450141 28234 tablet_replica.cc:333] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.450819 28234 raft_consensus.cc:2243] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.451298 28234 raft_consensus.cc:2272] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.453632 28234 tablet_replica.cc:333] T 068e5bd8f3ef45fc8a4a122e51537764 P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.454260 28234 raft_consensus.cc:2243] T 068e5bd8f3ef45fc8a4a122e51537764 P c4b52f14f9154b5a86f76fe58e4c235e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.454702 28234 raft_consensus.cc:2272] T 068e5bd8f3ef45fc8a4a122e51537764 P c4b52f14f9154b5a86f76fe58e4c235e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.457069 28234 tablet_replica.cc:333] T 34516de894fc408b8e355aba3402489c P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.457703 28234 raft_consensus.cc:2243] T 34516de894fc408b8e355aba3402489c P c4b52f14f9154b5a86f76fe58e4c235e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.458600 28234 raft_consensus.cc:2272] T 34516de894fc408b8e355aba3402489c P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.460788 28234 tablet_replica.cc:333] T 1db09971a25441c68427b8bea7e9c379 P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.461383 28234 raft_consensus.cc:2243] T 1db09971a25441c68427b8bea7e9c379 P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.461843 28234 raft_consensus.cc:2272] T 1db09971a25441c68427b8bea7e9c379 P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.463996 28234 tablet_replica.cc:333] T 99cdbf6d16c64a949df77a003bb7f7e4 P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.464627 28234 raft_consensus.cc:2243] T 99cdbf6d16c64a949df77a003bb7f7e4 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.465082 28234 raft_consensus.cc:2272] T 99cdbf6d16c64a949df77a003bb7f7e4 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.467924 28234 tablet_replica.cc:333] T c01a087c57254cf0822d574602320ab5 P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.468739 28234 raft_consensus.cc:2243] T c01a087c57254cf0822d574602320ab5 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:16:14.468780  5434 consensus_peers.cc:597] T 3ba8874bed41499cadc73289e5bb4ad3 P 77789aa45dc5463c82b73504fef4b4e0 -> Peer c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847): Couldn't send request to peer c4b52f14f9154b5a86f76fe58e4c235e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:14.469411 28234 raft_consensus.cc:2272] T c01a087c57254cf0822d574602320ab5 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.471690 28234 tablet_replica.cc:333] T f6cbde4ed3d14db5a1826609542ec5a4 P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.472297 28234 raft_consensus.cc:2243] T f6cbde4ed3d14db5a1826609542ec5a4 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.472793 28234 raft_consensus.cc:2272] T f6cbde4ed3d14db5a1826609542ec5a4 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.475167 28234 tablet_replica.cc:333] T 22ee19164403428187e72d7a7c868457 P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.475903 28234 raft_consensus.cc:2243] T 22ee19164403428187e72d7a7c868457 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.476408 28234 raft_consensus.cc:2272] T 22ee19164403428187e72d7a7c868457 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.478571 28234 tablet_replica.cc:333] T f18f7cc1557b43b9adbf357e50e292a0 P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.479203 28234 raft_consensus.cc:2243] T f18f7cc1557b43b9adbf357e50e292a0 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.480123 28234 raft_consensus.cc:2272] T f18f7cc1557b43b9adbf357e50e292a0 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.482316 28234 tablet_replica.cc:333] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.482921 28234 raft_consensus.cc:2243] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.483417 28234 raft_consensus.cc:2272] T 56fc1bf8741446b6ba1d4bb0c8fcb5ed P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.485708 28234 tablet_replica.cc:333] T 4791d524d10e495fb14f6fd27fcc2218 P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.486389 28234 raft_consensus.cc:2243] T 4791d524d10e495fb14f6fd27fcc2218 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.486835 28234 raft_consensus.cc:2272] T 4791d524d10e495fb14f6fd27fcc2218 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.489305 28234 tablet_replica.cc:333] T 4bc60d69f29e47689fd8fdf2b6aa836a P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.489923 28234 raft_consensus.cc:2243] T 4bc60d69f29e47689fd8fdf2b6aa836a P c4b52f14f9154b5a86f76fe58e4c235e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.490806 28234 raft_consensus.cc:2272] T 4bc60d69f29e47689fd8fdf2b6aa836a P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.493321 28234 tablet_replica.cc:333] T 39d465e757b14de1842d55d52271bceb P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.493906 28234 raft_consensus.cc:2243] T 39d465e757b14de1842d55d52271bceb P c4b52f14f9154b5a86f76fe58e4c235e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.494860 28234 raft_consensus.cc:2272] T 39d465e757b14de1842d55d52271bceb P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.497121 28234 tablet_replica.cc:333] T 57bbe622c9794d6fa61dd5f39cb3d306 P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.497754 28234 raft_consensus.cc:2243] T 57bbe622c9794d6fa61dd5f39cb3d306 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.498229 28234 raft_consensus.cc:2272] T 57bbe622c9794d6fa61dd5f39cb3d306 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.500677 28234 tablet_replica.cc:333] T 8c46fa9b6c00424a8697f4536d1a3b0e P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.501387 28234 raft_consensus.cc:2243] T 8c46fa9b6c00424a8697f4536d1a3b0e P c4b52f14f9154b5a86f76fe58e4c235e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.502264 28234 raft_consensus.cc:2272] T 8c46fa9b6c00424a8697f4536d1a3b0e P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.504690 28234 tablet_replica.cc:333] T 3ba8874bed41499cadc73289e5bb4ad3 P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.505283 28234 raft_consensus.cc:2243] T 3ba8874bed41499cadc73289e5bb4ad3 P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.505728 28234 raft_consensus.cc:2272] T 3ba8874bed41499cadc73289e5bb4ad3 P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.508034 28234 tablet_replica.cc:333] T 7c0e035a21aa4d43857f541259fa71b9 P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.508605 28234 raft_consensus.cc:2243] T 7c0e035a21aa4d43857f541259fa71b9 P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.509073 28234 raft_consensus.cc:2272] T 7c0e035a21aa4d43857f541259fa71b9 P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.511148 28234 tablet_replica.cc:333] T 4d479dd9f8c04491bb1e78273726187f P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.511780 28234 raft_consensus.cc:2243] T 4d479dd9f8c04491bb1e78273726187f P c4b52f14f9154b5a86f76fe58e4c235e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.512673 28234 raft_consensus.cc:2272] T 4d479dd9f8c04491bb1e78273726187f P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.515242 28234 tablet_replica.cc:333] T 436bb2869b55478b9c1cc99b5f83f981 P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.516037 28234 raft_consensus.cc:2243] T 436bb2869b55478b9c1cc99b5f83f981 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.517098 28234 raft_consensus.cc:2272] T 436bb2869b55478b9c1cc99b5f83f981 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.520018 28234 tablet_replica.cc:333] T 02dba91c167a418daee105670577c8aa P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.520761 28234 raft_consensus.cc:2243] T 02dba91c167a418daee105670577c8aa P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.521323 28234 raft_consensus.cc:2272] T 02dba91c167a418daee105670577c8aa P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.523588 28234 tablet_replica.cc:333] T fce0170182474e7dbe46361f5bf0eae9 P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.524128 28234 raft_consensus.cc:2243] T fce0170182474e7dbe46361f5bf0eae9 P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.524560 28234 raft_consensus.cc:2272] T fce0170182474e7dbe46361f5bf0eae9 P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.526490  6495 raft_consensus.cc:493] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:16:14.526953 28234 tablet_replica.cc:333] T bd6573fdc5bd411e8b0cbd3316ecaede P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.527015  6495 raft_consensus.cc:515] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } } peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } }
I20260709 13:16:14.528070 28234 raft_consensus.cc:2243] T bd6573fdc5bd411e8b0cbd3316ecaede P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.528687 28234 raft_consensus.cc:2272] T bd6573fdc5bd411e8b0cbd3316ecaede P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.529686  6495 leader_election.cc:290] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:16:14.531914 28234 tablet_replica.cc:333] T 7541727e0e0944a6b184ac464bcc6eee P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.532859 28234 raft_consensus.cc:2243] T 7541727e0e0944a6b184ac464bcc6eee P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.533461 28234 raft_consensus.cc:2272] T 7541727e0e0944a6b184ac464bcc6eee P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:14.535298  5360 leader_election.cc:336] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
I20260709 13:16:14.536617 28234 tablet_replica.cc:333] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.537724 28234 raft_consensus.cc:2243] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.538337 28234 raft_consensus.cc:2272] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:14.538777  5359 leader_election.cc:336] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Network error: Client connection negotiation failed: client connection to 127.27.146.130:43623: connect: Connection refused (error 111)
I20260709 13:16:14.539247  5359 leader_election.cc:304] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c4b52f14f9154b5a86f76fe58e4c235e; no voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba
W20260709 13:16:14.539973  5359 raft_consensus.cc:2686] T e78312bda196492eae76f2673c979fee P c4b52f14f9154b5a86f76fe58e4c235e: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:16:14.541183 28234 tablet_replica.cc:333] T 60775d8dc53c4243a0d744fd843c5cd5 P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.541870 28234 raft_consensus.cc:2243] T 60775d8dc53c4243a0d744fd843c5cd5 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.542356 28234 raft_consensus.cc:2272] T 60775d8dc53c4243a0d744fd843c5cd5 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.544847 28234 tablet_replica.cc:333] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.545392 28234 raft_consensus.cc:2243] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.546275 28234 raft_consensus.cc:2272] T 8e80c7aca57e4dc6bdd366ef7501749f P c4b52f14f9154b5a86f76fe58e4c235e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.548707 28234 tablet_replica.cc:333] T 0fde317f3ec547c3840e2fe1e07ec228 P c4b52f14f9154b5a86f76fe58e4c235e: stopping tablet replica
I20260709 13:16:14.549233 28234 raft_consensus.cc:2243] T 0fde317f3ec547c3840e2fe1e07ec228 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.550127 28234 raft_consensus.cc:2272] T 0fde317f3ec547c3840e2fe1e07ec228 P c4b52f14f9154b5a86f76fe58e4c235e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:14.556883  5434 consensus_peers.cc:597] T 99cdbf6d16c64a949df77a003bb7f7e4 P 77789aa45dc5463c82b73504fef4b4e0 -> Peer c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847): Couldn't send request to peer c4b52f14f9154b5a86f76fe58e4c235e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:14.586848  5434 consensus_peers.cc:597] T 15d005f85bf54ebfb870b326ef3e18ed P 77789aa45dc5463c82b73504fef4b4e0 -> Peer c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847): Couldn't send request to peer c4b52f14f9154b5a86f76fe58e4c235e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:14.607121  6441 raft_consensus.cc:493] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:16:14.607836  6441 raft_consensus.cc:515] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:16:14.610481  6441 leader_election.cc:290] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
W20260709 13:16:14.615433  5433 leader_election.cc:336] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Network error: Client connection negotiation failed: client connection to 127.27.146.130:43623: connect: Connection refused (error 111)
W20260709 13:16:14.616014  5434 leader_election.cc:336] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
I20260709 13:16:14.616496  5434 leader_election.cc:304] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0; no voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:16:14.616994  6441 raft_consensus.cc:493] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:16:14.617512  6491 raft_consensus.cc:2749] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:14.617704  6441 raft_consensus.cc:515] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:16:14.620287  6441 leader_election.cc:290] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
W20260709 13:16:14.623416  5434 consensus_peers.cc:597] T 3d6bcda036934682b5075c20b786026d P 77789aa45dc5463c82b73504fef4b4e0 -> Peer c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847): Couldn't send request to peer c4b52f14f9154b5a86f76fe58e4c235e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:14.626111  5433 leader_election.cc:336] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Network error: Client connection negotiation failed: client connection to 127.27.146.130:43623: connect: Connection refused (error 111)
W20260709 13:16:14.629273  5434 leader_election.cc:336] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
I20260709 13:16:14.629796  5434 leader_election.cc:304] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0; no voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:16:14.630654  6441 raft_consensus.cc:2749] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:14.643412 28234 tablet_server.cc:196] TabletServer@127.27.146.131:0 shutdown complete.
I20260709 13:16:14.671756  6491 raft_consensus.cc:493] T 58438f196e6d42cc8780742faa222dc8 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:16:14.672550  6491 raft_consensus.cc:515] T 58438f196e6d42cc8780742faa222dc8 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:16:14.677785  6491 leader_election.cc:290] T 58438f196e6d42cc8780742faa222dc8 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
W20260709 13:16:14.682118  5434 leader_election.cc:336] T 58438f196e6d42cc8780742faa222dc8 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847): Network error: Client connection negotiation failed: client connection to 127.27.146.131:40847: connect: Connection refused (error 111)
W20260709 13:16:14.685583  5434 leader_election.cc:336] T 58438f196e6d42cc8780742faa222dc8 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
I20260709 13:16:14.686164  5434 leader_election.cc:304] T 58438f196e6d42cc8780742faa222dc8 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:16:14.687306  6491 raft_consensus.cc:2749] T 58438f196e6d42cc8780742faa222dc8 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:14.694226  6491 raft_consensus.cc:493] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:16:14.694993  6491 raft_consensus.cc:515] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
I20260709 13:16:14.697517  6491 leader_election.cc:290] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
W20260709 13:16:14.704052  5433 leader_election.cc:336] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Network error: Client connection negotiation failed: client connection to 127.27.146.130:43623: connect: Connection refused (error 111)
W20260709 13:16:14.704979  5434 leader_election.cc:336] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
I20260709 13:16:14.705763  5434 leader_election.cc:304] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0; no voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:16:14.706799  6491 raft_consensus.cc:2749] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:14.744974 28234 tablet_server.cc:179] TabletServer@127.27.146.132:0 shutting down...
I20260709 13:16:14.765177  6491 raft_consensus.cc:493] T 71b75232471f416bb2d0ec813f32558e P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:16:14.767042  6491 raft_consensus.cc:515] T 71b75232471f416bb2d0ec813f32558e P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } } peers { permanent_uuid: "2f45532f94a34efcb68a82db3dd69372" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 43623 } }
W20260709 13:16:14.769552  5434 consensus_peers.cc:597] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 -> Peer c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847): Couldn't send request to peer c4b52f14f9154b5a86f76fe58e4c235e. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.131:40847: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:14.770551  6480 raft_consensus.cc:493] T 73c339ffbbca40c78c31d33aa9bb9e38 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 538ff4bfbd0c4f04bcd800c4ee4845ba)
I20260709 13:16:14.771136  6480 raft_consensus.cc:515] T 73c339ffbbca40c78c31d33aa9bb9e38 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4b52f14f9154b5a86f76fe58e4c235e" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 40847 } } peers { permanent_uuid: "77789aa45dc5463c82b73504fef4b4e0" member_type: VOTER last_known_addr { host: "127.27.146.132" port: 41391 } } peers { permanent_uuid: "538ff4bfbd0c4f04bcd800c4ee4845ba" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 41357 } }
I20260709 13:16:14.772915  6491 leader_election.cc:290] T 71b75232471f416bb2d0ec813f32558e P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357), 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623)
I20260709 13:16:14.773547  6480 leader_election.cc:290] T 73c339ffbbca40c78c31d33aa9bb9e38 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847), 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357)
W20260709 13:16:14.781296  5433 leader_election.cc:336] T 71b75232471f416bb2d0ec813f32558e P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2f45532f94a34efcb68a82db3dd69372 (127.27.146.130:43623): Network error: Client connection negotiation failed: client connection to 127.27.146.130:43623: connect: Connection refused (error 111)
W20260709 13:16:14.782981  5434 leader_election.cc:336] T 71b75232471f416bb2d0ec813f32558e P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
I20260709 13:16:14.783710  5434 leader_election.cc:304] T 71b75232471f416bb2d0ec813f32558e P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0; no voters: 2f45532f94a34efcb68a82db3dd69372, 538ff4bfbd0c4f04bcd800c4ee4845ba
I20260709 13:16:14.784754  6480 raft_consensus.cc:2749] T 71b75232471f416bb2d0ec813f32558e P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:16:14.788095  5434 leader_election.cc:336] T 73c339ffbbca40c78c31d33aa9bb9e38 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c4b52f14f9154b5a86f76fe58e4c235e (127.27.146.131:40847): Network error: Client connection negotiation failed: client connection to 127.27.146.131:40847: connect: Connection refused (error 111)
W20260709 13:16:14.788983  5434 leader_election.cc:336] T 73c339ffbbca40c78c31d33aa9bb9e38 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 538ff4bfbd0c4f04bcd800c4ee4845ba (127.27.146.129:41357): Network error: Client connection negotiation failed: client connection to 127.27.146.129:41357: connect: Connection refused (error 111)
I20260709 13:16:14.789397  5434 leader_election.cc:304] T 73c339ffbbca40c78c31d33aa9bb9e38 P 77789aa45dc5463c82b73504fef4b4e0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77789aa45dc5463c82b73504fef4b4e0; no voters: 538ff4bfbd0c4f04bcd800c4ee4845ba, c4b52f14f9154b5a86f76fe58e4c235e
I20260709 13:16:14.790107  6480 raft_consensus.cc:2749] T 73c339ffbbca40c78c31d33aa9bb9e38 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:14.813689 28234 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:14.814586 28234 tablet_replica.cc:333] T 3d6bcda036934682b5075c20b786026d P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.815344 28234 raft_consensus.cc:2243] T 3d6bcda036934682b5075c20b786026d P 77789aa45dc5463c82b73504fef4b4e0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.816278 28234 raft_consensus.cc:2272] T 3d6bcda036934682b5075c20b786026d P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.818574 28234 tablet_replica.cc:333] T 3b01a00074004ddb87b1710a6555353b P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.819233 28234 raft_consensus.cc:2243] T 3b01a00074004ddb87b1710a6555353b P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.819725 28234 raft_consensus.cc:2272] T 3b01a00074004ddb87b1710a6555353b P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.821712 28234 tablet_replica.cc:333] T 9c7fcfa184e1425c86c784dd9db4423e P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.822327 28234 raft_consensus.cc:2243] T 9c7fcfa184e1425c86c784dd9db4423e P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.822763 28234 raft_consensus.cc:2272] T 9c7fcfa184e1425c86c784dd9db4423e P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.824816 28234 tablet_replica.cc:333] T 073bb9d9d62f462db20229a4924564e1 P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.825407 28234 raft_consensus.cc:2243] T 073bb9d9d62f462db20229a4924564e1 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.825829 28234 raft_consensus.cc:2272] T 073bb9d9d62f462db20229a4924564e1 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.827858 28234 tablet_replica.cc:333] T c520b1f4431848d1967291be272086c5 P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.828452 28234 raft_consensus.cc:2243] T c520b1f4431848d1967291be272086c5 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.828891 28234 raft_consensus.cc:2272] T c520b1f4431848d1967291be272086c5 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.830866 28234 tablet_replica.cc:333] T 58438f196e6d42cc8780742faa222dc8 P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.831449 28234 raft_consensus.cc:2243] T 58438f196e6d42cc8780742faa222dc8 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.831938 28234 raft_consensus.cc:2272] T 58438f196e6d42cc8780742faa222dc8 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.834393 28234 tablet_replica.cc:333] T 73c339ffbbca40c78c31d33aa9bb9e38 P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.835224 28234 raft_consensus.cc:2243] T 73c339ffbbca40c78c31d33aa9bb9e38 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.835839 28234 raft_consensus.cc:2272] T 73c339ffbbca40c78c31d33aa9bb9e38 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.838697 28234 tablet_replica.cc:333] T 5b17eb476da34f05b466923d9c48cc2d P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.839565 28234 raft_consensus.cc:2243] T 5b17eb476da34f05b466923d9c48cc2d P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.840253 28234 raft_consensus.cc:2272] T 5b17eb476da34f05b466923d9c48cc2d P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.842824 28234 tablet_replica.cc:333] T 6a1e233f50be40f78b9208537916e93c P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.843417 28234 raft_consensus.cc:2243] T 6a1e233f50be40f78b9208537916e93c P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.844077 28234 raft_consensus.cc:2272] T 6a1e233f50be40f78b9208537916e93c P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.847242 28234 tablet_replica.cc:333] T 03ad7844466b46548e4e9600220710f0 P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.848014 28234 raft_consensus.cc:2243] T 03ad7844466b46548e4e9600220710f0 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.848541 28234 raft_consensus.cc:2272] T 03ad7844466b46548e4e9600220710f0 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.850904 28234 tablet_replica.cc:333] T 0796f5098e2a48c992868bbffce02505 P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.851408 28234 raft_consensus.cc:2243] T 0796f5098e2a48c992868bbffce02505 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.852224 28234 raft_consensus.cc:2272] T 0796f5098e2a48c992868bbffce02505 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.854080 28234 tablet_replica.cc:333] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.854600 28234 raft_consensus.cc:2243] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.854983 28234 raft_consensus.cc:2272] T 63267e5ca2594b41844fd758ca603a34 P 77789aa45dc5463c82b73504fef4b4e0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.856878 28234 tablet_replica.cc:333] T 34516de894fc408b8e355aba3402489c P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.857417 28234 raft_consensus.cc:2243] T 34516de894fc408b8e355aba3402489c P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.857911 28234 raft_consensus.cc:2272] T 34516de894fc408b8e355aba3402489c P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.860006 28234 tablet_replica.cc:333] T 99cdbf6d16c64a949df77a003bb7f7e4 P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.860554 28234 raft_consensus.cc:2243] T 99cdbf6d16c64a949df77a003bb7f7e4 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.861346 28234 raft_consensus.cc:2272] T 99cdbf6d16c64a949df77a003bb7f7e4 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.863984 28234 tablet_replica.cc:333] T c6bbe6dd572c4ea4aaf323c36eb05467 P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.864607 28234 raft_consensus.cc:2243] T c6bbe6dd572c4ea4aaf323c36eb05467 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.865051 28234 raft_consensus.cc:2272] T c6bbe6dd572c4ea4aaf323c36eb05467 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.867311 28234 tablet_replica.cc:333] T cb26053fad7244cd88a5182d9cfc2109 P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.868027 28234 raft_consensus.cc:2243] T cb26053fad7244cd88a5182d9cfc2109 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.868804 28234 raft_consensus.cc:2272] T cb26053fad7244cd88a5182d9cfc2109 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.870771 28234 tablet_replica.cc:333] T 15d005f85bf54ebfb870b326ef3e18ed P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.871308 28234 raft_consensus.cc:2243] T 15d005f85bf54ebfb870b326ef3e18ed P 77789aa45dc5463c82b73504fef4b4e0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.872110 28234 raft_consensus.cc:2272] T 15d005f85bf54ebfb870b326ef3e18ed P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.874027 28234 tablet_replica.cc:333] T bdbcf0a951c24340ba91509df11fc4c7 P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.874615 28234 raft_consensus.cc:2243] T bdbcf0a951c24340ba91509df11fc4c7 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.875320 28234 raft_consensus.cc:2272] T bdbcf0a951c24340ba91509df11fc4c7 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.877326 28234 tablet_replica.cc:333] T c01a087c57254cf0822d574602320ab5 P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.877839 28234 raft_consensus.cc:2243] T c01a087c57254cf0822d574602320ab5 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.878590 28234 raft_consensus.cc:2272] T c01a087c57254cf0822d574602320ab5 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.880625 28234 tablet_replica.cc:333] T 09e39d6f01a0444bb1aa42b5403943c8 P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.881151 28234 raft_consensus.cc:2243] T 09e39d6f01a0444bb1aa42b5403943c8 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.881536 28234 raft_consensus.cc:2272] T 09e39d6f01a0444bb1aa42b5403943c8 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.883526 28234 tablet_replica.cc:333] T f6cbde4ed3d14db5a1826609542ec5a4 P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.884039 28234 raft_consensus.cc:2243] T f6cbde4ed3d14db5a1826609542ec5a4 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.884749 28234 raft_consensus.cc:2272] T f6cbde4ed3d14db5a1826609542ec5a4 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.887007 28234 tablet_replica.cc:333] T f18f7cc1557b43b9adbf357e50e292a0 P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.887596 28234 raft_consensus.cc:2243] T f18f7cc1557b43b9adbf357e50e292a0 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.888026 28234 raft_consensus.cc:2272] T f18f7cc1557b43b9adbf357e50e292a0 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.889920 28234 tablet_replica.cc:333] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.890497 28234 raft_consensus.cc:2243] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.891275 28234 raft_consensus.cc:2272] T 068e5bd8f3ef45fc8a4a122e51537764 P 77789aa45dc5463c82b73504fef4b4e0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.893185 28234 tablet_replica.cc:333] T fce0170182474e7dbe46361f5bf0eae9 P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.893759 28234 raft_consensus.cc:2243] T fce0170182474e7dbe46361f5bf0eae9 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.894177 28234 raft_consensus.cc:2272] T fce0170182474e7dbe46361f5bf0eae9 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.896114 28234 tablet_replica.cc:333] T 4791d524d10e495fb14f6fd27fcc2218 P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.896721 28234 raft_consensus.cc:2243] T 4791d524d10e495fb14f6fd27fcc2218 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.897145 28234 raft_consensus.cc:2272] T 4791d524d10e495fb14f6fd27fcc2218 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.899086 28234 tablet_replica.cc:333] T 4bc60d69f29e47689fd8fdf2b6aa836a P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.899662 28234 raft_consensus.cc:2243] T 4bc60d69f29e47689fd8fdf2b6aa836a P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.900065 28234 raft_consensus.cc:2272] T 4bc60d69f29e47689fd8fdf2b6aa836a P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.901893 28234 tablet_replica.cc:333] T 39d465e757b14de1842d55d52271bceb P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.902477 28234 raft_consensus.cc:2243] T 39d465e757b14de1842d55d52271bceb P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.902904 28234 raft_consensus.cc:2272] T 39d465e757b14de1842d55d52271bceb P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.904961 28234 tablet_replica.cc:333] T 57bbe622c9794d6fa61dd5f39cb3d306 P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.905637 28234 raft_consensus.cc:2243] T 57bbe622c9794d6fa61dd5f39cb3d306 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.906212 28234 raft_consensus.cc:2272] T 57bbe622c9794d6fa61dd5f39cb3d306 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.908809 28234 tablet_replica.cc:333] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.909511 28234 raft_consensus.cc:2243] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.909966 28234 raft_consensus.cc:2272] T 29f5415006bb4218b579d580f0b9ff68 P 77789aa45dc5463c82b73504fef4b4e0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.912021 28234 tablet_replica.cc:333] T 3ba8874bed41499cadc73289e5bb4ad3 P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.912616 28234 raft_consensus.cc:2243] T 3ba8874bed41499cadc73289e5bb4ad3 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.913457 28234 raft_consensus.cc:2272] T 3ba8874bed41499cadc73289e5bb4ad3 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.915575 28234 tablet_replica.cc:333] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.916145 28234 raft_consensus.cc:2243] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.916595 28234 raft_consensus.cc:2272] T 7c0e035a21aa4d43857f541259fa71b9 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.918545 28234 tablet_replica.cc:333] T 436bb2869b55478b9c1cc99b5f83f981 P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.919096 28234 raft_consensus.cc:2243] T 436bb2869b55478b9c1cc99b5f83f981 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.919585 28234 raft_consensus.cc:2272] T 436bb2869b55478b9c1cc99b5f83f981 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.921492 28234 tablet_replica.cc:333] T 3e48fc9e60214121991b0bb473d174da P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.922025 28234 raft_consensus.cc:2243] T 3e48fc9e60214121991b0bb473d174da P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.922447 28234 raft_consensus.cc:2272] T 3e48fc9e60214121991b0bb473d174da P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.924769 28234 tablet_replica.cc:333] T 43d23c7f276f4df1acd8124ed4940f1b P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.925419 28234 raft_consensus.cc:2243] T 43d23c7f276f4df1acd8124ed4940f1b P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.925930 28234 raft_consensus.cc:2272] T 43d23c7f276f4df1acd8124ed4940f1b P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.928097 28234 tablet_replica.cc:333] T 480c812524814775bbf2823e53a996ed P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.928678 28234 raft_consensus.cc:2243] T 480c812524814775bbf2823e53a996ed P 77789aa45dc5463c82b73504fef4b4e0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.929603 28234 raft_consensus.cc:2272] T 480c812524814775bbf2823e53a996ed P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.931983 28234 tablet_replica.cc:333] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.932574 28234 raft_consensus.cc:2243] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.933393 28234 raft_consensus.cc:2272] T 8aac85b71e404ee1bcfb748bfb0376fb P 77789aa45dc5463c82b73504fef4b4e0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.935515 28234 tablet_replica.cc:333] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.936103 28234 raft_consensus.cc:2243] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 77789aa45dc5463c82b73504fef4b4e0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.936986 28234 raft_consensus.cc:2272] T 34ed89f0e9a64fd3ab95b7e83cd4b03a P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.939185 28234 tablet_replica.cc:333] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.939875 28234 raft_consensus.cc:2243] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.940434 28234 raft_consensus.cc:2272] T 5d841937b5db4e7fa656db32b84b9ca2 P 77789aa45dc5463c82b73504fef4b4e0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.942658 28234 tablet_replica.cc:333] T 0fde317f3ec547c3840e2fe1e07ec228 P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.943272 28234 raft_consensus.cc:2243] T 0fde317f3ec547c3840e2fe1e07ec228 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.943776 28234 raft_consensus.cc:2272] T 0fde317f3ec547c3840e2fe1e07ec228 P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.946136 28234 tablet_replica.cc:333] T d443132476914cd1958f499f68f8acd5 P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.946725 28234 raft_consensus.cc:2243] T d443132476914cd1958f499f68f8acd5 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.947621 28234 raft_consensus.cc:2272] T d443132476914cd1958f499f68f8acd5 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.949923 28234 tablet_replica.cc:333] T 104c92d196fa45818108b633cbfaea4b P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.950481 28234 raft_consensus.cc:2243] T 104c92d196fa45818108b633cbfaea4b P 77789aa45dc5463c82b73504fef4b4e0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:14.951314 28234 raft_consensus.cc:2272] T 104c92d196fa45818108b633cbfaea4b P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.953718 28234 tablet_replica.cc:333] T 309fb72c5b374642bb05a78b0b5ca308 P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.954295 28234 raft_consensus.cc:2243] T 309fb72c5b374642bb05a78b0b5ca308 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.954767 28234 raft_consensus.cc:2272] T 309fb72c5b374642bb05a78b0b5ca308 P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.956938 28234 tablet_replica.cc:333] T 71b75232471f416bb2d0ec813f32558e P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.957453 28234 raft_consensus.cc:2243] T 71b75232471f416bb2d0ec813f32558e P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.957922 28234 raft_consensus.cc:2272] T 71b75232471f416bb2d0ec813f32558e P 77789aa45dc5463c82b73504fef4b4e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:14.959872 28234 tablet_replica.cc:333] T 8c46fa9b6c00424a8697f4536d1a3b0e P 77789aa45dc5463c82b73504fef4b4e0: stopping tablet replica
I20260709 13:16:14.960371 28234 raft_consensus.cc:2243] T 8c46fa9b6c00424a8697f4536d1a3b0e P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:14.960804 28234 raft_consensus.cc:2272] T 8c46fa9b6c00424a8697f4536d1a3b0e P 77789aa45dc5463c82b73504fef4b4e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:15.035424 28234 tablet_server.cc:196] TabletServer@127.27.146.132:0 shutdown complete.
I20260709 13:16:15.110592 28234 master.cc:562] Master@127.27.146.190:43479 shutting down...
I20260709 13:16:15.144743 28234 raft_consensus.cc:2243] T 00000000000000000000000000000000 P dd92c4932f4e45ca9198ce72bd2b2a95 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:15.145325 28234 raft_consensus.cc:2272] T 00000000000000000000000000000000 P dd92c4932f4e45ca9198ce72bd2b2a95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:15.145690 28234 tablet_replica.cc:333] T 00000000000000000000000000000000 P dd92c4932f4e45ca9198ce72bd2b2a95: stopping tablet replica
I20260709 13:16:15.170104 28234 master.cc:584] Master@127.27.146.190:43479 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (36893 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:16:15.269958 28234 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.27.146.190:36709
I20260709 13:16:15.271044 28234 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:15.277813  6497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:15.277891  6496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:15.278900  6499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:15.279716 28234 server_base.cc:1061] running on GCE node
I20260709 13:16:15.280944 28234 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:15.281159 28234 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:15.281339 28234 hybrid_clock.cc:648] HybridClock initialized: now 1783602975281322 us; error 0 us; skew 500 ppm
I20260709 13:16:15.281903 28234 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:15.284960 28234 webserver.cc:533] Webserver started at http://127.27.146.190:39981/ using document root <none> and password file <none>
I20260709 13:16:15.285488 28234 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:15.285697 28234 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:15.285967 28234 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:15.287101 28234 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602648606606-28234-0/minicluster-data/master-0-root/instance:
uuid: "7cde1a47555a4e269621eb56a27cd096"
format_stamp: "Formatted at 2026-07-09 13:16:15 on dist-test-slave-clfv"
I20260709 13:16:15.291893 28234 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:16:15.296581  6504 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:15.297582 28234 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:16:15.297840 28234 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602648606606-28234-0/minicluster-data/master-0-root
uuid: "7cde1a47555a4e269621eb56a27cd096"
format_stamp: "Formatted at 2026-07-09 13:16:15 on dist-test-slave-clfv"
I20260709 13:16:15.298099 28234 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602648606606-28234-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602648606606-28234-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602648606606-28234-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:15.313060 28234 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:15.314308 28234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:15.361567 28234 rpc_server.cc:307] RPC server started. Bound to: 127.27.146.190:36709
I20260709 13:16:15.361697  6555 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.146.190:36709 every 8 connection(s)
I20260709 13:16:15.366614  6556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:15.379585  6556 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7cde1a47555a4e269621eb56a27cd096: Bootstrap starting.
I20260709 13:16:15.385982  6556 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7cde1a47555a4e269621eb56a27cd096: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:15.391535  6556 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7cde1a47555a4e269621eb56a27cd096: No bootstrap required, opened a new log
I20260709 13:16:15.394207  6556 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7cde1a47555a4e269621eb56a27cd096 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cde1a47555a4e269621eb56a27cd096" member_type: VOTER }
I20260709 13:16:15.394716  6556 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7cde1a47555a4e269621eb56a27cd096 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:15.394968  6556 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7cde1a47555a4e269621eb56a27cd096 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cde1a47555a4e269621eb56a27cd096, State: Initialized, Role: FOLLOWER
I20260709 13:16:15.395639  6556 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7cde1a47555a4e269621eb56a27cd096 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cde1a47555a4e269621eb56a27cd096" member_type: VOTER }
I20260709 13:16:15.396183  6556 raft_consensus.cc:399] T 00000000000000000000000000000000 P 7cde1a47555a4e269621eb56a27cd096 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:16:15.396430  6556 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7cde1a47555a4e269621eb56a27cd096 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:16:15.396697  6556 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7cde1a47555a4e269621eb56a27cd096 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:15.402618  6556 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7cde1a47555a4e269621eb56a27cd096 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cde1a47555a4e269621eb56a27cd096" member_type: VOTER }
I20260709 13:16:15.403278  6556 leader_election.cc:304] T 00000000000000000000000000000000 P 7cde1a47555a4e269621eb56a27cd096 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7cde1a47555a4e269621eb56a27cd096; no voters: 
I20260709 13:16:15.404790  6556 leader_election.cc:290] T 00000000000000000000000000000000 P 7cde1a47555a4e269621eb56a27cd096 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:16:15.405339  6559 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7cde1a47555a4e269621eb56a27cd096 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:15.407119  6559 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7cde1a47555a4e269621eb56a27cd096 [term 1 LEADER]: Becoming Leader. State: Replica: 7cde1a47555a4e269621eb56a27cd096, State: Running, Role: LEADER
I20260709 13:16:15.407864  6559 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7cde1a47555a4e269621eb56a27cd096 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cde1a47555a4e269621eb56a27cd096" member_type: VOTER }
I20260709 13:16:15.408349  6556 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7cde1a47555a4e269621eb56a27cd096 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:16:15.413868  6560 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cde1a47555a4e269621eb56a27cd096 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7cde1a47555a4e269621eb56a27cd096" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cde1a47555a4e269621eb56a27cd096" member_type: VOTER } }
I20260709 13:16:15.413995  6561 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cde1a47555a4e269621eb56a27cd096 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7cde1a47555a4e269621eb56a27cd096. Latest consensus state: current_term: 1 leader_uuid: "7cde1a47555a4e269621eb56a27cd096" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cde1a47555a4e269621eb56a27cd096" member_type: VOTER } }
I20260709 13:16:15.414983  6560 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cde1a47555a4e269621eb56a27cd096 [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:15.415258  6561 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cde1a47555a4e269621eb56a27cd096 [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:15.419117  6567 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:16:15.425138  6567 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:16:15.430131 28234 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:16:15.436182  6567 catalog_manager.cc:1383] Generated new cluster ID: a56170f0381244c1b887b299c8b1eb5d
I20260709 13:16:15.436688  6567 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:16:15.459121  6567 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:16:15.460870  6567 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:16:15.475142  6567 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 7cde1a47555a4e269621eb56a27cd096: Generated new TSK 0
I20260709 13:16:15.475909  6567 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:16:15.497319 28234 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:15.505023  6577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:15.505478  6578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:15.509362  6580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:15.509577 28234 server_base.cc:1061] running on GCE node
I20260709 13:16:15.511161 28234 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:15.511374 28234 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:15.511660 28234 hybrid_clock.cc:648] HybridClock initialized: now 1783602975511624 us; error 0 us; skew 500 ppm
I20260709 13:16:15.512396 28234 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:15.515622 28234 webserver.cc:533] Webserver started at http://127.27.146.129:41389/ using document root <none> and password file <none>
I20260709 13:16:15.516215 28234 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:15.516398 28234 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:15.516754 28234 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:15.518069 28234 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602648606606-28234-0/minicluster-data/ts-0-root/instance:
uuid: "7abeed0e8edf41809baa2d97c88c6b28"
format_stamp: "Formatted at 2026-07-09 13:16:15 on dist-test-slave-clfv"
I20260709 13:16:15.523775 28234 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:16:15.528090  6585 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:15.529125 28234 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:16:15.529515 28234 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602648606606-28234-0/minicluster-data/ts-0-root
uuid: "7abeed0e8edf41809baa2d97c88c6b28"
format_stamp: "Formatted at 2026-07-09 13:16:15 on dist-test-slave-clfv"
I20260709 13:16:15.529829 28234 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602648606606-28234-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602648606606-28234-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602648606606-28234-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:15.539393 28234 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:15.540709 28234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:15.542304 28234 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:15.544759 28234 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:15.544998 28234 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:15.545228 28234 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:15.545408 28234 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:15.592871 28234 rpc_server.cc:307] RPC server started. Bound to: 127.27.146.129:40447
I20260709 13:16:15.593101  6647 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.146.129:40447 every 8 connection(s)
I20260709 13:16:15.598379 28234 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:15.607992  6652 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:15.608870  6653 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:15.611305  6655 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:15.613893 28234 server_base.cc:1061] running on GCE node
I20260709 13:16:15.615113 28234 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:15.615350 28234 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:15.615688 28234 hybrid_clock.cc:648] HybridClock initialized: now 1783602975615667 us; error 0 us; skew 500 ppm
I20260709 13:16:15.616343 28234 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:15.619470 28234 webserver.cc:533] Webserver started at http://127.27.146.130:34885/ using document root <none> and password file <none>
I20260709 13:16:15.620375 28234 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:15.620663 28234 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:15.621050 28234 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:15.622843 28234 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602648606606-28234-0/minicluster-data/ts-1-root/instance:
uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
format_stamp: "Formatted at 2026-07-09 13:16:15 on dist-test-slave-clfv"
I20260709 13:16:15.623983  6648 heartbeater.cc:344] Connected to a master server at 127.27.146.190:36709
I20260709 13:16:15.624537  6648 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:15.625458  6648 heartbeater.cc:507] Master 127.27.146.190:36709 requested a full tablet report, sending...
I20260709 13:16:15.628374  6521 ts_manager.cc:194] Registered new tserver with Master: 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447)
I20260709 13:16:15.629208 28234 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:16:15.630592  6521 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49514
I20260709 13:16:15.634204  6660 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:15.635344 28234 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:16:15.635833 28234 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602648606606-28234-0/minicluster-data/ts-1-root
uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
format_stamp: "Formatted at 2026-07-09 13:16:15 on dist-test-slave-clfv"
I20260709 13:16:15.636152 28234 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602648606606-28234-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602648606606-28234-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602648606606-28234-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:15.654417 28234 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:15.655921 28234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:15.657617 28234 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:15.660178 28234 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:15.660424 28234 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:15.660693 28234 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:15.660885 28234 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:15.714015 28234 rpc_server.cc:307] RPC server started. Bound to: 127.27.146.130:35419
I20260709 13:16:15.714233  6722 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.146.130:35419 every 8 connection(s)
I20260709 13:16:15.719396 28234 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:15.726635  6726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:15.728838  6727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:15.731731  6729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:15.732259 28234 server_base.cc:1061] running on GCE node
I20260709 13:16:15.733563 28234 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:15.733997 28234 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:15.734205 28234 hybrid_clock.cc:648] HybridClock initialized: now 1783602975734186 us; error 0 us; skew 500 ppm
I20260709 13:16:15.735002 28234 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:15.738236 28234 webserver.cc:533] Webserver started at http://127.27.146.131:45131/ using document root <none> and password file <none>
I20260709 13:16:15.738586  6723 heartbeater.cc:344] Connected to a master server at 127.27.146.190:36709
I20260709 13:16:15.738791 28234 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:15.739184  6723 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:15.739200 28234 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:15.739879 28234 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:15.740391  6723 heartbeater.cc:507] Master 127.27.146.190:36709 requested a full tablet report, sending...
I20260709 13:16:15.741108 28234 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602648606606-28234-0/minicluster-data/ts-2-root/instance:
uuid: "3972da3671ef401bbc841052ea9c5588"
format_stamp: "Formatted at 2026-07-09 13:16:15 on dist-test-slave-clfv"
I20260709 13:16:15.743112  6521 ts_manager.cc:194] Registered new tserver with Master: d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419)
I20260709 13:16:15.745206  6521 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49518
I20260709 13:16:15.747468 28234 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:16:15.751740  6734 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:15.752792 28234 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:16:15.753273 28234 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602648606606-28234-0/minicluster-data/ts-2-root
uuid: "3972da3671ef401bbc841052ea9c5588"
format_stamp: "Formatted at 2026-07-09 13:16:15 on dist-test-slave-clfv"
I20260709 13:16:15.753582 28234 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602648606606-28234-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602648606606-28234-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602648606606-28234-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:15.775991 28234 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:15.777393 28234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:15.779170 28234 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:15.781813 28234 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:15.782028 28234 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:15.782369 28234 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:15.782552 28234 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:15.834110 28234 rpc_server.cc:307] RPC server started. Bound to: 127.27.146.131:44041
I20260709 13:16:15.834388  6796 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.146.131:44041 every 8 connection(s)
I20260709 13:16:15.850530  6797 heartbeater.cc:344] Connected to a master server at 127.27.146.190:36709
I20260709 13:16:15.851176  6797 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:15.852187  6797 heartbeater.cc:507] Master 127.27.146.190:36709 requested a full tablet report, sending...
I20260709 13:16:15.854874  6521 ts_manager.cc:194] Registered new tserver with Master: 3972da3671ef401bbc841052ea9c5588 (127.27.146.131:44041)
I20260709 13:16:15.855811 28234 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018310466s
I20260709 13:16:15.856869  6521 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49520
I20260709 13:16:15.886333  6521 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49534:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:16:15.889489  6521 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:16:15.978144  6613 tablet_service.cc:1511] Processing CreateTablet for tablet 4e0c8fb12e4e49f2927d224f188a8cc9 (DEFAULT_TABLE table=test-workload [id=167caebbcd4b4cdf93776c461e1e1af3]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:16:15.980871  6612 tablet_service.cc:1511] Processing CreateTablet for tablet 99642a0c8f7941bca524315ff82e60da (DEFAULT_TABLE table=test-workload [id=167caebbcd4b4cdf93776c461e1e1af3]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:16:15.982081  6610 tablet_service.cc:1511] Processing CreateTablet for tablet 47dc18fd364c4b079b99900a766e3208 (DEFAULT_TABLE table=test-workload [id=167caebbcd4b4cdf93776c461e1e1af3]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:16:15.982887  6612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99642a0c8f7941bca524315ff82e60da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:15.984627  6611 tablet_service.cc:1511] Processing CreateTablet for tablet 31789365471247b58419c92a028a9afc (DEFAULT_TABLE table=test-workload [id=167caebbcd4b4cdf93776c461e1e1af3]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:16:15.986218  6611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31789365471247b58419c92a028a9afc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:15.988000  6610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47dc18fd364c4b079b99900a766e3208. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:15.992455  6613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e0c8fb12e4e49f2927d224f188a8cc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:15.994400  6688 tablet_service.cc:1511] Processing CreateTablet for tablet 4e0c8fb12e4e49f2927d224f188a8cc9 (DEFAULT_TABLE table=test-workload [id=167caebbcd4b4cdf93776c461e1e1af3]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:16:15.995960  6688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e0c8fb12e4e49f2927d224f188a8cc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:15.996977  6686 tablet_service.cc:1511] Processing CreateTablet for tablet 31789365471247b58419c92a028a9afc (DEFAULT_TABLE table=test-workload [id=167caebbcd4b4cdf93776c461e1e1af3]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:16:15.998684  6686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31789365471247b58419c92a028a9afc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:15.995214  6687 tablet_service.cc:1511] Processing CreateTablet for tablet 99642a0c8f7941bca524315ff82e60da (DEFAULT_TABLE table=test-workload [id=167caebbcd4b4cdf93776c461e1e1af3]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:16:16.001151  6687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99642a0c8f7941bca524315ff82e60da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:16.003324  6685 tablet_service.cc:1511] Processing CreateTablet for tablet 47dc18fd364c4b079b99900a766e3208 (DEFAULT_TABLE table=test-workload [id=167caebbcd4b4cdf93776c461e1e1af3]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:16:16.005044  6685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47dc18fd364c4b079b99900a766e3208. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:16.006752  6608 tablet_service.cc:1511] Processing CreateTablet for tablet 7d0a65bcc05d492e860cd9066fb0161a (DEFAULT_TABLE table=test-workload [id=167caebbcd4b4cdf93776c461e1e1af3]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:16:16.020500  6681 tablet_service.cc:1511] Processing CreateTablet for tablet 43d643af6d3248da8abe7e13fd887cc1 (DEFAULT_TABLE table=test-workload [id=167caebbcd4b4cdf93776c461e1e1af3]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:16:16.021574  6608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d0a65bcc05d492e860cd9066fb0161a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:16.007912  6762 tablet_service.cc:1511] Processing CreateTablet for tablet 4e0c8fb12e4e49f2927d224f188a8cc9 (DEFAULT_TABLE table=test-workload [id=167caebbcd4b4cdf93776c461e1e1af3]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:16:16.023471  6759 tablet_service.cc:1511] Processing CreateTablet for tablet 47dc18fd364c4b079b99900a766e3208 (DEFAULT_TABLE table=test-workload [id=167caebbcd4b4cdf93776c461e1e1af3]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:16:16.024339  6762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e0c8fb12e4e49f2927d224f188a8cc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:16.025027  6759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47dc18fd364c4b079b99900a766e3208. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:16.020507  6605 tablet_service.cc:1511] Processing CreateTablet for tablet 571acba5e0524805ba100b31450f461c (DEFAULT_TABLE table=test-workload [id=167caebbcd4b4cdf93776c461e1e1af3]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:16:16.029225  6605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 571acba5e0524805ba100b31450f461c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:16.017869  6682 tablet_service.cc:1511] Processing CreateTablet for tablet f48bbc412be247c59a7817c33136ceee (DEFAULT_TABLE table=test-workload [id=167caebbcd4b4cdf93776c461e1e1af3]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:16:16.008798  6609 tablet_service.cc:1511] Processing CreateTablet for tablet ef0cd7434a044f94a030340fabe9f8fc (DEFAULT_TABLE table=test-workload [id=167caebbcd4b4cdf93776c461e1e1af3]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:16:16.033913  6609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef0cd7434a044f94a030340fabe9f8fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:16.038187  6754 tablet_service.cc:1511] Processing CreateTablet for tablet 571acba5e0524805ba100b31450f461c (DEFAULT_TABLE table=test-workload [id=167caebbcd4b4cdf93776c461e1e1af3]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:16:16.040546  6754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 571acba5e0524805ba100b31450f461c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:16.040659  6755 tablet_service.cc:1511] Processing CreateTablet for tablet 43d643af6d3248da8abe7e13fd887cc1 (DEFAULT_TABLE table=test-workload [id=167caebbcd4b4cdf93776c461e1e1af3]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:16:16.012621  6761 tablet_service.cc:1511] Processing CreateTablet for tablet 99642a0c8f7941bca524315ff82e60da (DEFAULT_TABLE table=test-workload [id=167caebbcd4b4cdf93776c461e1e1af3]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:16:16.042358  6755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43d643af6d3248da8abe7e13fd887cc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:16.043408  6761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99642a0c8f7941bca524315ff82e60da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:16.046072  6757 tablet_service.cc:1511] Processing CreateTablet for tablet 7d0a65bcc05d492e860cd9066fb0161a (DEFAULT_TABLE table=test-workload [id=167caebbcd4b4cdf93776c461e1e1af3]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:16:16.049154  6604 tablet_service.cc:1511] Processing CreateTablet for tablet 1b9d55b78dd94bbba5df1f481b3e8c5c (DEFAULT_TABLE table=test-workload [id=167caebbcd4b4cdf93776c461e1e1af3]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:16:16.049561  6680 tablet_service.cc:1511] Processing CreateTablet for tablet 571acba5e0524805ba100b31450f461c (DEFAULT_TABLE table=test-workload [id=167caebbcd4b4cdf93776c461e1e1af3]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:16:16.050788  6604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b9d55b78dd94bbba5df1f481b3e8c5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:16.012743  6607 tablet_service.cc:1511] Processing CreateTablet for tablet f48bbc412be247c59a7817c33136ceee (DEFAULT_TABLE table=test-workload [id=167caebbcd4b4cdf93776c461e1e1af3]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:16:16.014503  6683 tablet_service.cc:1511] Processing CreateTablet for tablet 7d0a65bcc05d492e860cd9066fb0161a (DEFAULT_TABLE table=test-workload [id=167caebbcd4b4cdf93776c461e1e1af3]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:16:16.010779  6684 tablet_service.cc:1511] Processing CreateTablet for tablet ef0cd7434a044f94a030340fabe9f8fc (DEFAULT_TABLE table=test-workload [id=167caebbcd4b4cdf93776c461e1e1af3]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:16:16.017076  6760 tablet_service.cc:1511] Processing CreateTablet for tablet 31789365471247b58419c92a028a9afc (DEFAULT_TABLE table=test-workload [id=167caebbcd4b4cdf93776c461e1e1af3]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:16:16.049418  6679 tablet_service.cc:1511] Processing CreateTablet for tablet 1b9d55b78dd94bbba5df1f481b3e8c5c (DEFAULT_TABLE table=test-workload [id=167caebbcd4b4cdf93776c461e1e1af3]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:16:16.051647  6758 tablet_service.cc:1511] Processing CreateTablet for tablet ef0cd7434a044f94a030340fabe9f8fc (DEFAULT_TABLE table=test-workload [id=167caebbcd4b4cdf93776c461e1e1af3]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:16:16.038520  6756 tablet_service.cc:1511] Processing CreateTablet for tablet f48bbc412be247c59a7817c33136ceee (DEFAULT_TABLE table=test-workload [id=167caebbcd4b4cdf93776c461e1e1af3]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:16:16.054694  6753 tablet_service.cc:1511] Processing CreateTablet for tablet 1b9d55b78dd94bbba5df1f481b3e8c5c (DEFAULT_TABLE table=test-workload [id=167caebbcd4b4cdf93776c461e1e1af3]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:16:16.016475  6606 tablet_service.cc:1511] Processing CreateTablet for tablet 43d643af6d3248da8abe7e13fd887cc1 (DEFAULT_TABLE table=test-workload [id=167caebbcd4b4cdf93776c461e1e1af3]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:16:16.057164  6757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d0a65bcc05d492e860cd9066fb0161a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:16.057912  6753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b9d55b78dd94bbba5df1f481b3e8c5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:16.060225  6758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef0cd7434a044f94a030340fabe9f8fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:16.052958  6607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f48bbc412be247c59a7817c33136ceee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:16.068009  6606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43d643af6d3248da8abe7e13fd887cc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:16.072039  6682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f48bbc412be247c59a7817c33136ceee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:16.061106  6756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f48bbc412be247c59a7817c33136ceee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:16.073820  6679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b9d55b78dd94bbba5df1f481b3e8c5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:16.074815  6760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31789365471247b58419c92a028a9afc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:16.075343  6681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43d643af6d3248da8abe7e13fd887cc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:16.077219  6680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 571acba5e0524805ba100b31450f461c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:16.078666  6683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d0a65bcc05d492e860cd9066fb0161a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:16.080133  6684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef0cd7434a044f94a030340fabe9f8fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:16.192621  6812 tablet_bootstrap.cc:492] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 7abeed0e8edf41809baa2d97c88c6b28: Bootstrap starting.
I20260709 13:16:16.234118  6813 tablet_bootstrap.cc:492] T 4e0c8fb12e4e49f2927d224f188a8cc9 P d8632beb9efb4ce4a1d87e0c854b639a: Bootstrap starting.
I20260709 13:16:16.236862  6812 tablet_bootstrap.cc:654] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 7abeed0e8edf41809baa2d97c88c6b28: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:16.242281  6813 tablet_bootstrap.cc:654] T 4e0c8fb12e4e49f2927d224f188a8cc9 P d8632beb9efb4ce4a1d87e0c854b639a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:16.248200  6814 tablet_bootstrap.cc:492] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588: Bootstrap starting.
I20260709 13:16:16.296679  6812 tablet_bootstrap.cc:492] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 7abeed0e8edf41809baa2d97c88c6b28: No bootstrap required, opened a new log
I20260709 13:16:16.297334  6812 ts_tablet_manager.cc:1403] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 7abeed0e8edf41809baa2d97c88c6b28: Time spent bootstrapping tablet: real 0.105s	user 0.018s	sys 0.000s
I20260709 13:16:16.293280  6814 tablet_bootstrap.cc:654] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:16.301234  6812 raft_consensus.cc:359] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.301977  6812 raft_consensus.cc:385] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:16.302273  6812 raft_consensus.cc:740] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7abeed0e8edf41809baa2d97c88c6b28, State: Initialized, Role: FOLLOWER
I20260709 13:16:16.303112  6812 consensus_queue.cc:260] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 7abeed0e8edf41809baa2d97c88c6b28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.305789  6813 tablet_bootstrap.cc:492] T 4e0c8fb12e4e49f2927d224f188a8cc9 P d8632beb9efb4ce4a1d87e0c854b639a: No bootstrap required, opened a new log
I20260709 13:16:16.306641  6813 ts_tablet_manager.cc:1403] T 4e0c8fb12e4e49f2927d224f188a8cc9 P d8632beb9efb4ce4a1d87e0c854b639a: Time spent bootstrapping tablet: real 0.073s	user 0.013s	sys 0.020s
I20260709 13:16:16.310983  6813 raft_consensus.cc:359] T 4e0c8fb12e4e49f2927d224f188a8cc9 P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.312019  6813 raft_consensus.cc:385] T 4e0c8fb12e4e49f2927d224f188a8cc9 P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:16.312273  6648 heartbeater.cc:499] Master 127.27.146.190:36709 was elected leader, sending a full tablet report...
I20260709 13:16:16.312444  6812 ts_tablet_manager.cc:1434] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 7abeed0e8edf41809baa2d97c88c6b28: Time spent starting tablet: real 0.015s	user 0.015s	sys 0.001s
I20260709 13:16:16.312350  6813 raft_consensus.cc:740] T 4e0c8fb12e4e49f2927d224f188a8cc9 P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8632beb9efb4ce4a1d87e0c854b639a, State: Initialized, Role: FOLLOWER
I20260709 13:16:16.314093  6812 tablet_bootstrap.cc:492] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28: Bootstrap starting.
I20260709 13:16:16.314057  6813 consensus_queue.cc:260] T 4e0c8fb12e4e49f2927d224f188a8cc9 P d8632beb9efb4ce4a1d87e0c854b639a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.321916  6812 tablet_bootstrap.cc:654] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:16.334578  6723 heartbeater.cc:499] Master 127.27.146.190:36709 was elected leader, sending a full tablet report...
I20260709 13:16:16.334975  6814 tablet_bootstrap.cc:492] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588: No bootstrap required, opened a new log
I20260709 13:16:16.335673  6814 ts_tablet_manager.cc:1403] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588: Time spent bootstrapping tablet: real 0.088s	user 0.007s	sys 0.015s
I20260709 13:16:16.337996  6812 tablet_bootstrap.cc:492] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28: No bootstrap required, opened a new log
I20260709 13:16:16.338860  6812 ts_tablet_manager.cc:1403] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.014s
I20260709 13:16:16.340764  6814 raft_consensus.cc:359] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.341611  6814 raft_consensus.cc:385] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:16.341939  6814 raft_consensus.cc:740] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3972da3671ef401bbc841052ea9c5588, State: Initialized, Role: FOLLOWER
I20260709 13:16:16.342658  6812 raft_consensus.cc:359] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.343745  6812 raft_consensus.cc:385] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:16.344090  6813 ts_tablet_manager.cc:1434] T 4e0c8fb12e4e49f2927d224f188a8cc9 P d8632beb9efb4ce4a1d87e0c854b639a: Time spent starting tablet: real 0.037s	user 0.022s	sys 0.006s
I20260709 13:16:16.342742  6814 consensus_queue.cc:260] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.345371  6813 tablet_bootstrap.cc:492] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a: Bootstrap starting.
I20260709 13:16:16.344136  6812 raft_consensus.cc:740] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7abeed0e8edf41809baa2d97c88c6b28, State: Initialized, Role: FOLLOWER
I20260709 13:16:16.347290  6812 consensus_queue.cc:260] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
W20260709 13:16:16.348129  6649 tablet.cc:2406] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 7abeed0e8edf41809baa2d97c88c6b28: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:16:16.348289  6797 heartbeater.cc:499] Master 127.27.146.190:36709 was elected leader, sending a full tablet report...
I20260709 13:16:16.349674  6812 ts_tablet_manager.cc:1434] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:16:16.350826  6812 tablet_bootstrap.cc:492] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28: Bootstrap starting.
I20260709 13:16:16.354604  6813 tablet_bootstrap.cc:654] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:16.356868  6814 ts_tablet_manager.cc:1434] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.002s
I20260709 13:16:16.358335  6814 tablet_bootstrap.cc:492] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 3972da3671ef401bbc841052ea9c5588: Bootstrap starting.
I20260709 13:16:16.363113  6812 tablet_bootstrap.cc:654] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:16.363399  6818 raft_consensus.cc:493] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.364156  6818 raft_consensus.cc:515] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.365501  6813 tablet_bootstrap.cc:492] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a: No bootstrap required, opened a new log
I20260709 13:16:16.366175  6813 ts_tablet_manager.cc:1403] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.000s
I20260709 13:16:16.366525  6814 tablet_bootstrap.cc:654] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 3972da3671ef401bbc841052ea9c5588: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:16.370512  6813 raft_consensus.cc:359] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.371764  6813 raft_consensus.cc:385] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:16.374428  6813 raft_consensus.cc:740] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8632beb9efb4ce4a1d87e0c854b639a, State: Initialized, Role: FOLLOWER
I20260709 13:16:16.375169  6818 leader_election.cc:290] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 7abeed0e8edf41809baa2d97c88c6b28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419), 3972da3671ef401bbc841052ea9c5588 (127.27.146.131:44041)
I20260709 13:16:16.376698  6813 consensus_queue.cc:260] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.383558  6813 ts_tablet_manager.cc:1434] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.001s
I20260709 13:16:16.387449  6813 tablet_bootstrap.cc:492] T 31789365471247b58419c92a028a9afc P d8632beb9efb4ce4a1d87e0c854b639a: Bootstrap starting.
I20260709 13:16:16.392920  6812 tablet_bootstrap.cc:492] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28: No bootstrap required, opened a new log
I20260709 13:16:16.397146  6812 ts_tablet_manager.cc:1403] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28: Time spent bootstrapping tablet: real 0.047s	user 0.017s	sys 0.015s
I20260709 13:16:16.399736  6698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0c8fb12e4e49f2927d224f188a8cc9" candidate_uuid: "7abeed0e8edf41809baa2d97c88c6b28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" is_pre_election: true
I20260709 13:16:16.400770  6698 raft_consensus.cc:2468] T 4e0c8fb12e4e49f2927d224f188a8cc9 P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7abeed0e8edf41809baa2d97c88c6b28 in term 0.
I20260709 13:16:16.400730  6812 raft_consensus.cc:359] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.401786  6812 raft_consensus.cc:385] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:16.402170  6812 raft_consensus.cc:740] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7abeed0e8edf41809baa2d97c88c6b28, State: Initialized, Role: FOLLOWER
I20260709 13:16:16.403007  6812 consensus_queue.cc:260] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.403221  6587 leader_election.cc:304] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 7abeed0e8edf41809baa2d97c88c6b28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7abeed0e8edf41809baa2d97c88c6b28, d8632beb9efb4ce4a1d87e0c854b639a; no voters: 
I20260709 13:16:16.404032  6814 tablet_bootstrap.cc:492] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 3972da3671ef401bbc841052ea9c5588: No bootstrap required, opened a new log
I20260709 13:16:16.404623  6814 ts_tablet_manager.cc:1403] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 3972da3671ef401bbc841052ea9c5588: Time spent bootstrapping tablet: real 0.047s	user 0.033s	sys 0.008s
I20260709 13:16:16.405606  6812 ts_tablet_manager.cc:1434] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:16:16.406723  6812 tablet_bootstrap.cc:492] T 99642a0c8f7941bca524315ff82e60da P 7abeed0e8edf41809baa2d97c88c6b28: Bootstrap starting.
I20260709 13:16:16.409674  6818 raft_consensus.cc:2804] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:16.410066  6813 tablet_bootstrap.cc:654] T 31789365471247b58419c92a028a9afc P d8632beb9efb4ce4a1d87e0c854b639a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:16.410459  6818 raft_consensus.cc:493] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.410991  6818 raft_consensus.cc:3060] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:16.413444  6814 raft_consensus.cc:359] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.414265  6814 raft_consensus.cc:385] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:16.414428  6812 tablet_bootstrap.cc:654] T 99642a0c8f7941bca524315ff82e60da P 7abeed0e8edf41809baa2d97c88c6b28: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:16.414645  6814 raft_consensus.cc:740] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3972da3671ef401bbc841052ea9c5588, State: Initialized, Role: FOLLOWER
I20260709 13:16:16.415577  6814 consensus_queue.cc:260] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 3972da3671ef401bbc841052ea9c5588 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.417816  6814 ts_tablet_manager.cc:1434] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 3972da3671ef401bbc841052ea9c5588: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:16:16.419034  6814 tablet_bootstrap.cc:492] T f48bbc412be247c59a7817c33136ceee P 3972da3671ef401bbc841052ea9c5588: Bootstrap starting.
I20260709 13:16:16.421183  6772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0c8fb12e4e49f2927d224f188a8cc9" candidate_uuid: "7abeed0e8edf41809baa2d97c88c6b28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3972da3671ef401bbc841052ea9c5588" is_pre_election: true
W20260709 13:16:16.424618  6569 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:16:16.425971  6588 leader_election.cc:343] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 7abeed0e8edf41809baa2d97c88c6b28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3972da3671ef401bbc841052ea9c5588 (127.27.146.131:44041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:16.433354  6814 tablet_bootstrap.cc:654] T f48bbc412be247c59a7817c33136ceee P 3972da3671ef401bbc841052ea9c5588: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:16.440013  6813 tablet_bootstrap.cc:492] T 31789365471247b58419c92a028a9afc P d8632beb9efb4ce4a1d87e0c854b639a: No bootstrap required, opened a new log
I20260709 13:16:16.440641  6813 ts_tablet_manager.cc:1403] T 31789365471247b58419c92a028a9afc P d8632beb9efb4ce4a1d87e0c854b639a: Time spent bootstrapping tablet: real 0.053s	user 0.010s	sys 0.007s
I20260709 13:16:16.443898  6813 raft_consensus.cc:359] T 31789365471247b58419c92a028a9afc P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.444701  6813 raft_consensus.cc:385] T 31789365471247b58419c92a028a9afc P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:16.445004  6813 raft_consensus.cc:740] T 31789365471247b58419c92a028a9afc P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8632beb9efb4ce4a1d87e0c854b639a, State: Initialized, Role: FOLLOWER
I20260709 13:16:16.445681  6818 raft_consensus.cc:515] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.446017  6813 consensus_queue.cc:260] T 31789365471247b58419c92a028a9afc P d8632beb9efb4ce4a1d87e0c854b639a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.448820  6813 ts_tablet_manager.cc:1434] T 31789365471247b58419c92a028a9afc P d8632beb9efb4ce4a1d87e0c854b639a: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:16:16.449172  6814 tablet_bootstrap.cc:492] T f48bbc412be247c59a7817c33136ceee P 3972da3671ef401bbc841052ea9c5588: No bootstrap required, opened a new log
I20260709 13:16:16.450033  6814 ts_tablet_manager.cc:1403] T f48bbc412be247c59a7817c33136ceee P 3972da3671ef401bbc841052ea9c5588: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.005s
I20260709 13:16:16.452119  6813 tablet_bootstrap.cc:492] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a: Bootstrap starting.
I20260709 13:16:16.454872  6814 raft_consensus.cc:359] T f48bbc412be247c59a7817c33136ceee P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.459585  6814 raft_consensus.cc:385] T f48bbc412be247c59a7817c33136ceee P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:16.460013  6814 raft_consensus.cc:740] T f48bbc412be247c59a7817c33136ceee P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3972da3671ef401bbc841052ea9c5588, State: Initialized, Role: FOLLOWER
I20260709 13:16:16.460289  6772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0c8fb12e4e49f2927d224f188a8cc9" candidate_uuid: "7abeed0e8edf41809baa2d97c88c6b28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3972da3671ef401bbc841052ea9c5588"
I20260709 13:16:16.462397  6813 tablet_bootstrap.cc:654] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:16.462544  6588 leader_election.cc:343] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 7abeed0e8edf41809baa2d97c88c6b28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3972da3671ef401bbc841052ea9c5588 (127.27.146.131:44041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:16.462736  6814 consensus_queue.cc:260] T f48bbc412be247c59a7817c33136ceee P 3972da3671ef401bbc841052ea9c5588 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.468494  6814 ts_tablet_manager.cc:1434] T f48bbc412be247c59a7817c33136ceee P 3972da3671ef401bbc841052ea9c5588: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.002s
I20260709 13:16:16.469884  6814 tablet_bootstrap.cc:492] T 571acba5e0524805ba100b31450f461c P 3972da3671ef401bbc841052ea9c5588: Bootstrap starting.
I20260709 13:16:16.471426  6812 tablet_bootstrap.cc:492] T 99642a0c8f7941bca524315ff82e60da P 7abeed0e8edf41809baa2d97c88c6b28: No bootstrap required, opened a new log
I20260709 13:16:16.472322  6812 ts_tablet_manager.cc:1403] T 99642a0c8f7941bca524315ff82e60da P 7abeed0e8edf41809baa2d97c88c6b28: Time spent bootstrapping tablet: real 0.066s	user 0.027s	sys 0.027s
I20260709 13:16:16.465339  6818 leader_election.cc:290] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 7abeed0e8edf41809baa2d97c88c6b28 [CANDIDATE]: Term 1 election: Requested vote from peers d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419), 3972da3671ef401bbc841052ea9c5588 (127.27.146.131:44041)
I20260709 13:16:16.477783  6812 raft_consensus.cc:359] T 99642a0c8f7941bca524315ff82e60da P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.479100  6812 raft_consensus.cc:385] T 99642a0c8f7941bca524315ff82e60da P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:16.479583  6812 raft_consensus.cc:740] T 99642a0c8f7941bca524315ff82e60da P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7abeed0e8edf41809baa2d97c88c6b28, State: Initialized, Role: FOLLOWER
I20260709 13:16:16.481319  6814 tablet_bootstrap.cc:654] T 571acba5e0524805ba100b31450f461c P 3972da3671ef401bbc841052ea9c5588: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:16.480784  6812 consensus_queue.cc:260] T 99642a0c8f7941bca524315ff82e60da P 7abeed0e8edf41809baa2d97c88c6b28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.484198  6812 ts_tablet_manager.cc:1434] T 99642a0c8f7941bca524315ff82e60da P 7abeed0e8edf41809baa2d97c88c6b28: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:16:16.485550  6812 tablet_bootstrap.cc:492] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 7abeed0e8edf41809baa2d97c88c6b28: Bootstrap starting.
W20260709 13:16:16.486811  6587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:35419, user_credentials={real_user=slave}} blocked reactor thread for 83876.9us
I20260709 13:16:16.488866  6813 tablet_bootstrap.cc:492] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a: No bootstrap required, opened a new log
I20260709 13:16:16.491410  6813 ts_tablet_manager.cc:1403] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.004s
I20260709 13:16:16.492307  6812 tablet_bootstrap.cc:654] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 7abeed0e8edf41809baa2d97c88c6b28: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:16.493121  6698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0c8fb12e4e49f2927d224f188a8cc9" candidate_uuid: "7abeed0e8edf41809baa2d97c88c6b28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
I20260709 13:16:16.493803  6698 raft_consensus.cc:3060] T 4e0c8fb12e4e49f2927d224f188a8cc9 P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:16.495811  6813 raft_consensus.cc:359] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.496984  6813 raft_consensus.cc:385] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:16.497386  6813 raft_consensus.cc:740] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8632beb9efb4ce4a1d87e0c854b639a, State: Initialized, Role: FOLLOWER
I20260709 13:16:16.498647  6813 consensus_queue.cc:260] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.504238  6812 tablet_bootstrap.cc:492] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 7abeed0e8edf41809baa2d97c88c6b28: No bootstrap required, opened a new log
I20260709 13:16:16.504846  6812 ts_tablet_manager.cc:1403] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 7abeed0e8edf41809baa2d97c88c6b28: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.003s
I20260709 13:16:16.503341  6698 raft_consensus.cc:2468] T 4e0c8fb12e4e49f2927d224f188a8cc9 P d8632beb9efb4ce4a1d87e0c854b639a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7abeed0e8edf41809baa2d97c88c6b28 in term 1.
I20260709 13:16:16.506896  6587 leader_election.cc:304] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 7abeed0e8edf41809baa2d97c88c6b28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7abeed0e8edf41809baa2d97c88c6b28, d8632beb9efb4ce4a1d87e0c854b639a; no voters: 3972da3671ef401bbc841052ea9c5588
I20260709 13:16:16.507963  6827 raft_consensus.cc:2804] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:16.508482  6827 raft_consensus.cc:697] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 LEADER]: Becoming Leader. State: Replica: 7abeed0e8edf41809baa2d97c88c6b28, State: Running, Role: LEADER
I20260709 13:16:16.509091  6812 raft_consensus.cc:359] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.509339  6827 consensus_queue.cc:237] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 7abeed0e8edf41809baa2d97c88c6b28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.509989  6812 raft_consensus.cc:385] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:16.510489  6812 raft_consensus.cc:740] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7abeed0e8edf41809baa2d97c88c6b28, State: Initialized, Role: FOLLOWER
I20260709 13:16:16.511277  6812 consensus_queue.cc:260] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 7abeed0e8edf41809baa2d97c88c6b28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.514287  6812 ts_tablet_manager.cc:1434] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 7abeed0e8edf41809baa2d97c88c6b28: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:16:16.515486  6812 tablet_bootstrap.cc:492] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28: Bootstrap starting.
I20260709 13:16:16.517529  6819 raft_consensus.cc:493] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.518159  6819 raft_consensus.cc:515] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.518409  6814 tablet_bootstrap.cc:492] T 571acba5e0524805ba100b31450f461c P 3972da3671ef401bbc841052ea9c5588: No bootstrap required, opened a new log
I20260709 13:16:16.519059  6814 ts_tablet_manager.cc:1403] T 571acba5e0524805ba100b31450f461c P 3972da3671ef401bbc841052ea9c5588: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.022s
I20260709 13:16:16.522377  6814 raft_consensus.cc:359] T 571acba5e0524805ba100b31450f461c P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.523156  6812 tablet_bootstrap.cc:654] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:16.523334  6814 raft_consensus.cc:385] T 571acba5e0524805ba100b31450f461c P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:16.523711  6814 raft_consensus.cc:740] T 571acba5e0524805ba100b31450f461c P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3972da3671ef401bbc841052ea9c5588, State: Initialized, Role: FOLLOWER
I20260709 13:16:16.524698  6814 consensus_queue.cc:260] T 571acba5e0524805ba100b31450f461c P 3972da3671ef401bbc841052ea9c5588 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.526950  6814 ts_tablet_manager.cc:1434] T 571acba5e0524805ba100b31450f461c P 3972da3671ef401bbc841052ea9c5588: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:16:16.528043  6814 tablet_bootstrap.cc:492] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 3972da3671ef401bbc841052ea9c5588: Bootstrap starting.
I20260709 13:16:16.514652  6813 ts_tablet_manager.cc:1434] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 13:16:16.534695  6813 tablet_bootstrap.cc:492] T 1b9d55b78dd94bbba5df1f481b3e8c5c P d8632beb9efb4ce4a1d87e0c854b639a: Bootstrap starting.
I20260709 13:16:16.537012  6814 tablet_bootstrap.cc:654] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 3972da3671ef401bbc841052ea9c5588: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:16.539510  6819 leader_election.cc:290] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447), 3972da3671ef401bbc841052ea9c5588 (127.27.146.131:44041)
I20260709 13:16:16.550766  6814 tablet_bootstrap.cc:492] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 3972da3671ef401bbc841052ea9c5588: No bootstrap required, opened a new log
I20260709 13:16:16.551664  6814 ts_tablet_manager.cc:1403] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 3972da3671ef401bbc841052ea9c5588: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.005s
I20260709 13:16:16.555555  6814 raft_consensus.cc:359] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.556576  6814 raft_consensus.cc:385] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:16.556964  6814 raft_consensus.cc:740] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3972da3671ef401bbc841052ea9c5588, State: Initialized, Role: FOLLOWER
I20260709 13:16:16.558651  6813 tablet_bootstrap.cc:654] T 1b9d55b78dd94bbba5df1f481b3e8c5c P d8632beb9efb4ce4a1d87e0c854b639a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:16.558125  6814 consensus_queue.cc:260] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 3972da3671ef401bbc841052ea9c5588 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.567433  6814 ts_tablet_manager.cc:1434] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 3972da3671ef401bbc841052ea9c5588: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:16:16.569000  6814 tablet_bootstrap.cc:492] T 99642a0c8f7941bca524315ff82e60da P 3972da3671ef401bbc841052ea9c5588: Bootstrap starting.
I20260709 13:16:16.577641  6814 tablet_bootstrap.cc:654] T 99642a0c8f7941bca524315ff82e60da P 3972da3671ef401bbc841052ea9c5588: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:16.589335  6520 catalog_manager.cc:5697] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 7abeed0e8edf41809baa2d97c88c6b28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "7abeed0e8edf41809baa2d97c88c6b28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:16.591410  6821 raft_consensus.cc:493] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.592237  6821 raft_consensus.cc:515] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.598326  6821 leader_election.cc:290] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447), d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419)
I20260709 13:16:16.603091  6813 tablet_bootstrap.cc:492] T 1b9d55b78dd94bbba5df1f481b3e8c5c P d8632beb9efb4ce4a1d87e0c854b639a: No bootstrap required, opened a new log
I20260709 13:16:16.604056  6813 ts_tablet_manager.cc:1403] T 1b9d55b78dd94bbba5df1f481b3e8c5c P d8632beb9efb4ce4a1d87e0c854b639a: Time spent bootstrapping tablet: real 0.070s	user 0.022s	sys 0.000s
I20260709 13:16:16.612591  6814 tablet_bootstrap.cc:492] T 99642a0c8f7941bca524315ff82e60da P 3972da3671ef401bbc841052ea9c5588: No bootstrap required, opened a new log
I20260709 13:16:16.612815  6812 tablet_bootstrap.cc:492] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28: No bootstrap required, opened a new log
I20260709 13:16:16.613566  6814 ts_tablet_manager.cc:1403] T 99642a0c8f7941bca524315ff82e60da P 3972da3671ef401bbc841052ea9c5588: Time spent bootstrapping tablet: real 0.045s	user 0.012s	sys 0.013s
I20260709 13:16:16.613404  6772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43d643af6d3248da8abe7e13fd887cc1" candidate_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3972da3671ef401bbc841052ea9c5588" is_pre_election: true
I20260709 13:16:16.613777  6812 ts_tablet_manager.cc:1403] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28: Time spent bootstrapping tablet: real 0.099s	user 0.028s	sys 0.051s
W20260709 13:16:16.615631  6663 leader_election.cc:343] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3972da3671ef401bbc841052ea9c5588 (127.27.146.131:44041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:16.616642  6827 raft_consensus.cc:493] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.617233  6827 raft_consensus.cc:515] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.617574  6814 raft_consensus.cc:359] T 99642a0c8f7941bca524315ff82e60da P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.618541  6814 raft_consensus.cc:385] T 99642a0c8f7941bca524315ff82e60da P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:16.618810  6812 raft_consensus.cc:359] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.619977  6827 leader_election.cc:290] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419), 3972da3671ef401bbc841052ea9c5588 (127.27.146.131:44041)
I20260709 13:16:16.618889  6814 raft_consensus.cc:740] T 99642a0c8f7941bca524315ff82e60da P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3972da3671ef401bbc841052ea9c5588, State: Initialized, Role: FOLLOWER
I20260709 13:16:16.621170  6813 raft_consensus.cc:359] T 1b9d55b78dd94bbba5df1f481b3e8c5c P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.621335  6772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47dc18fd364c4b079b99900a766e3208" candidate_uuid: "7abeed0e8edf41809baa2d97c88c6b28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3972da3671ef401bbc841052ea9c5588" is_pre_election: true
I20260709 13:16:16.625613  6813 raft_consensus.cc:385] T 1b9d55b78dd94bbba5df1f481b3e8c5c P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:16.625787  6772 raft_consensus.cc:2468] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7abeed0e8edf41809baa2d97c88c6b28 in term 0.
I20260709 13:16:16.626102  6813 raft_consensus.cc:740] T 1b9d55b78dd94bbba5df1f481b3e8c5c P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8632beb9efb4ce4a1d87e0c854b639a, State: Initialized, Role: FOLLOWER
I20260709 13:16:16.627344  6588 leader_election.cc:304] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3972da3671ef401bbc841052ea9c5588, 7abeed0e8edf41809baa2d97c88c6b28; no voters: 
I20260709 13:16:16.627374  6813 consensus_queue.cc:260] T 1b9d55b78dd94bbba5df1f481b3e8c5c P d8632beb9efb4ce4a1d87e0c854b639a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.629081  6827 raft_consensus.cc:2804] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:16.629534  6827 raft_consensus.cc:493] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.629899  6827 raft_consensus.cc:3060] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:16.621325  6814 consensus_queue.cc:260] T 99642a0c8f7941bca524315ff82e60da P 3972da3671ef401bbc841052ea9c5588 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.620033  6812 raft_consensus.cc:385] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:16.622370  6698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47dc18fd364c4b079b99900a766e3208" candidate_uuid: "7abeed0e8edf41809baa2d97c88c6b28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" is_pre_election: true
I20260709 13:16:16.624166  6623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43d643af6d3248da8abe7e13fd887cc1" candidate_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7abeed0e8edf41809baa2d97c88c6b28" is_pre_election: true
I20260709 13:16:16.632567  6814 ts_tablet_manager.cc:1434] T 99642a0c8f7941bca524315ff82e60da P 3972da3671ef401bbc841052ea9c5588: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.004s
W20260709 13:16:16.633373  6587 leader_election.cc:343] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:16.633690  6814 tablet_bootstrap.cc:492] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588: Bootstrap starting.
W20260709 13:16:16.634728  6662 leader_election.cc:343] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:16.635342  6662 leader_election.cc:304] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d8632beb9efb4ce4a1d87e0c854b639a; no voters: 3972da3671ef401bbc841052ea9c5588, 7abeed0e8edf41809baa2d97c88c6b28
I20260709 13:16:16.636435  6812 raft_consensus.cc:740] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7abeed0e8edf41809baa2d97c88c6b28, State: Initialized, Role: FOLLOWER
I20260709 13:16:16.637333  6812 consensus_queue.cc:260] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.640107  6812 ts_tablet_manager.cc:1434] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 13:16:16.641255  6812 tablet_bootstrap.cc:492] T f48bbc412be247c59a7817c33136ceee P 7abeed0e8edf41809baa2d97c88c6b28: Bootstrap starting.
I20260709 13:16:16.639899  6819 raft_consensus.cc:2749] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:16.643714  6623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0c8fb12e4e49f2927d224f188a8cc9" candidate_uuid: "3972da3671ef401bbc841052ea9c5588" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7abeed0e8edf41809baa2d97c88c6b28" is_pre_election: true
I20260709 13:16:16.644982  6827 raft_consensus.cc:515] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.646183  6813 ts_tablet_manager.cc:1434] T 1b9d55b78dd94bbba5df1f481b3e8c5c P d8632beb9efb4ce4a1d87e0c854b639a: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.001s
I20260709 13:16:16.647351  6814 tablet_bootstrap.cc:654] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:16.647472  6813 tablet_bootstrap.cc:492] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a: Bootstrap starting.
I20260709 13:16:16.648420  6698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47dc18fd364c4b079b99900a766e3208" candidate_uuid: "7abeed0e8edf41809baa2d97c88c6b28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
W20260709 13:16:16.650420  6587 leader_election.cc:343] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:16.651719  6698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0c8fb12e4e49f2927d224f188a8cc9" candidate_uuid: "3972da3671ef401bbc841052ea9c5588" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" is_pre_election: true
I20260709 13:16:16.652886  6698 raft_consensus.cc:2393] T 4e0c8fb12e4e49f2927d224f188a8cc9 P d8632beb9efb4ce4a1d87e0c854b639a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3972da3671ef401bbc841052ea9c5588 in current term 1: Already voted for candidate 7abeed0e8edf41809baa2d97c88c6b28 in this term.
I20260709 13:16:16.654716  6736 leader_election.cc:304] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3972da3671ef401bbc841052ea9c5588; no voters: 7abeed0e8edf41809baa2d97c88c6b28, d8632beb9efb4ce4a1d87e0c854b639a
I20260709 13:16:16.655762  6821 raft_consensus.cc:3060] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:16.657186  6827 leader_election.cc:290] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28 [CANDIDATE]: Term 1 election: Requested vote from peers d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419), 3972da3671ef401bbc841052ea9c5588 (127.27.146.131:44041)
I20260709 13:16:16.658543  6813 tablet_bootstrap.cc:654] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:16.658391  6772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47dc18fd364c4b079b99900a766e3208" candidate_uuid: "7abeed0e8edf41809baa2d97c88c6b28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3972da3671ef401bbc841052ea9c5588"
I20260709 13:16:16.659468  6772 raft_consensus.cc:3060] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:16.660746  6812 tablet_bootstrap.cc:654] T f48bbc412be247c59a7817c33136ceee P 7abeed0e8edf41809baa2d97c88c6b28: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:16.666832  6821 raft_consensus.cc:2749] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:16.671576  6772 raft_consensus.cc:2468] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7abeed0e8edf41809baa2d97c88c6b28 in term 1.
I20260709 13:16:16.673696  6588 leader_election.cc:304] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3972da3671ef401bbc841052ea9c5588, 7abeed0e8edf41809baa2d97c88c6b28; no voters: d8632beb9efb4ce4a1d87e0c854b639a
I20260709 13:16:16.676440  6827 raft_consensus.cc:2804] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:16.677136  6827 raft_consensus.cc:697] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 LEADER]: Becoming Leader. State: Replica: 7abeed0e8edf41809baa2d97c88c6b28, State: Running, Role: LEADER
I20260709 13:16:16.678030  6827 consensus_queue.cc:237] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.681784  6814 tablet_bootstrap.cc:492] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588: No bootstrap required, opened a new log
I20260709 13:16:16.682770  6814 ts_tablet_manager.cc:1403] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.010s
I20260709 13:16:16.688007  6814 raft_consensus.cc:359] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.688645  6821 raft_consensus.cc:493] T 99642a0c8f7941bca524315ff82e60da P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.689121  6814 raft_consensus.cc:385] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:16.689538  6814 raft_consensus.cc:740] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3972da3671ef401bbc841052ea9c5588, State: Initialized, Role: FOLLOWER
I20260709 13:16:16.690690  6814 consensus_queue.cc:260] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.689257  6821 raft_consensus.cc:515] T 99642a0c8f7941bca524315ff82e60da P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.691901  6812 tablet_bootstrap.cc:492] T f48bbc412be247c59a7817c33136ceee P 7abeed0e8edf41809baa2d97c88c6b28: No bootstrap required, opened a new log
I20260709 13:16:16.696949  6812 ts_tablet_manager.cc:1403] T f48bbc412be247c59a7817c33136ceee P 7abeed0e8edf41809baa2d97c88c6b28: Time spent bootstrapping tablet: real 0.056s	user 0.026s	sys 0.010s
I20260709 13:16:16.699235  6623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99642a0c8f7941bca524315ff82e60da" candidate_uuid: "3972da3671ef401bbc841052ea9c5588" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7abeed0e8edf41809baa2d97c88c6b28" is_pre_election: true
I20260709 13:16:16.700325  6623 raft_consensus.cc:2468] T 99642a0c8f7941bca524315ff82e60da P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3972da3671ef401bbc841052ea9c5588 in term 0.
I20260709 13:16:16.703028  6698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99642a0c8f7941bca524315ff82e60da" candidate_uuid: "3972da3671ef401bbc841052ea9c5588" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" is_pre_election: true
I20260709 13:16:16.703305  6736 leader_election.cc:304] T 99642a0c8f7941bca524315ff82e60da P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3972da3671ef401bbc841052ea9c5588, 7abeed0e8edf41809baa2d97c88c6b28; no voters: 
I20260709 13:16:16.705075  6821 leader_election.cc:290] T 99642a0c8f7941bca524315ff82e60da P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447), d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419)
I20260709 13:16:16.709406  6821 raft_consensus.cc:2804] T 99642a0c8f7941bca524315ff82e60da P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:16.710049  6821 raft_consensus.cc:493] T 99642a0c8f7941bca524315ff82e60da P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.708278  6518 catalog_manager.cc:5697] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "7abeed0e8edf41809baa2d97c88c6b28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:16.712349  6812 raft_consensus.cc:359] T f48bbc412be247c59a7817c33136ceee P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.713559  6812 raft_consensus.cc:385] T f48bbc412be247c59a7817c33136ceee P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:16.713963  6812 raft_consensus.cc:740] T f48bbc412be247c59a7817c33136ceee P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7abeed0e8edf41809baa2d97c88c6b28, State: Initialized, Role: FOLLOWER
I20260709 13:16:16.715127  6821 raft_consensus.cc:3060] T 99642a0c8f7941bca524315ff82e60da P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:16.729475  6813 tablet_bootstrap.cc:492] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a: No bootstrap required, opened a new log
I20260709 13:16:16.730126  6813 ts_tablet_manager.cc:1403] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a: Time spent bootstrapping tablet: real 0.083s	user 0.024s	sys 0.029s
W20260709 13:16:16.731703  6736 leader_election.cc:343] T 99642a0c8f7941bca524315ff82e60da P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:16.732708  6812 consensus_queue.cc:260] T f48bbc412be247c59a7817c33136ceee P 7abeed0e8edf41809baa2d97c88c6b28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.733389  6813 raft_consensus.cc:359] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.733914  6814 ts_tablet_manager.cc:1434] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588: Time spent starting tablet: real 0.051s	user 0.014s	sys 0.033s
I20260709 13:16:16.734269  6813 raft_consensus.cc:385] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:16.734647  6813 raft_consensus.cc:740] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8632beb9efb4ce4a1d87e0c854b639a, State: Initialized, Role: FOLLOWER
I20260709 13:16:16.735356  6814 tablet_bootstrap.cc:492] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588: Bootstrap starting.
I20260709 13:16:16.735529  6813 consensus_queue.cc:260] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.738957  6812 ts_tablet_manager.cc:1434] T f48bbc412be247c59a7817c33136ceee P 7abeed0e8edf41809baa2d97c88c6b28: Time spent starting tablet: real 0.041s	user 0.010s	sys 0.001s
I20260709 13:16:16.740485  6812 tablet_bootstrap.cc:492] T ef0cd7434a044f94a030340fabe9f8fc P 7abeed0e8edf41809baa2d97c88c6b28: Bootstrap starting.
I20260709 13:16:16.741392  6813 ts_tablet_manager.cc:1434] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:16:16.742616  6813 tablet_bootstrap.cc:492] T f48bbc412be247c59a7817c33136ceee P d8632beb9efb4ce4a1d87e0c854b639a: Bootstrap starting.
I20260709 13:16:16.743289  6814 tablet_bootstrap.cc:654] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:16.749148  6852 raft_consensus.cc:493] T f48bbc412be247c59a7817c33136ceee P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.749881  6852 raft_consensus.cc:515] T f48bbc412be247c59a7817c33136ceee P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.752614  6852 leader_election.cc:290] T f48bbc412be247c59a7817c33136ceee P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447), d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419)
I20260709 13:16:16.754791  6813 tablet_bootstrap.cc:654] T f48bbc412be247c59a7817c33136ceee P d8632beb9efb4ce4a1d87e0c854b639a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:16.757035  6623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48bbc412be247c59a7817c33136ceee" candidate_uuid: "3972da3671ef401bbc841052ea9c5588" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7abeed0e8edf41809baa2d97c88c6b28" is_pre_election: true
I20260709 13:16:16.763160  6623 raft_consensus.cc:2468] T f48bbc412be247c59a7817c33136ceee P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3972da3671ef401bbc841052ea9c5588 in term 0.
I20260709 13:16:16.756524  6821 raft_consensus.cc:515] T 99642a0c8f7941bca524315ff82e60da P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.767429  6821 leader_election.cc:290] T 99642a0c8f7941bca524315ff82e60da P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 1 election: Requested vote from peers 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447), d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419)
I20260709 13:16:16.759827  6812 tablet_bootstrap.cc:654] T ef0cd7434a044f94a030340fabe9f8fc P 7abeed0e8edf41809baa2d97c88c6b28: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:16.771662  6821 raft_consensus.cc:493] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.772305  6821 raft_consensus.cc:515] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.774266  6813 tablet_bootstrap.cc:492] T f48bbc412be247c59a7817c33136ceee P d8632beb9efb4ce4a1d87e0c854b639a: No bootstrap required, opened a new log
I20260709 13:16:16.774863  6813 ts_tablet_manager.cc:1403] T f48bbc412be247c59a7817c33136ceee P d8632beb9efb4ce4a1d87e0c854b639a: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.004s
I20260709 13:16:16.775552  6821 leader_election.cc:290] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447), d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419)
I20260709 13:16:16.778798  6813 raft_consensus.cc:359] T f48bbc412be247c59a7817c33136ceee P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.779942  6813 raft_consensus.cc:385] T f48bbc412be247c59a7817c33136ceee P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:16.780341  6813 raft_consensus.cc:740] T f48bbc412be247c59a7817c33136ceee P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8632beb9efb4ce4a1d87e0c854b639a, State: Initialized, Role: FOLLOWER
I20260709 13:16:16.781128  6827 raft_consensus.cc:493] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.781539  6813 consensus_queue.cc:260] T f48bbc412be247c59a7817c33136ceee P d8632beb9efb4ce4a1d87e0c854b639a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.782301  6827 raft_consensus.cc:515] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.788379  6827 leader_election.cc:290] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 7abeed0e8edf41809baa2d97c88c6b28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419), 3972da3671ef401bbc841052ea9c5588 (127.27.146.131:44041)
I20260709 13:16:16.788695  6772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9d55b78dd94bbba5df1f481b3e8c5c" candidate_uuid: "7abeed0e8edf41809baa2d97c88c6b28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3972da3671ef401bbc841052ea9c5588" is_pre_election: true
I20260709 13:16:16.789557  6772 raft_consensus.cc:2468] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7abeed0e8edf41809baa2d97c88c6b28 in term 0.
I20260709 13:16:16.790426  6698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9d55b78dd94bbba5df1f481b3e8c5c" candidate_uuid: "7abeed0e8edf41809baa2d97c88c6b28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" is_pre_election: true
I20260709 13:16:16.791126  6588 leader_election.cc:304] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 7abeed0e8edf41809baa2d97c88c6b28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3972da3671ef401bbc841052ea9c5588, 7abeed0e8edf41809baa2d97c88c6b28; no voters: 
I20260709 13:16:16.791283  6698 raft_consensus.cc:2468] T 1b9d55b78dd94bbba5df1f481b3e8c5c P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7abeed0e8edf41809baa2d97c88c6b28 in term 0.
I20260709 13:16:16.794885  6813 ts_tablet_manager.cc:1434] T f48bbc412be247c59a7817c33136ceee P d8632beb9efb4ce4a1d87e0c854b639a: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.001s
I20260709 13:16:16.795046  6827 raft_consensus.cc:2804] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:16.795956  6827 raft_consensus.cc:493] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.796483  6827 raft_consensus.cc:3060] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:16.798439  6812 tablet_bootstrap.cc:492] T ef0cd7434a044f94a030340fabe9f8fc P 7abeed0e8edf41809baa2d97c88c6b28: No bootstrap required, opened a new log
I20260709 13:16:16.799082  6812 ts_tablet_manager.cc:1403] T ef0cd7434a044f94a030340fabe9f8fc P 7abeed0e8edf41809baa2d97c88c6b28: Time spent bootstrapping tablet: real 0.059s	user 0.018s	sys 0.016s
I20260709 13:16:16.800729  6813 tablet_bootstrap.cc:492] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a: Bootstrap starting.
I20260709 13:16:16.800746  6818 raft_consensus.cc:493] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.801728  6818 raft_consensus.cc:515] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.802228  6812 raft_consensus.cc:359] T ef0cd7434a044f94a030340fabe9f8fc P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.803263  6812 raft_consensus.cc:385] T ef0cd7434a044f94a030340fabe9f8fc P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:16.803637  6812 raft_consensus.cc:740] T ef0cd7434a044f94a030340fabe9f8fc P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7abeed0e8edf41809baa2d97c88c6b28, State: Initialized, Role: FOLLOWER
I20260709 13:16:16.804443  6812 consensus_queue.cc:260] T ef0cd7434a044f94a030340fabe9f8fc P 7abeed0e8edf41809baa2d97c88c6b28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.808837  6813 tablet_bootstrap.cc:654] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:16.810588  6818 leader_election.cc:290] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419), 3972da3671ef401bbc841052ea9c5588 (127.27.146.131:44041)
I20260709 13:16:16.810791  6772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31789365471247b58419c92a028a9afc" candidate_uuid: "7abeed0e8edf41809baa2d97c88c6b28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3972da3671ef401bbc841052ea9c5588" is_pre_election: true
W20260709 13:16:16.812526  6588 leader_election.cc:343] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3972da3671ef401bbc841052ea9c5588 (127.27.146.131:44041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:16.812891  6698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31789365471247b58419c92a028a9afc" candidate_uuid: "7abeed0e8edf41809baa2d97c88c6b28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" is_pre_election: true
I20260709 13:16:16.813808  6698 raft_consensus.cc:2468] T 31789365471247b58419c92a028a9afc P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7abeed0e8edf41809baa2d97c88c6b28 in term 0.
I20260709 13:16:16.815331  6821 raft_consensus.cc:493] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.816143  6821 raft_consensus.cc:515] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.816102  6587 leader_election.cc:304] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7abeed0e8edf41809baa2d97c88c6b28, d8632beb9efb4ce4a1d87e0c854b639a; no voters: 3972da3671ef401bbc841052ea9c5588
I20260709 13:16:16.819361  6821 leader_election.cc:290] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447), d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419)
I20260709 13:16:16.823902  6818 raft_consensus.cc:2804] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:16.824536  6818 raft_consensus.cc:493] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.825006  6818 raft_consensus.cc:3060] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:16.825291  6813 tablet_bootstrap.cc:492] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a: No bootstrap required, opened a new log
I20260709 13:16:16.826350  6813 ts_tablet_manager.cc:1403] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.005s
I20260709 13:16:16.831105  6813 raft_consensus.cc:359] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.832414  6813 raft_consensus.cc:385] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:16.833082  6813 raft_consensus.cc:740] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8632beb9efb4ce4a1d87e0c854b639a, State: Initialized, Role: FOLLOWER
I20260709 13:16:16.834438  6813 consensus_queue.cc:260] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.834821  6698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48bbc412be247c59a7817c33136ceee" candidate_uuid: "3972da3671ef401bbc841052ea9c5588" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" is_pre_election: true
I20260709 13:16:16.836110  6698 raft_consensus.cc:2468] T f48bbc412be247c59a7817c33136ceee P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3972da3671ef401bbc841052ea9c5588 in term 0.
I20260709 13:16:16.838608  6698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99642a0c8f7941bca524315ff82e60da" candidate_uuid: "3972da3671ef401bbc841052ea9c5588" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
I20260709 13:16:16.840229  6813 ts_tablet_manager.cc:1434] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:16:16.841430  6623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99642a0c8f7941bca524315ff82e60da" candidate_uuid: "3972da3671ef401bbc841052ea9c5588" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7abeed0e8edf41809baa2d97c88c6b28"
I20260709 13:16:16.842099  6623 raft_consensus.cc:3060] T 99642a0c8f7941bca524315ff82e60da P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:16.845726  6813 tablet_bootstrap.cc:492] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a: Bootstrap starting.
I20260709 13:16:16.852087  6623 raft_consensus.cc:2468] T 99642a0c8f7941bca524315ff82e60da P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3972da3671ef401bbc841052ea9c5588 in term 1.
I20260709 13:16:16.856104  6819 raft_consensus.cc:493] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.856840  6819 raft_consensus.cc:515] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.857544  6698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9d55b78dd94bbba5df1f481b3e8c5c" candidate_uuid: "3972da3671ef401bbc841052ea9c5588" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" is_pre_election: true
I20260709 13:16:16.858203  6622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9d55b78dd94bbba5df1f481b3e8c5c" candidate_uuid: "3972da3671ef401bbc841052ea9c5588" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7abeed0e8edf41809baa2d97c88c6b28" is_pre_election: true
I20260709 13:16:16.858353  6698 raft_consensus.cc:2468] T 1b9d55b78dd94bbba5df1f481b3e8c5c P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3972da3671ef401bbc841052ea9c5588 in term 0.
I20260709 13:16:16.861052  6736 leader_election.cc:304] T f48bbc412be247c59a7817c33136ceee P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3972da3671ef401bbc841052ea9c5588, 7abeed0e8edf41809baa2d97c88c6b28; no voters: 
I20260709 13:16:16.862607  6698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef0cd7434a044f94a030340fabe9f8fc" candidate_uuid: "3972da3671ef401bbc841052ea9c5588" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" is_pre_election: true
I20260709 13:16:16.863252  6772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "571acba5e0524805ba100b31450f461c" candidate_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3972da3671ef401bbc841052ea9c5588" is_pre_election: true
I20260709 13:16:16.864637  6772 raft_consensus.cc:2468] T 571acba5e0524805ba100b31450f461c P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8632beb9efb4ce4a1d87e0c854b639a in term 0.
I20260709 13:16:16.867484  6663 leader_election.cc:304] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3972da3671ef401bbc841052ea9c5588, d8632beb9efb4ce4a1d87e0c854b639a; no voters: 
I20260709 13:16:16.869222  6819 leader_election.cc:290] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447), 3972da3671ef401bbc841052ea9c5588 (127.27.146.131:44041)
I20260709 13:16:16.870014  6859 raft_consensus.cc:2804] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:16.870474  6859 raft_consensus.cc:493] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.870855  6859 raft_consensus.cc:3060] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:16.871933  6821 raft_consensus.cc:2804] T f48bbc412be247c59a7817c33136ceee P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:16.872551  6821 raft_consensus.cc:493] T f48bbc412be247c59a7817c33136ceee P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.873006  6821 raft_consensus.cc:3060] T f48bbc412be247c59a7817c33136ceee P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:16.878142  6736 leader_election.cc:304] T 99642a0c8f7941bca524315ff82e60da P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3972da3671ef401bbc841052ea9c5588, 7abeed0e8edf41809baa2d97c88c6b28; no voters: 
I20260709 13:16:16.880030  6623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "571acba5e0524805ba100b31450f461c" candidate_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7abeed0e8edf41809baa2d97c88c6b28" is_pre_election: true
I20260709 13:16:16.882473  6813 tablet_bootstrap.cc:654] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:16.882728  6623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef0cd7434a044f94a030340fabe9f8fc" candidate_uuid: "3972da3671ef401bbc841052ea9c5588" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7abeed0e8edf41809baa2d97c88c6b28" is_pre_election: true
I20260709 13:16:16.883821  6623 raft_consensus.cc:2468] T ef0cd7434a044f94a030340fabe9f8fc P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3972da3671ef401bbc841052ea9c5588 in term 0.
W20260709 13:16:16.885568  6662 leader_election.cc:343] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:16.893388  6859 raft_consensus.cc:515] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.895713  6813 tablet_bootstrap.cc:492] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a: No bootstrap required, opened a new log
I20260709 13:16:16.896456  6813 ts_tablet_manager.cc:1403] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a: Time spent bootstrapping tablet: real 0.055s	user 0.017s	sys 0.003s
I20260709 13:16:16.896984  6623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "571acba5e0524805ba100b31450f461c" candidate_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7abeed0e8edf41809baa2d97c88c6b28"
I20260709 13:16:16.899967  6852 raft_consensus.cc:2804] T 99642a0c8f7941bca524315ff82e60da P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:16.900789  6852 raft_consensus.cc:697] T 99642a0c8f7941bca524315ff82e60da P 3972da3671ef401bbc841052ea9c5588 [term 1 LEADER]: Becoming Leader. State: Replica: 3972da3671ef401bbc841052ea9c5588, State: Running, Role: LEADER
W20260709 13:16:16.901129  6662 leader_election.cc:343] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:16.901038  6813 raft_consensus.cc:359] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.902086  6813 raft_consensus.cc:385] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:16.902009  6852 consensus_queue.cc:237] T 99642a0c8f7941bca524315ff82e60da P 3972da3671ef401bbc841052ea9c5588 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.902760  6813 raft_consensus.cc:740] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8632beb9efb4ce4a1d87e0c854b639a, State: Initialized, Role: FOLLOWER
I20260709 13:16:16.904838  6813 consensus_queue.cc:260] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.906666  6859 leader_election.cc:290] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 1 election: Requested vote from peers 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447), 3972da3671ef401bbc841052ea9c5588 (127.27.146.131:44041)
I20260709 13:16:16.910247  6772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "571acba5e0524805ba100b31450f461c" candidate_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3972da3671ef401bbc841052ea9c5588"
I20260709 13:16:16.911152  6772 raft_consensus.cc:3060] T 571acba5e0524805ba100b31450f461c P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:16.914026  6813 ts_tablet_manager.cc:1434] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 13:16:16.915962  6813 tablet_bootstrap.cc:492] T 99642a0c8f7941bca524315ff82e60da P d8632beb9efb4ce4a1d87e0c854b639a: Bootstrap starting.
I20260709 13:16:16.922991  6772 raft_consensus.cc:2468] T 571acba5e0524805ba100b31450f461c P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8632beb9efb4ce4a1d87e0c854b639a in term 1.
I20260709 13:16:16.925195  6813 tablet_bootstrap.cc:654] T 99642a0c8f7941bca524315ff82e60da P d8632beb9efb4ce4a1d87e0c854b639a: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:16.929682  6663 leader_election.cc:304] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3972da3671ef401bbc841052ea9c5588, d8632beb9efb4ce4a1d87e0c854b639a; no voters: 7abeed0e8edf41809baa2d97c88c6b28
I20260709 13:16:16.931175  6859 raft_consensus.cc:2804] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:16:16.910149  6736 leader_election.cc:343] T 99642a0c8f7941bca524315ff82e60da P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:16.931784  6859 raft_consensus.cc:697] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a [term 1 LEADER]: Becoming Leader. State: Replica: d8632beb9efb4ce4a1d87e0c854b639a, State: Running, Role: LEADER
I20260709 13:16:16.933009  6736 leader_election.cc:304] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3972da3671ef401bbc841052ea9c5588, d8632beb9efb4ce4a1d87e0c854b639a; no voters: 
I20260709 13:16:16.932859  6859 consensus_queue.cc:237] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.938103  6852 raft_consensus.cc:2804] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:16.938620  6852 raft_consensus.cc:493] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.939031  6852 raft_consensus.cc:3060] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:16.947659  6736 leader_election.cc:343] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:16.949059  6736 leader_election.cc:304] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3972da3671ef401bbc841052ea9c5588, 7abeed0e8edf41809baa2d97c88c6b28; no voters: d8632beb9efb4ce4a1d87e0c854b639a
I20260709 13:16:16.952431  6853 raft_consensus.cc:2804] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:16.953009  6853 raft_consensus.cc:493] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.953354  6853 raft_consensus.cc:3060] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:16.954937  6812 ts_tablet_manager.cc:1434] T ef0cd7434a044f94a030340fabe9f8fc P 7abeed0e8edf41809baa2d97c88c6b28: Time spent starting tablet: real 0.156s	user 0.060s	sys 0.032s
I20260709 13:16:16.956212  6812 tablet_bootstrap.cc:492] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28: Bootstrap starting.
I20260709 13:16:16.957086  6827 raft_consensus.cc:515] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.964179  6852 raft_consensus.cc:515] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.964986  6622 raft_consensus.cc:2393] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3972da3671ef401bbc841052ea9c5588 in current term 1: Already voted for candidate 7abeed0e8edf41809baa2d97c88c6b28 in this term.
I20260709 13:16:16.966172  6827 leader_election.cc:290] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 7abeed0e8edf41809baa2d97c88c6b28 [CANDIDATE]: Term 1 election: Requested vote from peers d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419), 3972da3671ef401bbc841052ea9c5588 (127.27.146.131:44041)
I20260709 13:16:16.963236  6812 tablet_bootstrap.cc:654] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:16.956118  6821 raft_consensus.cc:515] T f48bbc412be247c59a7817c33136ceee P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.968429  6772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9d55b78dd94bbba5df1f481b3e8c5c" candidate_uuid: "7abeed0e8edf41809baa2d97c88c6b28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3972da3671ef401bbc841052ea9c5588"
I20260709 13:16:16.968662  6821 leader_election.cc:290] T f48bbc412be247c59a7817c33136ceee P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 1 election: Requested vote from peers 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447), d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419)
I20260709 13:16:16.968019  6520 catalog_manager.cc:5697] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a reported cstate change: term changed from 0 to 1, leader changed from <none> to d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130). New cstate: current_term: 1 leader_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:16.955113  6818 raft_consensus.cc:515] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.969254  6772 raft_consensus.cc:2393] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7abeed0e8edf41809baa2d97c88c6b28 in current term 1: Already voted for candidate 3972da3671ef401bbc841052ea9c5588 in this term.
I20260709 13:16:16.971261  6857 raft_consensus.cc:493] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.971956  6698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9d55b78dd94bbba5df1f481b3e8c5c" candidate_uuid: "3972da3671ef401bbc841052ea9c5588" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
I20260709 13:16:16.971884  6857 raft_consensus.cc:515] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.972612  6698 raft_consensus.cc:3060] T 1b9d55b78dd94bbba5df1f481b3e8c5c P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:16.972955  6772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31789365471247b58419c92a028a9afc" candidate_uuid: "7abeed0e8edf41809baa2d97c88c6b28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3972da3671ef401bbc841052ea9c5588"
I20260709 13:16:16.953328  6814 tablet_bootstrap.cc:492] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588: No bootstrap required, opened a new log
I20260709 13:16:16.976135  6814 ts_tablet_manager.cc:1403] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588: Time spent bootstrapping tablet: real 0.241s	user 0.100s	sys 0.097s
I20260709 13:16:16.976716  6697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48bbc412be247c59a7817c33136ceee" candidate_uuid: "3972da3671ef401bbc841052ea9c5588" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
I20260709 13:16:16.977524  6697 raft_consensus.cc:3060] T f48bbc412be247c59a7817c33136ceee P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:16.962960  6853 raft_consensus.cc:515] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
W20260709 13:16:16.981389  6588 leader_election.cc:343] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3972da3671ef401bbc841052ea9c5588 (127.27.146.131:44041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:16.982231  6621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48bbc412be247c59a7817c33136ceee" candidate_uuid: "3972da3671ef401bbc841052ea9c5588" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7abeed0e8edf41809baa2d97c88c6b28"
I20260709 13:16:16.982997  6621 raft_consensus.cc:3060] T f48bbc412be247c59a7817c33136ceee P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:16.984000  6694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31789365471247b58419c92a028a9afc" candidate_uuid: "7abeed0e8edf41809baa2d97c88c6b28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
I20260709 13:16:16.986182  6694 raft_consensus.cc:3060] T 31789365471247b58419c92a028a9afc P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:16.986559  6695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9d55b78dd94bbba5df1f481b3e8c5c" candidate_uuid: "7abeed0e8edf41809baa2d97c88c6b28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
I20260709 13:16:16.982877  6772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d0a65bcc05d492e860cd9066fb0161a" candidate_uuid: "7abeed0e8edf41809baa2d97c88c6b28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3972da3671ef401bbc841052ea9c5588" is_pre_election: true
I20260709 13:16:16.988680  6693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d0a65bcc05d492e860cd9066fb0161a" candidate_uuid: "7abeed0e8edf41809baa2d97c88c6b28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" is_pre_election: true
I20260709 13:16:16.990013  6620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef0cd7434a044f94a030340fabe9f8fc" candidate_uuid: "3972da3671ef401bbc841052ea9c5588" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7abeed0e8edf41809baa2d97c88c6b28"
I20260709 13:16:16.990072  6693 raft_consensus.cc:2468] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7abeed0e8edf41809baa2d97c88c6b28 in term 0.
I20260709 13:16:16.991003  6620 raft_consensus.cc:3060] T ef0cd7434a044f94a030340fabe9f8fc P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:16.984325  6623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b9d55b78dd94bbba5df1f481b3e8c5c" candidate_uuid: "3972da3671ef401bbc841052ea9c5588" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7abeed0e8edf41809baa2d97c88c6b28"
W20260709 13:16:16.993628  6588 leader_election.cc:343] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3972da3671ef401bbc841052ea9c5588 (127.27.146.131:44041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:16.966553  6852 leader_election.cc:290] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 1 election: Requested vote from peers 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447), d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419)
I20260709 13:16:16.998610  6693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef0cd7434a044f94a030340fabe9f8fc" candidate_uuid: "3972da3671ef401bbc841052ea9c5588" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
I20260709 13:16:16.999476  6693 raft_consensus.cc:3060] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:17.005446  6827 consensus_queue.cc:1048] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 7abeed0e8edf41809baa2d97c88c6b28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:17.006839  6818 leader_election.cc:290] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28 [CANDIDATE]: Term 1 election: Requested vote from peers d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419), 3972da3671ef401bbc841052ea9c5588 (127.27.146.131:44041)
I20260709 13:16:17.009928  6587 leader_election.cc:304] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 7abeed0e8edf41809baa2d97c88c6b28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7abeed0e8edf41809baa2d97c88c6b28; no voters: 3972da3671ef401bbc841052ea9c5588, d8632beb9efb4ce4a1d87e0c854b639a
I20260709 13:16:17.011345  6694 raft_consensus.cc:2468] T 31789365471247b58419c92a028a9afc P d8632beb9efb4ce4a1d87e0c854b639a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7abeed0e8edf41809baa2d97c88c6b28 in term 1.
I20260709 13:16:17.012491  6827 raft_consensus.cc:2749] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:17.011516  6587 leader_election.cc:304] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7abeed0e8edf41809baa2d97c88c6b28, d8632beb9efb4ce4a1d87e0c854b639a; no voters: 3972da3671ef401bbc841052ea9c5588
I20260709 13:16:17.013499  6857 leader_election.cc:290] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419), 3972da3671ef401bbc841052ea9c5588 (127.27.146.131:44041)
I20260709 13:16:17.013685  6827 raft_consensus.cc:2804] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:17.014146  6853 leader_election.cc:290] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 1 election: Requested vote from peers 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447), d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419)
I20260709 13:16:17.014636  6827 raft_consensus.cc:493] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:17.015993  6693 raft_consensus.cc:2468] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3972da3671ef401bbc841052ea9c5588 in term 1.
I20260709 13:16:17.016067  6827 raft_consensus.cc:3060] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:17.017838  6736 leader_election.cc:304] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3972da3671ef401bbc841052ea9c5588, d8632beb9efb4ce4a1d87e0c854b639a; no voters: 
I20260709 13:16:17.018837  6853 raft_consensus.cc:2804] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:17.019615  6853 raft_consensus.cc:697] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [term 1 LEADER]: Becoming Leader. State: Replica: 3972da3671ef401bbc841052ea9c5588, State: Running, Role: LEADER
I20260709 13:16:17.020565  6853 consensus_queue.cc:237] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:16.979254  6814 raft_consensus.cc:359] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:17.025012  6814 raft_consensus.cc:385] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:17.025324  6814 raft_consensus.cc:740] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3972da3671ef401bbc841052ea9c5588, State: Initialized, Role: FOLLOWER
I20260709 13:16:17.026224  6814 consensus_queue.cc:260] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:17.025532  6587 leader_election.cc:304] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7abeed0e8edf41809baa2d97c88c6b28, d8632beb9efb4ce4a1d87e0c854b639a; no voters: 3972da3671ef401bbc841052ea9c5588
I20260709 13:16:17.029886  6621 raft_consensus.cc:2468] T f48bbc412be247c59a7817c33136ceee P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3972da3671ef401bbc841052ea9c5588 in term 1.
I20260709 13:16:17.030754  6857 raft_consensus.cc:2804] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:17.030153  6812 tablet_bootstrap.cc:492] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28: No bootstrap required, opened a new log
I20260709 13:16:17.032128  6736 leader_election.cc:304] T f48bbc412be247c59a7817c33136ceee P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3972da3671ef401bbc841052ea9c5588, 7abeed0e8edf41809baa2d97c88c6b28; no voters: 
I20260709 13:16:17.038522  6812 ts_tablet_manager.cc:1403] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28: Time spent bootstrapping tablet: real 0.083s	user 0.050s	sys 0.013s
I20260709 13:16:17.039860  6857 raft_consensus.cc:697] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 LEADER]: Becoming Leader. State: Replica: 7abeed0e8edf41809baa2d97c88c6b28, State: Running, Role: LEADER
I20260709 13:16:17.041015  6857 consensus_queue.cc:237] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:17.041975  6812 raft_consensus.cc:359] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:17.042797  6812 raft_consensus.cc:385] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:17.032577  6518 catalog_manager.cc:5697] T 99642a0c8f7941bca524315ff82e60da P 3972da3671ef401bbc841052ea9c5588 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3972da3671ef401bbc841052ea9c5588 (127.27.146.131). New cstate: current_term: 1 leader_uuid: "3972da3671ef401bbc841052ea9c5588" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:17.043097  6863 consensus_queue.cc:1048] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 7abeed0e8edf41809baa2d97c88c6b28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:17.043099  6812 raft_consensus.cc:740] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7abeed0e8edf41809baa2d97c88c6b28, State: Initialized, Role: FOLLOWER
I20260709 13:16:17.046136  6698 raft_consensus.cc:2468] T 1b9d55b78dd94bbba5df1f481b3e8c5c P d8632beb9efb4ce4a1d87e0c854b639a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3972da3671ef401bbc841052ea9c5588 in term 1.
I20260709 13:16:17.045895  6812 consensus_queue.cc:260] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:17.048601  6859 raft_consensus.cc:493] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.050082  6812 ts_tablet_manager.cc:1434] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:16:17.050731  6814 ts_tablet_manager.cc:1434] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588: Time spent starting tablet: real 0.074s	user 0.008s	sys 0.000s
I20260709 13:16:17.051247  6812 tablet_bootstrap.cc:492] T 571acba5e0524805ba100b31450f461c P 7abeed0e8edf41809baa2d97c88c6b28: Bootstrap starting.
I20260709 13:16:17.051787  6814 tablet_bootstrap.cc:492] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588: Bootstrap starting.
I20260709 13:16:17.064895  6852 raft_consensus.cc:493] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.065860  6852 raft_consensus.cc:515] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:17.057891  6821 raft_consensus.cc:2804] T f48bbc412be247c59a7817c33136ceee P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:17.070206  6821 raft_consensus.cc:697] T f48bbc412be247c59a7817c33136ceee P 3972da3671ef401bbc841052ea9c5588 [term 1 LEADER]: Becoming Leader. State: Replica: 3972da3671ef401bbc841052ea9c5588, State: Running, Role: LEADER
I20260709 13:16:17.048662  6827 raft_consensus.cc:515] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:17.071717  6736 leader_election.cc:304] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3972da3671ef401bbc841052ea9c5588, d8632beb9efb4ce4a1d87e0c854b639a; no voters: 7abeed0e8edf41809baa2d97c88c6b28
I20260709 13:16:17.058240  6859 raft_consensus.cc:515] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:17.076283  6859 leader_election.cc:290] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447), 3972da3671ef401bbc841052ea9c5588 (127.27.146.131:44041)
I20260709 13:16:17.076938  6698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d0a65bcc05d492e860cd9066fb0161a" candidate_uuid: "7abeed0e8edf41809baa2d97c88c6b28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
I20260709 13:16:17.077653  6698 raft_consensus.cc:3060] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:17.077883  6620 raft_consensus.cc:2468] T ef0cd7434a044f94a030340fabe9f8fc P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3972da3671ef401bbc841052ea9c5588 in term 1.
I20260709 13:16:17.078042  6621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47dc18fd364c4b079b99900a766e3208" candidate_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7abeed0e8edf41809baa2d97c88c6b28" is_pre_election: true
I20260709 13:16:17.084029  6813 tablet_bootstrap.cc:492] T 99642a0c8f7941bca524315ff82e60da P d8632beb9efb4ce4a1d87e0c854b639a: No bootstrap required, opened a new log
I20260709 13:16:17.084975  6813 ts_tablet_manager.cc:1403] T 99642a0c8f7941bca524315ff82e60da P d8632beb9efb4ce4a1d87e0c854b639a: Time spent bootstrapping tablet: real 0.169s	user 0.013s	sys 0.004s
I20260709 13:16:17.079337  6852 leader_election.cc:290] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447), d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419)
I20260709 13:16:17.088449  6852 raft_consensus.cc:2804] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:17.089180  6852 raft_consensus.cc:697] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 3972da3671ef401bbc841052ea9c5588 [term 1 LEADER]: Becoming Leader. State: Replica: 3972da3671ef401bbc841052ea9c5588, State: Running, Role: LEADER
I20260709 13:16:17.077812  6821 consensus_queue.cc:237] T f48bbc412be247c59a7817c33136ceee P 3972da3671ef401bbc841052ea9c5588 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:17.091926  6812 tablet_bootstrap.cc:654] T 571acba5e0524805ba100b31450f461c P 7abeed0e8edf41809baa2d97c88c6b28: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:17.090565  6852 consensus_queue.cc:237] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 3972da3671ef401bbc841052ea9c5588 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:17.074757  6827 leader_election.cc:290] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28 [CANDIDATE]: Term 1 election: Requested vote from peers d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419), 3972da3671ef401bbc841052ea9c5588 (127.27.146.131:44041)
I20260709 13:16:17.105394  6813 raft_consensus.cc:359] T 99642a0c8f7941bca524315ff82e60da P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:17.106119  6813 raft_consensus.cc:385] T 99642a0c8f7941bca524315ff82e60da P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:17.106433  6813 raft_consensus.cc:740] T 99642a0c8f7941bca524315ff82e60da P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8632beb9efb4ce4a1d87e0c854b639a, State: Initialized, Role: FOLLOWER
I20260709 13:16:17.107651  6813 consensus_queue.cc:260] T 99642a0c8f7941bca524315ff82e60da P d8632beb9efb4ce4a1d87e0c854b639a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:17.110621  6813 ts_tablet_manager.cc:1434] T 99642a0c8f7941bca524315ff82e60da P d8632beb9efb4ce4a1d87e0c854b639a: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.001s
I20260709 13:16:17.103360  6697 raft_consensus.cc:2468] T f48bbc412be247c59a7817c33136ceee P d8632beb9efb4ce4a1d87e0c854b639a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3972da3671ef401bbc841052ea9c5588 in term 1.
I20260709 13:16:17.116524  6814 tablet_bootstrap.cc:654] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:17.117513  6772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47dc18fd364c4b079b99900a766e3208" candidate_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3972da3671ef401bbc841052ea9c5588" is_pre_election: true
I20260709 13:16:17.118435  6772 raft_consensus.cc:2393] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d8632beb9efb4ce4a1d87e0c854b639a in current term 1: Already voted for candidate 7abeed0e8edf41809baa2d97c88c6b28 in this term.
I20260709 13:16:17.121634  6663 leader_election.cc:304] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d8632beb9efb4ce4a1d87e0c854b639a; no voters: 3972da3671ef401bbc841052ea9c5588, 7abeed0e8edf41809baa2d97c88c6b28
I20260709 13:16:17.122100  6769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d0a65bcc05d492e860cd9066fb0161a" candidate_uuid: "7abeed0e8edf41809baa2d97c88c6b28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3972da3671ef401bbc841052ea9c5588"
I20260709 13:16:17.123013  6859 raft_consensus.cc:3060] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:17.111629  6736 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.130:35419, user_credentials={real_user=slave}} blocked reactor thread for 52121.1us
W20260709 13:16:17.136385  6588 leader_election.cc:343] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3972da3671ef401bbc841052ea9c5588 (127.27.146.131:44041): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:17.137944  6698 raft_consensus.cc:2468] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7abeed0e8edf41809baa2d97c88c6b28 in term 1.
I20260709 13:16:17.148722  6587 leader_election.cc:304] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7abeed0e8edf41809baa2d97c88c6b28, d8632beb9efb4ce4a1d87e0c854b639a; no voters: 3972da3671ef401bbc841052ea9c5588
I20260709 13:16:17.144654  6827 consensus_queue.cc:1048] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:16:17.152542  6857 raft_consensus.cc:2804] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:17.159919  6857 raft_consensus.cc:697] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 LEADER]: Becoming Leader. State: Replica: 7abeed0e8edf41809baa2d97c88c6b28, State: Running, Role: LEADER
I20260709 13:16:17.160365  6698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31789365471247b58419c92a028a9afc" candidate_uuid: "3972da3671ef401bbc841052ea9c5588" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" is_pre_election: true
I20260709 13:16:17.161621  6698 raft_consensus.cc:2393] T 31789365471247b58419c92a028a9afc P d8632beb9efb4ce4a1d87e0c854b639a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3972da3671ef401bbc841052ea9c5588 in current term 1: Already voted for candidate 7abeed0e8edf41809baa2d97c88c6b28 in this term.
I20260709 13:16:17.161806  6857 consensus_queue.cc:237] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:17.156409  6620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31789365471247b58419c92a028a9afc" candidate_uuid: "3972da3671ef401bbc841052ea9c5588" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7abeed0e8edf41809baa2d97c88c6b28" is_pre_election: true
I20260709 13:16:17.166414  6859 raft_consensus.cc:2749] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:17.165417  6518 catalog_manager.cc:5697] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "7abeed0e8edf41809baa2d97c88c6b28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:17.182359  6812 tablet_bootstrap.cc:492] T 571acba5e0524805ba100b31450f461c P 7abeed0e8edf41809baa2d97c88c6b28: No bootstrap required, opened a new log
I20260709 13:16:17.183406  6812 ts_tablet_manager.cc:1403] T 571acba5e0524805ba100b31450f461c P 7abeed0e8edf41809baa2d97c88c6b28: Time spent bootstrapping tablet: real 0.132s	user 0.016s	sys 0.002s
I20260709 13:16:17.186534  6859 raft_consensus.cc:493] T 99642a0c8f7941bca524315ff82e60da P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.188083  6859 raft_consensus.cc:515] T 99642a0c8f7941bca524315ff82e60da P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:17.200487  6814 tablet_bootstrap.cc:492] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588: No bootstrap required, opened a new log
I20260709 13:16:17.201156  6814 ts_tablet_manager.cc:1403] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588: Time spent bootstrapping tablet: real 0.150s	user 0.021s	sys 0.003s
I20260709 13:16:17.201296  6736 leader_election.cc:304] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3972da3671ef401bbc841052ea9c5588; no voters: 7abeed0e8edf41809baa2d97c88c6b28, d8632beb9efb4ce4a1d87e0c854b639a
I20260709 13:16:17.204188  6620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99642a0c8f7941bca524315ff82e60da" candidate_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7abeed0e8edf41809baa2d97c88c6b28" is_pre_election: true
I20260709 13:16:17.205513  6620 raft_consensus.cc:2393] T 99642a0c8f7941bca524315ff82e60da P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d8632beb9efb4ce4a1d87e0c854b639a in current term 1: Already voted for candidate 3972da3671ef401bbc841052ea9c5588 in this term.
I20260709 13:16:17.206805  6821 raft_consensus.cc:3060] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:17.208086  6814 raft_consensus.cc:359] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:17.208858  6814 raft_consensus.cc:385] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:17.209146  6814 raft_consensus.cc:740] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3972da3671ef401bbc841052ea9c5588, State: Initialized, Role: FOLLOWER
I20260709 13:16:17.210057  6814 consensus_queue.cc:260] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:17.212738  6814 ts_tablet_manager.cc:1434] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:16:17.213922  6814 tablet_bootstrap.cc:492] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588: Bootstrap starting.
I20260709 13:16:17.213719  6859 leader_election.cc:290] T 99642a0c8f7941bca524315ff82e60da P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447), 3972da3671ef401bbc841052ea9c5588 (127.27.146.131:44041)
I20260709 13:16:17.216269  6771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99642a0c8f7941bca524315ff82e60da" candidate_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3972da3671ef401bbc841052ea9c5588" is_pre_election: true
I20260709 13:16:17.216451  6812 raft_consensus.cc:359] T 571acba5e0524805ba100b31450f461c P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:17.217281  6812 raft_consensus.cc:385] T 571acba5e0524805ba100b31450f461c P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:17.217641  6812 raft_consensus.cc:740] T 571acba5e0524805ba100b31450f461c P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7abeed0e8edf41809baa2d97c88c6b28, State: Initialized, Role: FOLLOWER
I20260709 13:16:17.218389  6812 consensus_queue.cc:260] T 571acba5e0524805ba100b31450f461c P 7abeed0e8edf41809baa2d97c88c6b28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:17.218410  6663 leader_election.cc:304] T 99642a0c8f7941bca524315ff82e60da P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d8632beb9efb4ce4a1d87e0c854b639a; no voters: 3972da3671ef401bbc841052ea9c5588, 7abeed0e8edf41809baa2d97c88c6b28
I20260709 13:16:17.220621  6859 raft_consensus.cc:3060] T 99642a0c8f7941bca524315ff82e60da P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:17.220865  6812 ts_tablet_manager.cc:1434] T 571acba5e0524805ba100b31450f461c P 7abeed0e8edf41809baa2d97c88c6b28: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 13:16:17.220880  6814 tablet_bootstrap.cc:654] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:17.218437  6821 raft_consensus.cc:2749] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:17.244885  6857 consensus_queue.cc:1048] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:16:17.252660  6814 tablet_bootstrap.cc:492] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588: No bootstrap required, opened a new log
I20260709 13:16:17.253293  6814 ts_tablet_manager.cc:1403] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.010s
I20260709 13:16:17.248299  6520 catalog_manager.cc:5697] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "7abeed0e8edf41809baa2d97c88c6b28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:17.260957  6859 raft_consensus.cc:2749] T 99642a0c8f7941bca524315ff82e60da P d8632beb9efb4ce4a1d87e0c854b639a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:17.263001  6814 raft_consensus.cc:359] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:17.263917  6814 raft_consensus.cc:385] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:17.264261  6814 raft_consensus.cc:740] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3972da3671ef401bbc841052ea9c5588, State: Initialized, Role: FOLLOWER
I20260709 13:16:17.263625  6518 catalog_manager.cc:5697] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3972da3671ef401bbc841052ea9c5588 (127.27.146.131). New cstate: current_term: 1 leader_uuid: "3972da3671ef401bbc841052ea9c5588" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:17.265962  6814 consensus_queue.cc:260] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:17.266296  6518 catalog_manager.cc:5697] T f48bbc412be247c59a7817c33136ceee P 3972da3671ef401bbc841052ea9c5588 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3972da3671ef401bbc841052ea9c5588 (127.27.146.131). New cstate: current_term: 1 leader_uuid: "3972da3671ef401bbc841052ea9c5588" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:17.268308  6814 ts_tablet_manager.cc:1434] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:16:17.268286  6518 catalog_manager.cc:5697] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 3972da3671ef401bbc841052ea9c5588 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3972da3671ef401bbc841052ea9c5588 (127.27.146.131). New cstate: current_term: 1 leader_uuid: "3972da3671ef401bbc841052ea9c5588" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:17.287168  6857 raft_consensus.cc:493] T 571acba5e0524805ba100b31450f461c P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.287779  6857 raft_consensus.cc:515] T 571acba5e0524805ba100b31450f461c P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:17.289736  6857 leader_election.cc:290] T 571acba5e0524805ba100b31450f461c P 7abeed0e8edf41809baa2d97c88c6b28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419), 3972da3671ef401bbc841052ea9c5588 (127.27.146.131:44041)
I20260709 13:16:17.290759  6695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "571acba5e0524805ba100b31450f461c" candidate_uuid: "7abeed0e8edf41809baa2d97c88c6b28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" is_pre_election: true
I20260709 13:16:17.291039  6769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "571acba5e0524805ba100b31450f461c" candidate_uuid: "7abeed0e8edf41809baa2d97c88c6b28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3972da3671ef401bbc841052ea9c5588" is_pre_election: true
I20260709 13:16:17.291682  6857 raft_consensus.cc:493] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.292028  6769 raft_consensus.cc:2393] T 571acba5e0524805ba100b31450f461c P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7abeed0e8edf41809baa2d97c88c6b28 in current term 1: Already voted for candidate d8632beb9efb4ce4a1d87e0c854b639a in this term.
I20260709 13:16:17.292346  6857 raft_consensus.cc:515] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:17.293200  6588 leader_election.cc:304] T 571acba5e0524805ba100b31450f461c P 7abeed0e8edf41809baa2d97c88c6b28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7abeed0e8edf41809baa2d97c88c6b28; no voters: 3972da3671ef401bbc841052ea9c5588, d8632beb9efb4ce4a1d87e0c854b639a
I20260709 13:16:17.294150  6863 raft_consensus.cc:3060] T 571acba5e0524805ba100b31450f461c P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:17.294574  6857 leader_election.cc:290] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419), 3972da3671ef401bbc841052ea9c5588 (127.27.146.131:44041)
I20260709 13:16:17.295928  6769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43d643af6d3248da8abe7e13fd887cc1" candidate_uuid: "7abeed0e8edf41809baa2d97c88c6b28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3972da3671ef401bbc841052ea9c5588" is_pre_election: true
I20260709 13:16:17.296676  6769 raft_consensus.cc:2468] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7abeed0e8edf41809baa2d97c88c6b28 in term 0.
I20260709 13:16:17.297926  6588 leader_election.cc:304] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3972da3671ef401bbc841052ea9c5588, 7abeed0e8edf41809baa2d97c88c6b28; no voters: 
I20260709 13:16:17.298993  6857 raft_consensus.cc:2804] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:17.299520  6857 raft_consensus.cc:493] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:17.299717  6695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43d643af6d3248da8abe7e13fd887cc1" candidate_uuid: "7abeed0e8edf41809baa2d97c88c6b28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" is_pre_election: true
I20260709 13:16:17.299878  6857 raft_consensus.cc:3060] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:17.300558  6695 raft_consensus.cc:2468] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7abeed0e8edf41809baa2d97c88c6b28 in term 0.
I20260709 13:16:17.303211  6863 raft_consensus.cc:2749] T 571acba5e0524805ba100b31450f461c P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:17.306937  6857 raft_consensus.cc:515] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:17.308856  6857 leader_election.cc:290] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28 [CANDIDATE]: Term 1 election: Requested vote from peers d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419), 3972da3671ef401bbc841052ea9c5588 (127.27.146.131:44041)
I20260709 13:16:17.310029  6769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43d643af6d3248da8abe7e13fd887cc1" candidate_uuid: "7abeed0e8edf41809baa2d97c88c6b28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3972da3671ef401bbc841052ea9c5588"
I20260709 13:16:17.309947  6695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43d643af6d3248da8abe7e13fd887cc1" candidate_uuid: "7abeed0e8edf41809baa2d97c88c6b28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
I20260709 13:16:17.310853  6769 raft_consensus.cc:3060] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:17.310879  6695 raft_consensus.cc:3060] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:17.320004  6695 raft_consensus.cc:2468] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7abeed0e8edf41809baa2d97c88c6b28 in term 1.
I20260709 13:16:17.320004  6769 raft_consensus.cc:2468] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7abeed0e8edf41809baa2d97c88c6b28 in term 1.
I20260709 13:16:17.321627  6588 leader_election.cc:304] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3972da3671ef401bbc841052ea9c5588, 7abeed0e8edf41809baa2d97c88c6b28; no voters: 
I20260709 13:16:17.322628  6857 raft_consensus.cc:2804] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:17.323148  6857 raft_consensus.cc:697] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 LEADER]: Becoming Leader. State: Replica: 7abeed0e8edf41809baa2d97c88c6b28, State: Running, Role: LEADER
I20260709 13:16:17.324034  6857 consensus_queue.cc:237] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:17.332051  6520 catalog_manager.cc:5697] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "7abeed0e8edf41809baa2d97c88c6b28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:17.392563 28234 ts_manager.cc:295] Set tserver state for 7abeed0e8edf41809baa2d97c88c6b28 to MAINTENANCE_MODE
I20260709 13:16:17.393646 28234 tablet_server.cc:179] TabletServer@127.27.146.129:0 shutting down...
I20260709 13:16:17.412922  6859 consensus_queue.cc:1048] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:16:17.414824  6736 consensus_peers.cc:597] T 99642a0c8f7941bca524315ff82e60da P 3972da3671ef401bbc841052ea9c5588 -> Peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Couldn't send request to peer 7abeed0e8edf41809baa2d97c88c6b28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:17.425978  6569 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:16:17.434828  6662 consensus_peers.cc:597] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a -> Peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Couldn't send request to peer 7abeed0e8edf41809baa2d97c88c6b28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:17.445324 28234 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:16:17.447008  6736 consensus_peers.cc:597] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 -> Peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Couldn't send request to peer 7abeed0e8edf41809baa2d97c88c6b28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:17.447780 28234 tablet_replica.cc:333] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28: stopping tablet replica
I20260709 13:16:17.448519 28234 raft_consensus.cc:2243] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:17.449213 28234 pending_rounds.cc:70] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28: Trying to abort 1 pending ops.
I20260709 13:16:17.449457 28234 pending_rounds.cc:77] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305637795127009280 op_type: NO_OP noop_request { }
I20260709 13:16:17.449816 28234 raft_consensus.cc:2889] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:16:17.450237 28234 raft_consensus.cc:2272] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.453189 28234 tablet_replica.cc:333] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 7abeed0e8edf41809baa2d97c88c6b28: stopping tablet replica
I20260709 13:16:17.453855 28234 raft_consensus.cc:2243] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.454294 28234 raft_consensus.cc:2272] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.456285 28234 tablet_replica.cc:333] T ef0cd7434a044f94a030340fabe9f8fc P 7abeed0e8edf41809baa2d97c88c6b28: stopping tablet replica
I20260709 13:16:17.456887 28234 raft_consensus.cc:2243] T ef0cd7434a044f94a030340fabe9f8fc P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.457310 28234 raft_consensus.cc:2272] T ef0cd7434a044f94a030340fabe9f8fc P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.459226 28234 tablet_replica.cc:333] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 7abeed0e8edf41809baa2d97c88c6b28: stopping tablet replica
I20260709 13:16:17.460018 28234 raft_consensus.cc:2243] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:17.461076 28234 raft_consensus.cc:2272] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.463291  6857 consensus_queue.cc:1048] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:17.464118 28234 tablet_replica.cc:333] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28: stopping tablet replica
I20260709 13:16:17.465173 28234 raft_consensus.cc:2243] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:17.466199 28234 raft_consensus.cc:2272] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.469102 28234 tablet_replica.cc:333] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28: stopping tablet replica
I20260709 13:16:17.469954 28234 raft_consensus.cc:2243] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:17.470708 28234 pending_rounds.cc:70] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28: Trying to abort 1 pending ops.
I20260709 13:16:17.470922 28234 pending_rounds.cc:77] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305637793972781056 op_type: NO_OP noop_request { }
I20260709 13:16:17.471227 28234 raft_consensus.cc:2889] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:16:17.471561 28234 raft_consensus.cc:2272] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.474092 28234 tablet_replica.cc:333] T 571acba5e0524805ba100b31450f461c P 7abeed0e8edf41809baa2d97c88c6b28: stopping tablet replica
I20260709 13:16:17.474856 28234 raft_consensus.cc:2243] T 571acba5e0524805ba100b31450f461c P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.475379 28234 raft_consensus.cc:2272] T 571acba5e0524805ba100b31450f461c P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.478061 28234 tablet_replica.cc:333] T f48bbc412be247c59a7817c33136ceee P 7abeed0e8edf41809baa2d97c88c6b28: stopping tablet replica
I20260709 13:16:17.478442  6821 consensus_queue.cc:1048] T 99642a0c8f7941bca524315ff82e60da P 3972da3671ef401bbc841052ea9c5588 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:17.479106 28234 raft_consensus.cc:2243] T f48bbc412be247c59a7817c33136ceee P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.479800 28234 raft_consensus.cc:2272] T f48bbc412be247c59a7817c33136ceee P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.482167 28234 tablet_replica.cc:333] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28: stopping tablet replica
I20260709 13:16:17.482678 28234 raft_consensus.cc:2243] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:17.483376 28234 pending_rounds.cc:70] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28: Trying to abort 1 pending ops.
I20260709 13:16:17.483645 28234 pending_rounds.cc:77] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305637794506215424 op_type: NO_OP noop_request { }
I20260709 13:16:17.483947 28234 raft_consensus.cc:2889] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:16:17.484267 28234 raft_consensus.cc:2272] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.487192 28234 tablet_replica.cc:333] T 99642a0c8f7941bca524315ff82e60da P 7abeed0e8edf41809baa2d97c88c6b28: stopping tablet replica
I20260709 13:16:17.488211 28234 raft_consensus.cc:2243] T 99642a0c8f7941bca524315ff82e60da P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:17.488747 28234 raft_consensus.cc:2272] T 99642a0c8f7941bca524315ff82e60da P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:17.511920  6852 consensus_queue.cc:1048] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:17.517789 28234 tablet_server.cc:196] TabletServer@127.27.146.129:0 shutdown complete.
W20260709 13:16:17.549057  6736 consensus_peers.cc:597] T f48bbc412be247c59a7817c33136ceee P 3972da3671ef401bbc841052ea9c5588 -> Peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Couldn't send request to peer 7abeed0e8edf41809baa2d97c88c6b28. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:40447: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:17.567283  6736 consensus_peers.cc:597] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 3972da3671ef401bbc841052ea9c5588 -> Peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Couldn't send request to peer 7abeed0e8edf41809baa2d97c88c6b28. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:40447: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:17.589205  6852 raft_consensus.cc:493] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.589900  6852 raft_consensus.cc:515] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:17.592209  6852 leader_election.cc:290] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447), d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419)
I20260709 13:16:17.594014  6695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d0a65bcc05d492e860cd9066fb0161a" candidate_uuid: "3972da3671ef401bbc841052ea9c5588" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" is_pre_election: true
I20260709 13:16:17.594975  6695 raft_consensus.cc:2393] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3972da3671ef401bbc841052ea9c5588 in current term 1: Already voted for candidate 7abeed0e8edf41809baa2d97c88c6b28 in this term.
W20260709 13:16:17.596491  6736 leader_election.cc:336] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Network error: Client connection negotiation failed: client connection to 127.27.146.129:40447: connect: Connection refused (error 111)
I20260709 13:16:17.597054  6736 leader_election.cc:304] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3972da3671ef401bbc841052ea9c5588; no voters: 7abeed0e8edf41809baa2d97c88c6b28, d8632beb9efb4ce4a1d87e0c854b639a
I20260709 13:16:17.597853  6852 raft_consensus.cc:3060] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:17.605055  6852 raft_consensus.cc:2749] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:17.647241  6852 consensus_queue.cc:1048] T f48bbc412be247c59a7817c33136ceee P 3972da3671ef401bbc841052ea9c5588 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:17.776106  6853 consensus_queue.cc:1048] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 3972da3671ef401bbc841052ea9c5588 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:16:18.313612  6662 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.146.129:40447: connect: Connection refused (error 111) [suppressed 143 similar messages]
W20260709 13:16:18.427420  6569 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:16:18.668836  6887 raft_consensus.cc:493] T 4e0c8fb12e4e49f2927d224f188a8cc9 P d8632beb9efb4ce4a1d87e0c854b639a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7abeed0e8edf41809baa2d97c88c6b28)
I20260709 13:16:18.669509  6887 raft_consensus.cc:515] T 4e0c8fb12e4e49f2927d224f188a8cc9 P d8632beb9efb4ce4a1d87e0c854b639a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:18.671216  6887 leader_election.cc:290] T 4e0c8fb12e4e49f2927d224f188a8cc9 P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447), 3972da3671ef401bbc841052ea9c5588 (127.27.146.131:44041)
I20260709 13:16:18.672703  6769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0c8fb12e4e49f2927d224f188a8cc9" candidate_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3972da3671ef401bbc841052ea9c5588" is_pre_election: true
W20260709 13:16:18.675812  6662 leader_election.cc:336] T 4e0c8fb12e4e49f2927d224f188a8cc9 P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Network error: Client connection negotiation failed: client connection to 127.27.146.129:40447: connect: Connection refused (error 111)
I20260709 13:16:18.676240  6662 leader_election.cc:304] T 4e0c8fb12e4e49f2927d224f188a8cc9 P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d8632beb9efb4ce4a1d87e0c854b639a; no voters: 3972da3671ef401bbc841052ea9c5588, 7abeed0e8edf41809baa2d97c88c6b28
I20260709 13:16:18.676899  6887 raft_consensus.cc:2749] T 4e0c8fb12e4e49f2927d224f188a8cc9 P d8632beb9efb4ce4a1d87e0c854b639a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:18.725828  6869 raft_consensus.cc:493] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7abeed0e8edf41809baa2d97c88c6b28)
I20260709 13:16:18.726616  6869 raft_consensus.cc:515] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:18.728622  6869 leader_election.cc:290] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447), d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419)
I20260709 13:16:18.730614  6695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0c8fb12e4e49f2927d224f188a8cc9" candidate_uuid: "3972da3671ef401bbc841052ea9c5588" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" is_pre_election: true
I20260709 13:16:18.731456  6695 raft_consensus.cc:2468] T 4e0c8fb12e4e49f2927d224f188a8cc9 P d8632beb9efb4ce4a1d87e0c854b639a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3972da3671ef401bbc841052ea9c5588 in term 1.
I20260709 13:16:18.732740  6736 leader_election.cc:304] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3972da3671ef401bbc841052ea9c5588, d8632beb9efb4ce4a1d87e0c854b639a; no voters: 
W20260709 13:16:18.733580  6736 leader_election.cc:336] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Network error: Client connection negotiation failed: client connection to 127.27.146.129:40447: connect: Connection refused (error 111)
I20260709 13:16:18.733620  6869 raft_consensus.cc:2804] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:18.734126  6869 raft_consensus.cc:493] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7abeed0e8edf41809baa2d97c88c6b28)
I20260709 13:16:18.734432  6869 raft_consensus.cc:3060] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:18.737861  6896 raft_consensus.cc:493] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7abeed0e8edf41809baa2d97c88c6b28)
I20260709 13:16:18.738442  6896 raft_consensus.cc:515] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:18.740432  6896 leader_election.cc:290] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447), d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419)
I20260709 13:16:18.741918  6695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47dc18fd364c4b079b99900a766e3208" candidate_uuid: "3972da3671ef401bbc841052ea9c5588" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" is_pre_election: true
I20260709 13:16:18.742012  6869 raft_consensus.cc:515] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 3972da3671ef401bbc841052ea9c5588 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:18.744936  6869 leader_election.cc:290] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 2 election: Requested vote from peers 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447), d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419)
W20260709 13:16:18.746130  6736 leader_election.cc:336] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Network error: Client connection negotiation failed: client connection to 127.27.146.129:40447: connect: Connection refused (error 111)
I20260709 13:16:18.746866  6736 leader_election.cc:304] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3972da3671ef401bbc841052ea9c5588; no voters: 7abeed0e8edf41809baa2d97c88c6b28, d8632beb9efb4ce4a1d87e0c854b639a
I20260709 13:16:18.746923  6695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e0c8fb12e4e49f2927d224f188a8cc9" candidate_uuid: "3972da3671ef401bbc841052ea9c5588" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
I20260709 13:16:18.747879  6695 raft_consensus.cc:3060] T 4e0c8fb12e4e49f2927d224f188a8cc9 P d8632beb9efb4ce4a1d87e0c854b639a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:18.748087  6869 raft_consensus.cc:2749] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:18.751199  6887 raft_consensus.cc:493] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7abeed0e8edf41809baa2d97c88c6b28)
I20260709 13:16:18.751792  6887 raft_consensus.cc:515] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:18.754091  6887 leader_election.cc:290] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447), 3972da3671ef401bbc841052ea9c5588 (127.27.146.131:44041)
W20260709 13:16:18.750679  6736 leader_election.cc:336] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Network error: Client connection negotiation failed: client connection to 127.27.146.129:40447: connect: Connection refused (error 111)
I20260709 13:16:18.756131  6769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47dc18fd364c4b079b99900a766e3208" candidate_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3972da3671ef401bbc841052ea9c5588" is_pre_election: true
I20260709 13:16:18.756986  6769 raft_consensus.cc:2468] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8632beb9efb4ce4a1d87e0c854b639a in term 1.
I20260709 13:16:18.757442  6695 raft_consensus.cc:2468] T 4e0c8fb12e4e49f2927d224f188a8cc9 P d8632beb9efb4ce4a1d87e0c854b639a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3972da3671ef401bbc841052ea9c5588 in term 2.
I20260709 13:16:18.758394  6663 leader_election.cc:304] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3972da3671ef401bbc841052ea9c5588, d8632beb9efb4ce4a1d87e0c854b639a; no voters: 
W20260709 13:16:18.759084  6662 leader_election.cc:336] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Network error: Client connection negotiation failed: client connection to 127.27.146.129:40447: connect: Connection refused (error 111)
I20260709 13:16:18.759305  6887 raft_consensus.cc:2804] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:18.759258  6736 leader_election.cc:304] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3972da3671ef401bbc841052ea9c5588, d8632beb9efb4ce4a1d87e0c854b639a; no voters: 7abeed0e8edf41809baa2d97c88c6b28
I20260709 13:16:18.760020  6887 raft_consensus.cc:493] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7abeed0e8edf41809baa2d97c88c6b28)
I20260709 13:16:18.760397  6887 raft_consensus.cc:3060] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:18.760528  6869 raft_consensus.cc:2804] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 3972da3671ef401bbc841052ea9c5588 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:18.761102  6869 raft_consensus.cc:697] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 3972da3671ef401bbc841052ea9c5588 [term 2 LEADER]: Becoming Leader. State: Replica: 3972da3671ef401bbc841052ea9c5588, State: Running, Role: LEADER
I20260709 13:16:18.761996  6869 consensus_queue.cc:237] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 3972da3671ef401bbc841052ea9c5588 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:18.769455  6887 raft_consensus.cc:515] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:18.771703  6887 leader_election.cc:290] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 2 election: Requested vote from peers 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447), 3972da3671ef401bbc841052ea9c5588 (127.27.146.131:44041)
I20260709 13:16:18.772324  6519 catalog_manager.cc:5697] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 3972da3671ef401bbc841052ea9c5588 reported cstate change: term changed from 1 to 2, leader changed from 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129) to 3972da3671ef401bbc841052ea9c5588 (127.27.146.131). New cstate: current_term: 2 leader_uuid: "3972da3671ef401bbc841052ea9c5588" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:18.774364  6769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47dc18fd364c4b079b99900a766e3208" candidate_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3972da3671ef401bbc841052ea9c5588"
I20260709 13:16:18.775362  6769 raft_consensus.cc:3060] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:18.778628  6662 leader_election.cc:336] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Network error: Client connection negotiation failed: client connection to 127.27.146.129:40447: connect: Connection refused (error 111)
I20260709 13:16:18.783103  6769 raft_consensus.cc:2468] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8632beb9efb4ce4a1d87e0c854b639a in term 2.
I20260709 13:16:18.785068  6663 leader_election.cc:304] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3972da3671ef401bbc841052ea9c5588, d8632beb9efb4ce4a1d87e0c854b639a; no voters: 7abeed0e8edf41809baa2d97c88c6b28
I20260709 13:16:18.786110  6887 raft_consensus.cc:2804] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:18.787798  6887 raft_consensus.cc:697] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [term 2 LEADER]: Becoming Leader. State: Replica: d8632beb9efb4ce4a1d87e0c854b639a, State: Running, Role: LEADER
I20260709 13:16:18.788728  6887 consensus_queue.cc:237] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:18.796844  6519 catalog_manager.cc:5697] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a reported cstate change: term changed from 1 to 2, leader changed from 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129) to d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130). New cstate: current_term: 2 leader_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:18.967833  6869 raft_consensus.cc:493] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7abeed0e8edf41809baa2d97c88c6b28)
I20260709 13:16:18.968456  6869 raft_consensus.cc:515] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:18.970278  6869 leader_election.cc:290] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447), d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419)
I20260709 13:16:18.972347  6698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31789365471247b58419c92a028a9afc" candidate_uuid: "3972da3671ef401bbc841052ea9c5588" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" is_pre_election: true
I20260709 13:16:18.973058  6698 raft_consensus.cc:2468] T 31789365471247b58419c92a028a9afc P d8632beb9efb4ce4a1d87e0c854b639a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3972da3671ef401bbc841052ea9c5588 in term 1.
I20260709 13:16:18.974180  6736 leader_election.cc:304] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3972da3671ef401bbc841052ea9c5588, d8632beb9efb4ce4a1d87e0c854b639a; no voters: 
W20260709 13:16:18.974944  6736 leader_election.cc:336] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Network error: Client connection negotiation failed: client connection to 127.27.146.129:40447: connect: Connection refused (error 111)
I20260709 13:16:18.974996  6869 raft_consensus.cc:2804] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:18.975539  6869 raft_consensus.cc:493] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7abeed0e8edf41809baa2d97c88c6b28)
I20260709 13:16:18.975871  6869 raft_consensus.cc:3060] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:18.983003  6869 raft_consensus.cc:515] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:18.984982  6869 leader_election.cc:290] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 2 election: Requested vote from peers 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447), d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419)
I20260709 13:16:18.987191  6698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31789365471247b58419c92a028a9afc" candidate_uuid: "3972da3671ef401bbc841052ea9c5588" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
I20260709 13:16:18.987970  6698 raft_consensus.cc:3060] T 31789365471247b58419c92a028a9afc P d8632beb9efb4ce4a1d87e0c854b639a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:18.988955  6736 leader_election.cc:336] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Network error: Client connection negotiation failed: client connection to 127.27.146.129:40447: connect: Connection refused (error 111)
I20260709 13:16:18.990084  6887 raft_consensus.cc:493] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.990574  6887 raft_consensus.cc:515] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:18.992244  6887 leader_election.cc:290] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447), 3972da3671ef401bbc841052ea9c5588 (127.27.146.131:44041)
I20260709 13:16:18.993407  6769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d0a65bcc05d492e860cd9066fb0161a" candidate_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3972da3671ef401bbc841052ea9c5588" is_pre_election: true
I20260709 13:16:18.993970  6769 raft_consensus.cc:2468] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8632beb9efb4ce4a1d87e0c854b639a in term 1.
I20260709 13:16:18.995023  6663 leader_election.cc:304] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3972da3671ef401bbc841052ea9c5588, d8632beb9efb4ce4a1d87e0c854b639a; no voters: 
I20260709 13:16:18.995671  6698 raft_consensus.cc:2468] T 31789365471247b58419c92a028a9afc P d8632beb9efb4ce4a1d87e0c854b639a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3972da3671ef401bbc841052ea9c5588 in term 2.
I20260709 13:16:18.995842  6887 raft_consensus.cc:2804] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:18.996397  6887 raft_consensus.cc:493] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.996757  6887 raft_consensus.cc:3060] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:18.997025  6736 leader_election.cc:304] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3972da3671ef401bbc841052ea9c5588, d8632beb9efb4ce4a1d87e0c854b639a; no voters: 7abeed0e8edf41809baa2d97c88c6b28
W20260709 13:16:18.997339  6662 leader_election.cc:336] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Network error: Client connection negotiation failed: client connection to 127.27.146.129:40447: connect: Connection refused (error 111)
I20260709 13:16:18.998080  6869 raft_consensus.cc:2804] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:18.998581  6869 raft_consensus.cc:697] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [term 2 LEADER]: Becoming Leader. State: Replica: 3972da3671ef401bbc841052ea9c5588, State: Running, Role: LEADER
I20260709 13:16:18.999430  6869 consensus_queue.cc:237] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:19.004846  6887 raft_consensus.cc:515] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:19.007038  6887 leader_election.cc:290] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 2 election: Requested vote from peers 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447), 3972da3671ef401bbc841052ea9c5588 (127.27.146.131:44041)
I20260709 13:16:19.008416  6769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d0a65bcc05d492e860cd9066fb0161a" candidate_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3972da3671ef401bbc841052ea9c5588"
I20260709 13:16:19.009195  6769 raft_consensus.cc:3060] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:19.009513  6519 catalog_manager.cc:5697] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 reported cstate change: term changed from 1 to 2, leader changed from 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129) to 3972da3671ef401bbc841052ea9c5588 (127.27.146.131). New cstate: current_term: 2 leader_uuid: "3972da3671ef401bbc841052ea9c5588" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:19.012094  6662 leader_election.cc:336] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Network error: Client connection negotiation failed: client connection to 127.27.146.129:40447: connect: Connection refused (error 111)
I20260709 13:16:19.018071  6769 raft_consensus.cc:2468] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8632beb9efb4ce4a1d87e0c854b639a in term 2.
I20260709 13:16:19.019649  6663 leader_election.cc:304] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3972da3671ef401bbc841052ea9c5588, d8632beb9efb4ce4a1d87e0c854b639a; no voters: 7abeed0e8edf41809baa2d97c88c6b28
I20260709 13:16:19.020602  6887 raft_consensus.cc:2804] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:19.021152  6887 raft_consensus.cc:697] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [term 2 LEADER]: Becoming Leader. State: Replica: d8632beb9efb4ce4a1d87e0c854b639a, State: Running, Role: LEADER
I20260709 13:16:19.021981  6887 consensus_queue.cc:237] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:19.030761  6519 catalog_manager.cc:5697] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a reported cstate change: term changed from 1 to 2, leader changed from 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129) to d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130). New cstate: current_term: 2 leader_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:19.230175  6736 consensus_peers.cc:597] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 3972da3671ef401bbc841052ea9c5588 -> Peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Couldn't send request to peer 7abeed0e8edf41809baa2d97c88c6b28. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:40447: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:19.288156  6698 raft_consensus.cc:1275] T 4e0c8fb12e4e49f2927d224f188a8cc9 P d8632beb9efb4ce4a1d87e0c854b639a [term 2 FOLLOWER]: Refusing update from remote peer 3972da3671ef401bbc841052ea9c5588: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:19.290083  6869 consensus_queue.cc:1048] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 3972da3671ef401bbc841052ea9c5588 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:19.296936  6869 raft_consensus.cc:493] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.297524  6869 raft_consensus.cc:515] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:19.299423  6869 leader_election.cc:290] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447), d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419)
I20260709 13:16:19.302819  6698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43d643af6d3248da8abe7e13fd887cc1" candidate_uuid: "3972da3671ef401bbc841052ea9c5588" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" is_pre_election: true
I20260709 13:16:19.303723  6698 raft_consensus.cc:2468] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3972da3671ef401bbc841052ea9c5588 in term 1.
I20260709 13:16:19.306571  6736 leader_election.cc:304] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3972da3671ef401bbc841052ea9c5588, d8632beb9efb4ce4a1d87e0c854b639a; no voters: 
I20260709 13:16:19.308127  6869 raft_consensus.cc:2804] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:16:19.308190  6736 leader_election.cc:336] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Network error: Client connection negotiation failed: client connection to 127.27.146.129:40447: connect: Connection refused (error 111)
I20260709 13:16:19.308653  6869 raft_consensus.cc:493] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.309070  6869 raft_consensus.cc:3060] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:19.318575  6869 raft_consensus.cc:515] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:19.320456  6869 leader_election.cc:290] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 2 election: Requested vote from peers 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447), d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419)
I20260709 13:16:19.322072  6698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43d643af6d3248da8abe7e13fd887cc1" candidate_uuid: "3972da3671ef401bbc841052ea9c5588" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
I20260709 13:16:19.322813  6698 raft_consensus.cc:3060] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:19.324572  6736 leader_election.cc:336] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Network error: Client connection negotiation failed: client connection to 127.27.146.129:40447: connect: Connection refused (error 111)
I20260709 13:16:19.328702  6698 raft_consensus.cc:2468] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3972da3671ef401bbc841052ea9c5588 in term 2.
I20260709 13:16:19.330229  6736 leader_election.cc:304] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3972da3671ef401bbc841052ea9c5588, d8632beb9efb4ce4a1d87e0c854b639a; no voters: 7abeed0e8edf41809baa2d97c88c6b28
I20260709 13:16:19.331164  6869 raft_consensus.cc:2804] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:19.331768  6869 raft_consensus.cc:697] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [term 2 LEADER]: Becoming Leader. State: Replica: 3972da3671ef401bbc841052ea9c5588, State: Running, Role: LEADER
I20260709 13:16:19.332631  6869 consensus_queue.cc:237] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:19.340911  6519 catalog_manager.cc:5697] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 reported cstate change: term changed from 1 to 2, leader changed from 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129) to 3972da3671ef401bbc841052ea9c5588 (127.27.146.131). New cstate: current_term: 2 leader_uuid: "3972da3671ef401bbc841052ea9c5588" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:19.355475  6662 consensus_peers.cc:597] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a -> Peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Couldn't send request to peer 7abeed0e8edf41809baa2d97c88c6b28. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:40447: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:19.367944  6769 raft_consensus.cc:1275] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588 [term 2 FOLLOWER]: Refusing update from remote peer d8632beb9efb4ce4a1d87e0c854b639a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:19.369794  6887 consensus_queue.cc:1048] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:16:19.428702  6569 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:16:19.519227  6769 raft_consensus.cc:1275] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588 [term 2 FOLLOWER]: Refusing update from remote peer d8632beb9efb4ce4a1d87e0c854b639a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:16:19.521165  6912 consensus_queue.cc:1048] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:16:19.538889  6662 consensus_peers.cc:597] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a -> Peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Couldn't send request to peer 7abeed0e8edf41809baa2d97c88c6b28. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:40447: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:19.558045  6698 raft_consensus.cc:1275] T 31789365471247b58419c92a028a9afc P d8632beb9efb4ce4a1d87e0c854b639a [term 2 FOLLOWER]: Refusing update from remote peer 3972da3671ef401bbc841052ea9c5588: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:19.559895  6869 consensus_queue.cc:1048] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:16:19.568147  6736 consensus_peers.cc:597] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 -> Peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Couldn't send request to peer 7abeed0e8edf41809baa2d97c88c6b28. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:40447: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:19.803859  6736 consensus_peers.cc:597] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 -> Peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Couldn't send request to peer 7abeed0e8edf41809baa2d97c88c6b28. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:40447: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:19.892793  6736 consensus_peers.cc:597] T f48bbc412be247c59a7817c33136ceee P 3972da3671ef401bbc841052ea9c5588 -> Peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Couldn't send request to peer 7abeed0e8edf41809baa2d97c88c6b28. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:40447: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:19.912292  6662 consensus_peers.cc:597] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a -> Peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Couldn't send request to peer 7abeed0e8edf41809baa2d97c88c6b28. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:40447: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:16:19.914453  6698 raft_consensus.cc:1275] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a [term 2 FOLLOWER]: Refusing update from remote peer 3972da3671ef401bbc841052ea9c5588: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:16:19.916098  6907 consensus_queue.cc:1048] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:16:20.049264  6736 consensus_peers.cc:597] T 99642a0c8f7941bca524315ff82e60da P 3972da3671ef401bbc841052ea9c5588 -> Peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Couldn't send request to peer 7abeed0e8edf41809baa2d97c88c6b28. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:40447: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:20.177034  6736 consensus_peers.cc:597] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 -> Peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Couldn't send request to peer 7abeed0e8edf41809baa2d97c88c6b28. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:40447: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:20.207211  6736 consensus_peers.cc:597] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 3972da3671ef401bbc841052ea9c5588 -> Peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Couldn't send request to peer 7abeed0e8edf41809baa2d97c88c6b28. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:40447: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:20.429924  6569 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:16:21.431190  6569 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:16:21.497623  6662 consensus_peers.cc:597] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a -> Peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Couldn't send request to peer 7abeed0e8edf41809baa2d97c88c6b28. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:40447: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:21.675954  6736 consensus_peers.cc:597] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 3972da3671ef401bbc841052ea9c5588 -> Peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Couldn't send request to peer 7abeed0e8edf41809baa2d97c88c6b28. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:40447: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:21.989048  6736 consensus_peers.cc:597] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 -> Peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Couldn't send request to peer 7abeed0e8edf41809baa2d97c88c6b28. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:40447: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:22.017434  6662 consensus_peers.cc:597] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a -> Peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Couldn't send request to peer 7abeed0e8edf41809baa2d97c88c6b28. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:40447: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:22.260066  6736 consensus_peers.cc:597] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 -> Peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Couldn't send request to peer 7abeed0e8edf41809baa2d97c88c6b28. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:40447: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:16:22.351660  6736 consensus_peers.cc:597] T 99642a0c8f7941bca524315ff82e60da P 3972da3671ef401bbc841052ea9c5588 -> Peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Couldn't send request to peer 7abeed0e8edf41809baa2d97c88c6b28. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:40447: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:22.358752  6736 consensus_peers.cc:597] T f48bbc412be247c59a7817c33136ceee P 3972da3671ef401bbc841052ea9c5588 -> Peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Couldn't send request to peer 7abeed0e8edf41809baa2d97c88c6b28. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:40447: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:22.427354  6662 consensus_peers.cc:597] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a -> Peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Couldn't send request to peer 7abeed0e8edf41809baa2d97c88c6b28. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:40447: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:22.432494  6569 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:16:22.546192 28234 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:22.555912  6922 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:22.557399  6921 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:22.559041  6924 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:22.560149 28234 server_base.cc:1061] running on GCE node
I20260709 13:16:22.561612 28234 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:22.561841 28234 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:22.562114 28234 hybrid_clock.cc:648] HybridClock initialized: now 1783602982562093 us; error 0 us; skew 500 ppm
I20260709 13:16:22.562798 28234 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:22.566102 28234 webserver.cc:533] Webserver started at http://127.27.146.129:41389/ using document root <none> and password file <none>
I20260709 13:16:22.566807 28234 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:22.567045 28234 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:16:22.571697 28234 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:16:22.578267  6929 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:22.579397 28234 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.006s	sys 0.001s
I20260709 13:16:22.579823 28234 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602648606606-28234-0/minicluster-data/ts-0-root
uuid: "7abeed0e8edf41809baa2d97c88c6b28"
format_stamp: "Formatted at 2026-07-09 13:16:15 on dist-test-slave-clfv"
I20260709 13:16:22.580265 28234 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602648606606-28234-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602648606606-28234-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602648606606-28234-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:22.612744 28234 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:22.614627 28234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:22.617002 28234 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:22.623133  6936 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:16:22.623469  6736 consensus_peers.cc:597] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 3972da3671ef401bbc841052ea9c5588 -> Peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Couldn't send request to peer 7abeed0e8edf41809baa2d97c88c6b28. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:40447: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:16:22.643965  6736 consensus_peers.cc:597] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 -> Peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Couldn't send request to peer 7abeed0e8edf41809baa2d97c88c6b28. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:40447: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:16:22.678841 28234 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:16:22.679220 28234 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.058s	user 0.004s	sys 0.000s
I20260709 13:16:22.679617 28234 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:16:22.685927  6936 tablet_bootstrap.cc:492] T 571acba5e0524805ba100b31450f461c P 7abeed0e8edf41809baa2d97c88c6b28: Bootstrap starting.
I20260709 13:16:22.702154  6936 tablet_bootstrap.cc:492] T 571acba5e0524805ba100b31450f461c P 7abeed0e8edf41809baa2d97c88c6b28: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:22.703078  6936 tablet_bootstrap.cc:492] T 571acba5e0524805ba100b31450f461c P 7abeed0e8edf41809baa2d97c88c6b28: Bootstrap complete.
I20260709 13:16:22.703792  6936 ts_tablet_manager.cc:1403] T 571acba5e0524805ba100b31450f461c P 7abeed0e8edf41809baa2d97c88c6b28: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 13:16:22.706921  6936 raft_consensus.cc:359] T 571acba5e0524805ba100b31450f461c P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:22.708252  6936 raft_consensus.cc:740] T 571acba5e0524805ba100b31450f461c P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7abeed0e8edf41809baa2d97c88c6b28, State: Initialized, Role: FOLLOWER
I20260709 13:16:22.709252  6936 consensus_queue.cc:260] T 571acba5e0524805ba100b31450f461c P 7abeed0e8edf41809baa2d97c88c6b28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:22.712958  6936 ts_tablet_manager.cc:1434] T 571acba5e0524805ba100b31450f461c P 7abeed0e8edf41809baa2d97c88c6b28: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.005s
I20260709 13:16:22.713841  6936 tablet_bootstrap.cc:492] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 7abeed0e8edf41809baa2d97c88c6b28: Bootstrap starting.
I20260709 13:16:22.732241  6936 tablet_bootstrap.cc:492] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 7abeed0e8edf41809baa2d97c88c6b28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:22.733256  6936 tablet_bootstrap.cc:492] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 7abeed0e8edf41809baa2d97c88c6b28: Bootstrap complete.
I20260709 13:16:22.733986  6936 ts_tablet_manager.cc:1403] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 7abeed0e8edf41809baa2d97c88c6b28: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 13:16:22.736855  6936 raft_consensus.cc:359] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:22.737598  6936 raft_consensus.cc:740] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7abeed0e8edf41809baa2d97c88c6b28, State: Initialized, Role: FOLLOWER
I20260709 13:16:22.738349  6936 consensus_queue.cc:260] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 7abeed0e8edf41809baa2d97c88c6b28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:22.740446  6936 ts_tablet_manager.cc:1434] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 7abeed0e8edf41809baa2d97c88c6b28: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:16:22.741351  6936 tablet_bootstrap.cc:492] T ef0cd7434a044f94a030340fabe9f8fc P 7abeed0e8edf41809baa2d97c88c6b28: Bootstrap starting.
I20260709 13:16:22.745760 28234 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:16:22.746177 28234 ts_tablet_manager.cc:595] Time spent register tablets: real 0.067s	user 0.057s	sys 0.007s
I20260709 13:16:22.758976  6936 tablet_bootstrap.cc:492] T ef0cd7434a044f94a030340fabe9f8fc P 7abeed0e8edf41809baa2d97c88c6b28: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:22.760370  6936 tablet_bootstrap.cc:492] T ef0cd7434a044f94a030340fabe9f8fc P 7abeed0e8edf41809baa2d97c88c6b28: Bootstrap complete.
I20260709 13:16:22.761175  6936 ts_tablet_manager.cc:1403] T ef0cd7434a044f94a030340fabe9f8fc P 7abeed0e8edf41809baa2d97c88c6b28: Time spent bootstrapping tablet: real 0.020s	user 0.005s	sys 0.012s
I20260709 13:16:22.765034  6936 raft_consensus.cc:359] T ef0cd7434a044f94a030340fabe9f8fc P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:22.765969  6936 raft_consensus.cc:740] T ef0cd7434a044f94a030340fabe9f8fc P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7abeed0e8edf41809baa2d97c88c6b28, State: Initialized, Role: FOLLOWER
I20260709 13:16:22.767098  6936 consensus_queue.cc:260] T ef0cd7434a044f94a030340fabe9f8fc P 7abeed0e8edf41809baa2d97c88c6b28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:22.769898  6936 ts_tablet_manager.cc:1434] T ef0cd7434a044f94a030340fabe9f8fc P 7abeed0e8edf41809baa2d97c88c6b28: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.001s
I20260709 13:16:22.770995  6936 tablet_bootstrap.cc:492] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28: Bootstrap starting.
I20260709 13:16:22.790944  6936 tablet_bootstrap.cc:492] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:16:22.791967  6936 tablet_bootstrap.cc:492] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28: Bootstrap complete.
I20260709 13:16:22.792613  6936 ts_tablet_manager.cc:1403] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.015s
I20260709 13:16:22.794795  6936 raft_consensus.cc:359] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:22.795614  6936 raft_consensus.cc:740] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7abeed0e8edf41809baa2d97c88c6b28, State: Initialized, Role: FOLLOWER
I20260709 13:16:22.796502  6936 consensus_queue.cc:260] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:22.798237  6936 ts_tablet_manager.cc:1434] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:16:22.799175  6936 tablet_bootstrap.cc:492] T 99642a0c8f7941bca524315ff82e60da P 7abeed0e8edf41809baa2d97c88c6b28: Bootstrap starting.
I20260709 13:16:22.812830  6936 tablet_bootstrap.cc:492] T 99642a0c8f7941bca524315ff82e60da P 7abeed0e8edf41809baa2d97c88c6b28: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:22.813632  6936 tablet_bootstrap.cc:492] T 99642a0c8f7941bca524315ff82e60da P 7abeed0e8edf41809baa2d97c88c6b28: Bootstrap complete.
I20260709 13:16:22.814312  6936 ts_tablet_manager.cc:1403] T 99642a0c8f7941bca524315ff82e60da P 7abeed0e8edf41809baa2d97c88c6b28: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 13:16:22.816933  6936 raft_consensus.cc:359] T 99642a0c8f7941bca524315ff82e60da P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:22.817510  6936 raft_consensus.cc:740] T 99642a0c8f7941bca524315ff82e60da P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7abeed0e8edf41809baa2d97c88c6b28, State: Initialized, Role: FOLLOWER
I20260709 13:16:22.818250  6936 consensus_queue.cc:260] T 99642a0c8f7941bca524315ff82e60da P 7abeed0e8edf41809baa2d97c88c6b28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:22.819093 28234 rpc_server.cc:307] RPC server started. Bound to: 127.27.146.129:40447
I20260709 13:16:22.820322  6936 ts_tablet_manager.cc:1434] T 99642a0c8f7941bca524315ff82e60da P 7abeed0e8edf41809baa2d97c88c6b28: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:16:22.819209  6998 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.146.129:40447 every 8 connection(s)
I20260709 13:16:22.821319  6936 tablet_bootstrap.cc:492] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28: Bootstrap starting.
I20260709 13:16:22.825105 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:22.868078  6999 heartbeater.cc:344] Connected to a master server at 127.27.146.190:36709
I20260709 13:16:22.869239  6999 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:22.873827  6999 heartbeater.cc:507] Master 127.27.146.190:36709 requested a full tablet report, sending...
I20260709 13:16:22.893219  6520 ts_manager.cc:194] Re-registered known tserver with Master: 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447)
I20260709 13:16:22.898977  6936 tablet_bootstrap.cc:492] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:16:22.900669  6936 tablet_bootstrap.cc:492] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28: Bootstrap complete.
I20260709 13:16:22.901839  6936 ts_tablet_manager.cc:1403] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28: Time spent bootstrapping tablet: real 0.081s	user 0.031s	sys 0.036s
I20260709 13:16:22.905094  6771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31789365471247b58419c92a028a9afc"
dest_uuid: "3972da3671ef401bbc841052ea9c5588"
mode: GRACEFUL
new_leader_uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
 from {username='slave'} at 127.0.0.1:34342
I20260709 13:16:22.905184  6936 raft_consensus.cc:359] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:22.906179  6771 raft_consensus.cc:606] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [term 2 LEADER]: Received request to transfer leadership to TS d8632beb9efb4ce4a1d87e0c854b639a
I20260709 13:16:22.906378  6936 raft_consensus.cc:740] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7abeed0e8edf41809baa2d97c88c6b28, State: Initialized, Role: FOLLOWER
I20260709 13:16:22.907464  6936 consensus_queue.cc:260] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:22.910043  6520 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43914
I20260709 13:16:22.910476  6936 ts_tablet_manager.cc:1434] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:16:22.911042  6771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef0cd7434a044f94a030340fabe9f8fc"
dest_uuid: "3972da3671ef401bbc841052ea9c5588"
mode: GRACEFUL
new_leader_uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
 from {username='slave'} at 127.0.0.1:34342
I20260709 13:16:22.913206  6936 tablet_bootstrap.cc:492] T f48bbc412be247c59a7817c33136ceee P 7abeed0e8edf41809baa2d97c88c6b28: Bootstrap starting.
I20260709 13:16:22.913429  6771 raft_consensus.cc:606] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [term 1 LEADER]: Received request to transfer leadership to TS d8632beb9efb4ce4a1d87e0c854b639a
I20260709 13:16:22.917645  6771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f48bbc412be247c59a7817c33136ceee"
dest_uuid: "3972da3671ef401bbc841052ea9c5588"
mode: GRACEFUL
new_leader_uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
 from {username='slave'} at 127.0.0.1:34342
I20260709 13:16:22.918462  6771 raft_consensus.cc:606] T f48bbc412be247c59a7817c33136ceee P 3972da3671ef401bbc841052ea9c5588 [term 1 LEADER]: Received request to transfer leadership to TS d8632beb9efb4ce4a1d87e0c854b639a
I20260709 13:16:22.919840  6999 heartbeater.cc:499] Master 127.27.146.190:36709 was elected leader, sending a full tablet report...
I20260709 13:16:22.921519 28234 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:16:22.922228 28234 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:22.922602  7007 raft_consensus.cc:993] T f48bbc412be247c59a7817c33136ceee P 3972da3671ef401bbc841052ea9c5588: : Instructing follower d8632beb9efb4ce4a1d87e0c854b639a to start an election
I20260709 13:16:22.923161 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:22.923422  6919 raft_consensus.cc:1081] T f48bbc412be247c59a7817c33136ceee P 3972da3671ef401bbc841052ea9c5588 [term 1 LEADER]: Signalling peer d8632beb9efb4ce4a1d87e0c854b639a to start an election
I20260709 13:16:22.925799  6698 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f48bbc412be247c59a7817c33136ceee"
dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
 from {username='slave'} at 127.0.0.1:44926
I20260709 13:16:22.926306  6698 raft_consensus.cc:493] T f48bbc412be247c59a7817c33136ceee P d8632beb9efb4ce4a1d87e0c854b639a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:22.926625  6698 raft_consensus.cc:3060] T f48bbc412be247c59a7817c33136ceee P d8632beb9efb4ce4a1d87e0c854b639a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.937217  6698 raft_consensus.cc:515] T f48bbc412be247c59a7817c33136ceee P d8632beb9efb4ce4a1d87e0c854b639a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:22.938923  6936 tablet_bootstrap.cc:492] T f48bbc412be247c59a7817c33136ceee P 7abeed0e8edf41809baa2d97c88c6b28: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:22.940155  6936 tablet_bootstrap.cc:492] T f48bbc412be247c59a7817c33136ceee P 7abeed0e8edf41809baa2d97c88c6b28: Bootstrap complete.
I20260709 13:16:22.941123  6936 ts_tablet_manager.cc:1403] T f48bbc412be247c59a7817c33136ceee P 7abeed0e8edf41809baa2d97c88c6b28: Time spent bootstrapping tablet: real 0.028s	user 0.019s	sys 0.007s
I20260709 13:16:22.943924  6936 raft_consensus.cc:359] T f48bbc412be247c59a7817c33136ceee P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:22.944522  6936 raft_consensus.cc:740] T f48bbc412be247c59a7817c33136ceee P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7abeed0e8edf41809baa2d97c88c6b28, State: Initialized, Role: FOLLOWER
I20260709 13:16:22.945263  6936 consensus_queue.cc:260] T f48bbc412be247c59a7817c33136ceee P 7abeed0e8edf41809baa2d97c88c6b28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:22.945444  6771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48bbc412be247c59a7817c33136ceee" candidate_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3972da3671ef401bbc841052ea9c5588"
I20260709 13:16:22.946451  6771 raft_consensus.cc:3055] T f48bbc412be247c59a7817c33136ceee P 3972da3671ef401bbc841052ea9c5588 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:22.946822  6771 raft_consensus.cc:740] T f48bbc412be247c59a7817c33136ceee P 3972da3671ef401bbc841052ea9c5588 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3972da3671ef401bbc841052ea9c5588, State: Running, Role: LEADER
I20260709 13:16:22.947028  6698 leader_election.cc:290] T f48bbc412be247c59a7817c33136ceee P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 2 election: Requested vote from peers 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447), 3972da3671ef401bbc841052ea9c5588 (127.27.146.131:44041)
I20260709 13:16:22.948035  6936 ts_tablet_manager.cc:1434] T f48bbc412be247c59a7817c33136ceee P 7abeed0e8edf41809baa2d97c88c6b28: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:22.948226  6771 consensus_queue.cc:260] T f48bbc412be247c59a7817c33136ceee P 3972da3671ef401bbc841052ea9c5588 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:22.949057  6936 tablet_bootstrap.cc:492] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28: Bootstrap starting.
I20260709 13:16:22.949934  6771 raft_consensus.cc:3060] T f48bbc412be247c59a7817c33136ceee P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.958606  6971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f48bbc412be247c59a7817c33136ceee" candidate_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7abeed0e8edf41809baa2d97c88c6b28"
I20260709 13:16:22.959450  6971 raft_consensus.cc:3060] T f48bbc412be247c59a7817c33136ceee P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.963085  6771 raft_consensus.cc:2468] T f48bbc412be247c59a7817c33136ceee P 3972da3671ef401bbc841052ea9c5588 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8632beb9efb4ce4a1d87e0c854b639a in term 2.
I20260709 13:16:22.965016  6663 leader_election.cc:304] T f48bbc412be247c59a7817c33136ceee P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3972da3671ef401bbc841052ea9c5588, d8632beb9efb4ce4a1d87e0c854b639a; no voters: 
I20260709 13:16:22.966125  6887 raft_consensus.cc:2804] T f48bbc412be247c59a7817c33136ceee P d8632beb9efb4ce4a1d87e0c854b639a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:22.971655  6887 raft_consensus.cc:697] T f48bbc412be247c59a7817c33136ceee P d8632beb9efb4ce4a1d87e0c854b639a [term 2 LEADER]: Becoming Leader. State: Replica: d8632beb9efb4ce4a1d87e0c854b639a, State: Running, Role: LEADER
I20260709 13:16:22.973448  6887 consensus_queue.cc:237] T f48bbc412be247c59a7817c33136ceee P d8632beb9efb4ce4a1d87e0c854b639a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:22.976713  6971 raft_consensus.cc:2468] T f48bbc412be247c59a7817c33136ceee P 7abeed0e8edf41809baa2d97c88c6b28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8632beb9efb4ce4a1d87e0c854b639a in term 2.
I20260709 13:16:22.979153  6936 tablet_bootstrap.cc:492] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:16:22.980588  6936 tablet_bootstrap.cc:492] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28: Bootstrap complete.
I20260709 13:16:22.981570  6936 ts_tablet_manager.cc:1403] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28: Time spent bootstrapping tablet: real 0.033s	user 0.022s	sys 0.008s
I20260709 13:16:22.984628  6936 raft_consensus.cc:359] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:22.985800  6936 raft_consensus.cc:740] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7abeed0e8edf41809baa2d97c88c6b28, State: Initialized, Role: FOLLOWER
I20260709 13:16:22.985121  6520 catalog_manager.cc:5697] T f48bbc412be247c59a7817c33136ceee P d8632beb9efb4ce4a1d87e0c854b639a reported cstate change: term changed from 1 to 2, leader changed from 3972da3671ef401bbc841052ea9c5588 (127.27.146.131) to d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130). New cstate: current_term: 2 leader_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:22.986693  6936 consensus_queue.cc:260] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:22.989463  6936 ts_tablet_manager.cc:1434] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:16:22.990762  6936 tablet_bootstrap.cc:492] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 7abeed0e8edf41809baa2d97c88c6b28: Bootstrap starting.
I20260709 13:16:23.010702  6936 tablet_bootstrap.cc:492] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 7abeed0e8edf41809baa2d97c88c6b28: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:23.011962  6936 tablet_bootstrap.cc:492] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 7abeed0e8edf41809baa2d97c88c6b28: Bootstrap complete.
I20260709 13:16:23.012874  6936 ts_tablet_manager.cc:1403] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 7abeed0e8edf41809baa2d97c88c6b28: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.003s
I20260709 13:16:23.016903  6936 raft_consensus.cc:359] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:23.018024  6936 raft_consensus.cc:740] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7abeed0e8edf41809baa2d97c88c6b28, State: Initialized, Role: FOLLOWER
I20260709 13:16:23.018800  6919 raft_consensus.cc:993] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588: : Instructing follower d8632beb9efb4ce4a1d87e0c854b639a to start an election
I20260709 13:16:23.019459  6919 raft_consensus.cc:1081] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [term 2 LEADER]: Signalling peer d8632beb9efb4ce4a1d87e0c854b639a to start an election
I20260709 13:16:23.019099  6936 consensus_queue.cc:260] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 7abeed0e8edf41809baa2d97c88c6b28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:23.021981  6698 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "31789365471247b58419c92a028a9afc"
dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
 from {username='slave'} at 127.0.0.1:44926
I20260709 13:16:23.022676  6698 raft_consensus.cc:493] T 31789365471247b58419c92a028a9afc P d8632beb9efb4ce4a1d87e0c854b639a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:23.023140  6698 raft_consensus.cc:3060] T 31789365471247b58419c92a028a9afc P d8632beb9efb4ce4a1d87e0c854b639a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:23.024381  6936 ts_tablet_manager.cc:1434] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 7abeed0e8edf41809baa2d97c88c6b28: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:16:23.025460  6936 tablet_bootstrap.cc:492] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28: Bootstrap starting.
I20260709 13:16:23.032871  6698 raft_consensus.cc:515] T 31789365471247b58419c92a028a9afc P d8632beb9efb4ce4a1d87e0c854b639a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:23.035342  6698 leader_election.cc:290] T 31789365471247b58419c92a028a9afc P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 3 election: Requested vote from peers 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447), 3972da3671ef401bbc841052ea9c5588 (127.27.146.131:44041)
I20260709 13:16:23.036585  6771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31789365471247b58419c92a028a9afc" candidate_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3972da3671ef401bbc841052ea9c5588"
I20260709 13:16:23.036525  6971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31789365471247b58419c92a028a9afc" candidate_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7abeed0e8edf41809baa2d97c88c6b28"
I20260709 13:16:23.037695  6971 raft_consensus.cc:3060] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:16:23.037714  6771 raft_consensus.cc:3055] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:23.038326  6771 raft_consensus.cc:740] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3972da3671ef401bbc841052ea9c5588, State: Running, Role: LEADER
I20260709 13:16:23.039371  6771 consensus_queue.cc:260] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:23.041088  6771 raft_consensus.cc:3060] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:23.045138  6936 tablet_bootstrap.cc:492] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:23.046401  6936 tablet_bootstrap.cc:492] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28: Bootstrap complete.
I20260709 13:16:23.047215  6936 ts_tablet_manager.cc:1403] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.004s
I20260709 13:16:23.048563  6971 raft_consensus.cc:2468] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8632beb9efb4ce4a1d87e0c854b639a in term 3.
I20260709 13:16:23.049794  6662 leader_election.cc:304] T 31789365471247b58419c92a028a9afc P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7abeed0e8edf41809baa2d97c88c6b28, d8632beb9efb4ce4a1d87e0c854b639a; no voters: 
I20260709 13:16:23.050635  6887 raft_consensus.cc:2804] T 31789365471247b58419c92a028a9afc P d8632beb9efb4ce4a1d87e0c854b639a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:23.050252  6936 raft_consensus.cc:359] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:23.051043  6771 raft_consensus.cc:2468] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8632beb9efb4ce4a1d87e0c854b639a in term 3.
I20260709 13:16:23.051194  6887 raft_consensus.cc:697] T 31789365471247b58419c92a028a9afc P d8632beb9efb4ce4a1d87e0c854b639a [term 3 LEADER]: Becoming Leader. State: Replica: d8632beb9efb4ce4a1d87e0c854b639a, State: Running, Role: LEADER
I20260709 13:16:23.051124  6936 raft_consensus.cc:740] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7abeed0e8edf41809baa2d97c88c6b28, State: Initialized, Role: FOLLOWER
I20260709 13:16:23.053649  6936 consensus_queue.cc:260] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:23.053791  6887 consensus_queue.cc:237] T 31789365471247b58419c92a028a9afc P d8632beb9efb4ce4a1d87e0c854b639a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:23.056241  6936 ts_tablet_manager.cc:1434] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:16:23.063150  6520 catalog_manager.cc:5697] T 31789365471247b58419c92a028a9afc P d8632beb9efb4ce4a1d87e0c854b639a reported cstate change: term changed from 2 to 3, leader changed from 3972da3671ef401bbc841052ea9c5588 (127.27.146.131) to d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130). New cstate: current_term: 3 leader_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:23.065805  6919 raft_consensus.cc:993] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588: : Instructing follower d8632beb9efb4ce4a1d87e0c854b639a to start an election
I20260709 13:16:23.066442  7007 raft_consensus.cc:1081] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [term 1 LEADER]: Signalling peer d8632beb9efb4ce4a1d87e0c854b639a to start an election
I20260709 13:16:23.069344  6698 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef0cd7434a044f94a030340fabe9f8fc"
dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
 from {username='slave'} at 127.0.0.1:44926
I20260709 13:16:23.069993  6698 raft_consensus.cc:493] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:23.070192  6971 raft_consensus.cc:3060] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.070495  6698 raft_consensus.cc:3060] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.077214  6971 pending_rounds.cc:85] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28: Aborting all ops after (but not including) 0
I20260709 13:16:23.077616  6971 pending_rounds.cc:107] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:16:23.078008  6971 raft_consensus.cc:2889] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:23.082101  6698 raft_consensus.cc:515] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:23.084970  6698 leader_election.cc:290] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 2 election: Requested vote from peers 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447), 3972da3671ef401bbc841052ea9c5588 (127.27.146.131:44041)
I20260709 13:16:23.086069  6972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef0cd7434a044f94a030340fabe9f8fc" candidate_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7abeed0e8edf41809baa2d97c88c6b28"
I20260709 13:16:23.086676  6972 raft_consensus.cc:3060] T ef0cd7434a044f94a030340fabe9f8fc P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.091552  6970 raft_consensus.cc:3060] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.092160  6771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef0cd7434a044f94a030340fabe9f8fc" candidate_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3972da3671ef401bbc841052ea9c5588"
I20260709 13:16:23.092870  6771 raft_consensus.cc:3055] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:23.093180  6771 raft_consensus.cc:740] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3972da3671ef401bbc841052ea9c5588, State: Running, Role: LEADER
I20260709 13:16:23.094247  6771 consensus_queue.cc:260] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:23.095847  6771 raft_consensus.cc:3060] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.098073  6972 raft_consensus.cc:2468] T ef0cd7434a044f94a030340fabe9f8fc P 7abeed0e8edf41809baa2d97c88c6b28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8632beb9efb4ce4a1d87e0c854b639a in term 2.
I20260709 13:16:23.099969  6662 leader_election.cc:304] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7abeed0e8edf41809baa2d97c88c6b28, d8632beb9efb4ce4a1d87e0c854b639a; no voters: 
I20260709 13:16:23.100872  6887 raft_consensus.cc:2804] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:23.101644  6887 raft_consensus.cc:697] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a [term 2 LEADER]: Becoming Leader. State: Replica: d8632beb9efb4ce4a1d87e0c854b639a, State: Running, Role: LEADER
I20260709 13:16:23.103631  6887 consensus_queue.cc:237] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:23.106328  6771 raft_consensus.cc:2468] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8632beb9efb4ce4a1d87e0c854b639a in term 2.
I20260709 13:16:23.108160  6970 pending_rounds.cc:85] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28: Aborting all ops after (but not including) 0
I20260709 13:16:23.108579  6970 pending_rounds.cc:107] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:16:23.108847  6970 raft_consensus.cc:2889] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:23.113410  6520 catalog_manager.cc:5697] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a reported cstate change: term changed from 1 to 2, leader changed from 3972da3671ef401bbc841052ea9c5588 (127.27.146.131) to d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130). New cstate: current_term: 2 leader_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:23.182128  6970 raft_consensus.cc:3060] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:23.433580  6569 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:16:23.493770  6970 raft_consensus.cc:1275] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28 [term 3 FOLLOWER]: Refusing update from remote peer d8632beb9efb4ce4a1d87e0c854b639a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:23.495688  6887 consensus_queue.cc:1048] T 31789365471247b58419c92a028a9afc P d8632beb9efb4ce4a1d87e0c854b639a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:23.498345  6970 raft_consensus.cc:1275] T f48bbc412be247c59a7817c33136ceee P 7abeed0e8edf41809baa2d97c88c6b28 [term 2 FOLLOWER]: Refusing update from remote peer d8632beb9efb4ce4a1d87e0c854b639a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:23.499363  6771 raft_consensus.cc:1275] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [term 3 FOLLOWER]: Refusing update from remote peer d8632beb9efb4ce4a1d87e0c854b639a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:23.501294  6887 consensus_queue.cc:1048] T 31789365471247b58419c92a028a9afc P d8632beb9efb4ce4a1d87e0c854b639a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:23.501585  7012 consensus_queue.cc:1048] T f48bbc412be247c59a7817c33136ceee P d8632beb9efb4ce4a1d87e0c854b639a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:23.547119  6771 raft_consensus.cc:1275] T f48bbc412be247c59a7817c33136ceee P 3972da3671ef401bbc841052ea9c5588 [term 2 FOLLOWER]: Refusing update from remote peer d8632beb9efb4ce4a1d87e0c854b639a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:23.549039  6887 consensus_queue.cc:1048] T f48bbc412be247c59a7817c33136ceee P d8632beb9efb4ce4a1d87e0c854b639a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:23.615015  6769 raft_consensus.cc:1275] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [term 2 FOLLOWER]: Refusing update from remote peer d8632beb9efb4ce4a1d87e0c854b639a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:23.616822  7035 consensus_queue.cc:1048] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:23.629305  6971 raft_consensus.cc:1275] T ef0cd7434a044f94a030340fabe9f8fc P 7abeed0e8edf41809baa2d97c88c6b28 [term 2 FOLLOWER]: Refusing update from remote peer d8632beb9efb4ce4a1d87e0c854b639a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:23.631150  7035 consensus_queue.cc:1048] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:23.642763  6970 raft_consensus.cc:3060] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.938724 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:23.959908  6698 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47dc18fd364c4b079b99900a766e3208"
dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
mode: GRACEFUL
new_leader_uuid: "3972da3671ef401bbc841052ea9c5588"
 from {username='slave'} at 127.0.0.1:57362
I20260709 13:16:23.960747  6698 raft_consensus.cc:606] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [term 2 LEADER]: Received request to transfer leadership to TS 3972da3671ef401bbc841052ea9c5588
I20260709 13:16:23.964275  6698 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "571acba5e0524805ba100b31450f461c"
dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
mode: GRACEFUL
new_leader_uuid: "3972da3671ef401bbc841052ea9c5588"
 from {username='slave'} at 127.0.0.1:57362
I20260709 13:16:23.964797  6698 raft_consensus.cc:606] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a [term 1 LEADER]: Received request to transfer leadership to TS 3972da3671ef401bbc841052ea9c5588
I20260709 13:16:23.965982 28234 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:16:23.966662 28234 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:23.967600 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:24.050639  6887 raft_consensus.cc:993] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a: : Instructing follower 3972da3671ef401bbc841052ea9c5588 to start an election
I20260709 13:16:24.051330  7033 raft_consensus.cc:1081] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a [term 1 LEADER]: Signalling peer 3972da3671ef401bbc841052ea9c5588 to start an election
I20260709 13:16:24.053211  6769 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "571acba5e0524805ba100b31450f461c"
dest_uuid: "3972da3671ef401bbc841052ea9c5588"
 from {username='slave'} at 127.0.0.1:38738
I20260709 13:16:24.053821  6769 raft_consensus.cc:493] T 571acba5e0524805ba100b31450f461c P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:24.054144  6769 raft_consensus.cc:3060] T 571acba5e0524805ba100b31450f461c P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:24.062335  6769 raft_consensus.cc:515] T 571acba5e0524805ba100b31450f461c P 3972da3671ef401bbc841052ea9c5588 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:24.064479  6769 leader_election.cc:290] T 571acba5e0524805ba100b31450f461c P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 2 election: Requested vote from peers 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447), d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419)
I20260709 13:16:24.065727  6698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "571acba5e0524805ba100b31450f461c" candidate_uuid: "3972da3671ef401bbc841052ea9c5588" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
I20260709 13:16:24.065824  6970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "571acba5e0524805ba100b31450f461c" candidate_uuid: "3972da3671ef401bbc841052ea9c5588" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7abeed0e8edf41809baa2d97c88c6b28"
I20260709 13:16:24.066411  6698 raft_consensus.cc:3055] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:24.066620  6970 raft_consensus.cc:3060] T 571acba5e0524805ba100b31450f461c P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:24.066752  6698 raft_consensus.cc:740] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d8632beb9efb4ce4a1d87e0c854b639a, State: Running, Role: LEADER
I20260709 13:16:24.067687  6698 consensus_queue.cc:260] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:24.068704  6698 raft_consensus.cc:3060] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:24.074844  6698 raft_consensus.cc:2468] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3972da3671ef401bbc841052ea9c5588 in term 2.
I20260709 13:16:24.075886  6970 raft_consensus.cc:2468] T 571acba5e0524805ba100b31450f461c P 7abeed0e8edf41809baa2d97c88c6b28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3972da3671ef401bbc841052ea9c5588 in term 2.
I20260709 13:16:24.076010  6736 leader_election.cc:304] T 571acba5e0524805ba100b31450f461c P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3972da3671ef401bbc841052ea9c5588, d8632beb9efb4ce4a1d87e0c854b639a; no voters: 
I20260709 13:16:24.077081  7007 raft_consensus.cc:2804] T 571acba5e0524805ba100b31450f461c P 3972da3671ef401bbc841052ea9c5588 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:24.077663  7007 raft_consensus.cc:697] T 571acba5e0524805ba100b31450f461c P 3972da3671ef401bbc841052ea9c5588 [term 2 LEADER]: Becoming Leader. State: Replica: 3972da3671ef401bbc841052ea9c5588, State: Running, Role: LEADER
I20260709 13:16:24.078433  7007 consensus_queue.cc:237] T 571acba5e0524805ba100b31450f461c P 3972da3671ef401bbc841052ea9c5588 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:24.086684  6520 catalog_manager.cc:5697] T 571acba5e0524805ba100b31450f461c P 3972da3671ef401bbc841052ea9c5588 reported cstate change: term changed from 1 to 2, leader changed from d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130) to 3972da3671ef401bbc841052ea9c5588 (127.27.146.131). New cstate: current_term: 2 leader_uuid: "3972da3671ef401bbc841052ea9c5588" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:24.434638  6569 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:16:24.528466  7033 raft_consensus.cc:993] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a: : Instructing follower 3972da3671ef401bbc841052ea9c5588 to start an election
I20260709 13:16:24.529140  7035 raft_consensus.cc:1081] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [term 2 LEADER]: Signalling peer 3972da3671ef401bbc841052ea9c5588 to start an election
I20260709 13:16:24.530779  6769 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47dc18fd364c4b079b99900a766e3208"
dest_uuid: "3972da3671ef401bbc841052ea9c5588"
 from {username='slave'} at 127.0.0.1:38738
I20260709 13:16:24.531260  6769 raft_consensus.cc:493] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:24.531738  6769 raft_consensus.cc:3060] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:24.536988  6769 raft_consensus.cc:515] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:24.539237  6769 leader_election.cc:290] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 3 election: Requested vote from peers 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447), d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419)
I20260709 13:16:24.540068  6970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47dc18fd364c4b079b99900a766e3208" candidate_uuid: "3972da3671ef401bbc841052ea9c5588" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7abeed0e8edf41809baa2d97c88c6b28"
I20260709 13:16:24.540688  6695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47dc18fd364c4b079b99900a766e3208" candidate_uuid: "3972da3671ef401bbc841052ea9c5588" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
I20260709 13:16:24.541000  6970 raft_consensus.cc:3060] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:24.541150  6698 raft_consensus.cc:1275] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a [term 2 FOLLOWER]: Refusing update from remote peer 3972da3671ef401bbc841052ea9c5588: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:24.541419  6695 raft_consensus.cc:3055] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:24.541864  6695 raft_consensus.cc:740] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d8632beb9efb4ce4a1d87e0c854b639a, State: Running, Role: LEADER
I20260709 13:16:24.542683  6695 consensus_queue.cc:260] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:24.543030  7007 consensus_queue.cc:1048] T 571acba5e0524805ba100b31450f461c P 3972da3671ef401bbc841052ea9c5588 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:24.544194  6695 raft_consensus.cc:3060] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:24.548210  6972 raft_consensus.cc:1275] T 571acba5e0524805ba100b31450f461c P 7abeed0e8edf41809baa2d97c88c6b28 [term 2 FOLLOWER]: Refusing update from remote peer 3972da3671ef401bbc841052ea9c5588: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:24.551577  6970 raft_consensus.cc:2468] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3972da3671ef401bbc841052ea9c5588 in term 3.
I20260709 13:16:24.551998  7027 consensus_queue.cc:1048] T 571acba5e0524805ba100b31450f461c P 3972da3671ef401bbc841052ea9c5588 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:16:24.554313  6695 raft_consensus.cc:2468] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3972da3671ef401bbc841052ea9c5588 in term 3.
I20260709 13:16:24.556315  6736 leader_election.cc:304] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3972da3671ef401bbc841052ea9c5588, d8632beb9efb4ce4a1d87e0c854b639a; no voters: 
I20260709 13:16:24.557407  7027 raft_consensus.cc:2804] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:24.558105  7027 raft_consensus.cc:697] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588 [term 3 LEADER]: Becoming Leader. State: Replica: 3972da3671ef401bbc841052ea9c5588, State: Running, Role: LEADER
I20260709 13:16:24.559561  7027 consensus_queue.cc:237] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:24.585250  6518 catalog_manager.cc:5697] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588 reported cstate change: term changed from 2 to 3, leader changed from d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130) to 3972da3671ef401bbc841052ea9c5588 (127.27.146.131). New cstate: current_term: 3 leader_uuid: "3972da3671ef401bbc841052ea9c5588" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:24.979004 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:24.988003  6698 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31789365471247b58419c92a028a9afc"
dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
mode: GRACEFUL
new_leader_uuid: "3972da3671ef401bbc841052ea9c5588"
 from {username='slave'} at 127.0.0.1:57362
I20260709 13:16:24.988675  6698 raft_consensus.cc:606] T 31789365471247b58419c92a028a9afc P d8632beb9efb4ce4a1d87e0c854b639a [term 3 LEADER]: Received request to transfer leadership to TS 3972da3671ef401bbc841052ea9c5588
I20260709 13:16:24.991657  6769 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43d643af6d3248da8abe7e13fd887cc1"
dest_uuid: "3972da3671ef401bbc841052ea9c5588"
mode: GRACEFUL
new_leader_uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
 from {username='slave'} at 127.0.0.1:34342
I20260709 13:16:24.992301  6769 raft_consensus.cc:606] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [term 2 LEADER]: Received request to transfer leadership to TS d8632beb9efb4ce4a1d87e0c854b639a
I20260709 13:16:24.995160  6769 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47dc18fd364c4b079b99900a766e3208"
dest_uuid: "3972da3671ef401bbc841052ea9c5588"
mode: GRACEFUL
new_leader_uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
 from {username='slave'} at 127.0.0.1:34342
I20260709 13:16:24.995802  6769 raft_consensus.cc:606] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588 [term 3 LEADER]: Received request to transfer leadership to TS d8632beb9efb4ce4a1d87e0c854b639a
I20260709 13:16:24.997324 28234 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:16:24.997901 28234 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:24.998533 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:25.118978  6970 raft_consensus.cc:1275] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28 [term 3 FOLLOWER]: Refusing update from remote peer 3972da3671ef401bbc841052ea9c5588: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:25.120712  7007 consensus_queue.cc:1048] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:25.134135  6698 raft_consensus.cc:1275] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [term 3 FOLLOWER]: Refusing update from remote peer 3972da3671ef401bbc841052ea9c5588: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:25.136502  7061 consensus_queue.cc:1048] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:25.146452  7061 raft_consensus.cc:993] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588: : Instructing follower d8632beb9efb4ce4a1d87e0c854b639a to start an election
I20260709 13:16:25.147078  7056 raft_consensus.cc:1081] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588 [term 3 LEADER]: Signalling peer d8632beb9efb4ce4a1d87e0c854b639a to start an election
I20260709 13:16:25.148686  6698 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47dc18fd364c4b079b99900a766e3208"
dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
 from {username='slave'} at 127.0.0.1:44926
I20260709 13:16:25.149217  6698 raft_consensus.cc:493] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:25.149585  6698 raft_consensus.cc:3060] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:25.154220  6698 raft_consensus.cc:515] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:25.156051  6698 leader_election.cc:290] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 4 election: Requested vote from peers 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447), 3972da3671ef401bbc841052ea9c5588 (127.27.146.131:44041)
I20260709 13:16:25.157338  6769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47dc18fd364c4b079b99900a766e3208" candidate_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3972da3671ef401bbc841052ea9c5588"
I20260709 13:16:25.157435  6970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47dc18fd364c4b079b99900a766e3208" candidate_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7abeed0e8edf41809baa2d97c88c6b28"
I20260709 13:16:25.158017  6769 raft_consensus.cc:3055] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:25.158504  6769 raft_consensus.cc:740] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3972da3671ef401bbc841052ea9c5588, State: Running, Role: LEADER
I20260709 13:16:25.158555  6970 raft_consensus.cc:3060] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:25.159538  6769 consensus_queue.cc:260] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:25.160986  6769 raft_consensus.cc:3060] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:25.166092  6970 raft_consensus.cc:2468] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8632beb9efb4ce4a1d87e0c854b639a in term 4.
I20260709 13:16:25.166743  6769 raft_consensus.cc:2468] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8632beb9efb4ce4a1d87e0c854b639a in term 4.
I20260709 13:16:25.168092  6662 leader_election.cc:304] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7abeed0e8edf41809baa2d97c88c6b28, d8632beb9efb4ce4a1d87e0c854b639a; no voters: 
I20260709 13:16:25.169171  7033 raft_consensus.cc:2804] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:25.170398  7033 raft_consensus.cc:697] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [term 4 LEADER]: Becoming Leader. State: Replica: d8632beb9efb4ce4a1d87e0c854b639a, State: Running, Role: LEADER
I20260709 13:16:25.171270  7033 consensus_queue.cc:237] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:25.177557  6520 catalog_manager.cc:5697] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a reported cstate change: term changed from 3 to 4, leader changed from 3972da3671ef401bbc841052ea9c5588 (127.27.146.131) to d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130). New cstate: current_term: 4 leader_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:25.435775  6569 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:16:25.474084  7064 raft_consensus.cc:993] T 31789365471247b58419c92a028a9afc P d8632beb9efb4ce4a1d87e0c854b639a: : Instructing follower 3972da3671ef401bbc841052ea9c5588 to start an election
I20260709 13:16:25.474691  7033 raft_consensus.cc:1081] T 31789365471247b58419c92a028a9afc P d8632beb9efb4ce4a1d87e0c854b639a [term 3 LEADER]: Signalling peer 3972da3671ef401bbc841052ea9c5588 to start an election
I20260709 13:16:25.476979  6769 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "31789365471247b58419c92a028a9afc"
dest_uuid: "3972da3671ef401bbc841052ea9c5588"
 from {username='slave'} at 127.0.0.1:38738
I20260709 13:16:25.478005  6769 raft_consensus.cc:493] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:25.478489  6769 raft_consensus.cc:3060] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:25.488744  6769 raft_consensus.cc:515] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:25.491808  6769 leader_election.cc:290] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 4 election: Requested vote from peers 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447), d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419)
I20260709 13:16:25.492208  6970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31789365471247b58419c92a028a9afc" candidate_uuid: "3972da3671ef401bbc841052ea9c5588" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7abeed0e8edf41809baa2d97c88c6b28"
I20260709 13:16:25.492537  6698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31789365471247b58419c92a028a9afc" candidate_uuid: "3972da3671ef401bbc841052ea9c5588" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
I20260709 13:16:25.492955  6970 raft_consensus.cc:3060] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:25.493263  6698 raft_consensus.cc:3055] T 31789365471247b58419c92a028a9afc P d8632beb9efb4ce4a1d87e0c854b639a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:25.493667  6698 raft_consensus.cc:740] T 31789365471247b58419c92a028a9afc P d8632beb9efb4ce4a1d87e0c854b639a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d8632beb9efb4ce4a1d87e0c854b639a, State: Running, Role: LEADER
I20260709 13:16:25.495186  6698 consensus_queue.cc:260] T 31789365471247b58419c92a028a9afc P d8632beb9efb4ce4a1d87e0c854b639a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:25.496635  6698 raft_consensus.cc:3060] T 31789365471247b58419c92a028a9afc P d8632beb9efb4ce4a1d87e0c854b639a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:25.500389  7007 raft_consensus.cc:993] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588: : Instructing follower d8632beb9efb4ce4a1d87e0c854b639a to start an election
I20260709 13:16:25.501006  7061 raft_consensus.cc:1081] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [term 2 LEADER]: Signalling peer d8632beb9efb4ce4a1d87e0c854b639a to start an election
I20260709 13:16:25.502327  6698 raft_consensus.cc:2468] T 31789365471247b58419c92a028a9afc P d8632beb9efb4ce4a1d87e0c854b639a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3972da3671ef401bbc841052ea9c5588 in term 4.
I20260709 13:16:25.502840  6970 raft_consensus.cc:2468] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3972da3671ef401bbc841052ea9c5588 in term 4.
I20260709 13:16:25.504277  6698 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43d643af6d3248da8abe7e13fd887cc1"
dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
 from {username='slave'} at 127.0.0.1:44926
I20260709 13:16:25.504542  6736 leader_election.cc:304] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3972da3671ef401bbc841052ea9c5588, d8632beb9efb4ce4a1d87e0c854b639a; no voters: 
I20260709 13:16:25.505035  6698 raft_consensus.cc:493] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:25.505484  7061 raft_consensus.cc:2804] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:25.505584  6698 raft_consensus.cc:3060] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:25.506124  7061 raft_consensus.cc:697] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [term 4 LEADER]: Becoming Leader. State: Replica: 3972da3671ef401bbc841052ea9c5588, State: Running, Role: LEADER
I20260709 13:16:25.507019  7061 consensus_queue.cc:237] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:25.514704  6520 catalog_manager.cc:5697] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 reported cstate change: term changed from 3 to 4, leader changed from d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130) to 3972da3671ef401bbc841052ea9c5588 (127.27.146.131). New cstate: current_term: 4 leader_uuid: "3972da3671ef401bbc841052ea9c5588" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:25.515190  6698 raft_consensus.cc:515] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:25.517824  6698 leader_election.cc:290] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 3 election: Requested vote from peers 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447), 3972da3671ef401bbc841052ea9c5588 (127.27.146.131:44041)
I20260709 13:16:25.518872  6970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43d643af6d3248da8abe7e13fd887cc1" candidate_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "7abeed0e8edf41809baa2d97c88c6b28"
I20260709 13:16:25.519639  6970 raft_consensus.cc:3060] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:25.519690  6769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43d643af6d3248da8abe7e13fd887cc1" candidate_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "3972da3671ef401bbc841052ea9c5588"
I20260709 13:16:25.520325  6769 raft_consensus.cc:3055] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:25.520673  6769 raft_consensus.cc:740] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3972da3671ef401bbc841052ea9c5588, State: Running, Role: LEADER
I20260709 13:16:25.521780  6769 consensus_queue.cc:260] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:25.523337  6769 raft_consensus.cc:3060] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:25.531540  6769 raft_consensus.cc:2468] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8632beb9efb4ce4a1d87e0c854b639a in term 3.
I20260709 13:16:25.533095  6663 leader_election.cc:304] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3972da3671ef401bbc841052ea9c5588, d8632beb9efb4ce4a1d87e0c854b639a; no voters: 
I20260709 13:16:25.533707  6970 raft_consensus.cc:2468] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8632beb9efb4ce4a1d87e0c854b639a in term 3.
I20260709 13:16:25.534086  7033 raft_consensus.cc:2804] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:25.534775  7033 raft_consensus.cc:697] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a [term 3 LEADER]: Becoming Leader. State: Replica: d8632beb9efb4ce4a1d87e0c854b639a, State: Running, Role: LEADER
I20260709 13:16:25.535889  7033 consensus_queue.cc:237] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:25.545341  6520 catalog_manager.cc:5697] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a reported cstate change: term changed from 2 to 3, leader changed from 3972da3671ef401bbc841052ea9c5588 (127.27.146.131) to d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130). New cstate: current_term: 3 leader_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:25.559792  6970 raft_consensus.cc:1275] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28 [term 4 FOLLOWER]: Refusing update from remote peer d8632beb9efb4ce4a1d87e0c854b639a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:25.562121  7033 consensus_queue.cc:1048] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:25.579695  6769 raft_consensus.cc:1275] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588 [term 4 FOLLOWER]: Refusing update from remote peer d8632beb9efb4ce4a1d87e0c854b639a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:25.581238  7064 consensus_queue.cc:1048] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:25.964200  6698 raft_consensus.cc:1275] T 31789365471247b58419c92a028a9afc P d8632beb9efb4ce4a1d87e0c854b639a [term 4 FOLLOWER]: Refusing update from remote peer 3972da3671ef401bbc841052ea9c5588: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:25.965559  7061 consensus_queue.cc:1048] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:25.982156  6972 raft_consensus.cc:1275] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28 [term 4 FOLLOWER]: Refusing update from remote peer 3972da3671ef401bbc841052ea9c5588: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:25.984174  7007 consensus_queue.cc:1048] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:26.005862 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:26.013401  6769 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "571acba5e0524805ba100b31450f461c"
dest_uuid: "3972da3671ef401bbc841052ea9c5588"
mode: GRACEFUL
new_leader_uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
 from {username='slave'} at 127.0.0.1:34342
I20260709 13:16:26.013949  6769 raft_consensus.cc:606] T 571acba5e0524805ba100b31450f461c P 3972da3671ef401bbc841052ea9c5588 [term 2 LEADER]: Received request to transfer leadership to TS d8632beb9efb4ce4a1d87e0c854b639a
I20260709 13:16:26.017184  6698 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d0a65bcc05d492e860cd9066fb0161a"
dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
mode: GRACEFUL
new_leader_uuid: "3972da3671ef401bbc841052ea9c5588"
 from {username='slave'} at 127.0.0.1:57362
I20260709 13:16:26.017715  6698 raft_consensus.cc:606] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [term 2 LEADER]: Received request to transfer leadership to TS 3972da3671ef401bbc841052ea9c5588
I20260709 13:16:26.020735  6698 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef0cd7434a044f94a030340fabe9f8fc"
dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
mode: GRACEFUL
new_leader_uuid: "3972da3671ef401bbc841052ea9c5588"
 from {username='slave'} at 127.0.0.1:57362
I20260709 13:16:26.021442  6698 raft_consensus.cc:606] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a [term 2 LEADER]: Received request to transfer leadership to TS 3972da3671ef401bbc841052ea9c5588
I20260709 13:16:26.022681 28234 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:16:26.023375 28234 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:26.024268 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:26.028680  6970 raft_consensus.cc:1275] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28 [term 3 FOLLOWER]: Refusing update from remote peer d8632beb9efb4ce4a1d87e0c854b639a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:26.030162  7064 consensus_queue.cc:1048] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:26.041955  6769 raft_consensus.cc:1275] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [term 3 FOLLOWER]: Refusing update from remote peer d8632beb9efb4ce4a1d87e0c854b639a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:26.043689  7071 consensus_queue.cc:1048] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:26.172650  7033 raft_consensus.cc:993] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a: : Instructing follower 3972da3671ef401bbc841052ea9c5588 to start an election
I20260709 13:16:26.173271  7071 raft_consensus.cc:1081] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a [term 2 LEADER]: Signalling peer 3972da3671ef401bbc841052ea9c5588 to start an election
I20260709 13:16:26.175097  6769 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef0cd7434a044f94a030340fabe9f8fc"
dest_uuid: "3972da3671ef401bbc841052ea9c5588"
 from {username='slave'} at 127.0.0.1:38738
I20260709 13:16:26.175824  6769 raft_consensus.cc:493] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:26.176218  6769 raft_consensus.cc:3060] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:26.183281  6769 raft_consensus.cc:515] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:26.184981  6769 leader_election.cc:290] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 3 election: Requested vote from peers 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447), d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419)
I20260709 13:16:26.186432  6695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef0cd7434a044f94a030340fabe9f8fc" candidate_uuid: "3972da3671ef401bbc841052ea9c5588" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
I20260709 13:16:26.186434  6970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef0cd7434a044f94a030340fabe9f8fc" candidate_uuid: "3972da3671ef401bbc841052ea9c5588" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7abeed0e8edf41809baa2d97c88c6b28"
I20260709 13:16:26.187227  6695 raft_consensus.cc:3055] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:26.187420  6970 raft_consensus.cc:3060] T ef0cd7434a044f94a030340fabe9f8fc P 7abeed0e8edf41809baa2d97c88c6b28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:26.187613  6695 raft_consensus.cc:740] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d8632beb9efb4ce4a1d87e0c854b639a, State: Running, Role: LEADER
I20260709 13:16:26.188604  6695 consensus_queue.cc:260] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:26.189735  6695 raft_consensus.cc:3060] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:26.193552  6970 raft_consensus.cc:2468] T ef0cd7434a044f94a030340fabe9f8fc P 7abeed0e8edf41809baa2d97c88c6b28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3972da3671ef401bbc841052ea9c5588 in term 3.
I20260709 13:16:26.194993  6736 leader_election.cc:304] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3972da3671ef401bbc841052ea9c5588, 7abeed0e8edf41809baa2d97c88c6b28; no voters: 
I20260709 13:16:26.195936  7007 raft_consensus.cc:2804] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:26.196403  7007 raft_consensus.cc:697] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [term 3 LEADER]: Becoming Leader. State: Replica: 3972da3671ef401bbc841052ea9c5588, State: Running, Role: LEADER
I20260709 13:16:26.196971  6695 raft_consensus.cc:2468] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3972da3671ef401bbc841052ea9c5588 in term 3.
I20260709 13:16:26.197211  7007 consensus_queue.cc:237] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:26.204675  6520 catalog_manager.cc:5697] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 reported cstate change: term changed from 2 to 3, leader changed from d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130) to 3972da3671ef401bbc841052ea9c5588 (127.27.146.131). New cstate: current_term: 3 leader_uuid: "3972da3671ef401bbc841052ea9c5588" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:26.288249  7064 raft_consensus.cc:993] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a: : Instructing follower 3972da3671ef401bbc841052ea9c5588 to start an election
I20260709 13:16:26.288859  7071 raft_consensus.cc:1081] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [term 2 LEADER]: Signalling peer 3972da3671ef401bbc841052ea9c5588 to start an election
I20260709 13:16:26.290676  6769 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d0a65bcc05d492e860cd9066fb0161a"
dest_uuid: "3972da3671ef401bbc841052ea9c5588"
 from {username='slave'} at 127.0.0.1:38738
I20260709 13:16:26.291189  6769 raft_consensus.cc:493] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:26.291458  6769 raft_consensus.cc:3060] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:26.295953  6769 raft_consensus.cc:515] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:26.297402  6769 leader_election.cc:290] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 3 election: Requested vote from peers 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447), d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419)
I20260709 13:16:26.298743  6970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d0a65bcc05d492e860cd9066fb0161a" candidate_uuid: "3972da3671ef401bbc841052ea9c5588" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "7abeed0e8edf41809baa2d97c88c6b28"
I20260709 13:16:26.298862  6695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d0a65bcc05d492e860cd9066fb0161a" candidate_uuid: "3972da3671ef401bbc841052ea9c5588" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
I20260709 13:16:26.299548  6970 raft_consensus.cc:3060] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:26.299750  6695 raft_consensus.cc:3055] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:26.300215  6695 raft_consensus.cc:740] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d8632beb9efb4ce4a1d87e0c854b639a, State: Running, Role: LEADER
I20260709 13:16:26.301117  6695 consensus_queue.cc:260] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:26.302129  6695 raft_consensus.cc:3060] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:26.306226  6970 raft_consensus.cc:2468] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3972da3671ef401bbc841052ea9c5588 in term 3.
I20260709 13:16:26.307449  6695 raft_consensus.cc:2468] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3972da3671ef401bbc841052ea9c5588 in term 3.
I20260709 13:16:26.307700  6736 leader_election.cc:304] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3972da3671ef401bbc841052ea9c5588, 7abeed0e8edf41809baa2d97c88c6b28; no voters: 
I20260709 13:16:26.308774  7007 raft_consensus.cc:2804] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:26.309312  7007 raft_consensus.cc:697] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588 [term 3 LEADER]: Becoming Leader. State: Replica: 3972da3671ef401bbc841052ea9c5588, State: Running, Role: LEADER
I20260709 13:16:26.310209  7007 consensus_queue.cc:237] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:26.317539  6520 catalog_manager.cc:5697] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588 reported cstate change: term changed from 2 to 3, leader changed from d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130) to 3972da3671ef401bbc841052ea9c5588 (127.27.146.131). New cstate: current_term: 3 leader_uuid: "3972da3671ef401bbc841052ea9c5588" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:26.436964  6569 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:16:26.545930  7061 raft_consensus.cc:993] T 571acba5e0524805ba100b31450f461c P 3972da3671ef401bbc841052ea9c5588: : Instructing follower d8632beb9efb4ce4a1d87e0c854b639a to start an election
I20260709 13:16:26.546737  7082 raft_consensus.cc:1081] T 571acba5e0524805ba100b31450f461c P 3972da3671ef401bbc841052ea9c5588 [term 2 LEADER]: Signalling peer d8632beb9efb4ce4a1d87e0c854b639a to start an election
I20260709 13:16:26.548736  6695 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "571acba5e0524805ba100b31450f461c"
dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
 from {username='slave'} at 127.0.0.1:44926
I20260709 13:16:26.549201  6695 raft_consensus.cc:493] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:26.549558  6695 raft_consensus.cc:3060] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:26.554663  6695 raft_consensus.cc:515] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:26.557626  6970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "571acba5e0524805ba100b31450f461c" candidate_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7abeed0e8edf41809baa2d97c88c6b28"
I20260709 13:16:26.557878  6769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "571acba5e0524805ba100b31450f461c" candidate_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3972da3671ef401bbc841052ea9c5588"
I20260709 13:16:26.558589  6769 raft_consensus.cc:3055] T 571acba5e0524805ba100b31450f461c P 3972da3671ef401bbc841052ea9c5588 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:26.556627  6695 leader_election.cc:290] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 3 election: Requested vote from peers 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447), 3972da3671ef401bbc841052ea9c5588 (127.27.146.131:44041)
I20260709 13:16:26.559020  6769 raft_consensus.cc:740] T 571acba5e0524805ba100b31450f461c P 3972da3671ef401bbc841052ea9c5588 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3972da3671ef401bbc841052ea9c5588, State: Running, Role: LEADER
I20260709 13:16:26.558512  6970 raft_consensus.cc:3060] T 571acba5e0524805ba100b31450f461c P 7abeed0e8edf41809baa2d97c88c6b28 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:26.559962  6769 consensus_queue.cc:260] T 571acba5e0524805ba100b31450f461c P 3972da3671ef401bbc841052ea9c5588 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:26.561357  6769 raft_consensus.cc:3060] T 571acba5e0524805ba100b31450f461c P 3972da3671ef401bbc841052ea9c5588 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:26.565038  6970 raft_consensus.cc:2468] T 571acba5e0524805ba100b31450f461c P 7abeed0e8edf41809baa2d97c88c6b28 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8632beb9efb4ce4a1d87e0c854b639a in term 3.
I20260709 13:16:26.566222  6662 leader_election.cc:304] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7abeed0e8edf41809baa2d97c88c6b28, d8632beb9efb4ce4a1d87e0c854b639a; no voters: 
I20260709 13:16:26.567075  7071 raft_consensus.cc:2804] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:26.567672  7071 raft_consensus.cc:697] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a [term 3 LEADER]: Becoming Leader. State: Replica: d8632beb9efb4ce4a1d87e0c854b639a, State: Running, Role: LEADER
I20260709 13:16:26.568583  7071 consensus_queue.cc:237] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:26.569625  6769 raft_consensus.cc:2468] T 571acba5e0524805ba100b31450f461c P 3972da3671ef401bbc841052ea9c5588 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8632beb9efb4ce4a1d87e0c854b639a in term 3.
I20260709 13:16:26.577804  6520 catalog_manager.cc:5697] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a reported cstate change: term changed from 2 to 3, leader changed from 3972da3671ef401bbc841052ea9c5588 (127.27.146.131) to d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130). New cstate: current_term: 3 leader_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:26.703632  6698 raft_consensus.cc:1275] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a [term 3 FOLLOWER]: Refusing update from remote peer 3972da3671ef401bbc841052ea9c5588: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:26.705355  7061 consensus_queue.cc:1048] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:26.712993  6698 raft_consensus.cc:1275] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [term 3 FOLLOWER]: Refusing update from remote peer 3972da3671ef401bbc841052ea9c5588: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:26.715292  7007 consensus_queue.cc:1048] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:26.718914  6970 raft_consensus.cc:1275] T ef0cd7434a044f94a030340fabe9f8fc P 7abeed0e8edf41809baa2d97c88c6b28 [term 3 FOLLOWER]: Refusing update from remote peer 3972da3671ef401bbc841052ea9c5588: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:26.721213  7007 consensus_queue.cc:1048] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:26.729803  6972 raft_consensus.cc:1275] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28 [term 3 FOLLOWER]: Refusing update from remote peer 3972da3671ef401bbc841052ea9c5588: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:26.731891  7082 consensus_queue.cc:1048] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:27.032529 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:27.033969  6769 raft_consensus.cc:1275] T 571acba5e0524805ba100b31450f461c P 3972da3671ef401bbc841052ea9c5588 [term 3 FOLLOWER]: Refusing update from remote peer d8632beb9efb4ce4a1d87e0c854b639a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:27.035353  7033 consensus_queue.cc:1048] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:27.043287  6695 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43d643af6d3248da8abe7e13fd887cc1"
dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
mode: GRACEFUL
new_leader_uuid: "3972da3671ef401bbc841052ea9c5588"
 from {username='slave'} at 127.0.0.1:57362
I20260709 13:16:27.044091  6695 raft_consensus.cc:606] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a [term 3 LEADER]: Received request to transfer leadership to TS 3972da3671ef401bbc841052ea9c5588
I20260709 13:16:27.047344  6972 raft_consensus.cc:1275] T 571acba5e0524805ba100b31450f461c P 7abeed0e8edf41809baa2d97c88c6b28 [term 3 FOLLOWER]: Refusing update from remote peer d8632beb9efb4ce4a1d87e0c854b639a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:27.049335  7033 consensus_queue.cc:1048] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:27.054800  6769 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d0a65bcc05d492e860cd9066fb0161a"
dest_uuid: "3972da3671ef401bbc841052ea9c5588"
mode: GRACEFUL
new_leader_uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
 from {username='slave'} at 127.0.0.1:34342
I20260709 13:16:27.055677  6769 raft_consensus.cc:606] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588 [term 3 LEADER]: Received request to transfer leadership to TS d8632beb9efb4ce4a1d87e0c854b639a
I20260709 13:16:27.060976  6769 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef0cd7434a044f94a030340fabe9f8fc"
dest_uuid: "3972da3671ef401bbc841052ea9c5588"
mode: GRACEFUL
new_leader_uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
 from {username='slave'} at 127.0.0.1:34342
I20260709 13:16:27.061652  6769 raft_consensus.cc:606] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [term 3 LEADER]: Received request to transfer leadership to TS d8632beb9efb4ce4a1d87e0c854b639a
I20260709 13:16:27.063464 28234 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:16:27.064471 28234 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:27.065127 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:27.100876  7071 raft_consensus.cc:993] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a: : Instructing follower 3972da3671ef401bbc841052ea9c5588 to start an election
I20260709 13:16:27.101424  7033 raft_consensus.cc:1081] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a [term 3 LEADER]: Signalling peer 3972da3671ef401bbc841052ea9c5588 to start an election
I20260709 13:16:27.103857  6769 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43d643af6d3248da8abe7e13fd887cc1"
dest_uuid: "3972da3671ef401bbc841052ea9c5588"
 from {username='slave'} at 127.0.0.1:38738
I20260709 13:16:27.104460  6769 raft_consensus.cc:493] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:27.104756  6769 raft_consensus.cc:3060] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:27.110837  6769 raft_consensus.cc:515] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:27.112994  6769 leader_election.cc:290] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 4 election: Requested vote from peers 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447), d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130:35419)
I20260709 13:16:27.114334  6972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43d643af6d3248da8abe7e13fd887cc1" candidate_uuid: "3972da3671ef401bbc841052ea9c5588" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "7abeed0e8edf41809baa2d97c88c6b28"
I20260709 13:16:27.114537  6695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43d643af6d3248da8abe7e13fd887cc1" candidate_uuid: "3972da3671ef401bbc841052ea9c5588" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
I20260709 13:16:27.115247  6972 raft_consensus.cc:3060] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:27.115669  6695 raft_consensus.cc:3055] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:27.116014  6695 raft_consensus.cc:740] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d8632beb9efb4ce4a1d87e0c854b639a, State: Running, Role: LEADER
I20260709 13:16:27.116946  6695 consensus_queue.cc:260] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:27.118165  6695 raft_consensus.cc:3060] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:27.125560  6972 raft_consensus.cc:2468] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3972da3671ef401bbc841052ea9c5588 in term 4.
I20260709 13:16:27.127573  6736 leader_election.cc:304] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3972da3671ef401bbc841052ea9c5588, 7abeed0e8edf41809baa2d97c88c6b28; no voters: 
I20260709 13:16:27.127602  6695 raft_consensus.cc:2468] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3972da3671ef401bbc841052ea9c5588 in term 4.
I20260709 13:16:27.128475  7061 raft_consensus.cc:2804] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:27.129011  7061 raft_consensus.cc:697] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [term 4 LEADER]: Becoming Leader. State: Replica: 3972da3671ef401bbc841052ea9c5588, State: Running, Role: LEADER
I20260709 13:16:27.129877  7061 consensus_queue.cc:237] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:27.138564  7082 raft_consensus.cc:993] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588: : Instructing follower d8632beb9efb4ce4a1d87e0c854b639a to start an election
I20260709 13:16:27.139146  7082 raft_consensus.cc:1081] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588 [term 3 LEADER]: Signalling peer d8632beb9efb4ce4a1d87e0c854b639a to start an election
I20260709 13:16:27.139293  6518 catalog_manager.cc:5697] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 reported cstate change: term changed from 3 to 4, leader changed from d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130) to 3972da3671ef401bbc841052ea9c5588 (127.27.146.131). New cstate: current_term: 4 leader_uuid: "3972da3671ef401bbc841052ea9c5588" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:27.141016  6695 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d0a65bcc05d492e860cd9066fb0161a"
dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
 from {username='slave'} at 127.0.0.1:44926
I20260709 13:16:27.141580  6695 raft_consensus.cc:493] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:27.141919  6695 raft_consensus.cc:3060] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:27.154196  6695 raft_consensus.cc:515] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:27.156487  6695 leader_election.cc:290] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 4 election: Requested vote from peers 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447), 3972da3671ef401bbc841052ea9c5588 (127.27.146.131:44041)
I20260709 13:16:27.157788  6769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d0a65bcc05d492e860cd9066fb0161a" candidate_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "3972da3671ef401bbc841052ea9c5588"
I20260709 13:16:27.157629  6972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d0a65bcc05d492e860cd9066fb0161a" candidate_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "7abeed0e8edf41809baa2d97c88c6b28"
I20260709 13:16:27.158560  6769 raft_consensus.cc:3055] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:27.158607  6972 raft_consensus.cc:3060] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:27.158996  6769 raft_consensus.cc:740] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3972da3671ef401bbc841052ea9c5588, State: Running, Role: LEADER
I20260709 13:16:27.159904  6769 consensus_queue.cc:260] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:27.161134  6769 raft_consensus.cc:3060] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:27.167398  6972 raft_consensus.cc:2468] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8632beb9efb4ce4a1d87e0c854b639a in term 4.
I20260709 13:16:27.167945  6769 raft_consensus.cc:2468] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8632beb9efb4ce4a1d87e0c854b639a in term 4.
I20260709 13:16:27.169019  6662 leader_election.cc:304] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7abeed0e8edf41809baa2d97c88c6b28, d8632beb9efb4ce4a1d87e0c854b639a; no voters: 
I20260709 13:16:27.170200  7033 raft_consensus.cc:2804] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:27.170709  7033 raft_consensus.cc:697] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [term 4 LEADER]: Becoming Leader. State: Replica: d8632beb9efb4ce4a1d87e0c854b639a, State: Running, Role: LEADER
I20260709 13:16:27.171655  7033 consensus_queue.cc:237] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:27.179944  6518 catalog_manager.cc:5697] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a reported cstate change: term changed from 3 to 4, leader changed from 3972da3671ef401bbc841052ea9c5588 (127.27.146.131) to d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130). New cstate: current_term: 4 leader_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:27.256210  7007 raft_consensus.cc:993] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588: : Instructing follower d8632beb9efb4ce4a1d87e0c854b639a to start an election
I20260709 13:16:27.256762  7082 raft_consensus.cc:1081] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [term 3 LEADER]: Signalling peer d8632beb9efb4ce4a1d87e0c854b639a to start an election
I20260709 13:16:27.258695  6695 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef0cd7434a044f94a030340fabe9f8fc"
dest_uuid: "d8632beb9efb4ce4a1d87e0c854b639a"
 from {username='slave'} at 127.0.0.1:44926
I20260709 13:16:27.259255  6695 raft_consensus.cc:493] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:27.259580  6695 raft_consensus.cc:3060] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:27.265753  6695 raft_consensus.cc:515] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:27.267714  6695 leader_election.cc:290] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 4 election: Requested vote from peers 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447), 3972da3671ef401bbc841052ea9c5588 (127.27.146.131:44041)
I20260709 13:16:27.268837  6972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef0cd7434a044f94a030340fabe9f8fc" candidate_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7abeed0e8edf41809baa2d97c88c6b28"
I20260709 13:16:27.268837  6769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef0cd7434a044f94a030340fabe9f8fc" candidate_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3972da3671ef401bbc841052ea9c5588"
I20260709 13:16:27.269829  6972 raft_consensus.cc:3060] T ef0cd7434a044f94a030340fabe9f8fc P 7abeed0e8edf41809baa2d97c88c6b28 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:27.270044  6769 raft_consensus.cc:3055] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:27.270398  6769 raft_consensus.cc:740] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3972da3671ef401bbc841052ea9c5588, State: Running, Role: LEADER
I20260709 13:16:27.271235  6769 consensus_queue.cc:260] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:27.272681  6769 raft_consensus.cc:3060] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:27.279040  6972 raft_consensus.cc:2468] T ef0cd7434a044f94a030340fabe9f8fc P 7abeed0e8edf41809baa2d97c88c6b28 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8632beb9efb4ce4a1d87e0c854b639a in term 4.
I20260709 13:16:27.280776  6662 leader_election.cc:304] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7abeed0e8edf41809baa2d97c88c6b28, d8632beb9efb4ce4a1d87e0c854b639a; no voters: 
I20260709 13:16:27.281308  6769 raft_consensus.cc:2468] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8632beb9efb4ce4a1d87e0c854b639a in term 4.
I20260709 13:16:27.281637  7033 raft_consensus.cc:2804] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:27.282313  7033 raft_consensus.cc:697] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a [term 4 LEADER]: Becoming Leader. State: Replica: d8632beb9efb4ce4a1d87e0c854b639a, State: Running, Role: LEADER
I20260709 13:16:27.283176  7033 consensus_queue.cc:237] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } }
I20260709 13:16:27.290482  6518 catalog_manager.cc:5697] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a reported cstate change: term changed from 3 to 4, leader changed from 3972da3671ef401bbc841052ea9c5588 (127.27.146.131) to d8632beb9efb4ce4a1d87e0c854b639a (127.27.146.130). New cstate: current_term: 4 leader_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:27.438123  6569 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:16:27.561465  6972 raft_consensus.cc:1275] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28 [term 4 FOLLOWER]: Refusing update from remote peer 3972da3671ef401bbc841052ea9c5588: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:27.563402  7082 consensus_queue.cc:1048] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:27.579844  6695 raft_consensus.cc:1275] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a [term 4 FOLLOWER]: Refusing update from remote peer 3972da3671ef401bbc841052ea9c5588: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:27.581230  7082 consensus_queue.cc:1048] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8632beb9efb4ce4a1d87e0c854b639a" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:27.604790  6769 raft_consensus.cc:1275] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588 [term 4 FOLLOWER]: Refusing update from remote peer d8632beb9efb4ce4a1d87e0c854b639a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:27.606491  7033 consensus_queue.cc:1048] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:27.617563  6972 raft_consensus.cc:1275] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28 [term 4 FOLLOWER]: Refusing update from remote peer d8632beb9efb4ce4a1d87e0c854b639a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:27.619563  7071 consensus_queue.cc:1048] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:27.860227  6769 raft_consensus.cc:1275] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [term 4 FOLLOWER]: Refusing update from remote peer d8632beb9efb4ce4a1d87e0c854b639a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:27.861876  7071 consensus_queue.cc:1048] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3972da3671ef401bbc841052ea9c5588" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:27.876259  6972 raft_consensus.cc:1275] T ef0cd7434a044f94a030340fabe9f8fc P 7abeed0e8edf41809baa2d97c88c6b28 [term 4 FOLLOWER]: Refusing update from remote peer d8632beb9efb4ce4a1d87e0c854b639a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:27.877811  7100 consensus_queue.cc:1048] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7abeed0e8edf41809baa2d97c88c6b28" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:28.073158 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:28.110037 28234 tablet_server.cc:179] TabletServer@127.27.146.129:40447 shutting down...
I20260709 13:16:28.135000 28234 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:28.135896 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:28.136657 28234 raft_consensus.cc:2243] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.137156 28234 raft_consensus.cc:2272] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.139792 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:28.140555 28234 raft_consensus.cc:2243] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.141076 28234 raft_consensus.cc:2272] T 43d643af6d3248da8abe7e13fd887cc1 P 7abeed0e8edf41809baa2d97c88c6b28 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:28.141351  6662 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 92 similar messages]
I20260709 13:16:28.144519 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:28.145648 28234 raft_consensus.cc:2243] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28 [term 4 FOLLOWER]: Raft consensus shutting down.
W20260709 13:16:28.145660  6662 consensus_peers.cc:597] T f48bbc412be247c59a7817c33136ceee P d8632beb9efb4ce4a1d87e0c854b639a -> Peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Couldn't send request to peer 7abeed0e8edf41809baa2d97c88c6b28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:28.146317 28234 raft_consensus.cc:2272] T 31789365471247b58419c92a028a9afc P 7abeed0e8edf41809baa2d97c88c6b28 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.149374 28234 tablet_replica.cc:333] stopping tablet replica
W20260709 13:16:28.150413  6662 consensus_peers.cc:597] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a -> Peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Couldn't send request to peer 7abeed0e8edf41809baa2d97c88c6b28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:28.150938 28234 raft_consensus.cc:2243] T f48bbc412be247c59a7817c33136ceee P 7abeed0e8edf41809baa2d97c88c6b28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.152191 28234 raft_consensus.cc:2272] T f48bbc412be247c59a7817c33136ceee P 7abeed0e8edf41809baa2d97c88c6b28 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.155229 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:28.156026 28234 raft_consensus.cc:2243] T 571acba5e0524805ba100b31450f461c P 7abeed0e8edf41809baa2d97c88c6b28 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.156513 28234 raft_consensus.cc:2272] T 571acba5e0524805ba100b31450f461c P 7abeed0e8edf41809baa2d97c88c6b28 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.158702 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:28.159428 28234 raft_consensus.cc:2243] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.160050 28234 raft_consensus.cc:2272] T 7d0a65bcc05d492e860cd9066fb0161a P 7abeed0e8edf41809baa2d97c88c6b28 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.163748 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:28.164561 28234 raft_consensus.cc:2243] T 99642a0c8f7941bca524315ff82e60da P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.165087 28234 raft_consensus.cc:2272] T 99642a0c8f7941bca524315ff82e60da P 7abeed0e8edf41809baa2d97c88c6b28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.167318 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:28.167951 28234 raft_consensus.cc:2243] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.168473 28234 raft_consensus.cc:2272] T 47dc18fd364c4b079b99900a766e3208 P 7abeed0e8edf41809baa2d97c88c6b28 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.170544 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:28.171094 28234 raft_consensus.cc:2243] T ef0cd7434a044f94a030340fabe9f8fc P 7abeed0e8edf41809baa2d97c88c6b28 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.171595 28234 raft_consensus.cc:2272] T ef0cd7434a044f94a030340fabe9f8fc P 7abeed0e8edf41809baa2d97c88c6b28 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.174386 28234 tablet_replica.cc:333] stopping tablet replica
I20260709 13:16:28.175100 28234 raft_consensus.cc:2243] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 7abeed0e8edf41809baa2d97c88c6b28 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.175736 28234 raft_consensus.cc:2272] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 7abeed0e8edf41809baa2d97c88c6b28 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:28.189399  6662 consensus_peers.cc:597] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a -> Peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Couldn't send request to peer 7abeed0e8edf41809baa2d97c88c6b28. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:28.198374 28234 tablet_server.cc:196] TabletServer@127.27.146.129:40447 shutdown complete.
I20260709 13:16:28.219712 28234 tablet_server.cc:179] TabletServer@127.27.146.130:0 shutting down...
I20260709 13:16:28.252581 28234 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:28.253539 28234 tablet_replica.cc:333] T 1b9d55b78dd94bbba5df1f481b3e8c5c P d8632beb9efb4ce4a1d87e0c854b639a: stopping tablet replica
I20260709 13:16:28.254639 28234 raft_consensus.cc:2243] T 1b9d55b78dd94bbba5df1f481b3e8c5c P d8632beb9efb4ce4a1d87e0c854b639a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.255657 28234 raft_consensus.cc:2272] T 1b9d55b78dd94bbba5df1f481b3e8c5c P d8632beb9efb4ce4a1d87e0c854b639a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.258139 28234 tablet_replica.cc:333] T 31789365471247b58419c92a028a9afc P d8632beb9efb4ce4a1d87e0c854b639a: stopping tablet replica
I20260709 13:16:28.259021 28234 raft_consensus.cc:2243] T 31789365471247b58419c92a028a9afc P d8632beb9efb4ce4a1d87e0c854b639a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.259727 28234 raft_consensus.cc:2272] T 31789365471247b58419c92a028a9afc P d8632beb9efb4ce4a1d87e0c854b639a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.262223 28234 tablet_replica.cc:333] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a: stopping tablet replica
I20260709 13:16:28.262840 28234 raft_consensus.cc:2243] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.263319 28234 raft_consensus.cc:2272] T 43d643af6d3248da8abe7e13fd887cc1 P d8632beb9efb4ce4a1d87e0c854b639a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.266337 28234 tablet_replica.cc:333] T 99642a0c8f7941bca524315ff82e60da P d8632beb9efb4ce4a1d87e0c854b639a: stopping tablet replica
I20260709 13:16:28.267021 28234 raft_consensus.cc:2243] T 99642a0c8f7941bca524315ff82e60da P d8632beb9efb4ce4a1d87e0c854b639a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.267930 28234 raft_consensus.cc:2272] T 99642a0c8f7941bca524315ff82e60da P d8632beb9efb4ce4a1d87e0c854b639a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.270732 28234 tablet_replica.cc:333] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a: stopping tablet replica
I20260709 13:16:28.271775 28234 raft_consensus.cc:2243] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:16:28.272819 28234 raft_consensus.cc:2272] T 7d0a65bcc05d492e860cd9066fb0161a P d8632beb9efb4ce4a1d87e0c854b639a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.276695 28234 tablet_replica.cc:333] T f48bbc412be247c59a7817c33136ceee P d8632beb9efb4ce4a1d87e0c854b639a: stopping tablet replica
I20260709 13:16:28.277351 28234 raft_consensus.cc:2243] T f48bbc412be247c59a7817c33136ceee P d8632beb9efb4ce4a1d87e0c854b639a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:28.278270 28234 raft_consensus.cc:2272] T f48bbc412be247c59a7817c33136ceee P d8632beb9efb4ce4a1d87e0c854b639a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.281304 28234 tablet_replica.cc:333] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a: stopping tablet replica
I20260709 13:16:28.282212 28234 raft_consensus.cc:2243] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:28.283286 28234 raft_consensus.cc:2272] T 571acba5e0524805ba100b31450f461c P d8632beb9efb4ce4a1d87e0c854b639a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.285926 28234 tablet_replica.cc:333] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a: stopping tablet replica
I20260709 13:16:28.286535 28234 raft_consensus.cc:2243] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:16:28.287906 28234 raft_consensus.cc:2272] T ef0cd7434a044f94a030340fabe9f8fc P d8632beb9efb4ce4a1d87e0c854b639a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.291188 28234 tablet_replica.cc:333] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a: stopping tablet replica
I20260709 13:16:28.291942 28234 raft_consensus.cc:2243] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:16:28.292858 28234 raft_consensus.cc:2272] T 47dc18fd364c4b079b99900a766e3208 P d8632beb9efb4ce4a1d87e0c854b639a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.296092 28234 tablet_replica.cc:333] T 4e0c8fb12e4e49f2927d224f188a8cc9 P d8632beb9efb4ce4a1d87e0c854b639a: stopping tablet replica
I20260709 13:16:28.296823 28234 raft_consensus.cc:2243] T 4e0c8fb12e4e49f2927d224f188a8cc9 P d8632beb9efb4ce4a1d87e0c854b639a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.297423 28234 raft_consensus.cc:2272] T 4e0c8fb12e4e49f2927d224f188a8cc9 P d8632beb9efb4ce4a1d87e0c854b639a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:28.307576  6736 consensus_peers.cc:597] T 99642a0c8f7941bca524315ff82e60da P 3972da3671ef401bbc841052ea9c5588 -> Peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Couldn't send request to peer 7abeed0e8edf41809baa2d97c88c6b28. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:40447: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:28.312647  6736 consensus_peers.cc:597] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 3972da3671ef401bbc841052ea9c5588 -> Peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Couldn't send request to peer 7abeed0e8edf41809baa2d97c88c6b28. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:40447: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:28.337071 28234 tablet_server.cc:196] TabletServer@127.27.146.130:0 shutdown complete.
I20260709 13:16:28.361286 28234 tablet_server.cc:179] TabletServer@127.27.146.131:0 shutting down...
W20260709 13:16:28.383948  6736 consensus_peers.cc:597] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 -> Peer 7abeed0e8edf41809baa2d97c88c6b28 (127.27.146.129:40447): Couldn't send request to peer 7abeed0e8edf41809baa2d97c88c6b28. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:40447: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:28.402733 28234 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:28.404078 28234 tablet_replica.cc:333] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588: stopping tablet replica
I20260709 13:16:28.404855 28234 raft_consensus.cc:2243] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:16:28.406142 28234 raft_consensus.cc:2272] T 43d643af6d3248da8abe7e13fd887cc1 P 3972da3671ef401bbc841052ea9c5588 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.411936 28234 tablet_replica.cc:333] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588: stopping tablet replica
I20260709 13:16:28.412652 28234 raft_consensus.cc:2243] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:16:28.413529 28234 raft_consensus.cc:2272] T 31789365471247b58419c92a028a9afc P 3972da3671ef401bbc841052ea9c5588 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.416706 28234 tablet_replica.cc:333] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588: stopping tablet replica
I20260709 13:16:28.417518 28234 raft_consensus.cc:2243] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.418068 28234 raft_consensus.cc:2272] T ef0cd7434a044f94a030340fabe9f8fc P 3972da3671ef401bbc841052ea9c5588 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.421800 28234 tablet_replica.cc:333] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588: stopping tablet replica
I20260709 13:16:28.422542 28234 raft_consensus.cc:2243] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.423200 28234 raft_consensus.cc:2272] T 47dc18fd364c4b079b99900a766e3208 P 3972da3671ef401bbc841052ea9c5588 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.425702 28234 tablet_replica.cc:333] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 3972da3671ef401bbc841052ea9c5588: stopping tablet replica
I20260709 13:16:28.426447 28234 raft_consensus.cc:2243] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 3972da3671ef401bbc841052ea9c5588 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:28.427471 28234 raft_consensus.cc:2272] T 4e0c8fb12e4e49f2927d224f188a8cc9 P 3972da3671ef401bbc841052ea9c5588 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.430262 28234 tablet_replica.cc:333] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588: stopping tablet replica
I20260709 13:16:28.430930 28234 raft_consensus.cc:2243] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.431437 28234 raft_consensus.cc:2272] T 7d0a65bcc05d492e860cd9066fb0161a P 3972da3671ef401bbc841052ea9c5588 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.434440 28234 tablet_replica.cc:333] T 99642a0c8f7941bca524315ff82e60da P 3972da3671ef401bbc841052ea9c5588: stopping tablet replica
I20260709 13:16:28.435348 28234 raft_consensus.cc:2243] T 99642a0c8f7941bca524315ff82e60da P 3972da3671ef401bbc841052ea9c5588 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:28.436597 28234 raft_consensus.cc:2272] T 99642a0c8f7941bca524315ff82e60da P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:28.439357  6569 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:16:28.439741 28234 tablet_replica.cc:333] T 571acba5e0524805ba100b31450f461c P 3972da3671ef401bbc841052ea9c5588: stopping tablet replica
I20260709 13:16:28.441135 28234 raft_consensus.cc:2243] T 571acba5e0524805ba100b31450f461c P 3972da3671ef401bbc841052ea9c5588 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.441792 28234 raft_consensus.cc:2272] T 571acba5e0524805ba100b31450f461c P 3972da3671ef401bbc841052ea9c5588 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.445117 28234 tablet_replica.cc:333] T f48bbc412be247c59a7817c33136ceee P 3972da3671ef401bbc841052ea9c5588: stopping tablet replica
I20260709 13:16:28.445897 28234 raft_consensus.cc:2243] T f48bbc412be247c59a7817c33136ceee P 3972da3671ef401bbc841052ea9c5588 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:28.446470 28234 raft_consensus.cc:2272] T f48bbc412be247c59a7817c33136ceee P 3972da3671ef401bbc841052ea9c5588 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.449240 28234 tablet_replica.cc:333] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 3972da3671ef401bbc841052ea9c5588: stopping tablet replica
I20260709 13:16:28.450295 28234 raft_consensus.cc:2243] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 3972da3671ef401bbc841052ea9c5588 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:28.451318 28234 raft_consensus.cc:2272] T 1b9d55b78dd94bbba5df1f481b3e8c5c P 3972da3671ef401bbc841052ea9c5588 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.491066 28234 tablet_server.cc:196] TabletServer@127.27.146.131:0 shutdown complete.
I20260709 13:16:28.516399 28234 master.cc:562] Master@127.27.146.190:36709 shutting down...
I20260709 13:16:28.550901 28234 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 7cde1a47555a4e269621eb56a27cd096 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:28.551859 28234 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 7cde1a47555a4e269621eb56a27cd096 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:28.552341 28234 tablet_replica.cc:333] T 00000000000000000000000000000000 P 7cde1a47555a4e269621eb56a27cd096: stopping tablet replica
I20260709 13:16:28.577761 28234 master.cc:584] Master@127.27.146.190:36709 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13360 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:16:28.630470 28234 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.27.146.190:46499
I20260709 13:16:28.631753 28234 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:28.638044  7115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:28.640108  7116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:28.640305  7118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:28.641059 28234 server_base.cc:1061] running on GCE node
I20260709 13:16:28.642218 28234 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:28.642421 28234 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:28.642656 28234 hybrid_clock.cc:648] HybridClock initialized: now 1783602988642639 us; error 0 us; skew 500 ppm
I20260709 13:16:28.643337 28234 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:28.646173 28234 webserver.cc:533] Webserver started at http://127.27.146.190:44309/ using document root <none> and password file <none>
I20260709 13:16:28.646762 28234 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:28.646939 28234 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:28.647320 28234 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:28.648557 28234 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602648606606-28234-0/minicluster-data/master-0-root/instance:
uuid: "3b7b990859ae49f1b025f0b3c6309b4e"
format_stamp: "Formatted at 2026-07-09 13:16:28 on dist-test-slave-clfv"
I20260709 13:16:28.653591 28234 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 13:16:28.657928  7123 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:28.659322 28234 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:16:28.659749 28234 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602648606606-28234-0/minicluster-data/master-0-root
uuid: "3b7b990859ae49f1b025f0b3c6309b4e"
format_stamp: "Formatted at 2026-07-09 13:16:28 on dist-test-slave-clfv"
I20260709 13:16:28.660187 28234 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602648606606-28234-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602648606606-28234-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602648606606-28234-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:28.683287 28234 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:28.684670 28234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:28.734395 28234 rpc_server.cc:307] RPC server started. Bound to: 127.27.146.190:46499
I20260709 13:16:28.734596  7174 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.146.190:46499 every 8 connection(s)
I20260709 13:16:28.739646  7175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:28.761034  7175 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b7b990859ae49f1b025f0b3c6309b4e: Bootstrap starting.
I20260709 13:16:28.767062  7175 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3b7b990859ae49f1b025f0b3c6309b4e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:28.772598  7175 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b7b990859ae49f1b025f0b3c6309b4e: No bootstrap required, opened a new log
I20260709 13:16:28.775640  7175 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3b7b990859ae49f1b025f0b3c6309b4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b7b990859ae49f1b025f0b3c6309b4e" member_type: VOTER }
I20260709 13:16:28.776098  7175 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3b7b990859ae49f1b025f0b3c6309b4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:28.776389  7175 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3b7b990859ae49f1b025f0b3c6309b4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b7b990859ae49f1b025f0b3c6309b4e, State: Initialized, Role: FOLLOWER
I20260709 13:16:28.777083  7175 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3b7b990859ae49f1b025f0b3c6309b4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b7b990859ae49f1b025f0b3c6309b4e" member_type: VOTER }
I20260709 13:16:28.777653  7175 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3b7b990859ae49f1b025f0b3c6309b4e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:16:28.777869  7175 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3b7b990859ae49f1b025f0b3c6309b4e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:16:28.778188  7175 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3b7b990859ae49f1b025f0b3c6309b4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:28.784226  7175 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3b7b990859ae49f1b025f0b3c6309b4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b7b990859ae49f1b025f0b3c6309b4e" member_type: VOTER }
I20260709 13:16:28.784900  7175 leader_election.cc:304] T 00000000000000000000000000000000 P 3b7b990859ae49f1b025f0b3c6309b4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3b7b990859ae49f1b025f0b3c6309b4e; no voters: 
I20260709 13:16:28.786332  7175 leader_election.cc:290] T 00000000000000000000000000000000 P 3b7b990859ae49f1b025f0b3c6309b4e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:16:28.786760  7178 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3b7b990859ae49f1b025f0b3c6309b4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:28.788483  7178 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3b7b990859ae49f1b025f0b3c6309b4e [term 1 LEADER]: Becoming Leader. State: Replica: 3b7b990859ae49f1b025f0b3c6309b4e, State: Running, Role: LEADER
I20260709 13:16:28.789207  7178 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3b7b990859ae49f1b025f0b3c6309b4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b7b990859ae49f1b025f0b3c6309b4e" member_type: VOTER }
I20260709 13:16:28.789680  7175 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3b7b990859ae49f1b025f0b3c6309b4e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:16:28.794188  7180 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b7b990859ae49f1b025f0b3c6309b4e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3b7b990859ae49f1b025f0b3c6309b4e. Latest consensus state: current_term: 1 leader_uuid: "3b7b990859ae49f1b025f0b3c6309b4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b7b990859ae49f1b025f0b3c6309b4e" member_type: VOTER } }
I20260709 13:16:28.794070  7179 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b7b990859ae49f1b025f0b3c6309b4e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3b7b990859ae49f1b025f0b3c6309b4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b7b990859ae49f1b025f0b3c6309b4e" member_type: VOTER } }
I20260709 13:16:28.795020  7180 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b7b990859ae49f1b025f0b3c6309b4e [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:28.795061  7179 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b7b990859ae49f1b025f0b3c6309b4e [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:28.800467  7184 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:16:28.805521  7184 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:16:28.810145 28234 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:16:28.815752  7184 catalog_manager.cc:1383] Generated new cluster ID: 51800214c5df4929bde7e23126078bec
I20260709 13:16:28.816115  7184 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:16:28.832917  7184 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:16:28.834573  7184 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:16:28.851044  7184 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 3b7b990859ae49f1b025f0b3c6309b4e: Generated new TSK 0
I20260709 13:16:28.851794  7184 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:16:28.877211 28234 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:28.884367  7196 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:28.885854  7197 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:28.887853  7199 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:28.888597 28234 server_base.cc:1061] running on GCE node
I20260709 13:16:28.889726 28234 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:28.889930 28234 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:28.890137 28234 hybrid_clock.cc:648] HybridClock initialized: now 1783602988890118 us; error 0 us; skew 500 ppm
I20260709 13:16:28.890810 28234 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:28.893787 28234 webserver.cc:533] Webserver started at http://127.27.146.129:38463/ using document root <none> and password file <none>
I20260709 13:16:28.894282 28234 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:28.894462 28234 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:28.894685 28234 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:28.896456 28234 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602648606606-28234-0/minicluster-data/ts-0-root/instance:
uuid: "2fda9136dc39419caca3051af8d00e26"
format_stamp: "Formatted at 2026-07-09 13:16:28 on dist-test-slave-clfv"
I20260709 13:16:28.901926 28234 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:16:28.906200  7204 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:28.907356 28234 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 13:16:28.907840 28234 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602648606606-28234-0/minicluster-data/ts-0-root
uuid: "2fda9136dc39419caca3051af8d00e26"
format_stamp: "Formatted at 2026-07-09 13:16:28 on dist-test-slave-clfv"
I20260709 13:16:28.908216 28234 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602648606606-28234-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602648606606-28234-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602648606606-28234-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:28.922055 28234 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:28.923594 28234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:28.925366 28234 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:28.927937 28234 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:28.928169 28234 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:28.928440 28234 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:28.928619 28234 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:28.984474 28234 rpc_server.cc:307] RPC server started. Bound to: 127.27.146.129:39945
I20260709 13:16:28.984601  7266 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.146.129:39945 every 8 connection(s)
I20260709 13:16:28.990976 28234 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:29.000644  7271 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:29.002722  7272 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:29.009764  7274 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:29.010550 28234 server_base.cc:1061] running on GCE node
I20260709 13:16:29.011425  7267 heartbeater.cc:344] Connected to a master server at 127.27.146.190:46499
I20260709 13:16:29.011963  7267 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:29.012084 28234 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:29.012410 28234 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:29.012629 28234 hybrid_clock.cc:648] HybridClock initialized: now 1783602989012607 us; error 0 us; skew 500 ppm
I20260709 13:16:29.013085  7267 heartbeater.cc:507] Master 127.27.146.190:46499 requested a full tablet report, sending...
I20260709 13:16:29.013581 28234 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:29.016419  7140 ts_manager.cc:194] Registered new tserver with Master: 2fda9136dc39419caca3051af8d00e26 (127.27.146.129:39945)
I20260709 13:16:29.017374 28234 webserver.cc:533] Webserver started at http://127.27.146.130:33509/ using document root <none> and password file <none>
I20260709 13:16:29.018270 28234 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:29.018576 28234 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:29.019219 28234 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:29.019817  7140 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60982
I20260709 13:16:29.020973 28234 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602648606606-28234-0/minicluster-data/ts-1-root/instance:
uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e"
format_stamp: "Formatted at 2026-07-09 13:16:29 on dist-test-slave-clfv"
I20260709 13:16:29.028435 28234 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:16:29.033140  7279 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:29.034421 28234 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:16:29.034857 28234 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602648606606-28234-0/minicluster-data/ts-1-root
uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e"
format_stamp: "Formatted at 2026-07-09 13:16:29 on dist-test-slave-clfv"
I20260709 13:16:29.035187 28234 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602648606606-28234-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602648606606-28234-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602648606606-28234-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:29.057809 28234 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:29.059449 28234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:29.061334 28234 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:29.064200 28234 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:29.064466 28234 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:29.064747 28234 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:29.064934 28234 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:29.118602 28234 rpc_server.cc:307] RPC server started. Bound to: 127.27.146.130:36919
I20260709 13:16:29.118711  7341 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.146.130:36919 every 8 connection(s)
I20260709 13:16:29.124544 28234 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:29.133479  7345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:29.135656  7346 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:29.137984 28234 server_base.cc:1061] running on GCE node
W20260709 13:16:29.137835  7348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:29.139483 28234 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:29.139912 28234 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:29.140216 28234 hybrid_clock.cc:648] HybridClock initialized: now 1783602989140130 us; error 0 us; skew 500 ppm
I20260709 13:16:29.140846 28234 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:29.141443  7342 heartbeater.cc:344] Connected to a master server at 127.27.146.190:46499
I20260709 13:16:29.141996  7342 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:29.143090  7342 heartbeater.cc:507] Master 127.27.146.190:46499 requested a full tablet report, sending...
I20260709 13:16:29.144232 28234 webserver.cc:533] Webserver started at http://127.27.146.131:43413/ using document root <none> and password file <none>
I20260709 13:16:29.145035 28234 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:29.145285 28234 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:29.145577 28234 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:29.145889  7140 ts_manager.cc:194] Registered new tserver with Master: 5b47ff4d5f12424c9b97ddcc0b4a887e (127.27.146.130:36919)
I20260709 13:16:29.147105 28234 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602648606606-28234-0/minicluster-data/ts-2-root/instance:
uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe"
format_stamp: "Formatted at 2026-07-09 13:16:29 on dist-test-slave-clfv"
I20260709 13:16:29.147857  7140 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60990
I20260709 13:16:29.152782 28234 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:16:29.157542  7353 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:29.158445 28234 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:16:29.158807 28234 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602648606606-28234-0/minicluster-data/ts-2-root
uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe"
format_stamp: "Formatted at 2026-07-09 13:16:29 on dist-test-slave-clfv"
I20260709 13:16:29.159143 28234 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602648606606-28234-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602648606606-28234-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602648606606-28234-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:29.170648 28234 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:29.172191 28234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:29.173990 28234 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:29.176872 28234 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:29.177346 28234 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:29.177667 28234 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:29.177877 28234 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:29.228703 28234 rpc_server.cc:307] RPC server started. Bound to: 127.27.146.131:44739
I20260709 13:16:29.228839  7415 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.146.131:44739 every 8 connection(s)
I20260709 13:16:29.245975  7416 heartbeater.cc:344] Connected to a master server at 127.27.146.190:46499
I20260709 13:16:29.246546  7416 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:29.247483  7416 heartbeater.cc:507] Master 127.27.146.190:46499 requested a full tablet report, sending...
I20260709 13:16:29.249913  7140 ts_manager.cc:194] Registered new tserver with Master: 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe (127.27.146.131:44739)
I20260709 13:16:29.250614 28234 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017888742s
I20260709 13:16:29.251586  7140 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:32774
I20260709 13:16:29.282447  7140 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:32790:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:16:29.285177  7140 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:16:29.338101  7307 tablet_service.cc:1511] Processing CreateTablet for tablet 061106f0a9a34f2987ed9c2708440a56 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=32574002d09140ea8f40d9a86a8e015b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:16:29.338689  7306 tablet_service.cc:1511] Processing CreateTablet for tablet e1937954537243c8917f89a7417459ce (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=32574002d09140ea8f40d9a86a8e015b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:16:29.339530  7307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 061106f0a9a34f2987ed9c2708440a56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:29.340371  7306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1937954537243c8917f89a7417459ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:29.349288  7381 tablet_service.cc:1511] Processing CreateTablet for tablet 061106f0a9a34f2987ed9c2708440a56 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=32574002d09140ea8f40d9a86a8e015b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:16:29.349603  7380 tablet_service.cc:1511] Processing CreateTablet for tablet e1937954537243c8917f89a7417459ce (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=32574002d09140ea8f40d9a86a8e015b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:16:29.351397  7381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 061106f0a9a34f2987ed9c2708440a56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:29.355242  7380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1937954537243c8917f89a7417459ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:29.358834  7232 tablet_service.cc:1511] Processing CreateTablet for tablet 061106f0a9a34f2987ed9c2708440a56 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=32574002d09140ea8f40d9a86a8e015b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:16:29.360517  7232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 061106f0a9a34f2987ed9c2708440a56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:29.359086  7231 tablet_service.cc:1511] Processing CreateTablet for tablet e1937954537243c8917f89a7417459ce (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=32574002d09140ea8f40d9a86a8e015b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:16:29.363916  7231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1937954537243c8917f89a7417459ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:29.401011  7431 tablet_bootstrap.cc:492] T 061106f0a9a34f2987ed9c2708440a56 P 5b47ff4d5f12424c9b97ddcc0b4a887e: Bootstrap starting.
I20260709 13:16:29.408926  7431 tablet_bootstrap.cc:654] T 061106f0a9a34f2987ed9c2708440a56 P 5b47ff4d5f12424c9b97ddcc0b4a887e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:29.421200  7431 tablet_bootstrap.cc:492] T 061106f0a9a34f2987ed9c2708440a56 P 5b47ff4d5f12424c9b97ddcc0b4a887e: No bootstrap required, opened a new log
I20260709 13:16:29.421783  7431 ts_tablet_manager.cc:1403] T 061106f0a9a34f2987ed9c2708440a56 P 5b47ff4d5f12424c9b97ddcc0b4a887e: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.004s
I20260709 13:16:29.422139  7432 tablet_bootstrap.cc:492] T 061106f0a9a34f2987ed9c2708440a56 P 2fda9136dc39419caca3051af8d00e26: Bootstrap starting.
I20260709 13:16:29.425235  7431 raft_consensus.cc:359] T 061106f0a9a34f2987ed9c2708440a56 P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } } peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } }
I20260709 13:16:29.426064  7431 raft_consensus.cc:385] T 061106f0a9a34f2987ed9c2708440a56 P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:29.426383  7431 raft_consensus.cc:740] T 061106f0a9a34f2987ed9c2708440a56 P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b47ff4d5f12424c9b97ddcc0b4a887e, State: Initialized, Role: FOLLOWER
I20260709 13:16:29.427518  7431 consensus_queue.cc:260] T 061106f0a9a34f2987ed9c2708440a56 P 5b47ff4d5f12424c9b97ddcc0b4a887e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } } peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } }
I20260709 13:16:29.429208  7434 tablet_bootstrap.cc:492] T e1937954537243c8917f89a7417459ce P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe: Bootstrap starting.
I20260709 13:16:29.430462  7342 heartbeater.cc:499] Master 127.27.146.190:46499 was elected leader, sending a full tablet report...
I20260709 13:16:29.430840  7431 ts_tablet_manager.cc:1434] T 061106f0a9a34f2987ed9c2708440a56 P 5b47ff4d5f12424c9b97ddcc0b4a887e: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:16:29.432008  7431 tablet_bootstrap.cc:492] T e1937954537243c8917f89a7417459ce P 5b47ff4d5f12424c9b97ddcc0b4a887e: Bootstrap starting.
I20260709 13:16:29.433106  7432 tablet_bootstrap.cc:654] T 061106f0a9a34f2987ed9c2708440a56 P 2fda9136dc39419caca3051af8d00e26: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:29.437965  7434 tablet_bootstrap.cc:654] T e1937954537243c8917f89a7417459ce P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:29.444962  7431 tablet_bootstrap.cc:654] T e1937954537243c8917f89a7417459ce P 5b47ff4d5f12424c9b97ddcc0b4a887e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:29.450949  7434 tablet_bootstrap.cc:492] T e1937954537243c8917f89a7417459ce P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe: No bootstrap required, opened a new log
I20260709 13:16:29.451283  7432 tablet_bootstrap.cc:492] T 061106f0a9a34f2987ed9c2708440a56 P 2fda9136dc39419caca3051af8d00e26: No bootstrap required, opened a new log
I20260709 13:16:29.451664  7434 ts_tablet_manager.cc:1403] T e1937954537243c8917f89a7417459ce P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.010s
I20260709 13:16:29.451915  7432 ts_tablet_manager.cc:1403] T 061106f0a9a34f2987ed9c2708440a56 P 2fda9136dc39419caca3051af8d00e26: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.010s
I20260709 13:16:29.455694  7434 raft_consensus.cc:359] T e1937954537243c8917f89a7417459ce P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } }
I20260709 13:16:29.456634  7434 raft_consensus.cc:385] T e1937954537243c8917f89a7417459ce P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:29.456965  7434 raft_consensus.cc:740] T e1937954537243c8917f89a7417459ce P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe, State: Initialized, Role: FOLLOWER
I20260709 13:16:29.456789  7432 raft_consensus.cc:359] T 061106f0a9a34f2987ed9c2708440a56 P 2fda9136dc39419caca3051af8d00e26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } } peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } }
I20260709 13:16:29.458421  7432 raft_consensus.cc:385] T 061106f0a9a34f2987ed9c2708440a56 P 2fda9136dc39419caca3051af8d00e26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:29.458179  7434 consensus_queue.cc:260] T e1937954537243c8917f89a7417459ce P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } }
I20260709 13:16:29.458969  7432 raft_consensus.cc:740] T 061106f0a9a34f2987ed9c2708440a56 P 2fda9136dc39419caca3051af8d00e26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fda9136dc39419caca3051af8d00e26, State: Initialized, Role: FOLLOWER
I20260709 13:16:29.460234  7432 consensus_queue.cc:260] T 061106f0a9a34f2987ed9c2708440a56 P 2fda9136dc39419caca3051af8d00e26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } } peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } }
I20260709 13:16:29.466864  7432 ts_tablet_manager.cc:1434] T 061106f0a9a34f2987ed9c2708440a56 P 2fda9136dc39419caca3051af8d00e26: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 13:16:29.467188  7416 heartbeater.cc:499] Master 127.27.146.190:46499 was elected leader, sending a full tablet report...
I20260709 13:16:29.467801  7434 ts_tablet_manager.cc:1434] T e1937954537243c8917f89a7417459ce P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.010s
I20260709 13:16:29.468014  7267 heartbeater.cc:499] Master 127.27.146.190:46499 was elected leader, sending a full tablet report...
I20260709 13:16:29.469041  7432 tablet_bootstrap.cc:492] T e1937954537243c8917f89a7417459ce P 2fda9136dc39419caca3051af8d00e26: Bootstrap starting.
I20260709 13:16:29.469257  7434 tablet_bootstrap.cc:492] T 061106f0a9a34f2987ed9c2708440a56 P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe: Bootstrap starting.
I20260709 13:16:29.467975  7431 tablet_bootstrap.cc:492] T e1937954537243c8917f89a7417459ce P 5b47ff4d5f12424c9b97ddcc0b4a887e: No bootstrap required, opened a new log
I20260709 13:16:29.473857  7431 ts_tablet_manager.cc:1403] T e1937954537243c8917f89a7417459ce P 5b47ff4d5f12424c9b97ddcc0b4a887e: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.014s
I20260709 13:16:29.474960  7435 raft_consensus.cc:493] T 061106f0a9a34f2987ed9c2708440a56 P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.475643  7435 raft_consensus.cc:515] T 061106f0a9a34f2987ed9c2708440a56 P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } } peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } }
I20260709 13:16:29.477145  7432 tablet_bootstrap.cc:654] T e1937954537243c8917f89a7417459ce P 2fda9136dc39419caca3051af8d00e26: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:29.477327  7434 tablet_bootstrap.cc:654] T 061106f0a9a34f2987ed9c2708440a56 P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:29.477645  7431 raft_consensus.cc:359] T e1937954537243c8917f89a7417459ce P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } }
I20260709 13:16:29.478720  7431 raft_consensus.cc:385] T e1937954537243c8917f89a7417459ce P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:29.479063  7431 raft_consensus.cc:740] T e1937954537243c8917f89a7417459ce P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b47ff4d5f12424c9b97ddcc0b4a887e, State: Initialized, Role: FOLLOWER
I20260709 13:16:29.485086  7435 leader_election.cc:290] T 061106f0a9a34f2987ed9c2708440a56 P 5b47ff4d5f12424c9b97ddcc0b4a887e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe (127.27.146.131:44739), 2fda9136dc39419caca3051af8d00e26 (127.27.146.129:39945)
I20260709 13:16:29.496075  7434 tablet_bootstrap.cc:492] T 061106f0a9a34f2987ed9c2708440a56 P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe: No bootstrap required, opened a new log
I20260709 13:16:29.496855  7434 ts_tablet_manager.cc:1403] T 061106f0a9a34f2987ed9c2708440a56 P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.010s
I20260709 13:16:29.500851  7434 raft_consensus.cc:359] T 061106f0a9a34f2987ed9c2708440a56 P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } } peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } }
I20260709 13:16:29.501652  7434 raft_consensus.cc:385] T 061106f0a9a34f2987ed9c2708440a56 P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:29.501943  7434 raft_consensus.cc:740] T 061106f0a9a34f2987ed9c2708440a56 P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe, State: Initialized, Role: FOLLOWER
I20260709 13:16:29.503041  7434 consensus_queue.cc:260] T 061106f0a9a34f2987ed9c2708440a56 P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } } peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } }
I20260709 13:16:29.505729  7434 ts_tablet_manager.cc:1434] T 061106f0a9a34f2987ed9c2708440a56 P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260709 13:16:29.480166  7431 consensus_queue.cc:260] T e1937954537243c8917f89a7417459ce P 5b47ff4d5f12424c9b97ddcc0b4a887e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } }
I20260709 13:16:29.508916  7391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061106f0a9a34f2987ed9c2708440a56" candidate_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" is_pre_election: true
I20260709 13:16:29.509795  7391 raft_consensus.cc:2468] T 061106f0a9a34f2987ed9c2708440a56 P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b47ff4d5f12424c9b97ddcc0b4a887e in term 0.
I20260709 13:16:29.509840  7431 ts_tablet_manager.cc:1434] T e1937954537243c8917f89a7417459ce P 5b47ff4d5f12424c9b97ddcc0b4a887e: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 13:16:29.511912  7282 leader_election.cc:304] T 061106f0a9a34f2987ed9c2708440a56 P 5b47ff4d5f12424c9b97ddcc0b4a887e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b47ff4d5f12424c9b97ddcc0b4a887e, 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe; no voters: 
I20260709 13:16:29.512486  7242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061106f0a9a34f2987ed9c2708440a56" candidate_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fda9136dc39419caca3051af8d00e26" is_pre_election: true
I20260709 13:16:29.513330  7242 raft_consensus.cc:2468] T 061106f0a9a34f2987ed9c2708440a56 P 2fda9136dc39419caca3051af8d00e26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b47ff4d5f12424c9b97ddcc0b4a887e in term 0.
I20260709 13:16:29.514758  7432 tablet_bootstrap.cc:492] T e1937954537243c8917f89a7417459ce P 2fda9136dc39419caca3051af8d00e26: No bootstrap required, opened a new log
I20260709 13:16:29.515437  7432 ts_tablet_manager.cc:1403] T e1937954537243c8917f89a7417459ce P 2fda9136dc39419caca3051af8d00e26: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.030s
I20260709 13:16:29.514810  7435 raft_consensus.cc:2804] T 061106f0a9a34f2987ed9c2708440a56 P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:29.516266  7435 raft_consensus.cc:493] T 061106f0a9a34f2987ed9c2708440a56 P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.516664  7435 raft_consensus.cc:3060] T 061106f0a9a34f2987ed9c2708440a56 P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:29.519325  7432 raft_consensus.cc:359] T e1937954537243c8917f89a7417459ce P 2fda9136dc39419caca3051af8d00e26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } }
I20260709 13:16:29.520282  7432 raft_consensus.cc:385] T e1937954537243c8917f89a7417459ce P 2fda9136dc39419caca3051af8d00e26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:29.520612  7432 raft_consensus.cc:740] T e1937954537243c8917f89a7417459ce P 2fda9136dc39419caca3051af8d00e26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fda9136dc39419caca3051af8d00e26, State: Initialized, Role: FOLLOWER
I20260709 13:16:29.521524  7432 consensus_queue.cc:260] T e1937954537243c8917f89a7417459ce P 2fda9136dc39419caca3051af8d00e26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } }
I20260709 13:16:29.524492  7432 ts_tablet_manager.cc:1434] T e1937954537243c8917f89a7417459ce P 2fda9136dc39419caca3051af8d00e26: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:16:29.526640  7435 raft_consensus.cc:515] T 061106f0a9a34f2987ed9c2708440a56 P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } } peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } }
I20260709 13:16:29.529137  7435 leader_election.cc:290] T 061106f0a9a34f2987ed9c2708440a56 P 5b47ff4d5f12424c9b97ddcc0b4a887e [CANDIDATE]: Term 1 election: Requested vote from peers 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe (127.27.146.131:44739), 2fda9136dc39419caca3051af8d00e26 (127.27.146.129:39945)
I20260709 13:16:29.530129  7391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061106f0a9a34f2987ed9c2708440a56" candidate_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe"
I20260709 13:16:29.530896  7391 raft_consensus.cc:3060] T 061106f0a9a34f2987ed9c2708440a56 P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:29.531445  7242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061106f0a9a34f2987ed9c2708440a56" candidate_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fda9136dc39419caca3051af8d00e26"
I20260709 13:16:29.532238  7242 raft_consensus.cc:3060] T 061106f0a9a34f2987ed9c2708440a56 P 2fda9136dc39419caca3051af8d00e26 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:29.540791  7391 raft_consensus.cc:2468] T 061106f0a9a34f2987ed9c2708440a56 P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b47ff4d5f12424c9b97ddcc0b4a887e in term 1.
I20260709 13:16:29.541201  7242 raft_consensus.cc:2468] T 061106f0a9a34f2987ed9c2708440a56 P 2fda9136dc39419caca3051af8d00e26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b47ff4d5f12424c9b97ddcc0b4a887e in term 1.
I20260709 13:16:29.542514  7282 leader_election.cc:304] T 061106f0a9a34f2987ed9c2708440a56 P 5b47ff4d5f12424c9b97ddcc0b4a887e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b47ff4d5f12424c9b97ddcc0b4a887e, 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe; no voters: 
I20260709 13:16:29.543386  7435 raft_consensus.cc:2804] T 061106f0a9a34f2987ed9c2708440a56 P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:29.544332  7435 raft_consensus.cc:697] T 061106f0a9a34f2987ed9c2708440a56 P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 1 LEADER]: Becoming Leader. State: Replica: 5b47ff4d5f12424c9b97ddcc0b4a887e, State: Running, Role: LEADER
I20260709 13:16:29.545202  7435 consensus_queue.cc:237] T 061106f0a9a34f2987ed9c2708440a56 P 5b47ff4d5f12424c9b97ddcc0b4a887e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } } peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } }
I20260709 13:16:29.550931  7440 raft_consensus.cc:493] T e1937954537243c8917f89a7417459ce P 2fda9136dc39419caca3051af8d00e26 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.551671  7440 raft_consensus.cc:515] T e1937954537243c8917f89a7417459ce P 2fda9136dc39419caca3051af8d00e26 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } }
I20260709 13:16:29.554667  7440 leader_election.cc:290] T e1937954537243c8917f89a7417459ce P 2fda9136dc39419caca3051af8d00e26 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b47ff4d5f12424c9b97ddcc0b4a887e (127.27.146.130:36919), 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe (127.27.146.131:44739)
I20260709 13:16:29.554724  7140 catalog_manager.cc:5697] T 061106f0a9a34f2987ed9c2708440a56 P 5b47ff4d5f12424c9b97ddcc0b4a887e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b47ff4d5f12424c9b97ddcc0b4a887e (127.27.146.130). New cstate: current_term: 1 leader_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:29.570672  7317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1937954537243c8917f89a7417459ce" candidate_uuid: "2fda9136dc39419caca3051af8d00e26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" is_pre_election: true
I20260709 13:16:29.571120  7391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1937954537243c8917f89a7417459ce" candidate_uuid: "2fda9136dc39419caca3051af8d00e26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" is_pre_election: true
I20260709 13:16:29.571453  7317 raft_consensus.cc:2468] T e1937954537243c8917f89a7417459ce P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fda9136dc39419caca3051af8d00e26 in term 0.
I20260709 13:16:29.572132  7391 raft_consensus.cc:2468] T e1937954537243c8917f89a7417459ce P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fda9136dc39419caca3051af8d00e26 in term 0.
I20260709 13:16:29.573060  7207 leader_election.cc:304] T e1937954537243c8917f89a7417459ce P 2fda9136dc39419caca3051af8d00e26 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fda9136dc39419caca3051af8d00e26, 5b47ff4d5f12424c9b97ddcc0b4a887e; no voters: 
I20260709 13:16:29.574095  7440 raft_consensus.cc:2804] T e1937954537243c8917f89a7417459ce P 2fda9136dc39419caca3051af8d00e26 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:29.574448  7440 raft_consensus.cc:493] T e1937954537243c8917f89a7417459ce P 2fda9136dc39419caca3051af8d00e26 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.574779  7440 raft_consensus.cc:3060] T e1937954537243c8917f89a7417459ce P 2fda9136dc39419caca3051af8d00e26 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:29.581264  7440 raft_consensus.cc:515] T e1937954537243c8917f89a7417459ce P 2fda9136dc39419caca3051af8d00e26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } }
I20260709 13:16:29.583089  7440 leader_election.cc:290] T e1937954537243c8917f89a7417459ce P 2fda9136dc39419caca3051af8d00e26 [CANDIDATE]: Term 1 election: Requested vote from peers 5b47ff4d5f12424c9b97ddcc0b4a887e (127.27.146.130:36919), 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe (127.27.146.131:44739)
I20260709 13:16:29.584273  7317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1937954537243c8917f89a7417459ce" candidate_uuid: "2fda9136dc39419caca3051af8d00e26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e"
I20260709 13:16:29.584527  7391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1937954537243c8917f89a7417459ce" candidate_uuid: "2fda9136dc39419caca3051af8d00e26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe"
I20260709 13:16:29.584925  7317 raft_consensus.cc:3060] T e1937954537243c8917f89a7417459ce P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:29.585197  7391 raft_consensus.cc:3060] T e1937954537243c8917f89a7417459ce P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:29.591830  7317 raft_consensus.cc:2468] T e1937954537243c8917f89a7417459ce P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fda9136dc39419caca3051af8d00e26 in term 1.
I20260709 13:16:29.592391  7391 raft_consensus.cc:2468] T e1937954537243c8917f89a7417459ce P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fda9136dc39419caca3051af8d00e26 in term 1.
I20260709 13:16:29.593528  7207 leader_election.cc:304] T e1937954537243c8917f89a7417459ce P 2fda9136dc39419caca3051af8d00e26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fda9136dc39419caca3051af8d00e26, 5b47ff4d5f12424c9b97ddcc0b4a887e; no voters: 
I20260709 13:16:29.594344  7440 raft_consensus.cc:2804] T e1937954537243c8917f89a7417459ce P 2fda9136dc39419caca3051af8d00e26 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:29.595705  7440 raft_consensus.cc:697] T e1937954537243c8917f89a7417459ce P 2fda9136dc39419caca3051af8d00e26 [term 1 LEADER]: Becoming Leader. State: Replica: 2fda9136dc39419caca3051af8d00e26, State: Running, Role: LEADER
I20260709 13:16:29.596657  7440 consensus_queue.cc:237] T e1937954537243c8917f89a7417459ce P 2fda9136dc39419caca3051af8d00e26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } }
I20260709 13:16:29.604807  7139 catalog_manager.cc:5697] T e1937954537243c8917f89a7417459ce P 2fda9136dc39419caca3051af8d00e26 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fda9136dc39419caca3051af8d00e26 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "2fda9136dc39419caca3051af8d00e26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:29.645489  7139 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:32796:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:16:29.647889  7139 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:16:29.676899  7232 tablet_service.cc:1511] Processing CreateTablet for tablet e635c1b65a3d478da269206f19f79cca (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=e617db3117d8493eb32056108a81a4a8]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:16:29.678499  7232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e635c1b65a3d478da269206f19f79cca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:29.678452  7306 tablet_service.cc:1511] Processing CreateTablet for tablet e635c1b65a3d478da269206f19f79cca (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=e617db3117d8493eb32056108a81a4a8]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:16:29.680246  7306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e635c1b65a3d478da269206f19f79cca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:29.680601  7380 tablet_service.cc:1511] Processing CreateTablet for tablet e635c1b65a3d478da269206f19f79cca (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=e617db3117d8493eb32056108a81a4a8]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:16:29.682171  7380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e635c1b65a3d478da269206f19f79cca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:29.682085  7231 tablet_service.cc:1511] Processing CreateTablet for tablet 7dc7122ba1844230839afdf8caffd9d1 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=e617db3117d8493eb32056108a81a4a8]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:16:29.683704  7231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dc7122ba1844230839afdf8caffd9d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:29.683548  7307 tablet_service.cc:1511] Processing CreateTablet for tablet 7dc7122ba1844230839afdf8caffd9d1 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=e617db3117d8493eb32056108a81a4a8]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:16:29.685143  7307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dc7122ba1844230839afdf8caffd9d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:29.685241  7381 tablet_service.cc:1511] Processing CreateTablet for tablet 7dc7122ba1844230839afdf8caffd9d1 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=e617db3117d8493eb32056108a81a4a8]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:16:29.686887  7381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dc7122ba1844230839afdf8caffd9d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:29.707974  7431 tablet_bootstrap.cc:492] T 7dc7122ba1844230839afdf8caffd9d1 P 5b47ff4d5f12424c9b97ddcc0b4a887e: Bootstrap starting.
I20260709 13:16:29.708297  7434 tablet_bootstrap.cc:492] T 7dc7122ba1844230839afdf8caffd9d1 P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe: Bootstrap starting.
I20260709 13:16:29.716480  7431 tablet_bootstrap.cc:654] T 7dc7122ba1844230839afdf8caffd9d1 P 5b47ff4d5f12424c9b97ddcc0b4a887e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:29.717257  7434 tablet_bootstrap.cc:654] T 7dc7122ba1844230839afdf8caffd9d1 P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:29.727046  7432 tablet_bootstrap.cc:492] T e635c1b65a3d478da269206f19f79cca P 2fda9136dc39419caca3051af8d00e26: Bootstrap starting.
I20260709 13:16:29.728367  7434 tablet_bootstrap.cc:492] T 7dc7122ba1844230839afdf8caffd9d1 P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe: No bootstrap required, opened a new log
I20260709 13:16:29.729045  7434 ts_tablet_manager.cc:1403] T 7dc7122ba1844230839afdf8caffd9d1 P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.005s
I20260709 13:16:29.735108  7431 tablet_bootstrap.cc:492] T 7dc7122ba1844230839afdf8caffd9d1 P 5b47ff4d5f12424c9b97ddcc0b4a887e: No bootstrap required, opened a new log
I20260709 13:16:29.735435  7432 tablet_bootstrap.cc:654] T e635c1b65a3d478da269206f19f79cca P 2fda9136dc39419caca3051af8d00e26: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:29.735769  7431 ts_tablet_manager.cc:1403] T 7dc7122ba1844230839afdf8caffd9d1 P 5b47ff4d5f12424c9b97ddcc0b4a887e: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.001s
I20260709 13:16:29.736493  7434 raft_consensus.cc:359] T 7dc7122ba1844230839afdf8caffd9d1 P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } }
I20260709 13:16:29.737349  7434 raft_consensus.cc:385] T 7dc7122ba1844230839afdf8caffd9d1 P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:29.737710  7434 raft_consensus.cc:740] T 7dc7122ba1844230839afdf8caffd9d1 P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe, State: Initialized, Role: FOLLOWER
I20260709 13:16:29.738621  7434 consensus_queue.cc:260] T 7dc7122ba1844230839afdf8caffd9d1 P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } }
I20260709 13:16:29.741430  7434 ts_tablet_manager.cc:1434] T 7dc7122ba1844230839afdf8caffd9d1 P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:16:29.742631  7434 tablet_bootstrap.cc:492] T e635c1b65a3d478da269206f19f79cca P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe: Bootstrap starting.
I20260709 13:16:29.743773  7431 raft_consensus.cc:359] T 7dc7122ba1844230839afdf8caffd9d1 P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } }
I20260709 13:16:29.745234  7431 raft_consensus.cc:385] T 7dc7122ba1844230839afdf8caffd9d1 P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:29.745571  7431 raft_consensus.cc:740] T 7dc7122ba1844230839afdf8caffd9d1 P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b47ff4d5f12424c9b97ddcc0b4a887e, State: Initialized, Role: FOLLOWER
I20260709 13:16:29.746493  7431 consensus_queue.cc:260] T 7dc7122ba1844230839afdf8caffd9d1 P 5b47ff4d5f12424c9b97ddcc0b4a887e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } }
I20260709 13:16:29.749291  7432 tablet_bootstrap.cc:492] T e635c1b65a3d478da269206f19f79cca P 2fda9136dc39419caca3051af8d00e26: No bootstrap required, opened a new log
I20260709 13:16:29.750409  7432 ts_tablet_manager.cc:1403] T e635c1b65a3d478da269206f19f79cca P 2fda9136dc39419caca3051af8d00e26: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.007s
I20260709 13:16:29.751047  7434 tablet_bootstrap.cc:654] T e635c1b65a3d478da269206f19f79cca P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:29.751776  7431 ts_tablet_manager.cc:1434] T 7dc7122ba1844230839afdf8caffd9d1 P 5b47ff4d5f12424c9b97ddcc0b4a887e: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:16:29.753198  7431 tablet_bootstrap.cc:492] T e635c1b65a3d478da269206f19f79cca P 5b47ff4d5f12424c9b97ddcc0b4a887e: Bootstrap starting.
I20260709 13:16:29.754150  7432 raft_consensus.cc:359] T e635c1b65a3d478da269206f19f79cca P 2fda9136dc39419caca3051af8d00e26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } }
I20260709 13:16:29.754980  7432 raft_consensus.cc:385] T e635c1b65a3d478da269206f19f79cca P 2fda9136dc39419caca3051af8d00e26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:29.755271  7432 raft_consensus.cc:740] T e635c1b65a3d478da269206f19f79cca P 2fda9136dc39419caca3051af8d00e26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fda9136dc39419caca3051af8d00e26, State: Initialized, Role: FOLLOWER
I20260709 13:16:29.756304  7432 consensus_queue.cc:260] T e635c1b65a3d478da269206f19f79cca P 2fda9136dc39419caca3051af8d00e26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } }
I20260709 13:16:29.761842  7432 ts_tablet_manager.cc:1434] T e635c1b65a3d478da269206f19f79cca P 2fda9136dc39419caca3051af8d00e26: Time spent starting tablet: real 0.011s	user 0.011s	sys 0.000s
I20260709 13:16:29.763296  7432 tablet_bootstrap.cc:492] T 7dc7122ba1844230839afdf8caffd9d1 P 2fda9136dc39419caca3051af8d00e26: Bootstrap starting.
I20260709 13:16:29.771521  7440 raft_consensus.cc:493] T e635c1b65a3d478da269206f19f79cca P 2fda9136dc39419caca3051af8d00e26 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.772199  7440 raft_consensus.cc:515] T e635c1b65a3d478da269206f19f79cca P 2fda9136dc39419caca3051af8d00e26 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } }
I20260709 13:16:29.774971  7440 leader_election.cc:290] T e635c1b65a3d478da269206f19f79cca P 2fda9136dc39419caca3051af8d00e26 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b47ff4d5f12424c9b97ddcc0b4a887e (127.27.146.130:36919), 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe (127.27.146.131:44739)
I20260709 13:16:29.776667  7432 tablet_bootstrap.cc:654] T 7dc7122ba1844230839afdf8caffd9d1 P 2fda9136dc39419caca3051af8d00e26: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:29.777005  7317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e635c1b65a3d478da269206f19f79cca" candidate_uuid: "2fda9136dc39419caca3051af8d00e26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" is_pre_election: true
W20260709 13:16:29.779256  7207 leader_election.cc:343] T e635c1b65a3d478da269206f19f79cca P 2fda9136dc39419caca3051af8d00e26 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b47ff4d5f12424c9b97ddcc0b4a887e (127.27.146.130:36919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:29.777055  7391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e635c1b65a3d478da269206f19f79cca" candidate_uuid: "2fda9136dc39419caca3051af8d00e26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" is_pre_election: true
I20260709 13:16:29.783788  7431 tablet_bootstrap.cc:654] T e635c1b65a3d478da269206f19f79cca P 5b47ff4d5f12424c9b97ddcc0b4a887e: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:29.785643  7207 leader_election.cc:343] T e635c1b65a3d478da269206f19f79cca P 2fda9136dc39419caca3051af8d00e26 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe (127.27.146.131:44739): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:29.786741  7207 leader_election.cc:304] T e635c1b65a3d478da269206f19f79cca P 2fda9136dc39419caca3051af8d00e26 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fda9136dc39419caca3051af8d00e26; no voters: 5b47ff4d5f12424c9b97ddcc0b4a887e, 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe
I20260709 13:16:29.789462  7440 raft_consensus.cc:2749] T e635c1b65a3d478da269206f19f79cca P 2fda9136dc39419caca3051af8d00e26 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:29.799942  7434 tablet_bootstrap.cc:492] T e635c1b65a3d478da269206f19f79cca P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe: No bootstrap required, opened a new log
I20260709 13:16:29.800521  7434 ts_tablet_manager.cc:1403] T e635c1b65a3d478da269206f19f79cca P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe: Time spent bootstrapping tablet: real 0.058s	user 0.031s	sys 0.025s
I20260709 13:16:29.800554  7432 tablet_bootstrap.cc:492] T 7dc7122ba1844230839afdf8caffd9d1 P 2fda9136dc39419caca3051af8d00e26: No bootstrap required, opened a new log
I20260709 13:16:29.801162  7431 tablet_bootstrap.cc:492] T e635c1b65a3d478da269206f19f79cca P 5b47ff4d5f12424c9b97ddcc0b4a887e: No bootstrap required, opened a new log
I20260709 13:16:29.801167  7432 ts_tablet_manager.cc:1403] T 7dc7122ba1844230839afdf8caffd9d1 P 2fda9136dc39419caca3051af8d00e26: Time spent bootstrapping tablet: real 0.038s	user 0.020s	sys 0.009s
I20260709 13:16:29.801924  7431 ts_tablet_manager.cc:1403] T e635c1b65a3d478da269206f19f79cca P 5b47ff4d5f12424c9b97ddcc0b4a887e: Time spent bootstrapping tablet: real 0.049s	user 0.018s	sys 0.008s
W20260709 13:16:29.804237  7188 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:29.804065  7434 raft_consensus.cc:359] T e635c1b65a3d478da269206f19f79cca P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } }
I20260709 13:16:29.805013  7434 raft_consensus.cc:385] T e635c1b65a3d478da269206f19f79cca P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:29.804967  7432 raft_consensus.cc:359] T 7dc7122ba1844230839afdf8caffd9d1 P 2fda9136dc39419caca3051af8d00e26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } }
I20260709 13:16:29.805526  7434 raft_consensus.cc:740] T e635c1b65a3d478da269206f19f79cca P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe, State: Initialized, Role: FOLLOWER
I20260709 13:16:29.805751  7432 raft_consensus.cc:385] T 7dc7122ba1844230839afdf8caffd9d1 P 2fda9136dc39419caca3051af8d00e26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:29.806152  7432 raft_consensus.cc:740] T 7dc7122ba1844230839afdf8caffd9d1 P 2fda9136dc39419caca3051af8d00e26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fda9136dc39419caca3051af8d00e26, State: Initialized, Role: FOLLOWER
I20260709 13:16:29.806500  7434 consensus_queue.cc:260] T e635c1b65a3d478da269206f19f79cca P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } }
I20260709 13:16:29.806927  7431 raft_consensus.cc:359] T e635c1b65a3d478da269206f19f79cca P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } }
I20260709 13:16:29.807734  7431 raft_consensus.cc:385] T e635c1b65a3d478da269206f19f79cca P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:29.807444  7432 consensus_queue.cc:260] T 7dc7122ba1844230839afdf8caffd9d1 P 2fda9136dc39419caca3051af8d00e26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } }
I20260709 13:16:29.809042  7434 ts_tablet_manager.cc:1434] T e635c1b65a3d478da269206f19f79cca P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:16:29.808156  7431 raft_consensus.cc:740] T e635c1b65a3d478da269206f19f79cca P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b47ff4d5f12424c9b97ddcc0b4a887e, State: Initialized, Role: FOLLOWER
I20260709 13:16:29.811306  7431 consensus_queue.cc:260] T e635c1b65a3d478da269206f19f79cca P 5b47ff4d5f12424c9b97ddcc0b4a887e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } }
I20260709 13:16:29.812824  7440 raft_consensus.cc:493] T 7dc7122ba1844230839afdf8caffd9d1 P 2fda9136dc39419caca3051af8d00e26 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.813113  7432 ts_tablet_manager.cc:1434] T 7dc7122ba1844230839afdf8caffd9d1 P 2fda9136dc39419caca3051af8d00e26: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260709 13:16:29.813470  7440 raft_consensus.cc:515] T 7dc7122ba1844230839afdf8caffd9d1 P 2fda9136dc39419caca3051af8d00e26 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } }
I20260709 13:16:29.816274  7431 ts_tablet_manager.cc:1434] T e635c1b65a3d478da269206f19f79cca P 5b47ff4d5f12424c9b97ddcc0b4a887e: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.001s
I20260709 13:16:29.817150  7317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dc7122ba1844230839afdf8caffd9d1" candidate_uuid: "2fda9136dc39419caca3051af8d00e26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" is_pre_election: true
I20260709 13:16:29.817917  7317 raft_consensus.cc:2468] T 7dc7122ba1844230839afdf8caffd9d1 P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fda9136dc39419caca3051af8d00e26 in term 0.
I20260709 13:16:29.817907  7440 leader_election.cc:290] T 7dc7122ba1844230839afdf8caffd9d1 P 2fda9136dc39419caca3051af8d00e26 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b47ff4d5f12424c9b97ddcc0b4a887e (127.27.146.130:36919), 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe (127.27.146.131:44739)
I20260709 13:16:29.819455  7207 leader_election.cc:304] T 7dc7122ba1844230839afdf8caffd9d1 P 2fda9136dc39419caca3051af8d00e26 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fda9136dc39419caca3051af8d00e26, 5b47ff4d5f12424c9b97ddcc0b4a887e; no voters: 
I20260709 13:16:29.820482  7440 raft_consensus.cc:2804] T 7dc7122ba1844230839afdf8caffd9d1 P 2fda9136dc39419caca3051af8d00e26 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:29.821003  7440 raft_consensus.cc:493] T 7dc7122ba1844230839afdf8caffd9d1 P 2fda9136dc39419caca3051af8d00e26 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.821631  7440 raft_consensus.cc:3060] T 7dc7122ba1844230839afdf8caffd9d1 P 2fda9136dc39419caca3051af8d00e26 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:29.820993  7391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dc7122ba1844230839afdf8caffd9d1" candidate_uuid: "2fda9136dc39419caca3051af8d00e26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" is_pre_election: true
I20260709 13:16:29.824770  7391 raft_consensus.cc:2468] T 7dc7122ba1844230839afdf8caffd9d1 P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fda9136dc39419caca3051af8d00e26 in term 0.
I20260709 13:16:29.831589  7440 raft_consensus.cc:515] T 7dc7122ba1844230839afdf8caffd9d1 P 2fda9136dc39419caca3051af8d00e26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } }
I20260709 13:16:29.833833  7440 leader_election.cc:290] T 7dc7122ba1844230839afdf8caffd9d1 P 2fda9136dc39419caca3051af8d00e26 [CANDIDATE]: Term 1 election: Requested vote from peers 5b47ff4d5f12424c9b97ddcc0b4a887e (127.27.146.130:36919), 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe (127.27.146.131:44739)
I20260709 13:16:29.834669  7317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dc7122ba1844230839afdf8caffd9d1" candidate_uuid: "2fda9136dc39419caca3051af8d00e26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e"
I20260709 13:16:29.835232  7391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7dc7122ba1844230839afdf8caffd9d1" candidate_uuid: "2fda9136dc39419caca3051af8d00e26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe"
I20260709 13:16:29.835448  7317 raft_consensus.cc:3060] T 7dc7122ba1844230839afdf8caffd9d1 P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:29.835935  7391 raft_consensus.cc:3060] T 7dc7122ba1844230839afdf8caffd9d1 P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:29.843420  7317 raft_consensus.cc:2468] T 7dc7122ba1844230839afdf8caffd9d1 P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fda9136dc39419caca3051af8d00e26 in term 1.
I20260709 13:16:29.843752  7391 raft_consensus.cc:2468] T 7dc7122ba1844230839afdf8caffd9d1 P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fda9136dc39419caca3051af8d00e26 in term 1.
I20260709 13:16:29.844987  7207 leader_election.cc:304] T 7dc7122ba1844230839afdf8caffd9d1 P 2fda9136dc39419caca3051af8d00e26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fda9136dc39419caca3051af8d00e26, 5b47ff4d5f12424c9b97ddcc0b4a887e; no voters: 
I20260709 13:16:29.846148  7440 raft_consensus.cc:2804] T 7dc7122ba1844230839afdf8caffd9d1 P 2fda9136dc39419caca3051af8d00e26 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:29.846740  7440 raft_consensus.cc:697] T 7dc7122ba1844230839afdf8caffd9d1 P 2fda9136dc39419caca3051af8d00e26 [term 1 LEADER]: Becoming Leader. State: Replica: 2fda9136dc39419caca3051af8d00e26, State: Running, Role: LEADER
I20260709 13:16:29.847690  7440 consensus_queue.cc:237] T 7dc7122ba1844230839afdf8caffd9d1 P 2fda9136dc39419caca3051af8d00e26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } }
I20260709 13:16:29.855906  7139 catalog_manager.cc:5697] T 7dc7122ba1844230839afdf8caffd9d1 P 2fda9136dc39419caca3051af8d00e26 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fda9136dc39419caca3051af8d00e26 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "2fda9136dc39419caca3051af8d00e26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:30.024330  7440 consensus_queue.cc:1048] T e1937954537243c8917f89a7417459ce P 2fda9136dc39419caca3051af8d00e26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:30.038056  7440 consensus_queue.cc:1048] T e1937954537243c8917f89a7417459ce P 2fda9136dc39419caca3051af8d00e26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:30.087255  7435 consensus_queue.cc:1048] T 061106f0a9a34f2987ed9c2708440a56 P 5b47ff4d5f12424c9b97ddcc0b4a887e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:30.102375  7469 consensus_queue.cc:1048] T 061106f0a9a34f2987ed9c2708440a56 P 5b47ff4d5f12424c9b97ddcc0b4a887e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:30.216005  7469 raft_consensus.cc:493] T e635c1b65a3d478da269206f19f79cca P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.216624  7469 raft_consensus.cc:515] T e635c1b65a3d478da269206f19f79cca P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } }
I20260709 13:16:30.219035  7469 leader_election.cc:290] T e635c1b65a3d478da269206f19f79cca P 5b47ff4d5f12424c9b97ddcc0b4a887e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fda9136dc39419caca3051af8d00e26 (127.27.146.129:39945), 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe (127.27.146.131:44739)
I20260709 13:16:30.219647  7391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e635c1b65a3d478da269206f19f79cca" candidate_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" is_pre_election: true
I20260709 13:16:30.219527  7242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e635c1b65a3d478da269206f19f79cca" candidate_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fda9136dc39419caca3051af8d00e26" is_pre_election: true
I20260709 13:16:30.220350  7391 raft_consensus.cc:2468] T e635c1b65a3d478da269206f19f79cca P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b47ff4d5f12424c9b97ddcc0b4a887e in term 0.
I20260709 13:16:30.220474  7242 raft_consensus.cc:2468] T e635c1b65a3d478da269206f19f79cca P 2fda9136dc39419caca3051af8d00e26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b47ff4d5f12424c9b97ddcc0b4a887e in term 0.
I20260709 13:16:30.221470  7282 leader_election.cc:304] T e635c1b65a3d478da269206f19f79cca P 5b47ff4d5f12424c9b97ddcc0b4a887e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b47ff4d5f12424c9b97ddcc0b4a887e, 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe; no voters: 
I20260709 13:16:30.222265  7469 raft_consensus.cc:2804] T e635c1b65a3d478da269206f19f79cca P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:30.222661  7469 raft_consensus.cc:493] T e635c1b65a3d478da269206f19f79cca P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:30.222947  7469 raft_consensus.cc:3060] T e635c1b65a3d478da269206f19f79cca P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:30.229426  7469 raft_consensus.cc:515] T e635c1b65a3d478da269206f19f79cca P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } }
I20260709 13:16:30.231379  7469 leader_election.cc:290] T e635c1b65a3d478da269206f19f79cca P 5b47ff4d5f12424c9b97ddcc0b4a887e [CANDIDATE]: Term 1 election: Requested vote from peers 2fda9136dc39419caca3051af8d00e26 (127.27.146.129:39945), 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe (127.27.146.131:44739)
I20260709 13:16:30.232455  7242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e635c1b65a3d478da269206f19f79cca" candidate_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fda9136dc39419caca3051af8d00e26"
I20260709 13:16:30.232657  7391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e635c1b65a3d478da269206f19f79cca" candidate_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe"
I20260709 13:16:30.233093  7242 raft_consensus.cc:3060] T e635c1b65a3d478da269206f19f79cca P 2fda9136dc39419caca3051af8d00e26 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:30.233291  7391 raft_consensus.cc:3060] T e635c1b65a3d478da269206f19f79cca P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:30.239295  7391 raft_consensus.cc:2468] T e635c1b65a3d478da269206f19f79cca P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b47ff4d5f12424c9b97ddcc0b4a887e in term 1.
I20260709 13:16:30.239780  7242 raft_consensus.cc:2468] T e635c1b65a3d478da269206f19f79cca P 2fda9136dc39419caca3051af8d00e26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b47ff4d5f12424c9b97ddcc0b4a887e in term 1.
I20260709 13:16:30.240644  7282 leader_election.cc:304] T e635c1b65a3d478da269206f19f79cca P 5b47ff4d5f12424c9b97ddcc0b4a887e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b47ff4d5f12424c9b97ddcc0b4a887e, 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe; no voters: 
I20260709 13:16:30.241539  7469 raft_consensus.cc:2804] T e635c1b65a3d478da269206f19f79cca P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:30.242070  7469 raft_consensus.cc:697] T e635c1b65a3d478da269206f19f79cca P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 1 LEADER]: Becoming Leader. State: Replica: 5b47ff4d5f12424c9b97ddcc0b4a887e, State: Running, Role: LEADER
I20260709 13:16:30.242856  7469 consensus_queue.cc:237] T e635c1b65a3d478da269206f19f79cca P 5b47ff4d5f12424c9b97ddcc0b4a887e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } }
I20260709 13:16:30.250406  7138 catalog_manager.cc:5697] T e635c1b65a3d478da269206f19f79cca P 5b47ff4d5f12424c9b97ddcc0b4a887e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b47ff4d5f12424c9b97ddcc0b4a887e (127.27.146.130). New cstate: current_term: 1 leader_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:30.326206  7440 consensus_queue.cc:1048] T 7dc7122ba1844230839afdf8caffd9d1 P 2fda9136dc39419caca3051af8d00e26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:30.346514  7440 consensus_queue.cc:1048] T 7dc7122ba1844230839afdf8caffd9d1 P 2fda9136dc39419caca3051af8d00e26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:30.365808  7317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "061106f0a9a34f2987ed9c2708440a56"
dest_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e"
mode: GRACEFUL
new_leader_uuid: "2fda9136dc39419caca3051af8d00e26"
 from {username='slave'} at 127.0.0.1:36446
I20260709 13:16:30.366437  7317 raft_consensus.cc:606] T 061106f0a9a34f2987ed9c2708440a56 P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 1 LEADER]: Received request to transfer leadership to TS 2fda9136dc39419caca3051af8d00e26
I20260709 13:16:30.381984  7242 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1937954537243c8917f89a7417459ce"
dest_uuid: "2fda9136dc39419caca3051af8d00e26"
mode: GRACEFUL
new_leader_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e"
 from {username='slave'} at 127.0.0.1:34584
I20260709 13:16:30.382618  7242 raft_consensus.cc:606] T e1937954537243c8917f89a7417459ce P 2fda9136dc39419caca3051af8d00e26 [term 1 LEADER]: Received request to transfer leadership to TS 5b47ff4d5f12424c9b97ddcc0b4a887e
I20260709 13:16:30.389401  7317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e635c1b65a3d478da269206f19f79cca"
dest_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e"
mode: GRACEFUL
new_leader_uuid: "2fda9136dc39419caca3051af8d00e26"
 from {username='slave'} at 127.0.0.1:36446
I20260709 13:16:30.389974  7317 raft_consensus.cc:606] T e635c1b65a3d478da269206f19f79cca P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 1 LEADER]: Received request to transfer leadership to TS 2fda9136dc39419caca3051af8d00e26
I20260709 13:16:30.473464  7473 raft_consensus.cc:993] T e1937954537243c8917f89a7417459ce P 2fda9136dc39419caca3051af8d00e26: : Instructing follower 5b47ff4d5f12424c9b97ddcc0b4a887e to start an election
I20260709 13:16:30.473999  7440 raft_consensus.cc:1081] T e1937954537243c8917f89a7417459ce P 2fda9136dc39419caca3051af8d00e26 [term 1 LEADER]: Signalling peer 5b47ff4d5f12424c9b97ddcc0b4a887e to start an election
I20260709 13:16:30.475739  7317 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1937954537243c8917f89a7417459ce"
dest_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e"
 from {username='slave'} at 127.0.0.1:36432
I20260709 13:16:30.476274  7317 raft_consensus.cc:493] T e1937954537243c8917f89a7417459ce P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:30.476626  7317 raft_consensus.cc:3060] T e1937954537243c8917f89a7417459ce P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:30.483623  7317 raft_consensus.cc:515] T e1937954537243c8917f89a7417459ce P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } }
I20260709 13:16:30.486035  7317 leader_election.cc:290] T e1937954537243c8917f89a7417459ce P 5b47ff4d5f12424c9b97ddcc0b4a887e [CANDIDATE]: Term 2 election: Requested vote from peers 2fda9136dc39419caca3051af8d00e26 (127.27.146.129:39945), 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe (127.27.146.131:44739)
I20260709 13:16:30.486673  7390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1937954537243c8917f89a7417459ce" candidate_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe"
I20260709 13:16:30.486678  7242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1937954537243c8917f89a7417459ce" candidate_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fda9136dc39419caca3051af8d00e26"
I20260709 13:16:30.487709  7242 raft_consensus.cc:3055] T e1937954537243c8917f89a7417459ce P 2fda9136dc39419caca3051af8d00e26 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:30.487802  7390 raft_consensus.cc:3060] T e1937954537243c8917f89a7417459ce P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:30.488096  7242 raft_consensus.cc:740] T e1937954537243c8917f89a7417459ce P 2fda9136dc39419caca3051af8d00e26 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fda9136dc39419caca3051af8d00e26, State: Running, Role: LEADER
I20260709 13:16:30.489393  7242 consensus_queue.cc:260] T e1937954537243c8917f89a7417459ce P 2fda9136dc39419caca3051af8d00e26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } }
I20260709 13:16:30.490952  7242 raft_consensus.cc:3060] T e1937954537243c8917f89a7417459ce P 2fda9136dc39419caca3051af8d00e26 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:30.497511  7390 raft_consensus.cc:2468] T e1937954537243c8917f89a7417459ce P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b47ff4d5f12424c9b97ddcc0b4a887e in term 2.
I20260709 13:16:30.498968  7282 leader_election.cc:304] T e1937954537243c8917f89a7417459ce P 5b47ff4d5f12424c9b97ddcc0b4a887e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b47ff4d5f12424c9b97ddcc0b4a887e, 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe; no voters: 
I20260709 13:16:30.499388  7242 raft_consensus.cc:2468] T e1937954537243c8917f89a7417459ce P 2fda9136dc39419caca3051af8d00e26 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b47ff4d5f12424c9b97ddcc0b4a887e in term 2.
I20260709 13:16:30.499969  7469 raft_consensus.cc:2804] T e1937954537243c8917f89a7417459ce P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:30.500540  7469 raft_consensus.cc:697] T e1937954537243c8917f89a7417459ce P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 2 LEADER]: Becoming Leader. State: Replica: 5b47ff4d5f12424c9b97ddcc0b4a887e, State: Running, Role: LEADER
I20260709 13:16:30.501549  7469 consensus_queue.cc:237] T e1937954537243c8917f89a7417459ce P 5b47ff4d5f12424c9b97ddcc0b4a887e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } }
I20260709 13:16:30.509100  7138 catalog_manager.cc:5697] T e1937954537243c8917f89a7417459ce P 5b47ff4d5f12424c9b97ddcc0b4a887e reported cstate change: term changed from 1 to 2, leader changed from 2fda9136dc39419caca3051af8d00e26 (127.27.146.129) to 5b47ff4d5f12424c9b97ddcc0b4a887e (127.27.146.130). New cstate: current_term: 2 leader_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:30.687222  7469 consensus_queue.cc:1048] T e635c1b65a3d478da269206f19f79cca P 5b47ff4d5f12424c9b97ddcc0b4a887e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:30.703161  7479 consensus_queue.cc:1048] T e635c1b65a3d478da269206f19f79cca P 5b47ff4d5f12424c9b97ddcc0b4a887e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:30.713335  7479 raft_consensus.cc:993] T e635c1b65a3d478da269206f19f79cca P 5b47ff4d5f12424c9b97ddcc0b4a887e: : Instructing follower 2fda9136dc39419caca3051af8d00e26 to start an election
I20260709 13:16:30.714215  7468 raft_consensus.cc:1081] T e635c1b65a3d478da269206f19f79cca P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 1 LEADER]: Signalling peer 2fda9136dc39419caca3051af8d00e26 to start an election
I20260709 13:16:30.716363  7242 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e635c1b65a3d478da269206f19f79cca"
dest_uuid: "2fda9136dc39419caca3051af8d00e26"
 from {username='slave'} at 127.0.0.1:34580
I20260709 13:16:30.717097  7242 raft_consensus.cc:493] T e635c1b65a3d478da269206f19f79cca P 2fda9136dc39419caca3051af8d00e26 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:30.717541  7242 raft_consensus.cc:3060] T e635c1b65a3d478da269206f19f79cca P 2fda9136dc39419caca3051af8d00e26 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:30.724287  7242 raft_consensus.cc:515] T e635c1b65a3d478da269206f19f79cca P 2fda9136dc39419caca3051af8d00e26 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } }
I20260709 13:16:30.726622  7242 leader_election.cc:290] T e635c1b65a3d478da269206f19f79cca P 2fda9136dc39419caca3051af8d00e26 [CANDIDATE]: Term 2 election: Requested vote from peers 5b47ff4d5f12424c9b97ddcc0b4a887e (127.27.146.130:36919), 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe (127.27.146.131:44739)
I20260709 13:16:30.727622  7317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e635c1b65a3d478da269206f19f79cca" candidate_uuid: "2fda9136dc39419caca3051af8d00e26" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e"
I20260709 13:16:30.727897  7390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e635c1b65a3d478da269206f19f79cca" candidate_uuid: "2fda9136dc39419caca3051af8d00e26" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe"
I20260709 13:16:30.728410  7317 raft_consensus.cc:3055] T e635c1b65a3d478da269206f19f79cca P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:30.728566  7390 raft_consensus.cc:3060] T e635c1b65a3d478da269206f19f79cca P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:30.728818  7317 raft_consensus.cc:740] T e635c1b65a3d478da269206f19f79cca P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5b47ff4d5f12424c9b97ddcc0b4a887e, State: Running, Role: LEADER
I20260709 13:16:30.729815  7317 consensus_queue.cc:260] T e635c1b65a3d478da269206f19f79cca P 5b47ff4d5f12424c9b97ddcc0b4a887e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } }
I20260709 13:16:30.731364  7317 raft_consensus.cc:3060] T e635c1b65a3d478da269206f19f79cca P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:30.733665  7469 raft_consensus.cc:993] T 061106f0a9a34f2987ed9c2708440a56 P 5b47ff4d5f12424c9b97ddcc0b4a887e: : Instructing follower 2fda9136dc39419caca3051af8d00e26 to start an election
I20260709 13:16:30.734225  7469 raft_consensus.cc:1081] T 061106f0a9a34f2987ed9c2708440a56 P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 1 LEADER]: Signalling peer 2fda9136dc39419caca3051af8d00e26 to start an election
I20260709 13:16:30.736447  7242 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "061106f0a9a34f2987ed9c2708440a56"
dest_uuid: "2fda9136dc39419caca3051af8d00e26"
 from {username='slave'} at 127.0.0.1:34580
I20260709 13:16:30.737298  7242 raft_consensus.cc:493] T 061106f0a9a34f2987ed9c2708440a56 P 2fda9136dc39419caca3051af8d00e26 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:30.737782  7242 raft_consensus.cc:3060] T 061106f0a9a34f2987ed9c2708440a56 P 2fda9136dc39419caca3051af8d00e26 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:30.737934  7390 raft_consensus.cc:2468] T e635c1b65a3d478da269206f19f79cca P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fda9136dc39419caca3051af8d00e26 in term 2.
I20260709 13:16:30.739634  7207 leader_election.cc:304] T e635c1b65a3d478da269206f19f79cca P 2fda9136dc39419caca3051af8d00e26 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fda9136dc39419caca3051af8d00e26, 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe; no voters: 
I20260709 13:16:30.740600  7440 raft_consensus.cc:2804] T e635c1b65a3d478da269206f19f79cca P 2fda9136dc39419caca3051af8d00e26 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:30.740466  7317 raft_consensus.cc:2468] T e635c1b65a3d478da269206f19f79cca P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fda9136dc39419caca3051af8d00e26 in term 2.
I20260709 13:16:30.741207  7440 raft_consensus.cc:697] T e635c1b65a3d478da269206f19f79cca P 2fda9136dc39419caca3051af8d00e26 [term 2 LEADER]: Becoming Leader. State: Replica: 2fda9136dc39419caca3051af8d00e26, State: Running, Role: LEADER
I20260709 13:16:30.742286  7440 consensus_queue.cc:237] T e635c1b65a3d478da269206f19f79cca P 2fda9136dc39419caca3051af8d00e26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } }
I20260709 13:16:30.747601  7242 raft_consensus.cc:515] T 061106f0a9a34f2987ed9c2708440a56 P 2fda9136dc39419caca3051af8d00e26 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } } peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } }
I20260709 13:16:30.750475  7242 leader_election.cc:290] T 061106f0a9a34f2987ed9c2708440a56 P 2fda9136dc39419caca3051af8d00e26 [CANDIDATE]: Term 2 election: Requested vote from peers 5b47ff4d5f12424c9b97ddcc0b4a887e (127.27.146.130:36919), 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe (127.27.146.131:44739)
I20260709 13:16:30.752493  7391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061106f0a9a34f2987ed9c2708440a56" candidate_uuid: "2fda9136dc39419caca3051af8d00e26" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe"
I20260709 13:16:30.753232  7391 raft_consensus.cc:3060] T 061106f0a9a34f2987ed9c2708440a56 P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:30.754873  7138 catalog_manager.cc:5697] T e635c1b65a3d478da269206f19f79cca P 2fda9136dc39419caca3051af8d00e26 reported cstate change: term changed from 1 to 2, leader changed from 5b47ff4d5f12424c9b97ddcc0b4a887e (127.27.146.130) to 2fda9136dc39419caca3051af8d00e26 (127.27.146.129). New cstate: current_term: 2 leader_uuid: "2fda9136dc39419caca3051af8d00e26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:30.755965  7317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061106f0a9a34f2987ed9c2708440a56" candidate_uuid: "2fda9136dc39419caca3051af8d00e26" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e"
I20260709 13:16:30.756651  7317 raft_consensus.cc:3055] T 061106f0a9a34f2987ed9c2708440a56 P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:30.756978  7317 raft_consensus.cc:740] T 061106f0a9a34f2987ed9c2708440a56 P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5b47ff4d5f12424c9b97ddcc0b4a887e, State: Running, Role: LEADER
I20260709 13:16:30.757889  7317 consensus_queue.cc:260] T 061106f0a9a34f2987ed9c2708440a56 P 5b47ff4d5f12424c9b97ddcc0b4a887e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } } peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } }
I20260709 13:16:30.759466  7317 raft_consensus.cc:3060] T 061106f0a9a34f2987ed9c2708440a56 P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:30.762400  7391 raft_consensus.cc:2468] T 061106f0a9a34f2987ed9c2708440a56 P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fda9136dc39419caca3051af8d00e26 in term 2.
I20260709 13:16:30.764303  7207 leader_election.cc:304] T 061106f0a9a34f2987ed9c2708440a56 P 2fda9136dc39419caca3051af8d00e26 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fda9136dc39419caca3051af8d00e26, 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe; no voters: 
I20260709 13:16:30.765123  7440 raft_consensus.cc:2804] T 061106f0a9a34f2987ed9c2708440a56 P 2fda9136dc39419caca3051af8d00e26 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:30.765654  7440 raft_consensus.cc:697] T 061106f0a9a34f2987ed9c2708440a56 P 2fda9136dc39419caca3051af8d00e26 [term 2 LEADER]: Becoming Leader. State: Replica: 2fda9136dc39419caca3051af8d00e26, State: Running, Role: LEADER
I20260709 13:16:30.766379  7440 consensus_queue.cc:237] T 061106f0a9a34f2987ed9c2708440a56 P 2fda9136dc39419caca3051af8d00e26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } } peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } }
I20260709 13:16:30.768205  7317 raft_consensus.cc:2468] T 061106f0a9a34f2987ed9c2708440a56 P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fda9136dc39419caca3051af8d00e26 in term 2.
I20260709 13:16:30.775054  7138 catalog_manager.cc:5697] T 061106f0a9a34f2987ed9c2708440a56 P 2fda9136dc39419caca3051af8d00e26 reported cstate change: term changed from 1 to 2, leader changed from 5b47ff4d5f12424c9b97ddcc0b4a887e (127.27.146.130) to 2fda9136dc39419caca3051af8d00e26 (127.27.146.129). New cstate: current_term: 2 leader_uuid: "2fda9136dc39419caca3051af8d00e26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:30.881409 28234 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:16:30.884836 28234 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:16:30.885632 28234 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:16:30.914685  7242 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e635c1b65a3d478da269206f19f79cca"
dest_uuid: "2fda9136dc39419caca3051af8d00e26"
mode: GRACEFUL
new_leader_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe"
 from {username='slave'} at 127.0.0.1:34600
I20260709 13:16:30.915679  7242 raft_consensus.cc:606] T e635c1b65a3d478da269206f19f79cca P 2fda9136dc39419caca3051af8d00e26 [term 2 LEADER]: Received request to transfer leadership to TS 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe
I20260709 13:16:30.917436 28234 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:16:30.935900  7391 raft_consensus.cc:1275] T e1937954537243c8917f89a7417459ce P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 2 FOLLOWER]: Refusing update from remote peer 5b47ff4d5f12424c9b97ddcc0b4a887e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:30.937547  7479 consensus_queue.cc:1048] T e1937954537243c8917f89a7417459ce P 5b47ff4d5f12424c9b97ddcc0b4a887e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:30.951547  7242 raft_consensus.cc:1275] T e1937954537243c8917f89a7417459ce P 2fda9136dc39419caca3051af8d00e26 [term 2 FOLLOWER]: Refusing update from remote peer 5b47ff4d5f12424c9b97ddcc0b4a887e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:30.953158  7479 consensus_queue.cc:1048] T e1937954537243c8917f89a7417459ce P 5b47ff4d5f12424c9b97ddcc0b4a887e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:31.236431  7317 raft_consensus.cc:1275] T e635c1b65a3d478da269206f19f79cca P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 2 FOLLOWER]: Refusing update from remote peer 2fda9136dc39419caca3051af8d00e26: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:31.238560  7440 consensus_queue.cc:1048] T e635c1b65a3d478da269206f19f79cca P 2fda9136dc39419caca3051af8d00e26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:31.239296  7317 raft_consensus.cc:1275] T 061106f0a9a34f2987ed9c2708440a56 P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 2 FOLLOWER]: Refusing update from remote peer 2fda9136dc39419caca3051af8d00e26: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:31.240872  7440 consensus_queue.cc:1048] T 061106f0a9a34f2987ed9c2708440a56 P 2fda9136dc39419caca3051af8d00e26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:31.251384  7391 raft_consensus.cc:1275] T e635c1b65a3d478da269206f19f79cca P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 2 FOLLOWER]: Refusing update from remote peer 2fda9136dc39419caca3051af8d00e26: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:31.254644  7440 consensus_queue.cc:1048] T e635c1b65a3d478da269206f19f79cca P 2fda9136dc39419caca3051af8d00e26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:31.261612  7390 raft_consensus.cc:1275] T 061106f0a9a34f2987ed9c2708440a56 P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 2 FOLLOWER]: Refusing update from remote peer 2fda9136dc39419caca3051af8d00e26: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:31.263990  7448 consensus_queue.cc:1048] T 061106f0a9a34f2987ed9c2708440a56 P 2fda9136dc39419caca3051af8d00e26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:31.267412  7448 raft_consensus.cc:993] T e635c1b65a3d478da269206f19f79cca P 2fda9136dc39419caca3051af8d00e26: : Instructing follower 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe to start an election
I20260709 13:16:31.268040  7448 raft_consensus.cc:1081] T e635c1b65a3d478da269206f19f79cca P 2fda9136dc39419caca3051af8d00e26 [term 2 LEADER]: Signalling peer 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe to start an election
I20260709 13:16:31.269829  7390 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e635c1b65a3d478da269206f19f79cca"
dest_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe"
 from {username='slave'} at 127.0.0.1:36496
I20260709 13:16:31.270469  7390 raft_consensus.cc:493] T e635c1b65a3d478da269206f19f79cca P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:31.270895  7390 raft_consensus.cc:3060] T e635c1b65a3d478da269206f19f79cca P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:31.278898  7390 raft_consensus.cc:515] T e635c1b65a3d478da269206f19f79cca P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } }
I20260709 13:16:31.281729  7390 leader_election.cc:290] T e635c1b65a3d478da269206f19f79cca P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [CANDIDATE]: Term 3 election: Requested vote from peers 2fda9136dc39419caca3051af8d00e26 (127.27.146.129:39945), 5b47ff4d5f12424c9b97ddcc0b4a887e (127.27.146.130:36919)
I20260709 13:16:31.297200  7242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e635c1b65a3d478da269206f19f79cca" candidate_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2fda9136dc39419caca3051af8d00e26"
I20260709 13:16:31.298306  7242 raft_consensus.cc:3055] T e635c1b65a3d478da269206f19f79cca P 2fda9136dc39419caca3051af8d00e26 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:31.298666  7242 raft_consensus.cc:740] T e635c1b65a3d478da269206f19f79cca P 2fda9136dc39419caca3051af8d00e26 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2fda9136dc39419caca3051af8d00e26, State: Running, Role: LEADER
I20260709 13:16:31.299561  7242 consensus_queue.cc:260] T e635c1b65a3d478da269206f19f79cca P 2fda9136dc39419caca3051af8d00e26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } }
I20260709 13:16:31.301036  7242 raft_consensus.cc:3060] T e635c1b65a3d478da269206f19f79cca P 2fda9136dc39419caca3051af8d00e26 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:31.300976  7316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e635c1b65a3d478da269206f19f79cca" candidate_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e"
I20260709 13:16:31.301796  7316 raft_consensus.cc:3060] T e635c1b65a3d478da269206f19f79cca P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:31.308669  7316 raft_consensus.cc:2468] T e635c1b65a3d478da269206f19f79cca P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe in term 3.
I20260709 13:16:31.308789  7242 raft_consensus.cc:2468] T e635c1b65a3d478da269206f19f79cca P 2fda9136dc39419caca3051af8d00e26 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe in term 3.
I20260709 13:16:31.310271  7356 leader_election.cc:304] T e635c1b65a3d478da269206f19f79cca P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b47ff4d5f12424c9b97ddcc0b4a887e, 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe; no voters: 
I20260709 13:16:31.311228  7439 raft_consensus.cc:2804] T e635c1b65a3d478da269206f19f79cca P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:31.312276  7439 raft_consensus.cc:697] T e635c1b65a3d478da269206f19f79cca P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 3 LEADER]: Becoming Leader. State: Replica: 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe, State: Running, Role: LEADER
I20260709 13:16:31.313055  7439 consensus_queue.cc:237] T e635c1b65a3d478da269206f19f79cca P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } }
I20260709 13:16:31.320374  7139 catalog_manager.cc:5697] T e635c1b65a3d478da269206f19f79cca P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe reported cstate change: term changed from 2 to 3, leader changed from 2fda9136dc39419caca3051af8d00e26 (127.27.146.129) to 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe (127.27.146.131). New cstate: current_term: 3 leader_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fda9136dc39419caca3051af8d00e26" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 39945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b47ff4d5f12424c9b97ddcc0b4a887e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 36919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 44739 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:31.567081 28234 tablet_server.cc:179] TabletServer@127.27.146.129:0 shutting down...
W20260709 13:16:31.594786  7283 consensus_peers.cc:597] T e1937954537243c8917f89a7417459ce P 5b47ff4d5f12424c9b97ddcc0b4a887e -> Peer 2fda9136dc39419caca3051af8d00e26 (127.27.146.129:39945): Couldn't send request to peer 2fda9136dc39419caca3051af8d00e26. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:31.608592 28234 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:31.609475 28234 tablet_replica.cc:333] T 7dc7122ba1844230839afdf8caffd9d1 P 2fda9136dc39419caca3051af8d00e26: stopping tablet replica
I20260709 13:16:31.610155 28234 raft_consensus.cc:2243] T 7dc7122ba1844230839afdf8caffd9d1 P 2fda9136dc39419caca3051af8d00e26 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:31.611065 28234 raft_consensus.cc:2272] T 7dc7122ba1844230839afdf8caffd9d1 P 2fda9136dc39419caca3051af8d00e26 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:31.613698 28234 tablet_replica.cc:333] T e635c1b65a3d478da269206f19f79cca P 2fda9136dc39419caca3051af8d00e26: stopping tablet replica
I20260709 13:16:31.614436 28234 raft_consensus.cc:2243] T e635c1b65a3d478da269206f19f79cca P 2fda9136dc39419caca3051af8d00e26 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:31.615110 28234 raft_consensus.cc:2272] T e635c1b65a3d478da269206f19f79cca P 2fda9136dc39419caca3051af8d00e26 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:31.617817 28234 tablet_replica.cc:333] T e1937954537243c8917f89a7417459ce P 2fda9136dc39419caca3051af8d00e26: stopping tablet replica
I20260709 13:16:31.618412 28234 raft_consensus.cc:2243] T e1937954537243c8917f89a7417459ce P 2fda9136dc39419caca3051af8d00e26 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:31.618848 28234 raft_consensus.cc:2272] T e1937954537243c8917f89a7417459ce P 2fda9136dc39419caca3051af8d00e26 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:31.621699 28234 tablet_replica.cc:333] T 061106f0a9a34f2987ed9c2708440a56 P 2fda9136dc39419caca3051af8d00e26: stopping tablet replica
I20260709 13:16:31.622258 28234 raft_consensus.cc:2243] T 061106f0a9a34f2987ed9c2708440a56 P 2fda9136dc39419caca3051af8d00e26 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:31.623207 28234 raft_consensus.cc:2272] T 061106f0a9a34f2987ed9c2708440a56 P 2fda9136dc39419caca3051af8d00e26 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:31.650171 28234 tablet_server.cc:196] TabletServer@127.27.146.129:0 shutdown complete.
I20260709 13:16:31.665159 28234 tablet_server.cc:179] TabletServer@127.27.146.130:0 shutting down...
I20260709 13:16:31.689953 28234 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:31.690855 28234 tablet_replica.cc:333] T e635c1b65a3d478da269206f19f79cca P 5b47ff4d5f12424c9b97ddcc0b4a887e: stopping tablet replica
I20260709 13:16:31.729286 28234 raft_consensus.cc:2243] T e635c1b65a3d478da269206f19f79cca P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:31.731431 28234 raft_consensus.cc:2272] T e635c1b65a3d478da269206f19f79cca P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:31.736809 28234 tablet_replica.cc:333] T 7dc7122ba1844230839afdf8caffd9d1 P 5b47ff4d5f12424c9b97ddcc0b4a887e: stopping tablet replica
I20260709 13:16:31.738344 28234 raft_consensus.cc:2243] T 7dc7122ba1844230839afdf8caffd9d1 P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:31.739099 28234 raft_consensus.cc:2272] T 7dc7122ba1844230839afdf8caffd9d1 P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:31.742491 28234 tablet_replica.cc:333] T e1937954537243c8917f89a7417459ce P 5b47ff4d5f12424c9b97ddcc0b4a887e: stopping tablet replica
I20260709 13:16:31.743093 28234 raft_consensus.cc:2243] T e1937954537243c8917f89a7417459ce P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:31.744946 28234 raft_consensus.cc:2272] T e1937954537243c8917f89a7417459ce P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:31.749404 28234 tablet_replica.cc:333] T 061106f0a9a34f2987ed9c2708440a56 P 5b47ff4d5f12424c9b97ddcc0b4a887e: stopping tablet replica
I20260709 13:16:31.750087 28234 raft_consensus.cc:2243] T 061106f0a9a34f2987ed9c2708440a56 P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:31.750880 28234 raft_consensus.cc:2272] T 061106f0a9a34f2987ed9c2708440a56 P 5b47ff4d5f12424c9b97ddcc0b4a887e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:31.779580  7356 consensus_peers.cc:597] T e635c1b65a3d478da269206f19f79cca P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe -> Peer 5b47ff4d5f12424c9b97ddcc0b4a887e (127.27.146.130:36919): Couldn't send request to peer 5b47ff4d5f12424c9b97ddcc0b4a887e. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:36919: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:31.780103 28234 tablet_server.cc:196] TabletServer@127.27.146.130:0 shutdown complete.
I20260709 13:16:31.809154 28234 tablet_server.cc:179] TabletServer@127.27.146.131:0 shutting down...
W20260709 13:16:31.844483  7357 consensus_peers.cc:597] T e635c1b65a3d478da269206f19f79cca P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe -> Peer 2fda9136dc39419caca3051af8d00e26 (127.27.146.129:39945): Couldn't send request to peer 2fda9136dc39419caca3051af8d00e26. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:39945: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:31.853122 28234 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:31.854310 28234 tablet_replica.cc:333] T e635c1b65a3d478da269206f19f79cca P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe: stopping tablet replica
I20260709 13:16:31.855190 28234 raft_consensus.cc:2243] T e635c1b65a3d478da269206f19f79cca P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:31.856433 28234 pending_rounds.cc:70] T e635c1b65a3d478da269206f19f79cca P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe: Trying to abort 1 pending ops.
I20260709 13:16:31.856676 28234 pending_rounds.cc:77] T e635c1b65a3d478da269206f19f79cca P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305637852426784768 op_type: NO_OP noop_request { }
I20260709 13:16:31.857242 28234 raft_consensus.cc:2889] T e635c1b65a3d478da269206f19f79cca P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:16:31.857674 28234 raft_consensus.cc:2272] T e635c1b65a3d478da269206f19f79cca P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:31.862010 28234 tablet_replica.cc:333] T 7dc7122ba1844230839afdf8caffd9d1 P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe: stopping tablet replica
I20260709 13:16:31.862946 28234 raft_consensus.cc:2243] T 7dc7122ba1844230839afdf8caffd9d1 P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:31.863924 28234 raft_consensus.cc:2272] T 7dc7122ba1844230839afdf8caffd9d1 P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:31.866926 28234 tablet_replica.cc:333] T 061106f0a9a34f2987ed9c2708440a56 P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe: stopping tablet replica
I20260709 13:16:31.867631 28234 raft_consensus.cc:2243] T 061106f0a9a34f2987ed9c2708440a56 P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:31.868350 28234 raft_consensus.cc:2272] T 061106f0a9a34f2987ed9c2708440a56 P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:31.872552 28234 tablet_replica.cc:333] T e1937954537243c8917f89a7417459ce P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe: stopping tablet replica
I20260709 13:16:31.873180 28234 raft_consensus.cc:2243] T e1937954537243c8917f89a7417459ce P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:31.873884 28234 raft_consensus.cc:2272] T e1937954537243c8917f89a7417459ce P 7ce7bf8cb2464a4b8ad9a1ef3b5a4ebe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:31.902858 28234 tablet_server.cc:196] TabletServer@127.27.146.131:0 shutdown complete.
I20260709 13:16:31.927889 28234 master.cc:562] Master@127.27.146.190:46499 shutting down...
I20260709 13:16:31.953272 28234 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3b7b990859ae49f1b025f0b3c6309b4e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:31.954178 28234 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3b7b990859ae49f1b025f0b3c6309b4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:31.954530 28234 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3b7b990859ae49f1b025f0b3c6309b4e: stopping tablet replica
I20260709 13:16:31.979130 28234 master.cc:584] Master@127.27.146.190:46499 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (3401 ms)
[----------] 6 tests from LeaderRebalancerTest (343208 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:16:32.033358 28234 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.27.146.190:46761
I20260709 13:16:32.034713 28234 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:32.041733  7498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:32.041767  7499 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:32.042377  7501 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:32.043877 28234 server_base.cc:1061] running on GCE node
I20260709 13:16:32.044821 28234 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:32.045001 28234 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:32.045116 28234 hybrid_clock.cc:648] HybridClock initialized: now 1783602992045102 us; error 0 us; skew 500 ppm
I20260709 13:16:32.045661 28234 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:32.048364 28234 webserver.cc:533] Webserver started at http://127.27.146.190:46599/ using document root <none> and password file <none>
I20260709 13:16:32.048846 28234 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:32.049003 28234 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:32.049254 28234 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:32.050624 28234 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602648606606-28234-0/minicluster-data/master-0-root/instance:
uuid: "97eda03e8cdb44d791ffb8e7962b9113"
format_stamp: "Formatted at 2026-07-09 13:16:32 on dist-test-slave-clfv"
I20260709 13:16:32.055804 28234 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:16:32.059943  7506 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:32.060789 28234 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:16:32.061124 28234 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602648606606-28234-0/minicluster-data/master-0-root
uuid: "97eda03e8cdb44d791ffb8e7962b9113"
format_stamp: "Formatted at 2026-07-09 13:16:32 on dist-test-slave-clfv"
I20260709 13:16:32.061488 28234 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602648606606-28234-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602648606606-28234-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602648606606-28234-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:32.084491 28234 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:32.086277 28234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:32.134537 28234 rpc_server.cc:307] RPC server started. Bound to: 127.27.146.190:46761
I20260709 13:16:32.134651  7557 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.146.190:46761 every 8 connection(s)
I20260709 13:16:32.139245  7558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.154127  7558 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97eda03e8cdb44d791ffb8e7962b9113: Bootstrap starting.
I20260709 13:16:32.159956  7558 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 97eda03e8cdb44d791ffb8e7962b9113: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.165604  7558 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97eda03e8cdb44d791ffb8e7962b9113: No bootstrap required, opened a new log
I20260709 13:16:32.168287  7558 raft_consensus.cc:359] T 00000000000000000000000000000000 P 97eda03e8cdb44d791ffb8e7962b9113 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97eda03e8cdb44d791ffb8e7962b9113" member_type: VOTER }
I20260709 13:16:32.168759  7558 raft_consensus.cc:385] T 00000000000000000000000000000000 P 97eda03e8cdb44d791ffb8e7962b9113 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.168960  7558 raft_consensus.cc:740] T 00000000000000000000000000000000 P 97eda03e8cdb44d791ffb8e7962b9113 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97eda03e8cdb44d791ffb8e7962b9113, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.169636  7558 consensus_queue.cc:260] T 00000000000000000000000000000000 P 97eda03e8cdb44d791ffb8e7962b9113 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97eda03e8cdb44d791ffb8e7962b9113" member_type: VOTER }
I20260709 13:16:32.170094  7558 raft_consensus.cc:399] T 00000000000000000000000000000000 P 97eda03e8cdb44d791ffb8e7962b9113 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:16:32.170303  7558 raft_consensus.cc:493] T 00000000000000000000000000000000 P 97eda03e8cdb44d791ffb8e7962b9113 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:16:32.170531  7558 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 97eda03e8cdb44d791ffb8e7962b9113 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:32.176403  7558 raft_consensus.cc:515] T 00000000000000000000000000000000 P 97eda03e8cdb44d791ffb8e7962b9113 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97eda03e8cdb44d791ffb8e7962b9113" member_type: VOTER }
I20260709 13:16:32.176986  7558 leader_election.cc:304] T 00000000000000000000000000000000 P 97eda03e8cdb44d791ffb8e7962b9113 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 97eda03e8cdb44d791ffb8e7962b9113; no voters: 
I20260709 13:16:32.178265  7558 leader_election.cc:290] T 00000000000000000000000000000000 P 97eda03e8cdb44d791ffb8e7962b9113 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:16:32.178658  7561 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 97eda03e8cdb44d791ffb8e7962b9113 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:32.180264  7561 raft_consensus.cc:697] T 00000000000000000000000000000000 P 97eda03e8cdb44d791ffb8e7962b9113 [term 1 LEADER]: Becoming Leader. State: Replica: 97eda03e8cdb44d791ffb8e7962b9113, State: Running, Role: LEADER
I20260709 13:16:32.181080  7561 consensus_queue.cc:237] T 00000000000000000000000000000000 P 97eda03e8cdb44d791ffb8e7962b9113 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97eda03e8cdb44d791ffb8e7962b9113" member_type: VOTER }
I20260709 13:16:32.181842  7558 sys_catalog.cc:565] T 00000000000000000000000000000000 P 97eda03e8cdb44d791ffb8e7962b9113 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:16:32.184880  7563 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97eda03e8cdb44d791ffb8e7962b9113 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 97eda03e8cdb44d791ffb8e7962b9113. Latest consensus state: current_term: 1 leader_uuid: "97eda03e8cdb44d791ffb8e7962b9113" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97eda03e8cdb44d791ffb8e7962b9113" member_type: VOTER } }
I20260709 13:16:32.184865  7562 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97eda03e8cdb44d791ffb8e7962b9113 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "97eda03e8cdb44d791ffb8e7962b9113" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "97eda03e8cdb44d791ffb8e7962b9113" member_type: VOTER } }
I20260709 13:16:32.185802  7563 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97eda03e8cdb44d791ffb8e7962b9113 [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:32.185899  7562 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97eda03e8cdb44d791ffb8e7962b9113 [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:32.191442  7568 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:16:32.199932  7568 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:16:32.201119 28234 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:16:32.210604  7568 catalog_manager.cc:1383] Generated new cluster ID: 3be0f6078e6d4755bfa8a0cb06c3e6e1
I20260709 13:16:32.211151  7568 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:16:32.239456  7568 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:16:32.241040  7568 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:16:32.256196  7568 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 97eda03e8cdb44d791ffb8e7962b9113: Generated new TSK 0
I20260709 13:16:32.256958  7568 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:16:32.268442 28234 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:32.275560  7579 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:32.276743  7580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:32.279300 28234 server_base.cc:1061] running on GCE node
W20260709 13:16:32.279294  7582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:32.280659 28234 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:32.280910 28234 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:32.281071 28234 hybrid_clock.cc:648] HybridClock initialized: now 1783602992281054 us; error 0 us; skew 500 ppm
I20260709 13:16:32.281708 28234 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:32.284653 28234 webserver.cc:533] Webserver started at http://127.27.146.129:35793/ using document root <none> and password file <none>
I20260709 13:16:32.285209 28234 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:32.285405 28234 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:32.285713 28234 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:32.287101 28234 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602648606606-28234-0/minicluster-data/ts-0-root/instance:
uuid: "005ee35e74e24295be2b88596986b0e0"
format_stamp: "Formatted at 2026-07-09 13:16:32 on dist-test-slave-clfv"
I20260709 13:16:32.292430 28234 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:16:32.296578  7587 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:32.297582 28234 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:16:32.298039 28234 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602648606606-28234-0/minicluster-data/ts-0-root
uuid: "005ee35e74e24295be2b88596986b0e0"
format_stamp: "Formatted at 2026-07-09 13:16:32 on dist-test-slave-clfv"
I20260709 13:16:32.298388 28234 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602648606606-28234-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602648606606-28234-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602648606606-28234-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:32.318240 28234 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:32.320133 28234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:32.321884 28234 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:32.324529 28234 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:32.324772 28234 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:32.325068 28234 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:32.325258 28234 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:32.378099 28234 rpc_server.cc:307] RPC server started. Bound to: 127.27.146.129:40847
I20260709 13:16:32.378238  7649 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.146.129:40847 every 8 connection(s)
I20260709 13:16:32.384353 28234 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:32.392621  7654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:32.394279  7655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:32.399278  7657 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:32.400180 28234 server_base.cc:1061] running on GCE node
I20260709 13:16:32.400655  7650 heartbeater.cc:344] Connected to a master server at 127.27.146.190:46761
I20260709 13:16:32.401070  7650 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:32.401401 28234 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:32.401633 28234 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:32.401854 28234 hybrid_clock.cc:648] HybridClock initialized: now 1783602992401830 us; error 0 us; skew 500 ppm
I20260709 13:16:32.401974  7650 heartbeater.cc:507] Master 127.27.146.190:46761 requested a full tablet report, sending...
I20260709 13:16:32.402614 28234 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:32.404855  7523 ts_manager.cc:194] Registered new tserver with Master: 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847)
I20260709 13:16:32.406042 28234 webserver.cc:533] Webserver started at http://127.27.146.130:33575/ using document root <none> and password file <none>
I20260709 13:16:32.406692 28234 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:32.406927 28234 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:32.407218 28234 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:32.407382  7523 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43854
I20260709 13:16:32.408926 28234 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602648606606-28234-0/minicluster-data/ts-1-root/instance:
uuid: "256feb60c06e4ccbaeec28266939797e"
format_stamp: "Formatted at 2026-07-09 13:16:32 on dist-test-slave-clfv"
I20260709 13:16:32.414196 28234 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:16:32.418290  7662 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:32.419179 28234 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:16:32.419572 28234 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602648606606-28234-0/minicluster-data/ts-1-root
uuid: "256feb60c06e4ccbaeec28266939797e"
format_stamp: "Formatted at 2026-07-09 13:16:32 on dist-test-slave-clfv"
I20260709 13:16:32.419906 28234 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602648606606-28234-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602648606606-28234-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602648606606-28234-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:32.432888 28234 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:32.434294 28234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:32.436022 28234 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:32.438485 28234 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:32.438722 28234 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:32.438973 28234 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:32.439150 28234 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:32.491050 28234 rpc_server.cc:307] RPC server started. Bound to: 127.27.146.130:38449
I20260709 13:16:32.491195  7724 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.146.130:38449 every 8 connection(s)
I20260709 13:16:32.497133 28234 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:32.505513  7728 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:32.506724  7729 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:32.510303 28234 server_base.cc:1061] running on GCE node
W20260709 13:16:32.511793  7731 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:32.513437 28234 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:16:32.513615  7725 heartbeater.cc:344] Connected to a master server at 127.27.146.190:46761
W20260709 13:16:32.513764 28234 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:32.514243 28234 hybrid_clock.cc:648] HybridClock initialized: now 1783602992514215 us; error 0 us; skew 500 ppm
I20260709 13:16:32.514271  7725 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:32.515040 28234 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:32.515326  7725 heartbeater.cc:507] Master 127.27.146.190:46761 requested a full tablet report, sending...
I20260709 13:16:32.518015  7523 ts_manager.cc:194] Registered new tserver with Master: 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449)
I20260709 13:16:32.518214 28234 webserver.cc:533] Webserver started at http://127.27.146.131:33107/ using document root <none> and password file <none>
I20260709 13:16:32.518978 28234 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:32.519225 28234 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:32.519765 28234 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:32.520377  7523 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59358
I20260709 13:16:32.521981 28234 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602648606606-28234-0/minicluster-data/ts-2-root/instance:
uuid: "7c45cd47cdbf4b93ba0e20539d18b63d"
format_stamp: "Formatted at 2026-07-09 13:16:32 on dist-test-slave-clfv"
I20260709 13:16:32.527902 28234 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.003s
I20260709 13:16:32.532198  7736 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:32.533514 28234 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:16:32.533874 28234 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602648606606-28234-0/minicluster-data/ts-2-root
uuid: "7c45cd47cdbf4b93ba0e20539d18b63d"
format_stamp: "Formatted at 2026-07-09 13:16:32 on dist-test-slave-clfv"
I20260709 13:16:32.534195 28234 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602648606606-28234-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602648606606-28234-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602648606606-28234-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:32.568207 28234 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:32.569784 28234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:32.571575 28234 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:32.574343 28234 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:32.574566 28234 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:32.574761 28234 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:32.574895 28234 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:32.631039 28234 rpc_server.cc:307] RPC server started. Bound to: 127.27.146.131:34071
I20260709 13:16:32.631230  7798 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.146.131:34071 every 8 connection(s)
I20260709 13:16:32.647639  7799 heartbeater.cc:344] Connected to a master server at 127.27.146.190:46761
I20260709 13:16:32.648260  7799 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:32.649204  7799 heartbeater.cc:507] Master 127.27.146.190:46761 requested a full tablet report, sending...
I20260709 13:16:32.651669  7523 ts_manager.cc:194] Registered new tserver with Master: 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071)
I20260709 13:16:32.652333 28234 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017546762s
I20260709 13:16:32.653743  7523 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59360
I20260709 13:16:32.688946  7523 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59374:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:16:32.692255  7523 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:16:32.795233  7615 tablet_service.cc:1511] Processing CreateTablet for tablet 03c0eb40dfe644029acaf5902efd770f (DEFAULT_TABLE table=test-workload [id=3963e2d16b2945058843f15915fa69a5]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:32.797134  7615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03c0eb40dfe644029acaf5902efd770f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.796885  7614 tablet_service.cc:1511] Processing CreateTablet for tablet fca02db7c6d047448afb5d1e0c861d24 (DEFAULT_TABLE table=test-workload [id=3963e2d16b2945058843f15915fa69a5]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:32.797389  7611 tablet_service.cc:1511] Processing CreateTablet for tablet b3020531bc3d46fab66a8de40da58a22 (DEFAULT_TABLE table=test-workload [id=3963e2d16b2945058843f15915fa69a5]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:32.798461  7614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fca02db7c6d047448afb5d1e0c861d24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.799389  7611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3020531bc3d46fab66a8de40da58a22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.800873  7613 tablet_service.cc:1511] Processing CreateTablet for tablet 042aa79c19c34c80be5b1523a342312b (DEFAULT_TABLE table=test-workload [id=3963e2d16b2945058843f15915fa69a5]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:32.804404  7612 tablet_service.cc:1511] Processing CreateTablet for tablet 13401e98748b4f1a9cc0827692efd70a (DEFAULT_TABLE table=test-workload [id=3963e2d16b2945058843f15915fa69a5]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:32.808231  7610 tablet_service.cc:1511] Processing CreateTablet for tablet 047f830ce7f94325ac2b7a5bbcbb288e (DEFAULT_TABLE table=test-workload [id=3963e2d16b2945058843f15915fa69a5]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:32.802536  7613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 042aa79c19c34c80be5b1523a342312b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.811766  7612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13401e98748b4f1a9cc0827692efd70a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.813565  7610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 047f830ce7f94325ac2b7a5bbcbb288e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.819331  7689 tablet_service.cc:1511] Processing CreateTablet for tablet fca02db7c6d047448afb5d1e0c861d24 (DEFAULT_TABLE table=test-workload [id=3963e2d16b2945058843f15915fa69a5]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:32.821987  7689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fca02db7c6d047448afb5d1e0c861d24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.819331  7690 tablet_service.cc:1511] Processing CreateTablet for tablet 03c0eb40dfe644029acaf5902efd770f (DEFAULT_TABLE table=test-workload [id=3963e2d16b2945058843f15915fa69a5]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:32.828243  7690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03c0eb40dfe644029acaf5902efd770f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.831876  7688 tablet_service.cc:1511] Processing CreateTablet for tablet 042aa79c19c34c80be5b1523a342312b (DEFAULT_TABLE table=test-workload [id=3963e2d16b2945058843f15915fa69a5]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:32.832660  7686 tablet_service.cc:1511] Processing CreateTablet for tablet b3020531bc3d46fab66a8de40da58a22 (DEFAULT_TABLE table=test-workload [id=3963e2d16b2945058843f15915fa69a5]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:32.833055  7685 tablet_service.cc:1511] Processing CreateTablet for tablet 047f830ce7f94325ac2b7a5bbcbb288e (DEFAULT_TABLE table=test-workload [id=3963e2d16b2945058843f15915fa69a5]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:32.833698  7688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 042aa79c19c34c80be5b1523a342312b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.834441  7686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3020531bc3d46fab66a8de40da58a22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.835144  7685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 047f830ce7f94325ac2b7a5bbcbb288e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.837039  7687 tablet_service.cc:1511] Processing CreateTablet for tablet 13401e98748b4f1a9cc0827692efd70a (DEFAULT_TABLE table=test-workload [id=3963e2d16b2945058843f15915fa69a5]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:32.840737  7687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13401e98748b4f1a9cc0827692efd70a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.842558  7609 tablet_service.cc:1511] Processing CreateTablet for tablet 254e6899d958489e9e02130bfbc4cdf8 (DEFAULT_TABLE table=test-workload [id=3963e2d16b2945058843f15915fa69a5]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:32.844480  7609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 254e6899d958489e9e02130bfbc4cdf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.852154  7608 tablet_service.cc:1511] Processing CreateTablet for tablet 3eea5331f2be4e82ae096a77d8ed4023 (DEFAULT_TABLE table=test-workload [id=3963e2d16b2945058843f15915fa69a5]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:32.853546  7684 tablet_service.cc:1511] Processing CreateTablet for tablet 254e6899d958489e9e02130bfbc4cdf8 (DEFAULT_TABLE table=test-workload [id=3963e2d16b2945058843f15915fa69a5]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:32.854211  7608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eea5331f2be4e82ae096a77d8ed4023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.855302  7684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 254e6899d958489e9e02130bfbc4cdf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.860401  7683 tablet_service.cc:1511] Processing CreateTablet for tablet 3eea5331f2be4e82ae096a77d8ed4023 (DEFAULT_TABLE table=test-workload [id=3963e2d16b2945058843f15915fa69a5]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:32.862982  7683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eea5331f2be4e82ae096a77d8ed4023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.864434  7607 tablet_service.cc:1511] Processing CreateTablet for tablet 5e7913de22ae481cb204173005d94d41 (DEFAULT_TABLE table=test-workload [id=3963e2d16b2945058843f15915fa69a5]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:32.871279  7607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e7913de22ae481cb204173005d94d41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.871929  7682 tablet_service.cc:1511] Processing CreateTablet for tablet 5e7913de22ae481cb204173005d94d41 (DEFAULT_TABLE table=test-workload [id=3963e2d16b2945058843f15915fa69a5]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:32.873867  7682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e7913de22ae481cb204173005d94d41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.893121  7764 tablet_service.cc:1511] Processing CreateTablet for tablet 03c0eb40dfe644029acaf5902efd770f (DEFAULT_TABLE table=test-workload [id=3963e2d16b2945058843f15915fa69a5]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:32.894948  7764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03c0eb40dfe644029acaf5902efd770f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.896943  7763 tablet_service.cc:1511] Processing CreateTablet for tablet fca02db7c6d047448afb5d1e0c861d24 (DEFAULT_TABLE table=test-workload [id=3963e2d16b2945058843f15915fa69a5]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:32.898600  7763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fca02db7c6d047448afb5d1e0c861d24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.901054  7762 tablet_service.cc:1511] Processing CreateTablet for tablet 042aa79c19c34c80be5b1523a342312b (DEFAULT_TABLE table=test-workload [id=3963e2d16b2945058843f15915fa69a5]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:32.902760  7762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 042aa79c19c34c80be5b1523a342312b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.908283  7760 tablet_service.cc:1511] Processing CreateTablet for tablet b3020531bc3d46fab66a8de40da58a22 (DEFAULT_TABLE table=test-workload [id=3963e2d16b2945058843f15915fa69a5]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:32.910243  7760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3020531bc3d46fab66a8de40da58a22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.905117  7761 tablet_service.cc:1511] Processing CreateTablet for tablet 13401e98748b4f1a9cc0827692efd70a (DEFAULT_TABLE table=test-workload [id=3963e2d16b2945058843f15915fa69a5]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:32.913609  7759 tablet_service.cc:1511] Processing CreateTablet for tablet 047f830ce7f94325ac2b7a5bbcbb288e (DEFAULT_TABLE table=test-workload [id=3963e2d16b2945058843f15915fa69a5]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:32.917142  7758 tablet_service.cc:1511] Processing CreateTablet for tablet 254e6899d958489e9e02130bfbc4cdf8 (DEFAULT_TABLE table=test-workload [id=3963e2d16b2945058843f15915fa69a5]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:32.921049  7757 tablet_service.cc:1511] Processing CreateTablet for tablet 3eea5331f2be4e82ae096a77d8ed4023 (DEFAULT_TABLE table=test-workload [id=3963e2d16b2945058843f15915fa69a5]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:32.930537  7758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 254e6899d958489e9e02130bfbc4cdf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.931970  7761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13401e98748b4f1a9cc0827692efd70a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.932696  7757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eea5331f2be4e82ae096a77d8ed4023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.937052  7759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 047f830ce7f94325ac2b7a5bbcbb288e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.945358  7756 tablet_service.cc:1511] Processing CreateTablet for tablet 5e7913de22ae481cb204173005d94d41 (DEFAULT_TABLE table=test-workload [id=3963e2d16b2945058843f15915fa69a5]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:32.947543  7756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e7913de22ae481cb204173005d94d41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:33.046873  7815 tablet_bootstrap.cc:492] T b3020531bc3d46fab66a8de40da58a22 P 256feb60c06e4ccbaeec28266939797e: Bootstrap starting.
I20260709 13:16:33.058094  7814 tablet_bootstrap.cc:492] T b3020531bc3d46fab66a8de40da58a22 P 005ee35e74e24295be2b88596986b0e0: Bootstrap starting.
I20260709 13:16:33.066321  7814 tablet_bootstrap.cc:654] T b3020531bc3d46fab66a8de40da58a22 P 005ee35e74e24295be2b88596986b0e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:33.128520  7816 tablet_bootstrap.cc:492] T 042aa79c19c34c80be5b1523a342312b P 7c45cd47cdbf4b93ba0e20539d18b63d: Bootstrap starting.
I20260709 13:16:33.158007  7815 tablet_bootstrap.cc:654] T b3020531bc3d46fab66a8de40da58a22 P 256feb60c06e4ccbaeec28266939797e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:33.159138  7814 tablet_bootstrap.cc:492] T b3020531bc3d46fab66a8de40da58a22 P 005ee35e74e24295be2b88596986b0e0: No bootstrap required, opened a new log
I20260709 13:16:33.159729  7814 ts_tablet_manager.cc:1403] T b3020531bc3d46fab66a8de40da58a22 P 005ee35e74e24295be2b88596986b0e0: Time spent bootstrapping tablet: real 0.102s	user 0.048s	sys 0.047s
I20260709 13:16:33.163271  7814 raft_consensus.cc:359] T b3020531bc3d46fab66a8de40da58a22 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.164166  7814 raft_consensus.cc:385] T b3020531bc3d46fab66a8de40da58a22 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:33.164496  7814 raft_consensus.cc:740] T b3020531bc3d46fab66a8de40da58a22 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ee35e74e24295be2b88596986b0e0, State: Initialized, Role: FOLLOWER
I20260709 13:16:33.165266  7814 consensus_queue.cc:260] T b3020531bc3d46fab66a8de40da58a22 P 005ee35e74e24295be2b88596986b0e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.174829  7816 tablet_bootstrap.cc:654] T 042aa79c19c34c80be5b1523a342312b P 7c45cd47cdbf4b93ba0e20539d18b63d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:33.178524  7814 ts_tablet_manager.cc:1434] T b3020531bc3d46fab66a8de40da58a22 P 005ee35e74e24295be2b88596986b0e0: Time spent starting tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 13:16:33.179697  7650 heartbeater.cc:499] Master 127.27.146.190:46761 was elected leader, sending a full tablet report...
I20260709 13:16:33.180241  7814 tablet_bootstrap.cc:492] T 5e7913de22ae481cb204173005d94d41 P 005ee35e74e24295be2b88596986b0e0: Bootstrap starting.
I20260709 13:16:33.189947  7814 tablet_bootstrap.cc:654] T 5e7913de22ae481cb204173005d94d41 P 005ee35e74e24295be2b88596986b0e0: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:33.193958  7571 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:33.195814  7815 tablet_bootstrap.cc:492] T b3020531bc3d46fab66a8de40da58a22 P 256feb60c06e4ccbaeec28266939797e: No bootstrap required, opened a new log
I20260709 13:16:33.198032  7814 tablet_bootstrap.cc:492] T 5e7913de22ae481cb204173005d94d41 P 005ee35e74e24295be2b88596986b0e0: No bootstrap required, opened a new log
I20260709 13:16:33.198529  7814 ts_tablet_manager.cc:1403] T 5e7913de22ae481cb204173005d94d41 P 005ee35e74e24295be2b88596986b0e0: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.007s
I20260709 13:16:33.198765  7816 tablet_bootstrap.cc:492] T 042aa79c19c34c80be5b1523a342312b P 7c45cd47cdbf4b93ba0e20539d18b63d: No bootstrap required, opened a new log
I20260709 13:16:33.199353  7816 ts_tablet_manager.cc:1403] T 042aa79c19c34c80be5b1523a342312b P 7c45cd47cdbf4b93ba0e20539d18b63d: Time spent bootstrapping tablet: real 0.071s	user 0.011s	sys 0.004s
I20260709 13:16:33.199568  7815 ts_tablet_manager.cc:1403] T b3020531bc3d46fab66a8de40da58a22 P 256feb60c06e4ccbaeec28266939797e: Time spent bootstrapping tablet: real 0.150s	user 0.025s	sys 0.015s
I20260709 13:16:33.201921  7814 raft_consensus.cc:359] T 5e7913de22ae481cb204173005d94d41 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.202780  7814 raft_consensus.cc:385] T 5e7913de22ae481cb204173005d94d41 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:33.203081  7814 raft_consensus.cc:740] T 5e7913de22ae481cb204173005d94d41 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ee35e74e24295be2b88596986b0e0, State: Initialized, Role: FOLLOWER
I20260709 13:16:33.203444  7816 raft_consensus.cc:359] T 042aa79c19c34c80be5b1523a342312b P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.203543  7815 raft_consensus.cc:359] T b3020531bc3d46fab66a8de40da58a22 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.203980  7814 consensus_queue.cc:260] T 5e7913de22ae481cb204173005d94d41 P 005ee35e74e24295be2b88596986b0e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.204617  7816 raft_consensus.cc:385] T 042aa79c19c34c80be5b1523a342312b P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:33.204871  7815 raft_consensus.cc:385] T b3020531bc3d46fab66a8de40da58a22 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:33.205155  7816 raft_consensus.cc:740] T 042aa79c19c34c80be5b1523a342312b P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c45cd47cdbf4b93ba0e20539d18b63d, State: Initialized, Role: FOLLOWER
I20260709 13:16:33.205262  7815 raft_consensus.cc:740] T b3020531bc3d46fab66a8de40da58a22 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 256feb60c06e4ccbaeec28266939797e, State: Initialized, Role: FOLLOWER
I20260709 13:16:33.206851  7814 ts_tablet_manager.cc:1434] T 5e7913de22ae481cb204173005d94d41 P 005ee35e74e24295be2b88596986b0e0: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:16:33.206394  7815 consensus_queue.cc:260] T b3020531bc3d46fab66a8de40da58a22 P 256feb60c06e4ccbaeec28266939797e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.206394  7816 consensus_queue.cc:260] T 042aa79c19c34c80be5b1523a342312b P 7c45cd47cdbf4b93ba0e20539d18b63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.208029  7814 tablet_bootstrap.cc:492] T 03c0eb40dfe644029acaf5902efd770f P 005ee35e74e24295be2b88596986b0e0: Bootstrap starting.
I20260709 13:16:33.215363  7814 tablet_bootstrap.cc:654] T 03c0eb40dfe644029acaf5902efd770f P 005ee35e74e24295be2b88596986b0e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:33.218021  7816 ts_tablet_manager.cc:1434] T 042aa79c19c34c80be5b1523a342312b P 7c45cd47cdbf4b93ba0e20539d18b63d: Time spent starting tablet: real 0.018s	user 0.011s	sys 0.000s
I20260709 13:16:33.219341  7799 heartbeater.cc:499] Master 127.27.146.190:46761 was elected leader, sending a full tablet report...
I20260709 13:16:33.220548  7725 heartbeater.cc:499] Master 127.27.146.190:46761 was elected leader, sending a full tablet report...
I20260709 13:16:33.222460  7815 ts_tablet_manager.cc:1434] T b3020531bc3d46fab66a8de40da58a22 P 256feb60c06e4ccbaeec28266939797e: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.009s
I20260709 13:16:33.224166  7815 tablet_bootstrap.cc:492] T 254e6899d958489e9e02130bfbc4cdf8 P 256feb60c06e4ccbaeec28266939797e: Bootstrap starting.
I20260709 13:16:33.232453  7816 tablet_bootstrap.cc:492] T 13401e98748b4f1a9cc0827692efd70a P 7c45cd47cdbf4b93ba0e20539d18b63d: Bootstrap starting.
I20260709 13:16:33.235824  7815 tablet_bootstrap.cc:654] T 254e6899d958489e9e02130bfbc4cdf8 P 256feb60c06e4ccbaeec28266939797e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:33.244728  7816 tablet_bootstrap.cc:654] T 13401e98748b4f1a9cc0827692efd70a P 7c45cd47cdbf4b93ba0e20539d18b63d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:33.247045  7814 tablet_bootstrap.cc:492] T 03c0eb40dfe644029acaf5902efd770f P 005ee35e74e24295be2b88596986b0e0: No bootstrap required, opened a new log
I20260709 13:16:33.250862  7814 ts_tablet_manager.cc:1403] T 03c0eb40dfe644029acaf5902efd770f P 005ee35e74e24295be2b88596986b0e0: Time spent bootstrapping tablet: real 0.043s	user 0.006s	sys 0.032s
I20260709 13:16:33.254863  7814 raft_consensus.cc:359] T 03c0eb40dfe644029acaf5902efd770f P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } } peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } }
I20260709 13:16:33.255645  7815 tablet_bootstrap.cc:492] T 254e6899d958489e9e02130bfbc4cdf8 P 256feb60c06e4ccbaeec28266939797e: No bootstrap required, opened a new log
I20260709 13:16:33.255776  7816 tablet_bootstrap.cc:492] T 13401e98748b4f1a9cc0827692efd70a P 7c45cd47cdbf4b93ba0e20539d18b63d: No bootstrap required, opened a new log
I20260709 13:16:33.255795  7814 raft_consensus.cc:385] T 03c0eb40dfe644029acaf5902efd770f P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:33.256484  7815 ts_tablet_manager.cc:1403] T 254e6899d958489e9e02130bfbc4cdf8 P 256feb60c06e4ccbaeec28266939797e: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.020s
I20260709 13:16:33.256752  7816 ts_tablet_manager.cc:1403] T 13401e98748b4f1a9cc0827692efd70a P 7c45cd47cdbf4b93ba0e20539d18b63d: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.000s
I20260709 13:16:33.256695  7814 raft_consensus.cc:740] T 03c0eb40dfe644029acaf5902efd770f P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ee35e74e24295be2b88596986b0e0, State: Initialized, Role: FOLLOWER
I20260709 13:16:33.258075  7814 consensus_queue.cc:260] T 03c0eb40dfe644029acaf5902efd770f P 005ee35e74e24295be2b88596986b0e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } } peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } }
I20260709 13:16:33.260236  7815 raft_consensus.cc:359] T 254e6899d958489e9e02130bfbc4cdf8 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.260756  7814 ts_tablet_manager.cc:1434] T 03c0eb40dfe644029acaf5902efd770f P 005ee35e74e24295be2b88596986b0e0: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:16:33.260499  7816 raft_consensus.cc:359] T 13401e98748b4f1a9cc0827692efd70a P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.261085  7815 raft_consensus.cc:385] T 254e6899d958489e9e02130bfbc4cdf8 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:33.261372  7816 raft_consensus.cc:385] T 13401e98748b4f1a9cc0827692efd70a P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:33.261488  7815 raft_consensus.cc:740] T 254e6899d958489e9e02130bfbc4cdf8 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 256feb60c06e4ccbaeec28266939797e, State: Initialized, Role: FOLLOWER
I20260709 13:16:33.261806  7816 raft_consensus.cc:740] T 13401e98748b4f1a9cc0827692efd70a P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c45cd47cdbf4b93ba0e20539d18b63d, State: Initialized, Role: FOLLOWER
I20260709 13:16:33.262331  7814 tablet_bootstrap.cc:492] T 3eea5331f2be4e82ae096a77d8ed4023 P 005ee35e74e24295be2b88596986b0e0: Bootstrap starting.
I20260709 13:16:33.262444  7815 consensus_queue.cc:260] T 254e6899d958489e9e02130bfbc4cdf8 P 256feb60c06e4ccbaeec28266939797e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.262673  7816 consensus_queue.cc:260] T 13401e98748b4f1a9cc0827692efd70a P 7c45cd47cdbf4b93ba0e20539d18b63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.265266  7815 ts_tablet_manager.cc:1434] T 254e6899d958489e9e02130bfbc4cdf8 P 256feb60c06e4ccbaeec28266939797e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:16:33.265457  7816 ts_tablet_manager.cc:1434] T 13401e98748b4f1a9cc0827692efd70a P 7c45cd47cdbf4b93ba0e20539d18b63d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:16:33.266465  7815 tablet_bootstrap.cc:492] T 5e7913de22ae481cb204173005d94d41 P 256feb60c06e4ccbaeec28266939797e: Bootstrap starting.
I20260709 13:16:33.266572  7816 tablet_bootstrap.cc:492] T b3020531bc3d46fab66a8de40da58a22 P 7c45cd47cdbf4b93ba0e20539d18b63d: Bootstrap starting.
I20260709 13:16:33.271394  7814 tablet_bootstrap.cc:654] T 3eea5331f2be4e82ae096a77d8ed4023 P 005ee35e74e24295be2b88596986b0e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:33.274125  7816 tablet_bootstrap.cc:654] T b3020531bc3d46fab66a8de40da58a22 P 7c45cd47cdbf4b93ba0e20539d18b63d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:33.274657  7815 tablet_bootstrap.cc:654] T 5e7913de22ae481cb204173005d94d41 P 256feb60c06e4ccbaeec28266939797e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:33.284061  7822 raft_consensus.cc:493] T 254e6899d958489e9e02130bfbc4cdf8 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.284953  7814 tablet_bootstrap.cc:492] T 3eea5331f2be4e82ae096a77d8ed4023 P 005ee35e74e24295be2b88596986b0e0: No bootstrap required, opened a new log
I20260709 13:16:33.284925  7822 raft_consensus.cc:515] T 254e6899d958489e9e02130bfbc4cdf8 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.286108  7814 ts_tablet_manager.cc:1403] T 3eea5331f2be4e82ae096a77d8ed4023 P 005ee35e74e24295be2b88596986b0e0: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.006s
I20260709 13:16:33.290767  7814 raft_consensus.cc:359] T 3eea5331f2be4e82ae096a77d8ed4023 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.292697  7814 raft_consensus.cc:385] T 3eea5331f2be4e82ae096a77d8ed4023 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:33.293044  7814 raft_consensus.cc:740] T 3eea5331f2be4e82ae096a77d8ed4023 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ee35e74e24295be2b88596986b0e0, State: Initialized, Role: FOLLOWER
I20260709 13:16:33.294000  7814 consensus_queue.cc:260] T 3eea5331f2be4e82ae096a77d8ed4023 P 005ee35e74e24295be2b88596986b0e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.295295  7815 tablet_bootstrap.cc:492] T 5e7913de22ae481cb204173005d94d41 P 256feb60c06e4ccbaeec28266939797e: No bootstrap required, opened a new log
I20260709 13:16:33.295990  7815 ts_tablet_manager.cc:1403] T 5e7913de22ae481cb204173005d94d41 P 256feb60c06e4ccbaeec28266939797e: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.011s
I20260709 13:16:33.298826  7814 ts_tablet_manager.cc:1434] T 3eea5331f2be4e82ae096a77d8ed4023 P 005ee35e74e24295be2b88596986b0e0: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:16:33.300112  7814 tablet_bootstrap.cc:492] T 254e6899d958489e9e02130bfbc4cdf8 P 005ee35e74e24295be2b88596986b0e0: Bootstrap starting.
I20260709 13:16:33.299692  7822 leader_election.cc:290] T 254e6899d958489e9e02130bfbc4cdf8 P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847), 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071)
I20260709 13:16:33.299724  7815 raft_consensus.cc:359] T 5e7913de22ae481cb204173005d94d41 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.300913  7815 raft_consensus.cc:385] T 5e7913de22ae481cb204173005d94d41 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:33.301290  7815 raft_consensus.cc:740] T 5e7913de22ae481cb204173005d94d41 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 256feb60c06e4ccbaeec28266939797e, State: Initialized, Role: FOLLOWER
I20260709 13:16:33.302371  7815 consensus_queue.cc:260] T 5e7913de22ae481cb204173005d94d41 P 256feb60c06e4ccbaeec28266939797e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.304946  7815 ts_tablet_manager.cc:1434] T 5e7913de22ae481cb204173005d94d41 P 256feb60c06e4ccbaeec28266939797e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:16:33.306504  7815 tablet_bootstrap.cc:492] T 047f830ce7f94325ac2b7a5bbcbb288e P 256feb60c06e4ccbaeec28266939797e: Bootstrap starting.
I20260709 13:16:33.314339  7814 tablet_bootstrap.cc:654] T 254e6899d958489e9e02130bfbc4cdf8 P 005ee35e74e24295be2b88596986b0e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:33.320376  7815 tablet_bootstrap.cc:654] T 047f830ce7f94325ac2b7a5bbcbb288e P 256feb60c06e4ccbaeec28266939797e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:33.329391  7814 tablet_bootstrap.cc:492] T 254e6899d958489e9e02130bfbc4cdf8 P 005ee35e74e24295be2b88596986b0e0: No bootstrap required, opened a new log
I20260709 13:16:33.330161  7814 ts_tablet_manager.cc:1403] T 254e6899d958489e9e02130bfbc4cdf8 P 005ee35e74e24295be2b88596986b0e0: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.001s
I20260709 13:16:33.334648  7814 raft_consensus.cc:359] T 254e6899d958489e9e02130bfbc4cdf8 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.335754  7814 raft_consensus.cc:385] T 254e6899d958489e9e02130bfbc4cdf8 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:33.336140  7814 raft_consensus.cc:740] T 254e6899d958489e9e02130bfbc4cdf8 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ee35e74e24295be2b88596986b0e0, State: Initialized, Role: FOLLOWER
I20260709 13:16:33.338668  7814 consensus_queue.cc:260] T 254e6899d958489e9e02130bfbc4cdf8 P 005ee35e74e24295be2b88596986b0e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.340158  7815 tablet_bootstrap.cc:492] T 047f830ce7f94325ac2b7a5bbcbb288e P 256feb60c06e4ccbaeec28266939797e: No bootstrap required, opened a new log
I20260709 13:16:33.340842  7815 ts_tablet_manager.cc:1403] T 047f830ce7f94325ac2b7a5bbcbb288e P 256feb60c06e4ccbaeec28266939797e: Time spent bootstrapping tablet: real 0.035s	user 0.018s	sys 0.015s
I20260709 13:16:33.341689  7814 ts_tablet_manager.cc:1434] T 254e6899d958489e9e02130bfbc4cdf8 P 005ee35e74e24295be2b88596986b0e0: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 13:16:33.342881  7814 tablet_bootstrap.cc:492] T 13401e98748b4f1a9cc0827692efd70a P 005ee35e74e24295be2b88596986b0e0: Bootstrap starting.
I20260709 13:16:33.344496  7815 raft_consensus.cc:359] T 047f830ce7f94325ac2b7a5bbcbb288e P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.345444  7815 raft_consensus.cc:385] T 047f830ce7f94325ac2b7a5bbcbb288e P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:33.345811  7815 raft_consensus.cc:740] T 047f830ce7f94325ac2b7a5bbcbb288e P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 256feb60c06e4ccbaeec28266939797e, State: Initialized, Role: FOLLOWER
I20260709 13:16:33.347047  7815 consensus_queue.cc:260] T 047f830ce7f94325ac2b7a5bbcbb288e P 256feb60c06e4ccbaeec28266939797e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.351539  7814 tablet_bootstrap.cc:654] T 13401e98748b4f1a9cc0827692efd70a P 005ee35e74e24295be2b88596986b0e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:33.352627  7815 ts_tablet_manager.cc:1434] T 047f830ce7f94325ac2b7a5bbcbb288e P 256feb60c06e4ccbaeec28266939797e: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:16:33.354101  7815 tablet_bootstrap.cc:492] T 3eea5331f2be4e82ae096a77d8ed4023 P 256feb60c06e4ccbaeec28266939797e: Bootstrap starting.
I20260709 13:16:33.364184  7815 tablet_bootstrap.cc:654] T 3eea5331f2be4e82ae096a77d8ed4023 P 256feb60c06e4ccbaeec28266939797e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:33.364544  7814 tablet_bootstrap.cc:492] T 13401e98748b4f1a9cc0827692efd70a P 005ee35e74e24295be2b88596986b0e0: No bootstrap required, opened a new log
I20260709 13:16:33.365193  7814 ts_tablet_manager.cc:1403] T 13401e98748b4f1a9cc0827692efd70a P 005ee35e74e24295be2b88596986b0e0: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.012s
I20260709 13:16:33.369230  7814 raft_consensus.cc:359] T 13401e98748b4f1a9cc0827692efd70a P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.370306  7814 raft_consensus.cc:385] T 13401e98748b4f1a9cc0827692efd70a P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:33.370862  7814 raft_consensus.cc:740] T 13401e98748b4f1a9cc0827692efd70a P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ee35e74e24295be2b88596986b0e0, State: Initialized, Role: FOLLOWER
I20260709 13:16:33.372339  7814 consensus_queue.cc:260] T 13401e98748b4f1a9cc0827692efd70a P 005ee35e74e24295be2b88596986b0e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.376211  7814 ts_tablet_manager.cc:1434] T 13401e98748b4f1a9cc0827692efd70a P 005ee35e74e24295be2b88596986b0e0: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.003s
I20260709 13:16:33.377879  7814 tablet_bootstrap.cc:492] T fca02db7c6d047448afb5d1e0c861d24 P 005ee35e74e24295be2b88596986b0e0: Bootstrap starting.
I20260709 13:16:33.387950  7815 tablet_bootstrap.cc:492] T 3eea5331f2be4e82ae096a77d8ed4023 P 256feb60c06e4ccbaeec28266939797e: No bootstrap required, opened a new log
I20260709 13:16:33.388684  7814 tablet_bootstrap.cc:654] T fca02db7c6d047448afb5d1e0c861d24 P 005ee35e74e24295be2b88596986b0e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:33.388880  7815 ts_tablet_manager.cc:1403] T 3eea5331f2be4e82ae096a77d8ed4023 P 256feb60c06e4ccbaeec28266939797e: Time spent bootstrapping tablet: real 0.035s	user 0.022s	sys 0.009s
I20260709 13:16:33.391531  7822 raft_consensus.cc:493] T b3020531bc3d46fab66a8de40da58a22 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.392127  7822 raft_consensus.cc:515] T b3020531bc3d46fab66a8de40da58a22 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.395366  7822 leader_election.cc:290] T b3020531bc3d46fab66a8de40da58a22 P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847), 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071)
I20260709 13:16:33.398936  7815 raft_consensus.cc:359] T 3eea5331f2be4e82ae096a77d8ed4023 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.399870  7815 raft_consensus.cc:385] T 3eea5331f2be4e82ae096a77d8ed4023 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:33.400246  7815 raft_consensus.cc:740] T 3eea5331f2be4e82ae096a77d8ed4023 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 256feb60c06e4ccbaeec28266939797e, State: Initialized, Role: FOLLOWER
I20260709 13:16:33.401341  7815 consensus_queue.cc:260] T 3eea5331f2be4e82ae096a77d8ed4023 P 256feb60c06e4ccbaeec28266939797e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.402997  7814 tablet_bootstrap.cc:492] T fca02db7c6d047448afb5d1e0c861d24 P 005ee35e74e24295be2b88596986b0e0: No bootstrap required, opened a new log
I20260709 13:16:33.403712  7814 ts_tablet_manager.cc:1403] T fca02db7c6d047448afb5d1e0c861d24 P 005ee35e74e24295be2b88596986b0e0: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.005s
I20260709 13:16:33.406936  7815 ts_tablet_manager.cc:1434] T 3eea5331f2be4e82ae096a77d8ed4023 P 256feb60c06e4ccbaeec28266939797e: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:16:33.408568  7815 tablet_bootstrap.cc:492] T 042aa79c19c34c80be5b1523a342312b P 256feb60c06e4ccbaeec28266939797e: Bootstrap starting.
I20260709 13:16:33.409379  7814 raft_consensus.cc:359] T fca02db7c6d047448afb5d1e0c861d24 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.410311  7814 raft_consensus.cc:385] T fca02db7c6d047448afb5d1e0c861d24 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:33.410626  7814 raft_consensus.cc:740] T fca02db7c6d047448afb5d1e0c861d24 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ee35e74e24295be2b88596986b0e0, State: Initialized, Role: FOLLOWER
I20260709 13:16:33.411201  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254e6899d958489e9e02130bfbc4cdf8" candidate_uuid: "256feb60c06e4ccbaeec28266939797e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" is_pre_election: true
I20260709 13:16:33.411561  7814 consensus_queue.cc:260] T fca02db7c6d047448afb5d1e0c861d24 P 005ee35e74e24295be2b88596986b0e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.413012  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3020531bc3d46fab66a8de40da58a22" candidate_uuid: "256feb60c06e4ccbaeec28266939797e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" is_pre_election: true
I20260709 13:16:33.414181  7814 ts_tablet_manager.cc:1434] T fca02db7c6d047448afb5d1e0c861d24 P 005ee35e74e24295be2b88596986b0e0: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
W20260709 13:16:33.415083  7663 leader_election.cc:343] T 254e6899d958489e9e02130bfbc4cdf8 P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:33.416026  7663 leader_election.cc:343] T b3020531bc3d46fab66a8de40da58a22 P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:33.417853  7815 tablet_bootstrap.cc:654] T 042aa79c19c34c80be5b1523a342312b P 256feb60c06e4ccbaeec28266939797e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:33.415405  7814 tablet_bootstrap.cc:492] T 047f830ce7f94325ac2b7a5bbcbb288e P 005ee35e74e24295be2b88596986b0e0: Bootstrap starting.
I20260709 13:16:33.421522  7624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3020531bc3d46fab66a8de40da58a22" candidate_uuid: "256feb60c06e4ccbaeec28266939797e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ee35e74e24295be2b88596986b0e0" is_pre_election: true
I20260709 13:16:33.422677  7624 raft_consensus.cc:2468] T b3020531bc3d46fab66a8de40da58a22 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 256feb60c06e4ccbaeec28266939797e in term 0.
I20260709 13:16:33.424261  7625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254e6899d958489e9e02130bfbc4cdf8" candidate_uuid: "256feb60c06e4ccbaeec28266939797e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ee35e74e24295be2b88596986b0e0" is_pre_election: true
I20260709 13:16:33.425307  7625 raft_consensus.cc:2468] T 254e6899d958489e9e02130bfbc4cdf8 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 256feb60c06e4ccbaeec28266939797e in term 0.
I20260709 13:16:33.427927  7665 leader_election.cc:304] T b3020531bc3d46fab66a8de40da58a22 P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0, 256feb60c06e4ccbaeec28266939797e; no voters: 7c45cd47cdbf4b93ba0e20539d18b63d
I20260709 13:16:33.429018  7822 raft_consensus.cc:2804] T b3020531bc3d46fab66a8de40da58a22 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:33.429400  7822 raft_consensus.cc:493] T b3020531bc3d46fab66a8de40da58a22 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.429754  7822 raft_consensus.cc:3060] T b3020531bc3d46fab66a8de40da58a22 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.430284  7665 leader_election.cc:304] T 254e6899d958489e9e02130bfbc4cdf8 P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0, 256feb60c06e4ccbaeec28266939797e; no voters: 7c45cd47cdbf4b93ba0e20539d18b63d
I20260709 13:16:33.432168  7814 tablet_bootstrap.cc:654] T 047f830ce7f94325ac2b7a5bbcbb288e P 005ee35e74e24295be2b88596986b0e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:33.435032  7816 tablet_bootstrap.cc:492] T b3020531bc3d46fab66a8de40da58a22 P 7c45cd47cdbf4b93ba0e20539d18b63d: No bootstrap required, opened a new log
I20260709 13:16:33.435707  7816 ts_tablet_manager.cc:1403] T b3020531bc3d46fab66a8de40da58a22 P 7c45cd47cdbf4b93ba0e20539d18b63d: Time spent bootstrapping tablet: real 0.169s	user 0.064s	sys 0.069s
I20260709 13:16:33.436854  7838 raft_consensus.cc:2804] T 254e6899d958489e9e02130bfbc4cdf8 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:33.437428  7838 raft_consensus.cc:493] T 254e6899d958489e9e02130bfbc4cdf8 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.437752  7838 raft_consensus.cc:3060] T 254e6899d958489e9e02130bfbc4cdf8 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.439837  7822 raft_consensus.cc:515] T b3020531bc3d46fab66a8de40da58a22 P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.439054  7816 raft_consensus.cc:359] T b3020531bc3d46fab66a8de40da58a22 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.443037  7625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3020531bc3d46fab66a8de40da58a22" candidate_uuid: "256feb60c06e4ccbaeec28266939797e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ee35e74e24295be2b88596986b0e0"
I20260709 13:16:33.443744  7625 raft_consensus.cc:3060] T b3020531bc3d46fab66a8de40da58a22 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.446107  7815 tablet_bootstrap.cc:492] T 042aa79c19c34c80be5b1523a342312b P 256feb60c06e4ccbaeec28266939797e: No bootstrap required, opened a new log
I20260709 13:16:33.446815  7815 ts_tablet_manager.cc:1403] T 042aa79c19c34c80be5b1523a342312b P 256feb60c06e4ccbaeec28266939797e: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.008s
I20260709 13:16:33.449066  7814 tablet_bootstrap.cc:492] T 047f830ce7f94325ac2b7a5bbcbb288e P 005ee35e74e24295be2b88596986b0e0: No bootstrap required, opened a new log
I20260709 13:16:33.449679  7814 ts_tablet_manager.cc:1403] T 047f830ce7f94325ac2b7a5bbcbb288e P 005ee35e74e24295be2b88596986b0e0: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.005s
I20260709 13:16:33.450417  7815 raft_consensus.cc:359] T 042aa79c19c34c80be5b1523a342312b P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.451205  7815 raft_consensus.cc:385] T 042aa79c19c34c80be5b1523a342312b P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:33.451618  7815 raft_consensus.cc:740] T 042aa79c19c34c80be5b1523a342312b P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 256feb60c06e4ccbaeec28266939797e, State: Initialized, Role: FOLLOWER
I20260709 13:16:33.452922  7816 raft_consensus.cc:385] T b3020531bc3d46fab66a8de40da58a22 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:33.452801  7814 raft_consensus.cc:359] T 047f830ce7f94325ac2b7a5bbcbb288e P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.453466  7816 raft_consensus.cc:740] T b3020531bc3d46fab66a8de40da58a22 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c45cd47cdbf4b93ba0e20539d18b63d, State: Initialized, Role: FOLLOWER
I20260709 13:16:33.453295  7838 raft_consensus.cc:515] T 254e6899d958489e9e02130bfbc4cdf8 P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.452817  7625 raft_consensus.cc:2468] T b3020531bc3d46fab66a8de40da58a22 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 256feb60c06e4ccbaeec28266939797e in term 1.
I20260709 13:16:33.454486  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3020531bc3d46fab66a8de40da58a22" candidate_uuid: "256feb60c06e4ccbaeec28266939797e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d"
I20260709 13:16:33.454723  7816 consensus_queue.cc:260] T b3020531bc3d46fab66a8de40da58a22 P 7c45cd47cdbf4b93ba0e20539d18b63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.455730  7773 raft_consensus.cc:3060] T b3020531bc3d46fab66a8de40da58a22 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.455590  7665 leader_election.cc:304] T b3020531bc3d46fab66a8de40da58a22 P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0, 256feb60c06e4ccbaeec28266939797e; no voters: 
I20260709 13:16:33.455468  7815 consensus_queue.cc:260] T 042aa79c19c34c80be5b1523a342312b P 256feb60c06e4ccbaeec28266939797e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.455929  7822 leader_election.cc:290] T b3020531bc3d46fab66a8de40da58a22 P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 1 election: Requested vote from peers 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847), 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071)
I20260709 13:16:33.457314  7822 raft_consensus.cc:2804] T b3020531bc3d46fab66a8de40da58a22 P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:33.453748  7814 raft_consensus.cc:385] T 047f830ce7f94325ac2b7a5bbcbb288e P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:33.457863  7814 raft_consensus.cc:740] T 047f830ce7f94325ac2b7a5bbcbb288e P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ee35e74e24295be2b88596986b0e0, State: Initialized, Role: FOLLOWER
I20260709 13:16:33.458005  7822 raft_consensus.cc:697] T b3020531bc3d46fab66a8de40da58a22 P 256feb60c06e4ccbaeec28266939797e [term 1 LEADER]: Becoming Leader. State: Replica: 256feb60c06e4ccbaeec28266939797e, State: Running, Role: LEADER
I20260709 13:16:33.458544  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254e6899d958489e9e02130bfbc4cdf8" candidate_uuid: "256feb60c06e4ccbaeec28266939797e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d"
I20260709 13:16:33.459105  7822 consensus_queue.cc:237] T b3020531bc3d46fab66a8de40da58a22 P 256feb60c06e4ccbaeec28266939797e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.460018  7814 consensus_queue.cc:260] T 047f830ce7f94325ac2b7a5bbcbb288e P 005ee35e74e24295be2b88596986b0e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
W20260709 13:16:33.460935  7663 leader_election.cc:343] T 254e6899d958489e9e02130bfbc4cdf8 P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:33.461696  7838 leader_election.cc:290] T 254e6899d958489e9e02130bfbc4cdf8 P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 1 election: Requested vote from peers 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847), 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071)
I20260709 13:16:33.462462  7814 ts_tablet_manager.cc:1434] T 047f830ce7f94325ac2b7a5bbcbb288e P 005ee35e74e24295be2b88596986b0e0: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:16:33.465173  7814 tablet_bootstrap.cc:492] T 042aa79c19c34c80be5b1523a342312b P 005ee35e74e24295be2b88596986b0e0: Bootstrap starting.
I20260709 13:16:33.469539  7625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254e6899d958489e9e02130bfbc4cdf8" candidate_uuid: "256feb60c06e4ccbaeec28266939797e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ee35e74e24295be2b88596986b0e0"
I20260709 13:16:33.470469  7625 raft_consensus.cc:3060] T 254e6899d958489e9e02130bfbc4cdf8 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.473901  7814 tablet_bootstrap.cc:654] T 042aa79c19c34c80be5b1523a342312b P 005ee35e74e24295be2b88596986b0e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:33.480225  7815 ts_tablet_manager.cc:1434] T 042aa79c19c34c80be5b1523a342312b P 256feb60c06e4ccbaeec28266939797e: Time spent starting tablet: real 0.033s	user 0.011s	sys 0.004s
I20260709 13:16:33.479452  7523 catalog_manager.cc:5697] T b3020531bc3d46fab66a8de40da58a22 P 256feb60c06e4ccbaeec28266939797e reported cstate change: term changed from 0 to 1, leader changed from <none> to 256feb60c06e4ccbaeec28266939797e (127.27.146.130). New cstate: current_term: 1 leader_uuid: "256feb60c06e4ccbaeec28266939797e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:33.481050  7625 raft_consensus.cc:2468] T 254e6899d958489e9e02130bfbc4cdf8 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 256feb60c06e4ccbaeec28266939797e in term 1.
I20260709 13:16:33.481546  7815 tablet_bootstrap.cc:492] T 03c0eb40dfe644029acaf5902efd770f P 256feb60c06e4ccbaeec28266939797e: Bootstrap starting.
I20260709 13:16:33.482878  7665 leader_election.cc:304] T 254e6899d958489e9e02130bfbc4cdf8 P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0, 256feb60c06e4ccbaeec28266939797e; no voters: 7c45cd47cdbf4b93ba0e20539d18b63d
I20260709 13:16:33.484923  7841 raft_consensus.cc:2804] T 254e6899d958489e9e02130bfbc4cdf8 P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:33.485627  7841 raft_consensus.cc:697] T 254e6899d958489e9e02130bfbc4cdf8 P 256feb60c06e4ccbaeec28266939797e [term 1 LEADER]: Becoming Leader. State: Replica: 256feb60c06e4ccbaeec28266939797e, State: Running, Role: LEADER
I20260709 13:16:33.486845  7841 consensus_queue.cc:237] T 254e6899d958489e9e02130bfbc4cdf8 P 256feb60c06e4ccbaeec28266939797e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.489969  7773 raft_consensus.cc:2468] T b3020531bc3d46fab66a8de40da58a22 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 256feb60c06e4ccbaeec28266939797e in term 1.
I20260709 13:16:33.490001  7815 tablet_bootstrap.cc:654] T 03c0eb40dfe644029acaf5902efd770f P 256feb60c06e4ccbaeec28266939797e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:33.493227  7814 tablet_bootstrap.cc:492] T 042aa79c19c34c80be5b1523a342312b P 005ee35e74e24295be2b88596986b0e0: No bootstrap required, opened a new log
I20260709 13:16:33.493839  7814 ts_tablet_manager.cc:1403] T 042aa79c19c34c80be5b1523a342312b P 005ee35e74e24295be2b88596986b0e0: Time spent bootstrapping tablet: real 0.029s	user 0.007s	sys 0.019s
I20260709 13:16:33.494349  7816 ts_tablet_manager.cc:1434] T b3020531bc3d46fab66a8de40da58a22 P 7c45cd47cdbf4b93ba0e20539d18b63d: Time spent starting tablet: real 0.058s	user 0.008s	sys 0.000s
I20260709 13:16:33.497421  7814 raft_consensus.cc:359] T 042aa79c19c34c80be5b1523a342312b P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.498255  7814 raft_consensus.cc:385] T 042aa79c19c34c80be5b1523a342312b P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:33.498528  7814 raft_consensus.cc:740] T 042aa79c19c34c80be5b1523a342312b P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ee35e74e24295be2b88596986b0e0, State: Initialized, Role: FOLLOWER
I20260709 13:16:33.500501  7816 tablet_bootstrap.cc:492] T 254e6899d958489e9e02130bfbc4cdf8 P 7c45cd47cdbf4b93ba0e20539d18b63d: Bootstrap starting.
I20260709 13:16:33.501001  7823 raft_consensus.cc:493] T 13401e98748b4f1a9cc0827692efd70a P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.501755  7823 raft_consensus.cc:515] T 13401e98748b4f1a9cc0827692efd70a P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.509162  7814 consensus_queue.cc:260] T 042aa79c19c34c80be5b1523a342312b P 005ee35e74e24295be2b88596986b0e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.510324  7816 tablet_bootstrap.cc:654] T 254e6899d958489e9e02130bfbc4cdf8 P 7c45cd47cdbf4b93ba0e20539d18b63d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:33.516927  7814 ts_tablet_manager.cc:1434] T 042aa79c19c34c80be5b1523a342312b P 005ee35e74e24295be2b88596986b0e0: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.001s
I20260709 13:16:33.530308  7823 leader_election.cc:290] T 13401e98748b4f1a9cc0827692efd70a P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847), 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449)
I20260709 13:16:33.553862  7816 tablet_bootstrap.cc:492] T 254e6899d958489e9e02130bfbc4cdf8 P 7c45cd47cdbf4b93ba0e20539d18b63d: No bootstrap required, opened a new log
I20260709 13:16:33.554657  7816 ts_tablet_manager.cc:1403] T 254e6899d958489e9e02130bfbc4cdf8 P 7c45cd47cdbf4b93ba0e20539d18b63d: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.020s
I20260709 13:16:33.560632  7625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13401e98748b4f1a9cc0827692efd70a" candidate_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ee35e74e24295be2b88596986b0e0" is_pre_election: true
I20260709 13:16:33.561553  7625 raft_consensus.cc:2468] T 13401e98748b4f1a9cc0827692efd70a P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c45cd47cdbf4b93ba0e20539d18b63d in term 0.
I20260709 13:16:33.563273  7739 leader_election.cc:304] T 13401e98748b4f1a9cc0827692efd70a P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0, 7c45cd47cdbf4b93ba0e20539d18b63d; no voters: 
I20260709 13:16:33.564468  7823 raft_consensus.cc:2804] T 13401e98748b4f1a9cc0827692efd70a P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:33.564885  7823 raft_consensus.cc:493] T 13401e98748b4f1a9cc0827692efd70a P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.565223  7823 raft_consensus.cc:3060] T 13401e98748b4f1a9cc0827692efd70a P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.562131  7815 tablet_bootstrap.cc:492] T 03c0eb40dfe644029acaf5902efd770f P 256feb60c06e4ccbaeec28266939797e: No bootstrap required, opened a new log
I20260709 13:16:33.569775  7700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13401e98748b4f1a9cc0827692efd70a" candidate_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "256feb60c06e4ccbaeec28266939797e" is_pre_election: true
I20260709 13:16:33.570537  7822 raft_consensus.cc:493] T 042aa79c19c34c80be5b1523a342312b P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.574049  7822 raft_consensus.cc:515] T 042aa79c19c34c80be5b1523a342312b P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.574384  7519 catalog_manager.cc:5697] T 254e6899d958489e9e02130bfbc4cdf8 P 256feb60c06e4ccbaeec28266939797e reported cstate change: term changed from 0 to 1, leader changed from <none> to 256feb60c06e4ccbaeec28266939797e (127.27.146.130). New cstate: current_term: 1 leader_uuid: "256feb60c06e4ccbaeec28266939797e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:33.576545  7822 leader_election.cc:290] T 042aa79c19c34c80be5b1523a342312b P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847), 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071)
I20260709 13:16:33.576304  7823 raft_consensus.cc:515] T 13401e98748b4f1a9cc0827692efd70a P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.578681  7625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "042aa79c19c34c80be5b1523a342312b" candidate_uuid: "256feb60c06e4ccbaeec28266939797e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ee35e74e24295be2b88596986b0e0" is_pre_election: true
I20260709 13:16:33.579236  7815 ts_tablet_manager.cc:1403] T 03c0eb40dfe644029acaf5902efd770f P 256feb60c06e4ccbaeec28266939797e: Time spent bootstrapping tablet: real 0.098s	user 0.021s	sys 0.039s
I20260709 13:16:33.579517  7625 raft_consensus.cc:2468] T 042aa79c19c34c80be5b1523a342312b P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 256feb60c06e4ccbaeec28266939797e in term 0.
W20260709 13:16:33.579269  7740 leader_election.cc:343] T 13401e98748b4f1a9cc0827692efd70a P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:33.581327  7665 leader_election.cc:304] T 042aa79c19c34c80be5b1523a342312b P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0, 256feb60c06e4ccbaeec28266939797e; no voters: 
I20260709 13:16:33.581341  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "042aa79c19c34c80be5b1523a342312b" candidate_uuid: "256feb60c06e4ccbaeec28266939797e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" is_pre_election: true
I20260709 13:16:33.582288  7773 raft_consensus.cc:2468] T 042aa79c19c34c80be5b1523a342312b P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 256feb60c06e4ccbaeec28266939797e in term 0.
I20260709 13:16:33.582886  7815 raft_consensus.cc:359] T 03c0eb40dfe644029acaf5902efd770f P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } } peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } }
I20260709 13:16:33.583819  7815 raft_consensus.cc:385] T 03c0eb40dfe644029acaf5902efd770f P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:33.584136  7815 raft_consensus.cc:740] T 03c0eb40dfe644029acaf5902efd770f P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 256feb60c06e4ccbaeec28266939797e, State: Initialized, Role: FOLLOWER
I20260709 13:16:33.584231  7822 raft_consensus.cc:2804] T 042aa79c19c34c80be5b1523a342312b P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:33.584717  7822 raft_consensus.cc:493] T 042aa79c19c34c80be5b1523a342312b P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.585098  7822 raft_consensus.cc:3060] T 042aa79c19c34c80be5b1523a342312b P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.585104  7625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13401e98748b4f1a9cc0827692efd70a" candidate_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ee35e74e24295be2b88596986b0e0"
I20260709 13:16:33.586519  7625 raft_consensus.cc:3060] T 13401e98748b4f1a9cc0827692efd70a P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.587073  7700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13401e98748b4f1a9cc0827692efd70a" candidate_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "256feb60c06e4ccbaeec28266939797e"
I20260709 13:16:33.585042  7815 consensus_queue.cc:260] T 03c0eb40dfe644029acaf5902efd770f P 256feb60c06e4ccbaeec28266939797e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } } peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } }
W20260709 13:16:33.588776  7740 leader_election.cc:343] T 13401e98748b4f1a9cc0827692efd70a P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:33.585834  7823 leader_election.cc:290] T 13401e98748b4f1a9cc0827692efd70a P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 1 election: Requested vote from peers 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847), 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449)
I20260709 13:16:33.570959  7816 raft_consensus.cc:359] T 254e6899d958489e9e02130bfbc4cdf8 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.590268  7816 raft_consensus.cc:385] T 254e6899d958489e9e02130bfbc4cdf8 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:33.590610  7816 raft_consensus.cc:740] T 254e6899d958489e9e02130bfbc4cdf8 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c45cd47cdbf4b93ba0e20539d18b63d, State: Initialized, Role: FOLLOWER
I20260709 13:16:33.590969  7815 ts_tablet_manager.cc:1434] T 03c0eb40dfe644029acaf5902efd770f P 256feb60c06e4ccbaeec28266939797e: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:16:33.602541  7819 raft_consensus.cc:493] T 047f830ce7f94325ac2b7a5bbcbb288e P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.603523  7819 raft_consensus.cc:515] T 047f830ce7f94325ac2b7a5bbcbb288e P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.605343  7815 tablet_bootstrap.cc:492] T 13401e98748b4f1a9cc0827692efd70a P 256feb60c06e4ccbaeec28266939797e: Bootstrap starting.
I20260709 13:16:33.605571  7816 consensus_queue.cc:260] T 254e6899d958489e9e02130bfbc4cdf8 P 7c45cd47cdbf4b93ba0e20539d18b63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.608361  7816 ts_tablet_manager.cc:1434] T 254e6899d958489e9e02130bfbc4cdf8 P 7c45cd47cdbf4b93ba0e20539d18b63d: Time spent starting tablet: real 0.053s	user 0.011s	sys 0.013s
I20260709 13:16:33.609681  7816 tablet_bootstrap.cc:492] T 5e7913de22ae481cb204173005d94d41 P 7c45cd47cdbf4b93ba0e20539d18b63d: Bootstrap starting.
I20260709 13:16:33.614637  7815 tablet_bootstrap.cc:654] T 13401e98748b4f1a9cc0827692efd70a P 256feb60c06e4ccbaeec28266939797e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:33.614537  7841 raft_consensus.cc:493] T 3eea5331f2be4e82ae096a77d8ed4023 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.616772  7841 raft_consensus.cc:515] T 3eea5331f2be4e82ae096a77d8ed4023 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.617702  7816 tablet_bootstrap.cc:654] T 5e7913de22ae481cb204173005d94d41 P 7c45cd47cdbf4b93ba0e20539d18b63d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:33.620178  7841 leader_election.cc:290] T 3eea5331f2be4e82ae096a77d8ed4023 P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847), 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071)
I20260709 13:16:33.621587  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eea5331f2be4e82ae096a77d8ed4023" candidate_uuid: "256feb60c06e4ccbaeec28266939797e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" is_pre_election: true
I20260709 13:16:33.625675  7819 leader_election.cc:290] T 047f830ce7f94325ac2b7a5bbcbb288e P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449), 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071)
W20260709 13:16:33.631362  7663 leader_election.cc:343] T 3eea5331f2be4e82ae096a77d8ed4023 P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:33.642894  7625 raft_consensus.cc:2468] T 13401e98748b4f1a9cc0827692efd70a P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c45cd47cdbf4b93ba0e20539d18b63d in term 1.
I20260709 13:16:33.648535  7819 raft_consensus.cc:493] T 3eea5331f2be4e82ae096a77d8ed4023 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.651036  7819 raft_consensus.cc:515] T 3eea5331f2be4e82ae096a77d8ed4023 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.653772  7819 leader_election.cc:290] T 3eea5331f2be4e82ae096a77d8ed4023 P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449), 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071)
I20260709 13:16:33.655869  7739 leader_election.cc:304] T 13401e98748b4f1a9cc0827692efd70a P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0, 7c45cd47cdbf4b93ba0e20539d18b63d; no voters: 256feb60c06e4ccbaeec28266939797e
I20260709 13:16:33.647297  7822 raft_consensus.cc:515] T 042aa79c19c34c80be5b1523a342312b P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.650126  7624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eea5331f2be4e82ae096a77d8ed4023" candidate_uuid: "256feb60c06e4ccbaeec28266939797e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ee35e74e24295be2b88596986b0e0" is_pre_election: true
I20260709 13:16:33.668105  7624 raft_consensus.cc:2468] T 3eea5331f2be4e82ae096a77d8ed4023 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 256feb60c06e4ccbaeec28266939797e in term 0.
I20260709 13:16:33.656941  7823 raft_consensus.cc:2804] T 13401e98748b4f1a9cc0827692efd70a P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:33.666862  7819 raft_consensus.cc:493] T 5e7913de22ae481cb204173005d94d41 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.669677  7819 raft_consensus.cc:515] T 5e7913de22ae481cb204173005d94d41 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.671298  7665 leader_election.cc:304] T 3eea5331f2be4e82ae096a77d8ed4023 P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0, 256feb60c06e4ccbaeec28266939797e; no voters: 7c45cd47cdbf4b93ba0e20539d18b63d
I20260709 13:16:33.672137  7819 leader_election.cc:290] T 5e7913de22ae481cb204173005d94d41 P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449), 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071)
I20260709 13:16:33.672490  7823 raft_consensus.cc:697] T 13401e98748b4f1a9cc0827692efd70a P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 LEADER]: Becoming Leader. State: Replica: 7c45cd47cdbf4b93ba0e20539d18b63d, State: Running, Role: LEADER
I20260709 13:16:33.672775  7841 raft_consensus.cc:2804] T 3eea5331f2be4e82ae096a77d8ed4023 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:33.673295  7841 raft_consensus.cc:493] T 3eea5331f2be4e82ae096a77d8ed4023 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.667157  7815 tablet_bootstrap.cc:492] T 13401e98748b4f1a9cc0827692efd70a P 256feb60c06e4ccbaeec28266939797e: No bootstrap required, opened a new log
I20260709 13:16:33.673679  7841 raft_consensus.cc:3060] T 3eea5331f2be4e82ae096a77d8ed4023 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.674129  7815 ts_tablet_manager.cc:1403] T 13401e98748b4f1a9cc0827692efd70a P 256feb60c06e4ccbaeec28266939797e: Time spent bootstrapping tablet: real 0.082s	user 0.034s	sys 0.033s
I20260709 13:16:33.673766  7823 consensus_queue.cc:237] T 13401e98748b4f1a9cc0827692efd70a P 7c45cd47cdbf4b93ba0e20539d18b63d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.677700  7815 raft_consensus.cc:359] T 13401e98748b4f1a9cc0827692efd70a P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.678517  7815 raft_consensus.cc:385] T 13401e98748b4f1a9cc0827692efd70a P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:33.678844  7815 raft_consensus.cc:740] T 13401e98748b4f1a9cc0827692efd70a P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 256feb60c06e4ccbaeec28266939797e, State: Initialized, Role: FOLLOWER
I20260709 13:16:33.679332  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "042aa79c19c34c80be5b1523a342312b" candidate_uuid: "256feb60c06e4ccbaeec28266939797e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d"
I20260709 13:16:33.679695  7815 consensus_queue.cc:260] T 13401e98748b4f1a9cc0827692efd70a P 256feb60c06e4ccbaeec28266939797e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.680358  7773 raft_consensus.cc:3060] T 042aa79c19c34c80be5b1523a342312b P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.689050  7624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "042aa79c19c34c80be5b1523a342312b" candidate_uuid: "256feb60c06e4ccbaeec28266939797e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ee35e74e24295be2b88596986b0e0"
I20260709 13:16:33.690459  7624 raft_consensus.cc:3060] T 042aa79c19c34c80be5b1523a342312b P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.693863  7815 ts_tablet_manager.cc:1434] T 13401e98748b4f1a9cc0827692efd70a P 256feb60c06e4ccbaeec28266939797e: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:16:33.694983  7700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047f830ce7f94325ac2b7a5bbcbb288e" candidate_uuid: "005ee35e74e24295be2b88596986b0e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "256feb60c06e4ccbaeec28266939797e" is_pre_election: true
I20260709 13:16:33.695813  7700 raft_consensus.cc:2468] T 047f830ce7f94325ac2b7a5bbcbb288e P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ee35e74e24295be2b88596986b0e0 in term 0.
I20260709 13:16:33.696117  7698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7913de22ae481cb204173005d94d41" candidate_uuid: "005ee35e74e24295be2b88596986b0e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "256feb60c06e4ccbaeec28266939797e" is_pre_election: true
I20260709 13:16:33.696887  7698 raft_consensus.cc:2468] T 5e7913de22ae481cb204173005d94d41 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ee35e74e24295be2b88596986b0e0 in term 0.
I20260709 13:16:33.698261  7699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eea5331f2be4e82ae096a77d8ed4023" candidate_uuid: "005ee35e74e24295be2b88596986b0e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "256feb60c06e4ccbaeec28266939797e" is_pre_election: true
I20260709 13:16:33.698450  7591 leader_election.cc:304] T 047f830ce7f94325ac2b7a5bbcbb288e P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0, 256feb60c06e4ccbaeec28266939797e; no voters: 
I20260709 13:16:33.699419  7819 raft_consensus.cc:2804] T 047f830ce7f94325ac2b7a5bbcbb288e P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:33.699842  7819 raft_consensus.cc:493] T 047f830ce7f94325ac2b7a5bbcbb288e P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.700196  7819 raft_consensus.cc:3060] T 047f830ce7f94325ac2b7a5bbcbb288e P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.695248  7815 tablet_bootstrap.cc:492] T fca02db7c6d047448afb5d1e0c861d24 P 256feb60c06e4ccbaeec28266939797e: Bootstrap starting.
I20260709 13:16:33.705509  7591 leader_election.cc:304] T 5e7913de22ae481cb204173005d94d41 P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0, 256feb60c06e4ccbaeec28266939797e; no voters: 
I20260709 13:16:33.713686  7819 raft_consensus.cc:515] T 047f830ce7f94325ac2b7a5bbcbb288e P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.714322  7815 tablet_bootstrap.cc:654] T fca02db7c6d047448afb5d1e0c861d24 P 256feb60c06e4ccbaeec28266939797e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:33.707728  7841 raft_consensus.cc:515] T 3eea5331f2be4e82ae096a77d8ed4023 P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.717448  7699 raft_consensus.cc:2393] T 3eea5331f2be4e82ae096a77d8ed4023 P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ee35e74e24295be2b88596986b0e0 in current term 1: Already voted for candidate 256feb60c06e4ccbaeec28266939797e in this term.
I20260709 13:16:33.719674  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047f830ce7f94325ac2b7a5bbcbb288e" candidate_uuid: "005ee35e74e24295be2b88596986b0e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" is_pre_election: true
I20260709 13:16:33.722219  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eea5331f2be4e82ae096a77d8ed4023" candidate_uuid: "005ee35e74e24295be2b88596986b0e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" is_pre_election: true
I20260709 13:16:33.723899  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eea5331f2be4e82ae096a77d8ed4023" candidate_uuid: "256feb60c06e4ccbaeec28266939797e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d"
I20260709 13:16:33.725015  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7913de22ae481cb204173005d94d41" candidate_uuid: "005ee35e74e24295be2b88596986b0e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" is_pre_election: true
W20260709 13:16:33.725461  7663 leader_election.cc:343] T 3eea5331f2be4e82ae096a77d8ed4023 P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:33.722245  7841 leader_election.cc:290] T 3eea5331f2be4e82ae096a77d8ed4023 P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 1 election: Requested vote from peers 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847), 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071)
I20260709 13:16:33.724984  7822 leader_election.cc:290] T 042aa79c19c34c80be5b1523a342312b P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 1 election: Requested vote from peers 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847), 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071)
W20260709 13:16:33.725677  7588 leader_election.cc:343] T 047f830ce7f94325ac2b7a5bbcbb288e P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:33.728682  7588 leader_election.cc:343] T 3eea5331f2be4e82ae096a77d8ed4023 P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:33.729619  7588 leader_election.cc:343] T 5e7913de22ae481cb204173005d94d41 P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:33.730429  7816 tablet_bootstrap.cc:492] T 5e7913de22ae481cb204173005d94d41 P 7c45cd47cdbf4b93ba0e20539d18b63d: No bootstrap required, opened a new log
I20260709 13:16:33.731127  7816 ts_tablet_manager.cc:1403] T 5e7913de22ae481cb204173005d94d41 P 7c45cd47cdbf4b93ba0e20539d18b63d: Time spent bootstrapping tablet: real 0.122s	user 0.043s	sys 0.056s
I20260709 13:16:33.734123  7819 leader_election.cc:290] T 047f830ce7f94325ac2b7a5bbcbb288e P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 1 election: Requested vote from peers 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449), 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071)
I20260709 13:16:33.734310  7773 raft_consensus.cc:2468] T 042aa79c19c34c80be5b1523a342312b P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 256feb60c06e4ccbaeec28266939797e in term 1.
I20260709 13:16:33.735039  7816 raft_consensus.cc:359] T 5e7913de22ae481cb204173005d94d41 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.735961  7816 raft_consensus.cc:385] T 5e7913de22ae481cb204173005d94d41 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:33.736147  7663 leader_election.cc:304] T 042aa79c19c34c80be5b1523a342312b P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 256feb60c06e4ccbaeec28266939797e, 7c45cd47cdbf4b93ba0e20539d18b63d; no voters: 
I20260709 13:16:33.736617  7816 raft_consensus.cc:740] T 5e7913de22ae481cb204173005d94d41 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c45cd47cdbf4b93ba0e20539d18b63d, State: Initialized, Role: FOLLOWER
I20260709 13:16:33.737193  7822 raft_consensus.cc:2804] T 042aa79c19c34c80be5b1523a342312b P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:33.737198  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047f830ce7f94325ac2b7a5bbcbb288e" candidate_uuid: "005ee35e74e24295be2b88596986b0e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d"
I20260709 13:16:33.738108  7822 raft_consensus.cc:697] T 042aa79c19c34c80be5b1523a342312b P 256feb60c06e4ccbaeec28266939797e [term 1 LEADER]: Becoming Leader. State: Replica: 256feb60c06e4ccbaeec28266939797e, State: Running, Role: LEADER
I20260709 13:16:33.739043  7822 consensus_queue.cc:237] T 042aa79c19c34c80be5b1523a342312b P 256feb60c06e4ccbaeec28266939797e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
W20260709 13:16:33.740782  7588 leader_election.cc:343] T 047f830ce7f94325ac2b7a5bbcbb288e P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:33.742666  7624 raft_consensus.cc:2468] T 042aa79c19c34c80be5b1523a342312b P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 256feb60c06e4ccbaeec28266939797e in term 1.
I20260709 13:16:33.743781  7816 consensus_queue.cc:260] T 5e7913de22ae481cb204173005d94d41 P 7c45cd47cdbf4b93ba0e20539d18b63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.748492  7816 ts_tablet_manager.cc:1434] T 5e7913de22ae481cb204173005d94d41 P 7c45cd47cdbf4b93ba0e20539d18b63d: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:16:33.748103  7699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047f830ce7f94325ac2b7a5bbcbb288e" candidate_uuid: "005ee35e74e24295be2b88596986b0e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "256feb60c06e4ccbaeec28266939797e"
I20260709 13:16:33.750193  7625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eea5331f2be4e82ae096a77d8ed4023" candidate_uuid: "256feb60c06e4ccbaeec28266939797e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ee35e74e24295be2b88596986b0e0"
I20260709 13:16:33.750897  7699 raft_consensus.cc:3060] T 047f830ce7f94325ac2b7a5bbcbb288e P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.751147  7625 raft_consensus.cc:3060] T 3eea5331f2be4e82ae096a77d8ed4023 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.759716  7522 catalog_manager.cc:5697] T 13401e98748b4f1a9cc0827692efd70a P 7c45cd47cdbf4b93ba0e20539d18b63d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131). New cstate: current_term: 1 leader_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:33.761322  7699 raft_consensus.cc:2468] T 047f830ce7f94325ac2b7a5bbcbb288e P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ee35e74e24295be2b88596986b0e0 in term 1.
I20260709 13:16:33.762934  7816 tablet_bootstrap.cc:492] T 047f830ce7f94325ac2b7a5bbcbb288e P 7c45cd47cdbf4b93ba0e20539d18b63d: Bootstrap starting.
I20260709 13:16:33.768141  7591 leader_election.cc:304] T 3eea5331f2be4e82ae096a77d8ed4023 P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0; no voters: 256feb60c06e4ccbaeec28266939797e, 7c45cd47cdbf4b93ba0e20539d18b63d
I20260709 13:16:33.744814  7858 raft_consensus.cc:493] T 03c0eb40dfe644029acaf5902efd770f P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.770085  7858 raft_consensus.cc:515] T 03c0eb40dfe644029acaf5902efd770f P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } } peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } }
I20260709 13:16:33.735301  7819 raft_consensus.cc:2804] T 5e7913de22ae481cb204173005d94d41 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:33.774917  7819 raft_consensus.cc:493] T 5e7913de22ae481cb204173005d94d41 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.775484  7819 raft_consensus.cc:3060] T 5e7913de22ae481cb204173005d94d41 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.779899  7816 tablet_bootstrap.cc:654] T 047f830ce7f94325ac2b7a5bbcbb288e P 7c45cd47cdbf4b93ba0e20539d18b63d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:33.787828  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c0eb40dfe644029acaf5902efd770f" candidate_uuid: "005ee35e74e24295be2b88596986b0e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" is_pre_election: true
I20260709 13:16:33.787874  7858 leader_election.cc:290] T 03c0eb40dfe644029acaf5902efd770f P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449), 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071)
W20260709 13:16:33.790047  7588 leader_election.cc:343] T 03c0eb40dfe644029acaf5902efd770f P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:33.778914  7625 raft_consensus.cc:2468] T 3eea5331f2be4e82ae096a77d8ed4023 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 256feb60c06e4ccbaeec28266939797e in term 1.
I20260709 13:16:33.794396  7858 raft_consensus.cc:2749] T 3eea5331f2be4e82ae096a77d8ed4023 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:33.802641  7815 tablet_bootstrap.cc:492] T fca02db7c6d047448afb5d1e0c861d24 P 256feb60c06e4ccbaeec28266939797e: No bootstrap required, opened a new log
I20260709 13:16:33.803316  7815 ts_tablet_manager.cc:1403] T fca02db7c6d047448afb5d1e0c861d24 P 256feb60c06e4ccbaeec28266939797e: Time spent bootstrapping tablet: real 0.108s	user 0.043s	sys 0.043s
I20260709 13:16:33.804070  7522 catalog_manager.cc:5697] T 042aa79c19c34c80be5b1523a342312b P 256feb60c06e4ccbaeec28266939797e reported cstate change: term changed from 0 to 1, leader changed from <none> to 256feb60c06e4ccbaeec28266939797e (127.27.146.130). New cstate: current_term: 1 leader_uuid: "256feb60c06e4ccbaeec28266939797e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:33.806104  7591 leader_election.cc:304] T 047f830ce7f94325ac2b7a5bbcbb288e P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0, 256feb60c06e4ccbaeec28266939797e; no voters: 7c45cd47cdbf4b93ba0e20539d18b63d
I20260709 13:16:33.806424  7815 raft_consensus.cc:359] T fca02db7c6d047448afb5d1e0c861d24 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.807163  7815 raft_consensus.cc:385] T fca02db7c6d047448afb5d1e0c861d24 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:33.807440  7815 raft_consensus.cc:740] T fca02db7c6d047448afb5d1e0c861d24 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 256feb60c06e4ccbaeec28266939797e, State: Initialized, Role: FOLLOWER
I20260709 13:16:33.808254  7815 consensus_queue.cc:260] T fca02db7c6d047448afb5d1e0c861d24 P 256feb60c06e4ccbaeec28266939797e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.808842  7862 raft_consensus.cc:2804] T 047f830ce7f94325ac2b7a5bbcbb288e P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:33.808777  7665 leader_election.cc:304] T 3eea5331f2be4e82ae096a77d8ed4023 P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0, 256feb60c06e4ccbaeec28266939797e; no voters: 7c45cd47cdbf4b93ba0e20539d18b63d
I20260709 13:16:33.808687  7699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c0eb40dfe644029acaf5902efd770f" candidate_uuid: "005ee35e74e24295be2b88596986b0e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "256feb60c06e4ccbaeec28266939797e" is_pre_election: true
I20260709 13:16:33.809985  7858 raft_consensus.cc:493] T fca02db7c6d047448afb5d1e0c861d24 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.810015  7699 raft_consensus.cc:2468] T 03c0eb40dfe644029acaf5902efd770f P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ee35e74e24295be2b88596986b0e0 in term 0.
I20260709 13:16:33.810601  7815 ts_tablet_manager.cc:1434] T fca02db7c6d047448afb5d1e0c861d24 P 256feb60c06e4ccbaeec28266939797e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:16:33.811230  7822 raft_consensus.cc:2804] T 3eea5331f2be4e82ae096a77d8ed4023 P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:33.811805  7822 raft_consensus.cc:697] T 3eea5331f2be4e82ae096a77d8ed4023 P 256feb60c06e4ccbaeec28266939797e [term 1 LEADER]: Becoming Leader. State: Replica: 256feb60c06e4ccbaeec28266939797e, State: Running, Role: LEADER
I20260709 13:16:33.812717  7822 consensus_queue.cc:237] T 3eea5331f2be4e82ae096a77d8ed4023 P 256feb60c06e4ccbaeec28266939797e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.813071  7819 raft_consensus.cc:515] T 5e7913de22ae481cb204173005d94d41 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.817399  7699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7913de22ae481cb204173005d94d41" candidate_uuid: "005ee35e74e24295be2b88596986b0e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "256feb60c06e4ccbaeec28266939797e"
I20260709 13:16:33.818303  7699 raft_consensus.cc:3060] T 5e7913de22ae481cb204173005d94d41 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.823719  7862 raft_consensus.cc:697] T 047f830ce7f94325ac2b7a5bbcbb288e P 005ee35e74e24295be2b88596986b0e0 [term 1 LEADER]: Becoming Leader. State: Replica: 005ee35e74e24295be2b88596986b0e0, State: Running, Role: LEADER
I20260709 13:16:33.824753  7816 tablet_bootstrap.cc:492] T 047f830ce7f94325ac2b7a5bbcbb288e P 7c45cd47cdbf4b93ba0e20539d18b63d: No bootstrap required, opened a new log
I20260709 13:16:33.825402  7816 ts_tablet_manager.cc:1403] T 047f830ce7f94325ac2b7a5bbcbb288e P 7c45cd47cdbf4b93ba0e20539d18b63d: Time spent bootstrapping tablet: real 0.063s	user 0.012s	sys 0.016s
I20260709 13:16:33.825214  7862 consensus_queue.cc:237] T 047f830ce7f94325ac2b7a5bbcbb288e P 005ee35e74e24295be2b88596986b0e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.828518  7699 raft_consensus.cc:2468] T 5e7913de22ae481cb204173005d94d41 P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ee35e74e24295be2b88596986b0e0 in term 1.
I20260709 13:16:33.829723  7816 raft_consensus.cc:359] T 047f830ce7f94325ac2b7a5bbcbb288e P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.830720  7816 raft_consensus.cc:385] T 047f830ce7f94325ac2b7a5bbcbb288e P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:33.831015  7816 raft_consensus.cc:740] T 047f830ce7f94325ac2b7a5bbcbb288e P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c45cd47cdbf4b93ba0e20539d18b63d, State: Initialized, Role: FOLLOWER
I20260709 13:16:33.831976  7816 consensus_queue.cc:260] T 047f830ce7f94325ac2b7a5bbcbb288e P 7c45cd47cdbf4b93ba0e20539d18b63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.832567  7591 leader_election.cc:304] T 03c0eb40dfe644029acaf5902efd770f P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0, 256feb60c06e4ccbaeec28266939797e; no voters: 7c45cd47cdbf4b93ba0e20539d18b63d
I20260709 13:16:33.835358  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7913de22ae481cb204173005d94d41" candidate_uuid: "005ee35e74e24295be2b88596986b0e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d"
I20260709 13:16:33.836046  7773 raft_consensus.cc:3060] T 5e7913de22ae481cb204173005d94d41 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.837059  7816 ts_tablet_manager.cc:1434] T 047f830ce7f94325ac2b7a5bbcbb288e P 7c45cd47cdbf4b93ba0e20539d18b63d: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.002s
I20260709 13:16:33.838351  7816 tablet_bootstrap.cc:492] T fca02db7c6d047448afb5d1e0c861d24 P 7c45cd47cdbf4b93ba0e20539d18b63d: Bootstrap starting.
I20260709 13:16:33.841276  7522 catalog_manager.cc:5697] T 3eea5331f2be4e82ae096a77d8ed4023 P 256feb60c06e4ccbaeec28266939797e reported cstate change: term changed from 0 to 1, leader changed from <none> to 256feb60c06e4ccbaeec28266939797e (127.27.146.130). New cstate: current_term: 1 leader_uuid: "256feb60c06e4ccbaeec28266939797e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:33.845531  7823 raft_consensus.cc:493] T 254e6899d958489e9e02130bfbc4cdf8 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.846107  7823 raft_consensus.cc:515] T 254e6899d958489e9e02130bfbc4cdf8 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.848559  7823 leader_election.cc:290] T 254e6899d958489e9e02130bfbc4cdf8 P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847), 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449)
I20260709 13:16:33.850353  7625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254e6899d958489e9e02130bfbc4cdf8" candidate_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ee35e74e24295be2b88596986b0e0" is_pre_election: true
I20260709 13:16:33.851325  7625 raft_consensus.cc:2393] T 254e6899d958489e9e02130bfbc4cdf8 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c45cd47cdbf4b93ba0e20539d18b63d in current term 1: Already voted for candidate 256feb60c06e4ccbaeec28266939797e in this term.
I20260709 13:16:33.853493  7816 tablet_bootstrap.cc:654] T fca02db7c6d047448afb5d1e0c861d24 P 7c45cd47cdbf4b93ba0e20539d18b63d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:33.810606  7858 raft_consensus.cc:515] T fca02db7c6d047448afb5d1e0c861d24 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.858587  7699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254e6899d958489e9e02130bfbc4cdf8" candidate_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "256feb60c06e4ccbaeec28266939797e" is_pre_election: true
I20260709 13:16:33.859617  7819 leader_election.cc:290] T 5e7913de22ae481cb204173005d94d41 P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 1 election: Requested vote from peers 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449), 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071)
I20260709 13:16:33.860611  7864 raft_consensus.cc:2804] T 03c0eb40dfe644029acaf5902efd770f P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:33.860848  7591 leader_election.cc:304] T 5e7913de22ae481cb204173005d94d41 P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0, 256feb60c06e4ccbaeec28266939797e; no voters: 
I20260709 13:16:33.861650  7864 raft_consensus.cc:493] T 03c0eb40dfe644029acaf5902efd770f P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.862040  7773 raft_consensus.cc:2468] T 5e7913de22ae481cb204173005d94d41 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ee35e74e24295be2b88596986b0e0 in term 1.
I20260709 13:16:33.862228  7864 raft_consensus.cc:3060] T 03c0eb40dfe644029acaf5902efd770f P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.863111  7858 leader_election.cc:290] T fca02db7c6d047448afb5d1e0c861d24 P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449), 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071)
I20260709 13:16:33.864429  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca02db7c6d047448afb5d1e0c861d24" candidate_uuid: "005ee35e74e24295be2b88596986b0e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" is_pre_election: true
I20260709 13:16:33.862274  7819 raft_consensus.cc:2804] T 5e7913de22ae481cb204173005d94d41 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:33.871076  7819 raft_consensus.cc:697] T 5e7913de22ae481cb204173005d94d41 P 005ee35e74e24295be2b88596986b0e0 [term 1 LEADER]: Becoming Leader. State: Replica: 005ee35e74e24295be2b88596986b0e0, State: Running, Role: LEADER
I20260709 13:16:33.863620  7698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca02db7c6d047448afb5d1e0c861d24" candidate_uuid: "005ee35e74e24295be2b88596986b0e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "256feb60c06e4ccbaeec28266939797e" is_pre_election: true
I20260709 13:16:33.870913  7864 raft_consensus.cc:515] T 03c0eb40dfe644029acaf5902efd770f P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } } peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } }
W20260709 13:16:33.871826  7588 leader_election.cc:343] T fca02db7c6d047448afb5d1e0c861d24 P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:33.870098  7816 tablet_bootstrap.cc:492] T fca02db7c6d047448afb5d1e0c861d24 P 7c45cd47cdbf4b93ba0e20539d18b63d: No bootstrap required, opened a new log
I20260709 13:16:33.866501  7740 leader_election.cc:304] T 254e6899d958489e9e02130bfbc4cdf8 P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c45cd47cdbf4b93ba0e20539d18b63d; no voters: 005ee35e74e24295be2b88596986b0e0, 256feb60c06e4ccbaeec28266939797e
I20260709 13:16:33.871869  7698 raft_consensus.cc:2468] T fca02db7c6d047448afb5d1e0c861d24 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ee35e74e24295be2b88596986b0e0 in term 0.
I20260709 13:16:33.873292  7823 raft_consensus.cc:3060] T 254e6899d958489e9e02130bfbc4cdf8 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.872984  7819 consensus_queue.cc:237] T 5e7913de22ae481cb204173005d94d41 P 005ee35e74e24295be2b88596986b0e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.873909  7816 ts_tablet_manager.cc:1403] T fca02db7c6d047448afb5d1e0c861d24 P 7c45cd47cdbf4b93ba0e20539d18b63d: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.010s
I20260709 13:16:33.874742  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c0eb40dfe644029acaf5902efd770f" candidate_uuid: "005ee35e74e24295be2b88596986b0e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d"
I20260709 13:16:33.865418  7519 catalog_manager.cc:5697] T 047f830ce7f94325ac2b7a5bbcbb288e P 005ee35e74e24295be2b88596986b0e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 005ee35e74e24295be2b88596986b0e0 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "005ee35e74e24295be2b88596986b0e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:33.876441  7588 leader_election.cc:343] T 03c0eb40dfe644029acaf5902efd770f P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:33.877521  7864 leader_election.cc:290] T 03c0eb40dfe644029acaf5902efd770f P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 1 election: Requested vote from peers 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449), 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071)
I20260709 13:16:33.877744  7816 raft_consensus.cc:359] T fca02db7c6d047448afb5d1e0c861d24 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.878803  7816 raft_consensus.cc:385] T fca02db7c6d047448afb5d1e0c861d24 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:33.879302  7816 raft_consensus.cc:740] T fca02db7c6d047448afb5d1e0c861d24 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c45cd47cdbf4b93ba0e20539d18b63d, State: Initialized, Role: FOLLOWER
I20260709 13:16:33.880443  7816 consensus_queue.cc:260] T fca02db7c6d047448afb5d1e0c861d24 P 7c45cd47cdbf4b93ba0e20539d18b63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.880647  7591 leader_election.cc:304] T fca02db7c6d047448afb5d1e0c861d24 P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0, 256feb60c06e4ccbaeec28266939797e; no voters: 7c45cd47cdbf4b93ba0e20539d18b63d
I20260709 13:16:33.882328  7698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c0eb40dfe644029acaf5902efd770f" candidate_uuid: "005ee35e74e24295be2b88596986b0e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "256feb60c06e4ccbaeec28266939797e"
I20260709 13:16:33.883052  7698 raft_consensus.cc:3060] T 03c0eb40dfe644029acaf5902efd770f P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.883391  7816 ts_tablet_manager.cc:1434] T fca02db7c6d047448afb5d1e0c861d24 P 7c45cd47cdbf4b93ba0e20539d18b63d: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260709 13:16:33.884759  7816 tablet_bootstrap.cc:492] T 03c0eb40dfe644029acaf5902efd770f P 7c45cd47cdbf4b93ba0e20539d18b63d: Bootstrap starting.
I20260709 13:16:33.890342  7864 raft_consensus.cc:2804] T fca02db7c6d047448afb5d1e0c861d24 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:33.890980  7864 raft_consensus.cc:493] T fca02db7c6d047448afb5d1e0c861d24 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.895809  7864 raft_consensus.cc:3060] T fca02db7c6d047448afb5d1e0c861d24 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.897126  7816 tablet_bootstrap.cc:654] T 03c0eb40dfe644029acaf5902efd770f P 7c45cd47cdbf4b93ba0e20539d18b63d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:33.897548  7698 raft_consensus.cc:2468] T 03c0eb40dfe644029acaf5902efd770f P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ee35e74e24295be2b88596986b0e0 in term 1.
I20260709 13:16:33.899555  7822 consensus_queue.cc:1048] T b3020531bc3d46fab66a8de40da58a22 P 256feb60c06e4ccbaeec28266939797e [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:33.902181  7591 leader_election.cc:304] T 03c0eb40dfe644029acaf5902efd770f P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0, 256feb60c06e4ccbaeec28266939797e; no voters: 7c45cd47cdbf4b93ba0e20539d18b63d
I20260709 13:16:33.903153  7858 raft_consensus.cc:2804] T 03c0eb40dfe644029acaf5902efd770f P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:33.903719  7858 raft_consensus.cc:697] T 03c0eb40dfe644029acaf5902efd770f P 005ee35e74e24295be2b88596986b0e0 [term 1 LEADER]: Becoming Leader. State: Replica: 005ee35e74e24295be2b88596986b0e0, State: Running, Role: LEADER
I20260709 13:16:33.905180  7864 raft_consensus.cc:515] T fca02db7c6d047448afb5d1e0c861d24 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.904629  7858 consensus_queue.cc:237] T 03c0eb40dfe644029acaf5902efd770f P 005ee35e74e24295be2b88596986b0e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } } peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } }
I20260709 13:16:33.908576  7864 leader_election.cc:290] T fca02db7c6d047448afb5d1e0c861d24 P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 1 election: Requested vote from peers 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449), 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071)
I20260709 13:16:33.913102  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca02db7c6d047448afb5d1e0c861d24" candidate_uuid: "005ee35e74e24295be2b88596986b0e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d"
I20260709 13:16:33.914170  7772 raft_consensus.cc:3060] T fca02db7c6d047448afb5d1e0c861d24 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.916198  7699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca02db7c6d047448afb5d1e0c861d24" candidate_uuid: "005ee35e74e24295be2b88596986b0e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "256feb60c06e4ccbaeec28266939797e"
I20260709 13:16:33.917188  7699 raft_consensus.cc:3060] T fca02db7c6d047448afb5d1e0c861d24 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.940841  7816 tablet_bootstrap.cc:492] T 03c0eb40dfe644029acaf5902efd770f P 7c45cd47cdbf4b93ba0e20539d18b63d: No bootstrap required, opened a new log
I20260709 13:16:33.941546  7816 ts_tablet_manager.cc:1403] T 03c0eb40dfe644029acaf5902efd770f P 7c45cd47cdbf4b93ba0e20539d18b63d: Time spent bootstrapping tablet: real 0.057s	user 0.025s	sys 0.019s
I20260709 13:16:33.943143  7522 catalog_manager.cc:5697] T 5e7913de22ae481cb204173005d94d41 P 005ee35e74e24295be2b88596986b0e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 005ee35e74e24295be2b88596986b0e0 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "005ee35e74e24295be2b88596986b0e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:33.944236  7699 raft_consensus.cc:2468] T fca02db7c6d047448afb5d1e0c861d24 P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ee35e74e24295be2b88596986b0e0 in term 1.
I20260709 13:16:33.944826  7823 raft_consensus.cc:2749] T 254e6899d958489e9e02130bfbc4cdf8 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:33.944765  7816 raft_consensus.cc:359] T 03c0eb40dfe644029acaf5902efd770f P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } } peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } }
I20260709 13:16:33.945675  7816 raft_consensus.cc:385] T 03c0eb40dfe644029acaf5902efd770f P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:33.945971  7816 raft_consensus.cc:740] T 03c0eb40dfe644029acaf5902efd770f P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c45cd47cdbf4b93ba0e20539d18b63d, State: Initialized, Role: FOLLOWER
I20260709 13:16:33.945888  7591 leader_election.cc:304] T fca02db7c6d047448afb5d1e0c861d24 P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0, 256feb60c06e4ccbaeec28266939797e; no voters: 
I20260709 13:16:33.947121  7858 raft_consensus.cc:2804] T fca02db7c6d047448afb5d1e0c861d24 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:33.947021  7816 consensus_queue.cc:260] T 03c0eb40dfe644029acaf5902efd770f P 7c45cd47cdbf4b93ba0e20539d18b63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } } peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } }
I20260709 13:16:33.947769  7858 raft_consensus.cc:697] T fca02db7c6d047448afb5d1e0c861d24 P 005ee35e74e24295be2b88596986b0e0 [term 1 LEADER]: Becoming Leader. State: Replica: 005ee35e74e24295be2b88596986b0e0, State: Running, Role: LEADER
I20260709 13:16:33.948764  7858 consensus_queue.cc:237] T fca02db7c6d047448afb5d1e0c861d24 P 005ee35e74e24295be2b88596986b0e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.949831  7816 ts_tablet_manager.cc:1434] T 03c0eb40dfe644029acaf5902efd770f P 7c45cd47cdbf4b93ba0e20539d18b63d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:16:33.950938  7816 tablet_bootstrap.cc:492] T 3eea5331f2be4e82ae096a77d8ed4023 P 7c45cd47cdbf4b93ba0e20539d18b63d: Bootstrap starting.
I20260709 13:16:33.957176  7772 raft_consensus.cc:2468] T fca02db7c6d047448afb5d1e0c861d24 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ee35e74e24295be2b88596986b0e0 in term 1.
I20260709 13:16:33.957577  7816 tablet_bootstrap.cc:654] T 3eea5331f2be4e82ae096a77d8ed4023 P 7c45cd47cdbf4b93ba0e20539d18b63d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:33.974876  7816 tablet_bootstrap.cc:492] T 3eea5331f2be4e82ae096a77d8ed4023 P 7c45cd47cdbf4b93ba0e20539d18b63d: No bootstrap required, opened a new log
I20260709 13:16:33.975561  7816 ts_tablet_manager.cc:1403] T 3eea5331f2be4e82ae096a77d8ed4023 P 7c45cd47cdbf4b93ba0e20539d18b63d: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.006s
I20260709 13:16:33.976735  7822 consensus_queue.cc:1048] T b3020531bc3d46fab66a8de40da58a22 P 256feb60c06e4ccbaeec28266939797e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:33.978801  7816 raft_consensus.cc:359] T 3eea5331f2be4e82ae096a77d8ed4023 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.979718  7816 raft_consensus.cc:385] T 3eea5331f2be4e82ae096a77d8ed4023 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:33.980057  7816 raft_consensus.cc:740] T 3eea5331f2be4e82ae096a77d8ed4023 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c45cd47cdbf4b93ba0e20539d18b63d, State: Initialized, Role: FOLLOWER
I20260709 13:16:33.982409  7816 consensus_queue.cc:260] T 3eea5331f2be4e82ae096a77d8ed4023 P 7c45cd47cdbf4b93ba0e20539d18b63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:33.984709  7816 ts_tablet_manager.cc:1434] T 3eea5331f2be4e82ae096a77d8ed4023 P 7c45cd47cdbf4b93ba0e20539d18b63d: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:16:33.989843  7523 catalog_manager.cc:5697] T 03c0eb40dfe644029acaf5902efd770f P 005ee35e74e24295be2b88596986b0e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 005ee35e74e24295be2b88596986b0e0 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "005ee35e74e24295be2b88596986b0e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:33.992295  7523 catalog_manager.cc:5697] T fca02db7c6d047448afb5d1e0c861d24 P 005ee35e74e24295be2b88596986b0e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 005ee35e74e24295be2b88596986b0e0 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "005ee35e74e24295be2b88596986b0e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:34.036306  7823 raft_consensus.cc:493] T 3eea5331f2be4e82ae096a77d8ed4023 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.036989  7823 raft_consensus.cc:515] T 3eea5331f2be4e82ae096a77d8ed4023 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:34.038918  7823 leader_election.cc:290] T 3eea5331f2be4e82ae096a77d8ed4023 P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847), 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449)
I20260709 13:16:34.039983  7625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eea5331f2be4e82ae096a77d8ed4023" candidate_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ee35e74e24295be2b88596986b0e0" is_pre_election: true
I20260709 13:16:34.040158  7699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eea5331f2be4e82ae096a77d8ed4023" candidate_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "256feb60c06e4ccbaeec28266939797e" is_pre_election: true
I20260709 13:16:34.040822  7625 raft_consensus.cc:2393] T 3eea5331f2be4e82ae096a77d8ed4023 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c45cd47cdbf4b93ba0e20539d18b63d in current term 1: Already voted for candidate 256feb60c06e4ccbaeec28266939797e in this term.
I20260709 13:16:34.041822  7739 leader_election.cc:304] T 3eea5331f2be4e82ae096a77d8ed4023 P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c45cd47cdbf4b93ba0e20539d18b63d; no voters: 005ee35e74e24295be2b88596986b0e0, 256feb60c06e4ccbaeec28266939797e
I20260709 13:16:34.042549  7823 raft_consensus.cc:3060] T 3eea5331f2be4e82ae096a77d8ed4023 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:34.048758  7823 raft_consensus.cc:2749] T 3eea5331f2be4e82ae096a77d8ed4023 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:34.052448  7840 consensus_queue.cc:1048] T 254e6899d958489e9e02130bfbc4cdf8 P 256feb60c06e4ccbaeec28266939797e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:34.068694  7879 consensus_queue.cc:1048] T 254e6899d958489e9e02130bfbc4cdf8 P 256feb60c06e4ccbaeec28266939797e [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:34.136067  7823 raft_consensus.cc:493] T 047f830ce7f94325ac2b7a5bbcbb288e P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.136876  7823 raft_consensus.cc:515] T 047f830ce7f94325ac2b7a5bbcbb288e P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:34.138840  7823 leader_election.cc:290] T 047f830ce7f94325ac2b7a5bbcbb288e P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847), 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449)
I20260709 13:16:34.140008  7625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047f830ce7f94325ac2b7a5bbcbb288e" candidate_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ee35e74e24295be2b88596986b0e0" is_pre_election: true
I20260709 13:16:34.140165  7699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047f830ce7f94325ac2b7a5bbcbb288e" candidate_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "256feb60c06e4ccbaeec28266939797e" is_pre_election: true
I20260709 13:16:34.141203  7699 raft_consensus.cc:2393] T 047f830ce7f94325ac2b7a5bbcbb288e P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c45cd47cdbf4b93ba0e20539d18b63d in current term 1: Already voted for candidate 005ee35e74e24295be2b88596986b0e0 in this term.
I20260709 13:16:34.142261  7740 leader_election.cc:304] T 047f830ce7f94325ac2b7a5bbcbb288e P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c45cd47cdbf4b93ba0e20539d18b63d; no voters: 005ee35e74e24295be2b88596986b0e0, 256feb60c06e4ccbaeec28266939797e
I20260709 13:16:34.143049  7823 raft_consensus.cc:3060] T 047f830ce7f94325ac2b7a5bbcbb288e P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:34.145617  7879 raft_consensus.cc:493] T 13401e98748b4f1a9cc0827692efd70a P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.146416  7879 raft_consensus.cc:515] T 13401e98748b4f1a9cc0827692efd70a P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:34.149215  7879 leader_election.cc:290] T 13401e98748b4f1a9cc0827692efd70a P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847), 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071)
I20260709 13:16:34.150103  7625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13401e98748b4f1a9cc0827692efd70a" candidate_uuid: "256feb60c06e4ccbaeec28266939797e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ee35e74e24295be2b88596986b0e0" is_pre_election: true
I20260709 13:16:34.150724  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13401e98748b4f1a9cc0827692efd70a" candidate_uuid: "256feb60c06e4ccbaeec28266939797e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" is_pre_election: true
I20260709 13:16:34.151046  7625 raft_consensus.cc:2393] T 13401e98748b4f1a9cc0827692efd70a P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 256feb60c06e4ccbaeec28266939797e in current term 1: Already voted for candidate 7c45cd47cdbf4b93ba0e20539d18b63d in this term.
I20260709 13:16:34.152654  7823 raft_consensus.cc:2749] T 047f830ce7f94325ac2b7a5bbcbb288e P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:34.152776  7665 leader_election.cc:304] T 13401e98748b4f1a9cc0827692efd70a P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 256feb60c06e4ccbaeec28266939797e; no voters: 005ee35e74e24295be2b88596986b0e0, 7c45cd47cdbf4b93ba0e20539d18b63d
I20260709 13:16:34.153977  7879 raft_consensus.cc:3060] T 13401e98748b4f1a9cc0827692efd70a P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:34.161592  7879 raft_consensus.cc:2749] T 13401e98748b4f1a9cc0827692efd70a P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:34.181360  7823 consensus_queue.cc:1048] T 13401e98748b4f1a9cc0827692efd70a P 7c45cd47cdbf4b93ba0e20539d18b63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:34.196498  7882 consensus_queue.cc:1048] T 13401e98748b4f1a9cc0827692efd70a P 7c45cd47cdbf4b93ba0e20539d18b63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:34.271195  7699 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "042aa79c19c34c80be5b1523a342312b"
dest_uuid: "256feb60c06e4ccbaeec28266939797e"
mode: GRACEFUL
new_leader_uuid: "005ee35e74e24295be2b88596986b0e0"
 from {username='slave'} at 127.0.0.1:54272
I20260709 13:16:34.271991  7699 raft_consensus.cc:606] T 042aa79c19c34c80be5b1523a342312b P 256feb60c06e4ccbaeec28266939797e [term 1 LEADER]: Received request to transfer leadership to TS 005ee35e74e24295be2b88596986b0e0
I20260709 13:16:34.285425  7879 consensus_queue.cc:1048] T 042aa79c19c34c80be5b1523a342312b P 256feb60c06e4ccbaeec28266939797e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:34.289268  7773 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13401e98748b4f1a9cc0827692efd70a"
dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d"
mode: GRACEFUL
new_leader_uuid: "005ee35e74e24295be2b88596986b0e0"
 from {username='slave'} at 127.0.0.1:41154
I20260709 13:16:34.289999  7773 raft_consensus.cc:606] T 13401e98748b4f1a9cc0827692efd70a P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 LEADER]: Received request to transfer leadership to TS 005ee35e74e24295be2b88596986b0e0
I20260709 13:16:34.300621  7879 consensus_queue.cc:1048] T 042aa79c19c34c80be5b1523a342312b P 256feb60c06e4ccbaeec28266939797e [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:34.305805  7858 consensus_queue.cc:1048] T 5e7913de22ae481cb204173005d94d41 P 005ee35e74e24295be2b88596986b0e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:34.321818  7841 raft_consensus.cc:993] T 042aa79c19c34c80be5b1523a342312b P 256feb60c06e4ccbaeec28266939797e: : Instructing follower 005ee35e74e24295be2b88596986b0e0 to start an election
I20260709 13:16:34.322463  7841 raft_consensus.cc:1081] T 042aa79c19c34c80be5b1523a342312b P 256feb60c06e4ccbaeec28266939797e [term 1 LEADER]: Signalling peer 005ee35e74e24295be2b88596986b0e0 to start an election
I20260709 13:16:34.324538  7625 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "042aa79c19c34c80be5b1523a342312b"
dest_uuid: "005ee35e74e24295be2b88596986b0e0"
 from {username='slave'} at 127.0.0.1:41216
I20260709 13:16:34.325253  7625 raft_consensus.cc:493] T 042aa79c19c34c80be5b1523a342312b P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:34.325661  7625 raft_consensus.cc:3060] T 042aa79c19c34c80be5b1523a342312b P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:34.328437  7772 raft_consensus.cc:3060] T 03c0eb40dfe644029acaf5902efd770f P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:34.328372  7841 consensus_queue.cc:1048] T 3eea5331f2be4e82ae096a77d8ed4023 P 256feb60c06e4ccbaeec28266939797e [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:16:34.335616  7624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "047f830ce7f94325ac2b7a5bbcbb288e"
dest_uuid: "005ee35e74e24295be2b88596986b0e0"
mode: GRACEFUL
new_leader_uuid: "256feb60c06e4ccbaeec28266939797e"
 from {username='slave'} at 127.0.0.1:41228
I20260709 13:16:34.336350  7624 raft_consensus.cc:606] T 047f830ce7f94325ac2b7a5bbcbb288e P 005ee35e74e24295be2b88596986b0e0 [term 1 LEADER]: Received request to transfer leadership to TS 256feb60c06e4ccbaeec28266939797e
I20260709 13:16:34.334928  7625 raft_consensus.cc:515] T 042aa79c19c34c80be5b1523a342312b P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:34.341220  7773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "042aa79c19c34c80be5b1523a342312b" candidate_uuid: "005ee35e74e24295be2b88596986b0e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d"
I20260709 13:16:34.341914  7773 raft_consensus.cc:3060] T 042aa79c19c34c80be5b1523a342312b P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:34.342666  7841 consensus_queue.cc:1048] T 3eea5331f2be4e82ae096a77d8ed4023 P 256feb60c06e4ccbaeec28266939797e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:34.345279  7862 consensus_queue.cc:1048] T 5e7913de22ae481cb204173005d94d41 P 005ee35e74e24295be2b88596986b0e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:34.351660  7773 raft_consensus.cc:2468] T 042aa79c19c34c80be5b1523a342312b P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ee35e74e24295be2b88596986b0e0 in term 2.
I20260709 13:16:34.352851  7625 leader_election.cc:290] T 042aa79c19c34c80be5b1523a342312b P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 2 election: Requested vote from peers 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449), 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071)
I20260709 13:16:34.354838  7588 leader_election.cc:304] T 042aa79c19c34c80be5b1523a342312b P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0, 7c45cd47cdbf4b93ba0e20539d18b63d; no voters: 
I20260709 13:16:34.357669  7699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "042aa79c19c34c80be5b1523a342312b" candidate_uuid: "005ee35e74e24295be2b88596986b0e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "256feb60c06e4ccbaeec28266939797e"
I20260709 13:16:34.358659  7699 raft_consensus.cc:3055] T 042aa79c19c34c80be5b1523a342312b P 256feb60c06e4ccbaeec28266939797e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:34.359159  7699 raft_consensus.cc:740] T 042aa79c19c34c80be5b1523a342312b P 256feb60c06e4ccbaeec28266939797e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 256feb60c06e4ccbaeec28266939797e, State: Running, Role: LEADER
I20260709 13:16:34.360217  7699 consensus_queue.cc:260] T 042aa79c19c34c80be5b1523a342312b P 256feb60c06e4ccbaeec28266939797e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:34.362205  7699 raft_consensus.cc:3060] T 042aa79c19c34c80be5b1523a342312b P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:34.365517  7864 raft_consensus.cc:2804] T 042aa79c19c34c80be5b1523a342312b P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:34.366187  7864 raft_consensus.cc:697] T 042aa79c19c34c80be5b1523a342312b P 005ee35e74e24295be2b88596986b0e0 [term 2 LEADER]: Becoming Leader. State: Replica: 005ee35e74e24295be2b88596986b0e0, State: Running, Role: LEADER
I20260709 13:16:34.367143  7864 consensus_queue.cc:237] T 042aa79c19c34c80be5b1523a342312b P 005ee35e74e24295be2b88596986b0e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:34.376012  7625 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e7913de22ae481cb204173005d94d41"
dest_uuid: "005ee35e74e24295be2b88596986b0e0"
mode: GRACEFUL
new_leader_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d"
 from {username='slave'} at 127.0.0.1:41228
I20260709 13:16:34.376894  7625 raft_consensus.cc:606] T 5e7913de22ae481cb204173005d94d41 P 005ee35e74e24295be2b88596986b0e0 [term 1 LEADER]: Received request to transfer leadership to TS 7c45cd47cdbf4b93ba0e20539d18b63d
I20260709 13:16:34.376618  7819 consensus_queue.cc:1048] T 047f830ce7f94325ac2b7a5bbcbb288e P 005ee35e74e24295be2b88596986b0e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:34.377615  7862 consensus_queue.cc:1048] T 03c0eb40dfe644029acaf5902efd770f P 005ee35e74e24295be2b88596986b0e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:34.373200  7699 raft_consensus.cc:2468] T 042aa79c19c34c80be5b1523a342312b P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ee35e74e24295be2b88596986b0e0 in term 2.
I20260709 13:16:34.397599  7519 catalog_manager.cc:5697] T 042aa79c19c34c80be5b1523a342312b P 005ee35e74e24295be2b88596986b0e0 reported cstate change: term changed from 1 to 2, leader changed from 256feb60c06e4ccbaeec28266939797e (127.27.146.130) to 005ee35e74e24295be2b88596986b0e0 (127.27.146.129). New cstate: current_term: 2 leader_uuid: "005ee35e74e24295be2b88596986b0e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:34.406119  7862 raft_consensus.cc:993] T 5e7913de22ae481cb204173005d94d41 P 005ee35e74e24295be2b88596986b0e0: : Instructing follower 7c45cd47cdbf4b93ba0e20539d18b63d to start an election
I20260709 13:16:34.407482  7862 raft_consensus.cc:1081] T 5e7913de22ae481cb204173005d94d41 P 005ee35e74e24295be2b88596986b0e0 [term 1 LEADER]: Signalling peer 7c45cd47cdbf4b93ba0e20539d18b63d to start an election
I20260709 13:16:34.409242  7772 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e7913de22ae481cb204173005d94d41"
dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d"
 from {username='slave'} at 127.0.0.1:41144
I20260709 13:16:34.409914  7772 raft_consensus.cc:493] T 5e7913de22ae481cb204173005d94d41 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:34.410406  7772 raft_consensus.cc:3060] T 5e7913de22ae481cb204173005d94d41 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:34.417963  7819 consensus_queue.cc:1048] T 03c0eb40dfe644029acaf5902efd770f P 005ee35e74e24295be2b88596986b0e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:34.411007  7864 consensus_queue.cc:1048] T fca02db7c6d047448afb5d1e0c861d24 P 005ee35e74e24295be2b88596986b0e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:34.419181  7772 raft_consensus.cc:515] T 5e7913de22ae481cb204173005d94d41 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:34.420576  7858 consensus_queue.cc:1048] T fca02db7c6d047448afb5d1e0c861d24 P 005ee35e74e24295be2b88596986b0e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:34.422282  7772 leader_election.cc:290] T 5e7913de22ae481cb204173005d94d41 P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 2 election: Requested vote from peers 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847), 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449)
I20260709 13:16:34.429031  7698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7913de22ae481cb204173005d94d41" candidate_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "256feb60c06e4ccbaeec28266939797e"
I20260709 13:16:34.429740  7698 raft_consensus.cc:3060] T 5e7913de22ae481cb204173005d94d41 P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:34.435668  7862 consensus_queue.cc:1048] T 047f830ce7f94325ac2b7a5bbcbb288e P 005ee35e74e24295be2b88596986b0e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:34.474278  7623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e7913de22ae481cb204173005d94d41" candidate_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "005ee35e74e24295be2b88596986b0e0"
I20260709 13:16:34.475349  7623 raft_consensus.cc:3055] T 5e7913de22ae481cb204173005d94d41 P 005ee35e74e24295be2b88596986b0e0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:34.475803  7623 raft_consensus.cc:740] T 5e7913de22ae481cb204173005d94d41 P 005ee35e74e24295be2b88596986b0e0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 005ee35e74e24295be2b88596986b0e0, State: Running, Role: LEADER
I20260709 13:16:34.477038  7623 consensus_queue.cc:260] T 5e7913de22ae481cb204173005d94d41 P 005ee35e74e24295be2b88596986b0e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:34.479104  7623 raft_consensus.cc:3060] T 5e7913de22ae481cb204173005d94d41 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:34.493086  7623 raft_consensus.cc:2468] T 5e7913de22ae481cb204173005d94d41 P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c45cd47cdbf4b93ba0e20539d18b63d in term 2.
I20260709 13:16:34.495136  7739 leader_election.cc:304] T 5e7913de22ae481cb204173005d94d41 P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0, 7c45cd47cdbf4b93ba0e20539d18b63d; no voters: 
I20260709 13:16:34.496538  7882 raft_consensus.cc:2804] T 5e7913de22ae481cb204173005d94d41 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:34.497426  7882 raft_consensus.cc:697] T 5e7913de22ae481cb204173005d94d41 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 LEADER]: Becoming Leader. State: Replica: 7c45cd47cdbf4b93ba0e20539d18b63d, State: Running, Role: LEADER
I20260709 13:16:34.498944  7882 consensus_queue.cc:237] T 5e7913de22ae481cb204173005d94d41 P 7c45cd47cdbf4b93ba0e20539d18b63d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:34.513222  7858 raft_consensus.cc:993] T 047f830ce7f94325ac2b7a5bbcbb288e P 005ee35e74e24295be2b88596986b0e0: : Instructing follower 256feb60c06e4ccbaeec28266939797e to start an election
I20260709 13:16:34.513899  7858 raft_consensus.cc:1081] T 047f830ce7f94325ac2b7a5bbcbb288e P 005ee35e74e24295be2b88596986b0e0 [term 1 LEADER]: Signalling peer 256feb60c06e4ccbaeec28266939797e to start an election
I20260709 13:16:34.516150  7699 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "047f830ce7f94325ac2b7a5bbcbb288e"
dest_uuid: "256feb60c06e4ccbaeec28266939797e"
 from {username='slave'} at 127.0.0.1:54264
I20260709 13:16:34.516985  7699 raft_consensus.cc:493] T 047f830ce7f94325ac2b7a5bbcbb288e P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:34.517494  7699 raft_consensus.cc:3060] T 047f830ce7f94325ac2b7a5bbcbb288e P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:34.520324  7698 raft_consensus.cc:2468] T 5e7913de22ae481cb204173005d94d41 P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c45cd47cdbf4b93ba0e20539d18b63d in term 2.
I20260709 13:16:34.534289  7699 raft_consensus.cc:515] T 047f830ce7f94325ac2b7a5bbcbb288e P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:34.536870  7699 leader_election.cc:290] T 047f830ce7f94325ac2b7a5bbcbb288e P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 2 election: Requested vote from peers 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847), 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071)
I20260709 13:16:34.538287  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047f830ce7f94325ac2b7a5bbcbb288e" candidate_uuid: "256feb60c06e4ccbaeec28266939797e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d"
I20260709 13:16:34.540328  7772 raft_consensus.cc:3060] T 047f830ce7f94325ac2b7a5bbcbb288e P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:34.545280  7623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047f830ce7f94325ac2b7a5bbcbb288e" candidate_uuid: "256feb60c06e4ccbaeec28266939797e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "005ee35e74e24295be2b88596986b0e0"
I20260709 13:16:34.546124  7623 raft_consensus.cc:3055] T 047f830ce7f94325ac2b7a5bbcbb288e P 005ee35e74e24295be2b88596986b0e0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:34.546484  7623 raft_consensus.cc:740] T 047f830ce7f94325ac2b7a5bbcbb288e P 005ee35e74e24295be2b88596986b0e0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 005ee35e74e24295be2b88596986b0e0, State: Running, Role: LEADER
I20260709 13:16:34.547447  7623 consensus_queue.cc:260] T 047f830ce7f94325ac2b7a5bbcbb288e P 005ee35e74e24295be2b88596986b0e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:34.549091  7623 raft_consensus.cc:3060] T 047f830ce7f94325ac2b7a5bbcbb288e P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:34.550374  7772 raft_consensus.cc:2468] T 047f830ce7f94325ac2b7a5bbcbb288e P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 256feb60c06e4ccbaeec28266939797e in term 2.
I20260709 13:16:34.552122  7663 leader_election.cc:304] T 047f830ce7f94325ac2b7a5bbcbb288e P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 256feb60c06e4ccbaeec28266939797e, 7c45cd47cdbf4b93ba0e20539d18b63d; no voters: 
I20260709 13:16:34.552943  7841 raft_consensus.cc:2804] T 047f830ce7f94325ac2b7a5bbcbb288e P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:34.553491  7841 raft_consensus.cc:697] T 047f830ce7f94325ac2b7a5bbcbb288e P 256feb60c06e4ccbaeec28266939797e [term 2 LEADER]: Becoming Leader. State: Replica: 256feb60c06e4ccbaeec28266939797e, State: Running, Role: LEADER
I20260709 13:16:34.554427  7841 consensus_queue.cc:237] T 047f830ce7f94325ac2b7a5bbcbb288e P 256feb60c06e4ccbaeec28266939797e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:34.557982  7623 raft_consensus.cc:2468] T 047f830ce7f94325ac2b7a5bbcbb288e P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 256feb60c06e4ccbaeec28266939797e in term 2.
I20260709 13:16:34.565519  7521 catalog_manager.cc:5697] T 5e7913de22ae481cb204173005d94d41 P 7c45cd47cdbf4b93ba0e20539d18b63d reported cstate change: term changed from 1 to 2, leader changed from 005ee35e74e24295be2b88596986b0e0 (127.27.146.129) to 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131). New cstate: current_term: 2 leader_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:34.567669  7523 catalog_manager.cc:5697] T 047f830ce7f94325ac2b7a5bbcbb288e P 256feb60c06e4ccbaeec28266939797e reported cstate change: term changed from 1 to 2, leader changed from 005ee35e74e24295be2b88596986b0e0 (127.27.146.129) to 256feb60c06e4ccbaeec28266939797e (127.27.146.130). New cstate: current_term: 2 leader_uuid: "256feb60c06e4ccbaeec28266939797e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:34.725333  7857 raft_consensus.cc:993] T 13401e98748b4f1a9cc0827692efd70a P 7c45cd47cdbf4b93ba0e20539d18b63d: : Instructing follower 005ee35e74e24295be2b88596986b0e0 to start an election
I20260709 13:16:34.725921  7901 raft_consensus.cc:1081] T 13401e98748b4f1a9cc0827692efd70a P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 LEADER]: Signalling peer 005ee35e74e24295be2b88596986b0e0 to start an election
I20260709 13:16:34.727581  7623 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13401e98748b4f1a9cc0827692efd70a"
dest_uuid: "005ee35e74e24295be2b88596986b0e0"
 from {username='slave'} at 127.0.0.1:41220
I20260709 13:16:34.728099  7623 raft_consensus.cc:493] T 13401e98748b4f1a9cc0827692efd70a P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:34.728370  7623 raft_consensus.cc:3060] T 13401e98748b4f1a9cc0827692efd70a P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:34.734398  7623 raft_consensus.cc:515] T 13401e98748b4f1a9cc0827692efd70a P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:34.736351  7623 leader_election.cc:290] T 13401e98748b4f1a9cc0827692efd70a P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 2 election: Requested vote from peers 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449), 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071)
I20260709 13:16:34.737355  7700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13401e98748b4f1a9cc0827692efd70a" candidate_uuid: "005ee35e74e24295be2b88596986b0e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "256feb60c06e4ccbaeec28266939797e"
I20260709 13:16:34.737581  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13401e98748b4f1a9cc0827692efd70a" candidate_uuid: "005ee35e74e24295be2b88596986b0e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d"
I20260709 13:16:34.738191  7700 raft_consensus.cc:3060] T 13401e98748b4f1a9cc0827692efd70a P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:34.738256  7772 raft_consensus.cc:3055] T 13401e98748b4f1a9cc0827692efd70a P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:34.738781  7772 raft_consensus.cc:740] T 13401e98748b4f1a9cc0827692efd70a P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c45cd47cdbf4b93ba0e20539d18b63d, State: Running, Role: LEADER
I20260709 13:16:34.739881  7772 consensus_queue.cc:260] T 13401e98748b4f1a9cc0827692efd70a P 7c45cd47cdbf4b93ba0e20539d18b63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:34.741416  7772 raft_consensus.cc:3060] T 13401e98748b4f1a9cc0827692efd70a P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:34.747330  7700 raft_consensus.cc:2468] T 13401e98748b4f1a9cc0827692efd70a P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ee35e74e24295be2b88596986b0e0 in term 2.
I20260709 13:16:34.749104  7591 leader_election.cc:304] T 13401e98748b4f1a9cc0827692efd70a P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0, 256feb60c06e4ccbaeec28266939797e; no voters: 
I20260709 13:16:34.749787  7772 raft_consensus.cc:2468] T 13401e98748b4f1a9cc0827692efd70a P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ee35e74e24295be2b88596986b0e0 in term 2.
I20260709 13:16:34.750308  7896 raft_consensus.cc:2804] T 13401e98748b4f1a9cc0827692efd70a P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:34.750937  7896 raft_consensus.cc:697] T 13401e98748b4f1a9cc0827692efd70a P 005ee35e74e24295be2b88596986b0e0 [term 2 LEADER]: Becoming Leader. State: Replica: 005ee35e74e24295be2b88596986b0e0, State: Running, Role: LEADER
I20260709 13:16:34.751878  7896 consensus_queue.cc:237] T 13401e98748b4f1a9cc0827692efd70a P 005ee35e74e24295be2b88596986b0e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:34.759999  7523 catalog_manager.cc:5697] T 13401e98748b4f1a9cc0827692efd70a P 005ee35e74e24295be2b88596986b0e0 reported cstate change: term changed from 1 to 2, leader changed from 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131) to 005ee35e74e24295be2b88596986b0e0 (127.27.146.129). New cstate: current_term: 2 leader_uuid: "005ee35e74e24295be2b88596986b0e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:34.817435  7772 raft_consensus.cc:1275] T 042aa79c19c34c80be5b1523a342312b P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Refusing update from remote peer 005ee35e74e24295be2b88596986b0e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:34.818977  7896 consensus_queue.cc:1048] T 042aa79c19c34c80be5b1523a342312b P 005ee35e74e24295be2b88596986b0e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:34.828725  7700 raft_consensus.cc:1275] T 042aa79c19c34c80be5b1523a342312b P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Refusing update from remote peer 005ee35e74e24295be2b88596986b0e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:34.830873  7896 consensus_queue.cc:1048] T 042aa79c19c34c80be5b1523a342312b P 005ee35e74e24295be2b88596986b0e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:34.900663  7700 raft_consensus.cc:1275] T 5e7913de22ae481cb204173005d94d41 P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Refusing update from remote peer 7c45cd47cdbf4b93ba0e20539d18b63d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:34.902447  7901 consensus_queue.cc:1048] T 5e7913de22ae481cb204173005d94d41 P 7c45cd47cdbf4b93ba0e20539d18b63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:34.911252  7623 raft_consensus.cc:1275] T 5e7913de22ae481cb204173005d94d41 P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Refusing update from remote peer 7c45cd47cdbf4b93ba0e20539d18b63d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:34.913430  7857 consensus_queue.cc:1048] T 5e7913de22ae481cb204173005d94d41 P 7c45cd47cdbf4b93ba0e20539d18b63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:34.962812  7772 raft_consensus.cc:1275] T 047f830ce7f94325ac2b7a5bbcbb288e P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Refusing update from remote peer 256feb60c06e4ccbaeec28266939797e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:34.964520  7879 consensus_queue.cc:1048] T 047f830ce7f94325ac2b7a5bbcbb288e P 256feb60c06e4ccbaeec28266939797e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:34.973271  7625 raft_consensus.cc:1275] T 047f830ce7f94325ac2b7a5bbcbb288e P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Refusing update from remote peer 256feb60c06e4ccbaeec28266939797e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:34.974948  7841 consensus_queue.cc:1048] T 047f830ce7f94325ac2b7a5bbcbb288e P 256feb60c06e4ccbaeec28266939797e [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:35.271910  7772 raft_consensus.cc:1275] T 13401e98748b4f1a9cc0827692efd70a P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Refusing update from remote peer 005ee35e74e24295be2b88596986b0e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:35.273473  7864 consensus_queue.cc:1048] T 13401e98748b4f1a9cc0827692efd70a P 005ee35e74e24295be2b88596986b0e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:35.293588  7700 raft_consensus.cc:1275] T 13401e98748b4f1a9cc0827692efd70a P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Refusing update from remote peer 005ee35e74e24295be2b88596986b0e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:35.295281  7864 consensus_queue.cc:1048] T 13401e98748b4f1a9cc0827692efd70a P 005ee35e74e24295be2b88596986b0e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:37.412277  7523 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59382:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:16:37.414840  7523 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:16:37.477468  7613 tablet_service.cc:1511] Processing CreateTablet for tablet d57f28fe65ad4a5f87539791fad21572 (DEFAULT_TABLE table=soft_deleted_table [id=1b2ebc66c3de4c7b91abdb83026d6ea3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:37.478963  7613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d57f28fe65ad4a5f87539791fad21572. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.478711  7689 tablet_service.cc:1511] Processing CreateTablet for tablet d57f28fe65ad4a5f87539791fad21572 (DEFAULT_TABLE table=soft_deleted_table [id=1b2ebc66c3de4c7b91abdb83026d6ea3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:37.480012  7689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d57f28fe65ad4a5f87539791fad21572. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.479745  7764 tablet_service.cc:1511] Processing CreateTablet for tablet d57f28fe65ad4a5f87539791fad21572 (DEFAULT_TABLE table=soft_deleted_table [id=1b2ebc66c3de4c7b91abdb83026d6ea3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:37.481372  7764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d57f28fe65ad4a5f87539791fad21572. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.483631  7687 tablet_service.cc:1511] Processing CreateTablet for tablet 5fce78ca96eb4051bfdbf4a94fedb307 (DEFAULT_TABLE table=soft_deleted_table [id=1b2ebc66c3de4c7b91abdb83026d6ea3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:37.485155  7687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fce78ca96eb4051bfdbf4a94fedb307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.489034  7610 tablet_service.cc:1511] Processing CreateTablet for tablet 5fce78ca96eb4051bfdbf4a94fedb307 (DEFAULT_TABLE table=soft_deleted_table [id=1b2ebc66c3de4c7b91abdb83026d6ea3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:37.490950  7610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fce78ca96eb4051bfdbf4a94fedb307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.509433  7919 tablet_bootstrap.cc:492] T d57f28fe65ad4a5f87539791fad21572 P 256feb60c06e4ccbaeec28266939797e: Bootstrap starting.
I20260709 13:16:37.515332  7921 tablet_bootstrap.cc:492] T d57f28fe65ad4a5f87539791fad21572 P 7c45cd47cdbf4b93ba0e20539d18b63d: Bootstrap starting.
I20260709 13:16:37.517096  7764 tablet_service.cc:1511] Processing CreateTablet for tablet 5fce78ca96eb4051bfdbf4a94fedb307 (DEFAULT_TABLE table=soft_deleted_table [id=1b2ebc66c3de4c7b91abdb83026d6ea3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:37.518844  7764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fce78ca96eb4051bfdbf4a94fedb307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.519536  7919 tablet_bootstrap.cc:654] T d57f28fe65ad4a5f87539791fad21572 P 256feb60c06e4ccbaeec28266939797e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.519117  7613 tablet_service.cc:1511] Processing CreateTablet for tablet d449aa6b57b3466a91a42fca7495a248 (DEFAULT_TABLE table=soft_deleted_table [id=1b2ebc66c3de4c7b91abdb83026d6ea3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:37.520744  7613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d449aa6b57b3466a91a42fca7495a248. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.511456  7920 tablet_bootstrap.cc:492] T d57f28fe65ad4a5f87539791fad21572 P 005ee35e74e24295be2b88596986b0e0: Bootstrap starting.
I20260709 13:16:37.522799  7921 tablet_bootstrap.cc:654] T d57f28fe65ad4a5f87539791fad21572 P 7c45cd47cdbf4b93ba0e20539d18b63d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.534461  7689 tablet_service.cc:1511] Processing CreateTablet for tablet d449aa6b57b3466a91a42fca7495a248 (DEFAULT_TABLE table=soft_deleted_table [id=1b2ebc66c3de4c7b91abdb83026d6ea3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:37.535939  7689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d449aa6b57b3466a91a42fca7495a248. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.536309  7757 tablet_service.cc:1511] Processing CreateTablet for tablet d449aa6b57b3466a91a42fca7495a248 (DEFAULT_TABLE table=soft_deleted_table [id=1b2ebc66c3de4c7b91abdb83026d6ea3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:37.537559  7757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d449aa6b57b3466a91a42fca7495a248. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.541625  7614 tablet_service.cc:1511] Processing CreateTablet for tablet b7214fe40cbb4728934d178be63cac21 (DEFAULT_TABLE table=soft_deleted_table [id=1b2ebc66c3de4c7b91abdb83026d6ea3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:37.543844  7614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7214fe40cbb4728934d178be63cac21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.558871  7763 tablet_service.cc:1511] Processing CreateTablet for tablet b7214fe40cbb4728934d178be63cac21 (DEFAULT_TABLE table=soft_deleted_table [id=1b2ebc66c3de4c7b91abdb83026d6ea3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:37.560364  7763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7214fe40cbb4728934d178be63cac21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.563012  7919 tablet_bootstrap.cc:492] T d57f28fe65ad4a5f87539791fad21572 P 256feb60c06e4ccbaeec28266939797e: No bootstrap required, opened a new log
I20260709 13:16:37.563723  7919 ts_tablet_manager.cc:1403] T d57f28fe65ad4a5f87539791fad21572 P 256feb60c06e4ccbaeec28266939797e: Time spent bootstrapping tablet: real 0.057s	user 0.028s	sys 0.018s
I20260709 13:16:37.565726  7920 tablet_bootstrap.cc:654] T d57f28fe65ad4a5f87539791fad21572 P 005ee35e74e24295be2b88596986b0e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.575549  7919 raft_consensus.cc:359] T d57f28fe65ad4a5f87539791fad21572 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:37.576602  7919 raft_consensus.cc:385] T d57f28fe65ad4a5f87539791fad21572 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.576989  7919 raft_consensus.cc:740] T d57f28fe65ad4a5f87539791fad21572 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 256feb60c06e4ccbaeec28266939797e, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.577848  7612 tablet_service.cc:1511] Processing CreateTablet for tablet f2e32ae678174dc580caa70ad1407376 (DEFAULT_TABLE table=soft_deleted_table [id=1b2ebc66c3de4c7b91abdb83026d6ea3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:37.578037  7919 consensus_queue.cc:260] T d57f28fe65ad4a5f87539791fad21572 P 256feb60c06e4ccbaeec28266939797e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:37.579452  7612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2e32ae678174dc580caa70ad1407376. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.582782  7687 tablet_service.cc:1511] Processing CreateTablet for tablet f2e32ae678174dc580caa70ad1407376 (DEFAULT_TABLE table=soft_deleted_table [id=1b2ebc66c3de4c7b91abdb83026d6ea3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:37.584195  7687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2e32ae678174dc580caa70ad1407376. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.586843  7759 tablet_service.cc:1511] Processing CreateTablet for tablet f2e32ae678174dc580caa70ad1407376 (DEFAULT_TABLE table=soft_deleted_table [id=1b2ebc66c3de4c7b91abdb83026d6ea3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:37.588349  7759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2e32ae678174dc580caa70ad1407376. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.593748  7690 tablet_service.cc:1511] Processing CreateTablet for tablet 87d1ab8e509a451b91aaaeffce5e0f94 (DEFAULT_TABLE table=soft_deleted_table [id=1b2ebc66c3de4c7b91abdb83026d6ea3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:37.595274  7690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87d1ab8e509a451b91aaaeffce5e0f94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.597106  7611 tablet_service.cc:1511] Processing CreateTablet for tablet 87d1ab8e509a451b91aaaeffce5e0f94 (DEFAULT_TABLE table=soft_deleted_table [id=1b2ebc66c3de4c7b91abdb83026d6ea3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:37.600942  7689 tablet_service.cc:1511] Processing CreateTablet for tablet b7214fe40cbb4728934d178be63cac21 (DEFAULT_TABLE table=soft_deleted_table [id=1b2ebc66c3de4c7b91abdb83026d6ea3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:37.601428  7611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87d1ab8e509a451b91aaaeffce5e0f94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.602433  7689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7214fe40cbb4728934d178be63cac21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.602746  7921 tablet_bootstrap.cc:492] T d57f28fe65ad4a5f87539791fad21572 P 7c45cd47cdbf4b93ba0e20539d18b63d: No bootstrap required, opened a new log
I20260709 13:16:37.623050  7757 tablet_service.cc:1511] Processing CreateTablet for tablet 87d1ab8e509a451b91aaaeffce5e0f94 (DEFAULT_TABLE table=soft_deleted_table [id=1b2ebc66c3de4c7b91abdb83026d6ea3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:37.624476  7757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87d1ab8e509a451b91aaaeffce5e0f94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.626184  7921 ts_tablet_manager.cc:1403] T d57f28fe65ad4a5f87539791fad21572 P 7c45cd47cdbf4b93ba0e20539d18b63d: Time spent bootstrapping tablet: real 0.116s	user 0.017s	sys 0.006s
I20260709 13:16:37.629818  7613 tablet_service.cc:1511] Processing CreateTablet for tablet d788207049fe4313a1a8a63815944994 (DEFAULT_TABLE table=soft_deleted_table [id=1b2ebc66c3de4c7b91abdb83026d6ea3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:37.630023  7921 raft_consensus.cc:359] T d57f28fe65ad4a5f87539791fad21572 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:37.630923  7921 raft_consensus.cc:385] T d57f28fe65ad4a5f87539791fad21572 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.631279  7613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d788207049fe4313a1a8a63815944994. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.631099  7687 tablet_service.cc:1511] Processing CreateTablet for tablet d788207049fe4313a1a8a63815944994 (DEFAULT_TABLE table=soft_deleted_table [id=1b2ebc66c3de4c7b91abdb83026d6ea3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:37.633169  7919 ts_tablet_manager.cc:1434] T d57f28fe65ad4a5f87539791fad21572 P 256feb60c06e4ccbaeec28266939797e: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.004s
I20260709 13:16:37.634407  7919 tablet_bootstrap.cc:492] T 5fce78ca96eb4051bfdbf4a94fedb307 P 256feb60c06e4ccbaeec28266939797e: Bootstrap starting.
I20260709 13:16:37.631266  7921 raft_consensus.cc:740] T d57f28fe65ad4a5f87539791fad21572 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c45cd47cdbf4b93ba0e20539d18b63d, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.637282  7687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d788207049fe4313a1a8a63815944994. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.637722  7921 consensus_queue.cc:260] T d57f28fe65ad4a5f87539791fad21572 P 7c45cd47cdbf4b93ba0e20539d18b63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:37.640616  7921 ts_tablet_manager.cc:1434] T d57f28fe65ad4a5f87539791fad21572 P 7c45cd47cdbf4b93ba0e20539d18b63d: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:16:37.641732  7921 tablet_bootstrap.cc:492] T d449aa6b57b3466a91a42fca7495a248 P 7c45cd47cdbf4b93ba0e20539d18b63d: Bootstrap starting.
I20260709 13:16:37.643667  7920 tablet_bootstrap.cc:492] T d57f28fe65ad4a5f87539791fad21572 P 005ee35e74e24295be2b88596986b0e0: No bootstrap required, opened a new log
I20260709 13:16:37.644322  7920 ts_tablet_manager.cc:1403] T d57f28fe65ad4a5f87539791fad21572 P 005ee35e74e24295be2b88596986b0e0: Time spent bootstrapping tablet: real 0.133s	user 0.011s	sys 0.004s
I20260709 13:16:37.654430  7921 tablet_bootstrap.cc:654] T d449aa6b57b3466a91a42fca7495a248 P 7c45cd47cdbf4b93ba0e20539d18b63d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.662137  7614 tablet_service.cc:1511] Processing CreateTablet for tablet 5bbbdedc18e448da998c67da78c28236 (DEFAULT_TABLE table=soft_deleted_table [id=1b2ebc66c3de4c7b91abdb83026d6ea3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:37.666424  7614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bbbdedc18e448da998c67da78c28236. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.666996  7759 tablet_service.cc:1511] Processing CreateTablet for tablet 5bbbdedc18e448da998c67da78c28236 (DEFAULT_TABLE table=soft_deleted_table [id=1b2ebc66c3de4c7b91abdb83026d6ea3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:37.647424  7920 raft_consensus.cc:359] T d57f28fe65ad4a5f87539791fad21572 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:37.668237  7920 raft_consensus.cc:385] T d57f28fe65ad4a5f87539791fad21572 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.668529  7759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bbbdedc18e448da998c67da78c28236. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.664079  7688 tablet_service.cc:1511] Processing CreateTablet for tablet 5bbbdedc18e448da998c67da78c28236 (DEFAULT_TABLE table=soft_deleted_table [id=1b2ebc66c3de4c7b91abdb83026d6ea3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:37.671815  7688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bbbdedc18e448da998c67da78c28236. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.658042  7764 tablet_service.cc:1511] Processing CreateTablet for tablet d788207049fe4313a1a8a63815944994 (DEFAULT_TABLE table=soft_deleted_table [id=1b2ebc66c3de4c7b91abdb83026d6ea3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:37.672837  7764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d788207049fe4313a1a8a63815944994. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.668552  7920 raft_consensus.cc:740] T d57f28fe65ad4a5f87539791fad21572 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ee35e74e24295be2b88596986b0e0, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.679309  7920 consensus_queue.cc:260] T d57f28fe65ad4a5f87539791fad21572 P 005ee35e74e24295be2b88596986b0e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:37.688701  7683 tablet_service.cc:1511] Processing CreateTablet for tablet d89180feea324fd3b9f81816e4534626 (DEFAULT_TABLE table=soft_deleted_table [id=1b2ebc66c3de4c7b91abdb83026d6ea3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:37.690554  7683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d89180feea324fd3b9f81816e4534626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.694394  7901 raft_consensus.cc:493] T d57f28fe65ad4a5f87539791fad21572 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.695216  7901 raft_consensus.cc:515] T d57f28fe65ad4a5f87539791fad21572 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:37.699371  7763 tablet_service.cc:1511] Processing CreateTablet for tablet d89180feea324fd3b9f81816e4534626 (DEFAULT_TABLE table=soft_deleted_table [id=1b2ebc66c3de4c7b91abdb83026d6ea3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:37.701188  7763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d89180feea324fd3b9f81816e4534626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.715833  7625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57f28fe65ad4a5f87539791fad21572" candidate_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ee35e74e24295be2b88596986b0e0" is_pre_election: true
I20260709 13:16:37.716679  7625 raft_consensus.cc:2468] T d57f28fe65ad4a5f87539791fad21572 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c45cd47cdbf4b93ba0e20539d18b63d in term 0.
I20260709 13:16:37.718307  7739 leader_election.cc:304] T d57f28fe65ad4a5f87539791fad21572 P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0, 7c45cd47cdbf4b93ba0e20539d18b63d; no voters: 
I20260709 13:16:37.716017  7700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57f28fe65ad4a5f87539791fad21572" candidate_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "256feb60c06e4ccbaeec28266939797e" is_pre_election: true
I20260709 13:16:37.720868  7700 raft_consensus.cc:2468] T d57f28fe65ad4a5f87539791fad21572 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c45cd47cdbf4b93ba0e20539d18b63d in term 0.
I20260709 13:16:37.711187  7901 leader_election.cc:290] T d57f28fe65ad4a5f87539791fad21572 P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847), 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449)
I20260709 13:16:37.744529  7611 tablet_service.cc:1511] Processing CreateTablet for tablet d89180feea324fd3b9f81816e4534626 (DEFAULT_TABLE table=soft_deleted_table [id=1b2ebc66c3de4c7b91abdb83026d6ea3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:37.747148  7611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d89180feea324fd3b9f81816e4534626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:37.731719  7901 raft_consensus.cc:2804] T d57f28fe65ad4a5f87539791fad21572 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:37.754447  7901 raft_consensus.cc:493] T d57f28fe65ad4a5f87539791fad21572 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.754879  7901 raft_consensus.cc:3060] T d57f28fe65ad4a5f87539791fad21572 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:37.764891  7919 tablet_bootstrap.cc:654] T 5fce78ca96eb4051bfdbf4a94fedb307 P 256feb60c06e4ccbaeec28266939797e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.765986  7921 tablet_bootstrap.cc:492] T d449aa6b57b3466a91a42fca7495a248 P 7c45cd47cdbf4b93ba0e20539d18b63d: No bootstrap required, opened a new log
I20260709 13:16:37.766583  7921 ts_tablet_manager.cc:1403] T d449aa6b57b3466a91a42fca7495a248 P 7c45cd47cdbf4b93ba0e20539d18b63d: Time spent bootstrapping tablet: real 0.125s	user 0.009s	sys 0.017s
I20260709 13:16:37.773429  7920 ts_tablet_manager.cc:1434] T d57f28fe65ad4a5f87539791fad21572 P 005ee35e74e24295be2b88596986b0e0: Time spent starting tablet: real 0.129s	user 0.014s	sys 0.005s
I20260709 13:16:37.774570  7920 tablet_bootstrap.cc:492] T 5fce78ca96eb4051bfdbf4a94fedb307 P 005ee35e74e24295be2b88596986b0e0: Bootstrap starting.
I20260709 13:16:37.780313  7901 raft_consensus.cc:515] T d57f28fe65ad4a5f87539791fad21572 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:37.782387  7921 raft_consensus.cc:359] T d449aa6b57b3466a91a42fca7495a248 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:37.783475  7901 leader_election.cc:290] T d57f28fe65ad4a5f87539791fad21572 P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 1 election: Requested vote from peers 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847), 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449)
I20260709 13:16:37.784448  7625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57f28fe65ad4a5f87539791fad21572" candidate_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ee35e74e24295be2b88596986b0e0"
I20260709 13:16:37.785110  7625 raft_consensus.cc:3060] T d57f28fe65ad4a5f87539791fad21572 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:37.783282  7921 raft_consensus.cc:385] T d449aa6b57b3466a91a42fca7495a248 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.787914  7921 raft_consensus.cc:740] T d449aa6b57b3466a91a42fca7495a248 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c45cd47cdbf4b93ba0e20539d18b63d, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.788723  7921 consensus_queue.cc:260] T d449aa6b57b3466a91a42fca7495a248 P 7c45cd47cdbf4b93ba0e20539d18b63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:37.791168  7921 ts_tablet_manager.cc:1434] T d449aa6b57b3466a91a42fca7495a248 P 7c45cd47cdbf4b93ba0e20539d18b63d: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 13:16:37.792037  7700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57f28fe65ad4a5f87539791fad21572" candidate_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "256feb60c06e4ccbaeec28266939797e"
I20260709 13:16:37.793089  7700 raft_consensus.cc:3060] T d57f28fe65ad4a5f87539791fad21572 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:37.793345  7921 tablet_bootstrap.cc:492] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d: Bootstrap starting.
I20260709 13:16:37.802877  7625 raft_consensus.cc:2468] T d57f28fe65ad4a5f87539791fad21572 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c45cd47cdbf4b93ba0e20539d18b63d in term 1.
I20260709 13:16:37.804255  7920 tablet_bootstrap.cc:654] T 5fce78ca96eb4051bfdbf4a94fedb307 P 005ee35e74e24295be2b88596986b0e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.804684  7921 tablet_bootstrap.cc:654] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.807366  7700 raft_consensus.cc:2468] T d57f28fe65ad4a5f87539791fad21572 P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c45cd47cdbf4b93ba0e20539d18b63d in term 1.
I20260709 13:16:37.816635  7739 leader_election.cc:304] T d57f28fe65ad4a5f87539791fad21572 P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0, 7c45cd47cdbf4b93ba0e20539d18b63d; no voters: 
I20260709 13:16:37.817866  7901 raft_consensus.cc:2804] T d57f28fe65ad4a5f87539791fad21572 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:37.818404  7901 raft_consensus.cc:697] T d57f28fe65ad4a5f87539791fad21572 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 LEADER]: Becoming Leader. State: Replica: 7c45cd47cdbf4b93ba0e20539d18b63d, State: Running, Role: LEADER
I20260709 13:16:37.819520  7901 consensus_queue.cc:237] T d57f28fe65ad4a5f87539791fad21572 P 7c45cd47cdbf4b93ba0e20539d18b63d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:37.820463  7920 tablet_bootstrap.cc:492] T 5fce78ca96eb4051bfdbf4a94fedb307 P 005ee35e74e24295be2b88596986b0e0: No bootstrap required, opened a new log
I20260709 13:16:37.821408  7920 ts_tablet_manager.cc:1403] T 5fce78ca96eb4051bfdbf4a94fedb307 P 005ee35e74e24295be2b88596986b0e0: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.000s
I20260709 13:16:37.830591  7920 raft_consensus.cc:359] T 5fce78ca96eb4051bfdbf4a94fedb307 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:37.833442  7919 tablet_bootstrap.cc:492] T 5fce78ca96eb4051bfdbf4a94fedb307 P 256feb60c06e4ccbaeec28266939797e: No bootstrap required, opened a new log
I20260709 13:16:37.833802  7921 tablet_bootstrap.cc:492] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d: No bootstrap required, opened a new log
I20260709 13:16:37.834092  7919 ts_tablet_manager.cc:1403] T 5fce78ca96eb4051bfdbf4a94fedb307 P 256feb60c06e4ccbaeec28266939797e: Time spent bootstrapping tablet: real 0.200s	user 0.011s	sys 0.011s
I20260709 13:16:37.834301  7921 ts_tablet_manager.cc:1403] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d: Time spent bootstrapping tablet: real 0.041s	user 0.002s	sys 0.022s
I20260709 13:16:37.835867  7920 raft_consensus.cc:385] T 5fce78ca96eb4051bfdbf4a94fedb307 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.838589  7920 raft_consensus.cc:740] T 5fce78ca96eb4051bfdbf4a94fedb307 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ee35e74e24295be2b88596986b0e0, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.838065  7921 raft_consensus.cc:359] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:37.837880  7919 raft_consensus.cc:359] T 5fce78ca96eb4051bfdbf4a94fedb307 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:37.839931  7921 raft_consensus.cc:385] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.839541  7920 consensus_queue.cc:260] T 5fce78ca96eb4051bfdbf4a94fedb307 P 005ee35e74e24295be2b88596986b0e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:37.840416  7919 raft_consensus.cc:385] T 5fce78ca96eb4051bfdbf4a94fedb307 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.840830  7919 raft_consensus.cc:740] T 5fce78ca96eb4051bfdbf4a94fedb307 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 256feb60c06e4ccbaeec28266939797e, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.840480  7921 raft_consensus.cc:740] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c45cd47cdbf4b93ba0e20539d18b63d, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.842021  7919 consensus_queue.cc:260] T 5fce78ca96eb4051bfdbf4a94fedb307 P 256feb60c06e4ccbaeec28266939797e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:37.842696  7920 ts_tablet_manager.cc:1434] T 5fce78ca96eb4051bfdbf4a94fedb307 P 005ee35e74e24295be2b88596986b0e0: Time spent starting tablet: real 0.021s	user 0.010s	sys 0.000s
I20260709 13:16:37.842339  7921 consensus_queue.cc:260] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:37.844076  7920 tablet_bootstrap.cc:492] T d449aa6b57b3466a91a42fca7495a248 P 005ee35e74e24295be2b88596986b0e0: Bootstrap starting.
I20260709 13:16:37.845594  7921 ts_tablet_manager.cc:1434] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.007s
I20260709 13:16:37.846868  7921 tablet_bootstrap.cc:492] T f2e32ae678174dc580caa70ad1407376 P 7c45cd47cdbf4b93ba0e20539d18b63d: Bootstrap starting.
I20260709 13:16:37.854540  7921 tablet_bootstrap.cc:654] T f2e32ae678174dc580caa70ad1407376 P 7c45cd47cdbf4b93ba0e20539d18b63d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.855726  7919 ts_tablet_manager.cc:1434] T 5fce78ca96eb4051bfdbf4a94fedb307 P 256feb60c06e4ccbaeec28266939797e: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.006s
I20260709 13:16:37.856601  7920 tablet_bootstrap.cc:654] T d449aa6b57b3466a91a42fca7495a248 P 005ee35e74e24295be2b88596986b0e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.862236  7523 catalog_manager.cc:5697] T d57f28fe65ad4a5f87539791fad21572 P 7c45cd47cdbf4b93ba0e20539d18b63d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131). New cstate: current_term: 1 leader_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:37.875164  7919 tablet_bootstrap.cc:492] T d449aa6b57b3466a91a42fca7495a248 P 256feb60c06e4ccbaeec28266939797e: Bootstrap starting.
I20260709 13:16:37.887307  7919 tablet_bootstrap.cc:654] T d449aa6b57b3466a91a42fca7495a248 P 256feb60c06e4ccbaeec28266939797e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.895610  7921 tablet_bootstrap.cc:492] T f2e32ae678174dc580caa70ad1407376 P 7c45cd47cdbf4b93ba0e20539d18b63d: No bootstrap required, opened a new log
I20260709 13:16:37.896109  7921 ts_tablet_manager.cc:1403] T f2e32ae678174dc580caa70ad1407376 P 7c45cd47cdbf4b93ba0e20539d18b63d: Time spent bootstrapping tablet: real 0.050s	user 0.025s	sys 0.023s
I20260709 13:16:37.896844  7920 tablet_bootstrap.cc:492] T d449aa6b57b3466a91a42fca7495a248 P 005ee35e74e24295be2b88596986b0e0: No bootstrap required, opened a new log
I20260709 13:16:37.897514  7920 ts_tablet_manager.cc:1403] T d449aa6b57b3466a91a42fca7495a248 P 005ee35e74e24295be2b88596986b0e0: Time spent bootstrapping tablet: real 0.054s	user 0.024s	sys 0.021s
I20260709 13:16:37.898089  7919 tablet_bootstrap.cc:492] T d449aa6b57b3466a91a42fca7495a248 P 256feb60c06e4ccbaeec28266939797e: No bootstrap required, opened a new log
I20260709 13:16:37.898715  7919 ts_tablet_manager.cc:1403] T d449aa6b57b3466a91a42fca7495a248 P 256feb60c06e4ccbaeec28266939797e: Time spent bootstrapping tablet: real 0.024s	user 0.020s	sys 0.000s
I20260709 13:16:37.898627  7921 raft_consensus.cc:359] T f2e32ae678174dc580caa70ad1407376 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:37.899959  7921 raft_consensus.cc:385] T f2e32ae678174dc580caa70ad1407376 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.900282  7921 raft_consensus.cc:740] T f2e32ae678174dc580caa70ad1407376 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c45cd47cdbf4b93ba0e20539d18b63d, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.901226  7921 consensus_queue.cc:260] T f2e32ae678174dc580caa70ad1407376 P 7c45cd47cdbf4b93ba0e20539d18b63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:37.901304  7920 raft_consensus.cc:359] T d449aa6b57b3466a91a42fca7495a248 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:37.902930  7920 raft_consensus.cc:385] T d449aa6b57b3466a91a42fca7495a248 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.904213  7920 raft_consensus.cc:740] T d449aa6b57b3466a91a42fca7495a248 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ee35e74e24295be2b88596986b0e0, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.905978  7921 ts_tablet_manager.cc:1434] T f2e32ae678174dc580caa70ad1407376 P 7c45cd47cdbf4b93ba0e20539d18b63d: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:16:37.905726  7920 consensus_queue.cc:260] T d449aa6b57b3466a91a42fca7495a248 P 005ee35e74e24295be2b88596986b0e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:37.907330  7921 tablet_bootstrap.cc:492] T 5fce78ca96eb4051bfdbf4a94fedb307 P 7c45cd47cdbf4b93ba0e20539d18b63d: Bootstrap starting.
I20260709 13:16:37.908771  7920 ts_tablet_manager.cc:1434] T d449aa6b57b3466a91a42fca7495a248 P 005ee35e74e24295be2b88596986b0e0: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 13:16:37.903223  7919 raft_consensus.cc:359] T d449aa6b57b3466a91a42fca7495a248 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:37.909435  7919 raft_consensus.cc:385] T d449aa6b57b3466a91a42fca7495a248 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.909777  7919 raft_consensus.cc:740] T d449aa6b57b3466a91a42fca7495a248 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 256feb60c06e4ccbaeec28266939797e, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.910557  7920 tablet_bootstrap.cc:492] T b7214fe40cbb4728934d178be63cac21 P 005ee35e74e24295be2b88596986b0e0: Bootstrap starting.
I20260709 13:16:37.910805  7901 raft_consensus.cc:493] T f2e32ae678174dc580caa70ad1407376 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.911391  7901 raft_consensus.cc:515] T f2e32ae678174dc580caa70ad1407376 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:37.913589  7901 leader_election.cc:290] T f2e32ae678174dc580caa70ad1407376 P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847), 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449)
I20260709 13:16:37.916029  7921 tablet_bootstrap.cc:654] T 5fce78ca96eb4051bfdbf4a94fedb307 P 7c45cd47cdbf4b93ba0e20539d18b63d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.917711  7625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e32ae678174dc580caa70ad1407376" candidate_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ee35e74e24295be2b88596986b0e0" is_pre_election: true
I20260709 13:16:37.919294  7920 tablet_bootstrap.cc:654] T b7214fe40cbb4728934d178be63cac21 P 005ee35e74e24295be2b88596986b0e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.919368  7700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e32ae678174dc580caa70ad1407376" candidate_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "256feb60c06e4ccbaeec28266939797e" is_pre_election: true
W20260709 13:16:37.921252  7740 leader_election.cc:343] T f2e32ae678174dc580caa70ad1407376 P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:37.922514  7739 leader_election.cc:343] T f2e32ae678174dc580caa70ad1407376 P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:37.922976  7739 leader_election.cc:304] T f2e32ae678174dc580caa70ad1407376 P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c45cd47cdbf4b93ba0e20539d18b63d; no voters: 005ee35e74e24295be2b88596986b0e0, 256feb60c06e4ccbaeec28266939797e
I20260709 13:16:37.926637  7901 raft_consensus.cc:2749] T f2e32ae678174dc580caa70ad1407376 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:37.927590  7919 consensus_queue.cc:260] T d449aa6b57b3466a91a42fca7495a248 P 256feb60c06e4ccbaeec28266939797e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:37.934995  7920 tablet_bootstrap.cc:492] T b7214fe40cbb4728934d178be63cac21 P 005ee35e74e24295be2b88596986b0e0: No bootstrap required, opened a new log
I20260709 13:16:37.935997  7919 ts_tablet_manager.cc:1434] T d449aa6b57b3466a91a42fca7495a248 P 256feb60c06e4ccbaeec28266939797e: Time spent starting tablet: real 0.037s	user 0.010s	sys 0.001s
I20260709 13:16:37.936182  7920 ts_tablet_manager.cc:1403] T b7214fe40cbb4728934d178be63cac21 P 005ee35e74e24295be2b88596986b0e0: Time spent bootstrapping tablet: real 0.026s	user 0.019s	sys 0.005s
I20260709 13:16:37.937712  7919 tablet_bootstrap.cc:492] T f2e32ae678174dc580caa70ad1407376 P 256feb60c06e4ccbaeec28266939797e: Bootstrap starting.
I20260709 13:16:37.941848  7920 raft_consensus.cc:359] T b7214fe40cbb4728934d178be63cac21 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:37.943075  7920 raft_consensus.cc:385] T b7214fe40cbb4728934d178be63cac21 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.943547  7920 raft_consensus.cc:740] T b7214fe40cbb4728934d178be63cac21 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ee35e74e24295be2b88596986b0e0, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.944832  7920 consensus_queue.cc:260] T b7214fe40cbb4728934d178be63cac21 P 005ee35e74e24295be2b88596986b0e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:37.948648  7920 ts_tablet_manager.cc:1434] T b7214fe40cbb4728934d178be63cac21 P 005ee35e74e24295be2b88596986b0e0: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.001s
I20260709 13:16:37.950465  7920 tablet_bootstrap.cc:492] T 87d1ab8e509a451b91aaaeffce5e0f94 P 005ee35e74e24295be2b88596986b0e0: Bootstrap starting.
I20260709 13:16:37.951037  7919 tablet_bootstrap.cc:654] T f2e32ae678174dc580caa70ad1407376 P 256feb60c06e4ccbaeec28266939797e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.951138  7921 tablet_bootstrap.cc:492] T 5fce78ca96eb4051bfdbf4a94fedb307 P 7c45cd47cdbf4b93ba0e20539d18b63d: No bootstrap required, opened a new log
I20260709 13:16:37.951959  7921 ts_tablet_manager.cc:1403] T 5fce78ca96eb4051bfdbf4a94fedb307 P 7c45cd47cdbf4b93ba0e20539d18b63d: Time spent bootstrapping tablet: real 0.045s	user 0.022s	sys 0.022s
I20260709 13:16:37.955698  7921 raft_consensus.cc:359] T 5fce78ca96eb4051bfdbf4a94fedb307 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:37.956605  7921 raft_consensus.cc:385] T 5fce78ca96eb4051bfdbf4a94fedb307 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.956928  7921 raft_consensus.cc:740] T 5fce78ca96eb4051bfdbf4a94fedb307 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c45cd47cdbf4b93ba0e20539d18b63d, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.957701  7921 consensus_queue.cc:260] T 5fce78ca96eb4051bfdbf4a94fedb307 P 7c45cd47cdbf4b93ba0e20539d18b63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:37.959030  7920 tablet_bootstrap.cc:654] T 87d1ab8e509a451b91aaaeffce5e0f94 P 005ee35e74e24295be2b88596986b0e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.960696  7921 ts_tablet_manager.cc:1434] T 5fce78ca96eb4051bfdbf4a94fedb307 P 7c45cd47cdbf4b93ba0e20539d18b63d: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.005s
I20260709 13:16:37.961912  7921 tablet_bootstrap.cc:492] T d788207049fe4313a1a8a63815944994 P 7c45cd47cdbf4b93ba0e20539d18b63d: Bootstrap starting.
I20260709 13:16:37.971336  7921 tablet_bootstrap.cc:654] T d788207049fe4313a1a8a63815944994 P 7c45cd47cdbf4b93ba0e20539d18b63d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.972138  7920 tablet_bootstrap.cc:492] T 87d1ab8e509a451b91aaaeffce5e0f94 P 005ee35e74e24295be2b88596986b0e0: No bootstrap required, opened a new log
I20260709 13:16:37.972383  7919 tablet_bootstrap.cc:492] T f2e32ae678174dc580caa70ad1407376 P 256feb60c06e4ccbaeec28266939797e: No bootstrap required, opened a new log
I20260709 13:16:37.972875  7920 ts_tablet_manager.cc:1403] T 87d1ab8e509a451b91aaaeffce5e0f94 P 005ee35e74e24295be2b88596986b0e0: Time spent bootstrapping tablet: real 0.023s	user 0.000s	sys 0.019s
I20260709 13:16:37.973026  7919 ts_tablet_manager.cc:1403] T f2e32ae678174dc580caa70ad1407376 P 256feb60c06e4ccbaeec28266939797e: Time spent bootstrapping tablet: real 0.036s	user 0.006s	sys 0.012s
I20260709 13:16:37.976348  7919 raft_consensus.cc:359] T f2e32ae678174dc580caa70ad1407376 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:37.977119  7919 raft_consensus.cc:385] T f2e32ae678174dc580caa70ad1407376 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.977445  7919 raft_consensus.cc:740] T f2e32ae678174dc580caa70ad1407376 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 256feb60c06e4ccbaeec28266939797e, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.977190  7920 raft_consensus.cc:359] T 87d1ab8e509a451b91aaaeffce5e0f94 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:37.978609  7920 raft_consensus.cc:385] T 87d1ab8e509a451b91aaaeffce5e0f94 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.979250  7920 raft_consensus.cc:740] T 87d1ab8e509a451b91aaaeffce5e0f94 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ee35e74e24295be2b88596986b0e0, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.978649  7919 consensus_queue.cc:260] T f2e32ae678174dc580caa70ad1407376 P 256feb60c06e4ccbaeec28266939797e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:37.980443  7920 consensus_queue.cc:260] T 87d1ab8e509a451b91aaaeffce5e0f94 P 005ee35e74e24295be2b88596986b0e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:37.981956  7919 ts_tablet_manager.cc:1434] T f2e32ae678174dc580caa70ad1407376 P 256feb60c06e4ccbaeec28266939797e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:16:37.983081  7919 tablet_bootstrap.cc:492] T 87d1ab8e509a451b91aaaeffce5e0f94 P 256feb60c06e4ccbaeec28266939797e: Bootstrap starting.
I20260709 13:16:37.983887  7920 ts_tablet_manager.cc:1434] T 87d1ab8e509a451b91aaaeffce5e0f94 P 005ee35e74e24295be2b88596986b0e0: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.003s
I20260709 13:16:37.984447  7921 tablet_bootstrap.cc:492] T d788207049fe4313a1a8a63815944994 P 7c45cd47cdbf4b93ba0e20539d18b63d: No bootstrap required, opened a new log
I20260709 13:16:37.985208  7921 ts_tablet_manager.cc:1403] T d788207049fe4313a1a8a63815944994 P 7c45cd47cdbf4b93ba0e20539d18b63d: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.014s
I20260709 13:16:37.985396  7920 tablet_bootstrap.cc:492] T f2e32ae678174dc580caa70ad1407376 P 005ee35e74e24295be2b88596986b0e0: Bootstrap starting.
I20260709 13:16:37.990170  7919 tablet_bootstrap.cc:654] T 87d1ab8e509a451b91aaaeffce5e0f94 P 256feb60c06e4ccbaeec28266939797e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.993018  7920 tablet_bootstrap.cc:654] T f2e32ae678174dc580caa70ad1407376 P 005ee35e74e24295be2b88596986b0e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:37.996610  7921 raft_consensus.cc:359] T d788207049fe4313a1a8a63815944994 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:37.998140  7921 raft_consensus.cc:385] T d788207049fe4313a1a8a63815944994 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:37.998545  7921 raft_consensus.cc:740] T d788207049fe4313a1a8a63815944994 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c45cd47cdbf4b93ba0e20539d18b63d, State: Initialized, Role: FOLLOWER
I20260709 13:16:37.999679  7921 consensus_queue.cc:260] T d788207049fe4313a1a8a63815944994 P 7c45cd47cdbf4b93ba0e20539d18b63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.005605  7920 tablet_bootstrap.cc:492] T f2e32ae678174dc580caa70ad1407376 P 005ee35e74e24295be2b88596986b0e0: No bootstrap required, opened a new log
I20260709 13:16:38.006316  7920 ts_tablet_manager.cc:1403] T f2e32ae678174dc580caa70ad1407376 P 005ee35e74e24295be2b88596986b0e0: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 13:16:38.006327  7921 ts_tablet_manager.cc:1434] T d788207049fe4313a1a8a63815944994 P 7c45cd47cdbf4b93ba0e20539d18b63d: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.003s
I20260709 13:16:38.007702  7921 tablet_bootstrap.cc:492] T 87d1ab8e509a451b91aaaeffce5e0f94 P 7c45cd47cdbf4b93ba0e20539d18b63d: Bootstrap starting.
I20260709 13:16:38.009997  7920 raft_consensus.cc:359] T f2e32ae678174dc580caa70ad1407376 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.010844  7920 raft_consensus.cc:385] T f2e32ae678174dc580caa70ad1407376 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.011178  7920 raft_consensus.cc:740] T f2e32ae678174dc580caa70ad1407376 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ee35e74e24295be2b88596986b0e0, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.012108  7920 consensus_queue.cc:260] T f2e32ae678174dc580caa70ad1407376 P 005ee35e74e24295be2b88596986b0e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.012771  7919 tablet_bootstrap.cc:492] T 87d1ab8e509a451b91aaaeffce5e0f94 P 256feb60c06e4ccbaeec28266939797e: No bootstrap required, opened a new log
I20260709 13:16:38.013420  7919 ts_tablet_manager.cc:1403] T 87d1ab8e509a451b91aaaeffce5e0f94 P 256feb60c06e4ccbaeec28266939797e: Time spent bootstrapping tablet: real 0.031s	user 0.007s	sys 0.010s
I20260709 13:16:38.015184  7920 ts_tablet_manager.cc:1434] T f2e32ae678174dc580caa70ad1407376 P 005ee35e74e24295be2b88596986b0e0: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.001s
I20260709 13:16:38.015406  7921 tablet_bootstrap.cc:654] T 87d1ab8e509a451b91aaaeffce5e0f94 P 7c45cd47cdbf4b93ba0e20539d18b63d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.016981  7919 raft_consensus.cc:359] T 87d1ab8e509a451b91aaaeffce5e0f94 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.017895  7919 raft_consensus.cc:385] T 87d1ab8e509a451b91aaaeffce5e0f94 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.018080  7920 tablet_bootstrap.cc:492] T 5bbbdedc18e448da998c67da78c28236 P 005ee35e74e24295be2b88596986b0e0: Bootstrap starting.
I20260709 13:16:38.018222  7919 raft_consensus.cc:740] T 87d1ab8e509a451b91aaaeffce5e0f94 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 256feb60c06e4ccbaeec28266939797e, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.019320  7919 consensus_queue.cc:260] T 87d1ab8e509a451b91aaaeffce5e0f94 P 256feb60c06e4ccbaeec28266939797e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.022258  7919 ts_tablet_manager.cc:1434] T 87d1ab8e509a451b91aaaeffce5e0f94 P 256feb60c06e4ccbaeec28266939797e: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:16:38.023399  7919 tablet_bootstrap.cc:492] T d788207049fe4313a1a8a63815944994 P 256feb60c06e4ccbaeec28266939797e: Bootstrap starting.
I20260709 13:16:38.029409  7920 tablet_bootstrap.cc:654] T 5bbbdedc18e448da998c67da78c28236 P 005ee35e74e24295be2b88596986b0e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.037675  7919 tablet_bootstrap.cc:654] T d788207049fe4313a1a8a63815944994 P 256feb60c06e4ccbaeec28266939797e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.044664  7920 tablet_bootstrap.cc:492] T 5bbbdedc18e448da998c67da78c28236 P 005ee35e74e24295be2b88596986b0e0: No bootstrap required, opened a new log
I20260709 13:16:38.045575  7920 ts_tablet_manager.cc:1403] T 5bbbdedc18e448da998c67da78c28236 P 005ee35e74e24295be2b88596986b0e0: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.011s
I20260709 13:16:38.050103  7920 raft_consensus.cc:359] T 5bbbdedc18e448da998c67da78c28236 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.051147  7920 raft_consensus.cc:385] T 5bbbdedc18e448da998c67da78c28236 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.051556  7920 raft_consensus.cc:740] T 5bbbdedc18e448da998c67da78c28236 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ee35e74e24295be2b88596986b0e0, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.052893  7920 consensus_queue.cc:260] T 5bbbdedc18e448da998c67da78c28236 P 005ee35e74e24295be2b88596986b0e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.057324  7920 ts_tablet_manager.cc:1434] T 5bbbdedc18e448da998c67da78c28236 P 005ee35e74e24295be2b88596986b0e0: Time spent starting tablet: real 0.011s	user 0.011s	sys 0.000s
I20260709 13:16:38.059120  7920 tablet_bootstrap.cc:492] T d788207049fe4313a1a8a63815944994 P 005ee35e74e24295be2b88596986b0e0: Bootstrap starting.
I20260709 13:16:38.058739  7926 raft_consensus.cc:493] T f2e32ae678174dc580caa70ad1407376 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.059790  7926 raft_consensus.cc:515] T f2e32ae678174dc580caa70ad1407376 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.061890  7901 raft_consensus.cc:493] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.062511  7901 raft_consensus.cc:515] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.064481  7926 leader_election.cc:290] T f2e32ae678174dc580caa70ad1407376 P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449), 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071)
I20260709 13:16:38.064703  7901 leader_election.cc:290] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847), 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449)
I20260709 13:16:38.065618  7700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e32ae678174dc580caa70ad1407376" candidate_uuid: "005ee35e74e24295be2b88596986b0e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "256feb60c06e4ccbaeec28266939797e" is_pre_election: true
I20260709 13:16:38.066287  7700 raft_consensus.cc:2468] T f2e32ae678174dc580caa70ad1407376 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ee35e74e24295be2b88596986b0e0 in term 0.
I20260709 13:16:38.066923  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e32ae678174dc580caa70ad1407376" candidate_uuid: "005ee35e74e24295be2b88596986b0e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" is_pre_election: true
I20260709 13:16:38.067593  7772 raft_consensus.cc:2468] T f2e32ae678174dc580caa70ad1407376 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ee35e74e24295be2b88596986b0e0 in term 0.
I20260709 13:16:38.067867  7591 leader_election.cc:304] T f2e32ae678174dc580caa70ad1407376 P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0, 256feb60c06e4ccbaeec28266939797e; no voters: 
I20260709 13:16:38.070358  7625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7214fe40cbb4728934d178be63cac21" candidate_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ee35e74e24295be2b88596986b0e0" is_pre_election: true
I20260709 13:16:38.071013  7625 raft_consensus.cc:2468] T b7214fe40cbb4728934d178be63cac21 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c45cd47cdbf4b93ba0e20539d18b63d in term 0.
I20260709 13:16:38.071825  7920 tablet_bootstrap.cc:654] T d788207049fe4313a1a8a63815944994 P 005ee35e74e24295be2b88596986b0e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.072283  7739 leader_election.cc:304] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0, 7c45cd47cdbf4b93ba0e20539d18b63d; no voters: 
I20260709 13:16:38.073156  7933 raft_consensus.cc:493] T d449aa6b57b3466a91a42fca7495a248 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.073920  7700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7214fe40cbb4728934d178be63cac21" candidate_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "256feb60c06e4ccbaeec28266939797e" is_pre_election: true
W20260709 13:16:38.075366  7740 leader_election.cc:343] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:38.073733  7933 raft_consensus.cc:515] T d449aa6b57b3466a91a42fca7495a248 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.076298  7905 raft_consensus.cc:493] T 5fce78ca96eb4051bfdbf4a94fedb307 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.076905  7905 raft_consensus.cc:515] T 5fce78ca96eb4051bfdbf4a94fedb307 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.077898  7933 leader_election.cc:290] T d449aa6b57b3466a91a42fca7495a248 P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847), 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071)
I20260709 13:16:38.073257  7926 raft_consensus.cc:2804] T f2e32ae678174dc580caa70ad1407376 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:38.078617  7926 raft_consensus.cc:493] T f2e32ae678174dc580caa70ad1407376 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.079013  7926 raft_consensus.cc:3060] T f2e32ae678174dc580caa70ad1407376 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.079432  7905 leader_election.cc:290] T 5fce78ca96eb4051bfdbf4a94fedb307 P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847), 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071)
I20260709 13:16:38.079463  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d449aa6b57b3466a91a42fca7495a248" candidate_uuid: "256feb60c06e4ccbaeec28266939797e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" is_pre_election: true
I20260709 13:16:38.080440  7772 raft_consensus.cc:2468] T d449aa6b57b3466a91a42fca7495a248 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 256feb60c06e4ccbaeec28266939797e in term 0.
I20260709 13:16:38.082056  7663 leader_election.cc:304] T d449aa6b57b3466a91a42fca7495a248 P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 256feb60c06e4ccbaeec28266939797e, 7c45cd47cdbf4b93ba0e20539d18b63d; no voters: 
I20260709 13:16:38.084031  7623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce78ca96eb4051bfdbf4a94fedb307" candidate_uuid: "256feb60c06e4ccbaeec28266939797e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ee35e74e24295be2b88596986b0e0" is_pre_election: true
I20260709 13:16:38.084785  7623 raft_consensus.cc:2468] T 5fce78ca96eb4051bfdbf4a94fedb307 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 256feb60c06e4ccbaeec28266939797e in term 0.
I20260709 13:16:38.085904  7625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d449aa6b57b3466a91a42fca7495a248" candidate_uuid: "256feb60c06e4ccbaeec28266939797e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ee35e74e24295be2b88596986b0e0" is_pre_election: true
I20260709 13:16:38.086561  7625 raft_consensus.cc:2468] T d449aa6b57b3466a91a42fca7495a248 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 256feb60c06e4ccbaeec28266939797e in term 0.
I20260709 13:16:38.087052  7926 raft_consensus.cc:515] T f2e32ae678174dc580caa70ad1407376 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.087589  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce78ca96eb4051bfdbf4a94fedb307" candidate_uuid: "256feb60c06e4ccbaeec28266939797e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" is_pre_election: true
I20260709 13:16:38.088274  7772 raft_consensus.cc:2468] T 5fce78ca96eb4051bfdbf4a94fedb307 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 256feb60c06e4ccbaeec28266939797e in term 0.
I20260709 13:16:38.089591  7663 leader_election.cc:304] T 5fce78ca96eb4051bfdbf4a94fedb307 P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 256feb60c06e4ccbaeec28266939797e, 7c45cd47cdbf4b93ba0e20539d18b63d; no voters: 
I20260709 13:16:38.090286  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e32ae678174dc580caa70ad1407376" candidate_uuid: "005ee35e74e24295be2b88596986b0e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d"
I20260709 13:16:38.090857  7772 raft_consensus.cc:3060] T f2e32ae678174dc580caa70ad1407376 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.091782  7905 raft_consensus.cc:2804] T d449aa6b57b3466a91a42fca7495a248 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:38.092780  7700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e32ae678174dc580caa70ad1407376" candidate_uuid: "005ee35e74e24295be2b88596986b0e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "256feb60c06e4ccbaeec28266939797e"
I20260709 13:16:38.093361  7700 raft_consensus.cc:3060] T f2e32ae678174dc580caa70ad1407376 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.092175  7905 raft_consensus.cc:493] T d449aa6b57b3466a91a42fca7495a248 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.095465  7921 tablet_bootstrap.cc:492] T 87d1ab8e509a451b91aaaeffce5e0f94 P 7c45cd47cdbf4b93ba0e20539d18b63d: No bootstrap required, opened a new log
I20260709 13:16:38.096588  7933 raft_consensus.cc:2804] T 5fce78ca96eb4051bfdbf4a94fedb307 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:38.095762  7905 raft_consensus.cc:3060] T d449aa6b57b3466a91a42fca7495a248 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.096989  7921 ts_tablet_manager.cc:1403] T 87d1ab8e509a451b91aaaeffce5e0f94 P 7c45cd47cdbf4b93ba0e20539d18b63d: Time spent bootstrapping tablet: real 0.090s	user 0.027s	sys 0.039s
I20260709 13:16:38.098526  7772 raft_consensus.cc:2468] T f2e32ae678174dc580caa70ad1407376 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ee35e74e24295be2b88596986b0e0 in term 1.
I20260709 13:16:38.097016  7933 raft_consensus.cc:493] T 5fce78ca96eb4051bfdbf4a94fedb307 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.099964  7588 leader_election.cc:304] T f2e32ae678174dc580caa70ad1407376 P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0, 7c45cd47cdbf4b93ba0e20539d18b63d; no voters: 
I20260709 13:16:38.100883  7928 raft_consensus.cc:2804] T f2e32ae678174dc580caa70ad1407376 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:38.101439  7928 raft_consensus.cc:697] T f2e32ae678174dc580caa70ad1407376 P 005ee35e74e24295be2b88596986b0e0 [term 1 LEADER]: Becoming Leader. State: Replica: 005ee35e74e24295be2b88596986b0e0, State: Running, Role: LEADER
I20260709 13:16:38.102305  7928 consensus_queue.cc:237] T f2e32ae678174dc580caa70ad1407376 P 005ee35e74e24295be2b88596986b0e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.103627  7921 raft_consensus.cc:359] T 87d1ab8e509a451b91aaaeffce5e0f94 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.105054  7921 raft_consensus.cc:385] T 87d1ab8e509a451b91aaaeffce5e0f94 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.105588  7921 raft_consensus.cc:740] T 87d1ab8e509a451b91aaaeffce5e0f94 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c45cd47cdbf4b93ba0e20539d18b63d, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.099968  7933 raft_consensus.cc:3060] T 5fce78ca96eb4051bfdbf4a94fedb307 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.084031  7901 raft_consensus.cc:2804] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:38.107194  7901 raft_consensus.cc:493] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.108750  7901 raft_consensus.cc:3060] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.106972  7921 consensus_queue.cc:260] T 87d1ab8e509a451b91aaaeffce5e0f94 P 7c45cd47cdbf4b93ba0e20539d18b63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.116925  7901 raft_consensus.cc:515] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.113981  7926 leader_election.cc:290] T f2e32ae678174dc580caa70ad1407376 P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 1 election: Requested vote from peers 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449), 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071)
I20260709 13:16:38.125581  7919 tablet_bootstrap.cc:492] T d788207049fe4313a1a8a63815944994 P 256feb60c06e4ccbaeec28266939797e: No bootstrap required, opened a new log
I20260709 13:16:38.132158  7919 ts_tablet_manager.cc:1403] T d788207049fe4313a1a8a63815944994 P 256feb60c06e4ccbaeec28266939797e: Time spent bootstrapping tablet: real 0.109s	user 0.021s	sys 0.012s
I20260709 13:16:38.128247  7700 raft_consensus.cc:2468] T f2e32ae678174dc580caa70ad1407376 P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ee35e74e24295be2b88596986b0e0 in term 1.
I20260709 13:16:38.132808  7699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7214fe40cbb4728934d178be63cac21" candidate_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "256feb60c06e4ccbaeec28266939797e"
I20260709 13:16:38.125329  7905 raft_consensus.cc:515] T d449aa6b57b3466a91a42fca7495a248 P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
W20260709 13:16:38.135249  7740 leader_election.cc:343] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:38.135401  7919 raft_consensus.cc:359] T d788207049fe4313a1a8a63815944994 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.136622  7928 raft_consensus.cc:493] T 5bbbdedc18e448da998c67da78c28236 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.136754  7623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d449aa6b57b3466a91a42fca7495a248" candidate_uuid: "256feb60c06e4ccbaeec28266939797e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ee35e74e24295be2b88596986b0e0"
I20260709 13:16:38.137377  7623 raft_consensus.cc:3060] T d449aa6b57b3466a91a42fca7495a248 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.137151  7928 raft_consensus.cc:515] T 5bbbdedc18e448da998c67da78c28236 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.139390  7928 leader_election.cc:290] T 5bbbdedc18e448da998c67da78c28236 P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449), 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071)
I20260709 13:16:38.128834  7933 raft_consensus.cc:515] T 5fce78ca96eb4051bfdbf4a94fedb307 P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.130450  7921 ts_tablet_manager.cc:1434] T 87d1ab8e509a451b91aaaeffce5e0f94 P 7c45cd47cdbf4b93ba0e20539d18b63d: Time spent starting tablet: real 0.033s	user 0.011s	sys 0.000s
I20260709 13:16:38.129205  7523 catalog_manager.cc:5697] T f2e32ae678174dc580caa70ad1407376 P 005ee35e74e24295be2b88596986b0e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 005ee35e74e24295be2b88596986b0e0 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "005ee35e74e24295be2b88596986b0e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:38.130869  7625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7214fe40cbb4728934d178be63cac21" candidate_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ee35e74e24295be2b88596986b0e0"
I20260709 13:16:38.141211  7901 leader_election.cc:290] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 1 election: Requested vote from peers 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847), 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449)
I20260709 13:16:38.141479  7905 leader_election.cc:290] T d449aa6b57b3466a91a42fca7495a248 P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 1 election: Requested vote from peers 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847), 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071)
I20260709 13:16:38.141701  7699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbbdedc18e448da998c67da78c28236" candidate_uuid: "005ee35e74e24295be2b88596986b0e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "256feb60c06e4ccbaeec28266939797e" is_pre_election: true
I20260709 13:16:38.146258  7933 leader_election.cc:290] T 5fce78ca96eb4051bfdbf4a94fedb307 P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 1 election: Requested vote from peers 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847), 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071)
I20260709 13:16:38.136341  7919 raft_consensus.cc:385] T d788207049fe4313a1a8a63815944994 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.146987  7919 raft_consensus.cc:740] T d788207049fe4313a1a8a63815944994 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 256feb60c06e4ccbaeec28266939797e, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.147404  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce78ca96eb4051bfdbf4a94fedb307" candidate_uuid: "256feb60c06e4ccbaeec28266939797e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d"
I20260709 13:16:38.141762  7625 raft_consensus.cc:3060] T b7214fe40cbb4728934d178be63cac21 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.148103  7774 raft_consensus.cc:3060] T 5fce78ca96eb4051bfdbf4a94fedb307 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.144227  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d449aa6b57b3466a91a42fca7495a248" candidate_uuid: "256feb60c06e4ccbaeec28266939797e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d"
I20260709 13:16:38.149130  7772 raft_consensus.cc:3060] T d449aa6b57b3466a91a42fca7495a248 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.142900  7771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbbdedc18e448da998c67da78c28236" candidate_uuid: "005ee35e74e24295be2b88596986b0e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" is_pre_election: true
W20260709 13:16:38.151722  7588 leader_election.cc:343] T 5bbbdedc18e448da998c67da78c28236 P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:38.152217  7591 leader_election.cc:343] T 5bbbdedc18e448da998c67da78c28236 P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:38.152989  7591 leader_election.cc:304] T 5bbbdedc18e448da998c67da78c28236 P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0; no voters: 256feb60c06e4ccbaeec28266939797e, 7c45cd47cdbf4b93ba0e20539d18b63d
I20260709 13:16:38.142037  7921 tablet_bootstrap.cc:492] T d89180feea324fd3b9f81816e4534626 P 7c45cd47cdbf4b93ba0e20539d18b63d: Bootstrap starting.
I20260709 13:16:38.156044  7624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce78ca96eb4051bfdbf4a94fedb307" candidate_uuid: "256feb60c06e4ccbaeec28266939797e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ee35e74e24295be2b88596986b0e0"
I20260709 13:16:38.157089  7624 raft_consensus.cc:3060] T 5fce78ca96eb4051bfdbf4a94fedb307 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.146191  7623 raft_consensus.cc:2468] T d449aa6b57b3466a91a42fca7495a248 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 256feb60c06e4ccbaeec28266939797e in term 1.
I20260709 13:16:38.147809  7919 consensus_queue.cc:260] T d788207049fe4313a1a8a63815944994 P 256feb60c06e4ccbaeec28266939797e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.162195  7929 raft_consensus.cc:493] T 87d1ab8e509a451b91aaaeffce5e0f94 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.162954  7929 raft_consensus.cc:515] T 87d1ab8e509a451b91aaaeffce5e0f94 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.165239  7919 ts_tablet_manager.cc:1434] T d788207049fe4313a1a8a63815944994 P 256feb60c06e4ccbaeec28266939797e: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:16:38.165740  7929 leader_election.cc:290] T 87d1ab8e509a451b91aaaeffce5e0f94 P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847), 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449)
I20260709 13:16:38.166235  7919 tablet_bootstrap.cc:492] T d89180feea324fd3b9f81816e4534626 P 256feb60c06e4ccbaeec28266939797e: Bootstrap starting.
I20260709 13:16:38.161835  7928 raft_consensus.cc:2749] T 5bbbdedc18e448da998c67da78c28236 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:38.167153  7699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d1ab8e509a451b91aaaeffce5e0f94" candidate_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "256feb60c06e4ccbaeec28266939797e" is_pre_election: true
I20260709 13:16:38.160827  7921 tablet_bootstrap.cc:654] T d89180feea324fd3b9f81816e4534626 P 7c45cd47cdbf4b93ba0e20539d18b63d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.167989  7699 raft_consensus.cc:2468] T 87d1ab8e509a451b91aaaeffce5e0f94 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c45cd47cdbf4b93ba0e20539d18b63d in term 0.
I20260709 13:16:38.168011  7622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d1ab8e509a451b91aaaeffce5e0f94" candidate_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ee35e74e24295be2b88596986b0e0" is_pre_election: true
I20260709 13:16:38.169000  7622 raft_consensus.cc:2468] T 87d1ab8e509a451b91aaaeffce5e0f94 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c45cd47cdbf4b93ba0e20539d18b63d in term 0.
I20260709 13:16:38.170285  7739 leader_election.cc:304] T 87d1ab8e509a451b91aaaeffce5e0f94 P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0, 7c45cd47cdbf4b93ba0e20539d18b63d; no voters: 
I20260709 13:16:38.172358  7920 tablet_bootstrap.cc:492] T d788207049fe4313a1a8a63815944994 P 005ee35e74e24295be2b88596986b0e0: No bootstrap required, opened a new log
I20260709 13:16:38.172945  7920 ts_tablet_manager.cc:1403] T d788207049fe4313a1a8a63815944994 P 005ee35e74e24295be2b88596986b0e0: Time spent bootstrapping tablet: real 0.114s	user 0.042s	sys 0.051s
I20260709 13:16:38.175526  7919 tablet_bootstrap.cc:654] T d89180feea324fd3b9f81816e4534626 P 256feb60c06e4ccbaeec28266939797e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.175738  7929 raft_consensus.cc:2804] T 87d1ab8e509a451b91aaaeffce5e0f94 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:38.176249  7929 raft_consensus.cc:493] T 87d1ab8e509a451b91aaaeffce5e0f94 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.176625  7920 raft_consensus.cc:359] T d788207049fe4313a1a8a63815944994 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.177528  7920 raft_consensus.cc:385] T d788207049fe4313a1a8a63815944994 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.178013  7920 raft_consensus.cc:740] T d788207049fe4313a1a8a63815944994 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ee35e74e24295be2b88596986b0e0, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.178785  7920 consensus_queue.cc:260] T d788207049fe4313a1a8a63815944994 P 005ee35e74e24295be2b88596986b0e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.179284  7774 raft_consensus.cc:2468] T 5fce78ca96eb4051bfdbf4a94fedb307 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 256feb60c06e4ccbaeec28266939797e in term 1.
I20260709 13:16:38.181268  7663 leader_election.cc:304] T 5fce78ca96eb4051bfdbf4a94fedb307 P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 256feb60c06e4ccbaeec28266939797e, 7c45cd47cdbf4b93ba0e20539d18b63d; no voters: 
I20260709 13:16:38.181695  7920 ts_tablet_manager.cc:1434] T d788207049fe4313a1a8a63815944994 P 005ee35e74e24295be2b88596986b0e0: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:16:38.182504  7933 raft_consensus.cc:2804] T 5fce78ca96eb4051bfdbf4a94fedb307 P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:38.183064  7920 tablet_bootstrap.cc:492] T d89180feea324fd3b9f81816e4534626 P 005ee35e74e24295be2b88596986b0e0: Bootstrap starting.
I20260709 13:16:38.182575  7665 leader_election.cc:304] T d449aa6b57b3466a91a42fca7495a248 P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0, 256feb60c06e4ccbaeec28266939797e; no voters: 
I20260709 13:16:38.184144  7905 raft_consensus.cc:2804] T d449aa6b57b3466a91a42fca7495a248 P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:38.186108  7933 raft_consensus.cc:697] T 5fce78ca96eb4051bfdbf4a94fedb307 P 256feb60c06e4ccbaeec28266939797e [term 1 LEADER]: Becoming Leader. State: Replica: 256feb60c06e4ccbaeec28266939797e, State: Running, Role: LEADER
I20260709 13:16:38.187434  7933 consensus_queue.cc:237] T 5fce78ca96eb4051bfdbf4a94fedb307 P 256feb60c06e4ccbaeec28266939797e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.190932  7920 tablet_bootstrap.cc:654] T d89180feea324fd3b9f81816e4534626 P 005ee35e74e24295be2b88596986b0e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.192642  7772 raft_consensus.cc:2468] T d449aa6b57b3466a91a42fca7495a248 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 256feb60c06e4ccbaeec28266939797e in term 1.
I20260709 13:16:38.176612  7929 raft_consensus.cc:3060] T 87d1ab8e509a451b91aaaeffce5e0f94 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.205842  7920 tablet_bootstrap.cc:492] T d89180feea324fd3b9f81816e4534626 P 005ee35e74e24295be2b88596986b0e0: No bootstrap required, opened a new log
I20260709 13:16:38.206583  7920 ts_tablet_manager.cc:1403] T d89180feea324fd3b9f81816e4534626 P 005ee35e74e24295be2b88596986b0e0: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.007s
I20260709 13:16:38.209952  7920 raft_consensus.cc:359] T d89180feea324fd3b9f81816e4534626 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.210718  7920 raft_consensus.cc:385] T d89180feea324fd3b9f81816e4534626 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.211010  7920 raft_consensus.cc:740] T d89180feea324fd3b9f81816e4534626 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ee35e74e24295be2b88596986b0e0, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.212128  7920 consensus_queue.cc:260] T d89180feea324fd3b9f81816e4534626 P 005ee35e74e24295be2b88596986b0e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.212641  7905 raft_consensus.cc:697] T d449aa6b57b3466a91a42fca7495a248 P 256feb60c06e4ccbaeec28266939797e [term 1 LEADER]: Becoming Leader. State: Replica: 256feb60c06e4ccbaeec28266939797e, State: Running, Role: LEADER
I20260709 13:16:38.214434  7920 ts_tablet_manager.cc:1434] T d89180feea324fd3b9f81816e4534626 P 005ee35e74e24295be2b88596986b0e0: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:16:38.214071  7905 consensus_queue.cc:237] T d449aa6b57b3466a91a42fca7495a248 P 256feb60c06e4ccbaeec28266939797e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.217341  7625 raft_consensus.cc:2468] T b7214fe40cbb4728934d178be63cac21 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c45cd47cdbf4b93ba0e20539d18b63d in term 1.
I20260709 13:16:38.221431  7739 leader_election.cc:304] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0, 7c45cd47cdbf4b93ba0e20539d18b63d; no voters: 256feb60c06e4ccbaeec28266939797e
I20260709 13:16:38.221467  7929 raft_consensus.cc:515] T 87d1ab8e509a451b91aaaeffce5e0f94 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.222872  7901 raft_consensus.cc:2804] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:38.225603  7624 raft_consensus.cc:2468] T 5fce78ca96eb4051bfdbf4a94fedb307 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 256feb60c06e4ccbaeec28266939797e in term 1.
I20260709 13:16:38.233146  7929 leader_election.cc:290] T 87d1ab8e509a451b91aaaeffce5e0f94 P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 1 election: Requested vote from peers 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847), 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449)
I20260709 13:16:38.235774  7699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d1ab8e509a451b91aaaeffce5e0f94" candidate_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "256feb60c06e4ccbaeec28266939797e"
I20260709 13:16:38.236860  7699 raft_consensus.cc:3060] T 87d1ab8e509a451b91aaaeffce5e0f94 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.244130  7519 catalog_manager.cc:5697] T 5fce78ca96eb4051bfdbf4a94fedb307 P 256feb60c06e4ccbaeec28266939797e reported cstate change: term changed from 0 to 1, leader changed from <none> to 256feb60c06e4ccbaeec28266939797e (127.27.146.130). New cstate: current_term: 1 leader_uuid: "256feb60c06e4ccbaeec28266939797e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:38.255880  7928 raft_consensus.cc:493] T d89180feea324fd3b9f81816e4534626 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.257122  7928 raft_consensus.cc:515] T d89180feea324fd3b9f81816e4534626 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
W20260709 13:16:38.256091  7571 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:38.262831  7928 leader_election.cc:290] T d89180feea324fd3b9f81816e4534626 P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449), 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071)
I20260709 13:16:38.264006  7928 raft_consensus.cc:493] T d788207049fe4313a1a8a63815944994 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.265039  7928 raft_consensus.cc:515] T d788207049fe4313a1a8a63815944994 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.269047  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d89180feea324fd3b9f81816e4534626" candidate_uuid: "005ee35e74e24295be2b88596986b0e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" is_pre_election: true
I20260709 13:16:38.269505  7700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d89180feea324fd3b9f81816e4534626" candidate_uuid: "005ee35e74e24295be2b88596986b0e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "256feb60c06e4ccbaeec28266939797e" is_pre_election: true
I20260709 13:16:38.270169  7624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d1ab8e509a451b91aaaeffce5e0f94" candidate_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ee35e74e24295be2b88596986b0e0"
W20260709 13:16:38.270637  7588 leader_election.cc:343] T d89180feea324fd3b9f81816e4534626 P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:38.271359  7624 raft_consensus.cc:3060] T 87d1ab8e509a451b91aaaeffce5e0f94 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:38.276670  7591 leader_election.cc:343] T d89180feea324fd3b9f81816e4534626 P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:38.277573  7591 leader_election.cc:304] T d89180feea324fd3b9f81816e4534626 P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0; no voters: 256feb60c06e4ccbaeec28266939797e, 7c45cd47cdbf4b93ba0e20539d18b63d
I20260709 13:16:38.278978  7906 raft_consensus.cc:2749] T d89180feea324fd3b9f81816e4534626 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:38.301203  7933 raft_consensus.cc:493] T d788207049fe4313a1a8a63815944994 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.302042  7933 raft_consensus.cc:515] T d788207049fe4313a1a8a63815944994 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.307039  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d788207049fe4313a1a8a63815944994" candidate_uuid: "005ee35e74e24295be2b88596986b0e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" is_pre_election: true
I20260709 13:16:38.308293  7772 raft_consensus.cc:2468] T d788207049fe4313a1a8a63815944994 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 005ee35e74e24295be2b88596986b0e0 in term 0.
I20260709 13:16:38.310210  7588 leader_election.cc:304] T d788207049fe4313a1a8a63815944994 P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0, 7c45cd47cdbf4b93ba0e20539d18b63d; no voters: 
I20260709 13:16:38.312068  7926 raft_consensus.cc:2804] T d788207049fe4313a1a8a63815944994 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:38.312601  7926 raft_consensus.cc:493] T d788207049fe4313a1a8a63815944994 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.313284  7926 raft_consensus.cc:3060] T d788207049fe4313a1a8a63815944994 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.313861  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d788207049fe4313a1a8a63815944994" candidate_uuid: "256feb60c06e4ccbaeec28266939797e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" is_pre_election: true
I20260709 13:16:38.314963  7774 raft_consensus.cc:2468] T d788207049fe4313a1a8a63815944994 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 256feb60c06e4ccbaeec28266939797e in term 0.
I20260709 13:16:38.316670  7928 leader_election.cc:290] T d788207049fe4313a1a8a63815944994 P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449), 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071)
I20260709 13:16:38.316967  7663 leader_election.cc:304] T d788207049fe4313a1a8a63815944994 P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 256feb60c06e4ccbaeec28266939797e, 7c45cd47cdbf4b93ba0e20539d18b63d; no voters: 
I20260709 13:16:38.318673  7951 raft_consensus.cc:2804] T d788207049fe4313a1a8a63815944994 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:38.319684  7951 raft_consensus.cc:493] T d788207049fe4313a1a8a63815944994 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.320583  7951 raft_consensus.cc:3060] T d788207049fe4313a1a8a63815944994 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.319217  7933 leader_election.cc:290] T d788207049fe4313a1a8a63815944994 P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847), 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071)
I20260709 13:16:38.323626  7901 raft_consensus.cc:697] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 LEADER]: Becoming Leader. State: Replica: 7c45cd47cdbf4b93ba0e20539d18b63d, State: Running, Role: LEADER
I20260709 13:16:38.325147  7901 consensus_queue.cc:237] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.331912  7700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d788207049fe4313a1a8a63815944994" candidate_uuid: "005ee35e74e24295be2b88596986b0e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "256feb60c06e4ccbaeec28266939797e" is_pre_election: true
I20260709 13:16:38.335565  7623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d788207049fe4313a1a8a63815944994" candidate_uuid: "256feb60c06e4ccbaeec28266939797e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ee35e74e24295be2b88596986b0e0" is_pre_election: true
I20260709 13:16:38.342530  7919 tablet_bootstrap.cc:492] T d89180feea324fd3b9f81816e4534626 P 256feb60c06e4ccbaeec28266939797e: No bootstrap required, opened a new log
I20260709 13:16:38.343253  7919 ts_tablet_manager.cc:1403] T d89180feea324fd3b9f81816e4534626 P 256feb60c06e4ccbaeec28266939797e: Time spent bootstrapping tablet: real 0.177s	user 0.064s	sys 0.085s
I20260709 13:16:38.336591  7523 catalog_manager.cc:5697] T d449aa6b57b3466a91a42fca7495a248 P 256feb60c06e4ccbaeec28266939797e reported cstate change: term changed from 0 to 1, leader changed from <none> to 256feb60c06e4ccbaeec28266939797e (127.27.146.130). New cstate: current_term: 1 leader_uuid: "256feb60c06e4ccbaeec28266939797e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:38.347321  7919 raft_consensus.cc:359] T d89180feea324fd3b9f81816e4534626 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.348263  7919 raft_consensus.cc:385] T d89180feea324fd3b9f81816e4534626 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.348610  7919 raft_consensus.cc:740] T d89180feea324fd3b9f81816e4534626 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 256feb60c06e4ccbaeec28266939797e, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.349534  7919 consensus_queue.cc:260] T d89180feea324fd3b9f81816e4534626 P 256feb60c06e4ccbaeec28266939797e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.351960  7919 ts_tablet_manager.cc:1434] T d89180feea324fd3b9f81816e4534626 P 256feb60c06e4ccbaeec28266939797e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:16:38.353176  7919 tablet_bootstrap.cc:492] T 5bbbdedc18e448da998c67da78c28236 P 256feb60c06e4ccbaeec28266939797e: Bootstrap starting.
I20260709 13:16:38.359810  7921 tablet_bootstrap.cc:492] T d89180feea324fd3b9f81816e4534626 P 7c45cd47cdbf4b93ba0e20539d18b63d: No bootstrap required, opened a new log
I20260709 13:16:38.360471  7921 ts_tablet_manager.cc:1403] T d89180feea324fd3b9f81816e4534626 P 7c45cd47cdbf4b93ba0e20539d18b63d: Time spent bootstrapping tablet: real 0.219s	user 0.045s	sys 0.092s
I20260709 13:16:38.361500  7919 tablet_bootstrap.cc:654] T 5bbbdedc18e448da998c67da78c28236 P 256feb60c06e4ccbaeec28266939797e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.366080  7921 raft_consensus.cc:359] T d89180feea324fd3b9f81816e4534626 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.366866  7921 raft_consensus.cc:385] T d89180feea324fd3b9f81816e4534626 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.367120  7921 raft_consensus.cc:740] T d89180feea324fd3b9f81816e4534626 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c45cd47cdbf4b93ba0e20539d18b63d, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.367890  7921 consensus_queue.cc:260] T d89180feea324fd3b9f81816e4534626 P 7c45cd47cdbf4b93ba0e20539d18b63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.373920  7951 raft_consensus.cc:515] T d788207049fe4313a1a8a63815944994 P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.375315  7700 raft_consensus.cc:2393] T d788207049fe4313a1a8a63815944994 P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 005ee35e74e24295be2b88596986b0e0 in current term 1: Already voted for candidate 256feb60c06e4ccbaeec28266939797e in this term.
I20260709 13:16:38.378078  7921 ts_tablet_manager.cc:1434] T d89180feea324fd3b9f81816e4534626 P 7c45cd47cdbf4b93ba0e20539d18b63d: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 13:16:38.379297  7921 tablet_bootstrap.cc:492] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d: Bootstrap starting.
I20260709 13:16:38.379912  7699 raft_consensus.cc:2468] T 87d1ab8e509a451b91aaaeffce5e0f94 P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c45cd47cdbf4b93ba0e20539d18b63d in term 1.
I20260709 13:16:38.381341  7740 leader_election.cc:304] T 87d1ab8e509a451b91aaaeffce5e0f94 P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 256feb60c06e4ccbaeec28266939797e, 7c45cd47cdbf4b93ba0e20539d18b63d; no voters: 
I20260709 13:16:38.382344  7901 raft_consensus.cc:2804] T 87d1ab8e509a451b91aaaeffce5e0f94 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:38.383216  7901 raft_consensus.cc:697] T 87d1ab8e509a451b91aaaeffce5e0f94 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 LEADER]: Becoming Leader. State: Replica: 7c45cd47cdbf4b93ba0e20539d18b63d, State: Running, Role: LEADER
I20260709 13:16:38.379130  7523 catalog_manager.cc:5697] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131). New cstate: current_term: 1 leader_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:38.386886  7921 tablet_bootstrap.cc:654] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.384423  7901 consensus_queue.cc:237] T 87d1ab8e509a451b91aaaeffce5e0f94 P 7c45cd47cdbf4b93ba0e20539d18b63d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.389034  7951 leader_election.cc:290] T d788207049fe4313a1a8a63815944994 P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 1 election: Requested vote from peers 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847), 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071)
I20260709 13:16:38.396908  7624 raft_consensus.cc:2468] T 87d1ab8e509a451b91aaaeffce5e0f94 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c45cd47cdbf4b93ba0e20539d18b63d in term 1.
I20260709 13:16:38.400180  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d788207049fe4313a1a8a63815944994" candidate_uuid: "256feb60c06e4ccbaeec28266939797e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d"
I20260709 13:16:38.401196  7772 raft_consensus.cc:3060] T d788207049fe4313a1a8a63815944994 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.404551  7926 raft_consensus.cc:515] T d788207049fe4313a1a8a63815944994 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.406631  7623 raft_consensus.cc:2393] T d788207049fe4313a1a8a63815944994 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 256feb60c06e4ccbaeec28266939797e in current term 1: Already voted for candidate 005ee35e74e24295be2b88596986b0e0 in this term.
I20260709 13:16:38.410844  7624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d788207049fe4313a1a8a63815944994" candidate_uuid: "256feb60c06e4ccbaeec28266939797e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ee35e74e24295be2b88596986b0e0"
I20260709 13:16:38.416355  7699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d788207049fe4313a1a8a63815944994" candidate_uuid: "005ee35e74e24295be2b88596986b0e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "256feb60c06e4ccbaeec28266939797e"
I20260709 13:16:38.417717  7699 raft_consensus.cc:2393] T d788207049fe4313a1a8a63815944994 P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 005ee35e74e24295be2b88596986b0e0 in current term 1: Already voted for candidate 256feb60c06e4ccbaeec28266939797e in this term.
I20260709 13:16:38.422565  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d788207049fe4313a1a8a63815944994" candidate_uuid: "005ee35e74e24295be2b88596986b0e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d"
I20260709 13:16:38.425993  7588 leader_election.cc:304] T d788207049fe4313a1a8a63815944994 P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0; no voters: 256feb60c06e4ccbaeec28266939797e, 7c45cd47cdbf4b93ba0e20539d18b63d
I20260709 13:16:38.427572  7928 raft_consensus.cc:2749] T d788207049fe4313a1a8a63815944994 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:38.429033  7926 leader_election.cc:290] T d788207049fe4313a1a8a63815944994 P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 1 election: Requested vote from peers 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449), 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071)
I20260709 13:16:38.433774  7921 tablet_bootstrap.cc:492] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d: No bootstrap required, opened a new log
I20260709 13:16:38.434496  7921 ts_tablet_manager.cc:1403] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d: Time spent bootstrapping tablet: real 0.055s	user 0.032s	sys 0.020s
I20260709 13:16:38.438442  7921 raft_consensus.cc:359] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.439749  7921 raft_consensus.cc:385] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.440085  7921 raft_consensus.cc:740] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c45cd47cdbf4b93ba0e20539d18b63d, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.440896  7921 consensus_queue.cc:260] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.443217  7921 ts_tablet_manager.cc:1434] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:16:38.447956  7901 consensus_queue.cc:1048] T d57f28fe65ad4a5f87539791fad21572 P 7c45cd47cdbf4b93ba0e20539d18b63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:38.449230  7772 raft_consensus.cc:2468] T d788207049fe4313a1a8a63815944994 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 256feb60c06e4ccbaeec28266939797e in term 1.
I20260709 13:16:38.451725  7663 leader_election.cc:304] T d788207049fe4313a1a8a63815944994 P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 256feb60c06e4ccbaeec28266939797e, 7c45cd47cdbf4b93ba0e20539d18b63d; no voters: 005ee35e74e24295be2b88596986b0e0
I20260709 13:16:38.451967  7522 catalog_manager.cc:5697] T 87d1ab8e509a451b91aaaeffce5e0f94 P 7c45cd47cdbf4b93ba0e20539d18b63d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131). New cstate: current_term: 1 leader_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:38.453469  7919 tablet_bootstrap.cc:492] T 5bbbdedc18e448da998c67da78c28236 P 256feb60c06e4ccbaeec28266939797e: No bootstrap required, opened a new log
I20260709 13:16:38.454051  7919 ts_tablet_manager.cc:1403] T 5bbbdedc18e448da998c67da78c28236 P 256feb60c06e4ccbaeec28266939797e: Time spent bootstrapping tablet: real 0.101s	user 0.037s	sys 0.059s
I20260709 13:16:38.452906  7951 raft_consensus.cc:2804] T d788207049fe4313a1a8a63815944994 P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:38.454831  7951 raft_consensus.cc:697] T d788207049fe4313a1a8a63815944994 P 256feb60c06e4ccbaeec28266939797e [term 1 LEADER]: Becoming Leader. State: Replica: 256feb60c06e4ccbaeec28266939797e, State: Running, Role: LEADER
I20260709 13:16:38.455787  7951 consensus_queue.cc:237] T d788207049fe4313a1a8a63815944994 P 256feb60c06e4ccbaeec28266939797e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.458235  7901 consensus_queue.cc:1048] T d57f28fe65ad4a5f87539791fad21572 P 7c45cd47cdbf4b93ba0e20539d18b63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:38.459092  7919 raft_consensus.cc:359] T 5bbbdedc18e448da998c67da78c28236 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.459980  7919 raft_consensus.cc:385] T 5bbbdedc18e448da998c67da78c28236 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.460337  7919 raft_consensus.cc:740] T 5bbbdedc18e448da998c67da78c28236 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 256feb60c06e4ccbaeec28266939797e, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.461128  7919 consensus_queue.cc:260] T 5bbbdedc18e448da998c67da78c28236 P 256feb60c06e4ccbaeec28266939797e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.465026  7919 ts_tablet_manager.cc:1434] T 5bbbdedc18e448da998c67da78c28236 P 256feb60c06e4ccbaeec28266939797e: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:16:38.467053  7919 tablet_bootstrap.cc:492] T b7214fe40cbb4728934d178be63cac21 P 256feb60c06e4ccbaeec28266939797e: Bootstrap starting.
I20260709 13:16:38.476823  7919 tablet_bootstrap.cc:654] T b7214fe40cbb4728934d178be63cac21 P 256feb60c06e4ccbaeec28266939797e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:38.482843  7901 raft_consensus.cc:493] T d89180feea324fd3b9f81816e4534626 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.483618  7901 raft_consensus.cc:515] T d89180feea324fd3b9f81816e4534626 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.488189  7919 tablet_bootstrap.cc:492] T b7214fe40cbb4728934d178be63cac21 P 256feb60c06e4ccbaeec28266939797e: No bootstrap required, opened a new log
I20260709 13:16:38.488857  7919 ts_tablet_manager.cc:1403] T b7214fe40cbb4728934d178be63cac21 P 256feb60c06e4ccbaeec28266939797e: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.013s
I20260709 13:16:38.489063  7901 leader_election.cc:290] T d89180feea324fd3b9f81816e4534626 P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847), 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449)
I20260709 13:16:38.491568  7700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d89180feea324fd3b9f81816e4534626" candidate_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "256feb60c06e4ccbaeec28266939797e" is_pre_election: true
I20260709 13:16:38.492355  7700 raft_consensus.cc:2468] T d89180feea324fd3b9f81816e4534626 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c45cd47cdbf4b93ba0e20539d18b63d in term 0.
I20260709 13:16:38.492362  7919 raft_consensus.cc:359] T b7214fe40cbb4728934d178be63cac21 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.493281  7919 raft_consensus.cc:385] T b7214fe40cbb4728934d178be63cac21 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:38.493588  7919 raft_consensus.cc:740] T b7214fe40cbb4728934d178be63cac21 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 256feb60c06e4ccbaeec28266939797e, State: Initialized, Role: FOLLOWER
I20260709 13:16:38.494427  7919 consensus_queue.cc:260] T b7214fe40cbb4728934d178be63cac21 P 256feb60c06e4ccbaeec28266939797e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.497221  7919 ts_tablet_manager.cc:1434] T b7214fe40cbb4728934d178be63cac21 P 256feb60c06e4ccbaeec28266939797e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:16:38.497110  7623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d89180feea324fd3b9f81816e4534626" candidate_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ee35e74e24295be2b88596986b0e0" is_pre_election: true
I20260709 13:16:38.498065  7623 raft_consensus.cc:2468] T d89180feea324fd3b9f81816e4534626 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c45cd47cdbf4b93ba0e20539d18b63d in term 0.
I20260709 13:16:38.499123  7740 leader_election.cc:304] T d89180feea324fd3b9f81816e4534626 P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 256feb60c06e4ccbaeec28266939797e, 7c45cd47cdbf4b93ba0e20539d18b63d; no voters: 
I20260709 13:16:38.501534  7901 raft_consensus.cc:2804] T d89180feea324fd3b9f81816e4534626 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:38.501968  7901 raft_consensus.cc:493] T d89180feea324fd3b9f81816e4534626 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.502280  7901 raft_consensus.cc:3060] T d89180feea324fd3b9f81816e4534626 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.518285  7901 raft_consensus.cc:515] T d89180feea324fd3b9f81816e4534626 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.522107  7624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d89180feea324fd3b9f81816e4534626" candidate_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ee35e74e24295be2b88596986b0e0"
I20260709 13:16:38.522840  7624 raft_consensus.cc:3060] T d89180feea324fd3b9f81816e4534626 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.528056  7901 leader_election.cc:290] T d89180feea324fd3b9f81816e4534626 P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 1 election: Requested vote from peers 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847), 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449)
I20260709 13:16:38.530869  7699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d89180feea324fd3b9f81816e4534626" candidate_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "256feb60c06e4ccbaeec28266939797e"
I20260709 13:16:38.531669  7699 raft_consensus.cc:3060] T d89180feea324fd3b9f81816e4534626 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.539729  7522 catalog_manager.cc:5697] T d788207049fe4313a1a8a63815944994 P 256feb60c06e4ccbaeec28266939797e reported cstate change: term changed from 0 to 1, leader changed from <none> to 256feb60c06e4ccbaeec28266939797e (127.27.146.130). New cstate: current_term: 1 leader_uuid: "256feb60c06e4ccbaeec28266939797e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:38.541388  7699 raft_consensus.cc:2468] T d89180feea324fd3b9f81816e4534626 P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c45cd47cdbf4b93ba0e20539d18b63d in term 1.
I20260709 13:16:38.543035  7740 leader_election.cc:304] T d89180feea324fd3b9f81816e4534626 P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 256feb60c06e4ccbaeec28266939797e, 7c45cd47cdbf4b93ba0e20539d18b63d; no voters: 
I20260709 13:16:38.543913  7901 raft_consensus.cc:2804] T d89180feea324fd3b9f81816e4534626 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:38.544302  7624 raft_consensus.cc:2468] T d89180feea324fd3b9f81816e4534626 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c45cd47cdbf4b93ba0e20539d18b63d in term 1.
I20260709 13:16:38.544494  7901 raft_consensus.cc:697] T d89180feea324fd3b9f81816e4534626 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 LEADER]: Becoming Leader. State: Replica: 7c45cd47cdbf4b93ba0e20539d18b63d, State: Running, Role: LEADER
I20260709 13:16:38.546177  7901 consensus_queue.cc:237] T d89180feea324fd3b9f81816e4534626 P 7c45cd47cdbf4b93ba0e20539d18b63d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.556403  7522 catalog_manager.cc:5697] T d89180feea324fd3b9f81816e4534626 P 7c45cd47cdbf4b93ba0e20539d18b63d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131). New cstate: current_term: 1 leader_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:38.607735  7926 consensus_queue.cc:1048] T f2e32ae678174dc580caa70ad1407376 P 005ee35e74e24295be2b88596986b0e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:38.624389  7928 consensus_queue.cc:1048] T f2e32ae678174dc580caa70ad1407376 P 005ee35e74e24295be2b88596986b0e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:38.675554  7951 consensus_queue.cc:1048] T d449aa6b57b3466a91a42fca7495a248 P 256feb60c06e4ccbaeec28266939797e [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:38.677069  7933 consensus_queue.cc:1048] T d449aa6b57b3466a91a42fca7495a248 P 256feb60c06e4ccbaeec28266939797e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:38.701126  7933 consensus_queue.cc:1048] T 5fce78ca96eb4051bfdbf4a94fedb307 P 256feb60c06e4ccbaeec28266939797e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:38.716357  7933 consensus_queue.cc:1048] T 5fce78ca96eb4051bfdbf4a94fedb307 P 256feb60c06e4ccbaeec28266939797e [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:38.786458  7901 consensus_queue.cc:1048] T 87d1ab8e509a451b91aaaeffce5e0f94 P 7c45cd47cdbf4b93ba0e20539d18b63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:38.801115  7955 consensus_queue.cc:1048] T 87d1ab8e509a451b91aaaeffce5e0f94 P 7c45cd47cdbf4b93ba0e20539d18b63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:38.834784  7901 consensus_queue.cc:1048] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:38.836023  7955 raft_consensus.cc:493] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.836755  7955 raft_consensus.cc:515] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.839613  7955 leader_election.cc:290] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847), 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449)
I20260709 13:16:38.840831  7623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbbdedc18e448da998c67da78c28236" candidate_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ee35e74e24295be2b88596986b0e0" is_pre_election: true
I20260709 13:16:38.841640  7623 raft_consensus.cc:2468] T 5bbbdedc18e448da998c67da78c28236 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c45cd47cdbf4b93ba0e20539d18b63d in term 0.
I20260709 13:16:38.840986  7699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbbdedc18e448da998c67da78c28236" candidate_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "256feb60c06e4ccbaeec28266939797e" is_pre_election: true
I20260709 13:16:38.842867  7699 raft_consensus.cc:2468] T 5bbbdedc18e448da998c67da78c28236 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c45cd47cdbf4b93ba0e20539d18b63d in term 0.
I20260709 13:16:38.843261  7739 leader_election.cc:304] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0, 7c45cd47cdbf4b93ba0e20539d18b63d; no voters: 
I20260709 13:16:38.844477  7955 raft_consensus.cc:2804] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:38.844861  7955 raft_consensus.cc:493] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.845237  7955 raft_consensus.cc:3060] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.856951  7699 raft_consensus.cc:3060] T b7214fe40cbb4728934d178be63cac21 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.858031  7953 consensus_queue.cc:1048] T d788207049fe4313a1a8a63815944994 P 256feb60c06e4ccbaeec28266939797e [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:38.859026  7955 raft_consensus.cc:515] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.863080  7955 leader_election.cc:290] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 1 election: Requested vote from peers 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847), 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449)
I20260709 13:16:38.864117  7625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbbdedc18e448da998c67da78c28236" candidate_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "005ee35e74e24295be2b88596986b0e0"
I20260709 13:16:38.864372  7700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbbdedc18e448da998c67da78c28236" candidate_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "256feb60c06e4ccbaeec28266939797e"
I20260709 13:16:38.864953  7625 raft_consensus.cc:3060] T 5bbbdedc18e448da998c67da78c28236 P 005ee35e74e24295be2b88596986b0e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.865092  7700 raft_consensus.cc:3060] T 5bbbdedc18e448da998c67da78c28236 P 256feb60c06e4ccbaeec28266939797e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:38.872265  7955 consensus_queue.cc:1048] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:38.875007  7700 raft_consensus.cc:2468] T 5bbbdedc18e448da998c67da78c28236 P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c45cd47cdbf4b93ba0e20539d18b63d in term 1.
I20260709 13:16:38.881633  7625 raft_consensus.cc:2468] T 5bbbdedc18e448da998c67da78c28236 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c45cd47cdbf4b93ba0e20539d18b63d in term 1.
I20260709 13:16:38.883876  7739 leader_election.cc:304] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0, 7c45cd47cdbf4b93ba0e20539d18b63d; no voters: 
I20260709 13:16:38.885728  7955 raft_consensus.cc:2804] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:38.886277  7955 raft_consensus.cc:697] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 LEADER]: Becoming Leader. State: Replica: 7c45cd47cdbf4b93ba0e20539d18b63d, State: Running, Role: LEADER
I20260709 13:16:38.887179  7955 consensus_queue.cc:237] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:38.897154  7933 consensus_queue.cc:1048] T d788207049fe4313a1a8a63815944994 P 256feb60c06e4ccbaeec28266939797e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:38.910816  7519 catalog_manager.cc:5697] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131). New cstate: current_term: 1 leader_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:38.932765  7772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d57f28fe65ad4a5f87539791fad21572"
dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d"
mode: GRACEFUL
new_leader_uuid: "005ee35e74e24295be2b88596986b0e0"
 from {username='slave'} at 127.0.0.1:41154
I20260709 13:16:38.933447  7772 raft_consensus.cc:606] T d57f28fe65ad4a5f87539791fad21572 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 LEADER]: Received request to transfer leadership to TS 005ee35e74e24295be2b88596986b0e0
I20260709 13:16:38.939618  7699 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fce78ca96eb4051bfdbf4a94fedb307"
dest_uuid: "256feb60c06e4ccbaeec28266939797e"
mode: GRACEFUL
new_leader_uuid: "005ee35e74e24295be2b88596986b0e0"
 from {username='slave'} at 127.0.0.1:54272
I20260709 13:16:38.940282  7699 raft_consensus.cc:606] T 5fce78ca96eb4051bfdbf4a94fedb307 P 256feb60c06e4ccbaeec28266939797e [term 1 LEADER]: Received request to transfer leadership to TS 005ee35e74e24295be2b88596986b0e0
I20260709 13:16:38.947480  7699 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d449aa6b57b3466a91a42fca7495a248"
dest_uuid: "256feb60c06e4ccbaeec28266939797e"
mode: GRACEFUL
new_leader_uuid: "005ee35e74e24295be2b88596986b0e0"
 from {username='slave'} at 127.0.0.1:54272
I20260709 13:16:38.948181  7699 raft_consensus.cc:606] T d449aa6b57b3466a91a42fca7495a248 P 256feb60c06e4ccbaeec28266939797e [term 1 LEADER]: Received request to transfer leadership to TS 005ee35e74e24295be2b88596986b0e0
I20260709 13:16:38.954500  7772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7214fe40cbb4728934d178be63cac21"
dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d"
mode: GRACEFUL
new_leader_uuid: "005ee35e74e24295be2b88596986b0e0"
 from {username='slave'} at 127.0.0.1:41154
I20260709 13:16:38.955142  7772 raft_consensus.cc:606] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 LEADER]: Received request to transfer leadership to TS 005ee35e74e24295be2b88596986b0e0
I20260709 13:16:38.962461  7623 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2e32ae678174dc580caa70ad1407376"
dest_uuid: "005ee35e74e24295be2b88596986b0e0"
mode: GRACEFUL
new_leader_uuid: "256feb60c06e4ccbaeec28266939797e"
 from {username='slave'} at 127.0.0.1:41228
I20260709 13:16:38.963295  7623 raft_consensus.cc:606] T f2e32ae678174dc580caa70ad1407376 P 005ee35e74e24295be2b88596986b0e0 [term 1 LEADER]: Received request to transfer leadership to TS 256feb60c06e4ccbaeec28266939797e
I20260709 13:16:38.970439  7772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87d1ab8e509a451b91aaaeffce5e0f94"
dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d"
mode: GRACEFUL
new_leader_uuid: "256feb60c06e4ccbaeec28266939797e"
 from {username='slave'} at 127.0.0.1:41154
I20260709 13:16:38.971084  7772 raft_consensus.cc:606] T 87d1ab8e509a451b91aaaeffce5e0f94 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 LEADER]: Received request to transfer leadership to TS 256feb60c06e4ccbaeec28266939797e
I20260709 13:16:38.980962  7772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5bbbdedc18e448da998c67da78c28236"
dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d"
mode: GRACEFUL
new_leader_uuid: "256feb60c06e4ccbaeec28266939797e"
 from {username='slave'} at 127.0.0.1:41154
I20260709 13:16:38.981684  7772 raft_consensus.cc:606] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 LEADER]: Received request to transfer leadership to TS 256feb60c06e4ccbaeec28266939797e
I20260709 13:16:39.136137  7955 consensus_queue.cc:1048] T d89180feea324fd3b9f81816e4534626 P 7c45cd47cdbf4b93ba0e20539d18b63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:39.142614  7933 raft_consensus.cc:993] T 5fce78ca96eb4051bfdbf4a94fedb307 P 256feb60c06e4ccbaeec28266939797e: : Instructing follower 005ee35e74e24295be2b88596986b0e0 to start an election
I20260709 13:16:39.143577  7951 raft_consensus.cc:1081] T 5fce78ca96eb4051bfdbf4a94fedb307 P 256feb60c06e4ccbaeec28266939797e [term 1 LEADER]: Signalling peer 005ee35e74e24295be2b88596986b0e0 to start an election
I20260709 13:16:39.145893  7623 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5fce78ca96eb4051bfdbf4a94fedb307"
dest_uuid: "005ee35e74e24295be2b88596986b0e0"
 from {username='slave'} at 127.0.0.1:41216
I20260709 13:16:39.146595  7623 raft_consensus.cc:493] T 5fce78ca96eb4051bfdbf4a94fedb307 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:39.147027  7623 raft_consensus.cc:3060] T 5fce78ca96eb4051bfdbf4a94fedb307 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:39.153236  7955 consensus_queue.cc:1048] T d89180feea324fd3b9f81816e4534626 P 7c45cd47cdbf4b93ba0e20539d18b63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:39.162949  7623 raft_consensus.cc:515] T 5fce78ca96eb4051bfdbf4a94fedb307 P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:39.166098  7623 leader_election.cc:290] T 5fce78ca96eb4051bfdbf4a94fedb307 P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 2 election: Requested vote from peers 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449), 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071)
I20260709 13:16:39.166769  7699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce78ca96eb4051bfdbf4a94fedb307" candidate_uuid: "005ee35e74e24295be2b88596986b0e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "256feb60c06e4ccbaeec28266939797e"
I20260709 13:16:39.167543  7699 raft_consensus.cc:3055] T 5fce78ca96eb4051bfdbf4a94fedb307 P 256feb60c06e4ccbaeec28266939797e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:39.167907  7699 raft_consensus.cc:740] T 5fce78ca96eb4051bfdbf4a94fedb307 P 256feb60c06e4ccbaeec28266939797e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 256feb60c06e4ccbaeec28266939797e, State: Running, Role: LEADER
I20260709 13:16:39.169071  7699 consensus_queue.cc:260] T 5fce78ca96eb4051bfdbf4a94fedb307 P 256feb60c06e4ccbaeec28266939797e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:39.170620  7699 raft_consensus.cc:3060] T 5fce78ca96eb4051bfdbf4a94fedb307 P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:39.171404  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce78ca96eb4051bfdbf4a94fedb307" candidate_uuid: "005ee35e74e24295be2b88596986b0e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d"
I20260709 13:16:39.172191  7772 raft_consensus.cc:3060] T 5fce78ca96eb4051bfdbf4a94fedb307 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:39.178824  7699 raft_consensus.cc:2468] T 5fce78ca96eb4051bfdbf4a94fedb307 P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ee35e74e24295be2b88596986b0e0 in term 2.
I20260709 13:16:39.179278  7772 raft_consensus.cc:2468] T 5fce78ca96eb4051bfdbf4a94fedb307 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ee35e74e24295be2b88596986b0e0 in term 2.
I20260709 13:16:39.180315  7591 leader_election.cc:304] T 5fce78ca96eb4051bfdbf4a94fedb307 P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0, 256feb60c06e4ccbaeec28266939797e; no voters: 
I20260709 13:16:39.181267  7926 raft_consensus.cc:2804] T 5fce78ca96eb4051bfdbf4a94fedb307 P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:39.182826  7926 raft_consensus.cc:697] T 5fce78ca96eb4051bfdbf4a94fedb307 P 005ee35e74e24295be2b88596986b0e0 [term 2 LEADER]: Becoming Leader. State: Replica: 005ee35e74e24295be2b88596986b0e0, State: Running, Role: LEADER
I20260709 13:16:39.183856  7926 consensus_queue.cc:237] T 5fce78ca96eb4051bfdbf4a94fedb307 P 005ee35e74e24295be2b88596986b0e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:39.191970  7519 catalog_manager.cc:5697] T 5fce78ca96eb4051bfdbf4a94fedb307 P 005ee35e74e24295be2b88596986b0e0 reported cstate change: term changed from 1 to 2, leader changed from 256feb60c06e4ccbaeec28266939797e (127.27.146.130) to 005ee35e74e24295be2b88596986b0e0 (127.27.146.129). New cstate: current_term: 2 leader_uuid: "005ee35e74e24295be2b88596986b0e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:39.246228  7987 raft_consensus.cc:993] T f2e32ae678174dc580caa70ad1407376 P 005ee35e74e24295be2b88596986b0e0: : Instructing follower 256feb60c06e4ccbaeec28266939797e to start an election
I20260709 13:16:39.246852  7988 raft_consensus.cc:1081] T f2e32ae678174dc580caa70ad1407376 P 005ee35e74e24295be2b88596986b0e0 [term 1 LEADER]: Signalling peer 256feb60c06e4ccbaeec28266939797e to start an election
I20260709 13:16:39.248564  7699 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f2e32ae678174dc580caa70ad1407376"
dest_uuid: "256feb60c06e4ccbaeec28266939797e"
 from {username='slave'} at 127.0.0.1:54264
I20260709 13:16:39.249069  7699 raft_consensus.cc:493] T f2e32ae678174dc580caa70ad1407376 P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:39.249522  7699 raft_consensus.cc:3060] T f2e32ae678174dc580caa70ad1407376 P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:39.255806  7699 raft_consensus.cc:515] T f2e32ae678174dc580caa70ad1407376 P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:39.257598  7699 leader_election.cc:290] T f2e32ae678174dc580caa70ad1407376 P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 2 election: Requested vote from peers 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847), 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071)
I20260709 13:16:39.258661  7625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e32ae678174dc580caa70ad1407376" candidate_uuid: "256feb60c06e4ccbaeec28266939797e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "005ee35e74e24295be2b88596986b0e0"
I20260709 13:16:39.259083  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e32ae678174dc580caa70ad1407376" candidate_uuid: "256feb60c06e4ccbaeec28266939797e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d"
I20260709 13:16:39.259299  7625 raft_consensus.cc:3055] T f2e32ae678174dc580caa70ad1407376 P 005ee35e74e24295be2b88596986b0e0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:39.259714  7772 raft_consensus.cc:3060] T f2e32ae678174dc580caa70ad1407376 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:39.259717  7625 raft_consensus.cc:740] T f2e32ae678174dc580caa70ad1407376 P 005ee35e74e24295be2b88596986b0e0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 005ee35e74e24295be2b88596986b0e0, State: Running, Role: LEADER
I20260709 13:16:39.260841  7625 consensus_queue.cc:260] T f2e32ae678174dc580caa70ad1407376 P 005ee35e74e24295be2b88596986b0e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:39.262208  7625 raft_consensus.cc:3060] T f2e32ae678174dc580caa70ad1407376 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:39.265149  7933 raft_consensus.cc:993] T d449aa6b57b3466a91a42fca7495a248 P 256feb60c06e4ccbaeec28266939797e: : Instructing follower 005ee35e74e24295be2b88596986b0e0 to start an election
I20260709 13:16:39.265810  7933 raft_consensus.cc:1081] T d449aa6b57b3466a91a42fca7495a248 P 256feb60c06e4ccbaeec28266939797e [term 1 LEADER]: Signalling peer 005ee35e74e24295be2b88596986b0e0 to start an election
I20260709 13:16:39.268745  7772 raft_consensus.cc:2468] T f2e32ae678174dc580caa70ad1407376 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 256feb60c06e4ccbaeec28266939797e in term 2.
I20260709 13:16:39.270157  7663 leader_election.cc:304] T f2e32ae678174dc580caa70ad1407376 P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 256feb60c06e4ccbaeec28266939797e, 7c45cd47cdbf4b93ba0e20539d18b63d; no voters: 
I20260709 13:16:39.270361  7623 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d449aa6b57b3466a91a42fca7495a248"
dest_uuid: "005ee35e74e24295be2b88596986b0e0"
 from {username='slave'} at 127.0.0.1:41216
I20260709 13:16:39.271050  7623 raft_consensus.cc:493] T d449aa6b57b3466a91a42fca7495a248 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:39.271108  7951 raft_consensus.cc:2804] T f2e32ae678174dc580caa70ad1407376 P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:39.271586  7623 raft_consensus.cc:3060] T d449aa6b57b3466a91a42fca7495a248 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:39.272035  7951 raft_consensus.cc:697] T f2e32ae678174dc580caa70ad1407376 P 256feb60c06e4ccbaeec28266939797e [term 2 LEADER]: Becoming Leader. State: Replica: 256feb60c06e4ccbaeec28266939797e, State: Running, Role: LEADER
I20260709 13:16:39.271533  7625 raft_consensus.cc:2468] T f2e32ae678174dc580caa70ad1407376 P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 256feb60c06e4ccbaeec28266939797e in term 2.
I20260709 13:16:39.273015  7951 consensus_queue.cc:237] T f2e32ae678174dc580caa70ad1407376 P 256feb60c06e4ccbaeec28266939797e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:39.279525  7623 raft_consensus.cc:515] T d449aa6b57b3466a91a42fca7495a248 P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:39.282958  7699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d449aa6b57b3466a91a42fca7495a248" candidate_uuid: "005ee35e74e24295be2b88596986b0e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "256feb60c06e4ccbaeec28266939797e"
I20260709 13:16:39.283699  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d449aa6b57b3466a91a42fca7495a248" candidate_uuid: "005ee35e74e24295be2b88596986b0e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d"
I20260709 13:16:39.283737  7699 raft_consensus.cc:3055] T d449aa6b57b3466a91a42fca7495a248 P 256feb60c06e4ccbaeec28266939797e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:39.284466  7772 raft_consensus.cc:3060] T d449aa6b57b3466a91a42fca7495a248 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:39.284713  7699 raft_consensus.cc:740] T d449aa6b57b3466a91a42fca7495a248 P 256feb60c06e4ccbaeec28266939797e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 256feb60c06e4ccbaeec28266939797e, State: Running, Role: LEADER
I20260709 13:16:39.287632  7623 leader_election.cc:290] T d449aa6b57b3466a91a42fca7495a248 P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 2 election: Requested vote from peers 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449), 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071)
I20260709 13:16:39.285843  7699 consensus_queue.cc:260] T d449aa6b57b3466a91a42fca7495a248 P 256feb60c06e4ccbaeec28266939797e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:39.289039  7699 raft_consensus.cc:3060] T d449aa6b57b3466a91a42fca7495a248 P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:39.291862  7519 catalog_manager.cc:5697] T f2e32ae678174dc580caa70ad1407376 P 256feb60c06e4ccbaeec28266939797e reported cstate change: term changed from 1 to 2, leader changed from 005ee35e74e24295be2b88596986b0e0 (127.27.146.129) to 256feb60c06e4ccbaeec28266939797e (127.27.146.130). New cstate: current_term: 2 leader_uuid: "256feb60c06e4ccbaeec28266939797e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:39.294492  7772 raft_consensus.cc:2468] T d449aa6b57b3466a91a42fca7495a248 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ee35e74e24295be2b88596986b0e0 in term 2.
I20260709 13:16:39.295841  7588 leader_election.cc:304] T d449aa6b57b3466a91a42fca7495a248 P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0, 7c45cd47cdbf4b93ba0e20539d18b63d; no voters: 
I20260709 13:16:39.296802  7988 raft_consensus.cc:2804] T d449aa6b57b3466a91a42fca7495a248 P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:39.297271  7988 raft_consensus.cc:697] T d449aa6b57b3466a91a42fca7495a248 P 005ee35e74e24295be2b88596986b0e0 [term 2 LEADER]: Becoming Leader. State: Replica: 005ee35e74e24295be2b88596986b0e0, State: Running, Role: LEADER
I20260709 13:16:39.298072  7988 consensus_queue.cc:237] T d449aa6b57b3466a91a42fca7495a248 P 005ee35e74e24295be2b88596986b0e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:39.298954  7699 raft_consensus.cc:2468] T d449aa6b57b3466a91a42fca7495a248 P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ee35e74e24295be2b88596986b0e0 in term 2.
I20260709 13:16:39.301540  7901 raft_consensus.cc:993] T d57f28fe65ad4a5f87539791fad21572 P 7c45cd47cdbf4b93ba0e20539d18b63d: : Instructing follower 005ee35e74e24295be2b88596986b0e0 to start an election
I20260709 13:16:39.302021  7968 raft_consensus.cc:1081] T d57f28fe65ad4a5f87539791fad21572 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 LEADER]: Signalling peer 005ee35e74e24295be2b88596986b0e0 to start an election
I20260709 13:16:39.304456  7623 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d57f28fe65ad4a5f87539791fad21572"
dest_uuid: "005ee35e74e24295be2b88596986b0e0"
 from {username='slave'} at 127.0.0.1:41220
I20260709 13:16:39.305076  7623 raft_consensus.cc:493] T d57f28fe65ad4a5f87539791fad21572 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:39.305485  7623 raft_consensus.cc:3060] T d57f28fe65ad4a5f87539791fad21572 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:39.313601  7901 raft_consensus.cc:993] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d: : Instructing follower 005ee35e74e24295be2b88596986b0e0 to start an election
I20260709 13:16:39.314379  7929 raft_consensus.cc:1081] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 LEADER]: Signalling peer 005ee35e74e24295be2b88596986b0e0 to start an election
I20260709 13:16:39.316460  7625 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b7214fe40cbb4728934d178be63cac21"
dest_uuid: "005ee35e74e24295be2b88596986b0e0"
 from {username='slave'} at 127.0.0.1:41220
I20260709 13:16:39.316092  7522 catalog_manager.cc:5697] T d449aa6b57b3466a91a42fca7495a248 P 005ee35e74e24295be2b88596986b0e0 reported cstate change: term changed from 1 to 2, leader changed from 256feb60c06e4ccbaeec28266939797e (127.27.146.130) to 005ee35e74e24295be2b88596986b0e0 (127.27.146.129). New cstate: current_term: 2 leader_uuid: "005ee35e74e24295be2b88596986b0e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:39.317085  7625 raft_consensus.cc:493] T b7214fe40cbb4728934d178be63cac21 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:39.317513  7625 raft_consensus.cc:3060] T b7214fe40cbb4728934d178be63cac21 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:39.320174  7623 raft_consensus.cc:515] T d57f28fe65ad4a5f87539791fad21572 P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:39.324270  7772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57f28fe65ad4a5f87539791fad21572" candidate_uuid: "005ee35e74e24295be2b88596986b0e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d"
I20260709 13:16:39.324908  7772 raft_consensus.cc:3055] T d57f28fe65ad4a5f87539791fad21572 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:39.324990  7623 leader_election.cc:290] T d57f28fe65ad4a5f87539791fad21572 P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 2 election: Requested vote from peers 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449), 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071)
I20260709 13:16:39.325405  7772 raft_consensus.cc:740] T d57f28fe65ad4a5f87539791fad21572 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c45cd47cdbf4b93ba0e20539d18b63d, State: Running, Role: LEADER
I20260709 13:16:39.326447  7901 raft_consensus.cc:993] T 87d1ab8e509a451b91aaaeffce5e0f94 P 7c45cd47cdbf4b93ba0e20539d18b63d: : Instructing follower 256feb60c06e4ccbaeec28266939797e to start an election
I20260709 13:16:39.327471  7901 raft_consensus.cc:1081] T 87d1ab8e509a451b91aaaeffce5e0f94 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 LEADER]: Signalling peer 256feb60c06e4ccbaeec28266939797e to start an election
I20260709 13:16:39.326277  7772 consensus_queue.cc:260] T d57f28fe65ad4a5f87539791fad21572 P 7c45cd47cdbf4b93ba0e20539d18b63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:39.330335  7772 raft_consensus.cc:3060] T d57f28fe65ad4a5f87539791fad21572 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:39.331010  7699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57f28fe65ad4a5f87539791fad21572" candidate_uuid: "005ee35e74e24295be2b88596986b0e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "256feb60c06e4ccbaeec28266939797e"
I20260709 13:16:39.331707  7699 raft_consensus.cc:3060] T d57f28fe65ad4a5f87539791fad21572 P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:39.331439  7625 raft_consensus.cc:515] T b7214fe40cbb4728934d178be63cac21 P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:39.333577  7625 leader_election.cc:290] T b7214fe40cbb4728934d178be63cac21 P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 2 election: Requested vote from peers 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449), 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071)
I20260709 13:16:39.334410  7700 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "87d1ab8e509a451b91aaaeffce5e0f94"
dest_uuid: "256feb60c06e4ccbaeec28266939797e"
 from {username='slave'} at 127.0.0.1:54256
I20260709 13:16:39.334802  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7214fe40cbb4728934d178be63cac21" candidate_uuid: "005ee35e74e24295be2b88596986b0e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d"
I20260709 13:16:39.334954  7698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7214fe40cbb4728934d178be63cac21" candidate_uuid: "005ee35e74e24295be2b88596986b0e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "256feb60c06e4ccbaeec28266939797e"
I20260709 13:16:39.335078  7700 raft_consensus.cc:493] T 87d1ab8e509a451b91aaaeffce5e0f94 P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:39.335670  7698 raft_consensus.cc:3060] T b7214fe40cbb4728934d178be63cac21 P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:39.335695  7700 raft_consensus.cc:3060] T 87d1ab8e509a451b91aaaeffce5e0f94 P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:39.336463  7774 raft_consensus.cc:3055] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:39.336822  7774 raft_consensus.cc:740] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c45cd47cdbf4b93ba0e20539d18b63d, State: Running, Role: LEADER
I20260709 13:16:39.337713  7774 consensus_queue.cc:260] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:39.339030  7774 raft_consensus.cc:3060] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:39.340997  7699 raft_consensus.cc:2468] T d57f28fe65ad4a5f87539791fad21572 P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ee35e74e24295be2b88596986b0e0 in term 2.
I20260709 13:16:39.342278  7591 leader_election.cc:304] T d57f28fe65ad4a5f87539791fad21572 P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0, 256feb60c06e4ccbaeec28266939797e; no voters: 
I20260709 13:16:39.343150  7988 raft_consensus.cc:2804] T d57f28fe65ad4a5f87539791fad21572 P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:39.343658  7988 raft_consensus.cc:697] T d57f28fe65ad4a5f87539791fad21572 P 005ee35e74e24295be2b88596986b0e0 [term 2 LEADER]: Becoming Leader. State: Replica: 005ee35e74e24295be2b88596986b0e0, State: Running, Role: LEADER
I20260709 13:16:39.344511  7988 consensus_queue.cc:237] T d57f28fe65ad4a5f87539791fad21572 P 005ee35e74e24295be2b88596986b0e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:39.347378  7772 raft_consensus.cc:2468] T d57f28fe65ad4a5f87539791fad21572 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ee35e74e24295be2b88596986b0e0 in term 2.
I20260709 13:16:39.347252  7774 raft_consensus.cc:2468] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ee35e74e24295be2b88596986b0e0 in term 2.
I20260709 13:16:39.347178  7700 raft_consensus.cc:515] T 87d1ab8e509a451b91aaaeffce5e0f94 P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:39.349790  7588 leader_election.cc:304] T b7214fe40cbb4728934d178be63cac21 P 005ee35e74e24295be2b88596986b0e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0, 7c45cd47cdbf4b93ba0e20539d18b63d; no voters: 
I20260709 13:16:39.350395  7700 leader_election.cc:290] T 87d1ab8e509a451b91aaaeffce5e0f94 P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 2 election: Requested vote from peers 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847), 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071)
I20260709 13:16:39.352154  7698 raft_consensus.cc:2468] T b7214fe40cbb4728934d178be63cac21 P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 005ee35e74e24295be2b88596986b0e0 in term 2.
I20260709 13:16:39.352248  7625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d1ab8e509a451b91aaaeffce5e0f94" candidate_uuid: "256feb60c06e4ccbaeec28266939797e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "005ee35e74e24295be2b88596986b0e0"
I20260709 13:16:39.352463  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d1ab8e509a451b91aaaeffce5e0f94" candidate_uuid: "256feb60c06e4ccbaeec28266939797e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d"
I20260709 13:16:39.353118  7625 raft_consensus.cc:3060] T 87d1ab8e509a451b91aaaeffce5e0f94 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:39.353827  7988 raft_consensus.cc:2804] T b7214fe40cbb4728934d178be63cac21 P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:39.353188  7774 raft_consensus.cc:3055] T 87d1ab8e509a451b91aaaeffce5e0f94 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:39.354415  7988 raft_consensus.cc:697] T b7214fe40cbb4728934d178be63cac21 P 005ee35e74e24295be2b88596986b0e0 [term 2 LEADER]: Becoming Leader. State: Replica: 005ee35e74e24295be2b88596986b0e0, State: Running, Role: LEADER
I20260709 13:16:39.354790  7774 raft_consensus.cc:740] T 87d1ab8e509a451b91aaaeffce5e0f94 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c45cd47cdbf4b93ba0e20539d18b63d, State: Running, Role: LEADER
I20260709 13:16:39.355422  7988 consensus_queue.cc:237] T b7214fe40cbb4728934d178be63cac21 P 005ee35e74e24295be2b88596986b0e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:39.355155  7522 catalog_manager.cc:5697] T d57f28fe65ad4a5f87539791fad21572 P 005ee35e74e24295be2b88596986b0e0 reported cstate change: term changed from 1 to 2, leader changed from 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131) to 005ee35e74e24295be2b88596986b0e0 (127.27.146.129). New cstate: current_term: 2 leader_uuid: "005ee35e74e24295be2b88596986b0e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:39.355959  7774 consensus_queue.cc:260] T 87d1ab8e509a451b91aaaeffce5e0f94 P 7c45cd47cdbf4b93ba0e20539d18b63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:39.357515  7774 raft_consensus.cc:3060] T 87d1ab8e509a451b91aaaeffce5e0f94 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:39.361595  7625 raft_consensus.cc:2468] T 87d1ab8e509a451b91aaaeffce5e0f94 P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 256feb60c06e4ccbaeec28266939797e in term 2.
I20260709 13:16:39.363592  7665 leader_election.cc:304] T 87d1ab8e509a451b91aaaeffce5e0f94 P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0, 256feb60c06e4ccbaeec28266939797e; no voters: 
I20260709 13:16:39.364550  7951 raft_consensus.cc:2804] T 87d1ab8e509a451b91aaaeffce5e0f94 P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:39.365091  7951 raft_consensus.cc:697] T 87d1ab8e509a451b91aaaeffce5e0f94 P 256feb60c06e4ccbaeec28266939797e [term 2 LEADER]: Becoming Leader. State: Replica: 256feb60c06e4ccbaeec28266939797e, State: Running, Role: LEADER
I20260709 13:16:39.366075  7951 consensus_queue.cc:237] T 87d1ab8e509a451b91aaaeffce5e0f94 P 256feb60c06e4ccbaeec28266939797e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:39.367971  7774 raft_consensus.cc:2468] T 87d1ab8e509a451b91aaaeffce5e0f94 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 256feb60c06e4ccbaeec28266939797e in term 2.
I20260709 13:16:39.374466  7522 catalog_manager.cc:5697] T b7214fe40cbb4728934d178be63cac21 P 005ee35e74e24295be2b88596986b0e0 reported cstate change: term changed from 1 to 2, leader changed from 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131) to 005ee35e74e24295be2b88596986b0e0 (127.27.146.129). New cstate: current_term: 2 leader_uuid: "005ee35e74e24295be2b88596986b0e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:39.375562  7901 consensus_queue.cc:1048] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:39.375262  7519 catalog_manager.cc:5697] T 87d1ab8e509a451b91aaaeffce5e0f94 P 256feb60c06e4ccbaeec28266939797e reported cstate change: term changed from 1 to 2, leader changed from 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131) to 256feb60c06e4ccbaeec28266939797e (127.27.146.130). New cstate: current_term: 2 leader_uuid: "256feb60c06e4ccbaeec28266939797e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:39.389484  7955 raft_consensus.cc:993] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d: : Instructing follower 256feb60c06e4ccbaeec28266939797e to start an election
I20260709 13:16:39.390089  7968 raft_consensus.cc:1081] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 LEADER]: Signalling peer 256feb60c06e4ccbaeec28266939797e to start an election
I20260709 13:16:39.392148  7700 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5bbbdedc18e448da998c67da78c28236"
dest_uuid: "256feb60c06e4ccbaeec28266939797e"
 from {username='slave'} at 127.0.0.1:54256
I20260709 13:16:39.395604  7700 raft_consensus.cc:493] T 5bbbdedc18e448da998c67da78c28236 P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:39.396126  7700 raft_consensus.cc:3060] T 5bbbdedc18e448da998c67da78c28236 P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:39.397573  7968 consensus_queue.cc:1048] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:39.405242  7700 raft_consensus.cc:515] T 5bbbdedc18e448da998c67da78c28236 P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:39.416985  7700 leader_election.cc:290] T 5bbbdedc18e448da998c67da78c28236 P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 2 election: Requested vote from peers 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847), 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131:34071)
I20260709 13:16:39.417435  7774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbbdedc18e448da998c67da78c28236" candidate_uuid: "256feb60c06e4ccbaeec28266939797e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d"
I20260709 13:16:39.417616  7625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbbdedc18e448da998c67da78c28236" candidate_uuid: "256feb60c06e4ccbaeec28266939797e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "005ee35e74e24295be2b88596986b0e0"
I20260709 13:16:39.418277  7774 raft_consensus.cc:3055] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:39.418397  7625 raft_consensus.cc:3060] T 5bbbdedc18e448da998c67da78c28236 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:39.420614  7774 raft_consensus.cc:740] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c45cd47cdbf4b93ba0e20539d18b63d, State: Running, Role: LEADER
I20260709 13:16:39.421658  7774 consensus_queue.cc:260] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:39.423542  7774 raft_consensus.cc:3060] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:39.428488  7625 raft_consensus.cc:2468] T 5bbbdedc18e448da998c67da78c28236 P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 256feb60c06e4ccbaeec28266939797e in term 2.
I20260709 13:16:39.429950  7665 leader_election.cc:304] T 5bbbdedc18e448da998c67da78c28236 P 256feb60c06e4ccbaeec28266939797e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0, 256feb60c06e4ccbaeec28266939797e; no voters: 
I20260709 13:16:39.430902  7905 raft_consensus.cc:2804] T 5bbbdedc18e448da998c67da78c28236 P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:39.431484  7905 raft_consensus.cc:697] T 5bbbdedc18e448da998c67da78c28236 P 256feb60c06e4ccbaeec28266939797e [term 2 LEADER]: Becoming Leader. State: Replica: 256feb60c06e4ccbaeec28266939797e, State: Running, Role: LEADER
I20260709 13:16:39.432273  7774 raft_consensus.cc:2468] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 256feb60c06e4ccbaeec28266939797e in term 2.
I20260709 13:16:39.432473  7905 consensus_queue.cc:237] T 5bbbdedc18e448da998c67da78c28236 P 256feb60c06e4ccbaeec28266939797e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:39.441030  7519 catalog_manager.cc:5697] T 5bbbdedc18e448da998c67da78c28236 P 256feb60c06e4ccbaeec28266939797e reported cstate change: term changed from 1 to 2, leader changed from 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131) to 256feb60c06e4ccbaeec28266939797e (127.27.146.130). New cstate: current_term: 2 leader_uuid: "256feb60c06e4ccbaeec28266939797e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:39.615728  7774 raft_consensus.cc:1275] T 5fce78ca96eb4051bfdbf4a94fedb307 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Refusing update from remote peer 005ee35e74e24295be2b88596986b0e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:39.617385  7987 consensus_queue.cc:1048] T 5fce78ca96eb4051bfdbf4a94fedb307 P 005ee35e74e24295be2b88596986b0e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:39.627686  7700 raft_consensus.cc:1275] T 5fce78ca96eb4051bfdbf4a94fedb307 P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Refusing update from remote peer 005ee35e74e24295be2b88596986b0e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:39.629650  7988 consensus_queue.cc:1048] T 5fce78ca96eb4051bfdbf4a94fedb307 P 005ee35e74e24295be2b88596986b0e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:39.703078  7700 raft_consensus.cc:1275] T d449aa6b57b3466a91a42fca7495a248 P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Refusing update from remote peer 005ee35e74e24295be2b88596986b0e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:39.704535  7926 consensus_queue.cc:1048] T d449aa6b57b3466a91a42fca7495a248 P 005ee35e74e24295be2b88596986b0e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:39.717734  7774 raft_consensus.cc:1275] T d449aa6b57b3466a91a42fca7495a248 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Refusing update from remote peer 005ee35e74e24295be2b88596986b0e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:39.719389  7988 consensus_queue.cc:1048] T d449aa6b57b3466a91a42fca7495a248 P 005ee35e74e24295be2b88596986b0e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:39.773116  7774 raft_consensus.cc:1275] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Refusing update from remote peer 005ee35e74e24295be2b88596986b0e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:39.774747  7988 consensus_queue.cc:1048] T b7214fe40cbb4728934d178be63cac21 P 005ee35e74e24295be2b88596986b0e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:39.784205  7700 raft_consensus.cc:1275] T b7214fe40cbb4728934d178be63cac21 P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Refusing update from remote peer 005ee35e74e24295be2b88596986b0e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:39.786170  7926 consensus_queue.cc:1048] T b7214fe40cbb4728934d178be63cac21 P 005ee35e74e24295be2b88596986b0e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:39.794229  7774 raft_consensus.cc:1275] T f2e32ae678174dc580caa70ad1407376 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Refusing update from remote peer 256feb60c06e4ccbaeec28266939797e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:39.795889  7953 consensus_queue.cc:1048] T f2e32ae678174dc580caa70ad1407376 P 256feb60c06e4ccbaeec28266939797e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:39.801584  7625 raft_consensus.cc:1275] T 87d1ab8e509a451b91aaaeffce5e0f94 P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Refusing update from remote peer 256feb60c06e4ccbaeec28266939797e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:39.803941  7953 consensus_queue.cc:1048] T 87d1ab8e509a451b91aaaeffce5e0f94 P 256feb60c06e4ccbaeec28266939797e [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:39.811965  7623 raft_consensus.cc:1275] T f2e32ae678174dc580caa70ad1407376 P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Refusing update from remote peer 256feb60c06e4ccbaeec28266939797e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:39.815623  7951 consensus_queue.cc:1048] T f2e32ae678174dc580caa70ad1407376 P 256feb60c06e4ccbaeec28266939797e [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:39.826699  7700 raft_consensus.cc:1275] T d57f28fe65ad4a5f87539791fad21572 P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Refusing update from remote peer 005ee35e74e24295be2b88596986b0e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:39.830278  7988 consensus_queue.cc:1048] T d57f28fe65ad4a5f87539791fad21572 P 005ee35e74e24295be2b88596986b0e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:39.839078  7774 raft_consensus.cc:1275] T 87d1ab8e509a451b91aaaeffce5e0f94 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Refusing update from remote peer 256feb60c06e4ccbaeec28266939797e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:39.841035  7951 consensus_queue.cc:1048] T 87d1ab8e509a451b91aaaeffce5e0f94 P 256feb60c06e4ccbaeec28266939797e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:39.849936  7772 raft_consensus.cc:1275] T d57f28fe65ad4a5f87539791fad21572 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Refusing update from remote peer 005ee35e74e24295be2b88596986b0e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:39.856058  7926 consensus_queue.cc:1048] T d57f28fe65ad4a5f87539791fad21572 P 005ee35e74e24295be2b88596986b0e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:40.004611  7625 raft_consensus.cc:1275] T 5bbbdedc18e448da998c67da78c28236 P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Refusing update from remote peer 256feb60c06e4ccbaeec28266939797e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:40.006289  7951 consensus_queue.cc:1048] T 5bbbdedc18e448da998c67da78c28236 P 256feb60c06e4ccbaeec28266939797e [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:40.016170  7774 raft_consensus.cc:1275] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Refusing update from remote peer 256feb60c06e4ccbaeec28266939797e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:40.018281  7933 consensus_queue.cc:1048] T 5bbbdedc18e448da998c67da78c28236 P 256feb60c06e4ccbaeec28266939797e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:41.992188  7523 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59382:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:16:42.024663  7523 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59382:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:16:42.062507 28234 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:16:42.269662  7697 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5bbbdedc18e448da998c67da78c28236"
dest_uuid: "256feb60c06e4ccbaeec28266939797e"
mode: GRACEFUL
new_leader_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d"
 from {username='slave'} at 127.0.0.1:54284
W20260709 13:16:42.327965  7663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.131:34071, user_credentials={real_user=slave}} blocked reactor thread for 67895.8us
W20260709 13:16:42.336412  7591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:38449, user_credentials={real_user=slave}} blocked reactor thread for 100643us
I20260709 13:16:42.332690  7697 raft_consensus.cc:606] T 5bbbdedc18e448da998c67da78c28236 P 256feb60c06e4ccbaeec28266939797e [term 2 LEADER]: Received request to transfer leadership to TS 7c45cd47cdbf4b93ba0e20539d18b63d
I20260709 13:16:42.396436  8053 tablet.cc:1724] T 5fce78ca96eb4051bfdbf4a94fedb307 P 005ee35e74e24295be2b88596986b0e0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:42.414518  8050 tablet.cc:1724] T d89180feea324fd3b9f81816e4534626 P 7c45cd47cdbf4b93ba0e20539d18b63d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:16:42.443091  7651 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:5fce78ca96eb4051bfdbf4a94fedb307)
W20260709 13:16:42.456082  7651 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:5fce78ca96eb4051bfdbf4a94fedb307)
W20260709 13:16:42.473433  7651 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:5fce78ca96eb4051bfdbf4a94fedb307)
W20260709 13:16:42.581216  7591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:38449, user_credentials={real_user=slave}} blocked reactor thread for 76089.9us
I20260709 13:16:42.566448  8066 tablet.cc:1724] T d57f28fe65ad4a5f87539791fad21572 P 256feb60c06e4ccbaeec28266939797e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:42.569761  8067 tablet.cc:1724] T f2e32ae678174dc580caa70ad1407376 P 256feb60c06e4ccbaeec28266939797e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:16:42.608567  7740 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:38449, user_credentials={real_user=slave}} blocked reactor thread for 82315.8us
W20260709 13:16:42.645731  8042 log.cc:927] Time spent T 5bbbdedc18e448da998c67da78c28236 P 256feb60c06e4ccbaeec28266939797e: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
I20260709 13:16:42.476658  8060 tablet.cc:1724] T d89180feea324fd3b9f81816e4534626 P 256feb60c06e4ccbaeec28266939797e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:16:42.654707  7665 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:40847, user_credentials={real_user=slave}} blocked reactor thread for 68255.6us
W20260709 13:16:42.699726  8041 log.cc:927] Time spent T d449aa6b57b3466a91a42fca7495a248 P 256feb60c06e4ccbaeec28266939797e: Append to log took a long time: real 0.366s	user 0.002s	sys 0.004s
I20260709 13:16:42.701157  8061 tablet.cc:1724] T 87d1ab8e509a451b91aaaeffce5e0f94 P 256feb60c06e4ccbaeec28266939797e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:16:42.713636  8064 log.cc:927] Time spent T 5fce78ca96eb4051bfdbf4a94fedb307 P 256feb60c06e4ccbaeec28266939797e: Append to log took a long time: real 0.137s	user 0.001s	sys 0.002s
I20260709 13:16:42.727149  8072 tablet.cc:1724] T 5fce78ca96eb4051bfdbf4a94fedb307 P 7c45cd47cdbf4b93ba0e20539d18b63d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:42.728698  8062 tablet.cc:1724] T d57f28fe65ad4a5f87539791fad21572 P 005ee35e74e24295be2b88596986b0e0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:42.736056  8069 tablet.cc:1724] T d449aa6b57b3466a91a42fca7495a248 P 005ee35e74e24295be2b88596986b0e0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:42.741232  8066 tablet.cc:1724] T 5fce78ca96eb4051bfdbf4a94fedb307 P 256feb60c06e4ccbaeec28266939797e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:42.777637  8063 tablet.cc:1724] T d89180feea324fd3b9f81816e4534626 P 005ee35e74e24295be2b88596986b0e0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:42.786072  8071 tablet.cc:1724] T d449aa6b57b3466a91a42fca7495a248 P 7c45cd47cdbf4b93ba0e20539d18b63d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:42.788574  8065 tablet.cc:1724] T f2e32ae678174dc580caa70ad1407376 P 7c45cd47cdbf4b93ba0e20539d18b63d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:42.790333  8069 tablet.cc:1724] T b7214fe40cbb4728934d178be63cac21 P 005ee35e74e24295be2b88596986b0e0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:42.801884  8067 tablet.cc:1724] T d449aa6b57b3466a91a42fca7495a248 P 256feb60c06e4ccbaeec28266939797e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:42.844205  8050 tablet.cc:1724] T 87d1ab8e509a451b91aaaeffce5e0f94 P 7c45cd47cdbf4b93ba0e20539d18b63d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:42.848832  8035 raft_consensus.cc:993] T 5bbbdedc18e448da998c67da78c28236 P 256feb60c06e4ccbaeec28266939797e: : Instructing follower 7c45cd47cdbf4b93ba0e20539d18b63d to start an election
I20260709 13:16:42.822685  8053 tablet.cc:1724] T f2e32ae678174dc580caa70ad1407376 P 005ee35e74e24295be2b88596986b0e0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:42.850050  8028 raft_consensus.cc:1081] T 5bbbdedc18e448da998c67da78c28236 P 256feb60c06e4ccbaeec28266939797e [term 2 LEADER]: Signalling peer 7c45cd47cdbf4b93ba0e20539d18b63d to start an election
I20260709 13:16:42.823091  8067 tablet.cc:1724] T d788207049fe4313a1a8a63815944994 P 256feb60c06e4ccbaeec28266939797e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:42.880214  7774 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5bbbdedc18e448da998c67da78c28236"
dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d"
 from {username='slave'} at 127.0.0.1:41132
I20260709 13:16:42.881048  7774 raft_consensus.cc:493] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:42.881538  7774 raft_consensus.cc:3060] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:42.882867  8060 tablet.cc:1724] T b7214fe40cbb4728934d178be63cac21 P 256feb60c06e4ccbaeec28266939797e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:42.890919  8062 tablet.cc:1724] T d788207049fe4313a1a8a63815944994 P 005ee35e74e24295be2b88596986b0e0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:42.897192  8066 tablet.cc:1724] T 5bbbdedc18e448da998c67da78c28236 P 256feb60c06e4ccbaeec28266939797e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:42.908280  7774 raft_consensus.cc:515] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:42.914535  7624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbbdedc18e448da998c67da78c28236" candidate_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "005ee35e74e24295be2b88596986b0e0"
I20260709 13:16:42.915441  7624 raft_consensus.cc:3060] T 5bbbdedc18e448da998c67da78c28236 P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:42.917869  7696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bbbdedc18e448da998c67da78c28236" candidate_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "256feb60c06e4ccbaeec28266939797e"
I20260709 13:16:42.918574  7696 raft_consensus.cc:3055] T 5bbbdedc18e448da998c67da78c28236 P 256feb60c06e4ccbaeec28266939797e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:42.918968  7696 raft_consensus.cc:740] T 5bbbdedc18e448da998c67da78c28236 P 256feb60c06e4ccbaeec28266939797e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 256feb60c06e4ccbaeec28266939797e, State: Running, Role: LEADER
I20260709 13:16:42.914443  7523 catalog_manager.cc:5789] TS 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449) does not have the latest schema for tablet d788207049fe4313a1a8a63815944994 (table soft_deleted_table [id=1b2ebc66c3de4c7b91abdb83026d6ea3]). Expected version 1 got 0
I20260709 13:16:42.920006  7696 consensus_queue.cc:260] T 5bbbdedc18e448da998c67da78c28236 P 256feb60c06e4ccbaeec28266939797e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:42.921229  7523 catalog_manager.cc:5789] TS 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449) does not have the latest schema for tablet 5bbbdedc18e448da998c67da78c28236 (table soft_deleted_table [id=1b2ebc66c3de4c7b91abdb83026d6ea3]). Expected version 1 got 0
I20260709 13:16:42.921461  7696 raft_consensus.cc:3060] T 5bbbdedc18e448da998c67da78c28236 P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:42.916985  7774 leader_election.cc:290] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 3 election: Requested vote from peers 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847), 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449)
I20260709 13:16:42.887828  8072 tablet.cc:1724] T d57f28fe65ad4a5f87539791fad21572 P 7c45cd47cdbf4b93ba0e20539d18b63d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:42.947366  7624 raft_consensus.cc:2468] T 5bbbdedc18e448da998c67da78c28236 P 005ee35e74e24295be2b88596986b0e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c45cd47cdbf4b93ba0e20539d18b63d in term 3.
I20260709 13:16:42.947170  8053 tablet.cc:1724] T 87d1ab8e509a451b91aaaeffce5e0f94 P 005ee35e74e24295be2b88596986b0e0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:42.960034  7739 leader_election.cc:304] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0, 7c45cd47cdbf4b93ba0e20539d18b63d; no voters: 
I20260709 13:16:42.961388  8055 raft_consensus.cc:2804] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:42.961933  8055 raft_consensus.cc:697] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 3 LEADER]: Becoming Leader. State: Replica: 7c45cd47cdbf4b93ba0e20539d18b63d, State: Running, Role: LEADER
I20260709 13:16:42.950157  8063 tablet.cc:1724] T 5bbbdedc18e448da998c67da78c28236 P 005ee35e74e24295be2b88596986b0e0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:42.965349  8050 tablet.cc:1724] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:42.963125  8055 consensus_queue.cc:237] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:42.972354  8071 tablet.cc:1724] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:42.957616  7622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7214fe40cbb4728934d178be63cac21"
dest_uuid: "005ee35e74e24295be2b88596986b0e0"
mode: GRACEFUL
new_leader_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d"
 from {username='slave'} at 127.0.0.1:35196
I20260709 13:16:42.974571  7622 raft_consensus.cc:606] T b7214fe40cbb4728934d178be63cac21 P 005ee35e74e24295be2b88596986b0e0 [term 2 LEADER]: Received request to transfer leadership to TS 7c45cd47cdbf4b93ba0e20539d18b63d
I20260709 13:16:42.977324 28234 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:16:42.978155 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:42.985352  8065 tablet.cc:1724] T d788207049fe4313a1a8a63815944994 P 7c45cd47cdbf4b93ba0e20539d18b63d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:42.993094  7624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03c0eb40dfe644029acaf5902efd770f"
dest_uuid: "005ee35e74e24295be2b88596986b0e0"
mode: GRACEFUL
new_leader_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d"
 from {username='slave'} at 127.0.0.1:35196
I20260709 13:16:42.994026  7624 raft_consensus.cc:606] T 03c0eb40dfe644029acaf5902efd770f P 005ee35e74e24295be2b88596986b0e0 [term 1 LEADER]: Received request to transfer leadership to TS 7c45cd47cdbf4b93ba0e20539d18b63d
I20260709 13:16:42.997784  7697 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3eea5331f2be4e82ae096a77d8ed4023"
dest_uuid: "256feb60c06e4ccbaeec28266939797e"
mode: GRACEFUL
new_leader_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d"
 from {username='slave'} at 127.0.0.1:54284
I20260709 13:16:42.998534  7697 raft_consensus.cc:606] T 3eea5331f2be4e82ae096a77d8ed4023 P 256feb60c06e4ccbaeec28266939797e [term 1 LEADER]: Received request to transfer leadership to TS 7c45cd47cdbf4b93ba0e20539d18b63d
I20260709 13:16:43.002722 28234 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:16:43.008010 28234 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:43.021833  7696 raft_consensus.cc:2468] T 5bbbdedc18e448da998c67da78c28236 P 256feb60c06e4ccbaeec28266939797e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c45cd47cdbf4b93ba0e20539d18b63d in term 3.
I20260709 13:16:43.027570  7519 catalog_manager.cc:5697] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d reported cstate change: term changed from 2 to 3, leader changed from 256feb60c06e4ccbaeec28266939797e (127.27.146.130) to 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131). New cstate: current_term: 3 leader_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:43.035728  8035 raft_consensus.cc:993] T 3eea5331f2be4e82ae096a77d8ed4023 P 256feb60c06e4ccbaeec28266939797e: : Instructing follower 7c45cd47cdbf4b93ba0e20539d18b63d to start an election
I20260709 13:16:43.036423  8035 raft_consensus.cc:1081] T 3eea5331f2be4e82ae096a77d8ed4023 P 256feb60c06e4ccbaeec28266939797e [term 1 LEADER]: Signalling peer 7c45cd47cdbf4b93ba0e20539d18b63d to start an election
I20260709 13:16:43.038661  7773 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3eea5331f2be4e82ae096a77d8ed4023"
dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d"
 from {username='slave'} at 127.0.0.1:41132
I20260709 13:16:43.039249  7773 raft_consensus.cc:493] T 3eea5331f2be4e82ae096a77d8ed4023 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:43.039685  7773 raft_consensus.cc:3060] T 3eea5331f2be4e82ae096a77d8ed4023 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:43.049001  7773 raft_consensus.cc:515] T 3eea5331f2be4e82ae096a77d8ed4023 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:43.051638  7773 leader_election.cc:290] T 3eea5331f2be4e82ae096a77d8ed4023 P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 2 election: Requested vote from peers 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847), 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449)
I20260709 13:16:43.052963  7624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eea5331f2be4e82ae096a77d8ed4023" candidate_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "005ee35e74e24295be2b88596986b0e0"
I20260709 13:16:43.053249  7696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eea5331f2be4e82ae096a77d8ed4023" candidate_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "256feb60c06e4ccbaeec28266939797e"
I20260709 13:16:43.053845  7624 raft_consensus.cc:3060] T 3eea5331f2be4e82ae096a77d8ed4023 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:43.053928  7696 raft_consensus.cc:3055] T 3eea5331f2be4e82ae096a77d8ed4023 P 256feb60c06e4ccbaeec28266939797e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:43.054492  7696 raft_consensus.cc:740] T 3eea5331f2be4e82ae096a77d8ed4023 P 256feb60c06e4ccbaeec28266939797e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 256feb60c06e4ccbaeec28266939797e, State: Running, Role: LEADER
I20260709 13:16:43.055598  7696 consensus_queue.cc:260] T 3eea5331f2be4e82ae096a77d8ed4023 P 256feb60c06e4ccbaeec28266939797e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:43.057524  7696 raft_consensus.cc:3060] T 3eea5331f2be4e82ae096a77d8ed4023 P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:43.055552  7519 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 97eda03e8cdb44d791ffb8e7962b9113: soft_deleted_table [id=1b2ebc66c3de4c7b91abdb83026d6ea3] alter complete (version 1)
I20260709 13:16:43.062788  7624 raft_consensus.cc:2468] T 3eea5331f2be4e82ae096a77d8ed4023 P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c45cd47cdbf4b93ba0e20539d18b63d in term 2.
I20260709 13:16:43.064334  7739 leader_election.cc:304] T 3eea5331f2be4e82ae096a77d8ed4023 P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 005ee35e74e24295be2b88596986b0e0, 7c45cd47cdbf4b93ba0e20539d18b63d; no voters: 
I20260709 13:16:43.065412  8055 raft_consensus.cc:2804] T 3eea5331f2be4e82ae096a77d8ed4023 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:43.065917  8055 raft_consensus.cc:697] T 3eea5331f2be4e82ae096a77d8ed4023 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 LEADER]: Becoming Leader. State: Replica: 7c45cd47cdbf4b93ba0e20539d18b63d, State: Running, Role: LEADER
I20260709 13:16:43.066936  8055 consensus_queue.cc:237] T 3eea5331f2be4e82ae096a77d8ed4023 P 7c45cd47cdbf4b93ba0e20539d18b63d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:43.067358  7696 raft_consensus.cc:2468] T 3eea5331f2be4e82ae096a77d8ed4023 P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c45cd47cdbf4b93ba0e20539d18b63d in term 2.
I20260709 13:16:43.085680  8004 raft_consensus.cc:993] T 03c0eb40dfe644029acaf5902efd770f P 005ee35e74e24295be2b88596986b0e0: : Instructing follower 7c45cd47cdbf4b93ba0e20539d18b63d to start an election
I20260709 13:16:43.086345  8039 raft_consensus.cc:1081] T 03c0eb40dfe644029acaf5902efd770f P 005ee35e74e24295be2b88596986b0e0 [term 1 LEADER]: Signalling peer 7c45cd47cdbf4b93ba0e20539d18b63d to start an election
I20260709 13:16:43.086987  7519 catalog_manager.cc:5697] T 3eea5331f2be4e82ae096a77d8ed4023 P 7c45cd47cdbf4b93ba0e20539d18b63d reported cstate change: term changed from 1 to 2, leader changed from 256feb60c06e4ccbaeec28266939797e (127.27.146.130) to 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131). New cstate: current_term: 2 leader_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:43.088313  7773 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03c0eb40dfe644029acaf5902efd770f"
dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d"
 from {username='slave'} at 127.0.0.1:41144
I20260709 13:16:43.088928  7773 raft_consensus.cc:493] T 03c0eb40dfe644029acaf5902efd770f P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:43.089267  7773 raft_consensus.cc:3060] T 03c0eb40dfe644029acaf5902efd770f P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:43.097103  7773 raft_consensus.cc:515] T 03c0eb40dfe644029acaf5902efd770f P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } } peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } }
I20260709 13:16:43.099036  7773 leader_election.cc:290] T 03c0eb40dfe644029acaf5902efd770f P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 2 election: Requested vote from peers 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449), 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847)
I20260709 13:16:43.100064  7696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c0eb40dfe644029acaf5902efd770f" candidate_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "256feb60c06e4ccbaeec28266939797e"
I20260709 13:16:43.100787  7696 raft_consensus.cc:3060] T 03c0eb40dfe644029acaf5902efd770f P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:43.102476  7624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c0eb40dfe644029acaf5902efd770f" candidate_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "005ee35e74e24295be2b88596986b0e0"
I20260709 13:16:43.103173  7624 raft_consensus.cc:3055] T 03c0eb40dfe644029acaf5902efd770f P 005ee35e74e24295be2b88596986b0e0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:43.103547  7624 raft_consensus.cc:740] T 03c0eb40dfe644029acaf5902efd770f P 005ee35e74e24295be2b88596986b0e0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 005ee35e74e24295be2b88596986b0e0, State: Running, Role: LEADER
I20260709 13:16:43.104633  7624 consensus_queue.cc:260] T 03c0eb40dfe644029acaf5902efd770f P 005ee35e74e24295be2b88596986b0e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } } peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } }
I20260709 13:16:43.106207  7624 raft_consensus.cc:3060] T 03c0eb40dfe644029acaf5902efd770f P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:43.108898  7696 raft_consensus.cc:2468] T 03c0eb40dfe644029acaf5902efd770f P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c45cd47cdbf4b93ba0e20539d18b63d in term 2.
I20260709 13:16:43.110157  7740 leader_election.cc:304] T 03c0eb40dfe644029acaf5902efd770f P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 256feb60c06e4ccbaeec28266939797e, 7c45cd47cdbf4b93ba0e20539d18b63d; no voters: 
I20260709 13:16:43.111092  8055 raft_consensus.cc:2804] T 03c0eb40dfe644029acaf5902efd770f P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:43.111687  8055 raft_consensus.cc:697] T 03c0eb40dfe644029acaf5902efd770f P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 LEADER]: Becoming Leader. State: Replica: 7c45cd47cdbf4b93ba0e20539d18b63d, State: Running, Role: LEADER
I20260709 13:16:43.112715  8055 consensus_queue.cc:237] T 03c0eb40dfe644029acaf5902efd770f P 7c45cd47cdbf4b93ba0e20539d18b63d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } } peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } }
I20260709 13:16:43.113521  7624 raft_consensus.cc:2468] T 03c0eb40dfe644029acaf5902efd770f P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c45cd47cdbf4b93ba0e20539d18b63d in term 2.
I20260709 13:16:43.122681  7519 catalog_manager.cc:5697] T 03c0eb40dfe644029acaf5902efd770f P 7c45cd47cdbf4b93ba0e20539d18b63d reported cstate change: term changed from 1 to 2, leader changed from 005ee35e74e24295be2b88596986b0e0 (127.27.146.129) to 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131). New cstate: current_term: 2 leader_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:43.299655  8039 raft_consensus.cc:993] T b7214fe40cbb4728934d178be63cac21 P 005ee35e74e24295be2b88596986b0e0: : Instructing follower 7c45cd47cdbf4b93ba0e20539d18b63d to start an election
I20260709 13:16:43.300278  8004 raft_consensus.cc:1081] T b7214fe40cbb4728934d178be63cac21 P 005ee35e74e24295be2b88596986b0e0 [term 2 LEADER]: Signalling peer 7c45cd47cdbf4b93ba0e20539d18b63d to start an election
I20260709 13:16:43.301936  7773 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b7214fe40cbb4728934d178be63cac21"
dest_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d"
 from {username='slave'} at 127.0.0.1:41144
I20260709 13:16:43.302588  7773 raft_consensus.cc:493] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:43.302983  7773 raft_consensus.cc:3060] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:43.309505  7773 raft_consensus.cc:515] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:43.311369  7773 leader_election.cc:290] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 3 election: Requested vote from peers 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847), 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449)
I20260709 13:16:43.312600  7624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7214fe40cbb4728934d178be63cac21" candidate_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "005ee35e74e24295be2b88596986b0e0"
I20260709 13:16:43.312620  7696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7214fe40cbb4728934d178be63cac21" candidate_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "256feb60c06e4ccbaeec28266939797e"
I20260709 13:16:43.313400  7696 raft_consensus.cc:3060] T b7214fe40cbb4728934d178be63cac21 P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:43.313345  7624 raft_consensus.cc:3055] T b7214fe40cbb4728934d178be63cac21 P 005ee35e74e24295be2b88596986b0e0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:43.314016  7624 raft_consensus.cc:740] T b7214fe40cbb4728934d178be63cac21 P 005ee35e74e24295be2b88596986b0e0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 005ee35e74e24295be2b88596986b0e0, State: Running, Role: LEADER
I20260709 13:16:43.314838  7624 consensus_queue.cc:260] T b7214fe40cbb4728934d178be63cac21 P 005ee35e74e24295be2b88596986b0e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:43.316154  7624 raft_consensus.cc:3060] T b7214fe40cbb4728934d178be63cac21 P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:43.320281  7696 raft_consensus.cc:2468] T b7214fe40cbb4728934d178be63cac21 P 256feb60c06e4ccbaeec28266939797e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c45cd47cdbf4b93ba0e20539d18b63d in term 3.
I20260709 13:16:43.321928  7740 leader_election.cc:304] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 256feb60c06e4ccbaeec28266939797e, 7c45cd47cdbf4b93ba0e20539d18b63d; no voters: 
I20260709 13:16:43.322923  8055 raft_consensus.cc:2804] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:43.323535  8055 raft_consensus.cc:697] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 3 LEADER]: Becoming Leader. State: Replica: 7c45cd47cdbf4b93ba0e20539d18b63d, State: Running, Role: LEADER
I20260709 13:16:43.324420  7624 raft_consensus.cc:2468] T b7214fe40cbb4728934d178be63cac21 P 005ee35e74e24295be2b88596986b0e0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c45cd47cdbf4b93ba0e20539d18b63d in term 3.
I20260709 13:16:43.324661  8055 consensus_queue.cc:237] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } }
I20260709 13:16:43.332340  7519 catalog_manager.cc:5697] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d reported cstate change: term changed from 2 to 3, leader changed from 005ee35e74e24295be2b88596986b0e0 (127.27.146.129) to 7c45cd47cdbf4b93ba0e20539d18b63d (127.27.146.131). New cstate: current_term: 3 leader_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c45cd47cdbf4b93ba0e20539d18b63d" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 34071 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:43.468641  7624 raft_consensus.cc:1275] T 5bbbdedc18e448da998c67da78c28236 P 005ee35e74e24295be2b88596986b0e0 [term 3 FOLLOWER]: Refusing update from remote peer 7c45cd47cdbf4b93ba0e20539d18b63d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:16:43.470112  8055 consensus_queue.cc:1048] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:43.479436  7696 raft_consensus.cc:1275] T 5bbbdedc18e448da998c67da78c28236 P 256feb60c06e4ccbaeec28266939797e [term 3 FOLLOWER]: Refusing update from remote peer 7c45cd47cdbf4b93ba0e20539d18b63d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:16:43.481557  8057 consensus_queue.cc:1048] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:43.615293  7696 raft_consensus.cc:1275] T 3eea5331f2be4e82ae096a77d8ed4023 P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Refusing update from remote peer 7c45cd47cdbf4b93ba0e20539d18b63d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:43.616756  8057 consensus_queue.cc:1048] T 3eea5331f2be4e82ae096a77d8ed4023 P 7c45cd47cdbf4b93ba0e20539d18b63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:43.628253  7624 raft_consensus.cc:1275] T 3eea5331f2be4e82ae096a77d8ed4023 P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Refusing update from remote peer 7c45cd47cdbf4b93ba0e20539d18b63d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:43.629854  8057 consensus_queue.cc:1048] T 3eea5331f2be4e82ae096a77d8ed4023 P 7c45cd47cdbf4b93ba0e20539d18b63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:43.671823  7697 raft_consensus.cc:1275] T 03c0eb40dfe644029acaf5902efd770f P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Refusing update from remote peer 7c45cd47cdbf4b93ba0e20539d18b63d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:43.673139  8057 consensus_queue.cc:1048] T 03c0eb40dfe644029acaf5902efd770f P 7c45cd47cdbf4b93ba0e20539d18b63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:43.684238  7624 raft_consensus.cc:1275] T 03c0eb40dfe644029acaf5902efd770f P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Refusing update from remote peer 7c45cd47cdbf4b93ba0e20539d18b63d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:43.686260  8057 consensus_queue.cc:1048] T 03c0eb40dfe644029acaf5902efd770f P 7c45cd47cdbf4b93ba0e20539d18b63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:43.784548  7624 raft_consensus.cc:1275] T b7214fe40cbb4728934d178be63cac21 P 005ee35e74e24295be2b88596986b0e0 [term 3 FOLLOWER]: Refusing update from remote peer 7c45cd47cdbf4b93ba0e20539d18b63d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:16:43.786291  8086 consensus_queue.cc:1048] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "005ee35e74e24295be2b88596986b0e0" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 40847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:43.795893  7697 raft_consensus.cc:1275] T b7214fe40cbb4728934d178be63cac21 P 256feb60c06e4ccbaeec28266939797e [term 3 FOLLOWER]: Refusing update from remote peer 7c45cd47cdbf4b93ba0e20539d18b63d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:16:43.798045  8057 consensus_queue.cc:1048] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "256feb60c06e4ccbaeec28266939797e" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:44.084365 28234 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:16:44.090514 28234 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:16:44.091157 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:44.097302 28234 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:16:44.097836 28234 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:45.132326 28234 tablet_server.cc:179] TabletServer@127.27.146.129:0 shutting down...
I20260709 13:16:45.166759 28234 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:45.167798 28234 tablet_replica.cc:333] T d89180feea324fd3b9f81816e4534626 P 005ee35e74e24295be2b88596986b0e0: stopping tablet replica
I20260709 13:16:45.169171 28234 raft_consensus.cc:2243] T d89180feea324fd3b9f81816e4534626 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:45.169889 28234 raft_consensus.cc:2272] T d89180feea324fd3b9f81816e4534626 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.172646 28234 tablet_replica.cc:333] T 87d1ab8e509a451b91aaaeffce5e0f94 P 005ee35e74e24295be2b88596986b0e0: stopping tablet replica
I20260709 13:16:45.173410 28234 raft_consensus.cc:2243] T 87d1ab8e509a451b91aaaeffce5e0f94 P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:45.173935 28234 raft_consensus.cc:2272] T 87d1ab8e509a451b91aaaeffce5e0f94 P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.176478 28234 tablet_replica.cc:333] T f2e32ae678174dc580caa70ad1407376 P 005ee35e74e24295be2b88596986b0e0: stopping tablet replica
I20260709 13:16:45.177332 28234 raft_consensus.cc:2243] T f2e32ae678174dc580caa70ad1407376 P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:45.177959 28234 raft_consensus.cc:2272] T f2e32ae678174dc580caa70ad1407376 P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.181075 28234 tablet_replica.cc:333] T 5fce78ca96eb4051bfdbf4a94fedb307 P 005ee35e74e24295be2b88596986b0e0: stopping tablet replica
I20260709 13:16:45.181893 28234 raft_consensus.cc:2243] T 5fce78ca96eb4051bfdbf4a94fedb307 P 005ee35e74e24295be2b88596986b0e0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:45.183120 28234 raft_consensus.cc:2272] T 5fce78ca96eb4051bfdbf4a94fedb307 P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.186527 28234 tablet_replica.cc:333] T d57f28fe65ad4a5f87539791fad21572 P 005ee35e74e24295be2b88596986b0e0: stopping tablet replica
I20260709 13:16:45.187348 28234 raft_consensus.cc:2243] T d57f28fe65ad4a5f87539791fad21572 P 005ee35e74e24295be2b88596986b0e0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:45.188329 28234 raft_consensus.cc:2272] T d57f28fe65ad4a5f87539791fad21572 P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.191009 28234 tablet_replica.cc:333] T 042aa79c19c34c80be5b1523a342312b P 005ee35e74e24295be2b88596986b0e0: stopping tablet replica
I20260709 13:16:45.191741 28234 raft_consensus.cc:2243] T 042aa79c19c34c80be5b1523a342312b P 005ee35e74e24295be2b88596986b0e0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:45.193246 28234 raft_consensus.cc:2272] T 042aa79c19c34c80be5b1523a342312b P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.197139 28234 tablet_replica.cc:333] T b7214fe40cbb4728934d178be63cac21 P 005ee35e74e24295be2b88596986b0e0: stopping tablet replica
I20260709 13:16:45.198747 28234 raft_consensus.cc:2243] T b7214fe40cbb4728934d178be63cac21 P 005ee35e74e24295be2b88596986b0e0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:45.199415 28234 raft_consensus.cc:2272] T b7214fe40cbb4728934d178be63cac21 P 005ee35e74e24295be2b88596986b0e0 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:45.199831  7739 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 8 similar messages]
I20260709 13:16:45.202190 28234 tablet_replica.cc:333] T d449aa6b57b3466a91a42fca7495a248 P 005ee35e74e24295be2b88596986b0e0: stopping tablet replica
I20260709 13:16:45.202951 28234 raft_consensus.cc:2243] T d449aa6b57b3466a91a42fca7495a248 P 005ee35e74e24295be2b88596986b0e0 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:16:45.203286  7739 consensus_peers.cc:597] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d -> Peer 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847): Couldn't send request to peer 005ee35e74e24295be2b88596986b0e0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:45.204012 28234 raft_consensus.cc:2272] T d449aa6b57b3466a91a42fca7495a248 P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.206621 28234 tablet_replica.cc:333] T 047f830ce7f94325ac2b7a5bbcbb288e P 005ee35e74e24295be2b88596986b0e0: stopping tablet replica
I20260709 13:16:45.207324 28234 raft_consensus.cc:2243] T 047f830ce7f94325ac2b7a5bbcbb288e P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:45.207890 28234 raft_consensus.cc:2272] T 047f830ce7f94325ac2b7a5bbcbb288e P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.210306 28234 tablet_replica.cc:333] T 5e7913de22ae481cb204173005d94d41 P 005ee35e74e24295be2b88596986b0e0: stopping tablet replica
I20260709 13:16:45.210953 28234 raft_consensus.cc:2243] T 5e7913de22ae481cb204173005d94d41 P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:45.211562 28234 raft_consensus.cc:2272] T 5e7913de22ae481cb204173005d94d41 P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.214012 28234 tablet_replica.cc:333] T 13401e98748b4f1a9cc0827692efd70a P 005ee35e74e24295be2b88596986b0e0: stopping tablet replica
I20260709 13:16:45.214668 28234 raft_consensus.cc:2243] T 13401e98748b4f1a9cc0827692efd70a P 005ee35e74e24295be2b88596986b0e0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:45.215865 28234 raft_consensus.cc:2272] T 13401e98748b4f1a9cc0827692efd70a P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.218554 28234 tablet_replica.cc:333] T 5bbbdedc18e448da998c67da78c28236 P 005ee35e74e24295be2b88596986b0e0: stopping tablet replica
I20260709 13:16:45.219224 28234 raft_consensus.cc:2243] T 5bbbdedc18e448da998c67da78c28236 P 005ee35e74e24295be2b88596986b0e0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:45.219777 28234 raft_consensus.cc:2272] T 5bbbdedc18e448da998c67da78c28236 P 005ee35e74e24295be2b88596986b0e0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.222105 28234 tablet_replica.cc:333] T 03c0eb40dfe644029acaf5902efd770f P 005ee35e74e24295be2b88596986b0e0: stopping tablet replica
I20260709 13:16:45.222740 28234 raft_consensus.cc:2243] T 03c0eb40dfe644029acaf5902efd770f P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:45.223243 28234 raft_consensus.cc:2272] T 03c0eb40dfe644029acaf5902efd770f P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.225812 28234 tablet_replica.cc:333] T 254e6899d958489e9e02130bfbc4cdf8 P 005ee35e74e24295be2b88596986b0e0: stopping tablet replica
I20260709 13:16:45.226428 28234 raft_consensus.cc:2243] T 254e6899d958489e9e02130bfbc4cdf8 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:45.226903 28234 raft_consensus.cc:2272] T 254e6899d958489e9e02130bfbc4cdf8 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.229390 28234 tablet_replica.cc:333] T fca02db7c6d047448afb5d1e0c861d24 P 005ee35e74e24295be2b88596986b0e0: stopping tablet replica
I20260709 13:16:45.229992 28234 raft_consensus.cc:2243] T fca02db7c6d047448afb5d1e0c861d24 P 005ee35e74e24295be2b88596986b0e0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:45.231009 28234 raft_consensus.cc:2272] T fca02db7c6d047448afb5d1e0c861d24 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.233842 28234 tablet_replica.cc:333] T d788207049fe4313a1a8a63815944994 P 005ee35e74e24295be2b88596986b0e0: stopping tablet replica
I20260709 13:16:45.234593 28234 raft_consensus.cc:2243] T d788207049fe4313a1a8a63815944994 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:45.235159 28234 raft_consensus.cc:2272] T d788207049fe4313a1a8a63815944994 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.238267 28234 tablet_replica.cc:333] T 3eea5331f2be4e82ae096a77d8ed4023 P 005ee35e74e24295be2b88596986b0e0: stopping tablet replica
I20260709 13:16:45.239127 28234 raft_consensus.cc:2243] T 3eea5331f2be4e82ae096a77d8ed4023 P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:45.239763 28234 raft_consensus.cc:2272] T 3eea5331f2be4e82ae096a77d8ed4023 P 005ee35e74e24295be2b88596986b0e0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.242609 28234 tablet_replica.cc:333] T b3020531bc3d46fab66a8de40da58a22 P 005ee35e74e24295be2b88596986b0e0: stopping tablet replica
I20260709 13:16:45.243193 28234 raft_consensus.cc:2243] T b3020531bc3d46fab66a8de40da58a22 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:45.243716 28234 raft_consensus.cc:2272] T b3020531bc3d46fab66a8de40da58a22 P 005ee35e74e24295be2b88596986b0e0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:45.283958  7739 consensus_peers.cc:597] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d -> Peer 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847): Couldn't send request to peer 005ee35e74e24295be2b88596986b0e0. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:40847: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:45.284276 28234 tablet_server.cc:196] TabletServer@127.27.146.129:0 shutdown complete.
W20260709 13:16:45.298681  7739 consensus_peers.cc:597] T 3eea5331f2be4e82ae096a77d8ed4023 P 7c45cd47cdbf4b93ba0e20539d18b63d -> Peer 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847): Couldn't send request to peer 005ee35e74e24295be2b88596986b0e0. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:40847: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:45.336946 28234 tablet_server.cc:179] TabletServer@127.27.146.130:0 shutting down...
W20260709 13:16:45.352265  7665 consensus_peers.cc:597] T 254e6899d958489e9e02130bfbc4cdf8 P 256feb60c06e4ccbaeec28266939797e -> Peer 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847): Couldn't send request to peer 005ee35e74e24295be2b88596986b0e0. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:40847: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:45.368371  7665 consensus_peers.cc:597] T 87d1ab8e509a451b91aaaeffce5e0f94 P 256feb60c06e4ccbaeec28266939797e -> Peer 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847): Couldn't send request to peer 005ee35e74e24295be2b88596986b0e0. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:40847: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:45.391273 28234 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:45.392388 28234 tablet_replica.cc:333] T d89180feea324fd3b9f81816e4534626 P 256feb60c06e4ccbaeec28266939797e: stopping tablet replica
I20260709 13:16:45.394134 28234 raft_consensus.cc:2243] T d89180feea324fd3b9f81816e4534626 P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:45.394683 28234 raft_consensus.cc:2272] T d89180feea324fd3b9f81816e4534626 P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.397336 28234 tablet_replica.cc:333] T 87d1ab8e509a451b91aaaeffce5e0f94 P 256feb60c06e4ccbaeec28266939797e: stopping tablet replica
I20260709 13:16:45.397967 28234 raft_consensus.cc:2243] T 87d1ab8e509a451b91aaaeffce5e0f94 P 256feb60c06e4ccbaeec28266939797e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:45.398969 28234 raft_consensus.cc:2272] T 87d1ab8e509a451b91aaaeffce5e0f94 P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.401587 28234 tablet_replica.cc:333] T f2e32ae678174dc580caa70ad1407376 P 256feb60c06e4ccbaeec28266939797e: stopping tablet replica
I20260709 13:16:45.402236 28234 raft_consensus.cc:2243] T f2e32ae678174dc580caa70ad1407376 P 256feb60c06e4ccbaeec28266939797e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:45.403061 28234 raft_consensus.cc:2272] T f2e32ae678174dc580caa70ad1407376 P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.405515 28234 tablet_replica.cc:333] T 5fce78ca96eb4051bfdbf4a94fedb307 P 256feb60c06e4ccbaeec28266939797e: stopping tablet replica
I20260709 13:16:45.406162 28234 raft_consensus.cc:2243] T 5fce78ca96eb4051bfdbf4a94fedb307 P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:45.406636 28234 raft_consensus.cc:2272] T 5fce78ca96eb4051bfdbf4a94fedb307 P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.408969 28234 tablet_replica.cc:333] T d57f28fe65ad4a5f87539791fad21572 P 256feb60c06e4ccbaeec28266939797e: stopping tablet replica
I20260709 13:16:45.409512 28234 raft_consensus.cc:2243] T d57f28fe65ad4a5f87539791fad21572 P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:45.409914 28234 raft_consensus.cc:2272] T d57f28fe65ad4a5f87539791fad21572 P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.412256 28234 tablet_replica.cc:333] T 5e7913de22ae481cb204173005d94d41 P 256feb60c06e4ccbaeec28266939797e: stopping tablet replica
I20260709 13:16:45.412889 28234 raft_consensus.cc:2243] T 5e7913de22ae481cb204173005d94d41 P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:45.413331 28234 raft_consensus.cc:2272] T 5e7913de22ae481cb204173005d94d41 P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.415778 28234 tablet_replica.cc:333] T 13401e98748b4f1a9cc0827692efd70a P 256feb60c06e4ccbaeec28266939797e: stopping tablet replica
I20260709 13:16:45.416388 28234 raft_consensus.cc:2243] T 13401e98748b4f1a9cc0827692efd70a P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:45.416896 28234 raft_consensus.cc:2272] T 13401e98748b4f1a9cc0827692efd70a P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.419234 28234 tablet_replica.cc:333] T 5bbbdedc18e448da998c67da78c28236 P 256feb60c06e4ccbaeec28266939797e: stopping tablet replica
I20260709 13:16:45.420038 28234 raft_consensus.cc:2243] T 5bbbdedc18e448da998c67da78c28236 P 256feb60c06e4ccbaeec28266939797e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:45.420594 28234 raft_consensus.cc:2272] T 5bbbdedc18e448da998c67da78c28236 P 256feb60c06e4ccbaeec28266939797e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.422976 28234 tablet_replica.cc:333] T 03c0eb40dfe644029acaf5902efd770f P 256feb60c06e4ccbaeec28266939797e: stopping tablet replica
I20260709 13:16:45.423590 28234 raft_consensus.cc:2243] T 03c0eb40dfe644029acaf5902efd770f P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:45.424046 28234 raft_consensus.cc:2272] T 03c0eb40dfe644029acaf5902efd770f P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.426434 28234 tablet_replica.cc:333] T 042aa79c19c34c80be5b1523a342312b P 256feb60c06e4ccbaeec28266939797e: stopping tablet replica
I20260709 13:16:45.427112 28234 raft_consensus.cc:2243] T 042aa79c19c34c80be5b1523a342312b P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:45.427682 28234 raft_consensus.cc:2272] T 042aa79c19c34c80be5b1523a342312b P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.430141 28234 tablet_replica.cc:333] T fca02db7c6d047448afb5d1e0c861d24 P 256feb60c06e4ccbaeec28266939797e: stopping tablet replica
I20260709 13:16:45.430773 28234 raft_consensus.cc:2243] T fca02db7c6d047448afb5d1e0c861d24 P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:45.431254 28234 raft_consensus.cc:2272] T fca02db7c6d047448afb5d1e0c861d24 P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.434302 28234 tablet_replica.cc:333] T 254e6899d958489e9e02130bfbc4cdf8 P 256feb60c06e4ccbaeec28266939797e: stopping tablet replica
I20260709 13:16:45.435027 28234 raft_consensus.cc:2243] T 254e6899d958489e9e02130bfbc4cdf8 P 256feb60c06e4ccbaeec28266939797e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:45.436142 28234 raft_consensus.cc:2272] T 254e6899d958489e9e02130bfbc4cdf8 P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.439435 28234 tablet_replica.cc:333] T d788207049fe4313a1a8a63815944994 P 256feb60c06e4ccbaeec28266939797e: stopping tablet replica
I20260709 13:16:45.440424 28234 raft_consensus.cc:2243] T d788207049fe4313a1a8a63815944994 P 256feb60c06e4ccbaeec28266939797e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:45.441519 28234 raft_consensus.cc:2272] T d788207049fe4313a1a8a63815944994 P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:45.443183  7739 consensus_peers.cc:597] T 03c0eb40dfe644029acaf5902efd770f P 7c45cd47cdbf4b93ba0e20539d18b63d -> Peer 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847): Couldn't send request to peer 005ee35e74e24295be2b88596986b0e0. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:40847: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:45.444535 28234 tablet_replica.cc:333] T 3eea5331f2be4e82ae096a77d8ed4023 P 256feb60c06e4ccbaeec28266939797e: stopping tablet replica
I20260709 13:16:45.445212 28234 raft_consensus.cc:2243] T 3eea5331f2be4e82ae096a77d8ed4023 P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:45.445669 28234 raft_consensus.cc:2272] T 3eea5331f2be4e82ae096a77d8ed4023 P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.448414 28234 tablet_replica.cc:333] T b7214fe40cbb4728934d178be63cac21 P 256feb60c06e4ccbaeec28266939797e: stopping tablet replica
I20260709 13:16:45.449004 28234 raft_consensus.cc:2243] T b7214fe40cbb4728934d178be63cac21 P 256feb60c06e4ccbaeec28266939797e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:45.449536 28234 raft_consensus.cc:2272] T b7214fe40cbb4728934d178be63cac21 P 256feb60c06e4ccbaeec28266939797e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.451925 28234 tablet_replica.cc:333] T d449aa6b57b3466a91a42fca7495a248 P 256feb60c06e4ccbaeec28266939797e: stopping tablet replica
I20260709 13:16:45.452502 28234 raft_consensus.cc:2243] T d449aa6b57b3466a91a42fca7495a248 P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:45.452997 28234 raft_consensus.cc:2272] T d449aa6b57b3466a91a42fca7495a248 P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.455309 28234 tablet_replica.cc:333] T 047f830ce7f94325ac2b7a5bbcbb288e P 256feb60c06e4ccbaeec28266939797e: stopping tablet replica
I20260709 13:16:45.455938 28234 raft_consensus.cc:2243] T 047f830ce7f94325ac2b7a5bbcbb288e P 256feb60c06e4ccbaeec28266939797e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:45.456878 28234 raft_consensus.cc:2272] T 047f830ce7f94325ac2b7a5bbcbb288e P 256feb60c06e4ccbaeec28266939797e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.459611 28234 tablet_replica.cc:333] T b3020531bc3d46fab66a8de40da58a22 P 256feb60c06e4ccbaeec28266939797e: stopping tablet replica
I20260709 13:16:45.460189 28234 raft_consensus.cc:2243] T b3020531bc3d46fab66a8de40da58a22 P 256feb60c06e4ccbaeec28266939797e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:45.461427 28234 raft_consensus.cc:2272] T b3020531bc3d46fab66a8de40da58a22 P 256feb60c06e4ccbaeec28266939797e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.513182 28234 tablet_server.cc:196] TabletServer@127.27.146.130:0 shutdown complete.
W20260709 13:16:45.538865  7739 consensus_peers.cc:597] T d89180feea324fd3b9f81816e4534626 P 7c45cd47cdbf4b93ba0e20539d18b63d -> Peer 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847): Couldn't send request to peer 005ee35e74e24295be2b88596986b0e0. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:40847: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:45.547107  7740 consensus_peers.cc:597] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d -> Peer 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449): Couldn't send request to peer 256feb60c06e4ccbaeec28266939797e. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:38449: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:45.561538 28234 tablet_server.cc:179] TabletServer@127.27.146.131:0 shutting down...
W20260709 13:16:45.595741  7740 consensus_peers.cc:597] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d -> Peer 256feb60c06e4ccbaeec28266939797e (127.27.146.130:38449): Couldn't send request to peer 256feb60c06e4ccbaeec28266939797e. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:38449: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:45.607810 28234 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:45.609165 28234 tablet_replica.cc:333] T d89180feea324fd3b9f81816e4534626 P 7c45cd47cdbf4b93ba0e20539d18b63d: stopping tablet replica
I20260709 13:16:45.610569 28234 raft_consensus.cc:2243] T d89180feea324fd3b9f81816e4534626 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:45.612104 28234 raft_consensus.cc:2272] T d89180feea324fd3b9f81816e4534626 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:45.614420  7739 consensus_peers.cc:597] T 5e7913de22ae481cb204173005d94d41 P 7c45cd47cdbf4b93ba0e20539d18b63d -> Peer 005ee35e74e24295be2b88596986b0e0 (127.27.146.129:40847): Couldn't send request to peer 005ee35e74e24295be2b88596986b0e0. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:40847: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:45.615988 28234 tablet_replica.cc:333] T 87d1ab8e509a451b91aaaeffce5e0f94 P 7c45cd47cdbf4b93ba0e20539d18b63d: stopping tablet replica
I20260709 13:16:45.616927 28234 raft_consensus.cc:2243] T 87d1ab8e509a451b91aaaeffce5e0f94 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:45.617580 28234 raft_consensus.cc:2272] T 87d1ab8e509a451b91aaaeffce5e0f94 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.620290 28234 tablet_replica.cc:333] T 5fce78ca96eb4051bfdbf4a94fedb307 P 7c45cd47cdbf4b93ba0e20539d18b63d: stopping tablet replica
I20260709 13:16:45.621061 28234 raft_consensus.cc:2243] T 5fce78ca96eb4051bfdbf4a94fedb307 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:45.621640 28234 raft_consensus.cc:2272] T 5fce78ca96eb4051bfdbf4a94fedb307 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.624245 28234 tablet_replica.cc:333] T f2e32ae678174dc580caa70ad1407376 P 7c45cd47cdbf4b93ba0e20539d18b63d: stopping tablet replica
I20260709 13:16:45.624946 28234 raft_consensus.cc:2243] T f2e32ae678174dc580caa70ad1407376 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:45.625483 28234 raft_consensus.cc:2272] T f2e32ae678174dc580caa70ad1407376 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.628144 28234 tablet_replica.cc:333] T d57f28fe65ad4a5f87539791fad21572 P 7c45cd47cdbf4b93ba0e20539d18b63d: stopping tablet replica
I20260709 13:16:45.628870 28234 raft_consensus.cc:2243] T d57f28fe65ad4a5f87539791fad21572 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:45.629441 28234 raft_consensus.cc:2272] T d57f28fe65ad4a5f87539791fad21572 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.632123 28234 tablet_replica.cc:333] T d788207049fe4313a1a8a63815944994 P 7c45cd47cdbf4b93ba0e20539d18b63d: stopping tablet replica
I20260709 13:16:45.632818 28234 raft_consensus.cc:2243] T d788207049fe4313a1a8a63815944994 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:45.633373 28234 raft_consensus.cc:2272] T d788207049fe4313a1a8a63815944994 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.636943 28234 tablet_replica.cc:333] T 3eea5331f2be4e82ae096a77d8ed4023 P 7c45cd47cdbf4b93ba0e20539d18b63d: stopping tablet replica
I20260709 13:16:45.637881 28234 raft_consensus.cc:2243] T 3eea5331f2be4e82ae096a77d8ed4023 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:45.638979 28234 raft_consensus.cc:2272] T 3eea5331f2be4e82ae096a77d8ed4023 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.642131 28234 tablet_replica.cc:333] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d: stopping tablet replica
I20260709 13:16:45.643011 28234 raft_consensus.cc:2243] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:45.644119 28234 raft_consensus.cc:2272] T b7214fe40cbb4728934d178be63cac21 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.646881 28234 tablet_replica.cc:333] T d449aa6b57b3466a91a42fca7495a248 P 7c45cd47cdbf4b93ba0e20539d18b63d: stopping tablet replica
I20260709 13:16:45.647663 28234 raft_consensus.cc:2243] T d449aa6b57b3466a91a42fca7495a248 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:45.648895 28234 raft_consensus.cc:2272] T d449aa6b57b3466a91a42fca7495a248 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.652251 28234 tablet_replica.cc:333] T 047f830ce7f94325ac2b7a5bbcbb288e P 7c45cd47cdbf4b93ba0e20539d18b63d: stopping tablet replica
I20260709 13:16:45.653019 28234 raft_consensus.cc:2243] T 047f830ce7f94325ac2b7a5bbcbb288e P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:45.653738 28234 raft_consensus.cc:2272] T 047f830ce7f94325ac2b7a5bbcbb288e P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.658427 28234 tablet_replica.cc:333] T b3020531bc3d46fab66a8de40da58a22 P 7c45cd47cdbf4b93ba0e20539d18b63d: stopping tablet replica
I20260709 13:16:45.659409 28234 raft_consensus.cc:2243] T b3020531bc3d46fab66a8de40da58a22 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:45.660290 28234 raft_consensus.cc:2272] T b3020531bc3d46fab66a8de40da58a22 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.663800 28234 tablet_replica.cc:333] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d: stopping tablet replica
I20260709 13:16:45.664491 28234 raft_consensus.cc:2243] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:45.666018 28234 raft_consensus.cc:2272] T 5bbbdedc18e448da998c67da78c28236 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.668850 28234 tablet_replica.cc:333] T 03c0eb40dfe644029acaf5902efd770f P 7c45cd47cdbf4b93ba0e20539d18b63d: stopping tablet replica
I20260709 13:16:45.669761 28234 raft_consensus.cc:2243] T 03c0eb40dfe644029acaf5902efd770f P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:45.671236 28234 raft_consensus.cc:2272] T 03c0eb40dfe644029acaf5902efd770f P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.674283 28234 tablet_replica.cc:333] T 5e7913de22ae481cb204173005d94d41 P 7c45cd47cdbf4b93ba0e20539d18b63d: stopping tablet replica
I20260709 13:16:45.674912 28234 raft_consensus.cc:2243] T 5e7913de22ae481cb204173005d94d41 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:45.676096 28234 raft_consensus.cc:2272] T 5e7913de22ae481cb204173005d94d41 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.678841 28234 tablet_replica.cc:333] T 13401e98748b4f1a9cc0827692efd70a P 7c45cd47cdbf4b93ba0e20539d18b63d: stopping tablet replica
I20260709 13:16:45.679768 28234 raft_consensus.cc:2243] T 13401e98748b4f1a9cc0827692efd70a P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:45.680392 28234 raft_consensus.cc:2272] T 13401e98748b4f1a9cc0827692efd70a P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.682839 28234 tablet_replica.cc:333] T fca02db7c6d047448afb5d1e0c861d24 P 7c45cd47cdbf4b93ba0e20539d18b63d: stopping tablet replica
I20260709 13:16:45.683578 28234 raft_consensus.cc:2243] T fca02db7c6d047448afb5d1e0c861d24 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:45.684304 28234 raft_consensus.cc:2272] T fca02db7c6d047448afb5d1e0c861d24 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.688526 28234 tablet_replica.cc:333] T 254e6899d958489e9e02130bfbc4cdf8 P 7c45cd47cdbf4b93ba0e20539d18b63d: stopping tablet replica
I20260709 13:16:45.689226 28234 raft_consensus.cc:2243] T 254e6899d958489e9e02130bfbc4cdf8 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:45.690323 28234 raft_consensus.cc:2272] T 254e6899d958489e9e02130bfbc4cdf8 P 7c45cd47cdbf4b93ba0e20539d18b63d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.694025 28234 tablet_replica.cc:333] T 042aa79c19c34c80be5b1523a342312b P 7c45cd47cdbf4b93ba0e20539d18b63d: stopping tablet replica
I20260709 13:16:45.694684 28234 raft_consensus.cc:2243] T 042aa79c19c34c80be5b1523a342312b P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:45.695739 28234 raft_consensus.cc:2272] T 042aa79c19c34c80be5b1523a342312b P 7c45cd47cdbf4b93ba0e20539d18b63d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.750662 28234 tablet_server.cc:196] TabletServer@127.27.146.131:0 shutdown complete.
I20260709 13:16:45.797878 28234 master.cc:562] Master@127.27.146.190:46761 shutting down...
I20260709 13:16:45.829602 28234 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 97eda03e8cdb44d791ffb8e7962b9113 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:45.830317 28234 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 97eda03e8cdb44d791ffb8e7962b9113 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:45.830654 28234 tablet_replica.cc:333] T 00000000000000000000000000000000 P 97eda03e8cdb44d791ffb8e7962b9113: stopping tablet replica
I20260709 13:16:45.853050 28234 master.cc:584] Master@127.27.146.190:46761 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (13890 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:16:45.924705 28234 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.27.146.190:41839
I20260709 13:16:45.926260 28234 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:45.933049  8101 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:45.934093  8103 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:45.934446  8100 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:45.935398 28234 server_base.cc:1061] running on GCE node
I20260709 13:16:45.936594 28234 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:45.936810 28234 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:45.936969 28234 hybrid_clock.cc:648] HybridClock initialized: now 1783603005936940 us; error 0 us; skew 500 ppm
I20260709 13:16:45.937563 28234 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:45.941044 28234 webserver.cc:533] Webserver started at http://127.27.146.190:36191/ using document root <none> and password file <none>
I20260709 13:16:45.941694 28234 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:45.941926 28234 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:45.942279 28234 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:45.943740 28234 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602648606606-28234-0/minicluster-data/master-0-root/instance:
uuid: "c95545f8d2964094ab29b977e7a0efd4"
format_stamp: "Formatted at 2026-07-09 13:16:45 on dist-test-slave-clfv"
I20260709 13:16:45.949373 28234 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:16:45.953778  8108 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:45.954658 28234 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:16:45.955060 28234 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602648606606-28234-0/minicluster-data/master-0-root
uuid: "c95545f8d2964094ab29b977e7a0efd4"
format_stamp: "Formatted at 2026-07-09 13:16:45 on dist-test-slave-clfv"
I20260709 13:16:45.955374 28234 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602648606606-28234-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602648606606-28234-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602648606606-28234-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:45.981002 28234 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:45.982631 28234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:46.034039 28234 rpc_server.cc:307] RPC server started. Bound to: 127.27.146.190:41839
I20260709 13:16:46.034157  8159 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.146.190:41839 every 8 connection(s)
I20260709 13:16:46.038467  8160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.051965  8160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c95545f8d2964094ab29b977e7a0efd4: Bootstrap starting.
I20260709 13:16:46.059944  8160 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c95545f8d2964094ab29b977e7a0efd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.065883  8160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c95545f8d2964094ab29b977e7a0efd4: No bootstrap required, opened a new log
I20260709 13:16:46.069027  8160 raft_consensus.cc:359] T 00000000000000000000000000000000 P c95545f8d2964094ab29b977e7a0efd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c95545f8d2964094ab29b977e7a0efd4" member_type: VOTER }
I20260709 13:16:46.069519  8160 raft_consensus.cc:385] T 00000000000000000000000000000000 P c95545f8d2964094ab29b977e7a0efd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.069711  8160 raft_consensus.cc:740] T 00000000000000000000000000000000 P c95545f8d2964094ab29b977e7a0efd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95545f8d2964094ab29b977e7a0efd4, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.070314  8160 consensus_queue.cc:260] T 00000000000000000000000000000000 P c95545f8d2964094ab29b977e7a0efd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c95545f8d2964094ab29b977e7a0efd4" member_type: VOTER }
I20260709 13:16:46.070775  8160 raft_consensus.cc:399] T 00000000000000000000000000000000 P c95545f8d2964094ab29b977e7a0efd4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:16:46.070974  8160 raft_consensus.cc:493] T 00000000000000000000000000000000 P c95545f8d2964094ab29b977e7a0efd4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:16:46.071206  8160 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c95545f8d2964094ab29b977e7a0efd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.077379  8160 raft_consensus.cc:515] T 00000000000000000000000000000000 P c95545f8d2964094ab29b977e7a0efd4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c95545f8d2964094ab29b977e7a0efd4" member_type: VOTER }
I20260709 13:16:46.077989  8160 leader_election.cc:304] T 00000000000000000000000000000000 P c95545f8d2964094ab29b977e7a0efd4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c95545f8d2964094ab29b977e7a0efd4; no voters: 
I20260709 13:16:46.079339  8160 leader_election.cc:290] T 00000000000000000000000000000000 P c95545f8d2964094ab29b977e7a0efd4 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:16:46.079952  8163 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c95545f8d2964094ab29b977e7a0efd4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:46.081650  8163 raft_consensus.cc:697] T 00000000000000000000000000000000 P c95545f8d2964094ab29b977e7a0efd4 [term 1 LEADER]: Becoming Leader. State: Replica: c95545f8d2964094ab29b977e7a0efd4, State: Running, Role: LEADER
I20260709 13:16:46.082472  8163 consensus_queue.cc:237] T 00000000000000000000000000000000 P c95545f8d2964094ab29b977e7a0efd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c95545f8d2964094ab29b977e7a0efd4" member_type: VOTER }
I20260709 13:16:46.082789  8160 sys_catalog.cc:565] T 00000000000000000000000000000000 P c95545f8d2964094ab29b977e7a0efd4 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:16:46.087627  8164 sys_catalog.cc:455] T 00000000000000000000000000000000 P c95545f8d2964094ab29b977e7a0efd4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c95545f8d2964094ab29b977e7a0efd4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c95545f8d2964094ab29b977e7a0efd4" member_type: VOTER } }
I20260709 13:16:46.088505  8164 sys_catalog.cc:458] T 00000000000000000000000000000000 P c95545f8d2964094ab29b977e7a0efd4 [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:46.087627  8165 sys_catalog.cc:455] T 00000000000000000000000000000000 P c95545f8d2964094ab29b977e7a0efd4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c95545f8d2964094ab29b977e7a0efd4. Latest consensus state: current_term: 1 leader_uuid: "c95545f8d2964094ab29b977e7a0efd4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c95545f8d2964094ab29b977e7a0efd4" member_type: VOTER } }
I20260709 13:16:46.089322  8165 sys_catalog.cc:458] T 00000000000000000000000000000000 P c95545f8d2964094ab29b977e7a0efd4 [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:46.092907  8170 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:16:46.102173  8170 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:16:46.103421 28234 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:16:46.114138  8170 catalog_manager.cc:1383] Generated new cluster ID: 180880d1f82043058a02e55e3aa9f6d2
I20260709 13:16:46.114513  8170 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:16:46.141772  8170 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:16:46.143326  8170 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:16:46.156978  8170 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c95545f8d2964094ab29b977e7a0efd4: Generated new TSK 0
I20260709 13:16:46.157789  8170 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:16:46.171139 28234 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:46.178057  8181 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:46.179659  8182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:46.180934  8184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:46.181973 28234 server_base.cc:1061] running on GCE node
I20260709 13:16:46.183075 28234 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:46.183279 28234 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:46.183528 28234 hybrid_clock.cc:648] HybridClock initialized: now 1783603006183466 us; error 0 us; skew 500 ppm
I20260709 13:16:46.184218 28234 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:46.187037 28234 webserver.cc:533] Webserver started at http://127.27.146.129:43919/ using document root <none> and password file <none>
I20260709 13:16:46.187637 28234 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:46.187865 28234 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:46.188171 28234 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:46.189471 28234 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602648606606-28234-0/minicluster-data/ts-0-root/instance:
uuid: "40136f5ac8c040d18bcea0a86211be68"
format_stamp: "Formatted at 2026-07-09 13:16:46 on dist-test-slave-clfv"
I20260709 13:16:46.195637 28234 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:16:46.200407  8189 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:46.201598 28234 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.002s
I20260709 13:16:46.201982 28234 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602648606606-28234-0/minicluster-data/ts-0-root
uuid: "40136f5ac8c040d18bcea0a86211be68"
format_stamp: "Formatted at 2026-07-09 13:16:46 on dist-test-slave-clfv"
I20260709 13:16:46.202335 28234 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602648606606-28234-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602648606606-28234-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602648606606-28234-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:46.238027 28234 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:46.239605 28234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:46.241676 28234 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:46.244517 28234 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:46.245014 28234 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.000s	sys 0.000s
I20260709 13:16:46.245323 28234 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:46.245667 28234 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:46.298902 28234 rpc_server.cc:307] RPC server started. Bound to: 127.27.146.129:43503
I20260709 13:16:46.299018  8251 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.146.129:43503 every 8 connection(s)
I20260709 13:16:46.306034 28234 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:46.315974  8257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:46.316098  8256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:46.318679  8259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:46.320466 28234 server_base.cc:1061] running on GCE node
I20260709 13:16:46.322386 28234 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:46.322763 28234 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:46.322999 28234 hybrid_clock.cc:648] HybridClock initialized: now 1783603006322974 us; error 0 us; skew 500 ppm
I20260709 13:16:46.323801 28234 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:46.324725  8252 heartbeater.cc:344] Connected to a master server at 127.27.146.190:41839
I20260709 13:16:46.325152  8252 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:46.326336  8252 heartbeater.cc:507] Master 127.27.146.190:41839 requested a full tablet report, sending...
I20260709 13:16:46.327756 28234 webserver.cc:533] Webserver started at http://127.27.146.130:43353/ using document root <none> and password file <none>
I20260709 13:16:46.328516 28234 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:46.328760 28234 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:46.329064 28234 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:46.329383  8125 ts_manager.cc:194] Registered new tserver with Master: 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503)
I20260709 13:16:46.330693 28234 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602648606606-28234-0/minicluster-data/ts-1-root/instance:
uuid: "b29a30c058b24b799c64511edcc51af1"
format_stamp: "Formatted at 2026-07-09 13:16:46 on dist-test-slave-clfv"
I20260709 13:16:46.331664  8125 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35396
I20260709 13:16:46.336601 28234 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.002s
I20260709 13:16:46.341435  8264 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:46.342521 28234 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:16:46.342833 28234 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602648606606-28234-0/minicluster-data/ts-1-root
uuid: "b29a30c058b24b799c64511edcc51af1"
format_stamp: "Formatted at 2026-07-09 13:16:46 on dist-test-slave-clfv"
I20260709 13:16:46.343118 28234 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602648606606-28234-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602648606606-28234-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602648606606-28234-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:46.362367 28234 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:46.364073 28234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:46.366292 28234 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:46.369365 28234 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:46.369594 28234 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:46.369938 28234 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:46.370105 28234 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:46.426950 28234 rpc_server.cc:307] RPC server started. Bound to: 127.27.146.130:39155
I20260709 13:16:46.427374  8326 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.146.130:39155 every 8 connection(s)
I20260709 13:16:46.433094 28234 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:46.442283  8330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:46.446349  8331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:46.451764  8327 heartbeater.cc:344] Connected to a master server at 127.27.146.190:41839
I20260709 13:16:46.452673  8327 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:46.453796  8327 heartbeater.cc:507] Master 127.27.146.190:41839 requested a full tablet report, sending...
W20260709 13:16:46.454541  8333 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:46.454705 28234 server_base.cc:1061] running on GCE node
I20260709 13:16:46.456053 28234 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:46.456322 28234 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:46.456516 28234 hybrid_clock.cc:648] HybridClock initialized: now 1783603006456498 us; error 0 us; skew 500 ppm
I20260709 13:16:46.456616  8125 ts_manager.cc:194] Registered new tserver with Master: b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155)
I20260709 13:16:46.457226 28234 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:46.458940  8125 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35408
I20260709 13:16:46.461297 28234 webserver.cc:533] Webserver started at http://127.27.146.131:36637/ using document root <none> and password file <none>
I20260709 13:16:46.462057 28234 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:46.462281 28234 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:46.462627 28234 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:46.464095 28234 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602648606606-28234-0/minicluster-data/ts-2-root/instance:
uuid: "293fa96e53fc447285b9eaec7ba3d452"
format_stamp: "Formatted at 2026-07-09 13:16:46 on dist-test-slave-clfv"
I20260709 13:16:46.469934 28234 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:16:46.474263  8338 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:46.475364 28234 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 13:16:46.475747 28234 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602648606606-28234-0/minicluster-data/ts-2-root
uuid: "293fa96e53fc447285b9eaec7ba3d452"
format_stamp: "Formatted at 2026-07-09 13:16:46 on dist-test-slave-clfv"
I20260709 13:16:46.476034 28234 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602648606606-28234-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602648606606-28234-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskEjxuNk/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602648606606-28234-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:46.489392 28234 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:46.490801 28234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:46.492547 28234 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:46.495790 28234 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:46.496023 28234 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:46.496349 28234 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:46.496498 28234 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:46.548667 28234 rpc_server.cc:307] RPC server started. Bound to: 127.27.146.131:36869
I20260709 13:16:46.548789  8400 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.146.131:36869 every 8 connection(s)
I20260709 13:16:46.564927  8401 heartbeater.cc:344] Connected to a master server at 127.27.146.190:41839
I20260709 13:16:46.565546  8401 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:46.566464  8401 heartbeater.cc:507] Master 127.27.146.190:41839 requested a full tablet report, sending...
I20260709 13:16:46.568989  8125 ts_manager.cc:194] Registered new tserver with Master: 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:46.569819 28234 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017510367s
I20260709 13:16:46.571293  8125 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35422
I20260709 13:16:46.604864  8125 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35430:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:16:46.607985  8125 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:16:46.687209  8292 tablet_service.cc:1511] Processing CreateTablet for tablet 8c22e7a7140249b2a7e0e7250fa6c63d (DEFAULT_TABLE table=test-workload [id=0cf05a4bf69943d1b5a58ec3b457ad12]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:46.689086  8292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c22e7a7140249b2a7e0e7250fa6c63d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.698675  8291 tablet_service.cc:1511] Processing CreateTablet for tablet c346f6db2c27498fbf2e803ac5a47629 (DEFAULT_TABLE table=test-workload [id=0cf05a4bf69943d1b5a58ec3b457ad12]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:46.700620  8291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c346f6db2c27498fbf2e803ac5a47629. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.700439  8216 tablet_service.cc:1511] Processing CreateTablet for tablet c346f6db2c27498fbf2e803ac5a47629 (DEFAULT_TABLE table=test-workload [id=0cf05a4bf69943d1b5a58ec3b457ad12]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:46.701269  8217 tablet_service.cc:1511] Processing CreateTablet for tablet 8c22e7a7140249b2a7e0e7250fa6c63d (DEFAULT_TABLE table=test-workload [id=0cf05a4bf69943d1b5a58ec3b457ad12]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:46.704105  8290 tablet_service.cc:1511] Processing CreateTablet for tablet caa758e90c4b498690b7598eb7b021a5 (DEFAULT_TABLE table=test-workload [id=0cf05a4bf69943d1b5a58ec3b457ad12]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:46.704743  8215 tablet_service.cc:1511] Processing CreateTablet for tablet caa758e90c4b498690b7598eb7b021a5 (DEFAULT_TABLE table=test-workload [id=0cf05a4bf69943d1b5a58ec3b457ad12]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:46.706207  8290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caa758e90c4b498690b7598eb7b021a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.706921  8214 tablet_service.cc:1511] Processing CreateTablet for tablet a7bad7246022445bb86fa0f48a3afd6f (DEFAULT_TABLE table=test-workload [id=0cf05a4bf69943d1b5a58ec3b457ad12]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:46.706784  8212 tablet_service.cc:1511] Processing CreateTablet for tablet bc5215886f3d4f0eb3364d518fb846bc (DEFAULT_TABLE table=test-workload [id=0cf05a4bf69943d1b5a58ec3b457ad12]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:46.708709  8217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c22e7a7140249b2a7e0e7250fa6c63d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.708914  8213 tablet_service.cc:1511] Processing CreateTablet for tablet 79bac7eaf2b54d5ebb8697bde03f3ea9 (DEFAULT_TABLE table=test-workload [id=0cf05a4bf69943d1b5a58ec3b457ad12]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:46.710629  8213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79bac7eaf2b54d5ebb8697bde03f3ea9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.710472  8289 tablet_service.cc:1511] Processing CreateTablet for tablet a7bad7246022445bb86fa0f48a3afd6f (DEFAULT_TABLE table=test-workload [id=0cf05a4bf69943d1b5a58ec3b457ad12]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:46.711980  8289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7bad7246022445bb86fa0f48a3afd6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.712411  8288 tablet_service.cc:1511] Processing CreateTablet for tablet 79bac7eaf2b54d5ebb8697bde03f3ea9 (DEFAULT_TABLE table=test-workload [id=0cf05a4bf69943d1b5a58ec3b457ad12]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:46.713877  8288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79bac7eaf2b54d5ebb8697bde03f3ea9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.716400  8214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7bad7246022445bb86fa0f48a3afd6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.720139  8212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc5215886f3d4f0eb3364d518fb846bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.722887  8215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caa758e90c4b498690b7598eb7b021a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.728323  8216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c346f6db2c27498fbf2e803ac5a47629. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.757813  8287 tablet_service.cc:1511] Processing CreateTablet for tablet bc5215886f3d4f0eb3364d518fb846bc (DEFAULT_TABLE table=test-workload [id=0cf05a4bf69943d1b5a58ec3b457ad12]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:46.759806  8211 tablet_service.cc:1511] Processing CreateTablet for tablet 6cfddc3bdd0b4550b4672e0cf720cd39 (DEFAULT_TABLE table=test-workload [id=0cf05a4bf69943d1b5a58ec3b457ad12]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:46.772092  8211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cfddc3bdd0b4550b4672e0cf720cd39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.761955  8287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc5215886f3d4f0eb3364d518fb846bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.779266  8290 tablet_service.cc:1511] Processing CreateTablet for tablet 6cfddc3bdd0b4550b4672e0cf720cd39 (DEFAULT_TABLE table=test-workload [id=0cf05a4bf69943d1b5a58ec3b457ad12]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:46.787390  8363 tablet_service.cc:1511] Processing CreateTablet for tablet a7bad7246022445bb86fa0f48a3afd6f (DEFAULT_TABLE table=test-workload [id=0cf05a4bf69943d1b5a58ec3b457ad12]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:46.792501  8290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cfddc3bdd0b4550b4672e0cf720cd39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.792941  8363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7bad7246022445bb86fa0f48a3afd6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.759385  8415 tablet_bootstrap.cc:492] T caa758e90c4b498690b7598eb7b021a5 P b29a30c058b24b799c64511edcc51af1: Bootstrap starting.
I20260709 13:16:46.788632  8362 tablet_service.cc:1511] Processing CreateTablet for tablet 79bac7eaf2b54d5ebb8697bde03f3ea9 (DEFAULT_TABLE table=test-workload [id=0cf05a4bf69943d1b5a58ec3b457ad12]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:46.790020  8361 tablet_service.cc:1511] Processing CreateTablet for tablet bc5215886f3d4f0eb3364d518fb846bc (DEFAULT_TABLE table=test-workload [id=0cf05a4bf69943d1b5a58ec3b457ad12]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:46.782253  8366 tablet_service.cc:1511] Processing CreateTablet for tablet 8c22e7a7140249b2a7e0e7250fa6c63d (DEFAULT_TABLE table=test-workload [id=0cf05a4bf69943d1b5a58ec3b457ad12]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:46.784197  8365 tablet_service.cc:1511] Processing CreateTablet for tablet c346f6db2c27498fbf2e803ac5a47629 (DEFAULT_TABLE table=test-workload [id=0cf05a4bf69943d1b5a58ec3b457ad12]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:46.784446  8360 tablet_service.cc:1511] Processing CreateTablet for tablet 6cfddc3bdd0b4550b4672e0cf720cd39 (DEFAULT_TABLE table=test-workload [id=0cf05a4bf69943d1b5a58ec3b457ad12]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:46.795481  8362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79bac7eaf2b54d5ebb8697bde03f3ea9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.801702  8360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cfddc3bdd0b4550b4672e0cf720cd39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.803215  8365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c346f6db2c27498fbf2e803ac5a47629. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.804795  8366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c22e7a7140249b2a7e0e7250fa6c63d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.807914  8361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc5215886f3d4f0eb3364d518fb846bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.784175  8217 tablet_service.cc:1511] Processing CreateTablet for tablet b39ad7757ad748238fab733ef5360084 (DEFAULT_TABLE table=test-workload [id=0cf05a4bf69943d1b5a58ec3b457ad12]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:46.785509  8364 tablet_service.cc:1511] Processing CreateTablet for tablet caa758e90c4b498690b7598eb7b021a5 (DEFAULT_TABLE table=test-workload [id=0cf05a4bf69943d1b5a58ec3b457ad12]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:46.812418  8364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caa758e90c4b498690b7598eb7b021a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.818300  8217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b39ad7757ad748238fab733ef5360084. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.835254  8415 tablet_bootstrap.cc:654] T caa758e90c4b498690b7598eb7b021a5 P b29a30c058b24b799c64511edcc51af1: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:46.855837  8112 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.27.146.130:39155, user_credentials={real_user=slave}} blocked reactor thread for 45371.7us
I20260709 13:16:46.861311  8288 tablet_service.cc:1511] Processing CreateTablet for tablet b39ad7757ad748238fab733ef5360084 (DEFAULT_TABLE table=test-workload [id=0cf05a4bf69943d1b5a58ec3b457ad12]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:46.862917  8288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b39ad7757ad748238fab733ef5360084. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.760960  8416 tablet_bootstrap.cc:492] T 8c22e7a7140249b2a7e0e7250fa6c63d P 40136f5ac8c040d18bcea0a86211be68: Bootstrap starting.
I20260709 13:16:46.866511  8359 tablet_service.cc:1511] Processing CreateTablet for tablet b39ad7757ad748238fab733ef5360084 (DEFAULT_TABLE table=test-workload [id=0cf05a4bf69943d1b5a58ec3b457ad12]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:46.866359  8212 tablet_service.cc:1511] Processing CreateTablet for tablet cd1da709c81d4c17a8308b204dca7be7 (DEFAULT_TABLE table=test-workload [id=0cf05a4bf69943d1b5a58ec3b457ad12]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:46.868382  8359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b39ad7757ad748238fab733ef5360084. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.869069  8212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd1da709c81d4c17a8308b204dca7be7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.890818  8358 tablet_service.cc:1511] Processing CreateTablet for tablet cd1da709c81d4c17a8308b204dca7be7 (DEFAULT_TABLE table=test-workload [id=0cf05a4bf69943d1b5a58ec3b457ad12]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:46.892560  8358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd1da709c81d4c17a8308b204dca7be7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.888411  8289 tablet_service.cc:1511] Processing CreateTablet for tablet cd1da709c81d4c17a8308b204dca7be7 (DEFAULT_TABLE table=test-workload [id=0cf05a4bf69943d1b5a58ec3b457ad12]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:46.899511  8289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd1da709c81d4c17a8308b204dca7be7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:46.917491  8415 tablet_bootstrap.cc:492] T caa758e90c4b498690b7598eb7b021a5 P b29a30c058b24b799c64511edcc51af1: No bootstrap required, opened a new log
I20260709 13:16:46.918243  8415 ts_tablet_manager.cc:1403] T caa758e90c4b498690b7598eb7b021a5 P b29a30c058b24b799c64511edcc51af1: Time spent bootstrapping tablet: real 0.160s	user 0.025s	sys 0.056s
I20260709 13:16:46.921708  8415 raft_consensus.cc:359] T caa758e90c4b498690b7598eb7b021a5 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:46.922510  8415 raft_consensus.cc:385] T caa758e90c4b498690b7598eb7b021a5 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.922817  8415 raft_consensus.cc:740] T caa758e90c4b498690b7598eb7b021a5 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b29a30c058b24b799c64511edcc51af1, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.927858  8415 consensus_queue.cc:260] T caa758e90c4b498690b7598eb7b021a5 P b29a30c058b24b799c64511edcc51af1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:46.937155  8416 tablet_bootstrap.cc:654] T 8c22e7a7140249b2a7e0e7250fa6c63d P 40136f5ac8c040d18bcea0a86211be68: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.948879  8418 tablet_bootstrap.cc:492] T b39ad7757ad748238fab733ef5360084 P 293fa96e53fc447285b9eaec7ba3d452: Bootstrap starting.
I20260709 13:16:46.980057  8418 tablet_bootstrap.cc:654] T b39ad7757ad748238fab733ef5360084 P 293fa96e53fc447285b9eaec7ba3d452: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.987040  8327 heartbeater.cc:499] Master 127.27.146.190:41839 was elected leader, sending a full tablet report...
I20260709 13:16:46.987790  8415 ts_tablet_manager.cc:1434] T caa758e90c4b498690b7598eb7b021a5 P b29a30c058b24b799c64511edcc51af1: Time spent starting tablet: real 0.069s	user 0.027s	sys 0.035s
I20260709 13:16:46.995132  8415 tablet_bootstrap.cc:492] T a7bad7246022445bb86fa0f48a3afd6f P b29a30c058b24b799c64511edcc51af1: Bootstrap starting.
I20260709 13:16:47.003374  8415 tablet_bootstrap.cc:654] T a7bad7246022445bb86fa0f48a3afd6f P b29a30c058b24b799c64511edcc51af1: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.011179  8416 tablet_bootstrap.cc:492] T 8c22e7a7140249b2a7e0e7250fa6c63d P 40136f5ac8c040d18bcea0a86211be68: No bootstrap required, opened a new log
I20260709 13:16:47.011686  8418 tablet_bootstrap.cc:492] T b39ad7757ad748238fab733ef5360084 P 293fa96e53fc447285b9eaec7ba3d452: No bootstrap required, opened a new log
I20260709 13:16:47.012068  8416 ts_tablet_manager.cc:1403] T 8c22e7a7140249b2a7e0e7250fa6c63d P 40136f5ac8c040d18bcea0a86211be68: Time spent bootstrapping tablet: real 0.252s	user 0.022s	sys 0.005s
I20260709 13:16:47.012315  8418 ts_tablet_manager.cc:1403] T b39ad7757ad748238fab733ef5360084 P 293fa96e53fc447285b9eaec7ba3d452: Time spent bootstrapping tablet: real 0.064s	user 0.028s	sys 0.008s
I20260709 13:16:47.015902  8418 raft_consensus.cc:359] T b39ad7757ad748238fab733ef5360084 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.016788  8416 raft_consensus.cc:359] T 8c22e7a7140249b2a7e0e7250fa6c63d P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.018146  8416 raft_consensus.cc:385] T 8c22e7a7140249b2a7e0e7250fa6c63d P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.018491  8416 raft_consensus.cc:740] T 8c22e7a7140249b2a7e0e7250fa6c63d P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40136f5ac8c040d18bcea0a86211be68, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.016830  8418 raft_consensus.cc:385] T b39ad7757ad748238fab733ef5360084 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.018826  8415 tablet_bootstrap.cc:492] T a7bad7246022445bb86fa0f48a3afd6f P b29a30c058b24b799c64511edcc51af1: No bootstrap required, opened a new log
I20260709 13:16:47.018965  8418 raft_consensus.cc:740] T b39ad7757ad748238fab733ef5360084 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293fa96e53fc447285b9eaec7ba3d452, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.019572  8415 ts_tablet_manager.cc:1403] T a7bad7246022445bb86fa0f48a3afd6f P b29a30c058b24b799c64511edcc51af1: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.001s
I20260709 13:16:47.019395  8416 consensus_queue.cc:260] T 8c22e7a7140249b2a7e0e7250fa6c63d P 40136f5ac8c040d18bcea0a86211be68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.020253  8418 consensus_queue.cc:260] T b39ad7757ad748238fab733ef5360084 P 293fa96e53fc447285b9eaec7ba3d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.024237  8415 raft_consensus.cc:359] T a7bad7246022445bb86fa0f48a3afd6f P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.025589  8415 raft_consensus.cc:385] T a7bad7246022445bb86fa0f48a3afd6f P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.025945  8415 raft_consensus.cc:740] T a7bad7246022445bb86fa0f48a3afd6f P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b29a30c058b24b799c64511edcc51af1, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.026997  8415 consensus_queue.cc:260] T a7bad7246022445bb86fa0f48a3afd6f P b29a30c058b24b799c64511edcc51af1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.027798  8401 heartbeater.cc:499] Master 127.27.146.190:41839 was elected leader, sending a full tablet report...
I20260709 13:16:47.028337  8418 ts_tablet_manager.cc:1434] T b39ad7757ad748238fab733ef5360084 P 293fa96e53fc447285b9eaec7ba3d452: Time spent starting tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:16:47.029489  8418 tablet_bootstrap.cc:492] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 293fa96e53fc447285b9eaec7ba3d452: Bootstrap starting.
I20260709 13:16:47.029503  8415 ts_tablet_manager.cc:1434] T a7bad7246022445bb86fa0f48a3afd6f P b29a30c058b24b799c64511edcc51af1: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:16:47.030835  8415 tablet_bootstrap.cc:492] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P b29a30c058b24b799c64511edcc51af1: Bootstrap starting.
I20260709 13:16:47.027860  8252 heartbeater.cc:499] Master 127.27.146.190:41839 was elected leader, sending a full tablet report...
I20260709 13:16:47.037045  8418 tablet_bootstrap.cc:654] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 293fa96e53fc447285b9eaec7ba3d452: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.038172  8415 tablet_bootstrap.cc:654] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P b29a30c058b24b799c64511edcc51af1: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.040206  8416 ts_tablet_manager.cc:1434] T 8c22e7a7140249b2a7e0e7250fa6c63d P 40136f5ac8c040d18bcea0a86211be68: Time spent starting tablet: real 0.028s	user 0.013s	sys 0.000s
I20260709 13:16:47.041445  8416 tablet_bootstrap.cc:492] T a7bad7246022445bb86fa0f48a3afd6f P 40136f5ac8c040d18bcea0a86211be68: Bootstrap starting.
I20260709 13:16:47.047379  8416 tablet_bootstrap.cc:654] T a7bad7246022445bb86fa0f48a3afd6f P 40136f5ac8c040d18bcea0a86211be68: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:47.053526  8402 tablet.cc:2406] T b39ad7757ad748238fab733ef5360084 P 293fa96e53fc447285b9eaec7ba3d452: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:16:47.054562  8418 tablet_bootstrap.cc:492] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 293fa96e53fc447285b9eaec7ba3d452: No bootstrap required, opened a new log
I20260709 13:16:47.055272  8418 ts_tablet_manager.cc:1403] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 293fa96e53fc447285b9eaec7ba3d452: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.004s
I20260709 13:16:47.056571  8423 raft_consensus.cc:493] T 8c22e7a7140249b2a7e0e7250fa6c63d P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.057333  8423 raft_consensus.cc:515] T 8c22e7a7140249b2a7e0e7250fa6c63d P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.059451  8418 raft_consensus.cc:359] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.060488  8418 raft_consensus.cc:385] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.060870  8418 raft_consensus.cc:740] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293fa96e53fc447285b9eaec7ba3d452, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.062062  8418 consensus_queue.cc:260] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 293fa96e53fc447285b9eaec7ba3d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.065966  8418 ts_tablet_manager.cc:1434] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 293fa96e53fc447285b9eaec7ba3d452: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 13:16:47.067226  8418 tablet_bootstrap.cc:492] T 8c22e7a7140249b2a7e0e7250fa6c63d P 293fa96e53fc447285b9eaec7ba3d452: Bootstrap starting.
I20260709 13:16:47.075222  8418 tablet_bootstrap.cc:654] T 8c22e7a7140249b2a7e0e7250fa6c63d P 293fa96e53fc447285b9eaec7ba3d452: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.083122  8423 leader_election.cc:290] T 8c22e7a7140249b2a7e0e7250fa6c63d P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:47.086916  8415 tablet_bootstrap.cc:492] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P b29a30c058b24b799c64511edcc51af1: No bootstrap required, opened a new log
I20260709 13:16:47.087832  8415 ts_tablet_manager.cc:1403] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P b29a30c058b24b799c64511edcc51af1: Time spent bootstrapping tablet: real 0.057s	user 0.023s	sys 0.021s
I20260709 13:16:47.088575  8418 tablet_bootstrap.cc:492] T 8c22e7a7140249b2a7e0e7250fa6c63d P 293fa96e53fc447285b9eaec7ba3d452: No bootstrap required, opened a new log
I20260709 13:16:47.089214  8418 ts_tablet_manager.cc:1403] T 8c22e7a7140249b2a7e0e7250fa6c63d P 293fa96e53fc447285b9eaec7ba3d452: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.003s
I20260709 13:16:47.092295  8415 raft_consensus.cc:359] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
W20260709 13:16:47.095659  8173 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:47.096555  8415 raft_consensus.cc:385] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.097577  8302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c22e7a7140249b2a7e0e7250fa6c63d" candidate_uuid: "40136f5ac8c040d18bcea0a86211be68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b29a30c058b24b799c64511edcc51af1" is_pre_election: true
I20260709 13:16:47.098093  8415 raft_consensus.cc:740] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b29a30c058b24b799c64511edcc51af1, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.098932  8418 raft_consensus.cc:359] T 8c22e7a7140249b2a7e0e7250fa6c63d P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
W20260709 13:16:47.099413  8193 leader_election.cc:343] T 8c22e7a7140249b2a7e0e7250fa6c63d P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.099156  8415 consensus_queue.cc:260] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P b29a30c058b24b799c64511edcc51af1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.097993  8416 tablet_bootstrap.cc:492] T a7bad7246022445bb86fa0f48a3afd6f P 40136f5ac8c040d18bcea0a86211be68: No bootstrap required, opened a new log
I20260709 13:16:47.099838  8418 raft_consensus.cc:385] T 8c22e7a7140249b2a7e0e7250fa6c63d P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.101784  8418 raft_consensus.cc:740] T 8c22e7a7140249b2a7e0e7250fa6c63d P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293fa96e53fc447285b9eaec7ba3d452, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.102051  8416 ts_tablet_manager.cc:1403] T a7bad7246022445bb86fa0f48a3afd6f P 40136f5ac8c040d18bcea0a86211be68: Time spent bootstrapping tablet: real 0.061s	user 0.011s	sys 0.004s
I20260709 13:16:47.102669  8418 consensus_queue.cc:260] T 8c22e7a7140249b2a7e0e7250fa6c63d P 293fa96e53fc447285b9eaec7ba3d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.105978  8418 ts_tablet_manager.cc:1434] T 8c22e7a7140249b2a7e0e7250fa6c63d P 293fa96e53fc447285b9eaec7ba3d452: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.001s
I20260709 13:16:47.106206  8416 raft_consensus.cc:359] T a7bad7246022445bb86fa0f48a3afd6f P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.107227  8416 raft_consensus.cc:385] T a7bad7246022445bb86fa0f48a3afd6f P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.107646  8416 raft_consensus.cc:740] T a7bad7246022445bb86fa0f48a3afd6f P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40136f5ac8c040d18bcea0a86211be68, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.108773  8416 consensus_queue.cc:260] T a7bad7246022445bb86fa0f48a3afd6f P 40136f5ac8c040d18bcea0a86211be68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.110066  8418 tablet_bootstrap.cc:492] T cd1da709c81d4c17a8308b204dca7be7 P 293fa96e53fc447285b9eaec7ba3d452: Bootstrap starting.
I20260709 13:16:47.110651  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c22e7a7140249b2a7e0e7250fa6c63d" candidate_uuid: "40136f5ac8c040d18bcea0a86211be68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293fa96e53fc447285b9eaec7ba3d452" is_pre_election: true
I20260709 13:16:47.111425  8376 raft_consensus.cc:2468] T 8c22e7a7140249b2a7e0e7250fa6c63d P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40136f5ac8c040d18bcea0a86211be68 in term 0.
I20260709 13:16:47.114722  8191 leader_election.cc:304] T 8c22e7a7140249b2a7e0e7250fa6c63d P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293fa96e53fc447285b9eaec7ba3d452, 40136f5ac8c040d18bcea0a86211be68; no voters: b29a30c058b24b799c64511edcc51af1
I20260709 13:16:47.115445  8415 ts_tablet_manager.cc:1434] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P b29a30c058b24b799c64511edcc51af1: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.004s
I20260709 13:16:47.115743  8423 raft_consensus.cc:2804] T 8c22e7a7140249b2a7e0e7250fa6c63d P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:47.116269  8423 raft_consensus.cc:493] T 8c22e7a7140249b2a7e0e7250fa6c63d P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.116695  8423 raft_consensus.cc:3060] T 8c22e7a7140249b2a7e0e7250fa6c63d P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.119522  8415 tablet_bootstrap.cc:492] T c346f6db2c27498fbf2e803ac5a47629 P b29a30c058b24b799c64511edcc51af1: Bootstrap starting.
I20260709 13:16:47.124987  8418 tablet_bootstrap.cc:654] T cd1da709c81d4c17a8308b204dca7be7 P 293fa96e53fc447285b9eaec7ba3d452: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.127185  8416 ts_tablet_manager.cc:1434] T a7bad7246022445bb86fa0f48a3afd6f P 40136f5ac8c040d18bcea0a86211be68: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.004s
I20260709 13:16:47.127965  8415 tablet_bootstrap.cc:654] T c346f6db2c27498fbf2e803ac5a47629 P b29a30c058b24b799c64511edcc51af1: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.132447  8418 tablet_bootstrap.cc:492] T cd1da709c81d4c17a8308b204dca7be7 P 293fa96e53fc447285b9eaec7ba3d452: No bootstrap required, opened a new log
I20260709 13:16:47.131166  8423 raft_consensus.cc:515] T 8c22e7a7140249b2a7e0e7250fa6c63d P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.133152  8418 ts_tablet_manager.cc:1403] T cd1da709c81d4c17a8308b204dca7be7 P 293fa96e53fc447285b9eaec7ba3d452: Time spent bootstrapping tablet: real 0.026s	user 0.006s	sys 0.009s
I20260709 13:16:47.135974  8302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c22e7a7140249b2a7e0e7250fa6c63d" candidate_uuid: "40136f5ac8c040d18bcea0a86211be68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b29a30c058b24b799c64511edcc51af1"
W20260709 13:16:47.137602  8193 leader_election.cc:343] T 8c22e7a7140249b2a7e0e7250fa6c63d P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.137552  8418 raft_consensus.cc:359] T cd1da709c81d4c17a8308b204dca7be7 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.138924  8418 raft_consensus.cc:385] T cd1da709c81d4c17a8308b204dca7be7 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.139361  8418 raft_consensus.cc:740] T cd1da709c81d4c17a8308b204dca7be7 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293fa96e53fc447285b9eaec7ba3d452, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.140497  8418 consensus_queue.cc:260] T cd1da709c81d4c17a8308b204dca7be7 P 293fa96e53fc447285b9eaec7ba3d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.133086  8416 tablet_bootstrap.cc:492] T c346f6db2c27498fbf2e803ac5a47629 P 40136f5ac8c040d18bcea0a86211be68: Bootstrap starting.
I20260709 13:16:47.143798  8418 ts_tablet_manager.cc:1434] T cd1da709c81d4c17a8308b204dca7be7 P 293fa96e53fc447285b9eaec7ba3d452: Time spent starting tablet: real 0.010s	user 0.012s	sys 0.000s
I20260709 13:16:47.145303  8418 tablet_bootstrap.cc:492] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452: Bootstrap starting.
I20260709 13:16:47.152418  8416 tablet_bootstrap.cc:654] T c346f6db2c27498fbf2e803ac5a47629 P 40136f5ac8c040d18bcea0a86211be68: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.154645  8418 tablet_bootstrap.cc:654] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.158203  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c22e7a7140249b2a7e0e7250fa6c63d" candidate_uuid: "40136f5ac8c040d18bcea0a86211be68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293fa96e53fc447285b9eaec7ba3d452"
I20260709 13:16:47.158936  8376 raft_consensus.cc:3060] T 8c22e7a7140249b2a7e0e7250fa6c63d P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.163727  8423 leader_election.cc:290] T 8c22e7a7140249b2a7e0e7250fa6c63d P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 election: Requested vote from peers b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:47.167152  8376 raft_consensus.cc:2468] T 8c22e7a7140249b2a7e0e7250fa6c63d P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40136f5ac8c040d18bcea0a86211be68 in term 1.
I20260709 13:16:47.167852  8415 tablet_bootstrap.cc:492] T c346f6db2c27498fbf2e803ac5a47629 P b29a30c058b24b799c64511edcc51af1: No bootstrap required, opened a new log
I20260709 13:16:47.167867  8418 tablet_bootstrap.cc:492] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452: No bootstrap required, opened a new log
I20260709 13:16:47.168659  8418 ts_tablet_manager.cc:1403] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.007s
I20260709 13:16:47.168668  8415 ts_tablet_manager.cc:1403] T c346f6db2c27498fbf2e803ac5a47629 P b29a30c058b24b799c64511edcc51af1: Time spent bootstrapping tablet: real 0.049s	user 0.025s	sys 0.018s
I20260709 13:16:47.169567  8191 leader_election.cc:304] T 8c22e7a7140249b2a7e0e7250fa6c63d P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293fa96e53fc447285b9eaec7ba3d452, 40136f5ac8c040d18bcea0a86211be68; no voters: b29a30c058b24b799c64511edcc51af1
I20260709 13:16:47.171396  8423 raft_consensus.cc:2804] T 8c22e7a7140249b2a7e0e7250fa6c63d P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:47.172601  8418 raft_consensus.cc:359] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.173527  8415 raft_consensus.cc:359] T c346f6db2c27498fbf2e803ac5a47629 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.174279  8418 raft_consensus.cc:385] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.174378  8415 raft_consensus.cc:385] T c346f6db2c27498fbf2e803ac5a47629 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.174654  8418 raft_consensus.cc:740] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293fa96e53fc447285b9eaec7ba3d452, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.174751  8415 raft_consensus.cc:740] T c346f6db2c27498fbf2e803ac5a47629 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b29a30c058b24b799c64511edcc51af1, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.175792  8418 consensus_queue.cc:260] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.175792  8415 consensus_queue.cc:260] T c346f6db2c27498fbf2e803ac5a47629 P b29a30c058b24b799c64511edcc51af1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.179805  8415 ts_tablet_manager.cc:1434] T c346f6db2c27498fbf2e803ac5a47629 P b29a30c058b24b799c64511edcc51af1: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 13:16:47.177950  8423 raft_consensus.cc:697] T 8c22e7a7140249b2a7e0e7250fa6c63d P 40136f5ac8c040d18bcea0a86211be68 [term 1 LEADER]: Becoming Leader. State: Replica: 40136f5ac8c040d18bcea0a86211be68, State: Running, Role: LEADER
I20260709 13:16:47.179874  8418 ts_tablet_manager.cc:1434] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.004s
I20260709 13:16:47.181581  8418 tablet_bootstrap.cc:492] T c346f6db2c27498fbf2e803ac5a47629 P 293fa96e53fc447285b9eaec7ba3d452: Bootstrap starting.
I20260709 13:16:47.181324  8423 consensus_queue.cc:237] T 8c22e7a7140249b2a7e0e7250fa6c63d P 40136f5ac8c040d18bcea0a86211be68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.182664  8415 tablet_bootstrap.cc:492] T 8c22e7a7140249b2a7e0e7250fa6c63d P b29a30c058b24b799c64511edcc51af1: Bootstrap starting.
I20260709 13:16:47.185039  8419 raft_consensus.cc:493] T caa758e90c4b498690b7598eb7b021a5 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.185638  8419 raft_consensus.cc:515] T caa758e90c4b498690b7598eb7b021a5 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.191525  8418 tablet_bootstrap.cc:654] T c346f6db2c27498fbf2e803ac5a47629 P 293fa96e53fc447285b9eaec7ba3d452: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.191349  8419 leader_election.cc:290] T caa758e90c4b498690b7598eb7b021a5 P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:47.193701  8416 tablet_bootstrap.cc:492] T c346f6db2c27498fbf2e803ac5a47629 P 40136f5ac8c040d18bcea0a86211be68: No bootstrap required, opened a new log
I20260709 13:16:47.194407  8416 ts_tablet_manager.cc:1403] T c346f6db2c27498fbf2e803ac5a47629 P 40136f5ac8c040d18bcea0a86211be68: Time spent bootstrapping tablet: real 0.062s	user 0.015s	sys 0.008s
I20260709 13:16:47.199040  8416 raft_consensus.cc:359] T c346f6db2c27498fbf2e803ac5a47629 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.200448  8416 raft_consensus.cc:385] T c346f6db2c27498fbf2e803ac5a47629 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.200937  8416 raft_consensus.cc:740] T c346f6db2c27498fbf2e803ac5a47629 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40136f5ac8c040d18bcea0a86211be68, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.202033  8416 consensus_queue.cc:260] T c346f6db2c27498fbf2e803ac5a47629 P 40136f5ac8c040d18bcea0a86211be68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.205641  8415 tablet_bootstrap.cc:654] T 8c22e7a7140249b2a7e0e7250fa6c63d P b29a30c058b24b799c64511edcc51af1: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.215462  8419 raft_consensus.cc:493] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.216279  8419 raft_consensus.cc:515] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.217784  8416 ts_tablet_manager.cc:1434] T c346f6db2c27498fbf2e803ac5a47629 P 40136f5ac8c040d18bcea0a86211be68: Time spent starting tablet: real 0.023s	user 0.012s	sys 0.006s
I20260709 13:16:47.219223  8419 leader_election.cc:290] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:47.219422  8416 tablet_bootstrap.cc:492] T bc5215886f3d4f0eb3364d518fb846bc P 40136f5ac8c040d18bcea0a86211be68: Bootstrap starting.
I20260709 13:16:47.223400  8419 raft_consensus.cc:493] T c346f6db2c27498fbf2e803ac5a47629 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.223984  8419 raft_consensus.cc:515] T c346f6db2c27498fbf2e803ac5a47629 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.227973  8419 leader_election.cc:290] T c346f6db2c27498fbf2e803ac5a47629 P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:47.228648  8123 catalog_manager.cc:5697] T 8c22e7a7140249b2a7e0e7250fa6c63d P 40136f5ac8c040d18bcea0a86211be68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "40136f5ac8c040d18bcea0a86211be68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:47.230438  8416 tablet_bootstrap.cc:654] T bc5215886f3d4f0eb3364d518fb846bc P 40136f5ac8c040d18bcea0a86211be68: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.233255  8227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa758e90c4b498690b7598eb7b021a5" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40136f5ac8c040d18bcea0a86211be68" is_pre_election: true
I20260709 13:16:47.235163  8225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c346f6db2c27498fbf2e803ac5a47629" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40136f5ac8c040d18bcea0a86211be68" is_pre_election: true
I20260709 13:16:47.235654  8226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79bac7eaf2b54d5ebb8697bde03f3ea9" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40136f5ac8c040d18bcea0a86211be68" is_pre_election: true
I20260709 13:16:47.236205  8225 raft_consensus.cc:2468] T c346f6db2c27498fbf2e803ac5a47629 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b29a30c058b24b799c64511edcc51af1 in term 0.
I20260709 13:16:47.237787  8418 tablet_bootstrap.cc:492] T c346f6db2c27498fbf2e803ac5a47629 P 293fa96e53fc447285b9eaec7ba3d452: No bootstrap required, opened a new log
I20260709 13:16:47.238407  8418 ts_tablet_manager.cc:1403] T c346f6db2c27498fbf2e803ac5a47629 P 293fa96e53fc447285b9eaec7ba3d452: Time spent bootstrapping tablet: real 0.057s	user 0.028s	sys 0.008s
I20260709 13:16:47.239300  8415 tablet_bootstrap.cc:492] T 8c22e7a7140249b2a7e0e7250fa6c63d P b29a30c058b24b799c64511edcc51af1: No bootstrap required, opened a new log
W20260709 13:16:47.239362  8266 leader_election.cc:343] T caa758e90c4b498690b7598eb7b021a5 P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.240059  8415 ts_tablet_manager.cc:1403] T 8c22e7a7140249b2a7e0e7250fa6c63d P b29a30c058b24b799c64511edcc51af1: Time spent bootstrapping tablet: real 0.058s	user 0.014s	sys 0.006s
W20260709 13:16:47.240367  8266 leader_election.cc:343] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.241987  8418 raft_consensus.cc:359] T c346f6db2c27498fbf2e803ac5a47629 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.244493  8418 raft_consensus.cc:385] T c346f6db2c27498fbf2e803ac5a47629 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.243798  8415 raft_consensus.cc:359] T 8c22e7a7140249b2a7e0e7250fa6c63d P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.244968  8415 raft_consensus.cc:385] T 8c22e7a7140249b2a7e0e7250fa6c63d P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.245409  8415 raft_consensus.cc:740] T 8c22e7a7140249b2a7e0e7250fa6c63d P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b29a30c058b24b799c64511edcc51af1, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.241122  8266 leader_election.cc:304] T c346f6db2c27498fbf2e803ac5a47629 P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40136f5ac8c040d18bcea0a86211be68, b29a30c058b24b799c64511edcc51af1; no voters: 
I20260709 13:16:47.244804  8418 raft_consensus.cc:740] T c346f6db2c27498fbf2e803ac5a47629 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293fa96e53fc447285b9eaec7ba3d452, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.246855  8419 raft_consensus.cc:2804] T c346f6db2c27498fbf2e803ac5a47629 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:47.247400  8419 raft_consensus.cc:493] T c346f6db2c27498fbf2e803ac5a47629 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.247912  8419 raft_consensus.cc:3060] T c346f6db2c27498fbf2e803ac5a47629 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.248456  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa758e90c4b498690b7598eb7b021a5" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293fa96e53fc447285b9eaec7ba3d452" is_pre_election: true
I20260709 13:16:47.247731  8418 consensus_queue.cc:260] T c346f6db2c27498fbf2e803ac5a47629 P 293fa96e53fc447285b9eaec7ba3d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.249269  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79bac7eaf2b54d5ebb8697bde03f3ea9" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293fa96e53fc447285b9eaec7ba3d452" is_pre_election: true
I20260709 13:16:47.250131  8415 consensus_queue.cc:260] T 8c22e7a7140249b2a7e0e7250fa6c63d P b29a30c058b24b799c64511edcc51af1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.251276  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c346f6db2c27498fbf2e803ac5a47629" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293fa96e53fc447285b9eaec7ba3d452" is_pre_election: true
I20260709 13:16:47.252009  8375 raft_consensus.cc:2468] T c346f6db2c27498fbf2e803ac5a47629 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b29a30c058b24b799c64511edcc51af1 in term 0.
W20260709 13:16:47.250814  8266 leader_election.cc:343] T caa758e90c4b498690b7598eb7b021a5 P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.252614  8418 ts_tablet_manager.cc:1434] T c346f6db2c27498fbf2e803ac5a47629 P 293fa96e53fc447285b9eaec7ba3d452: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.004s
I20260709 13:16:47.252704  8266 leader_election.cc:304] T caa758e90c4b498690b7598eb7b021a5 P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b29a30c058b24b799c64511edcc51af1; no voters: 293fa96e53fc447285b9eaec7ba3d452, 40136f5ac8c040d18bcea0a86211be68
I20260709 13:16:47.254619  8418 tablet_bootstrap.cc:492] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 293fa96e53fc447285b9eaec7ba3d452: Bootstrap starting.
I20260709 13:16:47.265372  8418 tablet_bootstrap.cc:654] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 293fa96e53fc447285b9eaec7ba3d452: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.272320  8416 tablet_bootstrap.cc:492] T bc5215886f3d4f0eb3364d518fb846bc P 40136f5ac8c040d18bcea0a86211be68: No bootstrap required, opened a new log
W20260709 13:16:47.272132  8266 leader_election.cc:343] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.273176  8416 ts_tablet_manager.cc:1403] T bc5215886f3d4f0eb3364d518fb846bc P 40136f5ac8c040d18bcea0a86211be68: Time spent bootstrapping tablet: real 0.054s	user 0.007s	sys 0.008s
I20260709 13:16:47.273118  8266 leader_election.cc:304] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b29a30c058b24b799c64511edcc51af1; no voters: 293fa96e53fc447285b9eaec7ba3d452, 40136f5ac8c040d18bcea0a86211be68
I20260709 13:16:47.275674  8424 raft_consensus.cc:493] T cd1da709c81d4c17a8308b204dca7be7 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.276315  8424 raft_consensus.cc:515] T cd1da709c81d4c17a8308b204dca7be7 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.281167  8416 raft_consensus.cc:359] T bc5215886f3d4f0eb3364d518fb846bc P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.282043  8416 raft_consensus.cc:385] T bc5215886f3d4f0eb3364d518fb846bc P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.282368  8416 raft_consensus.cc:740] T bc5215886f3d4f0eb3364d518fb846bc P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40136f5ac8c040d18bcea0a86211be68, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.279897  8419 raft_consensus.cc:515] T c346f6db2c27498fbf2e803ac5a47629 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.283185  8424 leader_election.cc:290] T cd1da709c81d4c17a8308b204dca7be7 P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155)
I20260709 13:16:47.283811  8424 raft_consensus.cc:493] T b39ad7757ad748238fab733ef5360084 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.286952  8424 raft_consensus.cc:515] T b39ad7757ad748238fab733ef5360084 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.289852  8424 leader_election.cc:290] T b39ad7757ad748238fab733ef5360084 P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155)
I20260709 13:16:47.284545  8416 consensus_queue.cc:260] T bc5215886f3d4f0eb3364d518fb846bc P 40136f5ac8c040d18bcea0a86211be68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.293463  8415 ts_tablet_manager.cc:1434] T 8c22e7a7140249b2a7e0e7250fa6c63d P b29a30c058b24b799c64511edcc51af1: Time spent starting tablet: real 0.053s	user 0.012s	sys 0.013s
I20260709 13:16:47.294278  8424 raft_consensus.cc:493] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.295037  8424 raft_consensus.cc:515] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.295750  8415 tablet_bootstrap.cc:492] T 6cfddc3bdd0b4550b4672e0cf720cd39 P b29a30c058b24b799c64511edcc51af1: Bootstrap starting.
I20260709 13:16:47.286903  8419 leader_election.cc:290] T c346f6db2c27498fbf2e803ac5a47629 P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 election: Requested vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:47.293138  8444 raft_consensus.cc:2749] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:47.275784  8445 raft_consensus.cc:2749] T caa758e90c4b498690b7598eb7b021a5 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:47.300494  8424 leader_election.cc:290] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155)
I20260709 13:16:47.301180  8416 ts_tablet_manager.cc:1434] T bc5215886f3d4f0eb3364d518fb846bc P 40136f5ac8c040d18bcea0a86211be68: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.004s
I20260709 13:16:47.302707  8416 tablet_bootstrap.cc:492] T caa758e90c4b498690b7598eb7b021a5 P 40136f5ac8c040d18bcea0a86211be68: Bootstrap starting.
I20260709 13:16:47.311072  8416 tablet_bootstrap.cc:654] T caa758e90c4b498690b7598eb7b021a5 P 40136f5ac8c040d18bcea0a86211be68: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.313464  8415 tablet_bootstrap.cc:654] T 6cfddc3bdd0b4550b4672e0cf720cd39 P b29a30c058b24b799c64511edcc51af1: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.329802  8416 tablet_bootstrap.cc:492] T caa758e90c4b498690b7598eb7b021a5 P 40136f5ac8c040d18bcea0a86211be68: No bootstrap required, opened a new log
I20260709 13:16:47.330503  8416 ts_tablet_manager.cc:1403] T caa758e90c4b498690b7598eb7b021a5 P 40136f5ac8c040d18bcea0a86211be68: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.001s
I20260709 13:16:47.332273  8415 tablet_bootstrap.cc:492] T 6cfddc3bdd0b4550b4672e0cf720cd39 P b29a30c058b24b799c64511edcc51af1: No bootstrap required, opened a new log
I20260709 13:16:47.333127  8415 ts_tablet_manager.cc:1403] T 6cfddc3bdd0b4550b4672e0cf720cd39 P b29a30c058b24b799c64511edcc51af1: Time spent bootstrapping tablet: real 0.038s	user 0.018s	sys 0.001s
I20260709 13:16:47.333990  8445 raft_consensus.cc:493] T a7bad7246022445bb86fa0f48a3afd6f P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.334378  8416 raft_consensus.cc:359] T caa758e90c4b498690b7598eb7b021a5 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.334645  8445 raft_consensus.cc:515] T a7bad7246022445bb86fa0f48a3afd6f P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.337285  8445 leader_election.cc:290] T a7bad7246022445bb86fa0f48a3afd6f P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:47.337584  8415 raft_consensus.cc:359] T 6cfddc3bdd0b4550b4672e0cf720cd39 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.338444  8415 raft_consensus.cc:385] T 6cfddc3bdd0b4550b4672e0cf720cd39 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.338734  8415 raft_consensus.cc:740] T 6cfddc3bdd0b4550b4672e0cf720cd39 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b29a30c058b24b799c64511edcc51af1, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.335316  8416 raft_consensus.cc:385] T caa758e90c4b498690b7598eb7b021a5 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.341382  8416 raft_consensus.cc:740] T caa758e90c4b498690b7598eb7b021a5 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40136f5ac8c040d18bcea0a86211be68, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.342489  8416 consensus_queue.cc:260] T caa758e90c4b498690b7598eb7b021a5 P 40136f5ac8c040d18bcea0a86211be68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.343382  8418 tablet_bootstrap.cc:492] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 293fa96e53fc447285b9eaec7ba3d452: No bootstrap required, opened a new log
I20260709 13:16:47.344033  8418 ts_tablet_manager.cc:1403] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 293fa96e53fc447285b9eaec7ba3d452: Time spent bootstrapping tablet: real 0.090s	user 0.034s	sys 0.041s
I20260709 13:16:47.345398  8416 ts_tablet_manager.cc:1434] T caa758e90c4b498690b7598eb7b021a5 P 40136f5ac8c040d18bcea0a86211be68: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.004s
I20260709 13:16:47.339717  8415 consensus_queue.cc:260] T 6cfddc3bdd0b4550b4672e0cf720cd39 P b29a30c058b24b799c64511edcc51af1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.346921  8416 tablet_bootstrap.cc:492] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 40136f5ac8c040d18bcea0a86211be68: Bootstrap starting.
I20260709 13:16:47.348366  8415 ts_tablet_manager.cc:1434] T 6cfddc3bdd0b4550b4672e0cf720cd39 P b29a30c058b24b799c64511edcc51af1: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.005s
I20260709 13:16:47.350893  8448 raft_consensus.cc:493] T 8c22e7a7140249b2a7e0e7250fa6c63d P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.351619  8448 raft_consensus.cc:515] T 8c22e7a7140249b2a7e0e7250fa6c63d P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.354363  8448 leader_election.cc:290] T 8c22e7a7140249b2a7e0e7250fa6c63d P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:47.356231  8416 tablet_bootstrap.cc:654] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 40136f5ac8c040d18bcea0a86211be68: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.349789  8415 tablet_bootstrap.cc:492] T bc5215886f3d4f0eb3364d518fb846bc P b29a30c058b24b799c64511edcc51af1: Bootstrap starting.
I20260709 13:16:47.356338  8418 raft_consensus.cc:359] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.362876  8418 raft_consensus.cc:385] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.363174  8450 raft_consensus.cc:493] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:47.364149  8266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:36869, user_credentials={real_user=slave}} blocked reactor thread for 92088.2us
I20260709 13:16:47.364020  8450 raft_consensus.cc:515] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.368294  8450 leader_election.cc:290] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155)
I20260709 13:16:47.363205  8418 raft_consensus.cc:740] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293fa96e53fc447285b9eaec7ba3d452, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.370563  8225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c346f6db2c27498fbf2e803ac5a47629" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40136f5ac8c040d18bcea0a86211be68"
I20260709 13:16:47.370414  8418 consensus_queue.cc:260] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 293fa96e53fc447285b9eaec7ba3d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.370726  8226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bad7246022445bb86fa0f48a3afd6f" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40136f5ac8c040d18bcea0a86211be68" is_pre_election: true
I20260709 13:16:47.372043  8226 raft_consensus.cc:2468] T a7bad7246022445bb86fa0f48a3afd6f P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b29a30c058b24b799c64511edcc51af1 in term 0.
I20260709 13:16:47.371385  8225 raft_consensus.cc:3060] T c346f6db2c27498fbf2e803ac5a47629 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.376081  8226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c22e7a7140249b2a7e0e7250fa6c63d" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40136f5ac8c040d18bcea0a86211be68" is_pre_election: true
I20260709 13:16:47.380414  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c346f6db2c27498fbf2e803ac5a47629" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293fa96e53fc447285b9eaec7ba3d452"
I20260709 13:16:47.381382  8375 raft_consensus.cc:3060] T c346f6db2c27498fbf2e803ac5a47629 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.384284  8266 leader_election.cc:304] T a7bad7246022445bb86fa0f48a3afd6f P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40136f5ac8c040d18bcea0a86211be68, b29a30c058b24b799c64511edcc51af1; no voters: 
I20260709 13:16:47.390767  8227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b39ad7757ad748238fab733ef5360084" candidate_uuid: "293fa96e53fc447285b9eaec7ba3d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40136f5ac8c040d18bcea0a86211be68" is_pre_election: true
I20260709 13:16:47.392542  8224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5215886f3d4f0eb3364d518fb846bc" candidate_uuid: "293fa96e53fc447285b9eaec7ba3d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40136f5ac8c040d18bcea0a86211be68" is_pre_election: true
I20260709 13:16:47.392680  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bad7246022445bb86fa0f48a3afd6f" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293fa96e53fc447285b9eaec7ba3d452" is_pre_election: true
I20260709 13:16:47.393514  8224 raft_consensus.cc:2468] T bc5215886f3d4f0eb3364d518fb846bc P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293fa96e53fc447285b9eaec7ba3d452 in term 0.
I20260709 13:16:47.395346  8223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfddc3bdd0b4550b4672e0cf720cd39" candidate_uuid: "293fa96e53fc447285b9eaec7ba3d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40136f5ac8c040d18bcea0a86211be68" is_pre_election: true
I20260709 13:16:47.396806  8418 ts_tablet_manager.cc:1434] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 293fa96e53fc447285b9eaec7ba3d452: Time spent starting tablet: real 0.052s	user 0.009s	sys 0.001s
I20260709 13:16:47.398340  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c22e7a7140249b2a7e0e7250fa6c63d" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293fa96e53fc447285b9eaec7ba3d452" is_pre_election: true
W20260709 13:16:47.398731  8340 leader_election.cc:343] T b39ad7757ad748238fab733ef5360084 P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.399895  8376 raft_consensus.cc:2393] T 8c22e7a7140249b2a7e0e7250fa6c63d P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b29a30c058b24b799c64511edcc51af1 in current term 1: Already voted for candidate 40136f5ac8c040d18bcea0a86211be68 in this term.
I20260709 13:16:47.399863  8340 leader_election.cc:304] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293fa96e53fc447285b9eaec7ba3d452, 40136f5ac8c040d18bcea0a86211be68; no voters: 
I20260709 13:16:47.400892  8450 raft_consensus.cc:2804] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:16:47.401110  8340 leader_election.cc:343] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.401490  8450 raft_consensus.cc:493] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.402289  8445 raft_consensus.cc:2804] T a7bad7246022445bb86fa0f48a3afd6f P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:47.402455  8450 raft_consensus.cc:3060] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.396908  8226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1da709c81d4c17a8308b204dca7be7" candidate_uuid: "293fa96e53fc447285b9eaec7ba3d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40136f5ac8c040d18bcea0a86211be68" is_pre_election: true
W20260709 13:16:47.401559  8266 leader_election.cc:343] T a7bad7246022445bb86fa0f48a3afd6f P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:47.404884  8340 leader_election.cc:343] T cd1da709c81d4c17a8308b204dca7be7 P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.402897  8445 raft_consensus.cc:493] T a7bad7246022445bb86fa0f48a3afd6f P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.405838  8445 raft_consensus.cc:3060] T a7bad7246022445bb86fa0f48a3afd6f P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.406229  8302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1da709c81d4c17a8308b204dca7be7" candidate_uuid: "293fa96e53fc447285b9eaec7ba3d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b29a30c058b24b799c64511edcc51af1" is_pre_election: true
I20260709 13:16:47.408408  8375 raft_consensus.cc:2468] T c346f6db2c27498fbf2e803ac5a47629 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b29a30c058b24b799c64511edcc51af1 in term 1.
I20260709 13:16:47.409484  8302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b39ad7757ad748238fab733ef5360084" candidate_uuid: "293fa96e53fc447285b9eaec7ba3d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b29a30c058b24b799c64511edcc51af1" is_pre_election: true
I20260709 13:16:47.415772  8445 raft_consensus.cc:515] T a7bad7246022445bb86fa0f48a3afd6f P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.417133  8302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5215886f3d4f0eb3364d518fb846bc" candidate_uuid: "293fa96e53fc447285b9eaec7ba3d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b29a30c058b24b799c64511edcc51af1" is_pre_election: true
I20260709 13:16:47.418355  8445 leader_election.cc:290] T a7bad7246022445bb86fa0f48a3afd6f P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 election: Requested vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:47.419214  8302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfddc3bdd0b4550b4672e0cf720cd39" candidate_uuid: "293fa96e53fc447285b9eaec7ba3d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b29a30c058b24b799c64511edcc51af1" is_pre_election: true
I20260709 13:16:47.420068  8302 raft_consensus.cc:2468] T 6cfddc3bdd0b4550b4672e0cf720cd39 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293fa96e53fc447285b9eaec7ba3d452 in term 0.
I20260709 13:16:47.420318  8225 raft_consensus.cc:2468] T c346f6db2c27498fbf2e803ac5a47629 P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b29a30c058b24b799c64511edcc51af1 in term 1.
I20260709 13:16:47.421343  8266 leader_election.cc:304] T 8c22e7a7140249b2a7e0e7250fa6c63d P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b29a30c058b24b799c64511edcc51af1; no voters: 293fa96e53fc447285b9eaec7ba3d452, 40136f5ac8c040d18bcea0a86211be68
I20260709 13:16:47.421985  8418 tablet_bootstrap.cc:492] T caa758e90c4b498690b7598eb7b021a5 P 293fa96e53fc447285b9eaec7ba3d452: Bootstrap starting.
I20260709 13:16:47.423514  8266 leader_election.cc:304] T c346f6db2c27498fbf2e803ac5a47629 P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293fa96e53fc447285b9eaec7ba3d452, b29a30c058b24b799c64511edcc51af1; no voters: 
I20260709 13:16:47.424715  8448 raft_consensus.cc:3060] T 8c22e7a7140249b2a7e0e7250fa6c63d P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.425441  8415 tablet_bootstrap.cc:654] T bc5215886f3d4f0eb3364d518fb846bc P b29a30c058b24b799c64511edcc51af1: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.427048  8416 tablet_bootstrap.cc:492] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 40136f5ac8c040d18bcea0a86211be68: No bootstrap required, opened a new log
I20260709 13:16:47.427742  8416 ts_tablet_manager.cc:1403] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 40136f5ac8c040d18bcea0a86211be68: Time spent bootstrapping tablet: real 0.081s	user 0.022s	sys 0.056s
I20260709 13:16:47.428936  8445 raft_consensus.cc:2804] T c346f6db2c27498fbf2e803ac5a47629 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:47.430392  8445 raft_consensus.cc:697] T c346f6db2c27498fbf2e803ac5a47629 P b29a30c058b24b799c64511edcc51af1 [term 1 LEADER]: Becoming Leader. State: Replica: b29a30c058b24b799c64511edcc51af1, State: Running, Role: LEADER
I20260709 13:16:47.431310  8416 raft_consensus.cc:359] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.431367  8445 consensus_queue.cc:237] T c346f6db2c27498fbf2e803ac5a47629 P b29a30c058b24b799c64511edcc51af1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.432381  8416 raft_consensus.cc:385] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.432760  8416 raft_consensus.cc:740] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40136f5ac8c040d18bcea0a86211be68, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.433720  8416 consensus_queue.cc:260] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 40136f5ac8c040d18bcea0a86211be68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
W20260709 13:16:47.435266  8342 leader_election.cc:343] T cd1da709c81d4c17a8308b204dca7be7 P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.435822  8342 leader_election.cc:304] T cd1da709c81d4c17a8308b204dca7be7 P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293fa96e53fc447285b9eaec7ba3d452; no voters: 40136f5ac8c040d18bcea0a86211be68, b29a30c058b24b799c64511edcc51af1
I20260709 13:16:47.437228  8424 raft_consensus.cc:2749] T cd1da709c81d4c17a8308b204dca7be7 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:16:47.438230  8342 leader_election.cc:343] T b39ad7757ad748238fab733ef5360084 P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.438402  8450 raft_consensus.cc:515] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.438846  8342 leader_election.cc:304] T b39ad7757ad748238fab733ef5360084 P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293fa96e53fc447285b9eaec7ba3d452; no voters: 40136f5ac8c040d18bcea0a86211be68, b29a30c058b24b799c64511edcc51af1
I20260709 13:16:47.441237  8450 leader_election.cc:290] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 election: Requested vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155)
I20260709 13:16:47.441623  8226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bad7246022445bb86fa0f48a3afd6f" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40136f5ac8c040d18bcea0a86211be68"
I20260709 13:16:47.442358  8226 raft_consensus.cc:3060] T a7bad7246022445bb86fa0f48a3afd6f P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:47.442571  8342 leader_election.cc:343] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.435834  8418 tablet_bootstrap.cc:654] T caa758e90c4b498690b7598eb7b021a5 P 293fa96e53fc447285b9eaec7ba3d452: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.444341  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bad7246022445bb86fa0f48a3afd6f" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293fa96e53fc447285b9eaec7ba3d452"
I20260709 13:16:47.445109  8225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5215886f3d4f0eb3364d518fb846bc" candidate_uuid: "293fa96e53fc447285b9eaec7ba3d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40136f5ac8c040d18bcea0a86211be68"
I20260709 13:16:47.445732  8416 ts_tablet_manager.cc:1434] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 40136f5ac8c040d18bcea0a86211be68: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:16:47.446097  8302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5215886f3d4f0eb3364d518fb846bc" candidate_uuid: "293fa96e53fc447285b9eaec7ba3d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b29a30c058b24b799c64511edcc51af1"
I20260709 13:16:47.446041  8342 leader_election.cc:304] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293fa96e53fc447285b9eaec7ba3d452, b29a30c058b24b799c64511edcc51af1; no voters: 40136f5ac8c040d18bcea0a86211be68
I20260709 13:16:47.447249  8424 raft_consensus.cc:2804] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:47.447678  8424 raft_consensus.cc:493] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.448082  8424 raft_consensus.cc:3060] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.441772  8448 raft_consensus.cc:2749] T 8c22e7a7140249b2a7e0e7250fa6c63d P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:47.445873  8225 raft_consensus.cc:3060] T bc5215886f3d4f0eb3364d518fb846bc P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.454780  8418 tablet_bootstrap.cc:492] T caa758e90c4b498690b7598eb7b021a5 P 293fa96e53fc447285b9eaec7ba3d452: No bootstrap required, opened a new log
I20260709 13:16:47.455129  8416 tablet_bootstrap.cc:492] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 40136f5ac8c040d18bcea0a86211be68: Bootstrap starting.
I20260709 13:16:47.455677  8418 ts_tablet_manager.cc:1403] T caa758e90c4b498690b7598eb7b021a5 P 293fa96e53fc447285b9eaec7ba3d452: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.006s
W20260709 13:16:47.456477  8266 leader_election.cc:343] T a7bad7246022445bb86fa0f48a3afd6f P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:47.458575  8342 leader_election.cc:343] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.441834  8450 raft_consensus.cc:2749] T b39ad7757ad748238fab733ef5360084 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:47.459285  8418 raft_consensus.cc:359] T caa758e90c4b498690b7598eb7b021a5 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.460779  8424 raft_consensus.cc:515] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.461934  8418 raft_consensus.cc:385] T caa758e90c4b498690b7598eb7b021a5 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.462520  8418 raft_consensus.cc:740] T caa758e90c4b498690b7598eb7b021a5 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293fa96e53fc447285b9eaec7ba3d452, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.463511  8416 tablet_bootstrap.cc:654] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 40136f5ac8c040d18bcea0a86211be68: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.463663  8418 consensus_queue.cc:260] T caa758e90c4b498690b7598eb7b021a5 P 293fa96e53fc447285b9eaec7ba3d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.464985  8223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfddc3bdd0b4550b4672e0cf720cd39" candidate_uuid: "293fa96e53fc447285b9eaec7ba3d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40136f5ac8c040d18bcea0a86211be68"
I20260709 13:16:47.466143  8302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfddc3bdd0b4550b4672e0cf720cd39" candidate_uuid: "293fa96e53fc447285b9eaec7ba3d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b29a30c058b24b799c64511edcc51af1"
W20260709 13:16:47.466496  8340 leader_election.cc:343] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.468717  8302 raft_consensus.cc:3060] T 6cfddc3bdd0b4550b4672e0cf720cd39 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.469990  8225 raft_consensus.cc:2468] T bc5215886f3d4f0eb3364d518fb846bc P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293fa96e53fc447285b9eaec7ba3d452 in term 1.
I20260709 13:16:47.463589  8415 tablet_bootstrap.cc:492] T bc5215886f3d4f0eb3364d518fb846bc P b29a30c058b24b799c64511edcc51af1: No bootstrap required, opened a new log
I20260709 13:16:47.471230  8415 ts_tablet_manager.cc:1403] T bc5215886f3d4f0eb3364d518fb846bc P b29a30c058b24b799c64511edcc51af1: Time spent bootstrapping tablet: real 0.122s	user 0.015s	sys 0.003s
I20260709 13:16:47.476339  8418 ts_tablet_manager.cc:1434] T caa758e90c4b498690b7598eb7b021a5 P 293fa96e53fc447285b9eaec7ba3d452: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.003s
I20260709 13:16:47.477345  8226 raft_consensus.cc:2468] T a7bad7246022445bb86fa0f48a3afd6f P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b29a30c058b24b799c64511edcc51af1 in term 1.
I20260709 13:16:47.477842  8424 leader_election.cc:290] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 election: Requested vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155)
I20260709 13:16:47.479094  8266 leader_election.cc:304] T a7bad7246022445bb86fa0f48a3afd6f P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40136f5ac8c040d18bcea0a86211be68, b29a30c058b24b799c64511edcc51af1; no voters: 293fa96e53fc447285b9eaec7ba3d452
I20260709 13:16:47.479868  8340 leader_election.cc:304] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293fa96e53fc447285b9eaec7ba3d452, 40136f5ac8c040d18bcea0a86211be68; no voters: b29a30c058b24b799c64511edcc51af1
I20260709 13:16:47.481123  8448 raft_consensus.cc:2804] T a7bad7246022445bb86fa0f48a3afd6f P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:47.475078  8415 raft_consensus.cc:359] T bc5215886f3d4f0eb3364d518fb846bc P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.481927  8448 raft_consensus.cc:697] T a7bad7246022445bb86fa0f48a3afd6f P b29a30c058b24b799c64511edcc51af1 [term 1 LEADER]: Becoming Leader. State: Replica: b29a30c058b24b799c64511edcc51af1, State: Running, Role: LEADER
I20260709 13:16:47.481950  8415 raft_consensus.cc:385] T bc5215886f3d4f0eb3364d518fb846bc P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.482954  8415 raft_consensus.cc:740] T bc5215886f3d4f0eb3364d518fb846bc P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b29a30c058b24b799c64511edcc51af1, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.483922  8450 raft_consensus.cc:2804] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:47.483218  8448 consensus_queue.cc:237] T a7bad7246022445bb86fa0f48a3afd6f P b29a30c058b24b799c64511edcc51af1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.485570  8415 consensus_queue.cc:260] T bc5215886f3d4f0eb3364d518fb846bc P b29a30c058b24b799c64511edcc51af1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.490299  8415 ts_tablet_manager.cc:1434] T bc5215886f3d4f0eb3364d518fb846bc P b29a30c058b24b799c64511edcc51af1: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:16:47.491529  8415 tablet_bootstrap.cc:492] T cd1da709c81d4c17a8308b204dca7be7 P b29a30c058b24b799c64511edcc51af1: Bootstrap starting.
I20260709 13:16:47.493194  8418 tablet_bootstrap.cc:492] T a7bad7246022445bb86fa0f48a3afd6f P 293fa96e53fc447285b9eaec7ba3d452: Bootstrap starting.
I20260709 13:16:47.494174  8438 raft_consensus.cc:493] T caa758e90c4b498690b7598eb7b021a5 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.494753  8438 raft_consensus.cc:515] T caa758e90c4b498690b7598eb7b021a5 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.498946  8301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa758e90c4b498690b7598eb7b021a5" candidate_uuid: "40136f5ac8c040d18bcea0a86211be68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b29a30c058b24b799c64511edcc51af1" is_pre_election: true
I20260709 13:16:47.499969  8301 raft_consensus.cc:2468] T caa758e90c4b498690b7598eb7b021a5 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40136f5ac8c040d18bcea0a86211be68 in term 0.
I20260709 13:16:47.500679  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa758e90c4b498690b7598eb7b021a5" candidate_uuid: "40136f5ac8c040d18bcea0a86211be68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293fa96e53fc447285b9eaec7ba3d452" is_pre_election: true
I20260709 13:16:47.501463  8375 raft_consensus.cc:2468] T caa758e90c4b498690b7598eb7b021a5 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40136f5ac8c040d18bcea0a86211be68 in term 0.
I20260709 13:16:47.501845  8193 leader_election.cc:304] T caa758e90c4b498690b7598eb7b021a5 P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40136f5ac8c040d18bcea0a86211be68, b29a30c058b24b799c64511edcc51af1; no voters: 
I20260709 13:16:47.503096  8423 raft_consensus.cc:2804] T caa758e90c4b498690b7598eb7b021a5 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:47.503139  8438 leader_election.cc:290] T caa758e90c4b498690b7598eb7b021a5 P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:47.503611  8423 raft_consensus.cc:493] T caa758e90c4b498690b7598eb7b021a5 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.503365  8450 raft_consensus.cc:697] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 [term 1 LEADER]: Becoming Leader. State: Replica: 293fa96e53fc447285b9eaec7ba3d452, State: Running, Role: LEADER
I20260709 13:16:47.504555  8302 raft_consensus.cc:2468] T 6cfddc3bdd0b4550b4672e0cf720cd39 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293fa96e53fc447285b9eaec7ba3d452 in term 1.
I20260709 13:16:47.504758  8423 raft_consensus.cc:3060] T caa758e90c4b498690b7598eb7b021a5 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.505839  8450 consensus_queue.cc:237] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.508502  8418 tablet_bootstrap.cc:654] T a7bad7246022445bb86fa0f48a3afd6f P 293fa96e53fc447285b9eaec7ba3d452: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.512530  8123 catalog_manager.cc:5697] T c346f6db2c27498fbf2e803ac5a47629 P b29a30c058b24b799c64511edcc51af1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b29a30c058b24b799c64511edcc51af1 (127.27.146.130). New cstate: current_term: 1 leader_uuid: "b29a30c058b24b799c64511edcc51af1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:47.516258  8416 tablet_bootstrap.cc:492] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 40136f5ac8c040d18bcea0a86211be68: No bootstrap required, opened a new log
I20260709 13:16:47.516971  8416 ts_tablet_manager.cc:1403] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 40136f5ac8c040d18bcea0a86211be68: Time spent bootstrapping tablet: real 0.062s	user 0.023s	sys 0.018s
I20260709 13:16:47.520967  8418 tablet_bootstrap.cc:492] T a7bad7246022445bb86fa0f48a3afd6f P 293fa96e53fc447285b9eaec7ba3d452: No bootstrap required, opened a new log
I20260709 13:16:47.521715  8418 ts_tablet_manager.cc:1403] T a7bad7246022445bb86fa0f48a3afd6f P 293fa96e53fc447285b9eaec7ba3d452: Time spent bootstrapping tablet: real 0.030s	user 0.019s	sys 0.002s
I20260709 13:16:47.522327  8415 tablet_bootstrap.cc:654] T cd1da709c81d4c17a8308b204dca7be7 P b29a30c058b24b799c64511edcc51af1: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.525425  8418 raft_consensus.cc:359] T a7bad7246022445bb86fa0f48a3afd6f P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.526850  8418 raft_consensus.cc:385] T a7bad7246022445bb86fa0f48a3afd6f P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.527310  8418 raft_consensus.cc:740] T a7bad7246022445bb86fa0f48a3afd6f P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293fa96e53fc447285b9eaec7ba3d452, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.528470  8418 consensus_queue.cc:260] T a7bad7246022445bb86fa0f48a3afd6f P 293fa96e53fc447285b9eaec7ba3d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.520618  8416 raft_consensus.cc:359] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.530210  8416 raft_consensus.cc:385] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.532526  8418 ts_tablet_manager.cc:1434] T a7bad7246022445bb86fa0f48a3afd6f P 293fa96e53fc447285b9eaec7ba3d452: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:16:47.533015  8416 raft_consensus.cc:740] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40136f5ac8c040d18bcea0a86211be68, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.534024  8416 consensus_queue.cc:260] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 40136f5ac8c040d18bcea0a86211be68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.535733  8415 tablet_bootstrap.cc:492] T cd1da709c81d4c17a8308b204dca7be7 P b29a30c058b24b799c64511edcc51af1: No bootstrap required, opened a new log
I20260709 13:16:47.536387  8415 ts_tablet_manager.cc:1403] T cd1da709c81d4c17a8308b204dca7be7 P b29a30c058b24b799c64511edcc51af1: Time spent bootstrapping tablet: real 0.045s	user 0.016s	sys 0.003s
I20260709 13:16:47.536929  8416 ts_tablet_manager.cc:1434] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 40136f5ac8c040d18bcea0a86211be68: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.001s
I20260709 13:16:47.538235  8416 tablet_bootstrap.cc:492] T cd1da709c81d4c17a8308b204dca7be7 P 40136f5ac8c040d18bcea0a86211be68: Bootstrap starting.
I20260709 13:16:47.539664  8415 raft_consensus.cc:359] T cd1da709c81d4c17a8308b204dca7be7 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.540505  8415 raft_consensus.cc:385] T cd1da709c81d4c17a8308b204dca7be7 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.540807  8415 raft_consensus.cc:740] T cd1da709c81d4c17a8308b204dca7be7 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b29a30c058b24b799c64511edcc51af1, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.540148  8123 catalog_manager.cc:5697] T a7bad7246022445bb86fa0f48a3afd6f P b29a30c058b24b799c64511edcc51af1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b29a30c058b24b799c64511edcc51af1 (127.27.146.130). New cstate: current_term: 1 leader_uuid: "b29a30c058b24b799c64511edcc51af1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:47.541611  8415 consensus_queue.cc:260] T cd1da709c81d4c17a8308b204dca7be7 P b29a30c058b24b799c64511edcc51af1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.543715  8342 leader_election.cc:304] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293fa96e53fc447285b9eaec7ba3d452, b29a30c058b24b799c64511edcc51af1; no voters: 40136f5ac8c040d18bcea0a86211be68
I20260709 13:16:47.544461  8415 ts_tablet_manager.cc:1434] T cd1da709c81d4c17a8308b204dca7be7 P b29a30c058b24b799c64511edcc51af1: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:16:47.545253  8460 raft_consensus.cc:2804] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:47.545825  8415 tablet_bootstrap.cc:492] T b39ad7757ad748238fab733ef5360084 P b29a30c058b24b799c64511edcc51af1: Bootstrap starting.
I20260709 13:16:47.545920  8460 raft_consensus.cc:697] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 LEADER]: Becoming Leader. State: Replica: 293fa96e53fc447285b9eaec7ba3d452, State: Running, Role: LEADER
I20260709 13:16:47.546872  8416 tablet_bootstrap.cc:654] T cd1da709c81d4c17a8308b204dca7be7 P 40136f5ac8c040d18bcea0a86211be68: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.547071  8460 consensus_queue.cc:237] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 293fa96e53fc447285b9eaec7ba3d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.554998  8415 tablet_bootstrap.cc:654] T b39ad7757ad748238fab733ef5360084 P b29a30c058b24b799c64511edcc51af1: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.566530  8416 tablet_bootstrap.cc:492] T cd1da709c81d4c17a8308b204dca7be7 P 40136f5ac8c040d18bcea0a86211be68: No bootstrap required, opened a new log
I20260709 13:16:47.569679  8416 ts_tablet_manager.cc:1403] T cd1da709c81d4c17a8308b204dca7be7 P 40136f5ac8c040d18bcea0a86211be68: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.007s
I20260709 13:16:47.574549  8416 raft_consensus.cc:359] T cd1da709c81d4c17a8308b204dca7be7 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.577512  8416 raft_consensus.cc:385] T cd1da709c81d4c17a8308b204dca7be7 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.578193  8416 raft_consensus.cc:740] T cd1da709c81d4c17a8308b204dca7be7 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40136f5ac8c040d18bcea0a86211be68, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.579172  8415 tablet_bootstrap.cc:492] T b39ad7757ad748238fab733ef5360084 P b29a30c058b24b799c64511edcc51af1: No bootstrap required, opened a new log
I20260709 13:16:47.579890  8415 ts_tablet_manager.cc:1403] T b39ad7757ad748238fab733ef5360084 P b29a30c058b24b799c64511edcc51af1: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.017s
I20260709 13:16:47.579418  8416 consensus_queue.cc:260] T cd1da709c81d4c17a8308b204dca7be7 P 40136f5ac8c040d18bcea0a86211be68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.581669  8424 raft_consensus.cc:493] T a7bad7246022445bb86fa0f48a3afd6f P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.582369  8424 raft_consensus.cc:515] T a7bad7246022445bb86fa0f48a3afd6f P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.583277  8415 raft_consensus.cc:359] T b39ad7757ad748238fab733ef5360084 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.584280  8415 raft_consensus.cc:385] T b39ad7757ad748238fab733ef5360084 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.584915  8415 raft_consensus.cc:740] T b39ad7757ad748238fab733ef5360084 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b29a30c058b24b799c64511edcc51af1, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.585911  8415 consensus_queue.cc:260] T b39ad7757ad748238fab733ef5360084 P b29a30c058b24b799c64511edcc51af1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.587985  8416 ts_tablet_manager.cc:1434] T cd1da709c81d4c17a8308b204dca7be7 P 40136f5ac8c040d18bcea0a86211be68: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.001s
I20260709 13:16:47.588342  8445 raft_consensus.cc:493] T cd1da709c81d4c17a8308b204dca7be7 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.589417  8415 ts_tablet_manager.cc:1434] T b39ad7757ad748238fab733ef5360084 P b29a30c058b24b799c64511edcc51af1: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260709 13:16:47.589586  8416 tablet_bootstrap.cc:492] T b39ad7757ad748238fab733ef5360084 P 40136f5ac8c040d18bcea0a86211be68: Bootstrap starting.
I20260709 13:16:47.589270  8445 raft_consensus.cc:515] T cd1da709c81d4c17a8308b204dca7be7 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.593255  8445 leader_election.cc:290] T cd1da709c81d4c17a8308b204dca7be7 P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:47.593725  8225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1da709c81d4c17a8308b204dca7be7" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40136f5ac8c040d18bcea0a86211be68" is_pre_election: true
I20260709 13:16:47.594534  8225 raft_consensus.cc:2468] T cd1da709c81d4c17a8308b204dca7be7 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b29a30c058b24b799c64511edcc51af1 in term 0.
I20260709 13:16:47.594990  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1da709c81d4c17a8308b204dca7be7" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293fa96e53fc447285b9eaec7ba3d452" is_pre_election: true
I20260709 13:16:47.595881  8375 raft_consensus.cc:2468] T cd1da709c81d4c17a8308b204dca7be7 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b29a30c058b24b799c64511edcc51af1 in term 0.
I20260709 13:16:47.597010  8416 tablet_bootstrap.cc:654] T b39ad7757ad748238fab733ef5360084 P 40136f5ac8c040d18bcea0a86211be68: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.597128  8266 leader_election.cc:304] T cd1da709c81d4c17a8308b204dca7be7 P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40136f5ac8c040d18bcea0a86211be68, b29a30c058b24b799c64511edcc51af1; no voters: 
I20260709 13:16:47.599643  8225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bad7246022445bb86fa0f48a3afd6f" candidate_uuid: "293fa96e53fc447285b9eaec7ba3d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40136f5ac8c040d18bcea0a86211be68" is_pre_election: true
I20260709 13:16:47.601011  8225 raft_consensus.cc:2393] T a7bad7246022445bb86fa0f48a3afd6f P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293fa96e53fc447285b9eaec7ba3d452 in current term 1: Already voted for candidate b29a30c058b24b799c64511edcc51af1 in this term.
I20260709 13:16:47.601228  8301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bad7246022445bb86fa0f48a3afd6f" candidate_uuid: "293fa96e53fc447285b9eaec7ba3d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b29a30c058b24b799c64511edcc51af1" is_pre_election: true
I20260709 13:16:47.603216  8342 leader_election.cc:304] T a7bad7246022445bb86fa0f48a3afd6f P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293fa96e53fc447285b9eaec7ba3d452; no voters: 40136f5ac8c040d18bcea0a86211be68, b29a30c058b24b799c64511edcc51af1
I20260709 13:16:47.604609  8445 raft_consensus.cc:2804] T cd1da709c81d4c17a8308b204dca7be7 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:47.605379  8445 raft_consensus.cc:493] T cd1da709c81d4c17a8308b204dca7be7 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.605890  8445 raft_consensus.cc:3060] T cd1da709c81d4c17a8308b204dca7be7 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.607098  8416 tablet_bootstrap.cc:492] T b39ad7757ad748238fab733ef5360084 P 40136f5ac8c040d18bcea0a86211be68: No bootstrap required, opened a new log
I20260709 13:16:47.607808  8416 ts_tablet_manager.cc:1403] T b39ad7757ad748238fab733ef5360084 P 40136f5ac8c040d18bcea0a86211be68: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260709 13:16:47.608925  8424 leader_election.cc:290] T a7bad7246022445bb86fa0f48a3afd6f P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155)
I20260709 13:16:47.609912  8424 raft_consensus.cc:3060] T a7bad7246022445bb86fa0f48a3afd6f P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.610451  8416 raft_consensus.cc:359] T b39ad7757ad748238fab733ef5360084 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.611085  8416 raft_consensus.cc:385] T b39ad7757ad748238fab733ef5360084 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.611328  8416 raft_consensus.cc:740] T b39ad7757ad748238fab733ef5360084 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40136f5ac8c040d18bcea0a86211be68, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.612525  8416 consensus_queue.cc:260] T b39ad7757ad748238fab733ef5360084 P 40136f5ac8c040d18bcea0a86211be68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.624688  8416 ts_tablet_manager.cc:1434] T b39ad7757ad748238fab733ef5360084 P 40136f5ac8c040d18bcea0a86211be68: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:16:47.637661  8423 raft_consensus.cc:515] T caa758e90c4b498690b7598eb7b021a5 P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.642858  8445 raft_consensus.cc:515] T cd1da709c81d4c17a8308b204dca7be7 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.641294  8424 raft_consensus.cc:2749] T a7bad7246022445bb86fa0f48a3afd6f P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:47.644869  8302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa758e90c4b498690b7598eb7b021a5" candidate_uuid: "40136f5ac8c040d18bcea0a86211be68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b29a30c058b24b799c64511edcc51af1"
I20260709 13:16:47.645598  8302 raft_consensus.cc:3060] T caa758e90c4b498690b7598eb7b021a5 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.646512  8423 leader_election.cc:290] T caa758e90c4b498690b7598eb7b021a5 P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 election: Requested vote from peers b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:47.647367  8225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1da709c81d4c17a8308b204dca7be7" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40136f5ac8c040d18bcea0a86211be68"
I20260709 13:16:47.647722  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa758e90c4b498690b7598eb7b021a5" candidate_uuid: "40136f5ac8c040d18bcea0a86211be68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293fa96e53fc447285b9eaec7ba3d452"
I20260709 13:16:47.648097  8225 raft_consensus.cc:3060] T cd1da709c81d4c17a8308b204dca7be7 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.648362  8375 raft_consensus.cc:3060] T caa758e90c4b498690b7598eb7b021a5 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.648873  8445 leader_election.cc:290] T cd1da709c81d4c17a8308b204dca7be7 P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 election: Requested vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:47.650008  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1da709c81d4c17a8308b204dca7be7" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293fa96e53fc447285b9eaec7ba3d452"
I20260709 13:16:47.650692  8376 raft_consensus.cc:3060] T cd1da709c81d4c17a8308b204dca7be7 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.654778  8302 raft_consensus.cc:2468] T caa758e90c4b498690b7598eb7b021a5 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40136f5ac8c040d18bcea0a86211be68 in term 1.
I20260709 13:16:47.656450  8193 leader_election.cc:304] T caa758e90c4b498690b7598eb7b021a5 P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40136f5ac8c040d18bcea0a86211be68, b29a30c058b24b799c64511edcc51af1; no voters: 
I20260709 13:16:47.656620  8375 raft_consensus.cc:2468] T caa758e90c4b498690b7598eb7b021a5 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40136f5ac8c040d18bcea0a86211be68 in term 1.
I20260709 13:16:47.657526  8423 raft_consensus.cc:2804] T caa758e90c4b498690b7598eb7b021a5 P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:47.656620  8225 raft_consensus.cc:2468] T cd1da709c81d4c17a8308b204dca7be7 P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b29a30c058b24b799c64511edcc51af1 in term 1.
I20260709 13:16:47.659087  8423 raft_consensus.cc:697] T caa758e90c4b498690b7598eb7b021a5 P 40136f5ac8c040d18bcea0a86211be68 [term 1 LEADER]: Becoming Leader. State: Replica: 40136f5ac8c040d18bcea0a86211be68, State: Running, Role: LEADER
I20260709 13:16:47.659199  8376 raft_consensus.cc:2468] T cd1da709c81d4c17a8308b204dca7be7 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b29a30c058b24b799c64511edcc51af1 in term 1.
I20260709 13:16:47.659428  8123 catalog_manager.cc:5697] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131). New cstate: current_term: 1 leader_uuid: "293fa96e53fc447285b9eaec7ba3d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:47.660315  8266 leader_election.cc:304] T cd1da709c81d4c17a8308b204dca7be7 P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40136f5ac8c040d18bcea0a86211be68, b29a30c058b24b799c64511edcc51af1; no voters: 
I20260709 13:16:47.660152  8423 consensus_queue.cc:237] T caa758e90c4b498690b7598eb7b021a5 P 40136f5ac8c040d18bcea0a86211be68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.662096  8445 raft_consensus.cc:493] T b39ad7757ad748238fab733ef5360084 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.662185  8448 raft_consensus.cc:2804] T cd1da709c81d4c17a8308b204dca7be7 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:47.662784  8448 raft_consensus.cc:697] T cd1da709c81d4c17a8308b204dca7be7 P b29a30c058b24b799c64511edcc51af1 [term 1 LEADER]: Becoming Leader. State: Replica: b29a30c058b24b799c64511edcc51af1, State: Running, Role: LEADER
I20260709 13:16:47.662823  8445 raft_consensus.cc:515] T b39ad7757ad748238fab733ef5360084 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.663861  8448 consensus_queue.cc:237] T cd1da709c81d4c17a8308b204dca7be7 P b29a30c058b24b799c64511edcc51af1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.667886  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b39ad7757ad748238fab733ef5360084" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293fa96e53fc447285b9eaec7ba3d452" is_pre_election: true
I20260709 13:16:47.668938  8375 raft_consensus.cc:2468] T b39ad7757ad748238fab733ef5360084 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b29a30c058b24b799c64511edcc51af1 in term 0.
I20260709 13:16:47.669234  8225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b39ad7757ad748238fab733ef5360084" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40136f5ac8c040d18bcea0a86211be68" is_pre_election: true
I20260709 13:16:47.669906  8445 leader_election.cc:290] T b39ad7757ad748238fab733ef5360084 P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:47.670480  8266 leader_election.cc:304] T b39ad7757ad748238fab733ef5360084 P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293fa96e53fc447285b9eaec7ba3d452, b29a30c058b24b799c64511edcc51af1; no voters: 
I20260709 13:16:47.670516  8225 raft_consensus.cc:2468] T b39ad7757ad748238fab733ef5360084 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b29a30c058b24b799c64511edcc51af1 in term 0.
I20260709 13:16:47.671576  8445 raft_consensus.cc:2804] T b39ad7757ad748238fab733ef5360084 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:47.672029  8445 raft_consensus.cc:493] T b39ad7757ad748238fab733ef5360084 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.673038  8445 raft_consensus.cc:3060] T b39ad7757ad748238fab733ef5360084 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.672585  8124 catalog_manager.cc:5697] T caa758e90c4b498690b7598eb7b021a5 P 40136f5ac8c040d18bcea0a86211be68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "40136f5ac8c040d18bcea0a86211be68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:47.679311  8450 raft_consensus.cc:493] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.680115  8450 raft_consensus.cc:515] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.682560  8450 leader_election.cc:290] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155)
I20260709 13:16:47.684667  8225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79bac7eaf2b54d5ebb8697bde03f3ea9" candidate_uuid: "293fa96e53fc447285b9eaec7ba3d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40136f5ac8c040d18bcea0a86211be68" is_pre_election: true
I20260709 13:16:47.685187  8302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79bac7eaf2b54d5ebb8697bde03f3ea9" candidate_uuid: "293fa96e53fc447285b9eaec7ba3d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b29a30c058b24b799c64511edcc51af1" is_pre_election: true
I20260709 13:16:47.685561  8225 raft_consensus.cc:2468] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293fa96e53fc447285b9eaec7ba3d452 in term 0.
I20260709 13:16:47.685940  8302 raft_consensus.cc:2468] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293fa96e53fc447285b9eaec7ba3d452 in term 0.
I20260709 13:16:47.686937  8340 leader_election.cc:304] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293fa96e53fc447285b9eaec7ba3d452, 40136f5ac8c040d18bcea0a86211be68; no voters: 
I20260709 13:16:47.688261  8450 raft_consensus.cc:2804] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:47.688653  8450 raft_consensus.cc:493] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.689360  8450 raft_consensus.cc:3060] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.688756  8123 catalog_manager.cc:5697] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 293fa96e53fc447285b9eaec7ba3d452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131). New cstate: current_term: 1 leader_uuid: "293fa96e53fc447285b9eaec7ba3d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:47.691742  8124 catalog_manager.cc:5697] T cd1da709c81d4c17a8308b204dca7be7 P b29a30c058b24b799c64511edcc51af1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b29a30c058b24b799c64511edcc51af1 (127.27.146.130). New cstate: current_term: 1 leader_uuid: "b29a30c058b24b799c64511edcc51af1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:47.693406  8445 raft_consensus.cc:515] T b39ad7757ad748238fab733ef5360084 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.695901  8445 leader_election.cc:290] T b39ad7757ad748238fab733ef5360084 P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 election: Requested vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:47.698275  8225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b39ad7757ad748238fab733ef5360084" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40136f5ac8c040d18bcea0a86211be68"
I20260709 13:16:47.698467  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b39ad7757ad748238fab733ef5360084" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293fa96e53fc447285b9eaec7ba3d452"
I20260709 13:16:47.699196  8225 raft_consensus.cc:3060] T b39ad7757ad748238fab733ef5360084 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.699250  8375 raft_consensus.cc:3060] T b39ad7757ad748238fab733ef5360084 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.700229  8450 raft_consensus.cc:515] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.703680  8226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79bac7eaf2b54d5ebb8697bde03f3ea9" candidate_uuid: "293fa96e53fc447285b9eaec7ba3d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40136f5ac8c040d18bcea0a86211be68"
I20260709 13:16:47.704504  8226 raft_consensus.cc:3060] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.709375  8225 raft_consensus.cc:2468] T b39ad7757ad748238fab733ef5360084 P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b29a30c058b24b799c64511edcc51af1 in term 1.
I20260709 13:16:47.709547  8375 raft_consensus.cc:2468] T b39ad7757ad748238fab733ef5360084 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b29a30c058b24b799c64511edcc51af1 in term 1.
I20260709 13:16:47.711359  8266 leader_election.cc:304] T b39ad7757ad748238fab733ef5360084 P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293fa96e53fc447285b9eaec7ba3d452, b29a30c058b24b799c64511edcc51af1; no voters: 
I20260709 13:16:47.711853  8450 leader_election.cc:290] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 election: Requested vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155)
I20260709 13:16:47.713904  8302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79bac7eaf2b54d5ebb8697bde03f3ea9" candidate_uuid: "293fa96e53fc447285b9eaec7ba3d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b29a30c058b24b799c64511edcc51af1"
I20260709 13:16:47.714764  8302 raft_consensus.cc:3060] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.715267  8423 consensus_queue.cc:1048] T 8c22e7a7140249b2a7e0e7250fa6c63d P 40136f5ac8c040d18bcea0a86211be68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:47.715790  8226 raft_consensus.cc:2468] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293fa96e53fc447285b9eaec7ba3d452 in term 1.
I20260709 13:16:47.717192  8340 leader_election.cc:304] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293fa96e53fc447285b9eaec7ba3d452, 40136f5ac8c040d18bcea0a86211be68; no voters: 
I20260709 13:16:47.718080  8450 raft_consensus.cc:2804] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:47.720201  8450 raft_consensus.cc:697] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 LEADER]: Becoming Leader. State: Replica: 293fa96e53fc447285b9eaec7ba3d452, State: Running, Role: LEADER
I20260709 13:16:47.720355  8445 raft_consensus.cc:2804] T b39ad7757ad748238fab733ef5360084 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:47.721031  8445 raft_consensus.cc:697] T b39ad7757ad748238fab733ef5360084 P b29a30c058b24b799c64511edcc51af1 [term 1 LEADER]: Becoming Leader. State: Replica: b29a30c058b24b799c64511edcc51af1, State: Running, Role: LEADER
I20260709 13:16:47.721619  8450 consensus_queue.cc:237] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 293fa96e53fc447285b9eaec7ba3d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.722103  8445 consensus_queue.cc:237] T b39ad7757ad748238fab733ef5360084 P b29a30c058b24b799c64511edcc51af1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.731544  8302 raft_consensus.cc:2468] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293fa96e53fc447285b9eaec7ba3d452 in term 1.
I20260709 13:16:47.752380  8123 catalog_manager.cc:5697] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 293fa96e53fc447285b9eaec7ba3d452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131). New cstate: current_term: 1 leader_uuid: "293fa96e53fc447285b9eaec7ba3d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:47.756453  8122 catalog_manager.cc:5697] T b39ad7757ad748238fab733ef5360084 P b29a30c058b24b799c64511edcc51af1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b29a30c058b24b799c64511edcc51af1 (127.27.146.130). New cstate: current_term: 1 leader_uuid: "b29a30c058b24b799c64511edcc51af1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:47.759543  8477 raft_consensus.cc:493] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.750504  8438 consensus_queue.cc:1048] T 8c22e7a7140249b2a7e0e7250fa6c63d P 40136f5ac8c040d18bcea0a86211be68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:16:47.760195  8477 raft_consensus.cc:515] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.762457  8477 leader_election.cc:290] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:47.764194  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfddc3bdd0b4550b4672e0cf720cd39" candidate_uuid: "40136f5ac8c040d18bcea0a86211be68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293fa96e53fc447285b9eaec7ba3d452" is_pre_election: true
I20260709 13:16:47.766202  8301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfddc3bdd0b4550b4672e0cf720cd39" candidate_uuid: "40136f5ac8c040d18bcea0a86211be68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b29a30c058b24b799c64511edcc51af1" is_pre_election: true
I20260709 13:16:47.767970  8301 raft_consensus.cc:2393] T 6cfddc3bdd0b4550b4672e0cf720cd39 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40136f5ac8c040d18bcea0a86211be68 in current term 1: Already voted for candidate 293fa96e53fc447285b9eaec7ba3d452 in this term.
I20260709 13:16:47.769471  8193 leader_election.cc:304] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40136f5ac8c040d18bcea0a86211be68; no voters: 293fa96e53fc447285b9eaec7ba3d452, b29a30c058b24b799c64511edcc51af1
I20260709 13:16:47.770787  8477 raft_consensus.cc:3060] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.782598  8477 raft_consensus.cc:2749] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:47.862183  8445 raft_consensus.cc:493] T bc5215886f3d4f0eb3364d518fb846bc P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.863054  8445 raft_consensus.cc:515] T bc5215886f3d4f0eb3364d518fb846bc P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:47.866349  8445 leader_election.cc:290] T bc5215886f3d4f0eb3364d518fb846bc P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:47.867240  8226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5215886f3d4f0eb3364d518fb846bc" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40136f5ac8c040d18bcea0a86211be68" is_pre_election: true
I20260709 13:16:47.867846  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5215886f3d4f0eb3364d518fb846bc" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293fa96e53fc447285b9eaec7ba3d452" is_pre_election: true
I20260709 13:16:47.868429  8226 raft_consensus.cc:2393] T bc5215886f3d4f0eb3364d518fb846bc P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b29a30c058b24b799c64511edcc51af1 in current term 1: Already voted for candidate 293fa96e53fc447285b9eaec7ba3d452 in this term.
I20260709 13:16:47.869868  8266 leader_election.cc:304] T bc5215886f3d4f0eb3364d518fb846bc P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b29a30c058b24b799c64511edcc51af1; no voters: 293fa96e53fc447285b9eaec7ba3d452, 40136f5ac8c040d18bcea0a86211be68
I20260709 13:16:47.870623  8445 raft_consensus.cc:3060] T bc5215886f3d4f0eb3364d518fb846bc P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.877240  8445 raft_consensus.cc:2749] T bc5215886f3d4f0eb3364d518fb846bc P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:47.893606  8445 consensus_queue.cc:1048] T a7bad7246022445bb86fa0f48a3afd6f P b29a30c058b24b799c64511edcc51af1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:47.898880  8445 consensus_queue.cc:1048] T c346f6db2c27498fbf2e803ac5a47629 P b29a30c058b24b799c64511edcc51af1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:47.911182  8444 consensus_queue.cc:1048] T a7bad7246022445bb86fa0f48a3afd6f P b29a30c058b24b799c64511edcc51af1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:47.913049  8450 consensus_queue.cc:1048] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:47.936070  8483 consensus_queue.cc:1048] T c346f6db2c27498fbf2e803ac5a47629 P b29a30c058b24b799c64511edcc51af1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:47.942195  8424 consensus_queue.cc:1048] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:47.956655  8424 consensus_queue.cc:1048] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 293fa96e53fc447285b9eaec7ba3d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:47.973623  8460 consensus_queue.cc:1048] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 293fa96e53fc447285b9eaec7ba3d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:48.002844  8302 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c346f6db2c27498fbf2e803ac5a47629"
dest_uuid: "b29a30c058b24b799c64511edcc51af1"
mode: GRACEFUL
new_leader_uuid: "40136f5ac8c040d18bcea0a86211be68"
 from {username='slave'} at 127.0.0.1:34704
I20260709 13:16:48.003640  8302 raft_consensus.cc:606] T c346f6db2c27498fbf2e803ac5a47629 P b29a30c058b24b799c64511edcc51af1 [term 1 LEADER]: Received request to transfer leadership to TS 40136f5ac8c040d18bcea0a86211be68
I20260709 13:16:48.014045  8302 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7bad7246022445bb86fa0f48a3afd6f"
dest_uuid: "b29a30c058b24b799c64511edcc51af1"
mode: GRACEFUL
new_leader_uuid: "40136f5ac8c040d18bcea0a86211be68"
 from {username='slave'} at 127.0.0.1:34704
I20260709 13:16:48.014884  8302 raft_consensus.cc:606] T a7bad7246022445bb86fa0f48a3afd6f P b29a30c058b24b799c64511edcc51af1 [term 1 LEADER]: Received request to transfer leadership to TS 40136f5ac8c040d18bcea0a86211be68
I20260709 13:16:48.030435  8376 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79bac7eaf2b54d5ebb8697bde03f3ea9"
dest_uuid: "293fa96e53fc447285b9eaec7ba3d452"
mode: GRACEFUL
new_leader_uuid: "b29a30c058b24b799c64511edcc51af1"
 from {username='slave'} at 127.0.0.1:52414
I20260709 13:16:48.031131  8376 raft_consensus.cc:606] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 LEADER]: Received request to transfer leadership to TS b29a30c058b24b799c64511edcc51af1
I20260709 13:16:48.038096  8376 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc5215886f3d4f0eb3364d518fb846bc"
dest_uuid: "293fa96e53fc447285b9eaec7ba3d452"
mode: GRACEFUL
new_leader_uuid: "b29a30c058b24b799c64511edcc51af1"
 from {username='slave'} at 127.0.0.1:52414
I20260709 13:16:48.038786  8376 raft_consensus.cc:606] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 [term 1 LEADER]: Received request to transfer leadership to TS b29a30c058b24b799c64511edcc51af1
I20260709 13:16:48.044459  8376 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6cfddc3bdd0b4550b4672e0cf720cd39"
dest_uuid: "293fa96e53fc447285b9eaec7ba3d452"
mode: GRACEFUL
new_leader_uuid: "b29a30c058b24b799c64511edcc51af1"
 from {username='slave'} at 127.0.0.1:52414
I20260709 13:16:48.044958  8376 raft_consensus.cc:606] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 LEADER]: Received request to transfer leadership to TS b29a30c058b24b799c64511edcc51af1
I20260709 13:16:48.054644  8302 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd1da709c81d4c17a8308b204dca7be7"
dest_uuid: "b29a30c058b24b799c64511edcc51af1"
mode: GRACEFUL
new_leader_uuid: "293fa96e53fc447285b9eaec7ba3d452"
 from {username='slave'} at 127.0.0.1:34704
I20260709 13:16:48.055294  8302 raft_consensus.cc:606] T cd1da709c81d4c17a8308b204dca7be7 P b29a30c058b24b799c64511edcc51af1 [term 1 LEADER]: Received request to transfer leadership to TS 293fa96e53fc447285b9eaec7ba3d452
I20260709 13:16:48.056255  8483 consensus_queue.cc:1048] T cd1da709c81d4c17a8308b204dca7be7 P b29a30c058b24b799c64511edcc51af1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:48.069219  8483 consensus_queue.cc:1048] T cd1da709c81d4c17a8308b204dca7be7 P b29a30c058b24b799c64511edcc51af1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:48.079828  8483 raft_consensus.cc:993] T cd1da709c81d4c17a8308b204dca7be7 P b29a30c058b24b799c64511edcc51af1: : Instructing follower 293fa96e53fc447285b9eaec7ba3d452 to start an election
I20260709 13:16:48.080358  8445 raft_consensus.cc:1081] T cd1da709c81d4c17a8308b204dca7be7 P b29a30c058b24b799c64511edcc51af1 [term 1 LEADER]: Signalling peer 293fa96e53fc447285b9eaec7ba3d452 to start an election
I20260709 13:16:48.082219  8376 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd1da709c81d4c17a8308b204dca7be7"
dest_uuid: "293fa96e53fc447285b9eaec7ba3d452"
 from {username='slave'} at 127.0.0.1:52400
I20260709 13:16:48.083009  8376 raft_consensus.cc:493] T cd1da709c81d4c17a8308b204dca7be7 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:48.083483  8376 raft_consensus.cc:3060] T cd1da709c81d4c17a8308b204dca7be7 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:48.090934  8376 raft_consensus.cc:515] T cd1da709c81d4c17a8308b204dca7be7 P 293fa96e53fc447285b9eaec7ba3d452 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:48.092975  8376 leader_election.cc:290] T cd1da709c81d4c17a8308b204dca7be7 P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 2 election: Requested vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155)
I20260709 13:16:48.094337  8226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1da709c81d4c17a8308b204dca7be7" candidate_uuid: "293fa96e53fc447285b9eaec7ba3d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40136f5ac8c040d18bcea0a86211be68"
I20260709 13:16:48.094389  8302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1da709c81d4c17a8308b204dca7be7" candidate_uuid: "293fa96e53fc447285b9eaec7ba3d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b29a30c058b24b799c64511edcc51af1"
I20260709 13:16:48.095157  8226 raft_consensus.cc:3060] T cd1da709c81d4c17a8308b204dca7be7 P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:48.095676  8302 raft_consensus.cc:3055] T cd1da709c81d4c17a8308b204dca7be7 P b29a30c058b24b799c64511edcc51af1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:48.096014  8302 raft_consensus.cc:740] T cd1da709c81d4c17a8308b204dca7be7 P b29a30c058b24b799c64511edcc51af1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b29a30c058b24b799c64511edcc51af1, State: Running, Role: LEADER
I20260709 13:16:48.096812  8302 consensus_queue.cc:260] T cd1da709c81d4c17a8308b204dca7be7 P b29a30c058b24b799c64511edcc51af1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:48.098264  8302 raft_consensus.cc:3060] T cd1da709c81d4c17a8308b204dca7be7 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:48.105588  8226 raft_consensus.cc:2468] T cd1da709c81d4c17a8308b204dca7be7 P 40136f5ac8c040d18bcea0a86211be68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293fa96e53fc447285b9eaec7ba3d452 in term 2.
I20260709 13:16:48.107470  8340 leader_election.cc:304] T cd1da709c81d4c17a8308b204dca7be7 P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293fa96e53fc447285b9eaec7ba3d452, 40136f5ac8c040d18bcea0a86211be68; no voters: 
I20260709 13:16:48.108505  8460 raft_consensus.cc:2804] T cd1da709c81d4c17a8308b204dca7be7 P 293fa96e53fc447285b9eaec7ba3d452 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:48.109158  8460 raft_consensus.cc:697] T cd1da709c81d4c17a8308b204dca7be7 P 293fa96e53fc447285b9eaec7ba3d452 [term 2 LEADER]: Becoming Leader. State: Replica: 293fa96e53fc447285b9eaec7ba3d452, State: Running, Role: LEADER
I20260709 13:16:48.109493  8302 raft_consensus.cc:2468] T cd1da709c81d4c17a8308b204dca7be7 P b29a30c058b24b799c64511edcc51af1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293fa96e53fc447285b9eaec7ba3d452 in term 2.
I20260709 13:16:48.110231  8460 consensus_queue.cc:237] T cd1da709c81d4c17a8308b204dca7be7 P 293fa96e53fc447285b9eaec7ba3d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:48.115801  8477 consensus_queue.cc:1048] T caa758e90c4b498690b7598eb7b021a5 P 40136f5ac8c040d18bcea0a86211be68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:48.120539  8122 catalog_manager.cc:5697] T cd1da709c81d4c17a8308b204dca7be7 P 293fa96e53fc447285b9eaec7ba3d452 reported cstate change: term changed from 1 to 2, leader changed from b29a30c058b24b799c64511edcc51af1 (127.27.146.130) to 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131). New cstate: current_term: 2 leader_uuid: "293fa96e53fc447285b9eaec7ba3d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:48.130149  8477 consensus_queue.cc:1048] T caa758e90c4b498690b7598eb7b021a5 P 40136f5ac8c040d18bcea0a86211be68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:48.191885  8483 consensus_queue.cc:1048] T b39ad7757ad748238fab733ef5360084 P b29a30c058b24b799c64511edcc51af1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:48.206003  8483 consensus_queue.cc:1048] T b39ad7757ad748238fab733ef5360084 P b29a30c058b24b799c64511edcc51af1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:48.240411  8424 consensus_queue.cc:1048] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 293fa96e53fc447285b9eaec7ba3d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:48.243333  8424 consensus_queue.cc:1048] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 293fa96e53fc447285b9eaec7ba3d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:48.260407  8460 raft_consensus.cc:993] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 293fa96e53fc447285b9eaec7ba3d452: : Instructing follower b29a30c058b24b799c64511edcc51af1 to start an election
I20260709 13:16:48.260996  8469 raft_consensus.cc:1081] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 LEADER]: Signalling peer b29a30c058b24b799c64511edcc51af1 to start an election
I20260709 13:16:48.262907  8301 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79bac7eaf2b54d5ebb8697bde03f3ea9"
dest_uuid: "b29a30c058b24b799c64511edcc51af1"
 from {username='slave'} at 127.0.0.1:34692
I20260709 13:16:48.264632  8301 raft_consensus.cc:493] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:48.265112  8301 raft_consensus.cc:3060] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:48.273659  8301 raft_consensus.cc:515] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P b29a30c058b24b799c64511edcc51af1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:48.278353  8301 leader_election.cc:290] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 2 election: Requested vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:48.279325  8226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79bac7eaf2b54d5ebb8697bde03f3ea9" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40136f5ac8c040d18bcea0a86211be68"
I20260709 13:16:48.279702  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79bac7eaf2b54d5ebb8697bde03f3ea9" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "293fa96e53fc447285b9eaec7ba3d452"
I20260709 13:16:48.280112  8226 raft_consensus.cc:3060] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:48.280821  8376 raft_consensus.cc:3055] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:48.281137  8376 raft_consensus.cc:740] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 293fa96e53fc447285b9eaec7ba3d452, State: Running, Role: LEADER
I20260709 13:16:48.281991  8376 consensus_queue.cc:260] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 293fa96e53fc447285b9eaec7ba3d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:48.283093  8376 raft_consensus.cc:3060] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:48.287704  8226 raft_consensus.cc:2468] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 40136f5ac8c040d18bcea0a86211be68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b29a30c058b24b799c64511edcc51af1 in term 2.
I20260709 13:16:48.289176  8266 leader_election.cc:304] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40136f5ac8c040d18bcea0a86211be68, b29a30c058b24b799c64511edcc51af1; no voters: 
I20260709 13:16:48.289738  8376 raft_consensus.cc:2468] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 293fa96e53fc447285b9eaec7ba3d452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b29a30c058b24b799c64511edcc51af1 in term 2.
I20260709 13:16:48.290026  8483 raft_consensus.cc:2804] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P b29a30c058b24b799c64511edcc51af1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:48.290594  8483 raft_consensus.cc:697] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P b29a30c058b24b799c64511edcc51af1 [term 2 LEADER]: Becoming Leader. State: Replica: b29a30c058b24b799c64511edcc51af1, State: Running, Role: LEADER
I20260709 13:16:48.291663  8483 consensus_queue.cc:237] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P b29a30c058b24b799c64511edcc51af1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:48.299391  8123 catalog_manager.cc:5697] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P b29a30c058b24b799c64511edcc51af1 reported cstate change: term changed from 1 to 2, leader changed from 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131) to b29a30c058b24b799c64511edcc51af1 (127.27.146.130). New cstate: current_term: 2 leader_uuid: "b29a30c058b24b799c64511edcc51af1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:48.404233  8445 raft_consensus.cc:993] T c346f6db2c27498fbf2e803ac5a47629 P b29a30c058b24b799c64511edcc51af1: : Instructing follower 40136f5ac8c040d18bcea0a86211be68 to start an election
I20260709 13:16:48.404815  8445 raft_consensus.cc:1081] T c346f6db2c27498fbf2e803ac5a47629 P b29a30c058b24b799c64511edcc51af1 [term 1 LEADER]: Signalling peer 40136f5ac8c040d18bcea0a86211be68 to start an election
I20260709 13:16:48.406754  8226 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c346f6db2c27498fbf2e803ac5a47629"
dest_uuid: "40136f5ac8c040d18bcea0a86211be68"
 from {username='slave'} at 127.0.0.1:58196
I20260709 13:16:48.407670  8226 raft_consensus.cc:493] T c346f6db2c27498fbf2e803ac5a47629 P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:48.408031  8226 raft_consensus.cc:3060] T c346f6db2c27498fbf2e803ac5a47629 P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:48.413955  8226 raft_consensus.cc:515] T c346f6db2c27498fbf2e803ac5a47629 P 40136f5ac8c040d18bcea0a86211be68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:48.416162  8226 leader_election.cc:290] T c346f6db2c27498fbf2e803ac5a47629 P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 2 election: Requested vote from peers b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:48.417073  8301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c346f6db2c27498fbf2e803ac5a47629" candidate_uuid: "40136f5ac8c040d18bcea0a86211be68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b29a30c058b24b799c64511edcc51af1"
I20260709 13:16:48.417362  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c346f6db2c27498fbf2e803ac5a47629" candidate_uuid: "40136f5ac8c040d18bcea0a86211be68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "293fa96e53fc447285b9eaec7ba3d452"
I20260709 13:16:48.417761  8301 raft_consensus.cc:3055] T c346f6db2c27498fbf2e803ac5a47629 P b29a30c058b24b799c64511edcc51af1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:48.418012  8375 raft_consensus.cc:3060] T c346f6db2c27498fbf2e803ac5a47629 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:48.418154  8301 raft_consensus.cc:740] T c346f6db2c27498fbf2e803ac5a47629 P b29a30c058b24b799c64511edcc51af1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b29a30c058b24b799c64511edcc51af1, State: Running, Role: LEADER
I20260709 13:16:48.419063  8301 consensus_queue.cc:260] T c346f6db2c27498fbf2e803ac5a47629 P b29a30c058b24b799c64511edcc51af1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:48.420192  8301 raft_consensus.cc:3060] T c346f6db2c27498fbf2e803ac5a47629 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:48.424481  8375 raft_consensus.cc:2468] T c346f6db2c27498fbf2e803ac5a47629 P 293fa96e53fc447285b9eaec7ba3d452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40136f5ac8c040d18bcea0a86211be68 in term 2.
I20260709 13:16:48.426056  8191 leader_election.cc:304] T c346f6db2c27498fbf2e803ac5a47629 P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293fa96e53fc447285b9eaec7ba3d452, 40136f5ac8c040d18bcea0a86211be68; no voters: 
I20260709 13:16:48.426832  8301 raft_consensus.cc:2468] T c346f6db2c27498fbf2e803ac5a47629 P b29a30c058b24b799c64511edcc51af1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40136f5ac8c040d18bcea0a86211be68 in term 2.
I20260709 13:16:48.427211  8423 raft_consensus.cc:2804] T c346f6db2c27498fbf2e803ac5a47629 P 40136f5ac8c040d18bcea0a86211be68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:48.427940  8423 raft_consensus.cc:697] T c346f6db2c27498fbf2e803ac5a47629 P 40136f5ac8c040d18bcea0a86211be68 [term 2 LEADER]: Becoming Leader. State: Replica: 40136f5ac8c040d18bcea0a86211be68, State: Running, Role: LEADER
I20260709 13:16:48.428862  8423 consensus_queue.cc:237] T c346f6db2c27498fbf2e803ac5a47629 P 40136f5ac8c040d18bcea0a86211be68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:48.436103  8123 catalog_manager.cc:5697] T c346f6db2c27498fbf2e803ac5a47629 P 40136f5ac8c040d18bcea0a86211be68 reported cstate change: term changed from 1 to 2, leader changed from b29a30c058b24b799c64511edcc51af1 (127.27.146.130) to 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129). New cstate: current_term: 2 leader_uuid: "40136f5ac8c040d18bcea0a86211be68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:48.484964  8424 raft_consensus.cc:993] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 293fa96e53fc447285b9eaec7ba3d452: : Instructing follower b29a30c058b24b799c64511edcc51af1 to start an election
I20260709 13:16:48.485780  8469 raft_consensus.cc:1081] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 LEADER]: Signalling peer b29a30c058b24b799c64511edcc51af1 to start an election
I20260709 13:16:48.489044  8301 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6cfddc3bdd0b4550b4672e0cf720cd39"
dest_uuid: "b29a30c058b24b799c64511edcc51af1"
 from {username='slave'} at 127.0.0.1:34692
I20260709 13:16:48.489804  8301 raft_consensus.cc:493] T 6cfddc3bdd0b4550b4672e0cf720cd39 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:48.490135  8301 raft_consensus.cc:3060] T 6cfddc3bdd0b4550b4672e0cf720cd39 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:48.494831  8302 raft_consensus.cc:1275] T cd1da709c81d4c17a8308b204dca7be7 P b29a30c058b24b799c64511edcc51af1 [term 2 FOLLOWER]: Refusing update from remote peer 293fa96e53fc447285b9eaec7ba3d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:48.496551  8469 consensus_queue.cc:1048] T cd1da709c81d4c17a8308b204dca7be7 P 293fa96e53fc447285b9eaec7ba3d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:48.497011  8301 raft_consensus.cc:515] T 6cfddc3bdd0b4550b4672e0cf720cd39 P b29a30c058b24b799c64511edcc51af1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:48.498980  8301 leader_election.cc:290] T 6cfddc3bdd0b4550b4672e0cf720cd39 P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 2 election: Requested vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:48.499985  8226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfddc3bdd0b4550b4672e0cf720cd39" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40136f5ac8c040d18bcea0a86211be68"
I20260709 13:16:48.500551  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cfddc3bdd0b4550b4672e0cf720cd39" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "293fa96e53fc447285b9eaec7ba3d452"
I20260709 13:16:48.500859  8226 raft_consensus.cc:3060] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:48.501277  8375 raft_consensus.cc:3055] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:48.501626  8375 raft_consensus.cc:740] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 293fa96e53fc447285b9eaec7ba3d452, State: Running, Role: LEADER
I20260709 13:16:48.502688  8375 consensus_queue.cc:260] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 293fa96e53fc447285b9eaec7ba3d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:48.504271  8375 raft_consensus.cc:3060] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:48.509776  8225 raft_consensus.cc:1275] T cd1da709c81d4c17a8308b204dca7be7 P 40136f5ac8c040d18bcea0a86211be68 [term 2 FOLLOWER]: Refusing update from remote peer 293fa96e53fc447285b9eaec7ba3d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:48.510308  8226 raft_consensus.cc:2468] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 40136f5ac8c040d18bcea0a86211be68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b29a30c058b24b799c64511edcc51af1 in term 2.
I20260709 13:16:48.511983  8266 leader_election.cc:304] T 6cfddc3bdd0b4550b4672e0cf720cd39 P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40136f5ac8c040d18bcea0a86211be68, b29a30c058b24b799c64511edcc51af1; no voters: 
I20260709 13:16:48.512938  8445 raft_consensus.cc:2804] T 6cfddc3bdd0b4550b4672e0cf720cd39 P b29a30c058b24b799c64511edcc51af1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:48.513558  8445 raft_consensus.cc:697] T 6cfddc3bdd0b4550b4672e0cf720cd39 P b29a30c058b24b799c64511edcc51af1 [term 2 LEADER]: Becoming Leader. State: Replica: b29a30c058b24b799c64511edcc51af1, State: Running, Role: LEADER
I20260709 13:16:48.514531  8445 consensus_queue.cc:237] T 6cfddc3bdd0b4550b4672e0cf720cd39 P b29a30c058b24b799c64511edcc51af1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:48.517279  8469 consensus_queue.cc:1048] T cd1da709c81d4c17a8308b204dca7be7 P 293fa96e53fc447285b9eaec7ba3d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:48.520146  8375 raft_consensus.cc:2468] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 293fa96e53fc447285b9eaec7ba3d452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b29a30c058b24b799c64511edcc51af1 in term 2.
I20260709 13:16:48.528432  8122 catalog_manager.cc:5697] T 6cfddc3bdd0b4550b4672e0cf720cd39 P b29a30c058b24b799c64511edcc51af1 reported cstate change: term changed from 1 to 2, leader changed from 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131) to b29a30c058b24b799c64511edcc51af1 (127.27.146.130). New cstate: current_term: 2 leader_uuid: "b29a30c058b24b799c64511edcc51af1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:48.535158  8483 raft_consensus.cc:993] T a7bad7246022445bb86fa0f48a3afd6f P b29a30c058b24b799c64511edcc51af1: : Instructing follower 40136f5ac8c040d18bcea0a86211be68 to start an election
I20260709 13:16:48.535763  8445 raft_consensus.cc:1081] T a7bad7246022445bb86fa0f48a3afd6f P b29a30c058b24b799c64511edcc51af1 [term 1 LEADER]: Signalling peer 40136f5ac8c040d18bcea0a86211be68 to start an election
I20260709 13:16:48.537350  8226 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7bad7246022445bb86fa0f48a3afd6f"
dest_uuid: "40136f5ac8c040d18bcea0a86211be68"
 from {username='slave'} at 127.0.0.1:58196
I20260709 13:16:48.537979  8226 raft_consensus.cc:493] T a7bad7246022445bb86fa0f48a3afd6f P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:48.538431  8226 raft_consensus.cc:3060] T a7bad7246022445bb86fa0f48a3afd6f P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:48.544962  8226 raft_consensus.cc:515] T a7bad7246022445bb86fa0f48a3afd6f P 40136f5ac8c040d18bcea0a86211be68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:48.546865  8226 leader_election.cc:290] T a7bad7246022445bb86fa0f48a3afd6f P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 2 election: Requested vote from peers b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:48.548147  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bad7246022445bb86fa0f48a3afd6f" candidate_uuid: "40136f5ac8c040d18bcea0a86211be68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "293fa96e53fc447285b9eaec7ba3d452"
I20260709 13:16:48.548063  8302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bad7246022445bb86fa0f48a3afd6f" candidate_uuid: "40136f5ac8c040d18bcea0a86211be68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b29a30c058b24b799c64511edcc51af1"
I20260709 13:16:48.549042  8375 raft_consensus.cc:3060] T a7bad7246022445bb86fa0f48a3afd6f P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:48.549098  8302 raft_consensus.cc:3055] T a7bad7246022445bb86fa0f48a3afd6f P b29a30c058b24b799c64511edcc51af1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:48.549640  8302 raft_consensus.cc:740] T a7bad7246022445bb86fa0f48a3afd6f P b29a30c058b24b799c64511edcc51af1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b29a30c058b24b799c64511edcc51af1, State: Running, Role: LEADER
I20260709 13:16:48.550550  8302 consensus_queue.cc:260] T a7bad7246022445bb86fa0f48a3afd6f P b29a30c058b24b799c64511edcc51af1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:48.552057  8302 raft_consensus.cc:3060] T a7bad7246022445bb86fa0f48a3afd6f P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:48.558403  8375 raft_consensus.cc:2468] T a7bad7246022445bb86fa0f48a3afd6f P 293fa96e53fc447285b9eaec7ba3d452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40136f5ac8c040d18bcea0a86211be68 in term 2.
I20260709 13:16:48.560050  8191 leader_election.cc:304] T a7bad7246022445bb86fa0f48a3afd6f P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293fa96e53fc447285b9eaec7ba3d452, 40136f5ac8c040d18bcea0a86211be68; no voters: 
I20260709 13:16:48.560922  8302 raft_consensus.cc:2468] T a7bad7246022445bb86fa0f48a3afd6f P b29a30c058b24b799c64511edcc51af1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40136f5ac8c040d18bcea0a86211be68 in term 2.
I20260709 13:16:48.561062  8423 raft_consensus.cc:2804] T a7bad7246022445bb86fa0f48a3afd6f P 40136f5ac8c040d18bcea0a86211be68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:48.561758  8423 raft_consensus.cc:697] T a7bad7246022445bb86fa0f48a3afd6f P 40136f5ac8c040d18bcea0a86211be68 [term 2 LEADER]: Becoming Leader. State: Replica: 40136f5ac8c040d18bcea0a86211be68, State: Running, Role: LEADER
I20260709 13:16:48.562635  8423 consensus_queue.cc:237] T a7bad7246022445bb86fa0f48a3afd6f P 40136f5ac8c040d18bcea0a86211be68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:48.566250  8469 raft_consensus.cc:993] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452: : Instructing follower b29a30c058b24b799c64511edcc51af1 to start an election
I20260709 13:16:48.566890  8450 raft_consensus.cc:1081] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 [term 1 LEADER]: Signalling peer b29a30c058b24b799c64511edcc51af1 to start an election
I20260709 13:16:48.568840  8302 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc5215886f3d4f0eb3364d518fb846bc"
dest_uuid: "b29a30c058b24b799c64511edcc51af1"
 from {username='slave'} at 127.0.0.1:34692
I20260709 13:16:48.569427  8302 raft_consensus.cc:493] T bc5215886f3d4f0eb3364d518fb846bc P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:48.569748  8302 raft_consensus.cc:3060] T bc5215886f3d4f0eb3364d518fb846bc P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:48.572227  8124 catalog_manager.cc:5697] T a7bad7246022445bb86fa0f48a3afd6f P 40136f5ac8c040d18bcea0a86211be68 reported cstate change: term changed from 1 to 2, leader changed from b29a30c058b24b799c64511edcc51af1 (127.27.146.130) to 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129). New cstate: current_term: 2 leader_uuid: "40136f5ac8c040d18bcea0a86211be68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:48.578267  8302 raft_consensus.cc:515] T bc5215886f3d4f0eb3364d518fb846bc P b29a30c058b24b799c64511edcc51af1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:48.580705  8302 leader_election.cc:290] T bc5215886f3d4f0eb3364d518fb846bc P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 2 election: Requested vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:48.582757  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5215886f3d4f0eb3364d518fb846bc" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "293fa96e53fc447285b9eaec7ba3d452"
I20260709 13:16:48.583547  8375 raft_consensus.cc:3055] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:48.583902  8375 raft_consensus.cc:740] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 293fa96e53fc447285b9eaec7ba3d452, State: Running, Role: LEADER
I20260709 13:16:48.583885  8226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5215886f3d4f0eb3364d518fb846bc" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40136f5ac8c040d18bcea0a86211be68"
I20260709 13:16:48.585970  8226 raft_consensus.cc:3060] T bc5215886f3d4f0eb3364d518fb846bc P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:48.586181  8375 consensus_queue.cc:260] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:48.587430  8375 raft_consensus.cc:3060] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:48.593606  8375 raft_consensus.cc:2468] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b29a30c058b24b799c64511edcc51af1 in term 2.
I20260709 13:16:48.593603  8226 raft_consensus.cc:2468] T bc5215886f3d4f0eb3364d518fb846bc P 40136f5ac8c040d18bcea0a86211be68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b29a30c058b24b799c64511edcc51af1 in term 2.
I20260709 13:16:48.595431  8266 leader_election.cc:304] T bc5215886f3d4f0eb3364d518fb846bc P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293fa96e53fc447285b9eaec7ba3d452, b29a30c058b24b799c64511edcc51af1; no voters: 
I20260709 13:16:48.596369  8445 raft_consensus.cc:2804] T bc5215886f3d4f0eb3364d518fb846bc P b29a30c058b24b799c64511edcc51af1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:48.596906  8445 raft_consensus.cc:697] T bc5215886f3d4f0eb3364d518fb846bc P b29a30c058b24b799c64511edcc51af1 [term 2 LEADER]: Becoming Leader. State: Replica: b29a30c058b24b799c64511edcc51af1, State: Running, Role: LEADER
I20260709 13:16:48.597776  8445 consensus_queue.cc:237] T bc5215886f3d4f0eb3364d518fb846bc P b29a30c058b24b799c64511edcc51af1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:48.605789  8124 catalog_manager.cc:5697] T bc5215886f3d4f0eb3364d518fb846bc P b29a30c058b24b799c64511edcc51af1 reported cstate change: term changed from 1 to 2, leader changed from 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131) to b29a30c058b24b799c64511edcc51af1 (127.27.146.130). New cstate: current_term: 2 leader_uuid: "b29a30c058b24b799c64511edcc51af1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:48.698442  8226 raft_consensus.cc:1275] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 40136f5ac8c040d18bcea0a86211be68 [term 2 FOLLOWER]: Refusing update from remote peer b29a30c058b24b799c64511edcc51af1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:48.700037  8445 consensus_queue.cc:1048] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P b29a30c058b24b799c64511edcc51af1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:48.709338  8375 raft_consensus.cc:1275] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 293fa96e53fc447285b9eaec7ba3d452 [term 2 FOLLOWER]: Refusing update from remote peer b29a30c058b24b799c64511edcc51af1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:48.711470  8445 consensus_queue.cc:1048] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P b29a30c058b24b799c64511edcc51af1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:48.876600  8302 raft_consensus.cc:1275] T c346f6db2c27498fbf2e803ac5a47629 P b29a30c058b24b799c64511edcc51af1 [term 2 FOLLOWER]: Refusing update from remote peer 40136f5ac8c040d18bcea0a86211be68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:48.878196  8438 consensus_queue.cc:1048] T c346f6db2c27498fbf2e803ac5a47629 P 40136f5ac8c040d18bcea0a86211be68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:48.888445  8375 raft_consensus.cc:1275] T c346f6db2c27498fbf2e803ac5a47629 P 293fa96e53fc447285b9eaec7ba3d452 [term 2 FOLLOWER]: Refusing update from remote peer 40136f5ac8c040d18bcea0a86211be68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:48.892746  8423 consensus_queue.cc:1048] T c346f6db2c27498fbf2e803ac5a47629 P 40136f5ac8c040d18bcea0a86211be68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:48.992887  8302 raft_consensus.cc:1275] T a7bad7246022445bb86fa0f48a3afd6f P b29a30c058b24b799c64511edcc51af1 [term 2 FOLLOWER]: Refusing update from remote peer 40136f5ac8c040d18bcea0a86211be68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:48.994681  8423 consensus_queue.cc:1048] T a7bad7246022445bb86fa0f48a3afd6f P 40136f5ac8c040d18bcea0a86211be68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:49.005756  8375 raft_consensus.cc:1275] T a7bad7246022445bb86fa0f48a3afd6f P 293fa96e53fc447285b9eaec7ba3d452 [term 2 FOLLOWER]: Refusing update from remote peer 40136f5ac8c040d18bcea0a86211be68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:49.007714  8423 consensus_queue.cc:1048] T a7bad7246022445bb86fa0f48a3afd6f P 40136f5ac8c040d18bcea0a86211be68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:49.025930  8375 raft_consensus.cc:1275] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 293fa96e53fc447285b9eaec7ba3d452 [term 2 FOLLOWER]: Refusing update from remote peer b29a30c058b24b799c64511edcc51af1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:49.027568  8445 consensus_queue.cc:1048] T 6cfddc3bdd0b4550b4672e0cf720cd39 P b29a30c058b24b799c64511edcc51af1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:49.037705  8226 raft_consensus.cc:1275] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 40136f5ac8c040d18bcea0a86211be68 [term 2 FOLLOWER]: Refusing update from remote peer b29a30c058b24b799c64511edcc51af1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:49.039536  8483 consensus_queue.cc:1048] T 6cfddc3bdd0b4550b4672e0cf720cd39 P b29a30c058b24b799c64511edcc51af1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:49.098593  8226 raft_consensus.cc:1275] T bc5215886f3d4f0eb3364d518fb846bc P 40136f5ac8c040d18bcea0a86211be68 [term 2 FOLLOWER]: Refusing update from remote peer b29a30c058b24b799c64511edcc51af1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:49.100142  8448 consensus_queue.cc:1048] T bc5215886f3d4f0eb3364d518fb846bc P b29a30c058b24b799c64511edcc51af1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:49.110693  8375 raft_consensus.cc:1275] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 [term 2 FOLLOWER]: Refusing update from remote peer b29a30c058b24b799c64511edcc51af1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:49.112864  8448 consensus_queue.cc:1048] T bc5215886f3d4f0eb3364d518fb846bc P b29a30c058b24b799c64511edcc51af1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:51.087663  8123 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35432:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:16:51.090358  8123 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:16:51.145915  8217 tablet_service.cc:1511] Processing CreateTablet for tablet fd73e7ced65b4e0d9c0c447d6a73d9f9 (DEFAULT_TABLE table=soft_deleted_table [id=139434d8c2ac4ba2b214896a2cb21c24]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:51.147426  8217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd73e7ced65b4e0d9c0c447d6a73d9f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:51.147083  8288 tablet_service.cc:1511] Processing CreateTablet for tablet fd73e7ced65b4e0d9c0c447d6a73d9f9 (DEFAULT_TABLE table=soft_deleted_table [id=139434d8c2ac4ba2b214896a2cb21c24]), partition=RANGE (key) PARTITION VALUES < 238609294
W20260709 13:16:51.149199  8173 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:51.149519  8288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd73e7ced65b4e0d9c0c447d6a73d9f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:51.149475  8363 tablet_service.cc:1511] Processing CreateTablet for tablet fd73e7ced65b4e0d9c0c447d6a73d9f9 (DEFAULT_TABLE table=soft_deleted_table [id=139434d8c2ac4ba2b214896a2cb21c24]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:51.151079  8363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd73e7ced65b4e0d9c0c447d6a73d9f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:51.153481  8212 tablet_service.cc:1511] Processing CreateTablet for tablet b2ddf231a512421b954496fd121e3cb5 (DEFAULT_TABLE table=soft_deleted_table [id=139434d8c2ac4ba2b214896a2cb21c24]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:51.154824  8212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2ddf231a512421b954496fd121e3cb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:51.159549  8289 tablet_service.cc:1511] Processing CreateTablet for tablet b2ddf231a512421b954496fd121e3cb5 (DEFAULT_TABLE table=soft_deleted_table [id=139434d8c2ac4ba2b214896a2cb21c24]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:51.159632  8211 tablet_service.cc:1511] Processing CreateTablet for tablet a06df4e98ae74d568ce68a93bf8d8b65 (DEFAULT_TABLE table=soft_deleted_table [id=139434d8c2ac4ba2b214896a2cb21c24]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:51.161393  8289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2ddf231a512421b954496fd121e3cb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:51.161231  8364 tablet_service.cc:1511] Processing CreateTablet for tablet b2ddf231a512421b954496fd121e3cb5 (DEFAULT_TABLE table=soft_deleted_table [id=139434d8c2ac4ba2b214896a2cb21c24]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:51.162130  8211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a06df4e98ae74d568ce68a93bf8d8b65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:51.162680  8364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2ddf231a512421b954496fd121e3cb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:51.166065  8287 tablet_service.cc:1511] Processing CreateTablet for tablet a06df4e98ae74d568ce68a93bf8d8b65 (DEFAULT_TABLE table=soft_deleted_table [id=139434d8c2ac4ba2b214896a2cb21c24]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:51.167546  8287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a06df4e98ae74d568ce68a93bf8d8b65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:51.169088  8362 tablet_service.cc:1511] Processing CreateTablet for tablet a06df4e98ae74d568ce68a93bf8d8b65 (DEFAULT_TABLE table=soft_deleted_table [id=139434d8c2ac4ba2b214896a2cb21c24]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:51.170511  8362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a06df4e98ae74d568ce68a93bf8d8b65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:51.171599  8290 tablet_service.cc:1511] Processing CreateTablet for tablet fe87dab5958e4af6b02ec49bd36c1696 (DEFAULT_TABLE table=soft_deleted_table [id=139434d8c2ac4ba2b214896a2cb21c24]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:51.172446  8213 tablet_service.cc:1511] Processing CreateTablet for tablet fe87dab5958e4af6b02ec49bd36c1696 (DEFAULT_TABLE table=soft_deleted_table [id=139434d8c2ac4ba2b214896a2cb21c24]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:51.173046  8290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe87dab5958e4af6b02ec49bd36c1696. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:51.173796  8213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe87dab5958e4af6b02ec49bd36c1696. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:51.195333  8365 tablet_service.cc:1511] Processing CreateTablet for tablet fe87dab5958e4af6b02ec49bd36c1696 (DEFAULT_TABLE table=soft_deleted_table [id=139434d8c2ac4ba2b214896a2cb21c24]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:51.196789  8365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe87dab5958e4af6b02ec49bd36c1696. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:51.207931  8215 tablet_service.cc:1511] Processing CreateTablet for tablet ee21df898e384d3993f352142b8595c1 (DEFAULT_TABLE table=soft_deleted_table [id=139434d8c2ac4ba2b214896a2cb21c24]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:51.209430  8215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee21df898e384d3993f352142b8595c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:51.220348  8361 tablet_service.cc:1511] Processing CreateTablet for tablet ee21df898e384d3993f352142b8595c1 (DEFAULT_TABLE table=soft_deleted_table [id=139434d8c2ac4ba2b214896a2cb21c24]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:51.221850  8361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee21df898e384d3993f352142b8595c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:51.222456  8520 tablet_bootstrap.cc:492] T a06df4e98ae74d568ce68a93bf8d8b65 P 293fa96e53fc447285b9eaec7ba3d452: Bootstrap starting.
I20260709 13:16:51.225373  8289 tablet_service.cc:1511] Processing CreateTablet for tablet ee21df898e384d3993f352142b8595c1 (DEFAULT_TABLE table=soft_deleted_table [id=139434d8c2ac4ba2b214896a2cb21c24]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:51.225225  8287 tablet_service.cc:1511] Processing CreateTablet for tablet d8170e37c2074b2ebeefa955aa74d678 (DEFAULT_TABLE table=soft_deleted_table [id=139434d8c2ac4ba2b214896a2cb21c24]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:51.226997  8287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8170e37c2074b2ebeefa955aa74d678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:51.229166  8214 tablet_service.cc:1511] Processing CreateTablet for tablet d8170e37c2074b2ebeefa955aa74d678 (DEFAULT_TABLE table=soft_deleted_table [id=139434d8c2ac4ba2b214896a2cb21c24]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:51.230628  8214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8170e37c2074b2ebeefa955aa74d678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:51.232314  8289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee21df898e384d3993f352142b8595c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:51.235137  8290 tablet_service.cc:1511] Processing CreateTablet for tablet 6a0e7ee47f18454283552529e1acea87 (DEFAULT_TABLE table=soft_deleted_table [id=139434d8c2ac4ba2b214896a2cb21c24]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:51.235733  8216 tablet_service.cc:1511] Processing CreateTablet for tablet 6a0e7ee47f18454283552529e1acea87 (DEFAULT_TABLE table=soft_deleted_table [id=139434d8c2ac4ba2b214896a2cb21c24]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:51.236855  8290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a0e7ee47f18454283552529e1acea87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:51.237154  8216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a0e7ee47f18454283552529e1acea87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:51.241701  8364 tablet_service.cc:1511] Processing CreateTablet for tablet d8170e37c2074b2ebeefa955aa74d678 (DEFAULT_TABLE table=soft_deleted_table [id=139434d8c2ac4ba2b214896a2cb21c24]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:51.243269  8364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8170e37c2074b2ebeefa955aa74d678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:51.249454  8362 tablet_service.cc:1511] Processing CreateTablet for tablet 6a0e7ee47f18454283552529e1acea87 (DEFAULT_TABLE table=soft_deleted_table [id=139434d8c2ac4ba2b214896a2cb21c24]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:51.250993  8362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a0e7ee47f18454283552529e1acea87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:51.253834  8520 tablet_bootstrap.cc:654] T a06df4e98ae74d568ce68a93bf8d8b65 P 293fa96e53fc447285b9eaec7ba3d452: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.266618  8210 tablet_service.cc:1511] Processing CreateTablet for tablet 91a0bff862a5440f859cef65668de0ec (DEFAULT_TABLE table=soft_deleted_table [id=139434d8c2ac4ba2b214896a2cb21c24]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:51.268595  8210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91a0bff862a5440f859cef65668de0ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:51.268740  8519 tablet_bootstrap.cc:492] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P b29a30c058b24b799c64511edcc51af1: Bootstrap starting.
I20260709 13:16:51.272939  8521 tablet_bootstrap.cc:492] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 40136f5ac8c040d18bcea0a86211be68: Bootstrap starting.
I20260709 13:16:51.280270  8520 tablet_bootstrap.cc:492] T a06df4e98ae74d568ce68a93bf8d8b65 P 293fa96e53fc447285b9eaec7ba3d452: No bootstrap required, opened a new log
I20260709 13:16:51.280974  8520 ts_tablet_manager.cc:1403] T a06df4e98ae74d568ce68a93bf8d8b65 P 293fa96e53fc447285b9eaec7ba3d452: Time spent bootstrapping tablet: real 0.059s	user 0.011s	sys 0.002s
I20260709 13:16:51.297964  8288 tablet_service.cc:1511] Processing CreateTablet for tablet 91a0bff862a5440f859cef65668de0ec (DEFAULT_TABLE table=soft_deleted_table [id=139434d8c2ac4ba2b214896a2cb21c24]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:51.298141  8520 raft_consensus.cc:359] T a06df4e98ae74d568ce68a93bf8d8b65 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.299085  8520 raft_consensus.cc:385] T a06df4e98ae74d568ce68a93bf8d8b65 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.299407  8520 raft_consensus.cc:740] T a06df4e98ae74d568ce68a93bf8d8b65 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293fa96e53fc447285b9eaec7ba3d452, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.299441  8288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91a0bff862a5440f859cef65668de0ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:51.300266  8520 consensus_queue.cc:260] T a06df4e98ae74d568ce68a93bf8d8b65 P 293fa96e53fc447285b9eaec7ba3d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.301198  8366 tablet_service.cc:1511] Processing CreateTablet for tablet 91a0bff862a5440f859cef65668de0ec (DEFAULT_TABLE table=soft_deleted_table [id=139434d8c2ac4ba2b214896a2cb21c24]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:51.302527  8366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91a0bff862a5440f859cef65668de0ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:51.313248  8505 raft_consensus.cc:493] T a06df4e98ae74d568ce68a93bf8d8b65 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.313932  8505 raft_consensus.cc:515] T a06df4e98ae74d568ce68a93bf8d8b65 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.316505  8212 tablet_service.cc:1511] Processing CreateTablet for tablet 43cfc5b732654a7a9035a8f61d2c1c83 (DEFAULT_TABLE table=soft_deleted_table [id=139434d8c2ac4ba2b214896a2cb21c24]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:51.317416  8505 leader_election.cc:290] T a06df4e98ae74d568ce68a93bf8d8b65 P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155)
I20260709 13:16:51.318658  8302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a06df4e98ae74d568ce68a93bf8d8b65" candidate_uuid: "293fa96e53fc447285b9eaec7ba3d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b29a30c058b24b799c64511edcc51af1" is_pre_election: true
W20260709 13:16:51.318715  8340 leader_election.cc:343] T a06df4e98ae74d568ce68a93bf8d8b65 P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503): Not found: Tablet not found: a06df4e98ae74d568ce68a93bf8d8b65
I20260709 13:16:51.319113  8289 tablet_service.cc:1511] Processing CreateTablet for tablet 43cfc5b732654a7a9035a8f61d2c1c83 (DEFAULT_TABLE table=soft_deleted_table [id=139434d8c2ac4ba2b214896a2cb21c24]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:51.319991  8212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43cfc5b732654a7a9035a8f61d2c1c83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:51.320550  8289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43cfc5b732654a7a9035a8f61d2c1c83. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:16:51.321199  8342 leader_election.cc:343] T a06df4e98ae74d568ce68a93bf8d8b65 P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.323324  8342 leader_election.cc:304] T a06df4e98ae74d568ce68a93bf8d8b65 P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293fa96e53fc447285b9eaec7ba3d452; no voters: 40136f5ac8c040d18bcea0a86211be68, b29a30c058b24b799c64511edcc51af1
I20260709 13:16:51.325008  8505 raft_consensus.cc:2749] T a06df4e98ae74d568ce68a93bf8d8b65 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:51.322628  8520 ts_tablet_manager.cc:1434] T a06df4e98ae74d568ce68a93bf8d8b65 P 293fa96e53fc447285b9eaec7ba3d452: Time spent starting tablet: real 0.041s	user 0.004s	sys 0.005s
I20260709 13:16:51.327042  8520 tablet_bootstrap.cc:492] T b2ddf231a512421b954496fd121e3cb5 P 293fa96e53fc447285b9eaec7ba3d452: Bootstrap starting.
I20260709 13:16:51.337180  8364 tablet_service.cc:1511] Processing CreateTablet for tablet 43cfc5b732654a7a9035a8f61d2c1c83 (DEFAULT_TABLE table=soft_deleted_table [id=139434d8c2ac4ba2b214896a2cb21c24]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:51.338835  8364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43cfc5b732654a7a9035a8f61d2c1c83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:51.341815  8520 tablet_bootstrap.cc:654] T b2ddf231a512421b954496fd121e3cb5 P 293fa96e53fc447285b9eaec7ba3d452: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.358781  8520 tablet_bootstrap.cc:492] T b2ddf231a512421b954496fd121e3cb5 P 293fa96e53fc447285b9eaec7ba3d452: No bootstrap required, opened a new log
I20260709 13:16:51.359424  8520 ts_tablet_manager.cc:1403] T b2ddf231a512421b954496fd121e3cb5 P 293fa96e53fc447285b9eaec7ba3d452: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.007s
I20260709 13:16:51.362823  8520 raft_consensus.cc:359] T b2ddf231a512421b954496fd121e3cb5 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.363610  8520 raft_consensus.cc:385] T b2ddf231a512421b954496fd121e3cb5 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.363932  8520 raft_consensus.cc:740] T b2ddf231a512421b954496fd121e3cb5 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293fa96e53fc447285b9eaec7ba3d452, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.364697  8520 consensus_queue.cc:260] T b2ddf231a512421b954496fd121e3cb5 P 293fa96e53fc447285b9eaec7ba3d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.367256  8520 ts_tablet_manager.cc:1434] T b2ddf231a512421b954496fd121e3cb5 P 293fa96e53fc447285b9eaec7ba3d452: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:16:51.368376  8520 tablet_bootstrap.cc:492] T d8170e37c2074b2ebeefa955aa74d678 P 293fa96e53fc447285b9eaec7ba3d452: Bootstrap starting.
I20260709 13:16:51.374848  8519 tablet_bootstrap.cc:654] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P b29a30c058b24b799c64511edcc51af1: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.375939  8520 tablet_bootstrap.cc:654] T d8170e37c2074b2ebeefa955aa74d678 P 293fa96e53fc447285b9eaec7ba3d452: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.377658  8521 tablet_bootstrap.cc:654] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 40136f5ac8c040d18bcea0a86211be68: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.388972  8519 tablet_bootstrap.cc:492] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P b29a30c058b24b799c64511edcc51af1: No bootstrap required, opened a new log
I20260709 13:16:51.389331  8521 tablet_bootstrap.cc:492] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 40136f5ac8c040d18bcea0a86211be68: No bootstrap required, opened a new log
I20260709 13:16:51.389576  8519 ts_tablet_manager.cc:1403] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P b29a30c058b24b799c64511edcc51af1: Time spent bootstrapping tablet: real 0.121s	user 0.010s	sys 0.008s
I20260709 13:16:51.389892  8520 tablet_bootstrap.cc:492] T d8170e37c2074b2ebeefa955aa74d678 P 293fa96e53fc447285b9eaec7ba3d452: No bootstrap required, opened a new log
I20260709 13:16:51.389998  8521 ts_tablet_manager.cc:1403] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 40136f5ac8c040d18bcea0a86211be68: Time spent bootstrapping tablet: real 0.117s	user 0.013s	sys 0.000s
I20260709 13:16:51.390514  8520 ts_tablet_manager.cc:1403] T d8170e37c2074b2ebeefa955aa74d678 P 293fa96e53fc447285b9eaec7ba3d452: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.007s
I20260709 13:16:51.392925  8519 raft_consensus.cc:359] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.393797  8519 raft_consensus.cc:385] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.393977  8520 raft_consensus.cc:359] T d8170e37c2074b2ebeefa955aa74d678 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.394493  8519 raft_consensus.cc:740] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b29a30c058b24b799c64511edcc51af1, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.394865  8520 raft_consensus.cc:385] T d8170e37c2074b2ebeefa955aa74d678 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.395462  8520 raft_consensus.cc:740] T d8170e37c2074b2ebeefa955aa74d678 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293fa96e53fc447285b9eaec7ba3d452, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.393630  8521 raft_consensus.cc:359] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.396247  8521 raft_consensus.cc:385] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.395802  8519 consensus_queue.cc:260] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P b29a30c058b24b799c64511edcc51af1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.396638  8521 raft_consensus.cc:740] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40136f5ac8c040d18bcea0a86211be68, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.396389  8520 consensus_queue.cc:260] T d8170e37c2074b2ebeefa955aa74d678 P 293fa96e53fc447285b9eaec7ba3d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.397543  8521 consensus_queue.cc:260] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 40136f5ac8c040d18bcea0a86211be68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.398921  8520 ts_tablet_manager.cc:1434] T d8170e37c2074b2ebeefa955aa74d678 P 293fa96e53fc447285b9eaec7ba3d452: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:16:51.400056  8521 ts_tablet_manager.cc:1434] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 40136f5ac8c040d18bcea0a86211be68: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.001s
I20260709 13:16:51.400349  8520 tablet_bootstrap.cc:492] T ee21df898e384d3993f352142b8595c1 P 293fa96e53fc447285b9eaec7ba3d452: Bootstrap starting.
I20260709 13:16:51.401539  8519 ts_tablet_manager.cc:1434] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P b29a30c058b24b799c64511edcc51af1: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.005s
I20260709 13:16:51.402635  8519 tablet_bootstrap.cc:492] T fe87dab5958e4af6b02ec49bd36c1696 P b29a30c058b24b799c64511edcc51af1: Bootstrap starting.
I20260709 13:16:51.408699  8508 raft_consensus.cc:493] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.409277  8508 raft_consensus.cc:515] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.409709  8520 tablet_bootstrap.cc:654] T ee21df898e384d3993f352142b8595c1 P 293fa96e53fc447285b9eaec7ba3d452: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.409720  8519 tablet_bootstrap.cc:654] T fe87dab5958e4af6b02ec49bd36c1696 P b29a30c058b24b799c64511edcc51af1: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.401259  8521 tablet_bootstrap.cc:492] T b2ddf231a512421b954496fd121e3cb5 P 40136f5ac8c040d18bcea0a86211be68: Bootstrap starting.
I20260709 13:16:51.415355  8302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd73e7ced65b4e0d9c0c447d6a73d9f9" candidate_uuid: "40136f5ac8c040d18bcea0a86211be68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b29a30c058b24b799c64511edcc51af1" is_pre_election: true
I20260709 13:16:51.416266  8302 raft_consensus.cc:2468] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40136f5ac8c040d18bcea0a86211be68 in term 0.
I20260709 13:16:51.417871  8193 leader_election.cc:304] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40136f5ac8c040d18bcea0a86211be68, b29a30c058b24b799c64511edcc51af1; no voters: 
I20260709 13:16:51.418973  8521 tablet_bootstrap.cc:654] T b2ddf231a512421b954496fd121e3cb5 P 40136f5ac8c040d18bcea0a86211be68: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.422240  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd73e7ced65b4e0d9c0c447d6a73d9f9" candidate_uuid: "40136f5ac8c040d18bcea0a86211be68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293fa96e53fc447285b9eaec7ba3d452" is_pre_election: true
W20260709 13:16:51.424575  8191 leader_election.cc:343] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.425536  8508 leader_election.cc:290] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:51.426347  8508 raft_consensus.cc:2804] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:51.426904  8508 raft_consensus.cc:493] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.427717  8508 raft_consensus.cc:3060] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.449932  8519 tablet_bootstrap.cc:492] T fe87dab5958e4af6b02ec49bd36c1696 P b29a30c058b24b799c64511edcc51af1: No bootstrap required, opened a new log
I20260709 13:16:51.450595  8519 ts_tablet_manager.cc:1403] T fe87dab5958e4af6b02ec49bd36c1696 P b29a30c058b24b799c64511edcc51af1: Time spent bootstrapping tablet: real 0.048s	user 0.025s	sys 0.008s
I20260709 13:16:51.453668  8519 raft_consensus.cc:359] T fe87dab5958e4af6b02ec49bd36c1696 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.454454  8519 raft_consensus.cc:385] T fe87dab5958e4af6b02ec49bd36c1696 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.454716  8519 raft_consensus.cc:740] T fe87dab5958e4af6b02ec49bd36c1696 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b29a30c058b24b799c64511edcc51af1, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.455412  8519 consensus_queue.cc:260] T fe87dab5958e4af6b02ec49bd36c1696 P b29a30c058b24b799c64511edcc51af1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.457592  8519 ts_tablet_manager.cc:1434] T fe87dab5958e4af6b02ec49bd36c1696 P b29a30c058b24b799c64511edcc51af1: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:16:51.458580  8519 tablet_bootstrap.cc:492] T a06df4e98ae74d568ce68a93bf8d8b65 P b29a30c058b24b799c64511edcc51af1: Bootstrap starting.
I20260709 13:16:51.463078  8521 tablet_bootstrap.cc:492] T b2ddf231a512421b954496fd121e3cb5 P 40136f5ac8c040d18bcea0a86211be68: No bootstrap required, opened a new log
I20260709 13:16:51.463977  8521 ts_tablet_manager.cc:1403] T b2ddf231a512421b954496fd121e3cb5 P 40136f5ac8c040d18bcea0a86211be68: Time spent bootstrapping tablet: real 0.063s	user 0.024s	sys 0.008s
I20260709 13:16:51.464198  8520 tablet_bootstrap.cc:492] T ee21df898e384d3993f352142b8595c1 P 293fa96e53fc447285b9eaec7ba3d452: No bootstrap required, opened a new log
I20260709 13:16:51.464872  8520 ts_tablet_manager.cc:1403] T ee21df898e384d3993f352142b8595c1 P 293fa96e53fc447285b9eaec7ba3d452: Time spent bootstrapping tablet: real 0.065s	user 0.022s	sys 0.010s
I20260709 13:16:51.465971  8519 tablet_bootstrap.cc:654] T a06df4e98ae74d568ce68a93bf8d8b65 P b29a30c058b24b799c64511edcc51af1: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.468350  8520 raft_consensus.cc:359] T ee21df898e384d3993f352142b8595c1 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.472255  8521 raft_consensus.cc:359] T b2ddf231a512421b954496fd121e3cb5 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.472698  8520 raft_consensus.cc:385] T ee21df898e384d3993f352142b8595c1 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.473186  8521 raft_consensus.cc:385] T b2ddf231a512421b954496fd121e3cb5 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.471769  8508 raft_consensus.cc:515] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.473688  8521 raft_consensus.cc:740] T b2ddf231a512421b954496fd121e3cb5 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40136f5ac8c040d18bcea0a86211be68, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.474512  8521 consensus_queue.cc:260] T b2ddf231a512421b954496fd121e3cb5 P 40136f5ac8c040d18bcea0a86211be68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.476382  8302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd73e7ced65b4e0d9c0c447d6a73d9f9" candidate_uuid: "40136f5ac8c040d18bcea0a86211be68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b29a30c058b24b799c64511edcc51af1"
I20260709 13:16:51.477017  8302 raft_consensus.cc:3060] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.484305  8508 leader_election.cc:290] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 election: Requested vote from peers b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:51.473277  8520 raft_consensus.cc:740] T ee21df898e384d3993f352142b8595c1 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293fa96e53fc447285b9eaec7ba3d452, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.485680  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd73e7ced65b4e0d9c0c447d6a73d9f9" candidate_uuid: "40136f5ac8c040d18bcea0a86211be68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293fa96e53fc447285b9eaec7ba3d452"
I20260709 13:16:51.485956  8520 consensus_queue.cc:260] T ee21df898e384d3993f352142b8595c1 P 293fa96e53fc447285b9eaec7ba3d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
W20260709 13:16:51.487565  8191 leader_election.cc:343] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.488888  8521 ts_tablet_manager.cc:1434] T b2ddf231a512421b954496fd121e3cb5 P 40136f5ac8c040d18bcea0a86211be68: Time spent starting tablet: real 0.024s	user 0.001s	sys 0.006s
I20260709 13:16:51.491803  8302 raft_consensus.cc:2468] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40136f5ac8c040d18bcea0a86211be68 in term 1.
I20260709 13:16:51.497210  8193 leader_election.cc:304] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40136f5ac8c040d18bcea0a86211be68, b29a30c058b24b799c64511edcc51af1; no voters: 293fa96e53fc447285b9eaec7ba3d452
I20260709 13:16:51.494019  8521 tablet_bootstrap.cc:492] T 91a0bff862a5440f859cef65668de0ec P 40136f5ac8c040d18bcea0a86211be68: Bootstrap starting.
I20260709 13:16:51.498167  8508 raft_consensus.cc:2804] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:51.498785  8508 raft_consensus.cc:697] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 40136f5ac8c040d18bcea0a86211be68 [term 1 LEADER]: Becoming Leader. State: Replica: 40136f5ac8c040d18bcea0a86211be68, State: Running, Role: LEADER
I20260709 13:16:51.499752  8508 consensus_queue.cc:237] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 40136f5ac8c040d18bcea0a86211be68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.502894  8519 tablet_bootstrap.cc:492] T a06df4e98ae74d568ce68a93bf8d8b65 P b29a30c058b24b799c64511edcc51af1: No bootstrap required, opened a new log
I20260709 13:16:51.488888  8520 ts_tablet_manager.cc:1434] T ee21df898e384d3993f352142b8595c1 P 293fa96e53fc447285b9eaec7ba3d452: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:16:51.503520  8519 ts_tablet_manager.cc:1403] T a06df4e98ae74d568ce68a93bf8d8b65 P b29a30c058b24b799c64511edcc51af1: Time spent bootstrapping tablet: real 0.045s	user 0.019s	sys 0.013s
I20260709 13:16:51.504931  8520 tablet_bootstrap.cc:492] T 6a0e7ee47f18454283552529e1acea87 P 293fa96e53fc447285b9eaec7ba3d452: Bootstrap starting.
I20260709 13:16:51.505707  8521 tablet_bootstrap.cc:654] T 91a0bff862a5440f859cef65668de0ec P 40136f5ac8c040d18bcea0a86211be68: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.506858  8519 raft_consensus.cc:359] T a06df4e98ae74d568ce68a93bf8d8b65 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.507719  8519 raft_consensus.cc:385] T a06df4e98ae74d568ce68a93bf8d8b65 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.508065  8519 raft_consensus.cc:740] T a06df4e98ae74d568ce68a93bf8d8b65 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b29a30c058b24b799c64511edcc51af1, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.508808  8519 consensus_queue.cc:260] T a06df4e98ae74d568ce68a93bf8d8b65 P b29a30c058b24b799c64511edcc51af1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.515249  8519 ts_tablet_manager.cc:1434] T a06df4e98ae74d568ce68a93bf8d8b65 P b29a30c058b24b799c64511edcc51af1: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:16:51.516360  8519 tablet_bootstrap.cc:492] T b2ddf231a512421b954496fd121e3cb5 P b29a30c058b24b799c64511edcc51af1: Bootstrap starting.
I20260709 13:16:51.525720  8520 tablet_bootstrap.cc:654] T 6a0e7ee47f18454283552529e1acea87 P 293fa96e53fc447285b9eaec7ba3d452: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.530289  8508 raft_consensus.cc:493] T b2ddf231a512421b954496fd121e3cb5 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.531090  8508 raft_consensus.cc:515] T b2ddf231a512421b954496fd121e3cb5 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.533303  8519 tablet_bootstrap.cc:654] T b2ddf231a512421b954496fd121e3cb5 P b29a30c058b24b799c64511edcc51af1: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.534051  8302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ddf231a512421b954496fd121e3cb5" candidate_uuid: "40136f5ac8c040d18bcea0a86211be68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b29a30c058b24b799c64511edcc51af1" is_pre_election: true
W20260709 13:16:51.535583  8193 leader_election.cc:343] T b2ddf231a512421b954496fd121e3cb5 P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.535828  8505 raft_consensus.cc:493] T d8170e37c2074b2ebeefa955aa74d678 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.536716  8505 raft_consensus.cc:515] T d8170e37c2074b2ebeefa955aa74d678 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.537189  8508 leader_election.cc:290] T b2ddf231a512421b954496fd121e3cb5 P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:51.538836  8521 tablet_bootstrap.cc:492] T 91a0bff862a5440f859cef65668de0ec P 40136f5ac8c040d18bcea0a86211be68: No bootstrap required, opened a new log
I20260709 13:16:51.539342  8521 ts_tablet_manager.cc:1403] T 91a0bff862a5440f859cef65668de0ec P 40136f5ac8c040d18bcea0a86211be68: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.025s
I20260709 13:16:51.540467  8226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8170e37c2074b2ebeefa955aa74d678" candidate_uuid: "293fa96e53fc447285b9eaec7ba3d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40136f5ac8c040d18bcea0a86211be68" is_pre_election: true
I20260709 13:16:51.541008  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ddf231a512421b954496fd121e3cb5" candidate_uuid: "40136f5ac8c040d18bcea0a86211be68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293fa96e53fc447285b9eaec7ba3d452" is_pre_election: true
I20260709 13:16:51.541858  8375 raft_consensus.cc:2468] T b2ddf231a512421b954496fd121e3cb5 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40136f5ac8c040d18bcea0a86211be68 in term 0.
W20260709 13:16:51.542065  8340 leader_election.cc:343] T d8170e37c2074b2ebeefa955aa74d678 P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.542572  8521 raft_consensus.cc:359] T 91a0bff862a5440f859cef65668de0ec P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.543212  8191 leader_election.cc:304] T b2ddf231a512421b954496fd121e3cb5 P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293fa96e53fc447285b9eaec7ba3d452, 40136f5ac8c040d18bcea0a86211be68; no voters: b29a30c058b24b799c64511edcc51af1
I20260709 13:16:51.543992  8520 tablet_bootstrap.cc:492] T 6a0e7ee47f18454283552529e1acea87 P 293fa96e53fc447285b9eaec7ba3d452: No bootstrap required, opened a new log
I20260709 13:16:51.544561  8508 raft_consensus.cc:2804] T b2ddf231a512421b954496fd121e3cb5 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:51.545153  8505 leader_election.cc:290] T d8170e37c2074b2ebeefa955aa74d678 P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155)
I20260709 13:16:51.545166  8508 raft_consensus.cc:493] T b2ddf231a512421b954496fd121e3cb5 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.546011  8508 raft_consensus.cc:3060] T b2ddf231a512421b954496fd121e3cb5 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.546126  8302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8170e37c2074b2ebeefa955aa74d678" candidate_uuid: "293fa96e53fc447285b9eaec7ba3d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b29a30c058b24b799c64511edcc51af1" is_pre_election: true
I20260709 13:16:51.545765  8124 catalog_manager.cc:5697] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 40136f5ac8c040d18bcea0a86211be68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "40136f5ac8c040d18bcea0a86211be68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:51.547988  8342 leader_election.cc:343] T d8170e37c2074b2ebeefa955aa74d678 P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.543291  8521 raft_consensus.cc:385] T 91a0bff862a5440f859cef65668de0ec P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.548792  8521 raft_consensus.cc:740] T 91a0bff862a5440f859cef65668de0ec P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40136f5ac8c040d18bcea0a86211be68, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.548758  8342 leader_election.cc:304] T d8170e37c2074b2ebeefa955aa74d678 P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293fa96e53fc447285b9eaec7ba3d452; no voters: 40136f5ac8c040d18bcea0a86211be68, b29a30c058b24b799c64511edcc51af1
I20260709 13:16:51.544611  8520 ts_tablet_manager.cc:1403] T 6a0e7ee47f18454283552529e1acea87 P 293fa96e53fc447285b9eaec7ba3d452: Time spent bootstrapping tablet: real 0.040s	user 0.017s	sys 0.007s
I20260709 13:16:51.549995  8521 consensus_queue.cc:260] T 91a0bff862a5440f859cef65668de0ec P 40136f5ac8c040d18bcea0a86211be68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.552434  8521 ts_tablet_manager.cc:1434] T 91a0bff862a5440f859cef65668de0ec P 40136f5ac8c040d18bcea0a86211be68: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:16:51.553452  8521 tablet_bootstrap.cc:492] T a06df4e98ae74d568ce68a93bf8d8b65 P 40136f5ac8c040d18bcea0a86211be68: Bootstrap starting.
I20260709 13:16:51.553917  8520 raft_consensus.cc:359] T 6a0e7ee47f18454283552529e1acea87 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.554876  8520 raft_consensus.cc:385] T 6a0e7ee47f18454283552529e1acea87 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.555184  8520 raft_consensus.cc:740] T 6a0e7ee47f18454283552529e1acea87 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293fa96e53fc447285b9eaec7ba3d452, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.560921  8521 tablet_bootstrap.cc:654] T a06df4e98ae74d568ce68a93bf8d8b65 P 40136f5ac8c040d18bcea0a86211be68: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.561527  8519 tablet_bootstrap.cc:492] T b2ddf231a512421b954496fd121e3cb5 P b29a30c058b24b799c64511edcc51af1: No bootstrap required, opened a new log
I20260709 13:16:51.562243  8519 ts_tablet_manager.cc:1403] T b2ddf231a512421b954496fd121e3cb5 P b29a30c058b24b799c64511edcc51af1: Time spent bootstrapping tablet: real 0.046s	user 0.003s	sys 0.010s
I20260709 13:16:51.561719  8520 consensus_queue.cc:260] T 6a0e7ee47f18454283552529e1acea87 P 293fa96e53fc447285b9eaec7ba3d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.566130  8520 ts_tablet_manager.cc:1434] T 6a0e7ee47f18454283552529e1acea87 P 293fa96e53fc447285b9eaec7ba3d452: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:16:51.566212  8519 raft_consensus.cc:359] T b2ddf231a512421b954496fd121e3cb5 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.567214  8519 raft_consensus.cc:385] T b2ddf231a512421b954496fd121e3cb5 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.557986  8508 raft_consensus.cc:515] T b2ddf231a512421b954496fd121e3cb5 P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.567266  8520 tablet_bootstrap.cc:492] T 43cfc5b732654a7a9035a8f61d2c1c83 P 293fa96e53fc447285b9eaec7ba3d452: Bootstrap starting.
I20260709 13:16:51.556883  8505 raft_consensus.cc:2749] T d8170e37c2074b2ebeefa955aa74d678 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:51.569600  8508 leader_election.cc:290] T b2ddf231a512421b954496fd121e3cb5 P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 election: Requested vote from peers b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:51.572260  8519 raft_consensus.cc:740] T b2ddf231a512421b954496fd121e3cb5 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b29a30c058b24b799c64511edcc51af1, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.572511  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ddf231a512421b954496fd121e3cb5" candidate_uuid: "40136f5ac8c040d18bcea0a86211be68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293fa96e53fc447285b9eaec7ba3d452"
I20260709 13:16:51.573303  8375 raft_consensus.cc:3060] T b2ddf231a512421b954496fd121e3cb5 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.573531  8519 consensus_queue.cc:260] T b2ddf231a512421b954496fd121e3cb5 P b29a30c058b24b799c64511edcc51af1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.575284  8302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ddf231a512421b954496fd121e3cb5" candidate_uuid: "40136f5ac8c040d18bcea0a86211be68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b29a30c058b24b799c64511edcc51af1"
I20260709 13:16:51.576035  8302 raft_consensus.cc:3060] T b2ddf231a512421b954496fd121e3cb5 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.578877  8519 ts_tablet_manager.cc:1434] T b2ddf231a512421b954496fd121e3cb5 P b29a30c058b24b799c64511edcc51af1: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.002s
I20260709 13:16:51.580837  8519 tablet_bootstrap.cc:492] T 6a0e7ee47f18454283552529e1acea87 P b29a30c058b24b799c64511edcc51af1: Bootstrap starting.
I20260709 13:16:51.590037  8519 tablet_bootstrap.cc:654] T 6a0e7ee47f18454283552529e1acea87 P b29a30c058b24b799c64511edcc51af1: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.601035  8302 raft_consensus.cc:2468] T b2ddf231a512421b954496fd121e3cb5 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40136f5ac8c040d18bcea0a86211be68 in term 1.
I20260709 13:16:51.601915  8375 raft_consensus.cc:2468] T b2ddf231a512421b954496fd121e3cb5 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40136f5ac8c040d18bcea0a86211be68 in term 1.
I20260709 13:16:51.595132  8520 tablet_bootstrap.cc:654] T 43cfc5b732654a7a9035a8f61d2c1c83 P 293fa96e53fc447285b9eaec7ba3d452: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.603592  8191 leader_election.cc:304] T b2ddf231a512421b954496fd121e3cb5 P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293fa96e53fc447285b9eaec7ba3d452, 40136f5ac8c040d18bcea0a86211be68; no voters: 
I20260709 13:16:51.605177  8508 raft_consensus.cc:2804] T b2ddf231a512421b954496fd121e3cb5 P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:51.605458  8529 raft_consensus.cc:493] T 91a0bff862a5440f859cef65668de0ec P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.605894  8508 raft_consensus.cc:697] T b2ddf231a512421b954496fd121e3cb5 P 40136f5ac8c040d18bcea0a86211be68 [term 1 LEADER]: Becoming Leader. State: Replica: 40136f5ac8c040d18bcea0a86211be68, State: Running, Role: LEADER
I20260709 13:16:51.606137  8529 raft_consensus.cc:515] T 91a0bff862a5440f859cef65668de0ec P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.606946  8508 consensus_queue.cc:237] T b2ddf231a512421b954496fd121e3cb5 P 40136f5ac8c040d18bcea0a86211be68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.607848  8505 raft_consensus.cc:493] T 6a0e7ee47f18454283552529e1acea87 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.608506  8505 raft_consensus.cc:515] T 6a0e7ee47f18454283552529e1acea87 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.608932  8529 leader_election.cc:290] T 91a0bff862a5440f859cef65668de0ec P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:51.610364  8301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a0bff862a5440f859cef65668de0ec" candidate_uuid: "40136f5ac8c040d18bcea0a86211be68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b29a30c058b24b799c64511edcc51af1" is_pre_election: true
I20260709 13:16:51.612123  8301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0e7ee47f18454283552529e1acea87" candidate_uuid: "293fa96e53fc447285b9eaec7ba3d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b29a30c058b24b799c64511edcc51af1" is_pre_election: true
I20260709 13:16:51.612780  8226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0e7ee47f18454283552529e1acea87" candidate_uuid: "293fa96e53fc447285b9eaec7ba3d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40136f5ac8c040d18bcea0a86211be68" is_pre_election: true
W20260709 13:16:51.613615  8193 leader_election.cc:343] T 91a0bff862a5440f859cef65668de0ec P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.614274  8505 leader_election.cc:290] T 6a0e7ee47f18454283552529e1acea87 P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155)
W20260709 13:16:51.615152  8342 leader_election.cc:343] T 6a0e7ee47f18454283552529e1acea87 P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:51.615804  8340 leader_election.cc:343] T 6a0e7ee47f18454283552529e1acea87 P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.616466  8340 leader_election.cc:304] T 6a0e7ee47f18454283552529e1acea87 P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293fa96e53fc447285b9eaec7ba3d452; no voters: 40136f5ac8c040d18bcea0a86211be68, b29a30c058b24b799c64511edcc51af1
I20260709 13:16:51.618165  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a0bff862a5440f859cef65668de0ec" candidate_uuid: "40136f5ac8c040d18bcea0a86211be68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293fa96e53fc447285b9eaec7ba3d452" is_pre_election: true
I20260709 13:16:51.618593  8521 tablet_bootstrap.cc:492] T a06df4e98ae74d568ce68a93bf8d8b65 P 40136f5ac8c040d18bcea0a86211be68: No bootstrap required, opened a new log
I20260709 13:16:51.619247  8521 ts_tablet_manager.cc:1403] T a06df4e98ae74d568ce68a93bf8d8b65 P 40136f5ac8c040d18bcea0a86211be68: Time spent bootstrapping tablet: real 0.066s	user 0.033s	sys 0.021s
I20260709 13:16:51.619899  8505 raft_consensus.cc:2749] T 6a0e7ee47f18454283552529e1acea87 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:16:51.620113  8191 leader_election.cc:343] T 91a0bff862a5440f859cef65668de0ec P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.620631  8191 leader_election.cc:304] T 91a0bff862a5440f859cef65668de0ec P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40136f5ac8c040d18bcea0a86211be68; no voters: 293fa96e53fc447285b9eaec7ba3d452, b29a30c058b24b799c64511edcc51af1
I20260709 13:16:51.621443  8529 raft_consensus.cc:2749] T 91a0bff862a5440f859cef65668de0ec P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:51.622936  8521 raft_consensus.cc:359] T a06df4e98ae74d568ce68a93bf8d8b65 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.623766  8521 raft_consensus.cc:385] T a06df4e98ae74d568ce68a93bf8d8b65 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.624054  8521 raft_consensus.cc:740] T a06df4e98ae74d568ce68a93bf8d8b65 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40136f5ac8c040d18bcea0a86211be68, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.624718  8521 consensus_queue.cc:260] T a06df4e98ae74d568ce68a93bf8d8b65 P 40136f5ac8c040d18bcea0a86211be68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.626642  8521 ts_tablet_manager.cc:1434] T a06df4e98ae74d568ce68a93bf8d8b65 P 40136f5ac8c040d18bcea0a86211be68: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:51.627681  8521 tablet_bootstrap.cc:492] T fe87dab5958e4af6b02ec49bd36c1696 P 40136f5ac8c040d18bcea0a86211be68: Bootstrap starting.
I20260709 13:16:51.634256  8521 tablet_bootstrap.cc:654] T fe87dab5958e4af6b02ec49bd36c1696 P 40136f5ac8c040d18bcea0a86211be68: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.646617  8519 tablet_bootstrap.cc:492] T 6a0e7ee47f18454283552529e1acea87 P b29a30c058b24b799c64511edcc51af1: No bootstrap required, opened a new log
I20260709 13:16:51.647450  8519 ts_tablet_manager.cc:1403] T 6a0e7ee47f18454283552529e1acea87 P b29a30c058b24b799c64511edcc51af1: Time spent bootstrapping tablet: real 0.067s	user 0.010s	sys 0.012s
I20260709 13:16:51.652922  8521 tablet_bootstrap.cc:492] T fe87dab5958e4af6b02ec49bd36c1696 P 40136f5ac8c040d18bcea0a86211be68: No bootstrap required, opened a new log
I20260709 13:16:51.654022  8521 ts_tablet_manager.cc:1403] T fe87dab5958e4af6b02ec49bd36c1696 P 40136f5ac8c040d18bcea0a86211be68: Time spent bootstrapping tablet: real 0.027s	user 0.005s	sys 0.014s
I20260709 13:16:51.653031  8519 raft_consensus.cc:359] T 6a0e7ee47f18454283552529e1acea87 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.654896  8519 raft_consensus.cc:385] T 6a0e7ee47f18454283552529e1acea87 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.655282  8519 raft_consensus.cc:740] T 6a0e7ee47f18454283552529e1acea87 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b29a30c058b24b799c64511edcc51af1, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.655383  8124 catalog_manager.cc:5697] T b2ddf231a512421b954496fd121e3cb5 P 40136f5ac8c040d18bcea0a86211be68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "40136f5ac8c040d18bcea0a86211be68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:51.656193  8519 consensus_queue.cc:260] T 6a0e7ee47f18454283552529e1acea87 P b29a30c058b24b799c64511edcc51af1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.658372  8448 raft_consensus.cc:493] T 6a0e7ee47f18454283552529e1acea87 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.657878  8521 raft_consensus.cc:359] T fe87dab5958e4af6b02ec49bd36c1696 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.656844  8520 tablet_bootstrap.cc:492] T 43cfc5b732654a7a9035a8f61d2c1c83 P 293fa96e53fc447285b9eaec7ba3d452: No bootstrap required, opened a new log
I20260709 13:16:51.658859  8521 raft_consensus.cc:385] T fe87dab5958e4af6b02ec49bd36c1696 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.659358  8521 raft_consensus.cc:740] T fe87dab5958e4af6b02ec49bd36c1696 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40136f5ac8c040d18bcea0a86211be68, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.658885  8448 raft_consensus.cc:515] T 6a0e7ee47f18454283552529e1acea87 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.659595  8520 ts_tablet_manager.cc:1403] T 43cfc5b732654a7a9035a8f61d2c1c83 P 293fa96e53fc447285b9eaec7ba3d452: Time spent bootstrapping tablet: real 0.093s	user 0.017s	sys 0.033s
I20260709 13:16:51.660327  8521 consensus_queue.cc:260] T fe87dab5958e4af6b02ec49bd36c1696 P 40136f5ac8c040d18bcea0a86211be68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.663483  8521 ts_tablet_manager.cc:1434] T fe87dab5958e4af6b02ec49bd36c1696 P 40136f5ac8c040d18bcea0a86211be68: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:16:51.664750  8521 tablet_bootstrap.cc:492] T 6a0e7ee47f18454283552529e1acea87 P 40136f5ac8c040d18bcea0a86211be68: Bootstrap starting.
I20260709 13:16:51.664216  8520 raft_consensus.cc:359] T 43cfc5b732654a7a9035a8f61d2c1c83 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.665298  8520 raft_consensus.cc:385] T 43cfc5b732654a7a9035a8f61d2c1c83 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.665190  8225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0e7ee47f18454283552529e1acea87" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40136f5ac8c040d18bcea0a86211be68" is_pre_election: true
I20260709 13:16:51.665712  8520 raft_consensus.cc:740] T 43cfc5b732654a7a9035a8f61d2c1c83 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293fa96e53fc447285b9eaec7ba3d452, State: Initialized, Role: FOLLOWER
W20260709 13:16:51.667039  8266 leader_election.cc:343] T 6a0e7ee47f18454283552529e1acea87 P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.667404  8519 ts_tablet_manager.cc:1434] T 6a0e7ee47f18454283552529e1acea87 P b29a30c058b24b799c64511edcc51af1: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.004s
I20260709 13:16:51.668696  8519 tablet_bootstrap.cc:492] T ee21df898e384d3993f352142b8595c1 P b29a30c058b24b799c64511edcc51af1: Bootstrap starting.
I20260709 13:16:51.669852  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0e7ee47f18454283552529e1acea87" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293fa96e53fc447285b9eaec7ba3d452" is_pre_election: true
I20260709 13:16:51.670665  8375 raft_consensus.cc:2468] T 6a0e7ee47f18454283552529e1acea87 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b29a30c058b24b799c64511edcc51af1 in term 0.
I20260709 13:16:51.672554  8521 tablet_bootstrap.cc:654] T 6a0e7ee47f18454283552529e1acea87 P 40136f5ac8c040d18bcea0a86211be68: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.672354  8266 leader_election.cc:304] T 6a0e7ee47f18454283552529e1acea87 P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293fa96e53fc447285b9eaec7ba3d452, b29a30c058b24b799c64511edcc51af1; no voters: 40136f5ac8c040d18bcea0a86211be68
I20260709 13:16:51.673017  8448 leader_election.cc:290] T 6a0e7ee47f18454283552529e1acea87 P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:51.674232  8448 raft_consensus.cc:2804] T 6a0e7ee47f18454283552529e1acea87 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:51.674746  8448 raft_consensus.cc:493] T 6a0e7ee47f18454283552529e1acea87 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.675189  8448 raft_consensus.cc:3060] T 6a0e7ee47f18454283552529e1acea87 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.675817  8519 tablet_bootstrap.cc:654] T ee21df898e384d3993f352142b8595c1 P b29a30c058b24b799c64511edcc51af1: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.677947  8520 consensus_queue.cc:260] T 43cfc5b732654a7a9035a8f61d2c1c83 P 293fa96e53fc447285b9eaec7ba3d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.680717  8520 ts_tablet_manager.cc:1434] T 43cfc5b732654a7a9035a8f61d2c1c83 P 293fa96e53fc447285b9eaec7ba3d452: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.001s
I20260709 13:16:51.681880  8520 tablet_bootstrap.cc:492] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 293fa96e53fc447285b9eaec7ba3d452: Bootstrap starting.
I20260709 13:16:51.691587  8520 tablet_bootstrap.cc:654] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 293fa96e53fc447285b9eaec7ba3d452: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.698132  8521 tablet_bootstrap.cc:492] T 6a0e7ee47f18454283552529e1acea87 P 40136f5ac8c040d18bcea0a86211be68: No bootstrap required, opened a new log
I20260709 13:16:51.697469  8448 raft_consensus.cc:515] T 6a0e7ee47f18454283552529e1acea87 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.698784  8521 ts_tablet_manager.cc:1403] T 6a0e7ee47f18454283552529e1acea87 P 40136f5ac8c040d18bcea0a86211be68: Time spent bootstrapping tablet: real 0.034s	user 0.018s	sys 0.012s
I20260709 13:16:51.701671  8225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0e7ee47f18454283552529e1acea87" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40136f5ac8c040d18bcea0a86211be68"
I20260709 13:16:51.702562  8521 raft_consensus.cc:359] T 6a0e7ee47f18454283552529e1acea87 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.703341  8521 raft_consensus.cc:385] T 6a0e7ee47f18454283552529e1acea87 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.703701  8521 raft_consensus.cc:740] T 6a0e7ee47f18454283552529e1acea87 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40136f5ac8c040d18bcea0a86211be68, State: Initialized, Role: FOLLOWER
W20260709 13:16:51.703789  8266 leader_election.cc:343] T 6a0e7ee47f18454283552529e1acea87 P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.704727  8521 consensus_queue.cc:260] T 6a0e7ee47f18454283552529e1acea87 P 40136f5ac8c040d18bcea0a86211be68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.706625  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0e7ee47f18454283552529e1acea87" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293fa96e53fc447285b9eaec7ba3d452"
I20260709 13:16:51.707661  8375 raft_consensus.cc:3060] T 6a0e7ee47f18454283552529e1acea87 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.709316  8520 tablet_bootstrap.cc:492] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 293fa96e53fc447285b9eaec7ba3d452: No bootstrap required, opened a new log
I20260709 13:16:51.709329  8521 ts_tablet_manager.cc:1434] T 6a0e7ee47f18454283552529e1acea87 P 40136f5ac8c040d18bcea0a86211be68: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 13:16:51.710023  8520 ts_tablet_manager.cc:1403] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 293fa96e53fc447285b9eaec7ba3d452: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.007s
I20260709 13:16:51.710755  8521 tablet_bootstrap.cc:492] T d8170e37c2074b2ebeefa955aa74d678 P 40136f5ac8c040d18bcea0a86211be68: Bootstrap starting.
I20260709 13:16:51.713910  8520 raft_consensus.cc:359] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.714807  8520 raft_consensus.cc:385] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.715111  8520 raft_consensus.cc:740] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293fa96e53fc447285b9eaec7ba3d452, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.716461  8519 tablet_bootstrap.cc:492] T ee21df898e384d3993f352142b8595c1 P b29a30c058b24b799c64511edcc51af1: No bootstrap required, opened a new log
I20260709 13:16:51.716094  8520 consensus_queue.cc:260] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 293fa96e53fc447285b9eaec7ba3d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.713454  8448 leader_election.cc:290] T 6a0e7ee47f18454283552529e1acea87 P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 election: Requested vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:51.717156  8375 raft_consensus.cc:2468] T 6a0e7ee47f18454283552529e1acea87 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b29a30c058b24b799c64511edcc51af1 in term 1.
I20260709 13:16:51.717262  8519 ts_tablet_manager.cc:1403] T ee21df898e384d3993f352142b8595c1 P b29a30c058b24b799c64511edcc51af1: Time spent bootstrapping tablet: real 0.049s	user 0.010s	sys 0.012s
I20260709 13:16:51.721135  8266 leader_election.cc:304] T 6a0e7ee47f18454283552529e1acea87 P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293fa96e53fc447285b9eaec7ba3d452, b29a30c058b24b799c64511edcc51af1; no voters: 40136f5ac8c040d18bcea0a86211be68
I20260709 13:16:51.718923  8520 ts_tablet_manager.cc:1434] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 293fa96e53fc447285b9eaec7ba3d452: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.006s
I20260709 13:16:51.722574  8448 raft_consensus.cc:2804] T 6a0e7ee47f18454283552529e1acea87 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:51.723800  8520 tablet_bootstrap.cc:492] T fe87dab5958e4af6b02ec49bd36c1696 P 293fa96e53fc447285b9eaec7ba3d452: Bootstrap starting.
I20260709 13:16:51.724406  8521 tablet_bootstrap.cc:654] T d8170e37c2074b2ebeefa955aa74d678 P 40136f5ac8c040d18bcea0a86211be68: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.724459  8448 raft_consensus.cc:697] T 6a0e7ee47f18454283552529e1acea87 P b29a30c058b24b799c64511edcc51af1 [term 1 LEADER]: Becoming Leader. State: Replica: b29a30c058b24b799c64511edcc51af1, State: Running, Role: LEADER
I20260709 13:16:51.728720  8448 consensus_queue.cc:237] T 6a0e7ee47f18454283552529e1acea87 P b29a30c058b24b799c64511edcc51af1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.729772  8519 raft_consensus.cc:359] T ee21df898e384d3993f352142b8595c1 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.730847  8519 raft_consensus.cc:385] T ee21df898e384d3993f352142b8595c1 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.731252  8519 raft_consensus.cc:740] T ee21df898e384d3993f352142b8595c1 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b29a30c058b24b799c64511edcc51af1, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.736020  8519 consensus_queue.cc:260] T ee21df898e384d3993f352142b8595c1 P b29a30c058b24b799c64511edcc51af1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.739172  8519 ts_tablet_manager.cc:1434] T ee21df898e384d3993f352142b8595c1 P b29a30c058b24b799c64511edcc51af1: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.001s
I20260709 13:16:51.740386  8519 tablet_bootstrap.cc:492] T d8170e37c2074b2ebeefa955aa74d678 P b29a30c058b24b799c64511edcc51af1: Bootstrap starting.
I20260709 13:16:51.740509  8520 tablet_bootstrap.cc:654] T fe87dab5958e4af6b02ec49bd36c1696 P 293fa96e53fc447285b9eaec7ba3d452: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.741133  8521 tablet_bootstrap.cc:492] T d8170e37c2074b2ebeefa955aa74d678 P 40136f5ac8c040d18bcea0a86211be68: No bootstrap required, opened a new log
I20260709 13:16:51.741696  8521 ts_tablet_manager.cc:1403] T d8170e37c2074b2ebeefa955aa74d678 P 40136f5ac8c040d18bcea0a86211be68: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.007s
I20260709 13:16:51.745221  8521 raft_consensus.cc:359] T d8170e37c2074b2ebeefa955aa74d678 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.745992  8521 raft_consensus.cc:385] T d8170e37c2074b2ebeefa955aa74d678 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.746373  8521 raft_consensus.cc:740] T d8170e37c2074b2ebeefa955aa74d678 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40136f5ac8c040d18bcea0a86211be68, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.744127  8125 catalog_manager.cc:5697] T 6a0e7ee47f18454283552529e1acea87 P b29a30c058b24b799c64511edcc51af1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b29a30c058b24b799c64511edcc51af1 (127.27.146.130). New cstate: current_term: 1 leader_uuid: "b29a30c058b24b799c64511edcc51af1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:51.747171  8521 consensus_queue.cc:260] T d8170e37c2074b2ebeefa955aa74d678 P 40136f5ac8c040d18bcea0a86211be68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.756861  8521 ts_tablet_manager.cc:1434] T d8170e37c2074b2ebeefa955aa74d678 P 40136f5ac8c040d18bcea0a86211be68: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:16:51.758144  8521 tablet_bootstrap.cc:492] T 43cfc5b732654a7a9035a8f61d2c1c83 P 40136f5ac8c040d18bcea0a86211be68: Bootstrap starting.
I20260709 13:16:51.765307  8521 tablet_bootstrap.cc:654] T 43cfc5b732654a7a9035a8f61d2c1c83 P 40136f5ac8c040d18bcea0a86211be68: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.770932  8519 tablet_bootstrap.cc:654] T d8170e37c2074b2ebeefa955aa74d678 P b29a30c058b24b799c64511edcc51af1: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.780931  8508 raft_consensus.cc:493] T d8170e37c2074b2ebeefa955aa74d678 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.781690  8521 tablet_bootstrap.cc:492] T 43cfc5b732654a7a9035a8f61d2c1c83 P 40136f5ac8c040d18bcea0a86211be68: No bootstrap required, opened a new log
I20260709 13:16:51.781596  8508 raft_consensus.cc:515] T d8170e37c2074b2ebeefa955aa74d678 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.782202  8521 ts_tablet_manager.cc:1403] T 43cfc5b732654a7a9035a8f61d2c1c83 P 40136f5ac8c040d18bcea0a86211be68: Time spent bootstrapping tablet: real 0.024s	user 0.006s	sys 0.011s
I20260709 13:16:51.783252  8520 tablet_bootstrap.cc:492] T fe87dab5958e4af6b02ec49bd36c1696 P 293fa96e53fc447285b9eaec7ba3d452: No bootstrap required, opened a new log
I20260709 13:16:51.783861  8520 ts_tablet_manager.cc:1403] T fe87dab5958e4af6b02ec49bd36c1696 P 293fa96e53fc447285b9eaec7ba3d452: Time spent bootstrapping tablet: real 0.060s	user 0.021s	sys 0.023s
I20260709 13:16:51.784987  8302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8170e37c2074b2ebeefa955aa74d678" candidate_uuid: "40136f5ac8c040d18bcea0a86211be68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b29a30c058b24b799c64511edcc51af1" is_pre_election: true
I20260709 13:16:51.785187  8521 raft_consensus.cc:359] T 43cfc5b732654a7a9035a8f61d2c1c83 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.785854  8508 leader_election.cc:290] T d8170e37c2074b2ebeefa955aa74d678 P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:51.785871  8521 raft_consensus.cc:385] T 43cfc5b732654a7a9035a8f61d2c1c83 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.785305  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8170e37c2074b2ebeefa955aa74d678" candidate_uuid: "40136f5ac8c040d18bcea0a86211be68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293fa96e53fc447285b9eaec7ba3d452" is_pre_election: true
I20260709 13:16:51.786448  8521 raft_consensus.cc:740] T 43cfc5b732654a7a9035a8f61d2c1c83 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40136f5ac8c040d18bcea0a86211be68, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.786737  8375 raft_consensus.cc:2468] T d8170e37c2074b2ebeefa955aa74d678 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40136f5ac8c040d18bcea0a86211be68 in term 0.
W20260709 13:16:51.786793  8193 leader_election.cc:343] T d8170e37c2074b2ebeefa955aa74d678 P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.787032  8520 raft_consensus.cc:359] T fe87dab5958e4af6b02ec49bd36c1696 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.787353  8521 consensus_queue.cc:260] T 43cfc5b732654a7a9035a8f61d2c1c83 P 40136f5ac8c040d18bcea0a86211be68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.788022  8520 raft_consensus.cc:385] T fe87dab5958e4af6b02ec49bd36c1696 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.788185  8191 leader_election.cc:304] T d8170e37c2074b2ebeefa955aa74d678 P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293fa96e53fc447285b9eaec7ba3d452, 40136f5ac8c040d18bcea0a86211be68; no voters: b29a30c058b24b799c64511edcc51af1
I20260709 13:16:51.788435  8520 raft_consensus.cc:740] T fe87dab5958e4af6b02ec49bd36c1696 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293fa96e53fc447285b9eaec7ba3d452, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.789989  8521 ts_tablet_manager.cc:1434] T 43cfc5b732654a7a9035a8f61d2c1c83 P 40136f5ac8c040d18bcea0a86211be68: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:16:51.789845  8520 consensus_queue.cc:260] T fe87dab5958e4af6b02ec49bd36c1696 P 293fa96e53fc447285b9eaec7ba3d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.791349  8521 tablet_bootstrap.cc:492] T ee21df898e384d3993f352142b8595c1 P 40136f5ac8c040d18bcea0a86211be68: Bootstrap starting.
I20260709 13:16:51.790692  8508 raft_consensus.cc:2804] T d8170e37c2074b2ebeefa955aa74d678 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:51.795552  8508 raft_consensus.cc:493] T d8170e37c2074b2ebeefa955aa74d678 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.796192  8520 ts_tablet_manager.cc:1434] T fe87dab5958e4af6b02ec49bd36c1696 P 293fa96e53fc447285b9eaec7ba3d452: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:16:51.797770  8520 tablet_bootstrap.cc:492] T 91a0bff862a5440f859cef65668de0ec P 293fa96e53fc447285b9eaec7ba3d452: Bootstrap starting.
I20260709 13:16:51.796099  8508 raft_consensus.cc:3060] T d8170e37c2074b2ebeefa955aa74d678 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.802030  8519 tablet_bootstrap.cc:492] T d8170e37c2074b2ebeefa955aa74d678 P b29a30c058b24b799c64511edcc51af1: No bootstrap required, opened a new log
I20260709 13:16:51.802692  8519 ts_tablet_manager.cc:1403] T d8170e37c2074b2ebeefa955aa74d678 P b29a30c058b24b799c64511edcc51af1: Time spent bootstrapping tablet: real 0.063s	user 0.018s	sys 0.010s
I20260709 13:16:51.804804  8520 tablet_bootstrap.cc:654] T 91a0bff862a5440f859cef65668de0ec P 293fa96e53fc447285b9eaec7ba3d452: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.806447  8519 raft_consensus.cc:359] T d8170e37c2074b2ebeefa955aa74d678 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.807384  8519 raft_consensus.cc:385] T d8170e37c2074b2ebeefa955aa74d678 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.807783  8519 raft_consensus.cc:740] T d8170e37c2074b2ebeefa955aa74d678 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b29a30c058b24b799c64511edcc51af1, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.808604  8519 consensus_queue.cc:260] T d8170e37c2074b2ebeefa955aa74d678 P b29a30c058b24b799c64511edcc51af1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.811214  8519 ts_tablet_manager.cc:1434] T d8170e37c2074b2ebeefa955aa74d678 P b29a30c058b24b799c64511edcc51af1: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:16:51.812767  8519 tablet_bootstrap.cc:492] T 91a0bff862a5440f859cef65668de0ec P b29a30c058b24b799c64511edcc51af1: Bootstrap starting.
I20260709 13:16:51.814882  8521 tablet_bootstrap.cc:654] T ee21df898e384d3993f352142b8595c1 P 40136f5ac8c040d18bcea0a86211be68: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.796605  8529 raft_consensus.cc:493] T a06df4e98ae74d568ce68a93bf8d8b65 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.825609  8529 raft_consensus.cc:515] T a06df4e98ae74d568ce68a93bf8d8b65 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.829272  8529 leader_election.cc:290] T a06df4e98ae74d568ce68a93bf8d8b65 P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:51.830886  8519 tablet_bootstrap.cc:654] T 91a0bff862a5440f859cef65668de0ec P b29a30c058b24b799c64511edcc51af1: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.831472  8508 raft_consensus.cc:515] T d8170e37c2074b2ebeefa955aa74d678 P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.833055  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a06df4e98ae74d568ce68a93bf8d8b65" candidate_uuid: "40136f5ac8c040d18bcea0a86211be68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293fa96e53fc447285b9eaec7ba3d452" is_pre_election: true
I20260709 13:16:51.833775  8508 leader_election.cc:290] T d8170e37c2074b2ebeefa955aa74d678 P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 election: Requested vote from peers b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:51.834196  8529 raft_consensus.cc:493] T fe87dab5958e4af6b02ec49bd36c1696 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.836197  8529 raft_consensus.cc:515] T fe87dab5958e4af6b02ec49bd36c1696 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.836472  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8170e37c2074b2ebeefa955aa74d678" candidate_uuid: "40136f5ac8c040d18bcea0a86211be68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293fa96e53fc447285b9eaec7ba3d452"
I20260709 13:16:51.837167  8376 raft_consensus.cc:3060] T d8170e37c2074b2ebeefa955aa74d678 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.837925  8301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8170e37c2074b2ebeefa955aa74d678" candidate_uuid: "40136f5ac8c040d18bcea0a86211be68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b29a30c058b24b799c64511edcc51af1"
I20260709 13:16:51.839298  8301 raft_consensus.cc:3060] T d8170e37c2074b2ebeefa955aa74d678 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.839538  8529 leader_election.cc:290] T fe87dab5958e4af6b02ec49bd36c1696 P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:51.843137  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe87dab5958e4af6b02ec49bd36c1696" candidate_uuid: "40136f5ac8c040d18bcea0a86211be68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293fa96e53fc447285b9eaec7ba3d452" is_pre_election: true
I20260709 13:16:51.844376  8374 raft_consensus.cc:2468] T fe87dab5958e4af6b02ec49bd36c1696 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40136f5ac8c040d18bcea0a86211be68 in term 0.
I20260709 13:16:51.844447  8302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a06df4e98ae74d568ce68a93bf8d8b65" candidate_uuid: "40136f5ac8c040d18bcea0a86211be68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b29a30c058b24b799c64511edcc51af1" is_pre_election: true
I20260709 13:16:51.844921  8300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe87dab5958e4af6b02ec49bd36c1696" candidate_uuid: "40136f5ac8c040d18bcea0a86211be68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b29a30c058b24b799c64511edcc51af1" is_pre_election: true
I20260709 13:16:51.845212  8302 raft_consensus.cc:2468] T a06df4e98ae74d568ce68a93bf8d8b65 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40136f5ac8c040d18bcea0a86211be68 in term 0.
I20260709 13:16:51.845650  8300 raft_consensus.cc:2468] T fe87dab5958e4af6b02ec49bd36c1696 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40136f5ac8c040d18bcea0a86211be68 in term 0.
I20260709 13:16:51.845943  8191 leader_election.cc:304] T fe87dab5958e4af6b02ec49bd36c1696 P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293fa96e53fc447285b9eaec7ba3d452, 40136f5ac8c040d18bcea0a86211be68; no voters: 
I20260709 13:16:51.846554  8193 leader_election.cc:304] T a06df4e98ae74d568ce68a93bf8d8b65 P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40136f5ac8c040d18bcea0a86211be68, b29a30c058b24b799c64511edcc51af1; no voters: 
I20260709 13:16:51.847647  8508 raft_consensus.cc:2804] T fe87dab5958e4af6b02ec49bd36c1696 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:51.848054  8508 raft_consensus.cc:493] T fe87dab5958e4af6b02ec49bd36c1696 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.848439  8508 raft_consensus.cc:3060] T fe87dab5958e4af6b02ec49bd36c1696 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.850457  8521 tablet_bootstrap.cc:492] T ee21df898e384d3993f352142b8595c1 P 40136f5ac8c040d18bcea0a86211be68: No bootstrap required, opened a new log
I20260709 13:16:51.851250  8521 ts_tablet_manager.cc:1403] T ee21df898e384d3993f352142b8595c1 P 40136f5ac8c040d18bcea0a86211be68: Time spent bootstrapping tablet: real 0.060s	user 0.013s	sys 0.006s
I20260709 13:16:51.833815  8375 raft_consensus.cc:2468] T a06df4e98ae74d568ce68a93bf8d8b65 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40136f5ac8c040d18bcea0a86211be68 in term 0.
I20260709 13:16:51.856596  8301 raft_consensus.cc:2468] T d8170e37c2074b2ebeefa955aa74d678 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40136f5ac8c040d18bcea0a86211be68 in term 1.
I20260709 13:16:51.851939  8529 raft_consensus.cc:2804] T a06df4e98ae74d568ce68a93bf8d8b65 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:51.853744  8520 tablet_bootstrap.cc:492] T 91a0bff862a5440f859cef65668de0ec P 293fa96e53fc447285b9eaec7ba3d452: No bootstrap required, opened a new log
I20260709 13:16:51.857923  8193 leader_election.cc:304] T d8170e37c2074b2ebeefa955aa74d678 P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40136f5ac8c040d18bcea0a86211be68, b29a30c058b24b799c64511edcc51af1; no voters: 
I20260709 13:16:51.858404  8520 ts_tablet_manager.cc:1403] T 91a0bff862a5440f859cef65668de0ec P 293fa96e53fc447285b9eaec7ba3d452: Time spent bootstrapping tablet: real 0.061s	user 0.011s	sys 0.019s
I20260709 13:16:51.858167  8529 raft_consensus.cc:493] T a06df4e98ae74d568ce68a93bf8d8b65 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.858861  8532 raft_consensus.cc:2804] T d8170e37c2074b2ebeefa955aa74d678 P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:51.859025  8529 raft_consensus.cc:3060] T a06df4e98ae74d568ce68a93bf8d8b65 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.860647  8532 raft_consensus.cc:697] T d8170e37c2074b2ebeefa955aa74d678 P 40136f5ac8c040d18bcea0a86211be68 [term 1 LEADER]: Becoming Leader. State: Replica: 40136f5ac8c040d18bcea0a86211be68, State: Running, Role: LEADER
I20260709 13:16:51.861572  8532 consensus_queue.cc:237] T d8170e37c2074b2ebeefa955aa74d678 P 40136f5ac8c040d18bcea0a86211be68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.862135  8520 raft_consensus.cc:359] T 91a0bff862a5440f859cef65668de0ec P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.862864  8520 raft_consensus.cc:385] T 91a0bff862a5440f859cef65668de0ec P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.863163  8520 raft_consensus.cc:740] T 91a0bff862a5440f859cef65668de0ec P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293fa96e53fc447285b9eaec7ba3d452, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.863888  8520 consensus_queue.cc:260] T 91a0bff862a5440f859cef65668de0ec P 293fa96e53fc447285b9eaec7ba3d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.856935  8508 raft_consensus.cc:515] T fe87dab5958e4af6b02ec49bd36c1696 P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.866535  8520 ts_tablet_manager.cc:1434] T 91a0bff862a5440f859cef65668de0ec P 293fa96e53fc447285b9eaec7ba3d452: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:16:51.869966  8508 leader_election.cc:290] T fe87dab5958e4af6b02ec49bd36c1696 P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 election: Requested vote from peers b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:51.869485  8521 raft_consensus.cc:359] T ee21df898e384d3993f352142b8595c1 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.874275  8519 tablet_bootstrap.cc:492] T 91a0bff862a5440f859cef65668de0ec P b29a30c058b24b799c64511edcc51af1: No bootstrap required, opened a new log
I20260709 13:16:51.874222  8521 raft_consensus.cc:385] T ee21df898e384d3993f352142b8595c1 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.924799  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe87dab5958e4af6b02ec49bd36c1696" candidate_uuid: "40136f5ac8c040d18bcea0a86211be68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293fa96e53fc447285b9eaec7ba3d452"
I20260709 13:16:51.927023  8301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe87dab5958e4af6b02ec49bd36c1696" candidate_uuid: "40136f5ac8c040d18bcea0a86211be68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b29a30c058b24b799c64511edcc51af1"
I20260709 13:16:51.927379  8375 raft_consensus.cc:3060] T fe87dab5958e4af6b02ec49bd36c1696 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.928279  8301 raft_consensus.cc:3060] T fe87dab5958e4af6b02ec49bd36c1696 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.874895  8519 ts_tablet_manager.cc:1403] T 91a0bff862a5440f859cef65668de0ec P b29a30c058b24b799c64511edcc51af1: Time spent bootstrapping tablet: real 0.062s	user 0.019s	sys 0.020s
I20260709 13:16:51.940137  8505 raft_consensus.cc:493] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.941637  8505 raft_consensus.cc:515] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.874719  8521 raft_consensus.cc:740] T ee21df898e384d3993f352142b8595c1 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40136f5ac8c040d18bcea0a86211be68, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.945683  8521 consensus_queue.cc:260] T ee21df898e384d3993f352142b8595c1 P 40136f5ac8c040d18bcea0a86211be68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.950783  8448 raft_consensus.cc:493] T ee21df898e384d3993f352142b8595c1 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.952157  8448 raft_consensus.cc:515] T ee21df898e384d3993f352142b8595c1 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.964500  8376 raft_consensus.cc:2468] T d8170e37c2074b2ebeefa955aa74d678 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40136f5ac8c040d18bcea0a86211be68 in term 1.
I20260709 13:16:51.964836  8448 leader_election.cc:290] T ee21df898e384d3993f352142b8595c1 P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:51.966570  8225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee21df898e384d3993f352142b8595c1" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40136f5ac8c040d18bcea0a86211be68" is_pre_election: true
I20260709 13:16:51.967483  8505 leader_election.cc:290] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155)
I20260709 13:16:51.967855  8225 raft_consensus.cc:2468] T ee21df898e384d3993f352142b8595c1 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b29a30c058b24b799c64511edcc51af1 in term 0.
I20260709 13:16:51.969091  8521 ts_tablet_manager.cc:1434] T ee21df898e384d3993f352142b8595c1 P 40136f5ac8c040d18bcea0a86211be68: Time spent starting tablet: real 0.105s	user 0.008s	sys 0.002s
I20260709 13:16:51.976263  8300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd73e7ced65b4e0d9c0c447d6a73d9f9" candidate_uuid: "293fa96e53fc447285b9eaec7ba3d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b29a30c058b24b799c64511edcc51af1" is_pre_election: true
I20260709 13:16:51.981323  8300 raft_consensus.cc:2393] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293fa96e53fc447285b9eaec7ba3d452 in current term 1: Already voted for candidate 40136f5ac8c040d18bcea0a86211be68 in this term.
I20260709 13:16:51.975806  8519 raft_consensus.cc:359] T 91a0bff862a5440f859cef65668de0ec P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.977802  8266 leader_election.cc:304] T ee21df898e384d3993f352142b8595c1 P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40136f5ac8c040d18bcea0a86211be68, b29a30c058b24b799c64511edcc51af1; no voters: 
I20260709 13:16:51.985420  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee21df898e384d3993f352142b8595c1" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293fa96e53fc447285b9eaec7ba3d452" is_pre_election: true
I20260709 13:16:51.979643  8225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd73e7ced65b4e0d9c0c447d6a73d9f9" candidate_uuid: "293fa96e53fc447285b9eaec7ba3d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40136f5ac8c040d18bcea0a86211be68" is_pre_election: true
I20260709 13:16:51.986689  8448 raft_consensus.cc:2804] T ee21df898e384d3993f352142b8595c1 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:51.979175  8505 raft_consensus.cc:493] T ee21df898e384d3993f352142b8595c1 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.987212  8448 raft_consensus.cc:493] T ee21df898e384d3993f352142b8595c1 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.987720  8448 raft_consensus.cc:3060] T ee21df898e384d3993f352142b8595c1 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.987655  8505 raft_consensus.cc:515] T ee21df898e384d3993f352142b8595c1 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:51.981328  8125 catalog_manager.cc:5697] T d8170e37c2074b2ebeefa955aa74d678 P 40136f5ac8c040d18bcea0a86211be68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "40136f5ac8c040d18bcea0a86211be68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:51.992043  8226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee21df898e384d3993f352142b8595c1" candidate_uuid: "293fa96e53fc447285b9eaec7ba3d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40136f5ac8c040d18bcea0a86211be68" is_pre_election: true
I20260709 13:16:51.993003  8226 raft_consensus.cc:2468] T ee21df898e384d3993f352142b8595c1 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293fa96e53fc447285b9eaec7ba3d452 in term 0.
I20260709 13:16:51.994581  8505 leader_election.cc:290] T ee21df898e384d3993f352142b8595c1 P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155)
I20260709 13:16:51.996191  8519 raft_consensus.cc:385] T 91a0bff862a5440f859cef65668de0ec P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.997515  8300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee21df898e384d3993f352142b8595c1" candidate_uuid: "293fa96e53fc447285b9eaec7ba3d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b29a30c058b24b799c64511edcc51af1" is_pre_election: true
I20260709 13:16:52.005522  8376 raft_consensus.cc:2468] T ee21df898e384d3993f352142b8595c1 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b29a30c058b24b799c64511edcc51af1 in term 0.
I20260709 13:16:51.998651  8375 raft_consensus.cc:2468] T fe87dab5958e4af6b02ec49bd36c1696 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40136f5ac8c040d18bcea0a86211be68 in term 1.
I20260709 13:16:52.005563  8519 raft_consensus.cc:740] T 91a0bff862a5440f859cef65668de0ec P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b29a30c058b24b799c64511edcc51af1, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.997433  8340 leader_election.cc:304] T ee21df898e384d3993f352142b8595c1 P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293fa96e53fc447285b9eaec7ba3d452, 40136f5ac8c040d18bcea0a86211be68; no voters: 
I20260709 13:16:52.008327  8191 leader_election.cc:304] T fe87dab5958e4af6b02ec49bd36c1696 P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293fa96e53fc447285b9eaec7ba3d452, 40136f5ac8c040d18bcea0a86211be68; no voters: 
I20260709 13:16:52.009299  8519 consensus_queue.cc:260] T 91a0bff862a5440f859cef65668de0ec P b29a30c058b24b799c64511edcc51af1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:52.005856  8529 raft_consensus.cc:515] T a06df4e98ae74d568ce68a93bf8d8b65 P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:52.009686  8532 raft_consensus.cc:2804] T fe87dab5958e4af6b02ec49bd36c1696 P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:52.009773  8340 leader_election.cc:304] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293fa96e53fc447285b9eaec7ba3d452; no voters: 40136f5ac8c040d18bcea0a86211be68, b29a30c058b24b799c64511edcc51af1
I20260709 13:16:52.010614  8532 raft_consensus.cc:697] T fe87dab5958e4af6b02ec49bd36c1696 P 40136f5ac8c040d18bcea0a86211be68 [term 1 LEADER]: Becoming Leader. State: Replica: 40136f5ac8c040d18bcea0a86211be68, State: Running, Role: LEADER
I20260709 13:16:52.009967  8505 raft_consensus.cc:2804] T ee21df898e384d3993f352142b8595c1 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:52.011886  8505 raft_consensus.cc:493] T ee21df898e384d3993f352142b8595c1 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.013114  8538 raft_consensus.cc:3060] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.013579  8519 ts_tablet_manager.cc:1434] T 91a0bff862a5440f859cef65668de0ec P b29a30c058b24b799c64511edcc51af1: Time spent starting tablet: real 0.076s	user 0.009s	sys 0.007s
I20260709 13:16:52.012291  8532 consensus_queue.cc:237] T fe87dab5958e4af6b02ec49bd36c1696 P 40136f5ac8c040d18bcea0a86211be68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:52.017132  8299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a06df4e98ae74d568ce68a93bf8d8b65" candidate_uuid: "40136f5ac8c040d18bcea0a86211be68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b29a30c058b24b799c64511edcc51af1"
I20260709 13:16:52.018111  8299 raft_consensus.cc:3060] T a06df4e98ae74d568ce68a93bf8d8b65 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.012341  8505 raft_consensus.cc:3060] T ee21df898e384d3993f352142b8595c1 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.025229  8519 tablet_bootstrap.cc:492] T 43cfc5b732654a7a9035a8f61d2c1c83 P b29a30c058b24b799c64511edcc51af1: Bootstrap starting.
I20260709 13:16:52.026364  8508 raft_consensus.cc:493] T 6a0e7ee47f18454283552529e1acea87 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.027186  8508 raft_consensus.cc:515] T 6a0e7ee47f18454283552529e1acea87 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:52.030584  8556 raft_consensus.cc:493] T 43cfc5b732654a7a9035a8f61d2c1c83 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.031481  8556 raft_consensus.cc:515] T 43cfc5b732654a7a9035a8f61d2c1c83 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:52.032727  8302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0e7ee47f18454283552529e1acea87" candidate_uuid: "40136f5ac8c040d18bcea0a86211be68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b29a30c058b24b799c64511edcc51af1" is_pre_election: true
I20260709 13:16:52.032905  8508 leader_election.cc:290] T 6a0e7ee47f18454283552529e1acea87 P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:52.035172  8302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cfc5b732654a7a9035a8f61d2c1c83" candidate_uuid: "40136f5ac8c040d18bcea0a86211be68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b29a30c058b24b799c64511edcc51af1" is_pre_election: true
W20260709 13:16:52.036993  8193 leader_election.cc:343] T 43cfc5b732654a7a9035a8f61d2c1c83 P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:52.038339  8523 raft_consensus.cc:493] T 91a0bff862a5440f859cef65668de0ec P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.039007  8523 raft_consensus.cc:515] T 91a0bff862a5440f859cef65668de0ec P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:52.041781  8556 leader_election.cc:290] T 43cfc5b732654a7a9035a8f61d2c1c83 P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:52.036069  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0e7ee47f18454283552529e1acea87" candidate_uuid: "40136f5ac8c040d18bcea0a86211be68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293fa96e53fc447285b9eaec7ba3d452" is_pre_election: true
I20260709 13:16:52.042366  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cfc5b732654a7a9035a8f61d2c1c83" candidate_uuid: "40136f5ac8c040d18bcea0a86211be68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293fa96e53fc447285b9eaec7ba3d452" is_pre_election: true
I20260709 13:16:52.043081  8375 raft_consensus.cc:2393] T 6a0e7ee47f18454283552529e1acea87 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40136f5ac8c040d18bcea0a86211be68 in current term 1: Already voted for candidate b29a30c058b24b799c64511edcc51af1 in this term.
I20260709 13:16:52.043258  8374 raft_consensus.cc:2468] T 43cfc5b732654a7a9035a8f61d2c1c83 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40136f5ac8c040d18bcea0a86211be68 in term 0.
I20260709 13:16:52.044512  8191 leader_election.cc:304] T 6a0e7ee47f18454283552529e1acea87 P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40136f5ac8c040d18bcea0a86211be68; no voters: 293fa96e53fc447285b9eaec7ba3d452, b29a30c058b24b799c64511edcc51af1
I20260709 13:16:52.044646  8225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a0bff862a5440f859cef65668de0ec" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40136f5ac8c040d18bcea0a86211be68" is_pre_election: true
I20260709 13:16:52.045717  8225 raft_consensus.cc:2468] T 91a0bff862a5440f859cef65668de0ec P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b29a30c058b24b799c64511edcc51af1 in term 0.
I20260709 13:16:52.046119  8191 leader_election.cc:304] T 43cfc5b732654a7a9035a8f61d2c1c83 P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293fa96e53fc447285b9eaec7ba3d452, 40136f5ac8c040d18bcea0a86211be68; no voters: b29a30c058b24b799c64511edcc51af1
I20260709 13:16:52.047803  8266 leader_election.cc:304] T 91a0bff862a5440f859cef65668de0ec P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40136f5ac8c040d18bcea0a86211be68, b29a30c058b24b799c64511edcc51af1; no voters: 
I20260709 13:16:52.049177  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a0bff862a5440f859cef65668de0ec" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293fa96e53fc447285b9eaec7ba3d452" is_pre_election: true
I20260709 13:16:52.049942  8374 raft_consensus.cc:2468] T 91a0bff862a5440f859cef65668de0ec P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b29a30c058b24b799c64511edcc51af1 in term 0.
I20260709 13:16:52.050171  8556 raft_consensus.cc:3060] T 6a0e7ee47f18454283552529e1acea87 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.053682  8523 leader_election.cc:290] T 91a0bff862a5440f859cef65668de0ec P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:52.054476  8508 raft_consensus.cc:2804] T 43cfc5b732654a7a9035a8f61d2c1c83 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:52.055200  8508 raft_consensus.cc:493] T 43cfc5b732654a7a9035a8f61d2c1c83 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.055712  8508 raft_consensus.cc:3060] T 43cfc5b732654a7a9035a8f61d2c1c83 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.031260  8301 raft_consensus.cc:2468] T fe87dab5958e4af6b02ec49bd36c1696 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40136f5ac8c040d18bcea0a86211be68 in term 1.
I20260709 13:16:52.056314  8523 raft_consensus.cc:2804] T 91a0bff862a5440f859cef65668de0ec P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:52.066668  8523 raft_consensus.cc:493] T 91a0bff862a5440f859cef65668de0ec P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.067392  8523 raft_consensus.cc:3060] T 91a0bff862a5440f859cef65668de0ec P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.056505  8376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a06df4e98ae74d568ce68a93bf8d8b65" candidate_uuid: "40136f5ac8c040d18bcea0a86211be68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293fa96e53fc447285b9eaec7ba3d452"
I20260709 13:16:52.069509  8376 raft_consensus.cc:3060] T a06df4e98ae74d568ce68a93bf8d8b65 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.037024  8529 leader_election.cc:290] T a06df4e98ae74d568ce68a93bf8d8b65 P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 election: Requested vote from peers b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:52.076503  8529 consensus_queue.cc:1048] T b2ddf231a512421b954496fd121e3cb5 P 40136f5ac8c040d18bcea0a86211be68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:52.092813  8505 raft_consensus.cc:515] T ee21df898e384d3993f352142b8595c1 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:52.097296  8519 tablet_bootstrap.cc:654] T 43cfc5b732654a7a9035a8f61d2c1c83 P b29a30c058b24b799c64511edcc51af1: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.100047  8538 raft_consensus.cc:2749] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:52.112601  8448 raft_consensus.cc:515] T ee21df898e384d3993f352142b8595c1 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:52.114437  8300 raft_consensus.cc:2393] T ee21df898e384d3993f352142b8595c1 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293fa96e53fc447285b9eaec7ba3d452 in current term 1: Already voted for candidate b29a30c058b24b799c64511edcc51af1 in this term.
I20260709 13:16:52.114543  8299 raft_consensus.cc:2468] T a06df4e98ae74d568ce68a93bf8d8b65 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40136f5ac8c040d18bcea0a86211be68 in term 1.
W20260709 13:16:52.119014  8266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 61092.7us
I20260709 13:16:52.124425  8556 raft_consensus.cc:2749] T 6a0e7ee47f18454283552529e1acea87 P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:52.122172  8505 leader_election.cc:290] T ee21df898e384d3993f352142b8595c1 P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 election: Requested vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155)
I20260709 13:16:52.127180  8523 raft_consensus.cc:515] T 91a0bff862a5440f859cef65668de0ec P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:52.129650  8523 leader_election.cc:290] T 91a0bff862a5440f859cef65668de0ec P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 election: Requested vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:52.130030  8376 raft_consensus.cc:2468] T a06df4e98ae74d568ce68a93bf8d8b65 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40136f5ac8c040d18bcea0a86211be68 in term 1.
I20260709 13:16:52.133103  8225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee21df898e384d3993f352142b8595c1" candidate_uuid: "293fa96e53fc447285b9eaec7ba3d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40136f5ac8c040d18bcea0a86211be68"
I20260709 13:16:52.134181  8225 raft_consensus.cc:3060] T ee21df898e384d3993f352142b8595c1 P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.136948  8193 leader_election.cc:304] T a06df4e98ae74d568ce68a93bf8d8b65 P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40136f5ac8c040d18bcea0a86211be68, b29a30c058b24b799c64511edcc51af1; no voters: 
I20260709 13:16:52.137532  8508 raft_consensus.cc:515] T 43cfc5b732654a7a9035a8f61d2c1c83 P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:52.138057  8123 catalog_manager.cc:5697] T fe87dab5958e4af6b02ec49bd36c1696 P 40136f5ac8c040d18bcea0a86211be68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "40136f5ac8c040d18bcea0a86211be68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:52.140377  8508 leader_election.cc:290] T 43cfc5b732654a7a9035a8f61d2c1c83 P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 election: Requested vote from peers b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:52.140695  8556 raft_consensus.cc:2804] T a06df4e98ae74d568ce68a93bf8d8b65 P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:52.141301  8556 raft_consensus.cc:697] T a06df4e98ae74d568ce68a93bf8d8b65 P 40136f5ac8c040d18bcea0a86211be68 [term 1 LEADER]: Becoming Leader. State: Replica: 40136f5ac8c040d18bcea0a86211be68, State: Running, Role: LEADER
I20260709 13:16:52.142378  8300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee21df898e384d3993f352142b8595c1" candidate_uuid: "293fa96e53fc447285b9eaec7ba3d452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b29a30c058b24b799c64511edcc51af1"
I20260709 13:16:52.142606  8556 consensus_queue.cc:237] T a06df4e98ae74d568ce68a93bf8d8b65 P 40136f5ac8c040d18bcea0a86211be68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:52.143311  8300 raft_consensus.cc:2393] T ee21df898e384d3993f352142b8595c1 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 293fa96e53fc447285b9eaec7ba3d452 in current term 1: Already voted for candidate b29a30c058b24b799c64511edcc51af1 in this term.
I20260709 13:16:52.147228  8300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cfc5b732654a7a9035a8f61d2c1c83" candidate_uuid: "40136f5ac8c040d18bcea0a86211be68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b29a30c058b24b799c64511edcc51af1"
W20260709 13:16:52.149253  8193 leader_election.cc:343] T 43cfc5b732654a7a9035a8f61d2c1c83 P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:52.153362  8448 leader_election.cc:290] T ee21df898e384d3993f352142b8595c1 P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 election: Requested vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
W20260709 13:16:52.105885  8191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.146.131:36869, user_credentials={real_user=slave}} blocked reactor thread for 59882.2us
I20260709 13:16:52.157228  8226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a0bff862a5440f859cef65668de0ec" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40136f5ac8c040d18bcea0a86211be68"
I20260709 13:16:52.158370  8226 raft_consensus.cc:3060] T 91a0bff862a5440f859cef65668de0ec P 40136f5ac8c040d18bcea0a86211be68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.162352  8375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cfc5b732654a7a9035a8f61d2c1c83" candidate_uuid: "40136f5ac8c040d18bcea0a86211be68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293fa96e53fc447285b9eaec7ba3d452"
I20260709 13:16:52.163185  8375 raft_consensus.cc:3060] T 43cfc5b732654a7a9035a8f61d2c1c83 P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.166164  8508 consensus_queue.cc:1048] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 40136f5ac8c040d18bcea0a86211be68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:52.173026  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a0bff862a5440f859cef65668de0ec" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293fa96e53fc447285b9eaec7ba3d452"
I20260709 13:16:52.181638  8374 raft_consensus.cc:3060] T 91a0bff862a5440f859cef65668de0ec P 293fa96e53fc447285b9eaec7ba3d452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.182298  8375 raft_consensus.cc:2468] T 43cfc5b732654a7a9035a8f61d2c1c83 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40136f5ac8c040d18bcea0a86211be68 in term 1.
I20260709 13:16:52.183956  8191 leader_election.cc:304] T 43cfc5b732654a7a9035a8f61d2c1c83 P 40136f5ac8c040d18bcea0a86211be68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293fa96e53fc447285b9eaec7ba3d452, 40136f5ac8c040d18bcea0a86211be68; no voters: b29a30c058b24b799c64511edcc51af1
I20260709 13:16:52.185479  8532 raft_consensus.cc:2804] T 43cfc5b732654a7a9035a8f61d2c1c83 P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:52.186066  8532 raft_consensus.cc:697] T 43cfc5b732654a7a9035a8f61d2c1c83 P 40136f5ac8c040d18bcea0a86211be68 [term 1 LEADER]: Becoming Leader. State: Replica: 40136f5ac8c040d18bcea0a86211be68, State: Running, Role: LEADER
I20260709 13:16:52.187264  8532 consensus_queue.cc:237] T 43cfc5b732654a7a9035a8f61d2c1c83 P 40136f5ac8c040d18bcea0a86211be68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:52.189785  8223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee21df898e384d3993f352142b8595c1" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40136f5ac8c040d18bcea0a86211be68"
I20260709 13:16:52.190519  8373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee21df898e384d3993f352142b8595c1" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293fa96e53fc447285b9eaec7ba3d452"
I20260709 13:16:52.193012  8373 raft_consensus.cc:2393] T ee21df898e384d3993f352142b8595c1 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b29a30c058b24b799c64511edcc51af1 in current term 1: Already voted for candidate 293fa96e53fc447285b9eaec7ba3d452 in this term.
W20260709 13:16:52.171371  8173 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:52.202092  8225 raft_consensus.cc:2468] T ee21df898e384d3993f352142b8595c1 P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293fa96e53fc447285b9eaec7ba3d452 in term 1.
I20260709 13:16:52.203737  8340 leader_election.cc:304] T ee21df898e384d3993f352142b8595c1 P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293fa96e53fc447285b9eaec7ba3d452, 40136f5ac8c040d18bcea0a86211be68; no voters: b29a30c058b24b799c64511edcc51af1
I20260709 13:16:52.205962  8505 raft_consensus.cc:2804] T ee21df898e384d3993f352142b8595c1 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:52.206586  8505 raft_consensus.cc:697] T ee21df898e384d3993f352142b8595c1 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 LEADER]: Becoming Leader. State: Replica: 293fa96e53fc447285b9eaec7ba3d452, State: Running, Role: LEADER
I20260709 13:16:52.210134  8505 consensus_queue.cc:237] T ee21df898e384d3993f352142b8595c1 P 293fa96e53fc447285b9eaec7ba3d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:52.211123  8226 raft_consensus.cc:2468] T 91a0bff862a5440f859cef65668de0ec P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b29a30c058b24b799c64511edcc51af1 in term 1.
I20260709 13:16:52.217600  8563 consensus_queue.cc:1048] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 40136f5ac8c040d18bcea0a86211be68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:52.223757  8123 catalog_manager.cc:5697] T a06df4e98ae74d568ce68a93bf8d8b65 P 40136f5ac8c040d18bcea0a86211be68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "40136f5ac8c040d18bcea0a86211be68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:52.225389  8508 consensus_queue.cc:1048] T b2ddf231a512421b954496fd121e3cb5 P 40136f5ac8c040d18bcea0a86211be68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:52.227857  8266 leader_election.cc:304] T ee21df898e384d3993f352142b8595c1 P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b29a30c058b24b799c64511edcc51af1; no voters: 293fa96e53fc447285b9eaec7ba3d452, 40136f5ac8c040d18bcea0a86211be68
I20260709 13:16:52.229977  8448 raft_consensus.cc:2749] T ee21df898e384d3993f352142b8595c1 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:52.232249  8266 leader_election.cc:304] T 91a0bff862a5440f859cef65668de0ec P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40136f5ac8c040d18bcea0a86211be68, b29a30c058b24b799c64511edcc51af1; no voters: 
I20260709 13:16:52.234133  8448 raft_consensus.cc:2804] T 91a0bff862a5440f859cef65668de0ec P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:52.234813  8448 raft_consensus.cc:697] T 91a0bff862a5440f859cef65668de0ec P b29a30c058b24b799c64511edcc51af1 [term 1 LEADER]: Becoming Leader. State: Replica: b29a30c058b24b799c64511edcc51af1, State: Running, Role: LEADER
I20260709 13:16:52.235805  8448 consensus_queue.cc:237] T 91a0bff862a5440f859cef65668de0ec P b29a30c058b24b799c64511edcc51af1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:52.270278  8123 catalog_manager.cc:5697] T ee21df898e384d3993f352142b8595c1 P 293fa96e53fc447285b9eaec7ba3d452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131). New cstate: current_term: 1 leader_uuid: "293fa96e53fc447285b9eaec7ba3d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:52.270349  8519 tablet_bootstrap.cc:492] T 43cfc5b732654a7a9035a8f61d2c1c83 P b29a30c058b24b799c64511edcc51af1: No bootstrap required, opened a new log
I20260709 13:16:52.272639  8519 ts_tablet_manager.cc:1403] T 43cfc5b732654a7a9035a8f61d2c1c83 P b29a30c058b24b799c64511edcc51af1: Time spent bootstrapping tablet: real 0.248s	user 0.012s	sys 0.017s
I20260709 13:16:52.275934  8374 raft_consensus.cc:2468] T 91a0bff862a5440f859cef65668de0ec P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b29a30c058b24b799c64511edcc51af1 in term 1.
I20260709 13:16:52.290361  8519 raft_consensus.cc:359] T 43cfc5b732654a7a9035a8f61d2c1c83 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:52.291846  8519 raft_consensus.cc:385] T 43cfc5b732654a7a9035a8f61d2c1c83 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.292250  8519 raft_consensus.cc:740] T 43cfc5b732654a7a9035a8f61d2c1c83 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b29a30c058b24b799c64511edcc51af1, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.293370  8519 consensus_queue.cc:260] T 43cfc5b732654a7a9035a8f61d2c1c83 P b29a30c058b24b799c64511edcc51af1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:52.297515  8519 ts_tablet_manager.cc:1434] T 43cfc5b732654a7a9035a8f61d2c1c83 P b29a30c058b24b799c64511edcc51af1: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.000s
I20260709 13:16:52.310431  8561 consensus_queue.cc:1048] T 6a0e7ee47f18454283552529e1acea87 P b29a30c058b24b799c64511edcc51af1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:16:52.313155  8523 consensus_queue.cc:1048] T 6a0e7ee47f18454283552529e1acea87 P b29a30c058b24b799c64511edcc51af1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:16:52.324090  8125 catalog_manager.cc:5697] T 91a0bff862a5440f859cef65668de0ec P b29a30c058b24b799c64511edcc51af1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b29a30c058b24b799c64511edcc51af1 (127.27.146.130). New cstate: current_term: 1 leader_uuid: "b29a30c058b24b799c64511edcc51af1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:52.328065  8123 catalog_manager.cc:5697] T 43cfc5b732654a7a9035a8f61d2c1c83 P 40136f5ac8c040d18bcea0a86211be68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129). New cstate: current_term: 1 leader_uuid: "40136f5ac8c040d18bcea0a86211be68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:52.415939  8374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee21df898e384d3993f352142b8595c1"
dest_uuid: "293fa96e53fc447285b9eaec7ba3d452"
mode: GRACEFUL
new_leader_uuid: "b29a30c058b24b799c64511edcc51af1"
 from {username='slave'} at 127.0.0.1:52414
I20260709 13:16:52.416823  8374 raft_consensus.cc:606] T ee21df898e384d3993f352142b8595c1 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 LEADER]: Received request to transfer leadership to TS b29a30c058b24b799c64511edcc51af1
I20260709 13:16:52.443773  8226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8170e37c2074b2ebeefa955aa74d678"
dest_uuid: "40136f5ac8c040d18bcea0a86211be68"
mode: GRACEFUL
new_leader_uuid: "b29a30c058b24b799c64511edcc51af1"
 from {username='slave'} at 127.0.0.1:58210
I20260709 13:16:52.444487  8226 raft_consensus.cc:606] T d8170e37c2074b2ebeefa955aa74d678 P 40136f5ac8c040d18bcea0a86211be68 [term 1 LEADER]: Received request to transfer leadership to TS b29a30c058b24b799c64511edcc51af1
I20260709 13:16:52.457945  8226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43cfc5b732654a7a9035a8f61d2c1c83"
dest_uuid: "40136f5ac8c040d18bcea0a86211be68"
mode: GRACEFUL
new_leader_uuid: "293fa96e53fc447285b9eaec7ba3d452"
 from {username='slave'} at 127.0.0.1:58210
I20260709 13:16:52.457873  8532 consensus_queue.cc:1048] T fe87dab5958e4af6b02ec49bd36c1696 P 40136f5ac8c040d18bcea0a86211be68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:52.458813  8226 raft_consensus.cc:606] T 43cfc5b732654a7a9035a8f61d2c1c83 P 40136f5ac8c040d18bcea0a86211be68 [term 1 LEADER]: Received request to transfer leadership to TS 293fa96e53fc447285b9eaec7ba3d452
I20260709 13:16:52.465260  8532 consensus_queue.cc:1048] T d8170e37c2074b2ebeefa955aa74d678 P 40136f5ac8c040d18bcea0a86211be68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:52.472155  8529 consensus_queue.cc:1048] T fe87dab5958e4af6b02ec49bd36c1696 P 40136f5ac8c040d18bcea0a86211be68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:52.486696  8532 consensus_queue.cc:1048] T d8170e37c2074b2ebeefa955aa74d678 P 40136f5ac8c040d18bcea0a86211be68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:52.507118  8532 raft_consensus.cc:993] T d8170e37c2074b2ebeefa955aa74d678 P 40136f5ac8c040d18bcea0a86211be68: : Instructing follower b29a30c058b24b799c64511edcc51af1 to start an election
I20260709 13:16:52.507793  8532 raft_consensus.cc:1081] T d8170e37c2074b2ebeefa955aa74d678 P 40136f5ac8c040d18bcea0a86211be68 [term 1 LEADER]: Signalling peer b29a30c058b24b799c64511edcc51af1 to start an election
I20260709 13:16:52.510336  8299 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d8170e37c2074b2ebeefa955aa74d678"
dest_uuid: "b29a30c058b24b799c64511edcc51af1"
 from {username='slave'} at 127.0.0.1:34680
I20260709 13:16:52.511013  8299 raft_consensus.cc:493] T d8170e37c2074b2ebeefa955aa74d678 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:52.511358  8299 raft_consensus.cc:3060] T d8170e37c2074b2ebeefa955aa74d678 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:52.518935  8299 raft_consensus.cc:515] T d8170e37c2074b2ebeefa955aa74d678 P b29a30c058b24b799c64511edcc51af1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:52.521624  8299 leader_election.cc:290] T d8170e37c2074b2ebeefa955aa74d678 P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 2 election: Requested vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:52.522437  8226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8170e37c2074b2ebeefa955aa74d678" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40136f5ac8c040d18bcea0a86211be68"
I20260709 13:16:52.522866  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8170e37c2074b2ebeefa955aa74d678" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "293fa96e53fc447285b9eaec7ba3d452"
I20260709 13:16:52.523248  8226 raft_consensus.cc:3055] T d8170e37c2074b2ebeefa955aa74d678 P 40136f5ac8c040d18bcea0a86211be68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:52.523469  8374 raft_consensus.cc:3060] T d8170e37c2074b2ebeefa955aa74d678 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:52.523633  8226 raft_consensus.cc:740] T d8170e37c2074b2ebeefa955aa74d678 P 40136f5ac8c040d18bcea0a86211be68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40136f5ac8c040d18bcea0a86211be68, State: Running, Role: LEADER
I20260709 13:16:52.524681  8226 consensus_queue.cc:260] T d8170e37c2074b2ebeefa955aa74d678 P 40136f5ac8c040d18bcea0a86211be68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:52.526163  8226 raft_consensus.cc:3060] T d8170e37c2074b2ebeefa955aa74d678 P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:52.533519  8523 raft_consensus.cc:493] T 43cfc5b732654a7a9035a8f61d2c1c83 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.533730  8226 raft_consensus.cc:2468] T d8170e37c2074b2ebeefa955aa74d678 P 40136f5ac8c040d18bcea0a86211be68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b29a30c058b24b799c64511edcc51af1 in term 2.
I20260709 13:16:52.534240  8374 raft_consensus.cc:2468] T d8170e37c2074b2ebeefa955aa74d678 P 293fa96e53fc447285b9eaec7ba3d452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b29a30c058b24b799c64511edcc51af1 in term 2.
I20260709 13:16:52.534538  8523 raft_consensus.cc:515] T 43cfc5b732654a7a9035a8f61d2c1c83 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:52.535544  8266 leader_election.cc:304] T d8170e37c2074b2ebeefa955aa74d678 P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40136f5ac8c040d18bcea0a86211be68, b29a30c058b24b799c64511edcc51af1; no voters: 
I20260709 13:16:52.536430  8561 raft_consensus.cc:2804] T d8170e37c2074b2ebeefa955aa74d678 P b29a30c058b24b799c64511edcc51af1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:52.536985  8561 raft_consensus.cc:697] T d8170e37c2074b2ebeefa955aa74d678 P b29a30c058b24b799c64511edcc51af1 [term 2 LEADER]: Becoming Leader. State: Replica: b29a30c058b24b799c64511edcc51af1, State: Running, Role: LEADER
I20260709 13:16:52.537142  8523 leader_election.cc:290] T 43cfc5b732654a7a9035a8f61d2c1c83 P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:52.538614  8225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cfc5b732654a7a9035a8f61d2c1c83" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40136f5ac8c040d18bcea0a86211be68" is_pre_election: true
I20260709 13:16:52.538682  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cfc5b732654a7a9035a8f61d2c1c83" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "293fa96e53fc447285b9eaec7ba3d452" is_pre_election: true
I20260709 13:16:52.538911  8561 consensus_queue.cc:237] T d8170e37c2074b2ebeefa955aa74d678 P b29a30c058b24b799c64511edcc51af1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:52.539754  8374 raft_consensus.cc:2393] T 43cfc5b732654a7a9035a8f61d2c1c83 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b29a30c058b24b799c64511edcc51af1 in current term 1: Already voted for candidate 40136f5ac8c040d18bcea0a86211be68 in this term.
I20260709 13:16:52.541741  8266 leader_election.cc:304] T 43cfc5b732654a7a9035a8f61d2c1c83 P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b29a30c058b24b799c64511edcc51af1; no voters: 293fa96e53fc447285b9eaec7ba3d452, 40136f5ac8c040d18bcea0a86211be68
I20260709 13:16:52.542528  8523 raft_consensus.cc:3060] T 43cfc5b732654a7a9035a8f61d2c1c83 P b29a30c058b24b799c64511edcc51af1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.548903  8125 catalog_manager.cc:5697] T d8170e37c2074b2ebeefa955aa74d678 P b29a30c058b24b799c64511edcc51af1 reported cstate change: term changed from 1 to 2, leader changed from 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129) to b29a30c058b24b799c64511edcc51af1 (127.27.146.130). New cstate: current_term: 2 leader_uuid: "b29a30c058b24b799c64511edcc51af1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:52.551803  8523 raft_consensus.cc:2749] T 43cfc5b732654a7a9035a8f61d2c1c83 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:52.564343  8562 consensus_queue.cc:1048] T a06df4e98ae74d568ce68a93bf8d8b65 P 40136f5ac8c040d18bcea0a86211be68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:52.579247  8529 consensus_queue.cc:1048] T a06df4e98ae74d568ce68a93bf8d8b65 P 40136f5ac8c040d18bcea0a86211be68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:52.602989  8562 consensus_queue.cc:1048] T 43cfc5b732654a7a9035a8f61d2c1c83 P 40136f5ac8c040d18bcea0a86211be68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:52.613605  8532 raft_consensus.cc:993] T 43cfc5b732654a7a9035a8f61d2c1c83 P 40136f5ac8c040d18bcea0a86211be68: : Instructing follower 293fa96e53fc447285b9eaec7ba3d452 to start an election
I20260709 13:16:52.614391  8532 raft_consensus.cc:1081] T 43cfc5b732654a7a9035a8f61d2c1c83 P 40136f5ac8c040d18bcea0a86211be68 [term 1 LEADER]: Signalling peer 293fa96e53fc447285b9eaec7ba3d452 to start an election
I20260709 13:16:52.616402  8374 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43cfc5b732654a7a9035a8f61d2c1c83"
dest_uuid: "293fa96e53fc447285b9eaec7ba3d452"
 from {username='slave'} at 127.0.0.1:52396
I20260709 13:16:52.617059  8374 raft_consensus.cc:493] T 43cfc5b732654a7a9035a8f61d2c1c83 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:52.617506  8374 raft_consensus.cc:3060] T 43cfc5b732654a7a9035a8f61d2c1c83 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:52.624257  8529 consensus_queue.cc:1048] T 43cfc5b732654a7a9035a8f61d2c1c83 P 40136f5ac8c040d18bcea0a86211be68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:52.629880  8374 raft_consensus.cc:515] T 43cfc5b732654a7a9035a8f61d2c1c83 P 293fa96e53fc447285b9eaec7ba3d452 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:52.634130  8225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cfc5b732654a7a9035a8f61d2c1c83" candidate_uuid: "293fa96e53fc447285b9eaec7ba3d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40136f5ac8c040d18bcea0a86211be68"
I20260709 13:16:52.634943  8225 raft_consensus.cc:3055] T 43cfc5b732654a7a9035a8f61d2c1c83 P 40136f5ac8c040d18bcea0a86211be68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:52.635341  8225 raft_consensus.cc:740] T 43cfc5b732654a7a9035a8f61d2c1c83 P 40136f5ac8c040d18bcea0a86211be68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40136f5ac8c040d18bcea0a86211be68, State: Running, Role: LEADER
I20260709 13:16:52.636284  8225 consensus_queue.cc:260] T 43cfc5b732654a7a9035a8f61d2c1c83 P 40136f5ac8c040d18bcea0a86211be68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:52.637636  8225 raft_consensus.cc:3060] T 43cfc5b732654a7a9035a8f61d2c1c83 P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:52.638439  8301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cfc5b732654a7a9035a8f61d2c1c83" candidate_uuid: "293fa96e53fc447285b9eaec7ba3d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b29a30c058b24b799c64511edcc51af1"
I20260709 13:16:52.639519  8301 raft_consensus.cc:3060] T 43cfc5b732654a7a9035a8f61d2c1c83 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:52.647994  8505 consensus_queue.cc:1048] T ee21df898e384d3993f352142b8595c1 P 293fa96e53fc447285b9eaec7ba3d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:52.655771  8372 raft_consensus.cc:1240] T 43cfc5b732654a7a9035a8f61d2c1c83 P 293fa96e53fc447285b9eaec7ba3d452 [term 2 FOLLOWER]: Rejecting Update request from peer 40136f5ac8c040d18bcea0a86211be68 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:52.656946  8301 raft_consensus.cc:2468] T 43cfc5b732654a7a9035a8f61d2c1c83 P b29a30c058b24b799c64511edcc51af1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293fa96e53fc447285b9eaec7ba3d452 in term 2.
I20260709 13:16:52.658366  8225 raft_consensus.cc:2468] T 43cfc5b732654a7a9035a8f61d2c1c83 P 40136f5ac8c040d18bcea0a86211be68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293fa96e53fc447285b9eaec7ba3d452 in term 2.
I20260709 13:16:52.632900  8374 leader_election.cc:290] T 43cfc5b732654a7a9035a8f61d2c1c83 P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 2 election: Requested vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155)
I20260709 13:16:52.659389  8505 raft_consensus.cc:993] T ee21df898e384d3993f352142b8595c1 P 293fa96e53fc447285b9eaec7ba3d452: : Instructing follower b29a30c058b24b799c64511edcc51af1 to start an election
I20260709 13:16:52.660243  8340 leader_election.cc:304] T 43cfc5b732654a7a9035a8f61d2c1c83 P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293fa96e53fc447285b9eaec7ba3d452, 40136f5ac8c040d18bcea0a86211be68; no voters: 
I20260709 13:16:52.660611  8505 raft_consensus.cc:1081] T ee21df898e384d3993f352142b8595c1 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 LEADER]: Signalling peer b29a30c058b24b799c64511edcc51af1 to start an election
I20260709 13:16:52.662330  8505 raft_consensus.cc:2804] T 43cfc5b732654a7a9035a8f61d2c1c83 P 293fa96e53fc447285b9eaec7ba3d452 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:52.667284  8299 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee21df898e384d3993f352142b8595c1"
dest_uuid: "b29a30c058b24b799c64511edcc51af1"
 from {username='slave'} at 127.0.0.1:34692
I20260709 13:16:52.668321  8299 raft_consensus.cc:493] T ee21df898e384d3993f352142b8595c1 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:52.668869  8299 raft_consensus.cc:3060] T ee21df898e384d3993f352142b8595c1 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:52.671146  8505 raft_consensus.cc:697] T 43cfc5b732654a7a9035a8f61d2c1c83 P 293fa96e53fc447285b9eaec7ba3d452 [term 2 LEADER]: Becoming Leader. State: Replica: 293fa96e53fc447285b9eaec7ba3d452, State: Running, Role: LEADER
I20260709 13:16:52.672587  8505 consensus_queue.cc:237] T 43cfc5b732654a7a9035a8f61d2c1c83 P 293fa96e53fc447285b9eaec7ba3d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:52.679404  8505 consensus_queue.cc:1048] T ee21df898e384d3993f352142b8595c1 P 293fa96e53fc447285b9eaec7ba3d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:52.682029  8299 raft_consensus.cc:515] T ee21df898e384d3993f352142b8595c1 P b29a30c058b24b799c64511edcc51af1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:52.685637  8125 catalog_manager.cc:5697] T 43cfc5b732654a7a9035a8f61d2c1c83 P 293fa96e53fc447285b9eaec7ba3d452 reported cstate change: term changed from 1 to 2, leader changed from 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129) to 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131). New cstate: current_term: 2 leader_uuid: "293fa96e53fc447285b9eaec7ba3d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:52.689694  8523 consensus_queue.cc:1048] T 91a0bff862a5440f859cef65668de0ec P b29a30c058b24b799c64511edcc51af1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:52.694365  8225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee21df898e384d3993f352142b8595c1" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40136f5ac8c040d18bcea0a86211be68"
I20260709 13:16:52.694559  8299 leader_election.cc:290] T ee21df898e384d3993f352142b8595c1 P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 2 election: Requested vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131:36869)
I20260709 13:16:52.695093  8225 raft_consensus.cc:3060] T ee21df898e384d3993f352142b8595c1 P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:52.696017  8374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee21df898e384d3993f352142b8595c1" candidate_uuid: "b29a30c058b24b799c64511edcc51af1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "293fa96e53fc447285b9eaec7ba3d452"
I20260709 13:16:52.696535  8374 raft_consensus.cc:3055] T ee21df898e384d3993f352142b8595c1 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:52.696760  8374 raft_consensus.cc:740] T ee21df898e384d3993f352142b8595c1 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 293fa96e53fc447285b9eaec7ba3d452, State: Running, Role: LEADER
I20260709 13:16:52.697559  8374 consensus_queue.cc:260] T ee21df898e384d3993f352142b8595c1 P 293fa96e53fc447285b9eaec7ba3d452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:52.698688  8374 raft_consensus.cc:3060] T ee21df898e384d3993f352142b8595c1 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:52.708698  8225 raft_consensus.cc:2468] T ee21df898e384d3993f352142b8595c1 P 40136f5ac8c040d18bcea0a86211be68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b29a30c058b24b799c64511edcc51af1 in term 2.
I20260709 13:16:52.709049  8374 raft_consensus.cc:2468] T ee21df898e384d3993f352142b8595c1 P 293fa96e53fc447285b9eaec7ba3d452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b29a30c058b24b799c64511edcc51af1 in term 2.
I20260709 13:16:52.710806  8266 leader_election.cc:304] T ee21df898e384d3993f352142b8595c1 P b29a30c058b24b799c64511edcc51af1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293fa96e53fc447285b9eaec7ba3d452, b29a30c058b24b799c64511edcc51af1; no voters: 
I20260709 13:16:52.712049  8523 raft_consensus.cc:2804] T ee21df898e384d3993f352142b8595c1 P b29a30c058b24b799c64511edcc51af1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:52.712824  8523 raft_consensus.cc:697] T ee21df898e384d3993f352142b8595c1 P b29a30c058b24b799c64511edcc51af1 [term 2 LEADER]: Becoming Leader. State: Replica: b29a30c058b24b799c64511edcc51af1, State: Running, Role: LEADER
I20260709 13:16:52.713876  8523 consensus_queue.cc:237] T ee21df898e384d3993f352142b8595c1 P b29a30c058b24b799c64511edcc51af1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:52.717392  8448 consensus_queue.cc:1048] T 91a0bff862a5440f859cef65668de0ec P b29a30c058b24b799c64511edcc51af1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:52.724033  8125 catalog_manager.cc:5697] T ee21df898e384d3993f352142b8595c1 P b29a30c058b24b799c64511edcc51af1 reported cstate change: term changed from 1 to 2, leader changed from 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131) to b29a30c058b24b799c64511edcc51af1 (127.27.146.130). New cstate: current_term: 2 leader_uuid: "b29a30c058b24b799c64511edcc51af1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:52.927075  8372 raft_consensus.cc:1275] T d8170e37c2074b2ebeefa955aa74d678 P 293fa96e53fc447285b9eaec7ba3d452 [term 2 FOLLOWER]: Refusing update from remote peer b29a30c058b24b799c64511edcc51af1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:52.928794  8448 consensus_queue.cc:1048] T d8170e37c2074b2ebeefa955aa74d678 P b29a30c058b24b799c64511edcc51af1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:52.940104  8225 raft_consensus.cc:1275] T d8170e37c2074b2ebeefa955aa74d678 P 40136f5ac8c040d18bcea0a86211be68 [term 2 FOLLOWER]: Refusing update from remote peer b29a30c058b24b799c64511edcc51af1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:52.942337  8523 consensus_queue.cc:1048] T d8170e37c2074b2ebeefa955aa74d678 P b29a30c058b24b799c64511edcc51af1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:53.166685  8225 raft_consensus.cc:1275] T ee21df898e384d3993f352142b8595c1 P 40136f5ac8c040d18bcea0a86211be68 [term 2 FOLLOWER]: Refusing update from remote peer b29a30c058b24b799c64511edcc51af1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:53.168339  8523 consensus_queue.cc:1048] T ee21df898e384d3993f352142b8595c1 P b29a30c058b24b799c64511edcc51af1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:53.177002  8372 raft_consensus.cc:1275] T ee21df898e384d3993f352142b8595c1 P 293fa96e53fc447285b9eaec7ba3d452 [term 2 FOLLOWER]: Refusing update from remote peer b29a30c058b24b799c64511edcc51af1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:53.180483  8523 consensus_queue.cc:1048] T ee21df898e384d3993f352142b8595c1 P b29a30c058b24b799c64511edcc51af1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:53.187968  8225 raft_consensus.cc:1275] T 43cfc5b732654a7a9035a8f61d2c1c83 P 40136f5ac8c040d18bcea0a86211be68 [term 2 FOLLOWER]: Refusing update from remote peer 293fa96e53fc447285b9eaec7ba3d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:53.189982  8505 consensus_queue.cc:1048] T 43cfc5b732654a7a9035a8f61d2c1c83 P 293fa96e53fc447285b9eaec7ba3d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:53.206568  8299 raft_consensus.cc:1275] T 43cfc5b732654a7a9035a8f61d2c1c83 P b29a30c058b24b799c64511edcc51af1 [term 2 FOLLOWER]: Refusing update from remote peer 293fa96e53fc447285b9eaec7ba3d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:53.217566  8598 consensus_queue.cc:1048] T 43cfc5b732654a7a9035a8f61d2c1c83 P 293fa96e53fc447285b9eaec7ba3d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:55.463196  8123 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35432:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:16:55.487636  8123 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35432:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:16:55.565341  8631 tablet.cc:1724] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 40136f5ac8c040d18bcea0a86211be68: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:55.578199 28234 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:55.593096  8635 tablet.cc:1724] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 293fa96e53fc447285b9eaec7ba3d452: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:55.673795  8637 tablet.cc:1724] T b2ddf231a512421b954496fd121e3cb5 P 40136f5ac8c040d18bcea0a86211be68: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:16:55.701491  8266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 88993.4us
W20260709 13:16:55.707304  8619 log.cc:927] Time spent T a06df4e98ae74d568ce68a93bf8d8b65 P 40136f5ac8c040d18bcea0a86211be68: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
W20260709 13:16:55.819278  8193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.130:39155, user_credentials={real_user=slave}} blocked reactor thread for 46345.4us
W20260709 13:16:55.836922  8638 log.cc:927] Time spent T d8170e37c2074b2ebeefa955aa74d678 P b29a30c058b24b799c64511edcc51af1: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 13:16:55.856484  8640 log.cc:927] Time spent T 91a0bff862a5440f859cef65668de0ec P b29a30c058b24b799c64511edcc51af1: Append to log took a long time: real 0.149s	user 0.004s	sys 0.001s
I20260709 13:16:55.857534  8651 tablet.cc:1724] T ee21df898e384d3993f352142b8595c1 P b29a30c058b24b799c64511edcc51af1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:55.836889  8649 tablet.cc:1724] T fe87dab5958e4af6b02ec49bd36c1696 P 40136f5ac8c040d18bcea0a86211be68: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:55.887097  8657 tablet.cc:1724] T fe87dab5958e4af6b02ec49bd36c1696 P 293fa96e53fc447285b9eaec7ba3d452: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:55.903402  8635 tablet.cc:1724] T b2ddf231a512421b954496fd121e3cb5 P 293fa96e53fc447285b9eaec7ba3d452: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:55.922281  8662 tablet.cc:1724] T 43cfc5b732654a7a9035a8f61d2c1c83 P 293fa96e53fc447285b9eaec7ba3d452: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:55.925196  8637 tablet.cc:1724] T 43cfc5b732654a7a9035a8f61d2c1c83 P 40136f5ac8c040d18bcea0a86211be68: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:16:55.925277  8654 log.cc:927] Time spent T fe87dab5958e4af6b02ec49bd36c1696 P b29a30c058b24b799c64511edcc51af1: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:16:55.858450  8653 tablet.cc:1724] T b2ddf231a512421b954496fd121e3cb5 P b29a30c058b24b799c64511edcc51af1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:16:55.950255  8266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.146.129:43503, user_credentials={real_user=slave}} blocked reactor thread for 238232us
I20260709 13:16:55.960294  8631 tablet.cc:1724] T a06df4e98ae74d568ce68a93bf8d8b65 P 40136f5ac8c040d18bcea0a86211be68: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:55.942013  8651 tablet.cc:1724] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P b29a30c058b24b799c64511edcc51af1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:55.983656  8664 tablet.cc:1724] T a06df4e98ae74d568ce68a93bf8d8b65 P b29a30c058b24b799c64511edcc51af1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:56.008157  8666 tablet.cc:1724] T ee21df898e384d3993f352142b8595c1 P 40136f5ac8c040d18bcea0a86211be68: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:56.033911  8662 tablet.cc:1724] T ee21df898e384d3993f352142b8595c1 P 293fa96e53fc447285b9eaec7ba3d452: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:55.958658  8665 tablet.cc:1724] T fe87dab5958e4af6b02ec49bd36c1696 P b29a30c058b24b799c64511edcc51af1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:56.067466  8299 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc5215886f3d4f0eb3364d518fb846bc"
dest_uuid: "b29a30c058b24b799c64511edcc51af1"
mode: GRACEFUL
new_leader_uuid: "293fa96e53fc447285b9eaec7ba3d452"
 from {username='slave'} at 127.0.0.1:44372
I20260709 13:16:56.079376  8299 raft_consensus.cc:606] T bc5215886f3d4f0eb3364d518fb846bc P b29a30c058b24b799c64511edcc51af1 [term 2 LEADER]: Received request to transfer leadership to TS 293fa96e53fc447285b9eaec7ba3d452
I20260709 13:16:56.083722  8637 tablet.cc:1724] T 6a0e7ee47f18454283552529e1acea87 P 40136f5ac8c040d18bcea0a86211be68: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:56.098841  8649 tablet.cc:1724] T d8170e37c2074b2ebeefa955aa74d678 P 40136f5ac8c040d18bcea0a86211be68: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:56.127403  8635 tablet.cc:1724] T 6a0e7ee47f18454283552529e1acea87 P 293fa96e53fc447285b9eaec7ba3d452: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:56.133117  8653 tablet.cc:1724] T 6a0e7ee47f18454283552529e1acea87 P b29a30c058b24b799c64511edcc51af1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:56.132476  8669 tablet.cc:1724] T a06df4e98ae74d568ce68a93bf8d8b65 P 293fa96e53fc447285b9eaec7ba3d452: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:56.149837  8664 tablet.cc:1724] T d8170e37c2074b2ebeefa955aa74d678 P b29a30c058b24b799c64511edcc51af1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:56.150765  8631 tablet.cc:1724] T 91a0bff862a5440f859cef65668de0ec P 40136f5ac8c040d18bcea0a86211be68: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:56.157387  8657 tablet.cc:1724] T d8170e37c2074b2ebeefa955aa74d678 P 293fa96e53fc447285b9eaec7ba3d452: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:56.174221  8661 raft_consensus.cc:993] T bc5215886f3d4f0eb3364d518fb846bc P b29a30c058b24b799c64511edcc51af1: : Instructing follower 293fa96e53fc447285b9eaec7ba3d452 to start an election
I20260709 13:16:56.173501  8662 tablet.cc:1724] T 91a0bff862a5440f859cef65668de0ec P 293fa96e53fc447285b9eaec7ba3d452: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:56.174850  8661 raft_consensus.cc:1081] T bc5215886f3d4f0eb3364d518fb846bc P b29a30c058b24b799c64511edcc51af1 [term 2 LEADER]: Signalling peer 293fa96e53fc447285b9eaec7ba3d452 to start an election
I20260709 13:16:56.183647  8371 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc5215886f3d4f0eb3364d518fb846bc"
dest_uuid: "293fa96e53fc447285b9eaec7ba3d452"
 from {username='slave'} at 127.0.0.1:52400
I20260709 13:16:56.184423  8371 raft_consensus.cc:493] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:56.184891  8371 raft_consensus.cc:3060] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:56.209749  8224 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "caa758e90c4b498690b7598eb7b021a5"
dest_uuid: "40136f5ac8c040d18bcea0a86211be68"
mode: GRACEFUL
new_leader_uuid: "293fa96e53fc447285b9eaec7ba3d452"
 from {username='slave'} at 127.0.0.1:35950
I20260709 13:16:56.210558  8224 raft_consensus.cc:606] T caa758e90c4b498690b7598eb7b021a5 P 40136f5ac8c040d18bcea0a86211be68 [term 1 LEADER]: Received request to transfer leadership to TS 293fa96e53fc447285b9eaec7ba3d452
I20260709 13:16:56.213644 28234 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:16:56.214433 28234 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:56.215904  8651 tablet.cc:1724] T 43cfc5b732654a7a9035a8f61d2c1c83 P b29a30c058b24b799c64511edcc51af1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:56.217937  8371 raft_consensus.cc:515] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:56.220662  8371 leader_election.cc:290] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 3 election: Requested vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155)
I20260709 13:16:56.221797  8302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5215886f3d4f0eb3364d518fb846bc" candidate_uuid: "293fa96e53fc447285b9eaec7ba3d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b29a30c058b24b799c64511edcc51af1"
I20260709 13:16:56.222414  8302 raft_consensus.cc:3055] T bc5215886f3d4f0eb3364d518fb846bc P b29a30c058b24b799c64511edcc51af1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:56.222735  8302 raft_consensus.cc:740] T bc5215886f3d4f0eb3364d518fb846bc P b29a30c058b24b799c64511edcc51af1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b29a30c058b24b799c64511edcc51af1, State: Running, Role: LEADER
I20260709 13:16:56.223752  8302 consensus_queue.cc:260] T bc5215886f3d4f0eb3364d518fb846bc P b29a30c058b24b799c64511edcc51af1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:56.224953  8302 raft_consensus.cc:3060] T bc5215886f3d4f0eb3364d518fb846bc P b29a30c058b24b799c64511edcc51af1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:56.214934  8665 tablet.cc:1724] T 91a0bff862a5440f859cef65668de0ec P b29a30c058b24b799c64511edcc51af1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:16:56.221608  8224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5215886f3d4f0eb3364d518fb846bc" candidate_uuid: "293fa96e53fc447285b9eaec7ba3d452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "40136f5ac8c040d18bcea0a86211be68"
I20260709 13:16:56.231840  8224 raft_consensus.cc:3060] T bc5215886f3d4f0eb3364d518fb846bc P 40136f5ac8c040d18bcea0a86211be68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:56.250039  8302 raft_consensus.cc:2468] T bc5215886f3d4f0eb3364d518fb846bc P b29a30c058b24b799c64511edcc51af1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293fa96e53fc447285b9eaec7ba3d452 in term 3.
I20260709 13:16:56.250865  8224 raft_consensus.cc:2468] T bc5215886f3d4f0eb3364d518fb846bc P 40136f5ac8c040d18bcea0a86211be68 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293fa96e53fc447285b9eaec7ba3d452 in term 3.
I20260709 13:16:56.251935  8342 leader_election.cc:304] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293fa96e53fc447285b9eaec7ba3d452, b29a30c058b24b799c64511edcc51af1; no voters: 
I20260709 13:16:56.254088  8652 raft_consensus.cc:2804] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:56.254787  8652 raft_consensus.cc:697] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 [term 3 LEADER]: Becoming Leader. State: Replica: 293fa96e53fc447285b9eaec7ba3d452, State: Running, Role: LEADER
I20260709 13:16:56.255841  8652 consensus_queue.cc:237] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:56.298004  8122 catalog_manager.cc:6242] T 00000000000000000000000000000000 P c95545f8d2964094ab29b977e7a0efd4: soft_deleted_table [id=139434d8c2ac4ba2b214896a2cb21c24] alter complete (version 1)
I20260709 13:16:56.307632  8122 catalog_manager.cc:5697] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 reported cstate change: term changed from 2 to 3, leader changed from b29a30c058b24b799c64511edcc51af1 (127.27.146.130) to 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131). New cstate: current_term: 3 leader_uuid: "293fa96e53fc447285b9eaec7ba3d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:56.450871  8604 raft_consensus.cc:993] T caa758e90c4b498690b7598eb7b021a5 P 40136f5ac8c040d18bcea0a86211be68: : Instructing follower 293fa96e53fc447285b9eaec7ba3d452 to start an election
I20260709 13:16:56.451614  8604 raft_consensus.cc:1081] T caa758e90c4b498690b7598eb7b021a5 P 40136f5ac8c040d18bcea0a86211be68 [term 1 LEADER]: Signalling peer 293fa96e53fc447285b9eaec7ba3d452 to start an election
I20260709 13:16:56.453733  8371 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "caa758e90c4b498690b7598eb7b021a5"
dest_uuid: "293fa96e53fc447285b9eaec7ba3d452"
 from {username='slave'} at 127.0.0.1:52396
I20260709 13:16:56.454315  8371 raft_consensus.cc:493] T caa758e90c4b498690b7598eb7b021a5 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:56.454695  8371 raft_consensus.cc:3060] T caa758e90c4b498690b7598eb7b021a5 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.463085  8371 raft_consensus.cc:515] T caa758e90c4b498690b7598eb7b021a5 P 293fa96e53fc447285b9eaec7ba3d452 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:56.466050  8371 leader_election.cc:290] T caa758e90c4b498690b7598eb7b021a5 P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 2 election: Requested vote from peers 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503), b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155)
I20260709 13:16:56.467157  8224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa758e90c4b498690b7598eb7b021a5" candidate_uuid: "293fa96e53fc447285b9eaec7ba3d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40136f5ac8c040d18bcea0a86211be68"
I20260709 13:16:56.467870  8302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa758e90c4b498690b7598eb7b021a5" candidate_uuid: "293fa96e53fc447285b9eaec7ba3d452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b29a30c058b24b799c64511edcc51af1"
I20260709 13:16:56.468116  8224 raft_consensus.cc:3055] T caa758e90c4b498690b7598eb7b021a5 P 40136f5ac8c040d18bcea0a86211be68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:56.468560  8302 raft_consensus.cc:3060] T caa758e90c4b498690b7598eb7b021a5 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.468665  8224 raft_consensus.cc:740] T caa758e90c4b498690b7598eb7b021a5 P 40136f5ac8c040d18bcea0a86211be68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40136f5ac8c040d18bcea0a86211be68, State: Running, Role: LEADER
I20260709 13:16:56.470060  8224 consensus_queue.cc:260] T caa758e90c4b498690b7598eb7b021a5 P 40136f5ac8c040d18bcea0a86211be68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:56.471369  8224 raft_consensus.cc:3060] T caa758e90c4b498690b7598eb7b021a5 P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:56.478303  8302 raft_consensus.cc:2468] T caa758e90c4b498690b7598eb7b021a5 P b29a30c058b24b799c64511edcc51af1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293fa96e53fc447285b9eaec7ba3d452 in term 2.
I20260709 13:16:56.480103  8342 leader_election.cc:304] T caa758e90c4b498690b7598eb7b021a5 P 293fa96e53fc447285b9eaec7ba3d452 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293fa96e53fc447285b9eaec7ba3d452, b29a30c058b24b799c64511edcc51af1; no voters: 
I20260709 13:16:56.481135  8224 raft_consensus.cc:2468] T caa758e90c4b498690b7598eb7b021a5 P 40136f5ac8c040d18bcea0a86211be68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293fa96e53fc447285b9eaec7ba3d452 in term 2.
I20260709 13:16:56.481164  8652 raft_consensus.cc:2804] T caa758e90c4b498690b7598eb7b021a5 P 293fa96e53fc447285b9eaec7ba3d452 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:56.482414  8652 raft_consensus.cc:697] T caa758e90c4b498690b7598eb7b021a5 P 293fa96e53fc447285b9eaec7ba3d452 [term 2 LEADER]: Becoming Leader. State: Replica: 293fa96e53fc447285b9eaec7ba3d452, State: Running, Role: LEADER
I20260709 13:16:56.483613  8652 consensus_queue.cc:237] T caa758e90c4b498690b7598eb7b021a5 P 293fa96e53fc447285b9eaec7ba3d452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } }
I20260709 13:16:56.497359  8122 catalog_manager.cc:5697] T caa758e90c4b498690b7598eb7b021a5 P 293fa96e53fc447285b9eaec7ba3d452 reported cstate change: term changed from 1 to 2, leader changed from 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129) to 293fa96e53fc447285b9eaec7ba3d452 (127.27.146.131). New cstate: current_term: 2 leader_uuid: "293fa96e53fc447285b9eaec7ba3d452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293fa96e53fc447285b9eaec7ba3d452" member_type: VOTER last_known_addr { host: "127.27.146.131" port: 36869 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:56.838363  8224 raft_consensus.cc:1275] T bc5215886f3d4f0eb3364d518fb846bc P 40136f5ac8c040d18bcea0a86211be68 [term 3 FOLLOWER]: Refusing update from remote peer 293fa96e53fc447285b9eaec7ba3d452: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:56.840560  8652 consensus_queue.cc:1048] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:56.853874  8302 raft_consensus.cc:1275] T bc5215886f3d4f0eb3364d518fb846bc P b29a30c058b24b799c64511edcc51af1 [term 3 FOLLOWER]: Refusing update from remote peer 293fa96e53fc447285b9eaec7ba3d452: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:56.860303  8652 consensus_queue.cc:1048] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:16:56.946583  8224 raft_consensus.cc:1275] T caa758e90c4b498690b7598eb7b021a5 P 40136f5ac8c040d18bcea0a86211be68 [term 2 FOLLOWER]: Refusing update from remote peer 293fa96e53fc447285b9eaec7ba3d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:56.948338  8681 consensus_queue.cc:1048] T caa758e90c4b498690b7598eb7b021a5 P 293fa96e53fc447285b9eaec7ba3d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40136f5ac8c040d18bcea0a86211be68" member_type: VOTER last_known_addr { host: "127.27.146.129" port: 43503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:56.959910  8302 raft_consensus.cc:1275] T caa758e90c4b498690b7598eb7b021a5 P b29a30c058b24b799c64511edcc51af1 [term 2 FOLLOWER]: Refusing update from remote peer 293fa96e53fc447285b9eaec7ba3d452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:56.962067  8681 consensus_queue.cc:1048] T caa758e90c4b498690b7598eb7b021a5 P 293fa96e53fc447285b9eaec7ba3d452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b29a30c058b24b799c64511edcc51af1" member_type: VOTER last_known_addr { host: "127.27.146.130" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:57.299183 28234 tablet_server.cc:179] TabletServer@127.27.146.129:0 shutting down...
W20260709 13:16:57.304894  8340 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 10 similar messages]
W20260709 13:16:57.310341  8340 consensus_peers.cc:597] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 -> Peer 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503): Couldn't send request to peer 40136f5ac8c040d18bcea0a86211be68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:57.346134 28234 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:57.347350 28234 tablet_replica.cc:333] T 6a0e7ee47f18454283552529e1acea87 P 40136f5ac8c040d18bcea0a86211be68: stopping tablet replica
I20260709 13:16:57.348534 28234 raft_consensus.cc:2243] T 6a0e7ee47f18454283552529e1acea87 P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.349285 28234 raft_consensus.cc:2272] T 6a0e7ee47f18454283552529e1acea87 P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.352830 28234 tablet_replica.cc:333] T fe87dab5958e4af6b02ec49bd36c1696 P 40136f5ac8c040d18bcea0a86211be68: stopping tablet replica
I20260709 13:16:57.353649 28234 raft_consensus.cc:2243] T fe87dab5958e4af6b02ec49bd36c1696 P 40136f5ac8c040d18bcea0a86211be68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:57.354652 28234 raft_consensus.cc:2272] T fe87dab5958e4af6b02ec49bd36c1696 P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.357225 28234 tablet_replica.cc:333] T 43cfc5b732654a7a9035a8f61d2c1c83 P 40136f5ac8c040d18bcea0a86211be68: stopping tablet replica
I20260709 13:16:57.358047 28234 raft_consensus.cc:2243] T 43cfc5b732654a7a9035a8f61d2c1c83 P 40136f5ac8c040d18bcea0a86211be68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.358587 28234 raft_consensus.cc:2272] T 43cfc5b732654a7a9035a8f61d2c1c83 P 40136f5ac8c040d18bcea0a86211be68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.361956 28234 tablet_replica.cc:333] T a06df4e98ae74d568ce68a93bf8d8b65 P 40136f5ac8c040d18bcea0a86211be68: stopping tablet replica
I20260709 13:16:57.362772 28234 raft_consensus.cc:2243] T a06df4e98ae74d568ce68a93bf8d8b65 P 40136f5ac8c040d18bcea0a86211be68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:57.363770 28234 raft_consensus.cc:2272] T a06df4e98ae74d568ce68a93bf8d8b65 P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.366314 28234 tablet_replica.cc:333] T 91a0bff862a5440f859cef65668de0ec P 40136f5ac8c040d18bcea0a86211be68: stopping tablet replica
I20260709 13:16:57.367074 28234 raft_consensus.cc:2243] T 91a0bff862a5440f859cef65668de0ec P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.367668 28234 raft_consensus.cc:2272] T 91a0bff862a5440f859cef65668de0ec P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.371660 28234 tablet_replica.cc:333] T ee21df898e384d3993f352142b8595c1 P 40136f5ac8c040d18bcea0a86211be68: stopping tablet replica
I20260709 13:16:57.372474 28234 raft_consensus.cc:2243] T ee21df898e384d3993f352142b8595c1 P 40136f5ac8c040d18bcea0a86211be68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.373087 28234 raft_consensus.cc:2272] T ee21df898e384d3993f352142b8595c1 P 40136f5ac8c040d18bcea0a86211be68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.375892 28234 tablet_replica.cc:333] T b2ddf231a512421b954496fd121e3cb5 P 40136f5ac8c040d18bcea0a86211be68: stopping tablet replica
I20260709 13:16:57.376665 28234 raft_consensus.cc:2243] T b2ddf231a512421b954496fd121e3cb5 P 40136f5ac8c040d18bcea0a86211be68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:57.377772 28234 raft_consensus.cc:2272] T b2ddf231a512421b954496fd121e3cb5 P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.380565 28234 tablet_replica.cc:333] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 40136f5ac8c040d18bcea0a86211be68: stopping tablet replica
I20260709 13:16:57.381282 28234 raft_consensus.cc:2243] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 40136f5ac8c040d18bcea0a86211be68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:57.382215 28234 raft_consensus.cc:2272] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.386190 28234 tablet_replica.cc:333] T cd1da709c81d4c17a8308b204dca7be7 P 40136f5ac8c040d18bcea0a86211be68: stopping tablet replica
I20260709 13:16:57.387082 28234 raft_consensus.cc:2243] T cd1da709c81d4c17a8308b204dca7be7 P 40136f5ac8c040d18bcea0a86211be68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.387863 28234 raft_consensus.cc:2272] T cd1da709c81d4c17a8308b204dca7be7 P 40136f5ac8c040d18bcea0a86211be68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.391158 28234 tablet_replica.cc:333] T d8170e37c2074b2ebeefa955aa74d678 P 40136f5ac8c040d18bcea0a86211be68: stopping tablet replica
I20260709 13:16:57.392053 28234 raft_consensus.cc:2243] T d8170e37c2074b2ebeefa955aa74d678 P 40136f5ac8c040d18bcea0a86211be68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.392683 28234 raft_consensus.cc:2272] T d8170e37c2074b2ebeefa955aa74d678 P 40136f5ac8c040d18bcea0a86211be68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.396095 28234 tablet_replica.cc:333] T a7bad7246022445bb86fa0f48a3afd6f P 40136f5ac8c040d18bcea0a86211be68: stopping tablet replica
I20260709 13:16:57.397255 28234 raft_consensus.cc:2243] T a7bad7246022445bb86fa0f48a3afd6f P 40136f5ac8c040d18bcea0a86211be68 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:57.398746 28234 raft_consensus.cc:2272] T a7bad7246022445bb86fa0f48a3afd6f P 40136f5ac8c040d18bcea0a86211be68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.402590 28234 tablet_replica.cc:333] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 40136f5ac8c040d18bcea0a86211be68: stopping tablet replica
I20260709 13:16:57.403586 28234 raft_consensus.cc:2243] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 40136f5ac8c040d18bcea0a86211be68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.404353 28234 raft_consensus.cc:2272] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 40136f5ac8c040d18bcea0a86211be68 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:57.405135  8340 consensus_peers.cc:597] T 43cfc5b732654a7a9035a8f61d2c1c83 P 293fa96e53fc447285b9eaec7ba3d452 -> Peer 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503): Couldn't send request to peer 40136f5ac8c040d18bcea0a86211be68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:57.408098 28234 tablet_replica.cc:333] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 40136f5ac8c040d18bcea0a86211be68: stopping tablet replica
I20260709 13:16:57.408993 28234 raft_consensus.cc:2243] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 40136f5ac8c040d18bcea0a86211be68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.409631 28234 raft_consensus.cc:2272] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 40136f5ac8c040d18bcea0a86211be68 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:57.409643  8266 consensus_peers.cc:597] T 6cfddc3bdd0b4550b4672e0cf720cd39 P b29a30c058b24b799c64511edcc51af1 -> Peer 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503): Couldn't send request to peer 40136f5ac8c040d18bcea0a86211be68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:57.413054 28234 tablet_replica.cc:333] T b39ad7757ad748238fab733ef5360084 P 40136f5ac8c040d18bcea0a86211be68: stopping tablet replica
W20260709 13:16:57.413762  8340 consensus_peers.cc:597] T caa758e90c4b498690b7598eb7b021a5 P 293fa96e53fc447285b9eaec7ba3d452 -> Peer 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503): Couldn't send request to peer 40136f5ac8c040d18bcea0a86211be68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:57.413868 28234 raft_consensus.cc:2243] T b39ad7757ad748238fab733ef5360084 P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.414824 28234 raft_consensus.cc:2272] T b39ad7757ad748238fab733ef5360084 P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.417598 28234 tablet_replica.cc:333] T caa758e90c4b498690b7598eb7b021a5 P 40136f5ac8c040d18bcea0a86211be68: stopping tablet replica
I20260709 13:16:57.418533 28234 raft_consensus.cc:2243] T caa758e90c4b498690b7598eb7b021a5 P 40136f5ac8c040d18bcea0a86211be68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.419337 28234 raft_consensus.cc:2272] T caa758e90c4b498690b7598eb7b021a5 P 40136f5ac8c040d18bcea0a86211be68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.422873 28234 tablet_replica.cc:333] T bc5215886f3d4f0eb3364d518fb846bc P 40136f5ac8c040d18bcea0a86211be68: stopping tablet replica
I20260709 13:16:57.423655 28234 raft_consensus.cc:2243] T bc5215886f3d4f0eb3364d518fb846bc P 40136f5ac8c040d18bcea0a86211be68 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.424446 28234 raft_consensus.cc:2272] T bc5215886f3d4f0eb3364d518fb846bc P 40136f5ac8c040d18bcea0a86211be68 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.427843 28234 tablet_replica.cc:333] T c346f6db2c27498fbf2e803ac5a47629 P 40136f5ac8c040d18bcea0a86211be68: stopping tablet replica
I20260709 13:16:57.428926 28234 raft_consensus.cc:2243] T c346f6db2c27498fbf2e803ac5a47629 P 40136f5ac8c040d18bcea0a86211be68 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:57.430342 28234 raft_consensus.cc:2272] T c346f6db2c27498fbf2e803ac5a47629 P 40136f5ac8c040d18bcea0a86211be68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.433027 28234 tablet_replica.cc:333] T 8c22e7a7140249b2a7e0e7250fa6c63d P 40136f5ac8c040d18bcea0a86211be68: stopping tablet replica
I20260709 13:16:57.433682 28234 raft_consensus.cc:2243] T 8c22e7a7140249b2a7e0e7250fa6c63d P 40136f5ac8c040d18bcea0a86211be68 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:57.434695 28234 raft_consensus.cc:2272] T 8c22e7a7140249b2a7e0e7250fa6c63d P 40136f5ac8c040d18bcea0a86211be68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.486850 28234 tablet_server.cc:196] TabletServer@127.27.146.129:0 shutdown complete.
W20260709 13:16:57.525498  8266 consensus_peers.cc:597] T b39ad7757ad748238fab733ef5360084 P b29a30c058b24b799c64511edcc51af1 -> Peer 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503): Couldn't send request to peer 40136f5ac8c040d18bcea0a86211be68. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:43503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:57.525985 28234 tablet_server.cc:179] TabletServer@127.27.146.130:0 shutting down...
W20260709 13:16:57.554797  8266 consensus_peers.cc:597] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P b29a30c058b24b799c64511edcc51af1 -> Peer 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503): Couldn't send request to peer 40136f5ac8c040d18bcea0a86211be68. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:43503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:57.568634 28234 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:57.569770 28234 tablet_replica.cc:333] T 6a0e7ee47f18454283552529e1acea87 P b29a30c058b24b799c64511edcc51af1: stopping tablet replica
I20260709 13:16:57.570621 28234 raft_consensus.cc:2243] T 6a0e7ee47f18454283552529e1acea87 P b29a30c058b24b799c64511edcc51af1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:57.571791 28234 raft_consensus.cc:2272] T 6a0e7ee47f18454283552529e1acea87 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.574566 28234 tablet_replica.cc:333] T ee21df898e384d3993f352142b8595c1 P b29a30c058b24b799c64511edcc51af1: stopping tablet replica
I20260709 13:16:57.575300 28234 raft_consensus.cc:2243] T ee21df898e384d3993f352142b8595c1 P b29a30c058b24b799c64511edcc51af1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:57.576287 28234 raft_consensus.cc:2272] T ee21df898e384d3993f352142b8595c1 P b29a30c058b24b799c64511edcc51af1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.579095 28234 tablet_replica.cc:333] T b2ddf231a512421b954496fd121e3cb5 P b29a30c058b24b799c64511edcc51af1: stopping tablet replica
I20260709 13:16:57.579914 28234 raft_consensus.cc:2243] T b2ddf231a512421b954496fd121e3cb5 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.580483 28234 raft_consensus.cc:2272] T b2ddf231a512421b954496fd121e3cb5 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.582875 28234 tablet_replica.cc:333] T 43cfc5b732654a7a9035a8f61d2c1c83 P b29a30c058b24b799c64511edcc51af1: stopping tablet replica
I20260709 13:16:57.583555 28234 raft_consensus.cc:2243] T 43cfc5b732654a7a9035a8f61d2c1c83 P b29a30c058b24b799c64511edcc51af1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.584697 28234 raft_consensus.cc:2272] T 43cfc5b732654a7a9035a8f61d2c1c83 P b29a30c058b24b799c64511edcc51af1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.587672 28234 tablet_replica.cc:333] T 91a0bff862a5440f859cef65668de0ec P b29a30c058b24b799c64511edcc51af1: stopping tablet replica
I20260709 13:16:57.588392 28234 raft_consensus.cc:2243] T 91a0bff862a5440f859cef65668de0ec P b29a30c058b24b799c64511edcc51af1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:57.589392 28234 raft_consensus.cc:2272] T 91a0bff862a5440f859cef65668de0ec P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.592085 28234 tablet_replica.cc:333] T a06df4e98ae74d568ce68a93bf8d8b65 P b29a30c058b24b799c64511edcc51af1: stopping tablet replica
I20260709 13:16:57.592818 28234 raft_consensus.cc:2243] T a06df4e98ae74d568ce68a93bf8d8b65 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.593604 28234 raft_consensus.cc:2272] T a06df4e98ae74d568ce68a93bf8d8b65 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.596565 28234 tablet_replica.cc:333] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P b29a30c058b24b799c64511edcc51af1: stopping tablet replica
I20260709 13:16:57.597332 28234 raft_consensus.cc:2243] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.597976 28234 raft_consensus.cc:2272] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.601142 28234 tablet_replica.cc:333] T cd1da709c81d4c17a8308b204dca7be7 P b29a30c058b24b799c64511edcc51af1: stopping tablet replica
I20260709 13:16:57.602185 28234 raft_consensus.cc:2243] T cd1da709c81d4c17a8308b204dca7be7 P b29a30c058b24b799c64511edcc51af1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.603125 28234 raft_consensus.cc:2272] T cd1da709c81d4c17a8308b204dca7be7 P b29a30c058b24b799c64511edcc51af1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.605778 28234 tablet_replica.cc:333] T c346f6db2c27498fbf2e803ac5a47629 P b29a30c058b24b799c64511edcc51af1: stopping tablet replica
I20260709 13:16:57.606565 28234 raft_consensus.cc:2243] T c346f6db2c27498fbf2e803ac5a47629 P b29a30c058b24b799c64511edcc51af1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.607154 28234 raft_consensus.cc:2272] T c346f6db2c27498fbf2e803ac5a47629 P b29a30c058b24b799c64511edcc51af1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.609856 28234 tablet_replica.cc:333] T fe87dab5958e4af6b02ec49bd36c1696 P b29a30c058b24b799c64511edcc51af1: stopping tablet replica
I20260709 13:16:57.610548 28234 raft_consensus.cc:2243] T fe87dab5958e4af6b02ec49bd36c1696 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.611145 28234 raft_consensus.cc:2272] T fe87dab5958e4af6b02ec49bd36c1696 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.613772 28234 tablet_replica.cc:333] T 8c22e7a7140249b2a7e0e7250fa6c63d P b29a30c058b24b799c64511edcc51af1: stopping tablet replica
I20260709 13:16:57.614655 28234 raft_consensus.cc:2243] T 8c22e7a7140249b2a7e0e7250fa6c63d P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.616055 28234 raft_consensus.cc:2272] T 8c22e7a7140249b2a7e0e7250fa6c63d P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.620168 28234 tablet_replica.cc:333] T d8170e37c2074b2ebeefa955aa74d678 P b29a30c058b24b799c64511edcc51af1: stopping tablet replica
I20260709 13:16:57.620885 28234 raft_consensus.cc:2243] T d8170e37c2074b2ebeefa955aa74d678 P b29a30c058b24b799c64511edcc51af1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:57.621721 28234 raft_consensus.cc:2272] T d8170e37c2074b2ebeefa955aa74d678 P b29a30c058b24b799c64511edcc51af1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.624177 28234 tablet_replica.cc:333] T a7bad7246022445bb86fa0f48a3afd6f P b29a30c058b24b799c64511edcc51af1: stopping tablet replica
I20260709 13:16:57.624819 28234 raft_consensus.cc:2243] T a7bad7246022445bb86fa0f48a3afd6f P b29a30c058b24b799c64511edcc51af1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.625384 28234 raft_consensus.cc:2272] T a7bad7246022445bb86fa0f48a3afd6f P b29a30c058b24b799c64511edcc51af1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.628363 28234 tablet_replica.cc:333] T 6cfddc3bdd0b4550b4672e0cf720cd39 P b29a30c058b24b799c64511edcc51af1: stopping tablet replica
I20260709 13:16:57.629020 28234 raft_consensus.cc:2243] T 6cfddc3bdd0b4550b4672e0cf720cd39 P b29a30c058b24b799c64511edcc51af1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:57.630048 28234 raft_consensus.cc:2272] T 6cfddc3bdd0b4550b4672e0cf720cd39 P b29a30c058b24b799c64511edcc51af1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.633219 28234 tablet_replica.cc:333] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P b29a30c058b24b799c64511edcc51af1: stopping tablet replica
I20260709 13:16:57.634428 28234 raft_consensus.cc:2243] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P b29a30c058b24b799c64511edcc51af1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:57.635553 28234 raft_consensus.cc:2272] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P b29a30c058b24b799c64511edcc51af1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.638538 28234 tablet_replica.cc:333] T caa758e90c4b498690b7598eb7b021a5 P b29a30c058b24b799c64511edcc51af1: stopping tablet replica
I20260709 13:16:57.639304 28234 raft_consensus.cc:2243] T caa758e90c4b498690b7598eb7b021a5 P b29a30c058b24b799c64511edcc51af1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.639940 28234 raft_consensus.cc:2272] T caa758e90c4b498690b7598eb7b021a5 P b29a30c058b24b799c64511edcc51af1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.643631 28234 tablet_replica.cc:333] T b39ad7757ad748238fab733ef5360084 P b29a30c058b24b799c64511edcc51af1: stopping tablet replica
I20260709 13:16:57.644289 28234 raft_consensus.cc:2243] T b39ad7757ad748238fab733ef5360084 P b29a30c058b24b799c64511edcc51af1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:57.645475 28234 raft_consensus.cc:2272] T b39ad7757ad748238fab733ef5360084 P b29a30c058b24b799c64511edcc51af1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.648046 28234 tablet_replica.cc:333] T bc5215886f3d4f0eb3364d518fb846bc P b29a30c058b24b799c64511edcc51af1: stopping tablet replica
I20260709 13:16:57.648536 28234 raft_consensus.cc:2243] T bc5215886f3d4f0eb3364d518fb846bc P b29a30c058b24b799c64511edcc51af1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.648970 28234 raft_consensus.cc:2272] T bc5215886f3d4f0eb3364d518fb846bc P b29a30c058b24b799c64511edcc51af1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.701584 28234 tablet_server.cc:196] TabletServer@127.27.146.130:0 shutdown complete.
W20260709 13:16:57.729557  8340 consensus_peers.cc:597] T cd1da709c81d4c17a8308b204dca7be7 P 293fa96e53fc447285b9eaec7ba3d452 -> Peer 40136f5ac8c040d18bcea0a86211be68 (127.27.146.129:43503): Couldn't send request to peer 40136f5ac8c040d18bcea0a86211be68. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.129:43503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:57.737872  8342 consensus_peers.cc:597] T 43cfc5b732654a7a9035a8f61d2c1c83 P 293fa96e53fc447285b9eaec7ba3d452 -> Peer b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155): Couldn't send request to peer b29a30c058b24b799c64511edcc51af1. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:39155: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:57.756565 28234 tablet_server.cc:179] TabletServer@127.27.146.131:0 shutting down...
W20260709 13:16:57.765951  8342 consensus_peers.cc:597] T cd1da709c81d4c17a8308b204dca7be7 P 293fa96e53fc447285b9eaec7ba3d452 -> Peer b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155): Couldn't send request to peer b29a30c058b24b799c64511edcc51af1. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:39155: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:57.813036 28234 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:57.813964 28234 tablet_replica.cc:333] T fe87dab5958e4af6b02ec49bd36c1696 P 293fa96e53fc447285b9eaec7ba3d452: stopping tablet replica
I20260709 13:16:57.814757 28234 raft_consensus.cc:2243] T fe87dab5958e4af6b02ec49bd36c1696 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.815330 28234 raft_consensus.cc:2272] T fe87dab5958e4af6b02ec49bd36c1696 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.817593 28234 tablet_replica.cc:333] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 293fa96e53fc447285b9eaec7ba3d452: stopping tablet replica
I20260709 13:16:57.818128 28234 raft_consensus.cc:2243] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.818531 28234 raft_consensus.cc:2272] T fd73e7ced65b4e0d9c0c447d6a73d9f9 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.820541 28234 tablet_replica.cc:333] T 6a0e7ee47f18454283552529e1acea87 P 293fa96e53fc447285b9eaec7ba3d452: stopping tablet replica
I20260709 13:16:57.821056 28234 raft_consensus.cc:2243] T 6a0e7ee47f18454283552529e1acea87 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.821492 28234 raft_consensus.cc:2272] T 6a0e7ee47f18454283552529e1acea87 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.823318 28234 tablet_replica.cc:333] T ee21df898e384d3993f352142b8595c1 P 293fa96e53fc447285b9eaec7ba3d452: stopping tablet replica
I20260709 13:16:57.823943 28234 raft_consensus.cc:2243] T ee21df898e384d3993f352142b8595c1 P 293fa96e53fc447285b9eaec7ba3d452 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.824353 28234 raft_consensus.cc:2272] T ee21df898e384d3993f352142b8595c1 P 293fa96e53fc447285b9eaec7ba3d452 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.826184 28234 tablet_replica.cc:333] T b2ddf231a512421b954496fd121e3cb5 P 293fa96e53fc447285b9eaec7ba3d452: stopping tablet replica
I20260709 13:16:57.826709 28234 raft_consensus.cc:2243] T b2ddf231a512421b954496fd121e3cb5 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.827090 28234 raft_consensus.cc:2272] T b2ddf231a512421b954496fd121e3cb5 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.829036 28234 tablet_replica.cc:333] T 91a0bff862a5440f859cef65668de0ec P 293fa96e53fc447285b9eaec7ba3d452: stopping tablet replica
I20260709 13:16:57.829707 28234 raft_consensus.cc:2243] T 91a0bff862a5440f859cef65668de0ec P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.830098 28234 raft_consensus.cc:2272] T 91a0bff862a5440f859cef65668de0ec P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.832211 28234 tablet_replica.cc:333] T 43cfc5b732654a7a9035a8f61d2c1c83 P 293fa96e53fc447285b9eaec7ba3d452: stopping tablet replica
I20260709 13:16:57.832715 28234 raft_consensus.cc:2243] T 43cfc5b732654a7a9035a8f61d2c1c83 P 293fa96e53fc447285b9eaec7ba3d452 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:57.833642 28234 raft_consensus.cc:2272] T 43cfc5b732654a7a9035a8f61d2c1c83 P 293fa96e53fc447285b9eaec7ba3d452 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.836334 28234 tablet_replica.cc:333] T a06df4e98ae74d568ce68a93bf8d8b65 P 293fa96e53fc447285b9eaec7ba3d452: stopping tablet replica
I20260709 13:16:57.836850 28234 raft_consensus.cc:2243] T a06df4e98ae74d568ce68a93bf8d8b65 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.837275 28234 raft_consensus.cc:2272] T a06df4e98ae74d568ce68a93bf8d8b65 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.839237 28234 tablet_replica.cc:333] T d8170e37c2074b2ebeefa955aa74d678 P 293fa96e53fc447285b9eaec7ba3d452: stopping tablet replica
I20260709 13:16:57.839895 28234 raft_consensus.cc:2243] T d8170e37c2074b2ebeefa955aa74d678 P 293fa96e53fc447285b9eaec7ba3d452 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.840319 28234 raft_consensus.cc:2272] T d8170e37c2074b2ebeefa955aa74d678 P 293fa96e53fc447285b9eaec7ba3d452 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.842175 28234 tablet_replica.cc:333] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 293fa96e53fc447285b9eaec7ba3d452: stopping tablet replica
I20260709 13:16:57.842661 28234 raft_consensus.cc:2243] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 293fa96e53fc447285b9eaec7ba3d452 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.843086 28234 raft_consensus.cc:2272] T 6cfddc3bdd0b4550b4672e0cf720cd39 P 293fa96e53fc447285b9eaec7ba3d452 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.845661 28234 tablet_replica.cc:333] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 293fa96e53fc447285b9eaec7ba3d452: stopping tablet replica
I20260709 13:16:57.846201 28234 raft_consensus.cc:2243] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 293fa96e53fc447285b9eaec7ba3d452 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.846630 28234 raft_consensus.cc:2272] T 79bac7eaf2b54d5ebb8697bde03f3ea9 P 293fa96e53fc447285b9eaec7ba3d452 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.848714 28234 tablet_replica.cc:333] T a7bad7246022445bb86fa0f48a3afd6f P 293fa96e53fc447285b9eaec7ba3d452: stopping tablet replica
I20260709 13:16:57.849215 28234 raft_consensus.cc:2243] T a7bad7246022445bb86fa0f48a3afd6f P 293fa96e53fc447285b9eaec7ba3d452 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.849619 28234 raft_consensus.cc:2272] T a7bad7246022445bb86fa0f48a3afd6f P 293fa96e53fc447285b9eaec7ba3d452 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.851990 28234 tablet_replica.cc:333] T c346f6db2c27498fbf2e803ac5a47629 P 293fa96e53fc447285b9eaec7ba3d452: stopping tablet replica
I20260709 13:16:57.852834 28234 raft_consensus.cc:2243] T c346f6db2c27498fbf2e803ac5a47629 P 293fa96e53fc447285b9eaec7ba3d452 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.853448 28234 raft_consensus.cc:2272] T c346f6db2c27498fbf2e803ac5a47629 P 293fa96e53fc447285b9eaec7ba3d452 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.855708 28234 tablet_replica.cc:333] T cd1da709c81d4c17a8308b204dca7be7 P 293fa96e53fc447285b9eaec7ba3d452: stopping tablet replica
I20260709 13:16:57.856199 28234 raft_consensus.cc:2243] T cd1da709c81d4c17a8308b204dca7be7 P 293fa96e53fc447285b9eaec7ba3d452 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:57.856981 28234 raft_consensus.cc:2272] T cd1da709c81d4c17a8308b204dca7be7 P 293fa96e53fc447285b9eaec7ba3d452 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.859200 28234 tablet_replica.cc:333] T 8c22e7a7140249b2a7e0e7250fa6c63d P 293fa96e53fc447285b9eaec7ba3d452: stopping tablet replica
I20260709 13:16:57.859843 28234 raft_consensus.cc:2243] T 8c22e7a7140249b2a7e0e7250fa6c63d P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.860630 28234 raft_consensus.cc:2272] T 8c22e7a7140249b2a7e0e7250fa6c63d P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.863052 28234 tablet_replica.cc:333] T caa758e90c4b498690b7598eb7b021a5 P 293fa96e53fc447285b9eaec7ba3d452: stopping tablet replica
I20260709 13:16:57.863737 28234 raft_consensus.cc:2243] T caa758e90c4b498690b7598eb7b021a5 P 293fa96e53fc447285b9eaec7ba3d452 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:57.864568 28234 raft_consensus.cc:2272] T caa758e90c4b498690b7598eb7b021a5 P 293fa96e53fc447285b9eaec7ba3d452 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.868868 28234 tablet_replica.cc:333] T b39ad7757ad748238fab733ef5360084 P 293fa96e53fc447285b9eaec7ba3d452: stopping tablet replica
I20260709 13:16:57.869728 28234 raft_consensus.cc:2243] T b39ad7757ad748238fab733ef5360084 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:57.870404 28234 raft_consensus.cc:2272] T b39ad7757ad748238fab733ef5360084 P 293fa96e53fc447285b9eaec7ba3d452 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:57.872594  8342 consensus_peers.cc:597] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 -> Peer b29a30c058b24b799c64511edcc51af1 (127.27.146.130:39155): Couldn't send request to peer b29a30c058b24b799c64511edcc51af1. Status: Network error: Client connection negotiation failed: client connection to 127.27.146.130:39155: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:57.873201 28234 tablet_replica.cc:333] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452: stopping tablet replica
I20260709 13:16:57.873720 28234 raft_consensus.cc:2243] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:57.874534 28234 raft_consensus.cc:2272] T bc5215886f3d4f0eb3364d518fb846bc P 293fa96e53fc447285b9eaec7ba3d452 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:57.923812 28234 tablet_server.cc:196] TabletServer@127.27.146.131:0 shutdown complete.
I20260709 13:16:57.970813 28234 master.cc:562] Master@127.27.146.190:41839 shutting down...
I20260709 13:16:58.001338 28234 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c95545f8d2964094ab29b977e7a0efd4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:58.001947 28234 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c95545f8d2964094ab29b977e7a0efd4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:58.002318 28234 tablet_replica.cc:333] T 00000000000000000000000000000000 P c95545f8d2964094ab29b977e7a0efd4: stopping tablet replica
I20260709 13:16:58.024729 28234 master.cc:584] Master@127.27.146.190:41839 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (12159 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (26050 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (369259 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 13:16:58.085963 28234 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 441 messages since previous log ~15 seconds ago
I20260709 13:16:58.086465 28234 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 441 messages since previous log ~15 seconds ago
I20260709 13:16:58.086850 28234 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 437 messages since previous log ~15 seconds ago
I20260709 13:16:58.087126 28234 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~35 seconds ago
I20260709 13:16:58.087340 28234 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~35 seconds ago
I20260709 13:16:58.087620 28234 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 1 messages since previous log ~162 seconds ago
I20260709 13:16:58.087941 28234 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 10 messages since previous log ~0 seconds ago
I20260709 13:16:58.088276 28234 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~11 seconds ago
